Catapulting into Causal Calculus
How do you “do-”?
Scott H. Hawley
My blog about code, physics, and ideas
Latest posts
Factorizing Softly
Learning “soft-separable” directions in latent space as an alternative to explicit factorization.
Noticing a Pattern
Classification as Pattern Recognition
Flow Where You Want
Adding Inference Controls to Pretrained (Latent) Flow Models
Flow With What You Know
Basic physics provides a “straight, fast” way to get up to speed with flow-based generative models
Understanding Transformers, Part 2: Wee Music Box
Toy Transformer Tunes
To Understand Transformers, Focus on Attention
If you can get this one thing, the rest will make sense.
Residual Vector Quantization
An exploration of the heart of neural audio codecs
BYOL - Contrastive Representation Learning without Contrastive Losses
Now that we understand contrastive losses and what they’re good for – let’s get rid of them!
Shell Volumes and Distances in High-Dimensional Spaces
Given enough dimensions, does it really matter which distance norm you use?
Likelihood of Vector Orthogonality in High-Dimensional Spaces
Depends on whether you’re using unit vectors or not.
Learning Some Geometric/Clifford Algebra
Clifford algebra isn’t so scary
Handy Bash Functions for ML & Data Science
Once I figure out a complicated command, I make a bash function for it
Typical (Neural-Network-Based) Classification vs. Zero-Shot, Part 3 - Live Demo of CL Toy
Triplet Loss kicks butt
Typical (NN-Based) Classification vs. Zero-Shot, Part 2 - An Example Using FastAI
With my new data-visualization Callback!
Typical (Neural-Network-Based) Classification vs. Zero-Shot, Part 1 - The Joy of 3D
Visualizations in 3 (and 4) dimensions
Scottergories: Making GPT-3 Generate 3 of a Kind
In which we test GPT-3’s ability to generate members of a category
Naughty by Numbers: Classifications at Christmas
A snarky interactive lesson on classification and surveillance
Citations in Fastpages via BibTeX and jekyll-scholar
Supporting scholarly blogging by drawing references from your database.
Mac => Linux Switch Notes
Mac and I aren’t breaking up, we’re just seeing other people.