The Reverse Engineer's Guide to Mechanistic Interpretability

We reverse engineer a neural network the only way we know how: by writing the world's worst interpretability tool from scratch in Go, and pointing it at GPT-2's memory.