One Layer, +12%: What 667 Configs Reveal About Small LLM Anatomy

I ve been messing around with local LLMs on my 3090 for a while now I have a growing collection of Qwen models on D:\LLM that I probably should be embarrassed about. A few weeks ago I stumbled across David Noel Ng s LLM Neuroanatomy blog posts, where he showed that you can take a pretrained [ ]