The local shape of LLM stable regions

Most of the time at inference, the Fisher pullback through the unembedding tells you exactly how far you can perturb the residual stream before the predictive distribution moves — and it's literally the second-order Taylor expansion of KL.