Project Write-Up
NLAs make things up 40% of the time, and their own confidence can't tell Anthropic's Natural Language Autoencoders read a model's internal state and describe in plain English what it's thinking. People are starting to use them to audit models, including for whether a model is hiding something. The problem, which Anthropic states openly, is that they confabulate: they assert specific things that…