The logit lens can be deceptive if not used properly

The content of this short post will be already obvious to many researchers, but it&apos;s still worth writing out explicitly, especially when I see some assumptions that newer researchers are making. Tldr : The logit lens is a convenient way to investigate internal representations. But it can be misleading,