[Link] Circuit Tracing: Revealing Computational Graphs in Language Models

A group of Anthropic-affiliated scientists has released a paper where they study how human concepts are represented across Claude 3.5 Haiku's neurons and how these features interact to produce model outputs. This is a specially difficult task since these concepts are not contained within a single neuron. Neurons are polysemantic , meaning that they encode multiple unrelated concepts in its…