The Attention Head

What is an attention head, and how would you prove one does what you think it does? A from-zero walk through a single head in GPT-2 small: what it reads, what it writes, the copying behavior you can watch in its attention map, and why that picture is the weakest evidence there is — with logit attribution and ablation as the stronger tests.