How Attention Actually Works

I gave a talk to my team about how LLMs work under the hood. This is that talk turned into a blog post. There are three parts planned. This first one is about attention.