How LLMs Work, Part 2: How LLMs Learn In Part 1 , I covered tokenization and the forward pass: how text becomes numbers, and how those numbers flow through a transformer to produce predictions. But a model with random parameters makes random predictions. It needs to learn. In this article, we will explore the loss function that measures how wrong the model is, backpropagation that computes…