Building on Jagged Intelligence

The debate over whether language models can genuinely reason has been burning for a while now. Gary Marcus put it this way: "LLM 'reasoning' is so cooked they turned my name into a verb." Karpathy has a word for what Marcus is reacting to. He calls it jagged intelligence : "The word I came up with to describe the (strange, unintuitive) fact that state-of-the-art LLMs can both perform extremely…