The new interpreter

Andrej Karpathy has a useful framing for what shifted. We moved from handwritten code fed to a compiler to context fed to a much more general interpreter. The context window is the program and the AI is the interpreter. The interpreter is new. The cost of producing plausible programs collapsed because the new interpreter is vastly more general than a compiler. But if the program is now a prompt…