The Evolution of LLMs: From GPT-2 to Kimi K3

From GPT-2's 1.5B parameters to Kimi K3's hybrid memory architecture — a deep dive into 7 years of LLM evolution, and why the biggest breakthroughs had surprisingly little to do with making models bigger.