LLMs, from the Beginning — Part 3: Breaking the One-Token Barrier

Connect arithmetic intensity, continuous batching, sparse experts, and speculative decoding to the latency each user feels.