KV Cache Compaction and Compression: From Attention Sinks to Learned Memory

A code-first guide to KV cache compression: why the cache dominates long-context serving, how token-eviction methods work, and how Cartridges and STILL turn compact KV tensors into reusable memory.