TurboQuant and Vector Quantization: From Shannon to KV Cache Compression Google Research recently published a blog post titled TurboQuant: Redefining AI efficiency with extreme compression . It describes a set of three algorithms, QJL, PolarQuant, and TurboQuant, that together achieve 3-bit KV cache compression with zero accuracy loss. At 4 bits, TurboQuant shows up to 8x speedup in computing the…