Google TurboQuant: 6x KV Cache Compression, AI Inference Memory Cost Inflection Point
Google releases TurboQuant, a two-stage KV cache compression algorithm (PolarQuant + QJL) achieving 6x memory reduction (3-bit quantization) and 8x attention speedup with no measurable accuracy loss. The announcement triggered a sell-off in memory stocks (Micron -3%, Western Digital -4.7%), signaling a potential structural shift in AI inference memory demand.
