Why not sparse?

I was talking with a colleague the other day about the current industry trend to focus so much on further quantizing today's LLM models. I'm sure the reasons for pursuing quantization are apparent to most people who work in this industry: going from BF16 to FP8 or NVFP4 nets what amounts to a nearly 2x or 4x reduction in memory requirements and often a similar speedup. But I can't shake the…