Gemma 4 26B QAT + MTP: 100 tok/s Local MoE on 12GB VRAM

Google's release of the QAT (Quantization-Aware Training) variants of Gemma 4 has changed the game for local inference on consumer hardware. By combining QAT with MTP (Multi-Token Prediction) , we can now run the heavy Gemma 4 26B MoE model at over 100 tokens/second on a single 12GB GPU. Here is a performance breakdown comparing various configurations on a consumer RTX 4070 setup. Performance…