Running Gemma 4 MTP locally on 12GB VRAM

Update (May 20, 2026) : Gemma 4 MTP support has arrived in mainline llama.cpp via PR #23398 ! We are no longer dependent on the atomic-llama-cpp-turboquant fork. Update (May 21, 2026) : Successfully benchmarked Gemma 4 26B-A4B MTP on mainline llama.cpp using PR #23398 . On a 12GB RTX 4070, the mainline PR achieves ~52.4 tok/s (with f16 KV cache), which is a ~17% speedup over the non-MTP baseline…