Running large LLMs on small hardware: Gemma 4 12B on a VRAM-constrained Radeon laptop

Google released Gemma 4 12B today. I m a huge fan of the Gemma model family, they have improved with each iteration and consistently perform on par with larger models. It didn t run at first because it needs more VRAM that my laptop has, but there s a workaround. Here s a short instruction for how to run Continue reading Running large LLMs on small hardware: Gemma 4 12B on a VRAM-constrained…