How Small Can a Local LLM Get? Running Gemma 4 on a Raspberry Pi

A while back, I ran TinyLlama on a Raspberry Pi in Docker, mostly to answer one question: can this tiny board run a language model at all? Technically, yes. In the "watch it compose a sentence like it's dictating a will" sense. It worked. Nobody was impressed, including me. That was the ceiling back then: small enough to fit, not good enough to actually want. The question this time is sharper:…