Learning by Building, Part 3: Caltrain Bot, Local LLMs, and Reality

In the previous post , I mainly focused on software and data engineering lessons from working on the Caltrain bot. In this post, I’ll share how I tried to build a small Raspberry Pi–based device for local-only LLM inference, why I failed, and what I did instead. The post also includes a summary in which I reflect on what else I could do or try, as well as the other interesting possibilities this…