Local agents are good but slow

Last year, I shared how local LLMs are expensive . There are only 3 reasons to use them over an inference API: You have no choice , e.g. Government, pharma, finance, or other sensitive data. You have free GPUs , e.g. your laptop, local data center with sunk cost, free cloud credits, etc. This doesn't scale. You want to learn . This year, I finally started using them for a combination of #1 (on…