Making local LLM fast

I built a tool called Fono . It’s a voice front-end for your computer that can run entirely on your own machine. No cloud, no account, no audio leaving the laptop. It has three jobs, on two hotkeys: Hold F7 to dictate and cleaned-up text lands in whatever window you were typing in. Hold F8 to talk to an assistant and it answers various things. It can also call tools (look at what’s on your screen,…