Coding With Llama-cpp

Unfortunately using programs like OpenCode with local LLMs and a mid-range Nvidia GPU can be rather slow. Over the past few days I have been experimenting with llama-cpp and its built-in tools (like edit file, read file). llama-cpp Coding It seems possible to replace a harness like OpenCode with llama-cpp and its built-in tools . This would reduce the large prompts used. Info about the project can…