Running ollama and llama.cpp on Talos Linux on an AMD Strix Halo CPU

For about two months I ve been running ollama and llama.cpp on a Talos Linux Kubernetes cluster, on top of a desktop PC with the AMD Strix Halo CPU (AMD Ryzen AI Max+ 395). This blog post is to show you how to install it, and talk about some of my frustrations along the way. Introduction [ ]