On-Prem GPUs in a Boring Kubernetes Cluster

The clearest reason to put your own hardware in the hybrid cluster is the GPU. Sustained AI work on rented cloud GPUs runs up a large bill, and a GPU you own pays for itself quickly when you actually use it. This is the final piece of the platform, and it is what makes the optional in-cluster AI, self-hosted model inference and embeddings, affordable: adding GPUs to Kubernetes, the modern way,…