My Local LLM Rig (draft)

The hardware and software stack behind training and serving open-weights models from my home office — 2x 3090s, 256GB of non-ECC RAM, and a Threadripper that's older than it should be.