Local LLM Inference Optimization: The Complete Guide

Note: This post was drafted with significant AI assistance, synthesizing notes, bench results, and scripts from the l3ms homelab toolkit and the series of model-running posts on this site. The experiments, numbers, and failure modes documented here are real - the synthesis and prose are AI-assisted. Preface # Over the past year I've written posts on running gpt-oss-120b , Qwen3-Coder-Next , Gemma…