Gangs, Fabric, and Googput

This is the post where "improve on Borg today " stops being a slogan. Borg was designed for a world of fungible CPU and memory, and that world is gone for an enormous and growing slice of what data centers actually do, which is train large models. Almost every