di02: Production Server

di03 and di04 proved the patterns. Now it was time for the production tier. di02. The workhorse. Stable inference endpoints that don&rsquo;t go down for experiments. The Specs # Component Spec CPU Threadripper Pro 5945WX (12 cores) RAM 448GB ECC DDR4 GPU 2x RTX 3090 (NVLink bridge) VRAM 48GB total Storage mdadm RAID 1 (OS) + NFS from nexus Fans Yellow (Simon Says) Threadripper Pro for ECC memory.…