DiLoCo: Data Parallelism for the Datacenter Poor

Distributed training sans datacenter.