CS231n Lecture Note: Large Scale Distributed Training

GPUs Modern AI training is structured as a hierarchy: individual GPUs (