Megascale

Scaling Large Language Model Training to More Than 10,000 GPUs