Orion-100B: Distributed pretraining arrives at hundred-billion-parameter scale

Author: Dr. Steffen Cruz