MegaScale: Scaling Large Language Model Training to More Than 10, 000 GPUs. - Ziheng Jiang; Haibin Lin; Yinmin Zhong; Qi Huang; Yangrui Chen; Zhi Zhang; Yanghua Peng; Xiang Li 067; Cong Xie; Shibiao Nong; Yulu Jia; Sun He; et al. (NSDI, 2024)