MegaScale: Scaling Large Language Model Training to More Than 10, 000 GPUs. - Ziheng Jiang; Haibin Lin; Yinmin Zhong; Qi Huang; Yangrui Chen; Zhi Zhang; Yanghua Peng; Xiang Li 067; Cong Xie; Shibiao Nong; Yulu Jia; Sun He; et al. (NSDI, 2024)

ByteCheckpoint: A Unified Checkpointing System for LLM Development. - Borui Wan; Mingji Han; Yiyao Sheng; Zhichao Lai; Mofan Zhang; Junda Zhang; Yanghua Peng; Haibin Lin; Xin Liu; Chuan Wu 001 (CoRR, 2024)

ByteCheckpoint: A Unified Checkpointing System for Large Foundation Model Development. - Borui Wan; Mingji Han; Yiyao Sheng; Yanghua Peng; Haibin Lin; Mofan Zhang; Zhichao Lai; Menghan Yu; Junda Zhang; Zuquan Song; Xin Liu; Chuan Wu 001 (NSDI, 2025)