BAGUA: Scaling up Distributed Learning with System Relaxations. - Shaoduo Gan; Xiangru Lian; Rui Wang; Jianbin Chang; Chengjun Liu; Hongmei Shi; Shengzhuo Zhang; Xianghong Li; Tengxu Sun; Jiawei Jiang 001; Binhang Yuan; Sen Yang 004; et al. (Proc. VLDB Endow., 2021)

MoE Parallel Folding: Heterogeneous Parallelism Mappings for Efficient Large-Scale MoE Model Training with Megatron Core. - Dennis Liu; Zijie Yan; Xin Yao; Tong Liu; Vijay Korthikanti; Evan Wu; Shiqing Fan; Gao Deng; Hongxiao Bai; Jianbin Chang; Ashwath Aithal; Michael Andersch; et al. (CoRR, 2025)