Towards GPU Memory Efficiency for Distributed Training at Scale. - Runxiang Cheng; Chris Cai; Selman Yilmaz; Rahul Mitra; Malay Bag; Mrinmoy Ghosh; Tianyin Xu (SoCC, 2023)

Scaling Llama 3 Training with Efficient Parallelism Strategies. - Weiwei Chu; Xinfeng Xie; Jiecao Yu; Jie Wang 022; Amar Phanishayee; Chunqiang Tang; Yuchen Hao; Jianyu Huang; Mustafa Ozdal; Jun Wang; Vedanuj Goswami; Naman Goyal 001; et al. (ISCA, 2025)

WLB-LLM: Workload-Balanced 4D Parallelism for Large Language Model Training. - Zheng Wang 075; Anna Cai; Xinfeng Xie; Zaifeng Pan; Yue Guan; Weiwei Chu; Jie Wang 022; Shikai Li; Jianyu Huang; Chris Cai; Yuchen Hao; Yufei Ding 001 (OSDI, 2025)