PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications. - Zhihao Bai; Zhen Zhang 063; Yibo Zhu; Xin Jin 008 (OSDI, 2020)

Is Network the Bottleneck of Distributed Training? - Zhen Zhang 063; Chaokun Chang; Haibin Lin; Yida Wang 003; Raman Arora; Xin Jin 008 (NetAI@SIGCOMM, 2020)

MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud. - Zhen Zhang 063; Shuai Zheng 004; Yida Wang 003; Justin Chiu; George Karypis; Trishul Chilimbi; Mu Li 003; Xin Jin 008 (Proc. VLDB Endow., 2022)

Oobleck: Resilient Distributed Training of Large Models Using Pipeline Templates. - Insu Jang; Zhenning Yang; Zhen Zhang 063; Xin Jin 008; Mosharaf Chowdhury (SOSP, 2023)

GEMINI: Fast Failure Recovery in Distributed Training with In-Memory Checkpoints. - Zhuang Wang; Zhen Jia 001; Shuai Zheng 004; Zhen Zhang 063; Xinwei Fu; T. S. Eugene Ng; Yida Wang 003 (SOSP, 2023)

Decoupled Model Schedule for Deep Learning Training. - Hongzheng Chen; Cody Hao Yu; Shuai Zheng 004; Zhen Zhang 063; Zhiru Zhang; Yida Wang 003 (CoRR, 2023)

Slapo: A Schedule Language for Progressive Optimization of Large Deep Learning Model Training. - Hongzheng Chen; Cody Hao Yu; Shuai Zheng 004; Zhen Zhang 063; Zhiru Zhang; Yida Wang 003 (ASPLOS (2), 2024)

Distributed Training of Large Language Models on AWS Trainium. - Xinwei Fu; Zhen Zhang 063; Haozheng Fan; Guangtai Huang; Mohammad El-Shabani; Randy Huang; Rahul Solanki; Fei Wu; Ron Diamant; Yida Wang 003 (SoCC, 2024)

DISTMM: Accelerating Distributed Multimodal Model Training. - Jun Huang; Zhen Zhang 063; Shuai Zheng 004; Feng Qin; Yida Wang 003 (NSDI, 2024)

SDCC: software-defined collective communication for distributed training. - Xin Jin 008; Zhen Zhang 063; Yunshan Jia; Yun Ma 002; Xuanzhe Liu (Sci. China Inf. Sci., 2024)

DistMind: Efficient Resource Disaggregation for Deep Learning Workloads. - Xin Jin 008; Zhihao Bai; Zhen Zhang 063; Yibo Zhu; Yinmin Zhong; Xuanzhe Liu (IEEE/ACM Trans. Netw., 2024)

Verifying Semantic Equivalence of Large Models with Equality Saturation. - Kahfi S. Zulkifli; Wenbo Qian; Shaowei Zhu 001; Yuan Zhou; Zhen Zhang 063; Chang Lou (EuroMLSys, 2025)