Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning. - Lianmin Zheng; Zhuohan Li 001; Hao Zhang 025; Yonghao Zhuang 001; Zhifeng Chen; Yanping Huang; Yida Wang 003; Yuanzhong Xu; Danyang Zhuo; Eric P. Xing; Joseph E. Gonzalez; Ion Stoica (OSDI, 2022)

Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning. - Lianmin Zheng; Zhuohan Li 001; Hao Zhang 025; Yonghao Zhuang 001; Zhifeng Chen; Yanping Huang; Yida Wang 003; Yuanzhong Xu; Danyang Zhuo; Joseph E. Gonzalez; Ion Stoica (CoRR, 2022)

On Optimizing the Communication of Model Parallelism. - Yonghao Zhuang 001; Lianmin Zheng; Zhuohan Li 001; Eric P. Xing; Qirong Ho; Joseph Gonzalez 001; Ion Stoica; Hao Zhang 025; Hexu Zhao (MLSys, 2023)

Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena. - Lianmin Zheng; Wei-Lin Chiang; Ying Sheng 007; Siyuan Zhuang; Zhanghao Wu; Yonghao Zhuang 001; Zi Lin; Zhuohan Li 001; Dacheng Li; Eric P. Xing; Hao Zhang 025; Joseph E. Gonzalez; et al. (NeurIPS, 2023)

Redco: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs. - Bowen Tan; Yun Zhu; Lijuan Liu; Hongyi Wang 001; Yonghao Zhuang 001; Jindong Chen; Eric P. Xing; Zhiting Hu (CoRR, 2023)

LLM360: Towards Fully Transparent Open-Source LLMs. - Zhengzhong Liu 001; Aurick Qiao; Willie Neiswanger; Hongyi Wang 001; Bowen Tan; Tianhua Tao; Junbo Li; Yuqi Wang; Suqi Sun; Omkar Pangarkar; Richard Fan; Yi Gu 002; et al. (CoRR, 2023)

LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset. - Lianmin Zheng; Wei-Lin Chiang; Ying Sheng 007; Tianle Li; Siyuan Zhuang; Zhanghao Wu; Yonghao Zhuang 001; Zhuohan Li 001; Zi Lin; Eric P. Xing; Joseph E. Gonzalez; Ion Stoica; et al. (ICLR, 2024)

RedCoast: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs. - Bowen Tan; Yun Zhu; Lijuan Liu; Hongyi Wang 001; Yonghao Zhuang 001; Jindong Chen; Eric P. Xing; Zhiting Hu (NAACL (Demonstrations), 2024)

Toward Inference-optimal Mixture-of-Expert Large Language Models. - Longfei Yun; Yonghao Zhuang 001; Yao Fu; Eric P. Xing; Hao Zhang 025 (CoRR, 2024)

Helix: Distributed Serving of Large Language Models via Max-Flow on Heterogeneous GPUs. - Yixuan Mei; Yonghao Zhuang 001; Xupeng Miao; Juncheng Yang; Zhihao Jia; Rashmi Vinayak (CoRR, 2024)

Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow. - Yixuan Mei; Yonghao Zhuang 001; Xupeng Miao; Juncheng Yang; Zhihao Jia; Rashmi Vinayak (ASPLOS (1), 2025)

Scaling Long Context Training Data by Long-Distance Referrals. - Yonghao Zhuang 001; Lanxiang Hu; Longfei Yun; Souvik Kundu 009; Zhengzhong Liu 001; Eric P. Xing; Hao Zhang 025 (ICLR, 2025)

LLM360 K2: Building a 65B 360-Open-Source Large Language Model from Scratch. - Zhengzhong Liu 001; Bowen Tan; Hongyi Wang 001; Willie Neiswanger; Tianhua Tao; Haonan Li 002; Fajri Koto; Yuqi Wang; Suqi Sun; Omkar Pangarkar; Richard Fan; Yi Gu 002; et al. (CoRR, 2025)

Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain Perspective. - Zhoujun Cheng; Shibo Hao; Tianyang Liu 003; Fan Zhou; Yutao Xie; Feng Yao; Yuexin Bian; Yonghao Zhuang 001; Nilabjo Dey; Yuheng Zha; Yi Gu 002; Kun Zhou; et al. (CoRR, 2025)