ElasticFlow: An Elastic Serverless Training Platform for Distributed Deep Learning. - Diandian Gu; Yihao Zhao; Yinmin Zhong; Yifan Xiong 001; Zhenhua Han; Peng Cheng 005; Fan Yang 024; Gang Huang 001; Xin Jin 008; Xuanzhe Liu (ASPLOS (2), 2023)

AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving. - Zhuohan Li 001; Lianmin Zheng; Yinmin Zhong; Vincent Liu 001; Ying Sheng 007; Xin Jin 008; Yanping Huang; Zhifeng Chen; Hao Zhang 025; Joseph E. Gonzalez; Ion Stoica (OSDI, 2023)

Fast Distributed Inference Serving for Large Language Models. - Bingyang Wu; Yinmin Zhong; Zili Zhang; Gang Huang 001; Xuanzhe Liu; Xin Jin 008 (CoRR, 2023)

MegaScale: Scaling Large Language Model Training to More Than 10, 000 GPUs. - Ziheng Jiang; Haibin Lin; Yinmin Zhong; Qi Huang; Yangrui Chen; Zhi Zhang; Yanghua Peng; Xiang Li 067; Cong Xie; Shibiao Nong; Yulu Jia; Sun He; et al. (NSDI, 2024)

DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving. - Yinmin Zhong; Shengyu Liu; Junda Chen; Jianbo Hu; Yibo Zhu; Xuanzhe Liu; Xin Jin 008; Hao Zhang 025 (OSDI, 2024)

LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism. - Bingyang Wu; Shengyu Liu; Yinmin Zhong; Peng Sun 006; Xuanzhe Liu; Xin Jin 008 (SOSP, 2024)

FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion. - Li-Wen Chang; Wenlei Bao; Qi Hou; Chengquan Jiang; Ningxin Zheng; Yinmin Zhong; Xuanrun Zhang; Zuquan Song; Ziheng Jiang; Haibin Lin; Xin Jin 008; Xin Liu 086 (CoRR, 2024)

DistTrain: Addressing Model and Data Heterogeneity with Disaggregated Training for Multimodal Large Language Models. - Zili Zhang; Yinmin Zhong; Ranchen Ming; Hanpeng Hu; Jianjian Sun; Zheng Ge; Yibo Zhu; Xin Jin 008 (CoRR, 2024)

RLHFuse: Efficient RLHF Training for Large Language Models with Inter- and Intra-Stage Fusion. - Yinmin Zhong; Zili Zhang; Bingyang Wu; Shengyu Liu; Yukun Chen; Changyi Wan; Hanpeng Hu; Lei Xia; Ranchen Ming; Yibo Zhu; Xin Jin 008 (CoRR, 2024)

Aquifer: Transparent Microsecond-Scale Scheduling for vRAN Workloads. - Yunshan Jia; Yinmin Zhong; Meng Wang 018; Jiaqi Gao; Pengyu Zhang; Xuanzhe Liu; Xin Jin 008 (IEEE Trans. Serv. Comput., 2024)

DistMind: Efficient Resource Disaggregation for Deep Learning Workloads. - Xin Jin 008; Zhihao Bai; Zhen Zhang 063; Yibo Zhu; Yinmin Zhong; Xuanzhe Liu (IEEE/ACM Trans. Netw., 2024)

Optimizing RLHF Training for Large Language Models with Stage Fusion. - Yinmin Zhong; Zili Zhang; Bingyang Wu; Shengyu Liu; Yukun Chen; Changyi Wan; Hanpeng Hu; Lei Xia; Ranchen Ming; Yibo Zhu; Xin Jin 008 (NSDI, 2025)

StreamRL: Scalable, Heterogeneous, and Elastic RL for LLMs with Disaggregated Stream Generation. - Yinmin Zhong; Zili Zhang; Xiaoniu Song; Hanpeng Hu; Chao Jin; Bingyang Wu; Nuo Chen 001; Yukun Chen; Yu Zhou 010; Changyi Wan; Hongyu Zhou; Yimin Jiang; et al. (CoRR, 2025)

Step-Audio-AQAA: a Fully End-to-End Expressive Large Audio Language Model. - Ailin Huang; Bingxin Li; Bruce Wang; Boyong Wu; Chao Yan; Chengli Feng; Heng Wang 007; Hongyu Zhou; Hongyuan Wang; Jingbei Li; Jianjian Sun; Joanna Wang; et al. (CoRR, 2025)