Centauri: Enabling Efficient Scheduling for Communication-Computation Overlap in Large Model Training via Communication Partitioning. - Chang Chen; Xiuhong Li; Qianchao Zhu; Jiangfei Duan; Peng Sun 006; Xingcheng Zhang; Chao Yang 002 (ASPLOS (3), 2024)

SpotServe: Serving Generative Large Language Models on Preemptible Instances. - Xupeng Miao; Chunan Shi; Jiangfei Duan; Xiaoli Xi; Dahua Lin; Bin Cui 001; Zhihao Jia (ASPLOS (2), 2024)

MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving. - Jiangfei Duan; Runyu Lu; Haojie Duanmu; Xiuhong Li; Xingcheng Zhang; Dahua Lin; Ion Stoica; Hao Zhang 025 (ICML, 2024)

Parcae: Proactive, Liveput-Optimized DNN Training on Preemptible Instances. - Jiangfei Duan; Ziang Song; Xupeng Miao; Xiaoli Xi; Dahua Lin; Harry Xu 001; Minjia Zhang; Zhihao Jia (NSDI, 2024)

MuxServe: Flexible Multiplexing for Efficient Multiple LLM Serving. - Jiangfei Duan; Runyu Lu; Haojie Duanmu; Xiuhong Li; Xingcheng Zhang; Dahua Lin; Ion Stoica; Hao Zhang 025 (CoRR, 2024)

SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models. - Haojie Duanmu; Zhihang Yuan; Xiuhong Li; Jiangfei Duan; Xingcheng Zhang; Dahua Lin (CoRR, 2024)

SampleAttention: Near-Lossless Acceleration of Long Context LLM Inference with Adaptive Structured Sparse Attention. - Qianchao Zhu; Jiangfei Duan; Chang Chen; Siran Liu; Xiuhong Li; Guanyu Feng; Xin Lv; Huanqi Cao; Xiao Chuanfu; Xingcheng Zhang; Dahua Lin; Chao Yang 002 (CoRR, 2024)

Efficient Training of Large Language Models on Distributed Infrastructures: A Survey. - Jiangfei Duan; Shuo Zhang 022; Zerui Wang; Lijuan Jiang; Wenwen Qu; Qinghao Hu 004; Guoteng Wang; Qizhen Weng; Hang Yan 001; Xingcheng Zhang; Xipeng Qiu; Dahua Lin; et al. (CoRR, 2024)

Proteus: Simulating the Performance of Distributed DNN Training. - Jiangfei Duan; Xiuhong Li; Ping Xu; Xingcheng Zhang; Shengen Yan; Yun Liang 001; Dahua Lin (IEEE Trans. Parallel Distributed Syst., 2024)

MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design. - Haojie Duanmu; Xiuhong Li; Zhihang Yuan; Size Zheng 001; Jiangfei Duan; Xingcheng Zhang; Dahua Lin (CoRR, 2025)