Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism. - Xupeng Miao; Yujie Wang; Youhe Jiang; Chunan Shi; Xiaonan Nie; Hailin Zhang 004; Bin Cui 001 (Proc. VLDB Endow., 2022)

SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification. - Xupeng Miao; Gabriele Oliaro; Zhihao Zhang 001; Xinhao Cheng; Zeyu Wang; Zhengxin Zhang; Rae Ying Yee Wong; Alan Zhu 001; Lijie Yang 003; Xiaoxiang Shi; Chunan Shi; Zhuoming Chen; et al. (ASPLOS (3), 2024)

SpotServe: Serving Generative Large Language Models on Preemptible Instances. - Xupeng Miao; Chunan Shi; Jiangfei Duan; Xiaoli Xi; Dahua Lin; Bin Cui 001; Zhihao Jia (ASPLOS (2), 2024)

Clover: Regressive Lightweight Speculative Decoding with Sequential Knowledge. - Bin Xiao; Chunan Shi; Xiaonan Nie; Fan Yang 024; Xiangwei Deng; Lei Su; Weipeng Chen; Bin Cui 001 (CoRR, 2024)

Mirage: A Multi-Level Superoptimizer for Tensor Programs. - Mengdi Wu; Xinhao Cheng; Shengyu Liu; Chunan Shi; Jianan Ji; Man Kit Ao; Praveen Velliengiri; Xupeng Miao; Oded Padon; Zhihao Jia (OSDI, 2025)