Characterization and prediction of deep learning workloads in large-scale GPU datacenters. - Qinghao Hu 004; Peng Sun 006; Shengen Yan; Yonggang Wen 001; Tianwei Zhang 004 (SC, 2021)

Primo: Practical Learning-Augmented Systems with Interpretable Models. - Qinghao Hu 004; Harsha Nori; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (USENIX ATC, 2022)

Deep Learning Workload Scheduling in GPU Datacenters: Taxonomy, Challenges and Vision. - Wei Gao; Qinghao Hu 004; Zhisheng Ye 002; Peng Sun 006; Xiaolin Wang 001; Yingwei Luo; Tianwei Zhang 004; Yonggang Wen 001 (CoRR, 2022)

Lucid: A Non-intrusive, Scalable and Interpretable Scheduler for Deep Learning Training Jobs. - Qinghao Hu 004; Meng Zhang 045; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (ASPLOS (2), 2023)

Hydro: Surrogate-Based Hyperparameter Tuning Service in Datacenters. - Qinghao Hu 004; Zhisheng Ye 002; Meng Zhang 045; Qiaoling Chen; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (OSDI, 2023)

Boosting Distributed Full-graph GNN Training with Asynchronous One-bit Communication. - Meng Zhang 045; Qinghao Hu 004; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (CoRR, 2023)

AMSP: Super-Scaling LLM Training via Advanced Model States Partitioning. - Qiaoling Chen; Qinghao Hu 004; Zhisheng Ye 002; Guoteng Wang; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (CoRR, 2023)

Sylvie: 3D-Adaptive and Universal System for Large-Scale Graph Neural Network Training. - Meng Zhang 045; Qinghao Hu 004; Cheng Wan 005; Haozhao Wang; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 001 (ICDE, 2024)

Lins: Reducing Communication Overhead of ZeRO for Efficient LLM Training. - Qiaoling Chen; Qinghao Hu 004; Guoteng Wang; Yingtong Xiong; Ting Huang; Xun Chen; Yang Gao 042; Hang Yan 001; Yonggang Wen 001; Tianwei Zhang 004; Peng Sun 006 (IWQoS, 2024)

Characterization of Large Language Model Development in the Datacenter. - Qinghao Hu 004; Zhisheng Ye 002; Zerui Wang; Guoteng Wang; Meng Zhang 045; Qiaoling Chen; Peng Sun 006; Dahua Lin; Xiaolin Wang 001; Yingwei Luo; Yonggang Wen 001; Tianwei Zhang 004 (NSDI, 2024)

TorchGT: A Holistic System for Large-Scale Graph Transformer Training. - Meng Zhang 045; Jie Sun 017; Qinghao Hu 004; Peng Sun 006; Zeke Wang; Yonggang Wen 001; Tianwei Zhang 004 (SC, 2024)

FedDSE: Distribution-aware Sub-model Extraction for Federated Learning over Resource-constrained Devices. - Haozhao Wang; Yabo Jia; Meng Zhang 045; Qinghao Hu 004; Hao Ren 001; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (WWW, 2024)

InternEvo: Efficient Long-sequence Large Language Model Training via Hybrid Parallelism and Redundant Sharding. - Qiaoling Chen; Diandian Gu; Guoteng Wang; Xun Chen; Yingtong Xiong; Ting Huang; Qinghao Hu 004; Xin Jin 008; Yonggang Wen 001; Tianwei Zhang 004; Peng Sun 006 (CoRR, 2024)

LoongTrain: Efficient Training of Long-Sequence LLMs with Head-Context Parallelism. - Diandian Gu; Peng Sun 006; Qinghao Hu 004; Ting Huang; Xun Chen; Yingtong Xiong; Guoteng Wang; Qiaoling Chen; Shangchun Zhao; Jiarui Fang; Yonggang Wen 001; Tianwei Zhang 004; et al. (CoRR, 2024)

Efficient Training of Large Language Models on Distributed Infrastructures: A Survey. - Jiangfei Duan; Shuo Zhang; Zerui Wang; Lijuan Jiang; Wenwen Qu; Qinghao Hu 004; Guoteng Wang; Qizhen Weng; Hang Yan 001; Xingcheng Zhang; Xipeng Qiu; Dahua Lin; et al. (CoRR, 2024)

LongVILA: Scaling Long-Context Visual Language Models for Long Videos. - Fuzhao Xue; Yukang Chen; Dacheng Li; Qinghao Hu 004; Ligeng Zhu; Xiuyu Li; Yunhao Fang; Haotian Tang; Shang Yang; Zhijian Liu; Ethan He; Hongxu Yin; et al. (CoRR, 2024)

Deep Learning Workload Scheduling in GPU Datacenters: A Survey. - Zhisheng Ye 002; Wei Gao; Qinghao Hu 004; Peng Sun 006; Xiaolin Wang 001; Yingwei Luo; Tianwei Zhang 004; Yonggang Wen 001 (ACM Comput. Surv., 2024)

DeltaZip: Efficient Serving of Multiple Full-Model-Tuned LLMs. - Xiaozhe Yao; Qinghao Hu 004; Ana Klimovic (EuroSys, 2025)

LongVILA: Scaling Long-Context Visual Language Models for Long Videos. - Yukang Chen; Fuzhao Xue; Dacheng Li; Qinghao Hu 004; Ligeng Zhu; Xiuyu Li; Yunhao Fang; Haotian Tang; Shang Yang; Zhijian Liu; Yihui He; Hongxu Yin; et al. (ICLR, 2025)

LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention. - Shang Yang; Junxian Guo; Haotian Tang; Qinghao Hu 004; Guangxuan Xiao; Jiaming Tang; Yujun Lin 001; Zhijian Liu; Yao Lu 006; Song Han 003 (CoRR, 2025)

Sailor: Automating Distributed Training over Dynamic, Heterogeneous, and Geo-distributed Clusters. - Foteini Strati; Zhendong Zhang; George Manos; Ixeia Sánchez Périz; Qinghao Hu 004; Tiancheng Chen; Berk Buzcu; Song Han 003; Pamela Delgado; Ana Klimovic (CoRR, 2025)

Scaling RL to Long Videos. - Yukang Chen; Wei Huang; Baifeng Shi; Qinghao Hu 004; Hanrong Ye; Ligeng Zhu; Zhijian Liu; Pavlo Molchanov 001; Jan Kautz; Xiaojuan Qi; Sifei Liu; Hongxu Yin; et al. (CoRR, 2025)