Cloud3DView: an interactive tool for cloud data center operations. - Jianxiong Yin; Peng Sun 006; Yonggang Wen 001; Haigang Gong; Ming Liu 002; Xuelong Li 001; Haipeng You; Jinqi Gao; Cynthia Lin (SIGCOMM, 2013)

CREATE: Correlation enhanced traffic matrix estimation in Data Center Networks. - Zhiming Hu; Yan Qiao; Jun Luo 001; Peng Sun 006; Yonggang Wen 001 (Networking, 2014)

Timed Dataflow: Reducing Communication Overhead for Distributed Machine Learning Systems. - Peng Sun 006; Yonggang Wen 001; Ta Nguyen Binh Duong; Shengen Yan (ICPADS, 2016)

GraphH: High Performance Big Graph Analytics in Small Clusters. - Peng Sun 006; Yonggang Wen 001; Ta Nguyen Binh Duong; Xiaokui Xiao (CLUSTER, 2017)

GraphMP: An Efficient Semi-External-Memory Big Graph Processing System on a Single Machine. - Peng Sun 006; Yonggang Wen 001; Ta Nguyen Binh Duong; Xiaokui Xiao (ICPADS, 2017)

Towards Distributed Machine Learning in Shared Clusters: A Dynamically-Partitioned Approach. - Peng Sun 006; Yonggang Wen 001; Ta Nguyen Binh Duong; Shengen Yan (SMARTCOMP, 2017)

Speeding-Up Age Estimation in Intelligent Demographics System via Network Optimization. - Zhenzhen Hu; Peng Sun 006; Yonggang Wen 001 (ICC, 2018)

On Distributed Algorithms for Cost-Efficient Data Center Placement in Cloud Computing. - Wuqiong Luo; Wee Peng Tay; Peng Sun 006; Yonggang Wen 001 (CoRR, 2018)

MetaFlow: A Scalable Metadata Lookup Service for Distributed File Systems in Data Centers. - Peng Sun 006; Yonggang Wen 001; Duong Nguyen Binh Ta; Haiyong Xie 001 (IEEE Trans. Big Data, 2018)

Optimizing Network Performance for Distributed DNN Training on GPU Clusters: ImageNet/AlexNet Training in 1.5 Minutes. - Peng Sun 006; Wansen Feng; Ruobing Han; Shengen Yan; Yonggang Wen 001 (CoRR, 2019)

Scalable Architectures for Big Data Analysis. - Peng Sun 006; Yonggang Wen 001 (Encyclopedia of Big Data Technologies, 2019)

Elan: Towards Generic and Efficient Elastic Training for Deep Learning. - Lei Xie; Jidong Zhai; Baodong Wu; Yuanbo Wang; Xingcheng Zhang; Peng Sun 006; Shengen Yan (ICDCS, 2020)

GraphMP: I/O-Efficient Big Graph Analytics on a Single Commodity Machine. - Peng Sun 006; Yonggang Wen 001; Ta Nguyen Binh Duong; Xiaokui Xiao (IEEE Trans. Big Data, 2020)

Chronus: A Novel Deadline-aware Scheduler for Deep Learning Training Jobs. - Wei Gao; Zhisheng Ye 002; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (SoCC, 2021)

Characterization and prediction of deep learning workloads in large-scale GPU datacenters. - Qinghao Hu 004; Peng Sun 006; Shengen Yan; Yonggang Wen 001; Tianwei Zhang 004 (SC, 2021)

ModelCI-e: Enabling Continual Learning in Deep Learning Serving Systems. - Yizheng Huang 001; Huaizheng Zhang; Yonggang Wen 001; Peng Sun 006; Nguyen Binh Duong Ta (CoRR, 2021)

Titan: a scheduler for foundation model fine-tuning workloads. - Wei Gao; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (SoCC, 2022)

Primo: Practical Learning-Augmented Systems with Interpretable Models. - Qinghao Hu 004; Harsha Nori; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (USENIX ATC, 2022)

A Simulation Platform for Multi-tenant Machine Learning Services on Thousands of GPUs. - Ruofan Liang; Bingsheng He; Shengen Yan; Peng Sun 006 (CoRR, 2022)

Deep Learning Workload Scheduling in GPU Datacenters: Taxonomy, Challenges and Vision. - Wei Gao; Qinghao Hu 004; Zhisheng Ye 002; Peng Sun 006; Xiaolin Wang 001; Yingwei Luo; Tianwei Zhang 004; Yonggang Wen 001 (CoRR, 2022)

GradientFlow: Optimizing Network Performance for Large-Scale Distributed DNN Training. - Peng Sun 006; Yonggang Wen 001; Ruobing Han; Wansen Feng; Shengen Yan (IEEE Trans. Big Data, 2022)

Astraea: A Fair Deep Learning Scheduler for Multi-Tenant GPU Clusters. - Zhisheng Ye 002; Peng Sun 006; Wei Gao; Tianwei Zhang 004; Xiaolin Wang 001; Shengen Yan; Yingwei Luo (IEEE Trans. Parallel Distributed Syst., 2022)

Lucid: A Non-intrusive, Scalable and Interpretable Scheduler for Deep Learning Training Jobs. - Qinghao Hu 004; Meng Zhang 045; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (ASPLOS (2), 2023)

Hydro: Surrogate-Based Hyperparameter Tuning Service in Datacenters. - Qinghao Hu 004; Zhisheng Ye 002; Meng Zhang 045; Qiaoling Chen; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (OSDI, 2023)

Boosting Distributed Full-graph GNN Training with Asynchronous One-bit Communication. - Meng Zhang 045; Qinghao Hu 004; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (CoRR, 2023)

AMSP: Super-Scaling LLM Training via Advanced Model States Partitioning. - Qiaoling Chen; Qinghao Hu 004; Zhisheng Ye 002; Guoteng Wang; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (CoRR, 2023)

Centauri: Enabling Efficient Scheduling for Communication-Computation Overlap in Large Model Training via Communication Partitioning. - Chang Chen; Xiuhong Li; Qianchao Zhu; Jiangfei Duan; Peng Sun 006; Xingcheng Zhang; Chao Yang 002 (ASPLOS (3), 2024)

Sylvie: 3D-Adaptive and Universal System for Large-Scale Graph Neural Network Training. - Meng Zhang 045; Qinghao Hu 004; Cheng Wan 005; Haozhao Wang; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 001 (ICDE, 2024)

Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning. - Zhiheng Xi; Wenxiang Chen; Boyang Hong; Senjie Jin; Rui Zheng; Wei He 024; Yiwen Ding; Shichun Liu; Xin Guo; Junzhe Wang; Honglin Guo; Wei Shen; et al. (ICML, 2024)

AutoSched: An Adaptive Self-configured Framework for Scheduling Deep Learning Training Workloads. - Wei Gao; Xu Zhang; Shan Huang; Shangwei Guo; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (ICS, 2024)

Ymir: A Scheduler for Foundation Model Fine-tuning Workloads in Datacenters. - Wei Gao; Weiming Zhuang; Minghao Li 005; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (ICS, 2024)

Lins: Reducing Communication Overhead of ZeRO for Efficient LLM Training. - Qiaoling Chen; Qinghao Hu 004; Guoteng Wang; Yingtong Xiong; Ting Huang; Xun Chen; Yang Gao 042; Hang Yan 001; Yonggang Wen 001; Tianwei Zhang 004; Peng Sun 006 (IWQoS, 2024)

Characterization of Large Language Model Development in the Datacenter. - Qinghao Hu 004; Zhisheng Ye 002; Zerui Wang; Guoteng Wang; Meng Zhang 045; Qiaoling Chen; Peng Sun 006; Dahua Lin; Xiaolin Wang 001; Yingwei Luo; Yonggang Wen 001; Tianwei Zhang 004 (NSDI, 2024)

dLoRA: Dynamically Orchestrating Requests and Adapters for LoRA LLM Serving. - Bingyang Wu; Ruidong Zhu; Zili Zhang; Peng Sun 006; Xuanzhe Liu; Xin Jin 008 (OSDI, 2024)

TorchGT: A Holistic System for Large-Scale Graph Transformer Training. - Meng Zhang 045; Jie Sun 017; Qinghao Hu 004; Peng Sun 006; Zeke Wang; Yonggang Wen 001; Tianwei Zhang 004 (SC, 2024)

LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism. - Bingyang Wu; Shengyu Liu; Yinmin Zhong; Peng Sun 006; Xuanzhe Liu; Xin Jin 008 (SOSP, 2024)

FedDSE: Distribution-aware Sub-model Extraction for Federated Learning over Resource-constrained Devices. - Haozhao Wang; Yabo Jia; Meng Zhang 045; Qinghao Hu 004; Hao Ren 001; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (WWW, 2024)

InternEvo: Efficient Long-sequence Large Language Model Training via Hybrid Parallelism and Redundant Sharding. - Qiaoling Chen; Diandian Gu; Guoteng Wang; Xun Chen; Yingtong Xiong; Ting Huang; Qinghao Hu 004; Xin Jin 008; Yonggang Wen 001; Tianwei Zhang 004; Peng Sun 006 (CoRR, 2024)

InternLM2 Technical Report. - Zheng Cai; Maosong Cao; Haojiong Chen; Kai Chen 026; Keyu Chen; Xin Chen; Xun Chen; Zehui Chen; Zhi Chen 006; Pei Chu; Xiaoyi Dong; Haodong Duan; et al. (CoRR, 2024)

LoongTrain: Efficient Training of Long-Sequence LLMs with Head-Context Parallelism. - Diandian Gu; Peng Sun 006; Qinghao Hu 004; Ting Huang; Xun Chen; Yingtong Xiong; Guoteng Wang; Qiaoling Chen; Shangchun Zhao; Jiarui Fang; Yonggang Wen 001; Tianwei Zhang 004; et al. (CoRR, 2024)

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output. - Pan Zhang 001; Xiaoyi Dong; Yuhang Zang; Yuhang Cao; Rui Qian 001; Lin Chen 026; Qipeng Guo; Haodong Duan; Bin Wang 065; Linke Ouyang; Songyang Zhang; Wenwei Zhang; et al. (CoRR, 2024)

Efficient Training of Large Language Models on Distributed Infrastructures: A Survey. - Jiangfei Duan; Shuo Zhang 022; Zerui Wang; Lijuan Jiang; Wenwen Qu; Qinghao Hu 004; Guoteng Wang; Qizhen Weng; Hang Yan 001; Xingcheng Zhang; Xipeng Qiu; Dahua Lin; et al. (CoRR, 2024)

Deep Learning Workload Scheduling in GPU Datacenters: A Survey. - Zhisheng Ye 002; Wei Gao; Qinghao Hu 004; Peng Sun 006; Xiaolin Wang 001; Yingwei Luo; Tianwei Zhang 004; Yonggang Wen 001 (ACM Comput. Surv., 2024)

UniSched: A Unified Scheduler for Deep Learning Training Jobs With Different User Demands. - Wei Gao; Zhisheng Ye 002; Peng Sun 006; Tianwei Zhang 004; Yonggang Wen 001 (IEEE Trans. Computers, 2024)

GreenFlow: A Carbon-Efficient Scheduler for Deep Learning Workloads. - Diandian Gu; Yihao Zhao; Peng Sun 006; Xin Jin 008; Xuanzhe Liu (IEEE Trans. Parallel Distributed Syst., 2025)

SPPO:Efficient Long-sequence LLM Training via Adaptive Sequence Pipeline Parallel Offloading. - Qiaoling Chen; Shenggui Li; Wei Gao; Peng Sun 006; Yonggang Wen 001; Tianwei Zhang 004 (CoRR, 2025)

Rethinking Key-Value Cache Compression Techniques for Large Language Model Serving. - Wei Gao; Xinyu Zhou; Peng Sun 006; Tianwei Zhang 004; Yonggang Wen 001 (CoRR, 2025)

SeaLLM: Service-Aware and Latency-Optimized Resource Sharing for Large Language Model Inference. - Yihao Zhao; Jiadun Chen; Peng Sun 006; Lei Li; Xuanzhe Liu; Xin Jin 008 (CoRR, 2025)

IceFrog: A Layer-Elastic Scheduling System for Deep Learning Training in GPU Clusters. - Wei Gao; Zhuoyuan Ouyang; Peng Sun 006; Tianwei Zhang 004; Yonggang Wen 001 (IEEE Trans. Parallel Distributed Syst., 2025)