Auto-MAP: A DQN Framework for Exploring Distributed Execution Plans for DNN Workloads. - Siyu Wang 006; Yi Rong; Shiqing Fan; Zhen Zheng; Lansong Diao; Guoping Long; Jun Yang 052; Xiaoyong Liu; Wei Lin 016 (CoRR, 2020)

DAPPLE: a pipelined data parallel approach for training large models. - Shiqing Fan; Yi Rong; Chen Meng; Zongyan Cao; Siyu Wang 006; Zhen Zheng; Chuan Wu 001; Guoping Long; Jun Yang 052; Lixue Xia; Lansong Diao; Xiaoyong Liu; et al. (PPoPP, 2021)

Accelerating large-scale distributed neural network training with SPMD parallelism. - Shiwei Zhang 002; Lansong Diao; Chuan Wu 001; Siyu Wang 006; Wei Lin 016 (SoCC, 2022)

Optimizing DNN Compilation for Distributed Training With Joint OP and Tensor Fusion. - Xiaodong Yi 001; Shiwei Zhang 002; Lansong Diao; Chuan Wu 001; Zhen Zheng; Shiqing Fan; Siyu Wang 006; Jun Yang 052; Wei Lin 016 (IEEE Trans. Parallel Distributed Syst., 2022)

Auto-Parallelizing Large Models with Rhino: A Systematic Approach on Production AI Platform. - Shiwei Zhang 002; Lansong Diao; Siyu Wang 006; Zongyan Cao; Yiliang Gu; Chang Si; Ziji Shi; Zhen Zheng; Chuan Wu 001; Wei Lin 016 (CoRR, 2023)

Ada-Grouper: Accelerating Pipeline Parallelism in Preempted Network by Adaptive Group-Scheduling for Micro-Batches. - Siyu Wang 006; Zongyan Cao; Chang Si; Lansong Diao; Jiamang Wang; Wei Lin 016 (CoRR, 2023)

Expediting Distributed DNN Training With Device Topology-Aware Graph Deployment. - Shiwei Zhang 002; Xiaodong Yi 001; Lansong Diao; Chuan Wu 001; Siyu Wang 006; Wei Lin 016 (IEEE Trans. Parallel Distributed Syst., 2023)

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis. - Shiwei Zhang 002; Lansong Diao; Chuan Wu 001; Zongyan Cao; Siyu Wang 006; Wei Lin 016 (Zenodo, 2023)

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis. - Shiwei Zhang 002; Lansong Diao; Chuan Wu 001; Zongyan Cao; Siyu Wang 006; Wei Lin 016 (Zenodo, 2023)

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis. - Shiwei Zhang 002; Lansong Diao; Chuan Wu 001; Zongyan Cao; Siyu Wang 006; Wei Lin 016 (EuroSys, 2024)

Concerto: Automatic Communication Optimization and Scheduling for Large-Scale Deep Learning. - Shenggan Cheng; Shengjie Lin; Lansong Diao; Hao Wu 077; Siyu Wang 006; Chang Si; Ziming Liu; Xuanlei Zhao; Jiangsu Du; Wei Lin 016; Yang You 001 (ASPLOS (1), 2025)

DyOrc: Efficient Serving of Dynamic Machine Learning Workflows. - Shiwei Zhang 002; Lansong Diao; Zisheng Meng; Siyu Wang 006; Wei Lin 016; Chuan Wu 001 (SoCC, 2025)