Optimizing distributed training deployment in heterogeneous GPU clusters. - Xiaodong Yi 001; Shiwei Zhang 002; Ziyue Luo; Guoping Long; Lansong Diao; Chuan Wu 001; Zhen Zheng; Jun Yang 052; Wei Lin 016 (CoNEXT, 2020)

Accelerating large-scale distributed neural network training with SPMD parallelism. - Shiwei Zhang 002; Lansong Diao; Chuan Wu 001; Siyu Wang; Wei Lin 016 (SoCC, 2022)

Optimizing DNN Compilation for Distributed Training With Joint OP and Tensor Fusion. - Xiaodong Yi 001; Shiwei Zhang 002; Lansong Diao; Chuan Wu 001; Zhen Zheng; Shiqing Fan; Siyu Wang; Jun Yang 052; Wei Lin 016 (IEEE Trans. Parallel Distributed Syst., 2022)

Auto-Parallelizing Large Models with Rhino: A Systematic Approach on Production AI Platform. - Shiwei Zhang 002; Lansong Diao; Siyu Wang; Zongyan Cao; Yiliang Gu; Chang Si; Ziji Shi; Zhen Zheng; Chuan Wu 001; Wei Lin 016 (CoRR, 2023)

Expediting Distributed DNN Training With Device Topology-Aware Graph Deployment. - Shiwei Zhang 002; Xiaodong Yi 001; Lansong Diao; Chuan Wu 001; Siyu Wang; Wei Lin 016 (IEEE Trans. Parallel Distributed Syst., 2023)

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis. - Shiwei Zhang 002; Lansong Diao; Chuan Wu 001; Zongyan Cao; Siyu Wang; Wei Lin 016 (Zenodo, 2023)

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis. - Shiwei Zhang 002; Lansong Diao; Chuan Wu 001; Zongyan Cao; Siyu Wang; Wei Lin 016 (Zenodo, 2023)

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis. - Shiwei Zhang 002; Lansong Diao; Chuan Wu 001; Zongyan Cao; Siyu Wang; Wei Lin 016 (EuroSys, 2024)