Demystifying Workload Imbalances in Large Transformer Model Training over Variable-length Sequences. - Haoyang Li; Fangcheng Fu; Sheng Lin; Hao Ge; Xuanyu Wang; Jiawen Niu; Jie Jiang 015; Bin Cui 001 (CoRR, 2024)

Hetu v2: A General and Scalable Deep Learning System with Hierarchical and Heterogeneous Single Program Multiple Data Annotations. - Haoyang Li; Fangcheng Fu; Hao Ge; Sheng Lin; Xuanyu Wang; Jiawen Niu; Xupeng Miao; Bin Cui 001 (CoRR, 2025)

LobRA: Multi-tenant Fine-tuning over Heterogeneous Data. - Sheng Lin; Fangcheng Fu; Haoyang Li; Hao Ge; Xuanyu Wang; Jiawen Niu; Yaofeng Tu; Bin Cui 001 (Proc. VLDB Endow., 2025)

Malleus: Straggler-Resilient Hybrid Parallel Training of Large-scale Models via Malleable Data and Model Parallelization. - Haoyang Li; Fangcheng Fu; Hao Ge; Sheng Lin; Xuanyu Wang; Jiawen Niu; Yujie Wang; Hailin Zhang 004; Xiaonan Nie; Bin Cui 001 (Proc. ACM Manag. Data, 2025)