Shenhan Zhu

According to our database, Shenhan Zhu authored at least 9 papers between 2024 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

Galvatron: An Automatic Distributed System for Efficient Foundation Model Training.

Xinyi Liu, Yujie Wang, Shenhan Zhu, Fangcheng Fu, Qingshuo Liu, Guangming Lin, Bin Cui

CoRR, April, 2025

NetMoE: Accelerating MoE Training through Dynamic Sample Placement.

Xinyi Liu, Yujie Wang, Fangcheng Fu, Xupeng Miao, Shenhan Zhu, Xiaonan Nie, Bin Cui

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Spindle: Efficient Distributed Training of Multi-Task Large Models via Wavefront Scheduling.

Yujie Wang, Shenhan Zhu, Fangcheng Fu, Xupeng Miao, Jie Zhang, Juan Zhu, Fan Hong, Yong Li, Bin Cui

Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2025

FlexSP: Accelerating Large Language Model Training via Flexible Sequence Parallelism.

Yujie Wang, Shiju Wang, Shenhan Zhu, Fangcheng Fu, Xinyi Liu, Xuefeng Xiao, Huixia Li, Jiashi Li, Faming Wu, Bin Cui

Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2025

2024

Improving Automatic Parallel Training via Balanced Memory Workload Optimization.

Yujie Wang, Youhe Jiang, Xupeng Miao, Fangcheng Fu, Shenhan Zhu, Xiaonan Nie, Yaofeng Tu, Bin Cui

IEEE Trans. Knowl. Data Eng., 2024

Data-Centric and Heterogeneity-Adaptive Sequence Parallelism for Efficient LLM Training.

Yujie Wang, Shiju Wang, Shenhan Zhu, Fangcheng Fu, Xinyi Liu, Xuefeng Xiao, Huixia Li, Jiashi Li, Faming Wu, Bin Cui

CoRR, 2024

Efficient Multi-Task Large Model Training via Data Heterogeneity-aware Model Management.

Yujie Wang, Shenhan Zhu, Fangcheng Fu, Xupeng Miao, Jie Zhang, Juan Zhu, Fan Hong, Yong Li, Bin Cui

CoRR, 2024

LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing.

Xiaonan Nie, Qibin Liu, Fangcheng Fu, Shenhan Zhu, Xupeng Miao, Xiaoyang Li, Yang Zhang, Shouda Liu, Bin Cui

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024

X-former Elucidator: Reviving Efficient Attention for Long Context Language Modeling.

Xupeng Miao, Shenhan Zhu, Fangcheng Fu, Ziyu Guo, Zhi Yang, Yaofeng Tu, Zhihao Jia, Bin Cui

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, 2024