Fanxin Li

According to our database, Fanxin Li authored at least 7 papers between 2020 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

PipeMesh: Achieving Memory-Efficient Computation-Communication Overlap for Training Large Language Models.

Fanxin Li, Shixiong Zhao, Yuhao Qing, Jianyu Jiang, Xusheng Chen, Heming Cui

IEEE Trans. Parallel Distributed Syst., September, 2025

Hecate: Unlocking Efficient Sparse Model Training via Fully Sharded Sparse Data Parallelism.

Yuhao Qing, Guichao Zhu, Fanxin Li, Lintian Lei, Zekai Sun, Xiuxian Guan, Shixiong Zhao, Xusheng Chen, Dong Huang, Sen Wang, Heming Cui

CoRR, February, 2025

FoldMoE: Efficient Long Sequence MoE Training via Attention-MoE Pipelining.

Guichao Zhu, Lintian Lei, Yuhao Qing, Yichao Fu, Fanxin Li, Dong Huang, Zekai Sun, Heming Cui

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

2023

Fold3D: Rethinking and Parallelizing Computational and Communicational Tasks in the Training of Large DNN Models.

Fanxin Li, Shixiong Zhao, Yuhao Qing, Xusheng Chen, Xiuxian Guan, Sen Wang, Gong Zhang, Heming Cui

IEEE Trans. Parallel Distributed Syst., May, 2023

2022

vPipe: A Virtualized Acceleration System for Achieving Efficient and Scalable Pipeline Parallel DNN Training.

Shixiong Zhao, Fanxin Li, Xusheng Chen, Xiuxian Guan, Jianyu Jiang, Dong Huang, Yuhao Qing, Sen Wang, Peng Wang, Gong Zhang, Cheng Li, Ping Luo, Heming Cui

IEEE Trans. Parallel Distributed Syst., 2022

NASPipe: high performance and reproducible pipeline parallel supernet training via causal synchronous parallelism.

Shixiong Zhao, Fanxin Li, Xusheng Chen, Tianxiang Shen, Li Chen, Sen Wang, Nicholas Zhang, Cheng Li, Heming Cui

Proceedings of the ASPLOS '22: 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Lausanne, Switzerland, 28 February 2022, 2022

2020

HAMS: High Availability for Distributed Machine Learning Service Graphs.

Shixiong Zhao, Xusheng Chen, Cheng Wang, Fanxin Li, Qi Ji, Heming Cui, Cheng Li, Sen Wang

Proceedings of the 50th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, 2020