FoldMoE: Efficient Long Sequence MoE Training via Attention-MoE Pipelining. - Guichao Zhu; Lintian Lei; Yuhao Qing; Yichao Fu; Fanxin Li; Dong Huang 005; Zekai Sun; Heming Cui (ACL (1), 2025)

Hecate: Unlocking Efficient Sparse Model Training via Fully Sharded Sparse Data Parallelism. - Yuhao Qing; Guichao Zhu; Fanxin Li; Lintian Lei; Zekai Sun; Xiuxian Guan; Shixiong Zhao; Xusheng Chen; Dong Huang 005; Sen Wang 004; Heming Cui (CoRR, 2025)