Pangu Ultra MoE: How to Train Your Big MoE on Ascend NPUs. - Yehui Tang; Yichun Yin; Yaoyuan Wang; Hang Zhou; Yu Pan; Wei Guo 006; Zhiguo Zhang; Miao Rang; Fangcheng Liu; Naifu Zhang; Binghan Li; Yonghan Dong; et al. (CoRR, 2025)

MoESD: Unveil Speculative Decoding's Potential for Accelerating Sparse MoE. - Zongle Huang; Lei Zhu; Zongyuan Zhan; Ting Hu; Weikai Mao; Xianzhi Yu; Yongpan Liu; Tianyu Zhang (CoRR, 2025)