Pangu Ultra MoE: How to Train Your Big MoE on Ascend NPUs. - Yehui Tang; Yichun Yin; Yaoyuan Wang; Hang Zhou; Yu Pan; Wei Guo 006; Zhiguo Zhang; Miao Rang; Fangcheng Liu; Naifu Zhang; Binghan Li; Yonghan Dong; et al. (CoRR, 2025)

Pangu Pro MoE: Mixture of Grouped Experts for Efficient Sparsity. - Yehui Tang; Xiaosong Li; Fangcheng Liu; Wei Guo 006; Hang Zhou; Yaoyuan Wang; Kai Han 002; Xianzhi Yu; Jinpeng Li 004; Hui Zang; Fei Mi; Xiaojun Meng; et al. (CoRR, 2025)