ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation. - Shuohuan Wang; Yu Sun 004; Yang Xiang; Zhihua Wu; Siyu Ding; Weibao Gong; Shikun Feng; Junyuan Shang; Yanbin Zhao; Chao Pang; Jiaxiang Liu 004; Xuyi Chen; et al. (CoRR, 2021)

SE-MoE: A Scalable and Efficient Mixture-of-Experts Distributed Training and Inference System. - Liang Shen; Zhihua Wu; Weibao Gong; Hongxiang Hao; Yangfan Bai; HuaChao Wu; Xinxuan Wu; Haoyi Xiong; Dianhai Yu; Yanjun Ma (CoRR, 2022)