Yuan 1.0: Large-Scale Pre-trained Language Model in Zero-Shot and Few-Shot Learning. - Shaohua Wu; Xudong Zhao; Tong Yu; Rongguo Zhang; Chong Shen; Hongli Liu; Feng Li; Hong Zhu; Jiangang Luo; Liang Xu 011; Xuanwei Zhang (CoRR, 2021)

YUAN 2.0: A Large Language Model with Localized Filtering-based Attention. - Shaohua Wu; Xudong Zhao; Shenling Wang 002; Jiangang Luo; Lingjun Li; Xi Chen; Bing Zhao; Wei Wang 100; Tong Yu; Rongguo Zhang; Jiahua Zhang; Chao Wang (CoRR, 2023)

Yuan 2.0-M32: Mixture of Experts with Attention Router. - Shaohua Wu; Jiangang Luo; Xi Chen; Lingjun Li; Xudong Zhao; Tong Yu; Chao Wang; Yue Wang; Fei Wang; Weixu Qiao; Houbo He; Zeru Zhang; et al. (CoRR, 2024)