A Chinese Machine Reading Comprehension Dataset Automatic Generated Based on Knowledge Graph. - Hanyu Zhao; Sha Yuan; Jiahong Leng; Xiang Pan 001; Zhao Xue; Quanyue Ma; Yangxiao Liang (CCL, 2021)

AquilaMoE: Efficient Training for MoE Models with Scale-Up and Scale-Out Strategies. - Bo-Wen Zhang 011; Liangdong Wang; Ye Yuan 016; Jijie Li; Shuhao Gu; Mengdi Zhao; Xinya Wu; Guang Liu 006; Chengwei Wu; Hanyu Zhao; Li Du; Yiming Ju; et al. (CoRR, 2024)

CCI3.0-HQ: a large-scale Chinese dataset of high quality designed for pre-training large language models. - Liangdong Wang; Bowen Zhang 011; Chengwei Wu; Hanyu Zhao; Xiaofeng Shi; Shuhao Gu; Jijie Li; Quanyue Ma; Tengfei Pan; Guang Liu 006 (CoRR, 2024)