Prediction Is All MoE Needs: Expert Load Distribution Goes from Fluctuating to Stabilizing. - Peizhuang Cong; Aomufei Yuan; Shimao Chen; Yuxuan Tian; Bowen Ye; Tong Yang 003 (CoRR, 2024)

INT-FlashAttention: Enabling Flash Attention for INT8 Quantization. - Shimao Chen; Zirui Liu 002; Zhiying Wu; Ce Zheng; Peizhuang Cong; Zihan Jiang; Yuhan Wu 001; Lei Su; Tong Yang 003 (CoRR, 2024)

MiMo: Unlocking the Reasoning Potential of Language Model - From Pretraining to Posttraining. - Bingquan Xia; Bowen Shen; Cici; Dawei Zhu; Di Zhang; Gang Wang; Hailin Zhang 001; Huaqiu Liu; Jiebao Xiao; Jinhao Dong; Liang Zhao; Peidian Li; et al. (CoRR, 2025)

MiMo-VL Technical Report. - Zihao Yue; Zhenru Lin; Yifan Song; Weikun Wang; Shuhuai Ren; Shuhao Gu; Shicheng Li; Peidian Li; Liang Zhao; Lei Li; Kainan Bao; Hao Tian 006; et al. (CoRR, 2025)

iFairy: the First 2-bit Complex LLM with All Parameters in {±1, ± i}. - Feiyu Wang; Guoan Wang; Yihao Zhang; Shengfan Wang; Weitao Li; Bokai Huang; Shimao Chen; Zihan Jiang; Rui Xu; Tong Yang (CoRR, 2025)