Temporal Scaling Law for Large Language Models. - Yizhe Xiong; Xiansheng Chen; Xin Ye; Hui Chen 013; Zijia Lin; Haoran Lian; Jianwei Niu 002; Guiguang Ding (CoRR, 2024)

Scaffold-BPE: Enhancing Byte Pair Encoding with Simple and Effective Scaffold Token Removal. - Haoran Lian; Yizhe Xiong; Jianwei Niu 002; Shasha Mo; Zhenpeng Su; Zijia Lin; Peng Liu; Hui Chen 013; Guiguang Ding (CoRR, 2024)

MaskMoE: Boosting Token-Level Learning via Routing Mask in Mixture-of-Experts. - Zhenpeng Su; Zijia Lin; Xue Bai; Xing Wu 002; Yizhe Xiong; Haoran Lian; Guangyuan Ma; Hui Chen 013; Guiguang Ding; Wei Zhou 019; Songlin Hu 001 (CoRR, 2024)

Scaffold-BPE: Enhancing Byte Pair Encoding for Large Language Models with Simple and Effective Scaffold Token Removal. - Haoran Lian; Yizhe Xiong; Jianwei Niu 002; Shasha Mo; Zhenpeng Su; Zijia Lin; Hui Chen 013; Jungong Han; Guiguang Ding (AAAI, 2025)

Breaking the Stage Barrier: A Novel Single-Stage Approach to Long Context Extension for Large Language Models. - Haoran Lian; Junmin Chen; Wei Huang; Yizhe Xiong; Wenping Hu; Guiguang Ding; Hui Chen 013; Jianwei Niu 002; Zijia Lin; Fuzheng Zhang; Di Zhang (COLING, 2025)

LBPE: Long-token-first Tokenization to Improve Large Language Models. - Haoran Lian; Yizhe Xiong; Zijia Lin; Jianwei Niu 002; Shasha Mo; Hui Chen 013; Peng Liu; Guiguang Ding (ICASSP, 2025)

UniAttn: Reducing Inference Costs via Softmax Unification for Post-Training LLMs. - Yizhe Xiong; Wei Huang; Xin Ye; Hui Chen 013; Zijia Lin; Haoran Lian; Zhenpeng Su; Jungong Han; Guiguang Ding (CoRR, 2025)