Improving Reasoning Capabilities in Small Models through Mixture-of-layers Distillation with Stepwise Attention on Key Information. - Yao Chen 009; Jiawei Sheng; Wenyuan Zhang 002; Tingwen Liu (EMNLP, 2025)

ATTNPO: Attention-Guided Process Supervision for Efficient Reasoning. - Shuaiyi Nie; Siyu Ding; Wenyuan Zhang 002; Linhao Yu; Tianmeng Yang; Yao Chen 009; Tingwen Liu; Weichong Yin; Yu Sun; Hua Wu 003 (CoRR, 2026)

Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Looping. - Yao Chen 009; Yilong Chen; Yinqi Yang; Junyuan Shang; Zhenyu Zhang 006; Zefeng Zhang 001; Shuaiyi Nie; Shuohuan Wang; Yu Sun; Hua Wu 003; Haifeng Wang 001; Tingwen Liu (CoRR, 2026)