Robust Lottery Tickets for Pre-trained Language Models. - Rui Zheng; Bao Rong; Yuhao Zhou 005; Di Liang; Sirui Wang; Wei Wu 014; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (ACL (1), 2022)

Robust Lottery Tickets for Pre-trained Language Models. - Rui Zheng; Rong Bao; Yuhao Zhou 005; Di Liang; Sirui Wang; Wei Wu 014; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (CoRR, 2022)

Detecting Adversarial Samples through Sharpness of Loss Landscape. - Rui Zheng; Shihan Dou; Yuhao Zhou 005; Qin Liu 010; Tao Gui; Qi Zhang 001; Zhongyu Wei; Xuanjing Huang 001; Menghan Zhang (ACL (Findings), 2023)

Self-Polish: Enhance Reasoning in Large Language Models via Problem Refinement. - Zhiheng Xi; Senjie Jin; Yuhao Zhou 005; Rui Zheng; Songyang Gao; Jia Liu; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (EMNLP (Findings), 2023)

Self-Polish: Enhance Reasoning in Large Language Models via Problem Refinement. - Zhiheng Xi; Senjie Jin; Yuhao Zhou 005; Rui Zheng; Songyang Gao; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (CoRR, 2023)

Secrets of RLHF in Large Language Models Part I: PPO. - Rui Zheng; Shihan Dou; Songyang Gao; Yuan Hua; Wei Shen; Binghai Wang; Yan Liu 002; Senjie Jin; Qin Liu 010; Yuhao Zhou 005; Limao Xiong; Lu Chen; et al. (CoRR, 2023)

The Rise and Potential of Large Language Model Based Agents: A Survey. - Zhiheng Xi; Wenxiang Chen; Xin Guo; Wei He 024; Yiwen Ding; Boyang Hong; Ming Zhang 030; Junzhe Wang 001; Senjie Jin; Enyu Zhou; Rui Zheng; Xiaoran Fan; et al. (CoRR, 2023)

LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment. - Shihan Dou; Enyu Zhou; Yan Liu 002; Songyang Gao; Jun Zhao 019; Wei Shen; Yuhao Zhou 005; Zhiheng Xi; Xiao Wang 001; Xiaoran Fan; Shiliang Pu; Jiang Zhu; et al. (CoRR, 2023)

StepCoder: Improving Code Generation with Reinforcement Learning from Compiler Feedback. - Shihan Dou; Yan Liu 002; Haoxiang Jia; Enyu Zhou; Limao Xiong; Junjie Shan; Caishuang Huang; Xiao Wang 001; Xiaoran Fan; Zhiheng Xi; Yuhao Zhou 005; Tao Ji; et al. (ACL (1), 2024)

LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin. - Shihan Dou; Enyu Zhou; Yan Liu 002; Songyang Gao; Wei Shen; Limao Xiong; Yuhao Zhou 005; Xiao Wang 001; Zhiheng Xi; Xiaoran Fan; Shiliang Pu; Jiang Zhu; et al. (ACL (1), 2024)

Subspace Defense: Discarding Adversarial Perturbations by Learning a Subspace for Clean Signals. - Rui Zheng; Yuhao Zhou 005; Zhiheng Xi; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (LREC/COLING, 2024)

ORTicket: Let One Robust BERT Ticket Transfer across Different Tasks. - Yuhao Zhou 005; Wenxiang Chen; Rui Zheng; Zhiheng Xi; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (LREC/COLING, 2024)

Improving Discriminative Capability of Reward Models in RLHF Using Contrastive Learning. - Lu Chen; Rui Zheng; Binghai Wang; Senjie Jin; Caishuang Huang; Junjie Ye 005; Zhihao Zhang 002; Yuhao Zhou 005; Zhiheng Xi; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (EMNLP, 2024)

Reward Modeling Requires Automatic Adjustment Based on Data Quality. - Binghai Wang; Rui Zheng; Lu Chen; Zhiheng Xi; Wei Shen; Yuhao Zhou 005; Dong Yan; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (EMNLP (Findings), 2024)

Improving Generalization of Alignment with Human Preferences through Group Invariant Learning. - Rui Zheng; Wei Shen; Yuan Hua; Wenbin Lai; Shihan Dou; Yuhao Zhou 005; Zhiheng Xi; Xiao Wang 001; Haoran Huang; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (ICLR, 2024)

Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning. - Zhiheng Xi; Wenxiang Chen; Boyang Hong; Senjie Jin; Rui Zheng; Wei He 024; Yiwen Ding; Shichun Liu; Xin Guo; Junzhe Wang 001; Honglin Guo; Wei Shen; et al. (ICML, 2024)

Secrets of RLHF in Large Language Models Part II: Reward Modeling. - Binghai Wang; Rui Zheng; Lu Chen; Yan Liu 002; Shihan Dou; Caishuang Huang; Wei Shen; Senjie Jin; Enyu Zhou; Chenyu Shi; Songyang Gao; Nuo Xu; et al. (CoRR, 2024)

MouSi: Poly-Visual-Expert Vision-Language Models. - Xiaoran Fan; Tao Ji; Changhao Jiang; Shuo Li; Senjie Jin; Sirui Song; Junke Wang; Boyang Hong; Lu Chen; Guodong Zheng; Ming Zhang 030; Caishuang Huang; et al. (CoRR, 2024)

StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback. - Shihan Dou; Yan Liu 002; Haoxiang Jia; Limao Xiong; Enyu Zhou; Wei Shen; Junjie Shan; Caishuang Huang; Xiao Wang 001; Xiaoran Fan; Zhiheng Xi; Yuhao Zhou 005; et al. (CoRR, 2024)

What's Wrong with Your Code Generated by Large Language Models? An Extensive Study. - Shihan Dou; Haoxiang Jia; Shenxi Wu; Huiyuan Zheng; Weikang Zhou; Muling Wu; Mingxu Chai; Jessica Fan; Caishuang Huang; Yunbo Tao; Yan Liu 002; Enyu Zhou; et al. (CoRR, 2024)

CC2Vec: Combining Typed Tokens with Contrastive Learning for Effective Code Clone Detection. - Shihan Dou; Yueming Wu 001; Haoxiang Jia; Yuhao Zhou 005; Yan Liu 012; Yang Liu 003 (Proc. ACM Softw. Eng., 2024)

The rise and potential of large language model based agents: a survey. - Zhiheng Xi; Wenxiang Chen; Xin Guo; Wei He 024; Yiwen Ding; Boyang Hong; Ming Zhang 030; Junzhe Wang 001; Senjie Jin; Enyu Zhou; Rui Zheng; Xiaoran Fan; et al. (Sci. China Inf. Sci., 2025)

EliteKV: Scalable KV Cache Compression via RoPE Frequency Selection and Joint Low-Rank Projection. - Yuhao Zhou 005; Sirui Song; Boyang Liu; Zhiheng Xi; Senjie Jin; Xiaoran Fan; Zhihao Zhang 002; Wei Li; Xuanjing Huang 001 (CoRR, 2025)

Speech-Language Models with Decoupled Tokenizers and Multi-Token Prediction. - Xiaoran Fan; Zhichao Sun; Yangfan Gao; Jingfei Xiong; Hang Yan 001; Yifei Cao; Jiajun Sun; Shuo Li; Zhihao Zhang 002; Zhiheng Xi; Yuhao Zhou 005; Senjie Jin; et al. (CoRR, 2025)

Reinforcement Fine-Tuning Enables MLLMs Learning Novel Tasks Stably. - Zhihao Zhang 002; Qiaole Dong; Qi Zhang 001; Jun Zhao 019; Enyu Zhou; Zhiheng Xi; Senjie Jin; Xiaoran Fan; Yuhao Zhou 005; Yanwei Fu 001; Tao Ji; Tao Gui; et al. (CoRR, 2025)

Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination. - Mingqi Wu; Zhihao Zhang 002; Qiaole Dong; Zhiheng Xi; Jun Zhao 019; Senjie Jin; Xiaoran Fan; Yuhao Zhou 005; Yanwei Fu 001; Qin Liu 010; Songyang Zhang 001; Qi Zhang 001 (CoRR, 2025)