Efficient Adversarial Training with Robust Early-Bird Tickets. - Zhiheng Xi; Rui Zheng; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (EMNLP, 2022)

Connectivity Patterns are Task Embeddings. - Zhiheng Xi; Rui Zheng; Yuansen Zhang; Xuanjing Huang 001; Zhongyu Wei; Minlong Peng; Mingming Sun 001; Qi Zhang 001; Tao Gui (ACL (Findings), 2023)

Characterizing the Impacts of Instances on Robustness. - Rui Zheng; Zhiheng Xi; Qin Liu 010; Wenbin Lai; Tao Gui; Qi Zhang 001; Xuanjing Huang 001; Jin Ma 003; Ying Shan; Weifeng Ge (ACL (Findings), 2023)

Self-Polish: Enhance Reasoning in Large Language Models via Problem Refinement. - Zhiheng Xi; Senjie Jin; Yuhao Zhou; Rui Zheng; Songyang Gao; Jia Liu; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (EMNLP (Findings), 2023)

RealBehavior: A Framework for Faithfully Characterizing Foundation Models' Human-like Behavior Mechanisms. - Enyu Zhou; Rui Zheng; Zhiheng Xi; Songyang Gao; Xiaoran Fan; Zichu Fei; Jingting Ye; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (EMNLP (Findings), 2023)

Self-Polish: Enhance Reasoning in Large Language Models via Problem Refinement. - Zhiheng Xi; Senjie Jin; Yuhao Zhou; Rui Zheng; Songyang Gao; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (CoRR, 2023)

Secrets of RLHF in Large Language Models Part I: PPO. - Rui Zheng; Shihan Dou; Songyang Gao; Yuan Hua; Wei Shen; Binghai Wang; Yan Liu 002; Senjie Jin; Qin Liu 010; Yuhao Zhou; Limao Xiong; Lu Chen; et al. (CoRR, 2023)

Towards Understanding the Capability of Large Language Models on Code Clone Detection: A Survey. - Shihan Dou; Junjie Shan; Haoxiang Jia; Wenhao Deng 001; Zhiheng Xi; Wei He 024; Yueming Wu 001; Tao Gui; Yang Liu 003; Xuanjing Huang 001 (CoRR, 2023)

The Rise and Potential of Large Language Model Based Agents: A Survey. - Zhiheng Xi; Wenxiang Chen; Xin Guo; Wei He 024; Yiwen Ding; Boyang Hong; Ming Zhang 030; Junzhe Wang; Senjie Jin; Enyu Zhou; Rui Zheng; Xiaoran Fan; et al. (CoRR, 2023)

TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models. - Xiao Wang 001; Yuansen Zhang; Tianze Chen; Songyang Gao; Senjie Jin; Xianjun Yang; Zhiheng Xi; Rui Zheng; Yicheng Zou; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (CoRR, 2023)

LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment. - Shihan Dou; Enyu Zhou; Yan Liu 002; Songyang Gao; Jun Zhao 019; Wei Shen; Yuhao Zhou; Zhiheng Xi; Xiao Wang 001; Xiaoran Fan; Shiliang Pu; Jiang Zhu; et al. (CoRR, 2023)

StepCoder: Improving Code Generation with Reinforcement Learning from Compiler Feedback. - Shihan Dou; Yan Liu 002; Haoxiang Jia; Enyu Zhou; Limao Xiong; Junjie Shan; Caishuang Huang; Xiao Wang 001; Xiaoran Fan; Zhiheng Xi; Yuhao Zhou; Tao Ji; et al. (ACL (1), 2024)

LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin. - Shihan Dou; Enyu Zhou; Yan Liu 002; Songyang Gao; Wei Shen; Limao Xiong; Yuhao Zhou; Xiao Wang 001; Zhiheng Xi; Xiaoran Fan; Shiliang Pu; Jiang Zhu; et al. (ACL (1), 2024)

RoCoIns: Enhancing Robustness of Large Language Models through Code-Style Instructions. - Yuansen Zhang; Xiao Wang 001; Zhiheng Xi; Han Xia; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (LREC/COLING, 2024)

Subspace Defense: Discarding Adversarial Perturbations by Learning a Subspace for Clean Signals. - Rui Zheng; Yuhao Zhou; Zhiheng Xi; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (LREC/COLING, 2024)

ORTicket: Let One Robust BERT Ticket Transfer across Different Tasks. - Yuhao Zhou; Wenxiang Chen; Rui Zheng; Zhiheng Xi; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (LREC/COLING, 2024)

Improving Discriminative Capability of Reward Models in RLHF Using Contrastive Learning. - Lu Chen; Rui Zheng; Binghai Wang; Senjie Jin; Caishuang Huang; Junjie Ye; Zhihao Zhang 002; Yuhao Zhou; Zhiheng Xi; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (EMNLP, 2024)

Reward Modeling Requires Automatic Adjustment Based on Data Quality. - Binghai Wang; Rui Zheng; Lu Chen; Zhiheng Xi; Wei Shen; Yuhao Zhou; Dong Yan; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (EMNLP (Findings), 2024)

Inverse-Q*: Token Level Reinforcement Learning for Aligning Large Language Models Without Preference Data. - Han Xia; Songyang Gao; Qiming Ge; Zhiheng Xi; Qi Zhang 001; Xuanjing Huang 001 (EMNLP (Findings), 2024)

Improving Generalization of Alignment with Human Preferences through Group Invariant Learning. - Rui Zheng; Wei Shen; Yuan Hua; Wenbin Lai; Shihan Dou; Yuhao Zhou; Zhiheng Xi; Xiao Wang; Haoran Huang; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (ICLR, 2024)

Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning. - Zhiheng Xi; Wenxiang Chen; Boyang Hong; Senjie Jin; Rui Zheng; Wei He 024; Yiwen Ding; Shichun Liu; Xin Guo; Junzhe Wang; Honglin Guo; Wei Shen; et al. (ICML, 2024)

Self-Demos: Eliciting Out-of-Demonstration Generalizability in Large Language Models. - Wei He 024; Shichun Liu; Jun Zhao 019; Yiwen Ding; Yi Lu; Zhiheng Xi; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (NAACL-HLT (Findings), 2024)

Secrets of RLHF in Large Language Models Part II: Reward Modeling. - Binghai Wang; Rui Zheng; Lu Chen; Yan Liu 002; Shihan Dou; Caishuang Huang; Wei Shen; Senjie Jin; Enyu Zhou; Chenyu Shi; Songyang Gao; Nuo Xu; et al. (CoRR, 2024)

MouSi: Poly-Visual-Expert Vision-Language Models. - Xiaoran Fan; Tao Ji; Changhao Jiang; Shuo Li; Senjie Jin; Sirui Song; Junke Wang; Boyang Hong; Lu Chen; Guodong Zheng; Ming Zhang 030; Caishuang Huang; et al. (CoRR, 2024)

StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback. - Shihan Dou; Yan Liu 002; Haoxiang Jia; Limao Xiong; Enyu Zhou; Wei Shen; Junjie Shan; Caishuang Huang; Xiao Wang 001; Xiaoran Fan; Zhiheng Xi; Yuhao Zhou; et al. (CoRR, 2024)

EasyJailbreak: A Unified Framework for Jailbreaking Large Language Models. - Weikang Zhou; Xiao Wang 001; Limao Xiong; Han Xia; Yingshuang Gu; Mingxu Chai; Fukang Zhu; Caishuang Huang; Shihan Dou; Zhiheng Xi; Rui Zheng; Songyang Gao; et al. (CoRR, 2024)

AgentGym: Evolving Large Language Model-based Agents across Diverse Environments. - Zhiheng Xi; Yiwen Ding; Wenxiang Chen; Boyang Hong; Honglin Guo; Junzhe Wang; Dingwen Yang; Chenyang Liao; Xin Guo; Wei He 024; Songyang Gao; Lu Chen; et al. (CoRR, 2024)

Toward Optimal LLM Alignments Using Two-Player Games. - Rui Zheng; Hongyi Guo; Zhihan Liu; Xiaoying Zhang; Yuanshun Yao; Xiaojun Xu; Zhaoran Wang 001; Zhiheng Xi; Tao Gui; Qi Zhang 001; Xuanjing Huang 001; Hang Li 001; et al. (CoRR, 2024)

Distill Visual Chart Reasoning Ability from LLMs to MLLMs. - Wei He 024; Zhiheng Xi; Wanxu Zhao; Xiaoran Fan; Yiwen Ding; Zifei Shan; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (CoRR, 2024)

Mitigating Tail Narrowing in LLM Self-Improvement via Socratic-Guided Sampling. - Yiwen Ding; Zhiheng Xi; Wei He 024; Zhuoyuan Li; Yitao Zhai; Xiaowei Shi; Xunliang Cai; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (CoRR, 2024)

Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision. - Zhiheng Xi; Dingwen Yang; Jixuan Huang; Jiafu Tang; Guanyu Li; Yiwen Ding; Wei He 024; Boyang Hong; Shihan Dou; Wenyu Zhan; Xiao Wang 001; Rui Zheng; et al. (CoRR, 2024)

Better Process Supervision with Bi-directional Rewarding Signals. - Wenxiang Chen; Wei He 024; Zhiheng Xi; Honglin Guo; Boyang Hong; Jiazheng Zhang; Nijun Li; Tao Gui; Yun Li; Qi Zhang 001; Xuanjing Huang 001 (ACL (Findings), 2025)

CritiQ: Mining Data Quality Criteria from Human Preferences. - Honglin Guo; Kai Lv 001; Qipeng Guo; Tianyi Liang; Zhiheng Xi; Demin Song; Qiuyinzhe Zhang; Yu Sun 031; Kai Chen 026; Xipeng Qiu; Tao Gui (ACL (1), 2025)

AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments. - Zhiheng Xi; Yiwen Ding; Wenxiang Chen; Boyang Hong; Honglin Guo; Junzhe Wang; Xin Guo; Dingwen Yang; Chenyang Liao; Wei He 024; Songyang Gao; Lu Chen; et al. (ACL (1), 2025)

ToolHop: A Query-Driven Benchmark for Evaluating Large Language Models in Multi-Hop Tool Use. - Junjie Ye; Zhengyin Du; Xuesong Yao; Weijian Lin; Yufei Xu; Zehui Chen; Zaiyuan Wang; Sining Zhu; Zhiheng Xi; Siyu Yuan; Tao Gui; Qi Zhang 001; et al. (ACL (1), 2025)

PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts. - Ming Zhang 030; Yuhui Wang; Yujiong Shen; Tingyi Yang; Changhao Jiang; Yilong Wu; Shihan Dou; Qinhao Chen; Zhiheng Xi; Zhihao Zhang 002; Yi Dong; Zhen Wang 020; et al. (ACL (Findings), 2025)

Are LLMs Rational Investors? A Study on the Financial Bias in LLMs. - Yuhang Zhou; Yuchen Ni; Zhiheng Xi; Zhangyue Yin; Yu He; Gan Yunhui; Xiang Liu; Zhang Jian; Sen Liu; Xipeng Qiu; Yixin Cao; Guangnan Ye; et al. (ACL (Findings), 2025)

Have the VLMs Lost Confidence? A Study of Sycophancy in VLMs. - Shuo Li; Tao Ji; Xiaoran Fan; Linsheng Lu; Leyi Yang; Yuming Yang; Zhiheng Xi; Rui Zheng; Yuran Wang; Xiaohui Zhao; Tao Gui; Qi Zhang 001; et al. (ICLR, 2025)

RMB: Comprehensively benchmarking reward models in LLM alignment. - Enyu Zhou; Guodong Zheng; Binghai Wang; Zhiheng Xi; Shihan Dou; Rong Bao; Wei Shen; Limao Xiong; Jessica Fan; Yurong Mou; Rui Zheng; Tao Gui; et al. (ICLR, 2025)

Mitigating Tail Narrowing in LLM Self-Improvement via Socratic-Guided Sampling. - Yiwen Ding; Zhiheng Xi; Wei He 024; Lizhuoyuan Lizhuoyuan; Yitao Zhai; Shi Xiaowei; Xunliang Cai; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (NAACL (Long Papers), 2025)

The rise and potential of large language model based agents: a survey. - Zhiheng Xi; Wenxiang Chen; Xin Guo; Wei He 024; Yiwen Ding; Boyang Hong; Ming Zhang 030; Junzhe Wang; Senjie Jin; Enyu Zhou; Rui Zheng; Xiaoran Fan; et al. (Sci. China Inf. Sci., 2025)

MathCritique-76k. - Dingwen Yang; Zhiheng Xi; Jiafu Tang; Jixuan Huang (IEEE DataPort, 2025)

Agent-R: Training Language Model Agents to Reflect via Iterative Self-Training. - Siyu Yuan; Zehui Chen; Zhiheng Xi; Junjie Ye; Zhengyin Du; Jiecao Chen (CoRR, 2025)

Predicting Large Language Model Capabilities on Closed-Book QA Tasks Using Only Information Available Prior to Training. - Changhao Jiang; Ming Zhang 030; Junjie Ye; Xiaoran Fan; Yifei Cao; Jiajun Sun; Zhiheng Xi; Shihan Dou; Yi Dong; Yujiong Shen; Jingqi Tong; Zhen Wang 020; et al. (CoRR, 2025)

CritiQ: Mining Data Quality Criteria from Human Preferences. - Honglin Guo; Kai Lv 001; Qipeng Guo; Tianyi Liang; Zhiheng Xi; Demin Song; Qi Zhang 001; Yu Sun 031; Kai Chen 026; Xipeng Qiu; Tao Gui (CoRR, 2025)

EliteKV: Scalable KV Cache Compression via RoPE Frequency Selection and Joint Low-Rank Projection. - Yuhao Zhou; Sirui Song; Boyang Liu; Zhiheng Xi; Senjie Jin; Xiaoran Fan; Zhihao Zhang 002; Wei Li; Xuanjing Huang 001 (CoRR, 2025)

Better Process Supervision with Bi-directional Rewarding Signals. - Wenxiang Chen; Wei He 024; Zhiheng Xi; Honglin Guo; Boyang Hong; Jiazheng Zhang; Rui Zheng; Nijun Li; Tao Gui; Yun Li; Qi Zhang 001; Xuanjing Huang 001 (CoRR, 2025)

Mitigating Object Hallucinations in MLLMs via Multi-Frequency Perturbations. - Shuo Li; Jiajun Sun; Guodong Zheng; Xiaoran Fan; Yujiong Shen; Yi Lu; Zhiheng Xi; Yuming Yang; Wenming Tan; Tao Ji; Tao Gui; Qi Zhang 001; et al. (CoRR, 2025)

Two Minds Better Than One: Collaborative Reward Modeling for LLM Alignment. - Jiazheng Zhang; Wenqing Jing; Zizhuo Zhang; Zhiheng Xi; Shihan Dou; Rongxiang Weng; Jiahuan Li; Jingang Wang; Mingxu Chai; Shibo Hong; Tao Gui; Qi Zhang 001 (CoRR, 2025)

LLMEval-Med: A Real-world Clinical Benchmark for Medical LLMs with Physician Validation. - Ming Zhang 030; Yujiong Shen; Zelin Li; Huayu Sha; Binze Hu; Yuhui Wang; Chenhao Huang; Shichun Liu; Jingqi Tong; Changhao Jiang; Mingxu Chai; Zhiheng Xi; et al. (CoRR, 2025)

Speech-Language Models with Decoupled Tokenizers and Multi-Token Prediction. - Xiaoran Fan; Zhichao Sun; Yangfan Gao; Jingfei Xiong; Hang Yan 001; Yifei Cao; Jiajun Sun; Shuo Li; Zhihao Zhang 002; Zhiheng Xi; Yuhao Zhou; Senjie Jin; et al. (CoRR, 2025)

Reinforcement Fine-Tuning Enables MLLMs Learning Novel Tasks Stably. - Zhihao Zhang 002; Qiaole Dong; Qi Zhang 001; Jun Zhao 019; Enyu Zhou; Zhiheng Xi; Senjie Jin; Xiaoran Fan; Yuhao Zhou; Yanwei Fu 001; Tao Ji; Tao Gui; et al. (CoRR, 2025)

BMMR: A Large-Scale Bilingual Multimodal Multi-Discipline Reasoning Dataset. - Zhiheng Xi; Guanyu Li; Yutao Fan; Honglin Guo; Yufang Liu; Xiaoran Fan; Jiaqi Liu; Jingchao Ding; Wangmeng Zuo; Zhenfei Yin; Lei Bai 001; Tao Ji; et al. (CoRR, 2025)

Pre-Trained Policy Discriminators are General Reward Models. - Shihan Dou; Shichun Liu; Yuming Yang; Yicheng Zou; Yunhua Zhou; Shuhao Xing; Chenhao Huang; Qiming Ge; Demin Song; Haijun Lv; Songyang Gao; Chengqi Lv; et al. (CoRR, 2025)

Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination. - Mingqi Wu; Zhihao Zhang 002; Qiaole Dong; Zhiheng Xi; Jun Zhao 019; Senjie Jin; Xiaoran Fan; Yuhao Zhou; Yanwei Fu 001; Qin Liu 010; Songyang Zhang; Qi Zhang 001 (CoRR, 2025)

SpeechRole: A Large-Scale Dataset and Benchmark for Evaluating Speech Role-Playing Agents. - Changhao Jiang; Jiajun Sun; Yifei Cao; Jiabao Zhuang; Hui Li; Xiaoran Fan; Ming Zhang 030; Junjie Ye; Shihan Dou; Zhiheng Xi; Jingqi Tong; Yilong Wu; et al. (CoRR, 2025)

VRPO: Rethinking Value Modeling for Robust RL Training under Noisy Supervision. - Dingwei Zhu; Shihan Dou; Zhiheng Xi; Senjie Jin; Guoqiang Zhang; Jiazheng Zhang; Junjie Ye; Mingxu Chai; Enyu Zhou; Ming Zhang 030; Caishuang Huang; Yunke Zhang; et al. (CoRR, 2025)

MagicGUI: A Foundational Mobile GUI Agent with Scalable Data Pipeline and Reinforcement Fine-tuning. - Liujian Tang; Shaokang Dong; Yijia Huang; Minqi Xiang; Hongtao Ruan; Bin Wang; Shuo Li; Zhiheng Xi; Zhihui Cao; Hailiang Pang; Heng Kong; He Yang; et al. (CoRR, 2025)

LLMEval-3: A Large-Scale Longitudinal Study on Robust and Fair Evaluation of Large Language Models. - Ming Zhang 030; Yujiong Shen; Jingyi Deng; Yuhui Wang; Yue Zhang 004; Junzhe Wang; Shichun Liu; Shihan Dou; Huayu Sha; Qiyuan Peng; Changhao Jiang; Jingqi Tong; et al. (CoRR, 2025)

Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments. - Junjie Ye; Changhao Jiang; Zhengyin Du; Yufei Xu; Xuesong Yao; Zhiheng Xi; Xiaoran Fan; Qi Zhang 001; Xuanjing Huang 001; Jiecao Chen (CoRR, 2025)