On Value Discrepancy of Imitation Learning. - Tian Xu 003; Ziniu Li; Yang Yu 001 (CoRR, 2019)

Efficient Exploration by Novelty-Pursuit. - Ziniu Li; Xiong-Hui Chen (DAI, 2020)

Error Bounds of Imitating Policies and Environments. - Tian Xu 003; Ziniu Li; Yang Yu 001 (NeurIPS, 2020)

Solving the Inverse Design Problem of Electrical Fuse With Machine Learning. - Xinjian Huang; Ziniu Li; Zhiyuan Liu; Bin Xiang; Yingsan Geng; Jianhua Wang 003 (IEEE Access, 2020)

Nearly Minimax Optimal Adversarial Imitation Learning with Known and Unknown Transitions. - Tian Xu 003; Ziniu Li; Yang Yu 001 (CoRR, 2021)

HyperDQN: A Randomized Exploration Method for Deep Reinforcement Learning. - Ziniu Li; Yingru Li; Yushun Zhang; Tong Zhang 001; Zhi-Quan Luo (ICLR, 2022)

Rethinking ValueDice: Does It Really Improve Performance? - Ziniu Li; Tian Xu 003; Yang Yu 001; Zhi-Quan Luo (CoRR, 2022)

A Note on Target Q-learning For Solving Finite MDPs with A Generative Oracle. - Ziniu Li; Tian Xu 003; Yang Yu 001 (CoRR, 2022)

Understanding Adversarial Imitation Learning in Small Sample Regime: A Stage-coupled Analysis. - Tian Xu 003; Ziniu Li; Yang Yu 001; Zhi-Quan Luo (CoRR, 2022)

Error Bounds of Imitating Policies and Environments for Reinforcement Learning. - Tian Xu 003; Ziniu Li; Yang Yu 001 (IEEE Trans. Pattern Anal. Mach. Intell., 2022)

Imitation Learning from Imperfection: Theoretical Justifications and Algorithms. - Ziniu Li; Tian Xu 003; Zeyu Qin; Yang Yu 001; Zhi-Quan Luo (NeurIPS, 2023)

Provably Efficient Adversarial Imitation Learning with Unknown Transitions. - Tian Xu 003; Ziniu Li; Yang Yu 001; Zhi-Quan Luo (UAI, 2023)

Theoretical Analysis of Offline Imitation With Supplementary Dataset. - Ziniu Li; Tian Xu 003; Yang Yu 001; Zhi-Quan Luo (CoRR, 2023)

Deploying Offline Reinforcement Learning with Human Feedback. - Ziniu Li; Ke Xu; Liu Liu 014; Lanqing Li; Deheng Ye; Peilin Zhao (CoRR, 2023)

ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models. - Ziniu Li; Tian Xu 003; Yushun Zhang; Yang Yu 001; Ruoyu Sun 001; Zhi-Quan Luo (CoRR, 2023)

Policy Optimization in RLHF: The Impact of Out-of-preference Data. - Ziniu Li; Tian Xu 003; Yang Yu 001 (CoRR, 2023)

Unlocking Black-Box Prompt Tuning Efficiency via Zeroth-Order Optimization. - Heshen Zhan; Congliang Chen; Tian Ding; Ziniu Li; Ruoyu Sun 001 (EMNLP (Findings), 2024)

When is RL better than DPO in RLHF? A Representation and Optimization Perspective. - Ziniu Li; Tian Xu 003; Yang Yu 001 (Tiny Papers @ ICLR, 2024)

ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models. - Ziniu Li; Tian Xu 003; Yushun Zhang; Zhihang Lin; Yang Yu 001; Ruoyu Sun 001; Zhi-Quan Luo (ICML, 2024)

Why Transformers Need Adam: A Hessian Perspective. - Yushun Zhang; Congliang Chen; Tian Ding; Ziniu Li; Ruoyu Sun 001; Zhi-Quan Luo (NeurIPS, 2024)

On the Algorithmic Bias of Aligning Large Language Models with RLHF: Preference Collapse and Matching Regularization. - Jiancong Xiao; Ziniu Li; Xingyu Xie; Emily J. Getzen; Cong Fang 001; Qi Long; Weijie J. Su (CoRR, 2024)

BWArea Model: Learning World Model, Inverse Dynamics, and Policy for Controllable Language Generation. - Chengxing Jia; Pengyuan Wang; Ziniu Li; Yi-Chen Li 001; Zhilong Zhang; Nan Tang; Yang Yu 001 (CoRR, 2024)

Adam-mini: Use Fewer Learning Rates To Gain More. - Yushun Zhang; Congliang Chen; Ziniu Li; Tian Ding; Chenwei Wu 002; Yinyu Ye 001; Zhi-Quan Luo; Ruoyu Sun 001 (CoRR, 2024)

Entropic Distribution Matching in Supervised Fine-tuning of LLMs: Less Overfitting and Better Diversity. - Ziniu Li; Congliang Chen; Tian Xu 003; Zeyu Qin; Jiancong Xiao; Ruoyu Sun 001; Zhi-Quan Luo (CoRR, 2024)

Sensing Jamming Strategy From Limited Observations: An Imitation Learning Perspective. - Youlin Fan; Bo Jiu; Wenqiang Pu; Ziniu Li; Kang Li; Hongwei Liu 001 (IEEE Trans. Signal Process., 2024)

Advancing Zero-shot Text-to-Speech Intelligibility across Diverse Domains via Preference Alignment. - Xueyao Zhang; Yuancheng Wang; Chaoren Wang; Ziniu Li; Zhuo Chen 006; Zhizheng Wu 001 (ACL (1), 2025)

Preserving Diversity in Supervised Fine-Tuning of Large Language Models. - Ziniu Li; Congliang Chen; Tian Xu 003; Zeyu Qin; Jiancong Xiao; Zhi-Quan Luo; Ruoyu Sun 001 (ICLR, 2025)

Understanding and Mitigating Hallucination in Large Vision-Language Models via Modular Attribution and Intervention. - Tianyun Yang; Ziniu Li; Juan Cao 001; Chang Xu (ICLR, 2025)

Adam-mini: Use Fewer Learning Rates To Gain More. - Yushun Zhang; Congliang Chen; Ziniu Li; Tian Ding; Chenwei Wu 002; Diederik P. Kingma; Yinyu Ye 001; Zhi-Quan Luo; Ruoyu Sun 001 (ICLR, 2025)

Enabling Scalable Oversight via Self-Evolving Critic. - Zhengyang Tang; Ziniu Li; Zhenyang Xiao; Tian Ding; Ruoyu Sun 001; Benyou Wang; Dayiheng Liu; Fei Huang 005; Tianyu Liu 001; Bowen Yu 002; Junyang Lin (CoRR, 2025)

RealCritic: Towards Effectiveness-Driven Evaluation of Language Model Critiques. - Zhengyang Tang; Ziniu Li; Zhenyang Xiao; Tian Ding; Ruoyu Sun 001; Benyou Wang; Dayiheng Liu; Fei Huang 005; Tianyu Liu 001; Bowen Yu 002; Junyang Lin (CoRR, 2025)

Controlling Large Language Model with Latent Actions. - Chengxing Jia; Ziniu Li; Pengyuan Wang; Yi-Chen Li 001; Zhenyu Hou; Yuxiao Dong; Yang Yu 001 (CoRR, 2025)

Spectral Policy Optimization: Coloring your Incorrect Reasoning in GRPO. - Peter Chen; Xiaopeng Li; Ziniu Li; Xi Chen; Tianyi Lin (CoRR, 2025)

Quality-Diversity Red-Teaming: Automated Generation of High-Quality and Diverse Attackers for Large Language Models. - Ren-Jian Wang; Ke Xue 001; Zeyu Qin; Ziniu Li; Sheng Tang; Hao-Tian Li; Shengcai Liu; Chao Qian 001 (CoRR, 2025)

A Survey on Large Language Models for Mathematical Reasoning. - Peng-Yuan Wang; Tian-Shuo Liu; Chenyang Wang; Yi-Di Wang; Shu Yan; Cheng-Xing Jia; Xu-Hui Liu; Xin-Wei Chen; Jia-Cheng Xu; Ziniu Li; Yang Yu (CoRR, 2025)

CoRT: Code-integrated Reasoning within Thinking. - Chengpeng Li 001; Zhengyang Tang; Ziniu Li; Mingfeng Xue; Keqin Bao; Tian Ding; Ruoyu Sun 001; Benyou Wang; Xiang Wang 010; Junyang Lin; Dayiheng Liu (CoRR, 2025)

Bridging Formal Language with Chain-of-Thought Reasoning to Geometry Problem Solving. - Tianyun Yang; Yunwen Li; Ziniu Li; Zhihang Lin; Ruoyu Sun 001; Tian Ding (CoRR, 2025)