Ziniu Li

According to our database, Ziniu Li authored at least 58 papers between 2019 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

A Survey on Large Language Models for Mathematical Reasoning.

Peng-Yuan Wang, Tian-Shuo Liu, Chenyang Wang, Ziniu Li, Yidi Wang, Shu Yan, Chengxing Jia, Xu-Hui Liu, Xinwei Chen, Jiacheng Xu, Yang Yu

ACM Comput. Surv., June, 2026

Do Phone-Use Agents Respect Your Privacy?

Zhengyang Tang, Ke Ji, Xidong Wang, Zihan Ye, Xinyuan Wang, Yiduo Guo, Ziniu Li, Chenxin Li, Jingyuan Hu, Shunian Chen, Tongxu Luo, Jiaxi Bi, Zeyu Qin, Shaobo Wang, Xin Lai, Pengyuan Lyu, Junyi Li, Can Xu, Chengquan Zhang, Han Hu, Ming Yan, Benyou Wang

CoRR, April, 2026

Off-Policy Value-Based Reinforcement Learning for Large Language Models.

Peng-Yuan Wang, Ziniu Li, Tian Xu, Bohan Yang, Tian-Shuo Liu, ChenYang Wang, Xiong-Hui Chen, Yi-Chen Li, Tianyun Yang, Congliang Chen, Yang Yu

CoRR, March, 2026

Non-Adversarial Imitation Learning Provably Free of Compounding Errors: The Role of Bellman Constraints.

Tian Xu, Chenyang Wang, Xiaochen Zhai, Ziniu Li, Yi-Chen Li, Yang Yu

CoRR, March, 2026

The Optimal Token Baseline: Variance Reduction for Long-Horizon LLM-RL.

Yingru Li, Jiawei Xu, Ziniu Li, Jiacai Liu, Wei Liu, Yuxuan Tong, Longtao Zheng, Zhenghai Xue, Yaxiang Zhang, Tianle Cai, Ge Zhang, Qian Liu, Baoxiang Wang

CoRR, February, 2026

Beyond Precision: Training-Inference Mismatch is an Optimization Problem and Simple LR Scheduling Fixes It.

Yaxiang Zhang, Yingru Li, Jiacai Liu, Jiawei Xu, Ziniu Li, Qian Liu, Haoyuan Li

CoRR, February, 2026

The Molecular Structure of Thought: Mapping the Topology of Long Chain-of-Thought Reasoning.

Qiguang Chen, Yantao Du, Ziniu Li, Jinhao Liu, Songyao Duan, Jiarui Guo, Minghao Liu, Jiaheng Liu, Tong Yang, Ge Zhang, Libo Qin, Wanxiang Che, Wenhao Huang

CoRR, January, 2026

Stepwise Guided Policy Optimization: Coloring Your Incorrect Reasoning in GRPO.

Peter Chen, Xiaopeng Li, Ziniu Li, Xi Chen, Tianyi Lin

Trans. Mach. Learn. Res., 2026

2025

Encyclo-K: Evaluating LLMs with Dynamically Composed Knowledge Statements.

Yiming Liang, Yizhi Li, Yantao Du, Ge Zhang, Jiayi Zhou, Yuchen Wu, Yinzhu Piao, Denghui Cao, Tong Sun, Ziniu Li, Li Du, Bo Lei, Jiaheng Liu, Chenghua Lin, Zhaoxiang Zhang, Wenhao Huang, Jiajun Zhang

CoRR, December, 2025

A Note on Hybrid Online Reinforcement and Imitation Learning for LLMs: Formulations and Algorithms.

Yingru Li, Ziniu Li, Jiacai Liu

CoRR, December, 2025

Taming the Tail: Stable LLM Reinforcement Learning via Dynamic Vocabulary Pruning.

Yingru Li, Jiawei Xu, Jiacai Liu, Yuxuan Tong, Ziniu Li, Tianle Cai, Ge Zhang, Qian Liu, Baoxiang Wang

CoRR, December, 2025

Trust Region Masking for Long-Horizon LLM Reinforcement Learning.

Yingru Li, Jiacai Liu, Jiawei Xu, Yuxuan Tong, Ziniu Li, Baoxiang Wang

CoRR, December, 2025

Exploration vs Exploitation: Rethinking RLVR through Clipping, Entropy, and Spurious Reward.

Peter Chen, Xiaopeng Li, Ziniu Li, Wotao Yin, Xi Chen, Tianyi Lin

CoRR, December, 2025

Beyond Token-level Supervision: Unlocking the Potential of Decoding-based Regression via Reinforcement Learning.

Ming Chen, Sheng Tang, Rong-Xi Tan, Ziniu Li, Jiacheng Chen, Ke Xue, Chao Qian

CoRR, December, 2025

SpeechJudge: Towards Human-Level Judgment for Speech Naturalness.

Xueyao Zhang, Chaoren Wang, Huan Liao, Ziniu Li, Yuancheng Wang, Li Wang, Dongya Jia, Yuanzhe Chen, Xiulin Li, Zhuo Chen, Zhizheng Wu

CoRR, November, 2025

ORGEval: Graph-Theoretic Evaluation of LLMs in Optimization Modeling.

Zhuohan Wang, Ziwei Zhu, Ziniu Li, Congliang Chen, Yizhou Han, Yufeng Lin, Zhihang Lin, Angyang Gu, Xinglin Hu, Ruoyu Sun, Tian Ding

CoRR, October, 2025

Scaling Latent Reasoning via Looped Language Models.

Rui-Jie Zhu, Zixuan Wang, Kai Hua, Tianyu Zhang, Ziniu Li, Haoran Que, Boyi Wei, Zixin Wen, Fan Yin, He Xing, Lu Li, Jiajun Shi, Kaijing Ma, Shanda Li, Taylor Kergan, Andrew Smith, Xingwei Qu, Mude Hui, Bohong Wu, Qiyang Min, Hongzhi Huang, Xun Zhou, Wei Ye, Jiaheng Liu, Jian Yang, Yunfeng Shi, Chenghua Lin, Enduo Zhao, Tianle Cai, Ge Zhang, Wenhao Huang, Yoshua Bengio, Jason Eshraghian

CoRR, October, 2025

Teaching Language Models to Reason with Tools.

Chengpeng Li, Zhengyang Tang, Ziniu Li, Mingfeng Xue, Keqin Bao, Tian Ding, Ruoyu Sun, Benyou Wang, Xiang Wang, Junyang Lin, Dayiheng Liu

CoRR, October, 2025

Knapsack RL: Unlocking Exploration of LLMs via Optimizing Budget Allocation.

Ziniu Li, Congliang Chen, Tianyun Yang, Tian Ding, Ruoyu Sun, Ge Zhang, Wenhao Huang, Zhi-Quan Luo

CoRR, September, 2025

TreePO: Bridging the Gap of Policy Optimization and Efficacy and Inference Efficiency with Heuristic Tree-based Modeling.

Yizhi Li, Qingshui Gu, Zhoufutu Wen, Ziniu Li, Tianshun Xing, Shuyue Guo, Tianyu Zheng, Xin Zhou, Xingwei Qu, Wangchunshu Zhou, Zheng Zhang, Wei Shen, Qian Liu, Chenghua Lin, Jian Yang, Ge Zhang, Wenhao Huang

CoRR, August, 2025

Bridging Formal Language with Chain-of-Thought Reasoning to Geometry Problem Solving.

Tianyun Yang, Yunwen Li, Ziniu Li, Zhihang Lin, Ruoyu Sun, Tian Ding

CoRR, August, 2025

CoRT: Code-integrated Reasoning within Thinking.

Chengpeng Li, Zhengyang Tang, Ziniu Li, Mingfeng Xue, Keqin Bao, Tian Ding, Ruoyu Sun, Benyou Wang, Xiang Wang, Junyang Lin, Dayiheng Liu

CoRR, June, 2025

A Survey on Large Language Models for Mathematical Reasoning.

Peng-Yuan Wang, Tian-Shuo Liu, Chenyang Wang, Yi-Di Wang, Shu Yan, Cheng-Xing Jia, Xu-Hui Liu, Xin-Wei Chen, Jia-Cheng Xu, Ziniu Li, Yang Yu

CoRR, June, 2025

Quality-Diversity Red-Teaming: Automated Generation of High-Quality and Diverse Attackers for Large Language Models.

Ren-Jian Wang, Ke Xue, Zeyu Qin, Ziniu Li, Sheng Tang, Hao-Tian Li, Shengcai Liu, Chao Qian

CoRR, June, 2025

Spectral Policy Optimization: Coloring your Incorrect Reasoning in GRPO.

Peter Chen, Xiaopeng Li, Ziniu Li, Xi Chen, Tianyi Lin

CoRR, May, 2025

Controlling Large Language Model with Latent Actions.

Chengxing Jia, Ziniu Li, Pengyuan Wang, Yi-Chen Li, Zhenyu Hou, Yuxiao Dong, Yang Yu

CoRR, March, 2025

RealCritic: Towards Effectiveness-Driven Evaluation of Language Model Critiques.

Zhengyang Tang, Ziniu Li, Zhenyang Xiao, Tian Ding, Ruoyu Sun, Benyou Wang, Dayiheng Liu, Fei Huang, Tianyu Liu, Bowen Yu, Junyang Lin

CoRR, January, 2025

Enabling Scalable Oversight via Self-Evolving Critic.

Zhengyang Tang, Ziniu Li, Zhenyang Xiao, Tian Ding, Ruoyu Sun, Benyou Wang, Dayiheng Liu, Fei Huang, Tianyu Liu, Bowen Yu, Junyang Lin

CoRR, January, 2025

Controlling Large Language Model with Latent Action.

Chengxing Jia, Ziniu Li, Pengyuan Wang, Yi-Chen Li, Zhenyu Hou, Yuxiao Dong, Yang Yu

Proceedings of the Forty-second International Conference on Machine Learning, 2025

Adam-mini: Use Fewer Learning Rates To Gain More.

Yushun Zhang, Congliang Chen, Ziniu Li, Tian Ding, Chenwei Wu, Diederik P. Kingma, Yinyu Ye, Zhi-Quan Luo, Ruoyu Sun

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Understanding and Mitigating Hallucination in Large Vision-Language Models via Modular Attribution and Intervention.

Tianyun Yang, Ziniu Li, Juan Cao, Chang Xu

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Preserving Diversity in Supervised Fine-Tuning of Large Language Models.

Ziniu Li, Congliang Chen, Tian Xu, Zeyu Qin, Jiancong Xiao, Zhi-Quan Luo, Ruoyu Sun

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Advancing Zero-shot Text-to-Speech Intelligibility across Diverse Domains via Preference Alignment.

Xueyao Zhang, Yuancheng Wang, Chaoren Wang, Ziniu Li, Zhuo Chen, Zhizheng Wu

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

2024

Sensing Jamming Strategy From Limited Observations: An Imitation Learning Perspective.

Youlin Fan, Bo Jiu, Wenqiang Pu, Ziniu Li, Kang Li, Hongwei Liu

IEEE Trans. Signal Process., 2024

Entropic Distribution Matching in Supervised Fine-tuning of LLMs: Less Overfitting and Better Diversity.

Ziniu Li, Congliang Chen, Tian Xu, Zeyu Qin, Jiancong Xiao, Ruoyu Sun, Zhi-Quan Luo

CoRR, 2024

Adam-mini: Use Fewer Learning Rates To Gain More.

Yushun Zhang, Congliang Chen, Ziniu Li, Tian Ding, Chenwei Wu, Yinyu Ye, Zhi-Quan Luo, Ruoyu Sun

CoRR, 2024

BWArea Model: Learning World Model, Inverse Dynamics, and Policy for Controllable Language Generation.

Chengxing Jia, Pengyuan Wang, Ziniu Li, Yi-Chen Li, Zhilong Zhang, Nan Tang, Yang Yu

CoRR, 2024

On the Algorithmic Bias of Aligning Large Language Models with RLHF: Preference Collapse and Matching Regularization.

Jiancong Xiao, Ziniu Li, Xingyu Xie, Emily J. Getzen, Cong Fang, Qi Long, Weijie J. Su

CoRR, 2024

Why Transformers Need Adam: A Hessian Perspective.

Yushun Zhang, Congliang Chen, Tian Ding, Ziniu Li, Ruoyu Sun, Zhi-Quan Luo

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024

ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models.

Ziniu Li, Tian Xu, Yushun Zhang, Zhihang Lin, Yang Yu, Ruoyu Sun, Zhi-Quan Luo

Proceedings of the Forty-first International Conference on Machine Learning, 2024

When is RL better than DPO in RLHF? A Representation and Optimization Perspective.

Ziniu Li, Tian Xu, Yang Yu

Proceedings of the Second Tiny Papers Track at ICLR 2024, 2024

Unlocking Black-Box Prompt Tuning Efficiency via Zeroth-Order Optimization.

Heshen Zhan, Congliang Chen, Tian Ding, Ziniu Li, Ruoyu Sun

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

2023

Policy Optimization in RLHF: The Impact of Out-of-preference Data.

Ziniu Li, Tian Xu, Yang Yu

CoRR, 2023

ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models.

Ziniu Li, Tian Xu, Yushun Zhang, Yang Yu, Ruoyu Sun, Zhi-Quan Luo

CoRR, 2023

Deploying Offline Reinforcement Learning with Human Feedback.

Ziniu Li, Ke Xu, Liu Liu, Lanqing Li, Deheng Ye, Peilin Zhao

CoRR, 2023

Theoretical Analysis of Offline Imitation With Supplementary Dataset.

Ziniu Li, Tian Xu, Yang Yu, Zhi-Quan Luo

CoRR, 2023

Provably Efficient Adversarial Imitation Learning with Unknown Transitions.

Tian Xu, Ziniu Li, Yang Yu, Zhi-Quan Luo

Proceedings of the Uncertainty in Artificial Intelligence, 2023

Imitation Learning from Imperfection: Theoretical Justifications and Algorithms.

Ziniu Li, Tian Xu, Zeyu Qin, Yang Yu, Zhi-Quan Luo

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2022

Error Bounds of Imitating Policies and Environments for Reinforcement Learning.

Tian Xu, Ziniu Li, Yang Yu

IEEE Trans. Pattern Anal. Mach. Intell., 2022

Understanding Adversarial Imitation Learning in Small Sample Regime: A Stage-coupled Analysis.

Tian Xu, Ziniu Li, Yang Yu, Zhi-Quan Luo

CoRR, 2022

A Note on Target Q-learning For Solving Finite MDPs with A Generative Oracle.

Ziniu Li, Tian Xu, Yang Yu

CoRR, 2022

Rethinking ValueDice: Does It Really Improve Performance?

Ziniu Li, Tian Xu, Yang Yu, Zhi-Quan Luo

CoRR, 2022

HyperDQN: A Randomized Exploration Method for Deep Reinforcement Learning.

Ziniu Li, Yingru Li, Yushun Zhang, Tong Zhang, Zhi-Quan Luo

Proceedings of the Tenth International Conference on Learning Representations, 2022

2021

Nearly Minimax Optimal Adversarial Imitation Learning with Known and Unknown Transitions.

Tian Xu, Ziniu Li, Yang Yu

CoRR, 2021

2020

Solving the Inverse Design Problem of Electrical Fuse With Machine Learning.

Xinjian Huang, Ziniu Li, Zhiyuan Liu, Bin Xiang, Yingsan Geng, Jianhua Wang

IEEE Access, 2020

Error Bounds of Imitating Policies and Environments.

Tian Xu, Ziniu Li, Yang Yu

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Efficient Exploration by Novelty-Pursuit.

Ziniu Li, Xiong-Hui Chen

Proceedings of the Distributed Artificial Intelligence - Second International Conference, 2020

2019

On Value Discrepancy of Imitation Learning.

Tian Xu, Ziniu Li, Yang Yu

CoRR, 2019