MyoChallenge 2022: Learning contact-rich manipulation using a musculoskeletal hand. - Vittorio Caggiano; Guillaume Durandau; Huawei Wang 003; Alberto Silvio Chiappa; Alexander Mathis; Pablo Tano; Nisheet Patel; Alexandre Pouget; Pierre Schumacher; Georg Martius; Daniel F. B. Haeufle; Yiran Geng; et al. (NeurIPS (Competition and Demos), 2021)

Constrained Update Projection Approach to Safe Policy Optimization. - Long Yang 004; Jiaming Ji; Juntao Dai; Linrui Zhang; Binbin Zhou; Pengfei Li 005; Yaodong Yang 001; Gang Pan 001 (NeurIPS, 2022)

CUP: A Conservative Update Policy Algorithm for Safe Reinforcement Learning. - Long Yang 004; Jiaming Ji; Juntao Dai; Yu Zhang 009; Pengfei Li 005; Gang Pan 001 (CoRR, 2022)

Augmented Proximal Policy Optimization for Safe Reinforcement Learning. - Juntao Dai; Jiaming Ji; Long Yang 004; Qian Zheng; Gang Pan 001 (AAAI, 2023)

VOCE: Variational Optimization with Conservative Estimation for Offline Safe Reinforcement Learning. - Jiayi Guan; Guang Chen 001; Jiaming Ji; Long Yang 004; Ao Zhou 005; Zhijun Li 001; Changjun Jiang (NeurIPS, 2023)

BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Dataset. - Jiaming Ji; Mickel Liu; Josef Dai; Xuehai Pan; Chi Zhang 017; Ce Bian; Boyuan Chen 008; Ruiyang Sun; Yizhou Wang 001; Yaodong Yang 001 (NeurIPS, 2023)

Safety Gymnasium: A Unified Safe Reinforcement Learning Benchmark. - Jiaming Ji; Borong Zhang; Jiayi Zhou; Xuehai Pan; Weidong Huang 008; Ruiyang Sun; Yiran Geng; Yifan Zhong; Josef Dai; Yaodong Yang 001 (NeurIPS, 2023)

Heterogeneous-Agent Reinforcement Learning. - Yifan Zhong; Jakub Grudzien Kuba; Siyi Hu; Jiaming Ji; Yaodong Yang 001 (CoRR, 2023)

OmniSafe: An Infrastructure for Accelerating Safe Reinforcement Learning Research. - Jiaming Ji; Jiayi Zhou; Borong Zhang; Juntao Dai; Xuehai Pan; Ruiyang Sun; Weidong Huang 008; Yiran Geng; Mickel Liu; Yaodong Yang 001 (CoRR, 2023)

BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Dataset. - Jiaming Ji; Mickel Liu; Juntao Dai; Xuehai Pan; Chi Zhang 017; Ce Bian; Boyuan Zhang; Ruiyang Sun; Yizhou Wang 001; Yaodong Yang 001 (CoRR, 2023)

Safe DreamerV3: Safe Reinforcement Learning with World Models. - Weidong Huang 008; Jiaming Ji; Borong Zhang; Chunhe Xia; Yaodong Yang 001 (CoRR, 2023)

Baichuan 2: Open Large-scale Language Models. - Aiyuan Yang; Bin Xiao; Bingning Wang; Borong Zhang; Ce Bian; Chao Yin; Chenxu Lv; Da Pan 003; Dian Wang; Dong Yan; Fan Yang 087; Fei Deng; et al. (CoRR, 2023)

Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmark. - Jiaming Ji; Borong Zhang; Jiayi Zhou; Xuehai Pan; Weidong Huang 008; Ruiyang Sun; Yiran Geng; Yifan Zhong; Juntao Dai; Yaodong Yang 001 (CoRR, 2023)

AI Alignment: A Comprehensive Survey. - Jiaming Ji; Tianyi Qiu; Boyuan Chen 008; Borong Zhang; Hantao Lou; Kaile Wang; Yawen Duan; Zhonghao He; Jiayi Zhou; Zhaowei Zhang; Fanzhi Zeng; Kwan Yee Ng; et al. (CoRR, 2023)

Object Detection of Flexible Objects with Arbitrary Orientation Based on Rotation-Adaptive YOLOv5. - Jiajun Wu 012; Lumei Su; Zhiwei Lin; Yuhan Chen; Jiaming Ji; Tianyou Li (Sensors, 2023)

SafeDreamer: Safe Reinforcement Learning with World Models. - Weidong Huang 008; Jiaming Ji; Chunhe Xia; Borong Zhang; Yaodong Yang 001 (ICLR, 2024)

Safe RLHF: Safe Reinforcement Learning from Human Feedback. - Josef Dai; Xuehai Pan; Ruiyang Sun; Jiaming Ji; Xinbo Xu; Mickel Liu; Yizhou Wang 001; Yaodong Yang 001 (ICLR, 2024)

Multi-task Learning LSTM-based Traffic Prediction in Data Center Networks. - Xiongfei Ren; Xiaoyue Su; Yisong Zhao; Yuanzhi Guo; Changsheng Yang; Jiaming Ji; Xinwei Zhang; Bingli Guo; Xuwei Xue (ICMLSC, 2024)

SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Dataset. - Juntao Dai; Tianle Chen 001; Xuyao Wang; Ziran Yang; Taiye Chen; Jiaming Ji; Yaodong Yang 001 (NeurIPS, 2024)

Aligner: Efficient Alignment by Learning to Correct. - Jiaming Ji; Boyuan Chen 008; Hantao Lou; Donghai Hong; Borong Zhang; Xuehai Pan; Tianyi Qiu; Juntao Dai; Yaodong Yang 001 (NeurIPS, 2024)

ProgressGym: Alignment with a Millennium of Moral Progress. - Tianyi Qiu; Yang Zhang; Xuchuan Huang; Jasmine Xinze Li; Jiaming Ji; Yaodong Yang 001 (NeurIPS, 2024)

Aligner: Achieving Efficient Alignment through Weak-to-Strong Correction. - Jiaming Ji; Boyuan Chen 008; Hantao Lou; Donghai Hong; Borong Zhang; Xuehai Pan; Juntao Dai; Yaodong Yang 001 (CoRR, 2024)

Rethinking Information Structures in RLHF: Reward Generalization from a Graph Theory Perspective. - Tianyi Qiu; Fanzhi Zeng; Jiaming Ji; Dong Yan; Kaile Wang; Jiayi Zhou; Han Yang; Josef Dai; Xuehai Pan; Yaodong Yang 001 (CoRR, 2024)

Language Models Resist Alignment. - Jiaming Ji; Kaile Wang; Tianyi Qiu; Boyuan Chen 008; Jiayi Zhou; Changye Li 003; Hantao Lou; Yaodong Yang 001 (CoRR, 2024)

SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Dataset. - Josef Dai; Tianle Chen 001; Xuyao Wang; Ziran Yang; Taiye Chen; Jiaming Ji; Yaodong Yang 001 (CoRR, 2024)

PKU-SafeRLHF: A Safety Alignment Preference Dataset for Llama Family Models. - Jiaming Ji; Donghai Hong; Borong Zhang; Boyuan Chen 008; Josef Dai; Boren Zheng; Tianyi Qiu; Boxun Li; Yaodong Yang 001 (CoRR, 2024)

Sequence to Sequence Reward Modeling: Improving RLHF by Language Feedback. - Jiayi Zhou; Jiaming Ji; Juntao Dai; Yaodong Yang 001 (CoRR, 2024)

Align Anything: Training All-Modality Models to Follow Instructions with Language Feedback. - Jiaming Ji; Jiayi Zhou; Hantao Lou; Boyuan Chen 008; Donghai Hong; Xuyao Wang; Wenqi Chen; Kaile Wang; Rui Pan; Jiahao Li; Mohan Wang; Josef Dai; et al. (CoRR, 2024)

Heterogeneous-Agent Reinforcement Learning. - Yifan Zhong; Jakub Grudzien Kuba; Xidong Feng; Siyi Hu; Jiaming Ji; Yaodong Yang 001 (J. Mach. Learn. Res., 2024)

Bi-DexHands: Towards Human-Level Bimanual Dexterous Manipulation. - Yuanpei Chen; Yiran Geng; Fangwei Zhong; Jiaming Ji; Jiechuang Jiang; Zongqing Lu 002; Hao Dong 003; Yaodong Yang 001 (IEEE Trans. Pattern Anal. Mach. Intell., 2024)

Stream Aligner: Efficient Sentence-Level Alignment via Distribution Induction. - Hantao Lou; Jiaming Ji; Kaile Wang; Yaodong Yang 001 (AAAI, 2025)

Sequence to Sequence Reward Modeling: Improving RLHF by Language Feedback. - Jiayi Zhou; Jiaming Ji; Josef Dai; Yaodong Yang 001 (AAAI, 2025)

FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation. - Junyu Luo 002; Zhizhuo Kou; Liming Yang; Xiao Luo 001; Jinsheng Huang; Zhiping Xiao 001; Jingshu Peng; Chengzhong Liu; Jiaming Ji; Xuanzhe Liu; Sirui Han; Ming Zhang 004; et al. (ACL (1), 2025)

SafeLawBench: Towards Safe Alignment of Large Language Models. - Chuxue Cao; Han Zhu; Jiaming Ji; Qichao Sun; Zhenghao Zhu; Yinyu Wu; Josef Dai; Yaodong Yang 001; Sirui Han; Yike Guo (ACL (Findings), 2025)

Boosting Policy and Process Reward Models with Monte Carlo Tree Search in Open-Domain QA. - Chi-Min Chan; Chunpu Xu; Junqi Zhu; Jiaming Ji; Donghai Hong; Pengcheng Wen; Chunyang Jiang; Zhen Ye; Yaodong Yang 001; Wei Xue 002; Sirui Han; Yike Guo (ACL (Findings), 2025)

PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference. - Jiaming Ji; Donghai Hong; Borong Zhang; Boyuan Chen 008; Josef Dai; Boren Zheng; Tianyi Alex Qiu; Jiayi Zhou; Kaile Wang; Boxun Li; Sirui Han; Yike Guo; et al. (ACL (1), 2025)

Language Models Resist Alignment: Evidence From Data Compression. - Jiaming Ji; Kaile Wang; Tianyi Alex Qiu; Boyuan Chen 008; Jiayi Zhou; Changye Li 003; Hantao Lou; Josef Dai; Yunhuai Liu; Yaodong Yang 001 (ACL (1), 2025)

Benchmarking Multi-National Value Alignment for Large Language Models. - Chengyi Ju; Weijie Shi; Chengzhong Liu; Jiaming Ji; Jipeng Zhang; Ruiyuan Zhang; Jiajie Xu 001; Yaodong Yang 001; Sirui Han; Yike Guo (ACL (Findings), 2025)

Reward Generalization in RLHF: A Topological Perspective. - Tianyi Alex Qiu; Fanzhi Zeng; Jiaming Ji; Dong Yan; Kaile Wang; Jiayi Zhou; Yang Han; Josef Dai; Xuehai Pan; Yaodong Yang 001 (ACL (Findings), 2025)

LegalReasoner: Step-wised Verification-Correction for Legal Judgment Reasoning. - Weijie Shi; Han Zhu; Jiaming Ji; Mengze Li 001; Jipeng Zhang; Ruiyuan Zhang; Jia Zhu 003; Jiajie Xu 001; Sirui Han; Yike Guo (ACL (1), 2025)

A Survey of LLM-based Agents in Medicine: How far are we from Baymax? - Wenxuan Wang 001; Zizhan Ma; Zheng Wang; Chenghan Wu; Jiaming Ji; Wenting Chen; Xiang Li 001; Yixuan Yuan (ACL (Findings), 2025)

RedStar: Does Scaling Long-CoT Data Unlock Better Slow-Reasoning Systems? - Haotian Xu; Xing Wu; Weinong Wang; Zhongzhi Li; Da Zheng; Boyuan Chen 008; Yi Hu; Shijia Kang; Jiaming Ji; Yingying Zhang; Zhijiang Guo; Yaodong Yang 001; et al. (CoRR, 2025)

SAE-V: Interpreting Multimodal Models for Enhanced Alignment. - Hantao Lou; Changye Li 003; Jiaming Ji; Yaodong Yang 001 (CoRR, 2025)

SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Safe Reinforcement Learning. - Borong Zhang; Yuhao Zhang; Jiaming Ji; Yingshan Lei; Josef Dai; Yuanpei Chen; Yaodong Yang 001 (CoRR, 2025)

ThinkPatterns-21k: A Systematic Study on the Impact of Thinking Patterns in LLMs. - Pengcheng Wen; Jiaming Ji; Chi-Min Chan; Juntao Dai; Donghai Hong; Yaodong Yang 001; Sirui Han; Yike Guo (CoRR, 2025)

Safe RLHF-V: Safe Reinforcement Learning from Human Feedback in Multimodal Large Language Models. - Jiaming Ji; Xinyu Chen; Rui Pan; Han Zhu; Conghui Zhang; Jiahao Li; Donghai Hong; Boyuan Chen 008; Jiayi Zhou; Kaile Wang; Juntao Dai; Chi-Min Chan; et al. (CoRR, 2025)

Benchmarking Multi-National Value Alignment for Large Language Models. - Weijie Shi; Chengyi Ju; Chengzhong Liu; Jiaming Ji; Jipeng Zhang; Ruiyuan Zhang; Jia Zhu 003; Jiajie Xu 001; Yaodong Yang 001; Sirui Han; Yike Guo (CoRR, 2025)

A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment. - Kun Wang 056; Guibin Zhang; Zhenhong Zhou; Jiahao Wu; Miao Yu; Shiqian Zhao; Chenlong Yin; Jinhu Fu; Yibo Yan; Hanjun Luo; Liang Lin; Zhihao Xu; et al. (CoRR, 2025)

J1: Exploring Simple Test-Time Scaling for LLM-as-a-Judge. - Chi-Min Chan; Chunpu Xu; Jiaming Ji; Zhen Ye; Pengcheng Wen; Chunyang Jiang; Yaodong Yang 001; Wei Xue 002; Sirui Han; Yike Guo (CoRR, 2025)

Generative RLHF-V: Learning Principles from Multi-modal Human Preference. - Jiayi Zhou; Jiaming Ji; Boyuan Chen 008; Jiapeng Sun; Wenqi Chen; Donghai Hong; Sirui Han; Yike Guo; Yaodong Yang 001 (CoRR, 2025)

Mitigating Deceptive Alignment via Self-Monitoring. - Jiaming Ji; Wenqi Chen; Kaile Wang; Donghai Hong; Sitong Fang; Boyuan Chen 008; Jiayi Zhou; Juntao Dai; Sirui Han; Yike Guo; Yaodong Yang 001 (CoRR, 2025)

The Mirage of Multimodality: Where Truth is Tested and Honesty Unravels. - Jiaming Ji; Sitong Fang; Wenjing Cao; Jiahao Li; Xuyao Wang; Juntao Dai; Chi-Min Chan; Sirui Han; Yike Guo; Yaodong Yang 001 (CoRR, 2025)

InterMT: Multi-Turn Interleaved Preference Alignment with Human Feedback. - Boyuan Chen 008; Donghai Hong; Jiaming Ji; Jiacheng Zheng; Bowen Dong; Jiayi Zhou; Kaile Wang; Juntao Dai; Xuyao Wang; Wenqi Chen; Qirui Zheng; Wenxin Li; et al. (CoRR, 2025)

SafeLawBench: Towards Safe Alignment of Large Language Models. - Chuxue Cao; Han Zhu; Jiaming Ji; Qichao Sun; Zhenghao Zhu; Yinyu Wu; Juntao Dai; Yaodong Yang 001; Sirui Han; Yike Guo (CoRR, 2025)

A Game-Theoretic Negotiation Framework for Cross-Cultural Consensus in LLMs. - Guoxi Zhang; Jiawei Chen; Tianzhuo Yang; Jiaming Ji; Yaodong Yang 001; Juntao Dai (CoRR, 2025)

Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications. - Wenxuan Wang 001; Zizhan Ma; Meidan Ding; Shiyi Zheng; Shengyuan Liu; Jie Liu 044; Jiaming Ji; Wenting Chen; Xiang Li 001; Linlin Shen; Yixuan Yuan (CoRR, 2025)

ReDMan: reliable dexterous manipulation with safe reinforcement learning. - Yiran Geng; Jiaming Ji; Yuanpei Chen; Haoran Geng; Fangwei Zhong; Yaodong Yang 001 (Mach. Learn., 2025)