Aligner: Efficient Alignment by Learning to Correct. - Jiaming Ji; Boyuan Chen 008; Hantao Lou; Donghai Hong; Borong Zhang; Xuehai Pan; Tianyi Qiu; Juntao Dai; Yaodong Yang 001 (NeurIPS, 2024)

Aligner: Achieving Efficient Alignment through Weak-to-Strong Correction. - Jiaming Ji; Boyuan Chen 008; Hantao Lou; Donghai Hong; Borong Zhang; Xuehai Pan; Juntao Dai; Yaodong Yang 001 (CoRR, 2024)

PKU-SafeRLHF: A Safety Alignment Preference Dataset for Llama Family Models. - Jiaming Ji; Donghai Hong; Borong Zhang; Boyuan Chen 008; Josef Dai; Boren Zheng; Tianyi Qiu; Boxun Li; Yaodong Yang 001 (CoRR, 2024)

Align Anything: Training All-Modality Models to Follow Instructions with Language Feedback. - Jiaming Ji; Jiayi Zhou; Hantao Lou; Boyuan Chen 008; Donghai Hong; Xuyao Wang; Wenqi Chen; Kaile Wang; Rui Pan; Jiahao Li; Mohan Wang; Josef Dai; et al. (CoRR, 2024)

Libra-Leaderboard: Towards Responsible AI through a Balanced Leaderboard of Safety and Capability. - Haonan Li 002; Xudong Han; Zenan Zhai; Honglin Mu; Hao Wang; Zhenxuan Zhang; Yilin Geng; Shom Lin; Renxi Wang; Artem Shelmanov; Xiangyu Qi; Yuxia Wang; et al. (CoRR, 2024)

Boosting Policy and Process Reward Models with Monte Carlo Tree Search in Open-Domain QA. - Chi-Min Chan; Chunpu Xu; Junqi Zhu; Jiaming Ji; Donghai Hong; Pengcheng Wen; Chunyang Jiang; Zhen Ye; Yaodong Yang 001; Wei Xue 002; Sirui Han; Yike Guo (ACL (Findings), 2025)

PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference. - Jiaming Ji; Donghai Hong; Borong Zhang; Boyuan Chen 008; Josef Dai; Boren Zheng; Tianyi Alex Qiu; Jiayi Zhou; Kaile Wang; Boxun Li; Sirui Han; Yike Guo; et al. (ACL (1), 2025)

ThinkPatterns-21k: A Systematic Study on the Impact of Thinking Patterns in LLMs. - Pengcheng Wen; Jiaming Ji; Chi-Min Chan; Juntao Dai; Donghai Hong; Yaodong Yang 001; Sirui Han; Yike Guo (CoRR, 2025)

Safe RLHF-V: Safe Reinforcement Learning from Human Feedback in Multimodal Large Language Models. - Jiaming Ji; Xinyu Chen; Rui Pan; Han Zhu; Conghui Zhang; Jiahao Li; Donghai Hong; Boyuan Chen 008; Jiayi Zhou; Kaile Wang; Juntao Dai; Chi-Min Chan; et al. (CoRR, 2025)

A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment. - Kun Wang 056; Guibin Zhang; Zhenhong Zhou; Jiahao Wu; Miao Yu; Shiqian Zhao; Chenlong Yin; Jinhu Fu; Yibo Yan; Hanjun Luo; Liang Lin; Zhihao Xu; et al. (CoRR, 2025)

Generative RLHF-V: Learning Principles from Multi-modal Human Preference. - Jiayi Zhou; Jiaming Ji; Boyuan Chen 008; Jiapeng Sun; Wenqi Chen; Donghai Hong; Sirui Han; Yike Guo; Yaodong Yang 001 (CoRR, 2025)

Mitigating Deceptive Alignment via Self-Monitoring. - Jiaming Ji; Wenqi Chen; Kaile Wang; Donghai Hong; Sitong Fang; Boyuan Chen 008; Jiayi Zhou; Juntao Dai; Sirui Han; Yike Guo; Yaodong Yang 001 (CoRR, 2025)

InterMT: Multi-Turn Interleaved Preference Alignment with Human Feedback. - Boyuan Chen 008; Donghai Hong; Jiaming Ji; Jiacheng Zheng; Bowen Dong; Jiayi Zhou; Kaile Wang; Juntao Dai; Xuyao Wang; Wenqi Chen; Qirui Zheng; Wenxin Li; et al. (CoRR, 2025)