BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Dataset. - Jiaming Ji; Mickel Liu; Josef Dai; Xuehai Pan; Chi Zhang 017; Ce Bian; Boyuan Chen 008; Ruiyang Sun; Yizhou Wang 001; Yaodong Yang 001 (NeurIPS, 2023)

AI Alignment: A Comprehensive Survey. - Jiaming Ji; Tianyi Qiu; Boyuan Chen 008; Borong Zhang; Hantao Lou; Kaile Wang; Yawen Duan; Zhonghao He; Jiayi Zhou; Zhaowei Zhang; Fanzhi Zeng; Kwan Yee Ng; et al. (CoRR, 2023)

Aligner: Efficient Alignment by Learning to Correct. - Jiaming Ji; Boyuan Chen 008; Hantao Lou; Donghai Hong; Borong Zhang; Xuehai Pan; Tianyi Qiu; Juntao Dai; Yaodong Yang 001 (NeurIPS, 2024)

Aligner: Achieving Efficient Alignment through Weak-to-Strong Correction. - Jiaming Ji; Boyuan Chen 008; Hantao Lou; Donghai Hong; Borong Zhang; Xuehai Pan; Juntao Dai; Yaodong Yang 001 (CoRR, 2024)

Efficient Model-agnostic Alignment via Bayesian Persuasion. - Fengshuo Bai; Mingzhi Wang; Zhaowei Zhang; Boyuan Chen 008; Yinda Xu; Ying Wen 001; Yaodong Yang 001 (CoRR, 2024)

Language Models Resist Alignment. - Jiaming Ji; Kaile Wang; Tianyi Qiu; Boyuan Chen 008; Jiayi Zhou; Changye Li 003; Hantao Lou; Yaodong Yang 001 (CoRR, 2024)

PKU-SafeRLHF: A Safety Alignment Preference Dataset for Llama Family Models. - Jiaming Ji; Donghai Hong; Borong Zhang; Boyuan Chen 008; Josef Dai; Boren Zheng; Tianyi Qiu; Boxun Li; Yaodong Yang 001 (CoRR, 2024)

Align Anything: Training All-Modality Models to Follow Instructions with Language Feedback. - Jiaming Ji; Jiayi Zhou; Hantao Lou; Boyuan Chen 008; Donghai Hong; Xuyao Wang; Wenqi Chen; Kaile Wang; Rui Pan; Jiahao Li; Mohan Wang; Josef Dai; et al. (CoRR, 2024)

PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference. - Jiaming Ji; Donghai Hong; Borong Zhang; Boyuan Chen 008; Josef Dai; Boren Zheng; Tianyi Alex Qiu; Jiayi Zhou; Kaile Wang; Boxun Li; Sirui Han; Yike Guo; et al. (ACL (1), 2025)

Language Models Resist Alignment: Evidence From Data Compression. - Jiaming Ji; Kaile Wang; Tianyi Alex Qiu; Boyuan Chen 008; Jiayi Zhou; Changye Li 003; Hantao Lou; Josef Dai; Yunhuai Liu; Yaodong Yang 001 (ACL (1), 2025)

RedStar: Does Scaling Long-CoT Data Unlock Better Slow-Reasoning Systems? - Haotian Xu; Xing Wu; Weinong Wang; Zhongzhi Li; Da Zheng; Boyuan Chen 008; Yi Hu; Shijia Kang; Jiaming Ji; Yingying Zhang; Zhijiang Guo; Yaodong Yang 001; et al. (CoRR, 2025)

Safe RLHF-V: Safe Reinforcement Learning from Human Feedback in Multimodal Large Language Models. - Jiaming Ji; Xinyu Chen; Rui Pan; Han Zhu; Conghui Zhang; Jiahao Li; Donghai Hong; Boyuan Chen 008; Jiayi Zhou; Kaile Wang; Juntao Dai; Chi-Min Chan; et al. (CoRR, 2025)

Redefining Superalignment: From Weak-to-Strong Alignment to Human-AI Co-Alignment to Sustainable Symbiotic Society. - Yi Zeng 001; Feifei Zhao; Yuwei Wang; Enmeng Lu; Yaodong Yang 001; Lei Wang; Chao Liu; Yitao Liang; Dongcheng Zhao; Bing Han 010; Haibo Tong; Yao Liang; et al. (CoRR, 2025)

Generative RLHF-V: Learning Principles from Multi-modal Human Preference. - Jiayi Zhou; Jiaming Ji; Boyuan Chen 008; Jiapeng Sun; Wenqi Chen; Donghai Hong; Sirui Han; Yike Guo; Yaodong Yang 001 (CoRR, 2025)

Mitigating Deceptive Alignment via Self-Monitoring. - Jiaming Ji; Wenqi Chen; Kaile Wang; Donghai Hong; Sitong Fang; Boyuan Chen 008; Jiayi Zhou; Juntao Dai; Sirui Han; Yike Guo; Yaodong Yang 001 (CoRR, 2025)

InterMT: Multi-Turn Interleaved Preference Alignment with Human Feedback. - Boyuan Chen 008; Donghai Hong; Jiaming Ji; Jiacheng Zheng; Bowen Dong; Jiayi Zhou; Kaile Wang; Juntao Dai; Xuyao Wang; Wenqi Chen; Qirui Zheng; Wenxin Li; et al. (CoRR, 2025)