BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Dataset. - Jiaming Ji; Mickel Liu; Josef Dai; Xuehai Pan; Chi Zhang 017; Ce Bian; Boyuan Chen 008; Ruiyang Sun; Yizhou Wang 001; Yaodong Yang 001 (NeurIPS, 2023)

Safety Gymnasium: A Unified Safe Reinforcement Learning Benchmark. - Jiaming Ji; Borong Zhang; Jiayi Zhou; Xuehai Pan; Weidong Huang 008; Ruiyang Sun; Yiran Geng; Yifan Zhong; Josef Dai; Yaodong Yang 001 (NeurIPS, 2023)

Safe RLHF: Safe Reinforcement Learning from Human Feedback. - Josef Dai; Xuehai Pan; Ruiyang Sun; Jiaming Ji; Xinbo Xu; Mickel Liu; Yizhou Wang 001; Yaodong Yang 001 (ICLR, 2024)

Rethinking Information Structures in RLHF: Reward Generalization from a Graph Theory Perspective. - Tianyi Qiu; Fanzhi Zeng; Jiaming Ji; Dong Yan; Kaile Wang; Jiayi Zhou; Han Yang; Josef Dai; Xuehai Pan; Yaodong Yang 001 (CoRR, 2024)

SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Dataset. - Josef Dai; Tianle Chen 001; Xuyao Wang; Ziran Yang; Taiye Chen; Jiaming Ji; Yaodong Yang 001 (CoRR, 2024)

PKU-SafeRLHF: A Safety Alignment Preference Dataset for Llama Family Models. - Jiaming Ji; Donghai Hong; Borong Zhang; Boyuan Chen 008; Josef Dai; Boren Zheng; Tianyi Qiu; Boxun Li; Yaodong Yang 001 (CoRR, 2024)

Align Anything: Training All-Modality Models to Follow Instructions with Language Feedback. - Jiaming Ji; Jiayi Zhou; Hantao Lou; Boyuan Chen 008; Donghai Hong; Xuyao Wang; Wenqi Chen; Kaile Wang; Rui Pan; Jiahao Li; Mohan Wang; Josef Dai; et al. (CoRR, 2024)

Sequence to Sequence Reward Modeling: Improving RLHF by Language Feedback. - Jiayi Zhou; Jiaming Ji; Josef Dai; Yaodong Yang 001 (AAAI, 2025)

SafeLawBench: Towards Safe Alignment of Large Language Models. - Chuxue Cao; Han Zhu; Jiaming Ji; Qichao Sun; Zhenghao Zhu; Yinyu Wu; Josef Dai; Yaodong Yang 001; Sirui Han; Yike Guo (ACL (Findings), 2025)

PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference. - Jiaming Ji; Donghai Hong; Borong Zhang; Boyuan Chen 008; Josef Dai; Boren Zheng; Tianyi Alex Qiu; Jiayi Zhou; Kaile Wang; Boxun Li; Sirui Han; Yike Guo; et al. (ACL (1), 2025)

Language Models Resist Alignment: Evidence From Data Compression. - Jiaming Ji; Kaile Wang; Tianyi Alex Qiu; Boyuan Chen 008; Jiayi Zhou; Changye Li 003; Hantao Lou; Josef Dai; Yunhuai Liu; Yaodong Yang 001 (ACL (1), 2025)

Reward Generalization in RLHF: A Topological Perspective. - Tianyi Alex Qiu; Fanzhi Zeng; Jiaming Ji; Dong Yan; Kaile Wang; Jiayi Zhou; Yang Han; Josef Dai; Xuehai Pan; Yaodong Yang 001 (ACL (Findings), 2025)

SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Safe Reinforcement Learning. - Borong Zhang; Yuhao Zhang; Jiaming Ji; Yingshan Lei; Josef Dai; Yuanpei Chen; Yaodong Yang 001 (CoRR, 2025)