Secrets of RLHF in Large Language Models Part I: PPO. - Rui Zheng; Shihan Dou; Songyang Gao; Yuan Hua; Wei Shen; Binghai Wang; Yan Liu 002; Senjie Jin; Qin Liu 010; Yuhao Zhou; Limao Xiong; Lu Chen; et al. (CoRR, 2023)

Improving Discriminative Capability of Reward Models in RLHF Using Contrastive Learning. - Lu Chen; Rui Zheng; Binghai Wang; Senjie Jin; Caishuang Huang; Junjie Ye; Zhihao Zhang 002; Yuhao Zhou; Zhiheng Xi; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (EMNLP, 2024)

Reward Modeling Requires Automatic Adjustment Based on Data Quality. - Binghai Wang; Rui Zheng; Lu Chen; Zhiheng Xi; Wei Shen; Yuhao Zhou; Dong Yan; Tao Gui; Qi Zhang 001; Xuanjing Huang 001 (EMNLP (Findings), 2024)

Secrets of RLHF in Large Language Models Part II: Reward Modeling. - Binghai Wang; Rui Zheng; Lu Chen; Yan Liu 002; Shihan Dou; Caishuang Huang; Wei Shen; Senjie Jin; Enyu Zhou; Chenyu Shi; Songyang Gao; Nuo Xu; et al. (CoRR, 2024)

RMB: Comprehensively benchmarking reward models in LLM alignment. - Enyu Zhou; Guodong Zheng; Binghai Wang; Zhiheng Xi; Shihan Dou; Rong Bao; Wei Shen; Limao Xiong; Jessica Fan; Yurong Mou; Rui Zheng; Tao Gui; et al. (ICLR, 2025)

WorldPM: Scaling Human Preference Modeling. - Binghai Wang; Runji Lin; Keming Lu; Le Yu; Zhenru Zhang; Fei Huang 005; Chujie Zheng; Kai Dang; Yang Fan; Xingzhang Ren; An Yang; Binyuan Hui; et al. (CoRR, 2025)