A Comprehensive Survey of LLM Alignment Techniques: RLHF, RLAIF, PPO, DPO and More. - Zhichao Wang; Bin Bi; Shiva Kumar Pentyala; Kiran Ramnath; Sougata Chaudhuri; Shubham Mehrotra; Zixu James Zhu; Xiang-Bo Mao; Sitaram Asur; Na Claire Cheng (CoRR, 2024)

UNA: Unifying Alignments of RLHF/PPO, DPO and KTO by a Generalized Implicit Reward Function. - Zhichao Wang; Bin Bi; Can Huang; Shiva Kumar Pentyala; Zixu James Zhu; Sitaram Asur; Na Claire Cheng (CoRR, 2024)