Contrastive Policy Gradient: Aligning LLMs on sequence-level scores in a supervised-friendly fashion. - Yannis Flet-Berliac; Nathan Grinsztajn; Florian Strub; Eugene Choi; Bill Wu; Chris Cremer; Arash Ahmadian; Yash Chandak; Mohammad Gheshlaghi Azar; Olivier Pietquin; Matthieu Geist (EMNLP, 2024)

Averaging log-likelihoods in direct alignment. - Nathan Grinsztajn; Yannis Flet-Berliac; Mohammad Gheshlaghi Azar; Florian Strub; Bill Wu; Eugene Choi; Chris Cremer; Arash Ahmadian; Yash Chandak; Olivier Pietquin; Matthieu Geist (CoRR, 2024)