Objective Robustness in Deep Reinforcement Learning. - Jack Koch; Lauro Langosco; Jacob Pfau; James Le; Lee Sharkey (CoRR, 2021)

Neural Variational Gradient Descent. - Lauro Langosco di Langosco; Vincent Fortuin; Heiko Strathmann (CoRR, 2021)

Goal Misgeneralization in Deep Reinforcement Learning. - Lauro Langosco di Langosco; Jack Koch; Lee D. Sharkey; Jacob Pfau; David Krueger 001 (ICML, 2022)

Harms from Increasingly Agentic Algorithmic Systems. - Alan Chan; Rebecca Salganik; Alva Markelius; Chris Pang; Nitarshan Rajkumar; Dmitrii Krasheninnikov; Lauro Langosco; Zhonghao He; Yawen Duan; Micah Carroll; Michelle P. Lin; Alex Mayhew; et al. (FAccT, 2023)

Unifying Grokking and Double Descent. - Xander Davies; Lauro Langosco; David Krueger 001 (CoRR, 2023)

Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback. - Stephen Casper; Xander Davies; Claudia Shi; Thomas Krendl Gilbert; Jérémy Scheurer; Javier Rando; Rachel Freedman; Tomasz Korbak; David Lindner; Pedro Freire; Tony Tong Wang; Samuel Marks; et al. (Trans. Mach. Learn. Res., 2023)

Foundational Challenges in Assuring Alignment and Safety of Large Language Models. - Usman Anwar; Abulhair Saparov; Javier Rando; Daniel Paleka; Miles Turpin; Peter Hase; Ekdeep Singh Lubana; Erik Jenner; Stephen Casper; Oliver Sourbut; Benjamin L. Edelman; Zhaowei Zhang; et al. (CoRR, 2024)

Foundational Challenges in Assuring Alignment and Safety of Large Language Models. - Usman Anwar; Abulhair Saparov; Javier Rando; Daniel Paleka; Miles Turpin; Peter Hase; Ekdeep Singh Lubana; Erik Jenner; Stephen Casper; Oliver Sourbut; Benjamin L. Edelman; Zhaowei Zhang; et al. (Trans. Mach. Learn. Res., 2024)