Preferences Implicit in the State of the World. - Rohin Shah; Dmitrii Krasheninnikov; Jordan Alexander; Pieter Abbeel; Anca D. Dragan (ICLR (Poster), 2019)

Combining Reward Information from Multiple Sources. - Dmitrii Krasheninnikov; Rohin Shah; Herke van Hoof (CoRR, 2021)

Defining and Characterizing Reward Gaming. - Joar Skalse; Nikolaus H. R. Howe; Dmitrii Krasheninnikov; David Krueger 001 (NeurIPS, 2022)

Defining and Characterizing Reward Hacking. - Joar Skalse; Nikolaus H. R. Howe; Dmitrii Krasheninnikov; David Krueger 001 (CoRR, 2022)

Harms from Increasingly Agentic Algorithmic Systems. - Alan Chan; Rebecca Salganik; Alva Markelius; Chris Pang; Nitarshan Rajkumar; Dmitrii Krasheninnikov; Lauro Langosco; Zhonghao He; Yawen Duan; Micah Carroll; Michelle P. Lin; Alex Mayhew; et al. (FAccT, 2023)

Meta- (out-of-context) learning in neural networks. - Dmitrii Krasheninnikov; Egor Krasheninnikov; Bruno Mlodozeniec; David Krueger 001 (CoRR, 2023)

Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback. - Stephen Casper; Xander Davies; Claudia Shi; Thomas Krendl Gilbert; Jérémy Scheurer; Javier Rando; Rachel Freedman; Tomasz Korbak; David Lindner; Pedro Freire; Tony Tong Wang; Samuel Marks; et al. (Trans. Mach. Learn. Res., 2023)

Implicit meta-learning may lead language models to trust more reliable sources. - Dmitrii Krasheninnikov; Egor Krasheninnikov; Bruno Kacper Mlodozeniec; Tegan Maharaj; David Krueger 001 (ICML, 2024)

Stress-Testing Capability Elicitation With Password-Locked Models. - Ryan Greenblatt; Fabien Roger; Dmitrii Krasheninnikov; David Krueger 001 (NeurIPS, 2024)

Comparing Bottom-Up and Top-Down Steering Approaches on In-Context Learning Tasks. - Madeline Brumley; Joe Kwon; David Krueger 001; Dmitrii Krasheninnikov; Usman Anwar (CoRR, 2024)

Understanding (Un)Reliability of Steering Vectors in Language Models. - Joschka Braun; Carsten Eickhoff; David Krueger 001; Seyed Ali Bahrainian; Dmitrii Krasheninnikov (CoRR, 2025)

Detecting High-Stakes Interactions with Activation Probes. - Alex McKenzie; Urja Pawar; Phil Blandfort; William Bankes; David Krueger 001; Ekdeep Singh Lubana; Dmitrii Krasheninnikov (CoRR, 2025)