Risks from Learned Optimization in Advanced Machine Learning Systems. - Evan Hubinger; Chris van Merwijk; Vladimir Mikulik; Joar Skalse; Scott Garrabrant (CoRR, 2019)

An overview of 11 proposals for building safe advanced AI. - Evan Hubinger (CoRR, 2020)

Engineering Monosemanticity in Toy Models. - Adam S. Jermyn; Nicholas Schiefer; Evan Hubinger (CoRR, 2022)

Discovering Language Model Behaviors with Model-Written Evaluations. - Ethan Perez; Sam Ringer; Kamile Lukosiute; Karina Nguyen; Edwin Chen; Scott Heiner; Craig Pettit; Catherine Olsson; Sandipan Kundu; Saurav Kadavath; Andy Jones; Anna Chen; et al. (CoRR, 2022)

Discovering Language Model Behaviors with Model-Written Evaluations. - Ethan Perez; Sam Ringer; Kamile Lukosiute; Karina Nguyen; Edwin Chen; Scott Heiner; Craig Pettit; Catherine Olsson; Sandipan Kundu; Saurav Kadavath; Andy Jones; Anna Chen; et al. (ACL (Findings), 2023)

Conditioning Predictive Models: Risks and Strategies. - Evan Hubinger; Adam S. Jermyn; Johannes Treutlein; Rubi Hudson; Kate Woolverton (CoRR, 2023)

Question Decomposition Improves the Faithfulness of Model-Generated Reasoning. - Ansh Radhakrishnan; Karina Nguyen; Anna Chen; Carol Chen; Carson Denison; Danny Hernandez; Esin Durmus; Evan Hubinger; Jackson Kernion; Kamile Lukosiute; Newton Cheng; Nicholas Joseph; et al. (CoRR, 2023)

Measuring Faithfulness in Chain-of-Thought Reasoning. - Tamera Lanham; Anna Chen; Ansh Radhakrishnan; Benoit Steiner; Carson Denison; Danny Hernandez; Dustin Li; Esin Durmus; Evan Hubinger; Jackson Kernion; Kamile Lukosiute; Karina Nguyen; et al. (CoRR, 2023)

Studying Large Language Model Generalization with Influence Functions. - Roger B. Grosse; Juhan Bae; Cem Anil; Nelson Elhage; Alex Tamkin; Amirhossein Tajdini; Benoit Steiner; Dustin Li; Esin Durmus; Ethan Perez; Evan Hubinger; Kamile Lukosiute; et al. (CoRR, 2023)

Steering Llama 2 via Contrastive Activation Addition. - Nina Rimsky; Nick Gabrieli; Julian Schulz; Meg Tong; Evan Hubinger; Alexander Matt Turner (ACL (1), 2024)

Many-shot Jailbreaking. - Cem Anil; Esin Durmus; Nina Panickssery; Mrinank Sharma; Joe Benton; Sandipan Kundu; Joshua Batson; Meg Tong; Jesse Mu; Daniel Ford; Francesco Mosconi; Rajashree Agrawal; et al. (NeurIPS, 2024)

Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training. - Evan Hubinger; Carson Denison; Jesse Mu; Mike Lambert; Meg Tong; Monte MacDiarmid; Tamera Lanham; Daniel M. Ziegler; Tim Maxwell; Newton Cheng; Adam S. Jermyn; Amanda Askell; et al. (CoRR, 2024)

Uncovering Deceptive Tendencies in Language Models: A Simulated Company AI Assistant. - Olli Järviniemi; Evan Hubinger (CoRR, 2024)

Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models. - Carson Denison; Monte MacDiarmid; Fazl Barez; David Duvenaud; Shauna Kravec; Samuel Marks; Nicholas Schiefer; Ryan Soklaski; Alex Tamkin; Jared Kaplan; Buck Shlegeris; Samuel R. Bowman; et al. (CoRR, 2024)

Sabotage Evaluations for Frontier Models. - Joe Benton; Misha Wagner; Eric Christiansen; Cem Anil; Ethan Perez; Jai Srivastav; Esin Durmus; Deep Ganguli; Shauna Kravec; Buck Shlegeris; Jared Kaplan; Holden Karnofsky; et al. (CoRR, 2024)

Alignment faking in large language models. - Ryan Greenblatt; Carson Denison; Benjamin Wright; Fabien Roger; Monte MacDiarmid; Samuel Marks; Johannes Treutlein; Tim Belonax; Jack Chen; David Duvenaud; Akbir Khan; Julian Michael; et al. (CoRR, 2024)

Auditing language models for hidden objectives. - Samuel Marks; Johannes Treutlein; Trenton Bricken; Jack Lindsey; Jonathan Marcus; Siddharth Mishra-Sharma; Daniel M. Ziegler; Emmanuel Ameisen; Joshua Batson; Tim Belonax; Samuel R. Bowman; Shan Carter; et al. (CoRR, 2025)

Will AI Tell Lies to Save Sick Children? Litmus-Testing AI Values Prioritization with AIRiskDilemmas. - Yu Ying Chiu; Zhilin Wang; Sharan Maiya; Yejin Choi 001; Kyle Fish; Sydney Levine; Evan Hubinger (CoRR, 2025)

Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety. - Tomek Korbak; Mikita Balesni; Elizabeth Barnes; Yoshua Bengio; Joe Benton; Joseph Bloom; Mark Chen 003; Alan Cooney; Allan Dafoe; Anca D. Dragan; Scott Emmons; Owain Evans; et al. (CoRR, 2025)