Constitutional AI: Harmlessness from AI Feedback. - Yuntao Bai; Saurav Kadavath; Sandipan Kundu; Amanda Askell; Jackson Kernion; Andy Jones; Anna Chen; Anna Goldie; Azalia Mirhoseini; Cameron McKinnon; Carol Chen; Catherine Olsson; et al. (CoRR, 2022)

Discovering Language Model Behaviors with Model-Written Evaluations. - Ethan Perez; Sam Ringer; Kamile Lukosiute; Karina Nguyen; Edwin Chen; Scott Heiner; Craig Pettit; Catherine Olsson; Sandipan Kundu; Saurav Kadavath; Andy Jones; Anna Chen; et al. (CoRR, 2022)

Discovering Language Model Behaviors with Model-Written Evaluations. - Ethan Perez; Sam Ringer; Kamile Lukosiute; Karina Nguyen; Edwin Chen; Scott Heiner; Craig Pettit; Catherine Olsson; Sandipan Kundu; Saurav Kadavath; Andy Jones; Anna Chen; et al. (ACL (Findings), 2023)

The Capacity for Moral Self-Correction in Large Language Models. - Deep Ganguli; Amanda Askell; Nicholas Schiefer; Thomas I. Liao; Kamile Lukosiute; Anna Chen; Anna Goldie; Azalia Mirhoseini; Catherine Olsson; Danny Hernandez; Dawn Drain; Dustin Li; et al. (CoRR, 2023)

Question Decomposition Improves the Faithfulness of Model-Generated Reasoning. - Ansh Radhakrishnan; Karina Nguyen; Anna Chen; Carol Chen; Carson Denison; Danny Hernandez; Esin Durmus; Evan Hubinger; Jackson Kernion; Kamile Lukosiute; Newton Cheng; Nicholas Joseph; et al. (CoRR, 2023)

Measuring Faithfulness in Chain-of-Thought Reasoning. - Tamera Lanham; Anna Chen; Ansh Radhakrishnan; Benoit Steiner; Carson Denison; Danny Hernandez; Dustin Li; Esin Durmus; Evan Hubinger; Jackson Kernion; Kamile Lukosiute; Karina Nguyen; et al. (CoRR, 2023)

Many-shot Jailbreaking. - Cem Anil; Esin Durmus; Nina Panickssery; Mrinank Sharma; Joe Benton; Sandipan Kundu; Joshua Batson; Meg Tong; Jesse Mu; Daniel Ford; Francesco Mosconi; Rajashree Agrawal; et al. (NeurIPS, 2024)

Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training. - Evan Hubinger; Carson Denison; Jesse Mu; Mike Lambert; Meg Tong; Monte MacDiarmid; Tamera Lanham; Daniel M. Ziegler; Tim Maxwell; Newton Cheng; Adam S. Jermyn; Amanda Askell; et al. (CoRR, 2024)