The Role of Cooperation in Responsible AI Development. - Amanda Askell; Miles Brundage; Gillian K. Hadfield (CoRR, 2019)

Release Strategies and the Social Impacts of Language Models. - Irene Solaiman; Miles Brundage; Jack Clark; Amanda Askell; Ariel Herbert-Voss; Jeff Wu 003; Alec Radford; Jasmine Wang (CoRR, 2019)

Language Models are Few-Shot Learners. - Tom B. Brown; Benjamin Mann; Nick Ryder; Melanie Subbiah; Jared Kaplan; Prafulla Dhariwal; Arvind Neelakantan; Pranav Shyam; Girish Sastry; Amanda Askell; Sandhini Agarwal; Ariel Herbert-Voss; et al. (NeurIPS, 2020)

Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims. - Miles Brundage; Shahar Avin; Jasmine Wang; Haydn Belfield; Gretchen Krueger; Gillian K. Hadfield; Heidy Khlaaf; Jingying Yang; Helen Toner; Ruth Fong; Tegan Maharaj; Pang Wei Koh; et al. (CoRR, 2020)

Learning Transferable Visual Models From Natural Language Supervision. - Alec Radford; Jong Wook Kim; Chris Hallacy; Aditya Ramesh; Gabriel Goh; Sandhini Agarwal; Girish Sastry; Amanda Askell; Pamela Mishkin; Jack Clark; Gretchen Krueger; Ilya Sutskever (ICML, 2021)

A General Language Assistant as a Laboratory for Alignment. - Amanda Askell; Yuntao Bai; Anna Chen; Dawn Drain; Deep Ganguli; Tom Henighan; Andy Jones; Nicholas Joseph; Benjamin Mann; Nova DasSarma; Nelson Elhage; Zac Hatfield-Dodds; et al. (CoRR, 2021)

Predictability and Surprise in Large Generative Models. - Deep Ganguli; Danny Hernandez; Liane Lovitt; Amanda Askell; Yuntao Bai; Anna Chen; Tom Conerly; Nova DasSarma; Dawn Drain; Nelson Elhage; Sheer El Showk; Stanislav Fort; et al. (FAccT, 2022)

Training language models to follow instructions with human feedback. - Long Ouyang; Jeffrey Wu 003; Xu Jiang; Diogo Almeida; Carroll L. Wainwright; Pamela Mishkin; Chong Zhang; Sandhini Agarwal; Katarina Slama; Alex Ray; John Schulman; Jacob Hilton; et al. (NeurIPS, 2022)

Predictability and Surprise in Large Generative Models. - Deep Ganguli; Danny Hernandez; Liane Lovitt; Nova DasSarma; Tom Henighan; Andy Jones; Nicholas Joseph; Jackson Kernion; Benjamin Mann; Amanda Askell; Yuntao Bai; Anna Chen; et al. (CoRR, 2022)

Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback. - Yuntao Bai; Andy Jones; Kamal Ndousse; Amanda Askell; Anna Chen; Nova DasSarma; Dawn Drain; Stanislav Fort; Deep Ganguli; Tom Henighan; Nicholas Joseph; Saurav Kadavath; et al. (CoRR, 2022)

Language Models (Mostly) Know What They Know. - Saurav Kadavath; Tom Conerly; Amanda Askell; Tom Henighan; Dawn Drain; Ethan Perez; Nicholas Schiefer; Zac Hatfield-Dodds; Nova DasSarma; Eli Tran-Johnson; Scott Johnston; Sheer El Showk; et al. (CoRR, 2022)

Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned. - Deep Ganguli; Liane Lovitt; Jackson Kernion; Amanda Askell; Yuntao Bai; Saurav Kadavath; Ben Mann; Ethan Perez; Nicholas Schiefer; Kamal Ndousse; Andy Jones; Sam Bowman 001; et al. (CoRR, 2022)

In-context Learning and Induction Heads. - Catherine Olsson; Nelson Elhage; Neel Nanda; Nicholas Joseph; Nova DasSarma; Tom Henighan; Ben Mann; Amanda Askell; Yuntao Bai; Anna Chen; Tom Conerly; Dawn Drain; et al. (CoRR, 2022)

Measuring Progress on Scalable Oversight for Large Language Models. - Samuel R. Bowman; Jeeyoon Hyun; Ethan Perez; Edwin Chen; Craig Pettit; Scott Heiner; Kamile Lukosiute; Amanda Askell; Andy Jones; Anna Chen; Anna Goldie; Azalia Mirhoseini; et al. (CoRR, 2022)

Constitutional AI: Harmlessness from AI Feedback. - Yuntao Bai; Saurav Kadavath; Sandipan Kundu; Amanda Askell; Jackson Kernion; Andy Jones; Anna Chen; Anna Goldie; Azalia Mirhoseini; Cameron McKinnon; Carol Chen; Catherine Olsson; et al. (CoRR, 2022)

Discovering Language Model Behaviors with Model-Written Evaluations. - Ethan Perez; Sam Ringer; Kamile Lukosiute; Karina Nguyen; Edwin Chen; Scott Heiner; Craig Pettit; Catherine Olsson; Sandipan Kundu; Saurav Kadavath; Andy Jones; Anna Chen; et al. (CoRR, 2022)

Discovering Language Model Behaviors with Model-Written Evaluations. - Ethan Perez; Sam Ringer; Kamile Lukosiute; Karina Nguyen; Edwin Chen; Scott Heiner; Craig Pettit; Catherine Olsson; Sandipan Kundu; Saurav Kadavath; Andy Jones; Anna Chen; et al. (ACL (Findings), 2023)

The Capacity for Moral Self-Correction in Large Language Models. - Deep Ganguli; Amanda Askell; Nicholas Schiefer; Thomas I. Liao; Kamile Lukosiute; Anna Chen; Anna Goldie; Azalia Mirhoseini; Catherine Olsson; Danny Hernandez; Dawn Drain; Dustin Li; et al. (CoRR, 2023)

Towards Measuring the Representation of Subjective Global Opinions in Language Models. - Esin Durmus; Karina Nyugen; Thomas I. Liao; Nicholas Schiefer; Amanda Askell; Anton Bakhtin; Carol Chen; Zac Hatfield-Dodds; Danny Hernandez; Nicholas Joseph; Liane Lovitt; Sam McCandlish; et al. (CoRR, 2023)

Towards Understanding Sycophancy in Language Models. - Mrinank Sharma; Meg Tong; Tomasz Korbak; David Duvenaud; Amanda Askell; Samuel R. Bowman; Newton Cheng; Esin Durmus; Zac Hatfield-Dodds; Scott R. Johnston; Shauna Kravec; Timothy Maxwell; et al. (CoRR, 2023)

Specific versus General Principles for Constitutional AI. - Sandipan Kundu; Yuntao Bai; Saurav Kadavath; Amanda Askell; Andrew Callahan; Anna Chen; Anna Goldie; Avital Balwit; Azalia Mirhoseini; Brayden McLean; Catherine Olsson; Cassie Evraets; et al. (CoRR, 2023)

Evaluating and Mitigating Discrimination in Language Model Decisions. - Alex Tamkin; Amanda Askell; Liane Lovitt; Esin Durmus; Nicholas Joseph; Shauna Kravec; Karina Nguyen; Jared Kaplan; Deep Ganguli (CoRR, 2023)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. - Aarohi Srivastava; Abhinav Rastogi; Abhishek Rao; Abu Awal Md Shoeb; Abubakar Abid; Adam Fisch; Adam R. Brown; Adam Santoro; Aditya Gupta; Adrià Garriga-Alonso; Agnieszka Kluska; Aitor Lewkowycz; et al. (Trans. Mach. Learn. Res., 2023)

Towards Understanding Sycophancy in Language Models. - Mrinank Sharma; Meg Tong; Tomasz Korbak; David Duvenaud; Amanda Askell; Samuel R. Bowman; Esin Durmus; Zac Hatfield-Dodds; Scott R. Johnston; Shauna Kravec; Timothy Maxwell; Sam McCandlish; et al. (ICLR, 2024)

Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training. - Evan Hubinger; Carson Denison; Jesse Mu; Mike Lambert; Meg Tong; Monte MacDiarmid; Tamera Lanham; Daniel M. Ziegler; Tim Maxwell; Newton Cheng; Adam S. Jermyn; Amanda Askell; et al. (CoRR, 2024)

Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teaming. - Mrinank Sharma; Meg Tong; Jesse Mu; Jerry Wei; Jorrit Kruthoff; Scott Goodfriend; Euan Ong; Alwin Peng; Raj Agarwal; Cem Anil; Amanda Askell; Nathan Bailey; et al. (CoRR, 2025)