Fine-Tuning Language Models from Human Preferences. - Daniel M. Ziegler; Nisan Stiennon; Jeffrey Wu 003; Tom B. Brown; Alec Radford; Dario Amodei; Paul F. Christiano; Geoffrey Irving (CoRR, 2019)

Language Models are Few-Shot Learners. - Tom B. Brown; Benjamin Mann; Nick Ryder; Melanie Subbiah; Jared Kaplan; Prafulla Dhariwal; Arvind Neelakantan; Pranav Shyam; Girish Sastry; Amanda Askell; Sandhini Agarwal; Ariel Herbert-Voss; et al. (NeurIPS, 2020)

Learning to summarize with human feedback. - Nisan Stiennon; Long Ouyang; Jeffrey Wu 003; Daniel M. Ziegler; Ryan Lowe; Chelsea Voss; Alec Radford; Dario Amodei; Paul F. Christiano (NeurIPS, 2020)

Learning to summarize from human feedback. - Nisan Stiennon; Long Ouyang; Jeff Wu 003; Daniel M. Ziegler; Ryan Lowe; Chelsea Voss; Alec Radford; Dario Amodei; Paul F. Christiano (CoRR, 2020)

Scaling Laws for Autoregressive Generative Modeling. - Tom Henighan; Jared Kaplan; Mor Katz; Mark Chen 003; Christopher Hesse; Jacob Jackson; Heewoo Jun; Tom B. Brown; Prafulla Dhariwal; Scott Gray; Chris Hallacy; Benjamin Mann; et al. (CoRR, 2020)

Recursively Summarizing Books with Human Feedback. - Jeff Wu 003; Long Ouyang; Daniel M. Ziegler; Nisan Stiennon; Ryan Lowe; Jan Leike; Paul F. Christiano (CoRR, 2021)

Adversarial training for high-stakes reliability. - Daniel M. Ziegler; Seraphina Nix; Lawrence Chan; Tim Bauman; Peter Schmidt-Nielsen; Tao Lin; Adam Scherlis; Noa Nabeshima; Ben Weinstein-Raun; Daniel de Haas; Buck Shlegeris; Nate Thomas (NeurIPS, 2022)

Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training. - Evan Hubinger; Carson Denison; Jesse Mu; Mike Lambert; Meg Tong; Monte MacDiarmid; Tamera Lanham; Daniel M. Ziegler; Tim Maxwell; Newton Cheng; Adam S. Jermyn; Amanda Askell; et al. (CoRR, 2024)

Auditing language models for hidden objectives. - Samuel Marks; Johannes Treutlein; Trenton Bricken; Jack Lindsey; Jonathan Marcus; Siddharth Mishra-Sharma; Daniel M. Ziegler; Emmanuel Ameisen; Joshua Batson; Tim Belonax; Samuel R. Bowman; Shan Carter; et al. (CoRR, 2025)

Measuring AI Ability to Complete Long Tasks. - Thomas Kwa; Ben West; Joel Becker; Amy Deng; Katharyn Garcia; Max Hasin; Sami Jawhar; Megan Kinniment; Nate Rush; Sydney von Arx; Ryan Bloom; Thomas Broadley; et al. (CoRR, 2025)