Adversarial training for high-stakes reliability. - Daniel M. Ziegler; Seraphina Nix; Lawrence Chan; Tim Bauman; Peter Schmidt-Nielsen; Tao Lin; Adam Scherlis; Noa Nabeshima; Ben Weinstein-Raun; Daniel de Haas; Buck Shlegeris; Nate Thomas (NeurIPS, 2022)

RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts. - Hjalmar Wijk; Tao Lin; Joel Becker; Sami Jawhar; Neev Parikh; Thomas Broadley; Lawrence Chan; Michael Chen; Josh Clymer; Jai Dhyani; Elena Ericheva; Katharyn Garcia; et al. (CoRR, 2024)

Measuring AI Ability to Complete Long Tasks. - Thomas Kwa; Ben West; Joel Becker; Amy Deng; Katharyn Garcia; Max Hasin; Sami Jawhar; Megan Kinniment; Nate Rush; Sydney von Arx; Ryan Bloom; Thomas Broadley; et al. (CoRR, 2025)

HCAST: Human-Calibrated Autonomy Software Tasks. - David Rein; Joel Becker; Amy Deng; Seraphina Nix; Chris Canal; Daniel O'Connel; Pip Arnott; Ryan Bloom; Thomas Broadley; Katharyn Garcia; Brian Goodrich; Max Hasin; et al. (CoRR, 2025)