Evaluating Language-Model Agents on Realistic Autonomous Tasks. - Megan Kinniment; Lucas Jun Koba Sato; Haoxing Du; Brian Goodrich; Max Hasin; Lawrence Chan; Luke Harold Miles; Tao R. Lin; Hjalmar Wijk; Joel Burget; Aaron Ho; Elizabeth Barnes; et al. (CoRR, 2023)

RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts. - Hjalmar Wijk; Tao Lin; Joel Becker; Sami Jawhar; Neev Parikh; Thomas Broadley; Lawrence Chan; Michael Chen; Josh Clymer; Jai Dhyani; Elena Ericheva; Katharyn Garcia; et al. (CoRR, 2024)

Measuring AI Ability to Complete Long Tasks. - Thomas Kwa; Ben West; Joel Becker; Amy Deng; Katharyn Garcia; Max Hasin; Sami Jawhar; Megan Kinniment; Nate Rush; Sydney von Arx; Ryan Bloom; Thomas Broadley; et al. (CoRR, 2025)

HCAST: Human-Calibrated Autonomy Software Tasks. - David Rein; Joel Becker; Amy Deng; Seraphina Nix; Chris Canal; Daniel O'Connel; Pip Arnott; Ryan Bloom; Thomas Broadley; Katharyn Garcia; Brian Goodrich; Max Hasin; et al. (CoRR, 2025)