Catastrophic Cyber Capabilities Benchmark (3CB): Robustly Evaluating LLM Agent Cyber Offense Capabilities. - Andrey Anurin; Jonathan Ng; Kibo Schaffer; Jason Schreiber; Esben Kran (CoRR, 2024)

Benchmark Inflation: Revealing LLM Performance Gaps Using Retro-Holdouts. - Jacob Haimes; Cenny Wenner; Kunvar Thaman; Vassil Tashev; Clement Neo; Esben Kran; Jason Schreiber (CoRR, 2024)