Measuring Massive Multitask Language Understanding. - Dan Hendrycks; Collin Burns; Steven Basart; Andy Zou; Mantas Mazeika; Dawn Song; Jacob Steinhardt (ICLR, 2021)

What Would Jiminy Cricket Do? Towards Agents That Behave Morally. - Dan Hendrycks; Mantas Mazeika; Andy Zou; Sahil Patel; Christine Zhu; Jesus Navarro; Dawn Song; Bo Li 026; Jacob Steinhardt (NeurIPS Datasets and Benchmarks, 2021)

The Trojan Detection Challenge. - Mantas Mazeika; Dan Hendrycks; Huichen Li; Xiaojun Xu; Sidney Q. Hough; Andy Zou; Arezoo Rajabi; Qi Yao; Zihao Wang; Jian Tian; Yao Tang; Di Tang 001; et al. (NeurIPS (Competition and Demos), 2021)

PixMix: Dreamlike Pictures Comprehensively Improve Safety Measures. - Dan Hendrycks; Andy Zou; Mantas Mazeika; Leonard Tang; Bo Li 026; Dawn Song; Jacob Steinhardt (CVPR, 2022)

Scaling Out-of-Distribution Detection for Real-World Settings. - Dan Hendrycks; Steven Basart; Mantas Mazeika; Andy Zou; Joseph Kwon; Mohammadreza Mostajabi; Jacob Steinhardt; Dawn Song (ICML, 2022)

How Would The Viewer Feel? Estimating Wellbeing From Video Scenarios. - Mantas Mazeika; Eric Tang; Andy Zou; Steven Basart; Jun Shern Chan; Dawn Song; David A. Forsyth; Jacob Steinhardt; Dan Hendrycks (NeurIPS, 2022)

Forecasting Future World Events With Neural Networks. - Andy Zou; Tristan Xiao; Ryan Jia; Joe Kwon; Mantas Mazeika; Richard Li; Dawn Song; Jacob Steinhardt; Owain Evans; Dan Hendrycks (NeurIPS, 2022)

Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the Machiavelli Benchmark. - Alexander Pan; Jun Shern Chan; Andy Zou; Nathaniel Li; Steven Basart; Thomas Woodside; Hanlin Zhang 002; Scott Emmons; Dan Hendrycks (ICML, 2023)

Unlocking Deterministic Robustness Certification on ImageNet. - Kai Hu; Andy Zou; Zifan Wang 001; Klas Leino; Matt Fredrikson (NeurIPS, 2023)

Scaling in Depth: Unlocking Robustness Certification on ImageNet. - Kai Hu; Andy Zou; Zifan Wang 001; Klas Leino; Matt Fredrikson (CoRR, 2023)

Papaya: Federated Learning, but Fully Decentralized. - Ram M. Kripa; Andy Zou; Ryan Jia; Kenny Huang (CoRR, 2023)

Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmark. - Alexander Pan; Jun Shern Chan; Andy Zou; Nathaniel Li; Steven Basart; Thomas Woodside; Jonathan Ng; Hanlin Zhang 002; Scott Emmons; Dan Hendrycks (CoRR, 2023)

Universal and Transferable Adversarial Attacks on Aligned Language Models. - Andy Zou; Zifan Wang 001; J. Zico Kolter; Matt Fredrikson (CoRR, 2023)

Representation Engineering: A Top-Down Approach to AI Transparency. - Andy Zou; Long Phan; Sarah Li Chen; James Campbell; Phillip Guo; Richard Ren; Alexander Pan; Xuwang Yin; Mantas Mazeika; Ann-Kathrin Dombrowski; Shashwat Goel; Nathaniel Li; et al. (CoRR, 2023)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. - Aarohi Srivastava; Abhinav Rastogi; Abhishek Rao; Abu Awal Md Shoeb; Abubakar Abid; Adam Fisch; Adam R. Brown; Adam Santoro; Aditya Gupta; Adrià Garriga-Alonso; Agnieszka Kluska; Aitor Lewkowycz; et al. (Trans. Mach. Learn. Res., 2023)

The WMDP Benchmark: Measuring and Reducing Malicious Use with Unlearning. - Nathaniel Li; Alexander Pan; Anjali Gopal; Summer Yue; Daniel Berrios; Alice Gatti; Justin D. Li; Ann-Kathrin Dombrowski; Shashwat Goel; Gabriel Mukobi; Nathan Helm-Burger; Rassin Lababidi; et al. (ICML, 2024)

HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal. - Mantas Mazeika; Long Phan; Xuwang Yin; Andy Zou; Zifan Wang 001; Norman Mu; Elham Sakhaee; Nathaniel Li; Steven Basart; Bo Li 026; David A. Forsyth; Dan Hendrycks (ICML, 2024)

Improving Alignment and Robustness with Circuit Breakers. - Andy Zou; Long Phan; Justin Wang; Derek Duenas; Maxwell Lin; Maksym Andriushchenko; J. Zico Kolter; Matt Fredrikson; Dan Hendrycks (NeurIPS, 2024)

The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning. - Nathaniel Li; Alexander Pan; Anjali Gopal; Summer Yue; Daniel Berrios; Alice Gatti; Justin D. Li; Ann-Kathrin Dombrowski; Shashwat Goel; Long Phan; Gabriel Mukobi; Nathan Helm-Burger; et al. (CoRR, 2024)

Lessons from the Trenches on Reproducible Evaluation of Language Models. - Stella Biderman; Hailey Schoelkopf; Lintang Sutawika; Leo Gao; Jonathan Tow; Baber Abbasi; Alham Fikri Aji; Pawan Sasanka Ammanamanchi; Sidney Black; Jordan Clive; Anthony DiPofi; Julen Etxaniz; et al. (CoRR, 2024)

Improving Alignment and Robustness with Circuit Breakers. - Andy Zou; Long Phan; Justin Wang; Derek Duenas; Maxwell Lin; Maksym Andriushchenko; Rowan Wang; Zico Kolter; Matt Fredrikson; Dan Hendrycks (CoRR, 2024)

AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents. - Maksym Andriushchenko; Alexandra Souly; Mateusz Dziemian; Derek Duenas; Maxwell Lin; Justin Wang; Dan Hendrycks; Andy Zou; Zico Kolter; Matt Fredrikson; Eric Winsor; Jerome Wynne; et al. (CoRR, 2024)

AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents. - Maksym Andriushchenko; Alexandra Souly; Mateusz Dziemian; Derek Duenas; Maxwell Lin; Justin Wang; Dan Hendrycks; Andy Zou; J. Zico Kolter; Matt Fredrikson; Yarin Gal; Xander Davies (ICLR, 2025)

Tamper-Resistant Safeguards for Open-Weight LLMs. - Rishub Tamirisa; Bhrugu Bharathi; Long Phan; Andy Zhou; Alice Gatti; Tarun Suresh; Maxwell Lin; Justin Wang; Rowan Wang; Ron Arel; Andy Zou; Dawn Song; et al. (ICLR, 2025)

On the Trustworthiness of Generative Foundation Models: Guideline, Assessment, and Perspective. - Yue Huang 001; Chujie Gao; Siyuan Wu 001; Haoran Wang 005; Xiangqi Wang; Yujun Zhou 010; Yanbo Wang 005; Jiayi Ye; Jiawen Shi; Qihui Zhang; Yuan Li 032; Han Bao 003; et al. (CoRR, 2025)

Safety Pretraining: Toward the Next Generation of Safe AI. - Pratyush Maini; Sachin Goyal; Dylan Sam; Alexander Robey; Yash Savani; Yiding Jiang; Andy Zou; Zacharcy C. Lipton; J. Zico Kolter (CoRR, 2025)

Transferable Adversarial Attacks on Black-Box Vision-Language Models. - Kai Hu; Weichen Yu; Li Zhang; Alexander Robey; Andy Zou; Chengming Xu 004; Haoqi Hu; Matt Fredrikson (CoRR, 2025)

Adversarial Attacks on Robotic Vision Language Action Models. - Eliot Krzysztof Jones; Alexander Robey; Andy Zou; Zachary Ravichandran; George J. Pappas; Hamed Hassani; Matt Fredrikson; J. Zico Kolter (CoRR, 2025)

Security Challenges in AI Agent Deployment: Insights from a Large Scale Public Competition. - Andy Zou; Maxwell Lin; Eliot Krzysztof Jones; Micha Nowak; Mateusz Dziemian; Nick Winter; Alexander Grattan; Valent Nathanael; Ayla Croft; Xander Davies; Jai Patel; Robert Kirk; et al. (CoRR, 2025)

TextQuests: How Good are LLMs at Text-Based Video Games? - Long Phan; Mantas Mazeika; Andy Zou; Dan Hendrycks (CoRR, 2025)