Improving Robustness of Reinforcement Learning for Power System Control with Adversarial Training. - Alexander Pan; Yongkyun Lee; Huan Zhang 001; Yize Chen; Yuanyuan Shi (CoRR, 2021)

The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models. - Alexander Pan; Kush Bhatia; Jacob Steinhardt (ICLR, 2022)

Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the Machiavelli Benchmark. - Alexander Pan; Jun Shern Chan; Andy Zou; Nathaniel Li; Steven Basart; Thomas Woodside; Hanlin Zhang 002; Scott Emmons; Dan Hendrycks (ICML, 2023)

Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmark. - Alexander Pan; Jun Shern Chan; Andy Zou; Nathaniel Li; Steven Basart; Thomas Woodside; Jonathan Ng; Hanlin Zhang 002; Scott Emmons; Dan Hendrycks (CoRR, 2023)

Representation Engineering: A Top-Down Approach to AI Transparency. - Andy Zou; Long Phan; Sarah Li Chen; James Campbell; Phillip Guo; Richard Ren; Alexander Pan; Xuwang Yin; Mantas Mazeika; Ann-Kathrin Dombrowski; Shashwat Goel; Nathaniel Li; et al. (CoRR, 2023)

The WMDP Benchmark: Measuring and Reducing Malicious Use with Unlearning. - Nathaniel Li; Alexander Pan; Anjali Gopal; Summer Yue; Daniel Berrios; Alice Gatti; Justin D. Li; Ann-Kathrin Dombrowski; Shashwat Goel; Gabriel Mukobi; Nathan Helm-Burger; Rassin Lababidi; et al. (ICML, 2024)

Feedback Loops With Language Models Drive In-Context Reward Hacking. - Alexander Pan; Erik Jones; Meena Jagadeesan; Jacob Steinhardt (ICML, 2024)

Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress? - Richard Ren; Steven Basart; Adam Khoja; Alice Gatti; Long Phan; Xuwang Yin; Mantas Mazeika; Alexander Pan; Gabriel Mukobi; Ryan H. Kim; Stephen Fitz; Dan Hendrycks (NeurIPS, 2024)

The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning. - Nathaniel Li; Alexander Pan; Anjali Gopal; Summer Yue; Daniel Berrios; Alice Gatti; Justin D. Li; Ann-Kathrin Dombrowski; Shashwat Goel; Long Phan; Gabriel Mukobi; Nathan Helm-Burger; et al. (CoRR, 2024)

Foundational Challenges in Assuring Alignment and Safety of Large Language Models. - Usman Anwar; Abulhair Saparov; Javier Rando; Daniel Paleka; Miles Turpin; Peter Hase; Ekdeep Singh Lubana; Erik Jenner; Stephen Casper; Oliver Sourbut; Benjamin L. Edelman; Zhaowei Zhang; et al. (CoRR, 2024)

LatentQA: Teaching LLMs to Decode Activations Into Natural Language. - Alexander Pan; Lijie Chen 001; Jacob Steinhardt (CoRR, 2024)

Foundational Challenges in Assuring Alignment and Safety of Large Language Models. - Usman Anwar; Abulhair Saparov; Javier Rando; Daniel Paleka; Miles Turpin; Peter Hase; Ekdeep Singh Lubana; Erik Jenner; Stephen Casper; Oliver Sourbut; Benjamin L. Edelman; Zhaowei Zhang; et al. (Trans. Mach. Learn. Res., 2024)