Red-Teaming the Stable Diffusion Safety Filter. - Javier Rando; Daniel Paleka; David Lindner; Lennart Heim; Florian Tramèr (CoRR, 2022)

A law of adversarial risk, interpolation, and label noise. - Daniel Paleka; Amartya Sanyal (ICLR, 2023)

ARB: Advanced Reasoning Benchmark for Large Language Models. - Tomohiro Sawada; Daniel Paleka; Alexander Havrilla; Pranav Tadepalli; Paula Vidas; Alexander Kranias; John J. Nay; Kshitij Gupta; Aran Komatsuzaki (CoRR, 2023)

Stealing part of a production language model. - Nicholas Carlini; Daniel Paleka; Krishnamurthy Dj Dvijotham; Thomas Steinke 002; Jonathan Hayase; A. Feder Cooper; Katherine Lee; Matthew Jagielski; Milad Nasr; Arthur Conmy; Eric Wallace; David Rolnick; et al. (ICML, 2024)

Refusal in Language Models Is Mediated by a Single Direction. - Andy Arditi; Oscar Obeso; Aaquib Syed; Daniel Paleka; Nina Panickssery; Wes Gurnee; Neel Nanda (NeurIPS, 2024)

Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition. - Edoardo Debenedetti; Javier Rando; Daniel Paleka; Silaghi Fineas Florin; Dragos Albastroiu; Niv Cohen; Yuval Lemberg; Reshmi Ghosh; Rui Wen 002; Ahmed Salem 001; Giovanni Cherubin; Santiago Zanella-Béguelin; et al. (NeurIPS, 2024)

Evaluating Superhuman Models with Consistency Checks. - Lukas Fluri; Daniel Paleka; Florian Tramèr (SaTML, 2024)

Poisoning Web-Scale Training Datasets is Practical. - Nicholas Carlini; Matthew Jagielski; Christopher A. Choquette-Choo; Daniel Paleka; Will Pearce; Hyrum S. Anderson; Andreas Terzis; Kurt Thomas; Florian Tramèr (SP, 2024)

Foundational Challenges in Assuring Alignment and Safety of Large Language Models. - Usman Anwar; Abulhair Saparov; Javier Rando; Daniel Paleka; Miles Turpin; Peter Hase; Ekdeep Singh Lubana; Erik Jenner; Stephen Casper; Oliver Sourbut; Benjamin L. Edelman; Zhaowei Zhang; et al. (CoRR, 2024)

Refusal in Language Models Is Mediated by a Single Direction. - Andy Arditi; Oscar Obeso; Aaquib Syed; Daniel Paleka; Nina Rimsky; Wes Gurnee; Neel Nanda (CoRR, 2024)

Foundational Challenges in Assuring Alignment and Safety of Large Language Models. - Usman Anwar; Abulhair Saparov; Javier Rando; Daniel Paleka; Miles Turpin; Peter Hase; Ekdeep Singh Lubana; Erik Jenner; Stephen Casper; Oliver Sourbut; Benjamin L. Edelman; Zhaowei Zhang; et al. (Trans. Mach. Learn. Res., 2024)

Consistency Checks for Language Model Forecasters. - Daniel Paleka; Abhimanyu Pallavi Sudhir; Alejandro Alvarez; Vineeth Bhat; Adam Shen; Evan Wang; Florian Tramèr (ICLR, 2025)

Pitfalls in Evaluating Language Model Forecasters. - Daniel Paleka; Shashwat Goel; Jonas Geiping; Florian Tramèr (CoRR, 2025)