What is Your Metric Telling You? Evaluating Classifier Calibration under Context-Specific Definitions of Reliability. - John Kirchenbauer; Jacob Oaks; Eric Heim (CoRR, 2022)

A Watermark for Large Language Models. - John Kirchenbauer; Jonas Geiping; Yuxin Wen; Jonathan Katz; Ian Miers; Tom Goldstein (ICML, 2023)

GOAT: A Global Transformer on Large-scale Graphs. - Kezhi Kong; Jiuhai Chen; John Kirchenbauer; Renkun Ni; C. Bayan Bruss; Tom Goldstein (ICML, 2023)

Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery. - Yuxin Wen; Neel Jain; John Kirchenbauer; Micah Goldblum; Jonas Geiping; Tom Goldstein (NeurIPS, 2023)

Tree-Rings Watermarks: Invisible Fingerprints for Diffusion Images. - Yuxin Wen; John Kirchenbauer; Jonas Geiping; Tom Goldstein (NeurIPS, 2023)

Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust. - Yuxin Wen; John Kirchenbauer; Jonas Geiping; Tom Goldstein (CoRR, 2023)

Bring Your Own Data! Self-Supervised Evaluation for Large Language Models. - Neel Jain; Khalid Saifullah; Yuxin Wen; John Kirchenbauer; Manli Shu; Aniruddha Saha; Micah Goldblum; Jonas Geiping; Tom Goldstein (CoRR, 2023)

Baseline Defenses for Adversarial Attacks Against Aligned Language Models. - Neel Jain; Avi Schwarzschild; Yuxin Wen; Gowthami Somepalli; John Kirchenbauer; Ping-yeh Chiang; Micah Goldblum; Aniruddha Saha; Jonas Geiping; Tom Goldstein (CoRR, 2023)

NEFTune: Noisy Embeddings Improve Instruction Finetuning. - Neel Jain; Ping-yeh Chiang; Yuxin Wen; John Kirchenbauer; Hong-Min Chu; Gowthami Somepalli; Brian R. Bartoldson; Bhavya Kailkhura; Avi Schwarzschild; Aniruddha Saha; Micah Goldblum; Jonas Geiping; et al. (ICLR, 2024)

On the Reliability of Watermarks for Large Language Models. - John Kirchenbauer; Jonas Geiping; Yuxin Wen; Manli Shu; Khalid Saifullah; Kezhi Kong; Kasun Fernando; Aniruddha Saha; Micah Goldblum; Tom Goldstein (ICLR, 2024)

Be like a Goldfish, Don't Memorize! Mitigating Memorization in Generative LLMs. - Abhimanyu Hans; John Kirchenbauer; Yuxin Wen; Neel Jain; Hamid Kazemi; Prajwal Singhania; Siddharth Singh; Gowthami Somepalli; Jonas Geiping; Abhinav Bhatele; Tom Goldstein (NeurIPS, 2024)

Transformers Can Do Arithmetic with the Right Embeddings. - Sean McLeish; Arpit Bansal; Alex Stein; Neel Jain; John Kirchenbauer; Brian R. Bartoldson; Bhavya Kailkhura; Abhinav Bhatele; Jonas Geiping; Avi Schwarzschild; Tom Goldstein (NeurIPS, 2024)

Democratizing AI: Open-source Scalable LLM Training on GPU-based Supercomputers. - Siddharth Singh; Prajwal Singhania; Aditya Ranjan; John Kirchenbauer; Jonas Geiping; Yuxin Wen; Neel Jain; Abhimanyu Hans; Manli Shu; Aditya Tomar; Tom Goldstein; Abhinav Bhatele (SC, 2024)

LMD3: Language Model Data Density Dependence. - John Kirchenbauer; Garrett Honke; Gowthami Somepalli; Jonas Geiping; Daphne Ippolito; Katherine Lee; Tom Goldstein; David Andre (CoRR, 2024)

OPTune: Efficient Online Preference Tuning. - Lichang Chen; Jiuhai Chen; Chenxi Liu; John Kirchenbauer; Davit Soselia; Chen Zhu 001; Tom Goldstein; Tianyi Zhou 001; Heng Huang (CoRR, 2024)

GenQA: Generating Millions of Instructions from a Handful of Prompts. - Jiuhai Chen; Rifaa Qadri; Yuxin Wen; Neel Jain; John Kirchenbauer; Tianyi Zhou 001; Tom Goldstein (CoRR, 2024)

Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach. - Jonas Geiping; Sean McLeish; Neel Jain; John Kirchenbauer; Siddharth Singh; Brian R. Bartoldson; Bhavya Kailkhura; Abhinav Bhatele; Tom Goldstein (CoRR, 2025)

Exploiting Sparsity for Long Context Inference: Million Token Contexts on Commodity GPUs. - Ryan Synk; Monte Hoover; John Kirchenbauer; Neel Jain; Alex Stein; Manli Shu; Josue Melendez Sanchez; Ramani Duraiswami; Tom Goldstein (CoRR, 2025)

Gemstones: A Model Suite for Multi-Faceted Scaling Laws. - Sean McLeish; John Kirchenbauer; David Yu Miller; Siddharth Singh; Abhinav Bhatele; Micah Goldblum; Ashwinee Panda; Tom Goldstein (CoRR, 2025)

When Can You Get Away with Low Memory Adam? - Dayal Singh Kalra; John Kirchenbauer; Maissam Barkeshli; Tom Goldstein (CoRR, 2025)

Zero-Shot Vision Encoder Grafting via LLM Surrogates. - Kaiyu Yue; Vasu Singla; Menglin Jia; John Kirchenbauer; Rifaa Qadri; Zikui Cai; Abhinav Bhatele; Furong Huang; Tom Goldstein (CoRR, 2025)

The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text. - Nikhil Kandpal; Brian Lester; Colin Raffel; Sebastian Majstorovic; Stella Biderman; Baber Abbasi; Luca Soldaini; Enrico Shippole; A. Feder Cooper; Aviya Skowron; John Kirchenbauer; Shayne Longpre; et al. (CoRR, 2025)

A Fictional Q&A Dataset for Studying Memorization and Knowledge Acquisition. - John Kirchenbauer; Janny Mongkolsupawan; Yuxin Wen; Tom Goldstein; Daphne Ippolito (CoRR, 2025)