FOLIO: Natural Language Reasoning with First-Order Logic. - Simeng Han; Hailey Schoelkopf; Yilun Zhao 001; Zhenting Qi; Martin Riddell; Luke Benson; Lucy Sun; Ekaterina Zubova; Yujie Qiao; Matthew Burtell; David Peng; Jonathan Fan 001; et al. (CoRR, 2022)

Explicit Knowledge Transfer for Weakly-Supervised Code Generation. - Zhangir Azerbayev; Ansong Ni; Hailey Schoelkopf; Dragomir Radev (CoRR, 2022)

BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting. - Zheng Xin Yong; Hailey Schoelkopf; Niklas Muennighoff; Alham Fikri Aji; David Ifeoluwa Adelani; Khalid Almubarak; M. Saiful Bari; Lintang Sutawika; Jungo Kasai; Ahmed Baruwa; Genta Indra Winata; Stella Biderman; et al. (CoRR, 2022)

FeTaQA: Free-form Table Question Answering. - Linyong Nan; Chiachun Hsieh; Ziming Mao; Xi Victoria Lin; Neha Verma 001; Rui Zhang 037; Wojciech Kryscinski; Hailey Schoelkopf; Riley Kong; Xiangru Tang; Mutethia Mutuma; Ben Rosand; et al. (Trans. Assoc. Comput. Linguistics, 2022)

Crosslingual Generalization through Multitask Finetuning. - Niklas Muennighoff; Thomas Wang; Lintang Sutawika; Adam Roberts; Stella Biderman; Teven Le Scao; M. Saiful Bari; Sheng Shen 001; Zheng Xin Yong; Hailey Schoelkopf; Xiangru Tang; Dragomir Radev; et al. (ACL (1), 2023)

GAIA Search: Hugging Face and Pyserini Interoperability for NLP Training Data Exploration. - Aleksandra Piktus; Odunayo Ogundepo; Christopher Akiki; Akintunde Oladipo; Xinyu Zhang 018; Hailey Schoelkopf; Stella Biderman; Martin Potthast; Jimmy Lin (ACL (demo), 2023)

BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting. - Zheng Xin Yong; Hailey Schoelkopf; Niklas Muennighoff; Alham Fikri Aji; David Ifeoluwa Adelani; Khalid Almubarak; M. Saiful Bari; Lintang Sutawika; Jungo Kasai; Ahmed Baruwa; Genta Indra Winata; Stella Biderman; et al. (ACL (1), 2023)

Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling. - Stella Biderman; Hailey Schoelkopf; Quentin Gregory Anthony; Herbie Bradley; Kyle O'Brien; Eric Hallahan; Mohammad Aflah Khan; Shivanshu Purohit; USVSN Sai Prashanth; Edward Raff; Aviya Skowron; Lintang Sutawika; et al. (ICML, 2023)

Emergent and Predictable Memorization in Large Language Models. - Stella Biderman; USVSN Sai Prashanth; Lintang Sutawika; Hailey Schoelkopf; Quentin Anthony; Shivanshu Purohit; Edward Raff (NeurIPS, 2023)

SantaCoder: don't reach for the stars! - Loubna Ben Allal; Raymond Li; Denis Kocetkov; Chenghao Mou; Christopher Akiki; Carlos Muñoz Ferrandis; Niklas Muennighoff; Mayank Mishra; Alex Gu; Manan Dey; Logesh Kumar Umapathi; Carolyn Jane Anderson; et al. (CoRR, 2023)

ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematics. - Zhangir Azerbayev; Bartosz Piotrowski; Hailey Schoelkopf; Edward W. Ayers; Dragomir Radev; Jeremy Avigad (CoRR, 2023)

StarCoder: may the source be with you! - Raymond Li; Loubna Ben Allal; Yangtian Zi; Niklas Muennighoff; Denis Kocetkov; Chenghao Mou; Marc Marone; Christopher Akiki; Jia Li 015; Jenny Chim; Qian Liu 012; Evgenii Zheltonozhskii; et al. (Trans. Mach. Learn. Res., 2023)

FOLIO: Natural Language Reasoning with First-Order Logic. - Simeng Han; Hailey Schoelkopf; Yilun Zhao 001; Zhenting Qi; Martin Riddell; Wenfei Zhou; James Coady; David Peng; Yujie Qiao; Luke Benson; Lucy Sun; Alexander Wardle-Solano; et al. (EMNLP, 2024)

Llemma: An Open Language Model for Mathematics. - Zhangir Azerbayev; Hailey Schoelkopf; Keiran Paster; Marco Dos Santos; Stephen Marcus McAleer; Albert Q. Jiang; Jia Deng; Stella Biderman; Sean Welleck (ICLR, 2024)

Position: Social Choice Should Guide AI Alignment in Dealing with Diverse Human Feedback. - Vincent Conitzer; Rachel Freedman; Jobst Heitzig; Wesley H. Holliday; Bob M. Jacobs; Nathan Lambert 001; Milan Mossé; Eric Pacuit; Stuart Russell 001; Hailey Schoelkopf; Emanuel Tewolde; William S. Zwicker (ICML, 2024)

Consent in Crisis: The Rapid Decline of the AI Data Commons. - Shayne Longpre; Robert Mahari; Ariel Lee; Campbell Lund; Hamidah Oderinwale; William Brannon; Nayan Saxena; Naana Obeng-Marnu; Tobin South; Cole Hunter; Kevin Klyman; Christopher Klamm; et al. (NeurIPS, 2024)

Suppressing Pink Elephants with Direct Principle Feedback. - Louis Castricato; Nathan Lile; Suraj Anand; Hailey Schoelkopf; Siddharth Verma; Stella Biderman (CoRR, 2024)

Social Choice for AI Alignment: Dealing with Diverse Human Feedback. - Vincent Conitzer; Rachel Freedman; Jobst Heitzig; Wesley H. Holliday; Bob M. Jacobs; Nathan Lambert 001; Milan Mossé; Eric Pacuit; Stuart Russell 001; Hailey Schoelkopf; Emanuel Tewolde; William S. Zwicker (CoRR, 2024)

Lessons from the Trenches on Reproducible Evaluation of Language Models. - Stella Biderman; Hailey Schoelkopf; Lintang Sutawika; Leo Gao; Jonathan Tow; Baber Abbasi; Alham Fikri Aji; Pawan Sasanka Ammanamanchi; Sidney Black; Jordan Clive; Anthony DiPofi; Julen Etxaniz; et al. (CoRR, 2024)

Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive? - Rylan Schaeffer; Hailey Schoelkopf; Brando Miranda; Gabriel Mukobi; Varun Madan; Adam Ibrahim; Herbie Bradley; Stella Biderman; Sanmi Koyejo (CoRR, 2024)

Consent in Crisis: The Rapid Decline of the AI Data Commons. - Shayne Longpre; Robert Mahari; Ariel Lee; Campbell Lund; Hamidah Oderinwale; William Brannon; Nayan Saxena; Naana Obeng-Marnu; Tobin South; Cole Hunter; Kevin Klyman; Christopher Klamm; et al. (CoRR, 2024)

Self-Directed Synthetic Dialogues and Revisions Technical Report. - Nathan Lambert 001; Hailey Schoelkopf; Aaron Gokaslan; Luca Soldaini; Valentina Pyatkin; Louis Castricato (CoRR, 2024)

The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources. - Shayne Longpre; Stella Biderman; Alon Albalak; Hailey Schoelkopf; Daniel McDuff; Sayash Kapoor; Kevin Klyman; Kyle Lo; Gabriel Ilharco; Nay San; Maribeth Rauh; Aviya Skowron; et al. (Trans. Mach. Learn. Res., 2024)

From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models. - Sean Welleck; Amanda Bertsch; Matthew Finlayson; Hailey Schoelkopf; Alex Xie; Graham Neubig; Ilia Kulikov; Zaïd Harchaoui (Trans. Mach. Learn. Res., 2024)

PolyPythias: Stability and Outliers across Fifty Language Model Pre-Training Runs. - Oskar van der Wal; Pietro Lesci; Max Müller-Eberstein; Naomi Saphra; Hailey Schoelkopf; Willem H. Zuidema; Stella Biderman (ICLR, 2025)