Modeling Disclosive Transparency in NLP Application Descriptions. - Michael Saxon; Sharon Levy; Xinyi Wang 003; Alon Albalak; William Yang Wang (EMNLP (1), 2021)

Dimensions of Transparency in NLP Applications. - Michael Saxon; Sharon Levy; Xinyi Wang 003; Alon Albalak; William Yang Wang (CoRR, 2021)

D-REX: Dialogue Relation Extraction with Explanations. - Alon Albalak; Varun Embar; Yi-Lin Tuan; Lise Getoor; William Yang Wang (ConvAI@ACL, 2022)

FETA: A Benchmark for Few-Sample Task Transfer in Open-Domain Dialogue. - Alon Albalak; Yi-Lin Tuan; Pegah Jandaghi; Connor Pryor; Luke Yoffe; Deepak Ramachandran; Lise Getoor; Jay Pujara; William Yang Wang (EMNLP, 2022)

Emotion Recognition in Conversation using Probabilistic Soft Logic. - Eriq Augustine; Pegah Jandaghi; Alon Albalak; Connor Pryor; Charles Dickens; William Yang Wang; Lise Getoor (CoRR, 2022)

Data-Efficiency with a Single GPU: An Exploration of Transfer Methods for Small Language Models. - Alon Albalak; Akshat Shrivastava; Chinnadhurai Sankar; Adithya Sagar; Mike Ross (CoRR, 2022)

An Exploration of Data Efficiency in Intra-Dataset Task Transfer for Dialog Understanding. - Josiah Ross; Luke Yoffe; Alon Albalak; William Yang Wang (CoRR, 2022)

CausalDialogue: Modeling Utterance-level Causality in Conversations. - Yi-Lin Tuan; Alon Albalak; Wenda Xu; Michael Saxon; Connor Pryor; Lise Getoor; William Yang Wang (ACL (Findings), 2023)

Addressing Issues of Cross-Linguality in Open-Retrieval Question Answering Systems For Emergent Domains. - Alon Albalak; Sharon Levy; William Yang Wang (EACL (System Demonstrations), 2023)

Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning. - Liangming Pan; Alon Albalak; Xinyi Wang 003; William Yang Wang (EMNLP (Findings), 2023)

RWKV: Reinventing RNNs for the Transformer Era. - Bo Peng; Eric Alcaide; Quentin Anthony; Alon Albalak; Samuel Arcadinho; Stella Biderman; Huanqi Cao; Xin Cheng; Michael Chung; Leon Derczynski; Xingjian Du; Matteo Grella; et al. (EMNLP (Findings), 2023)

NeuPSL: Neural Probabilistic Soft Logic. - Connor Pryor; Charles Dickens; Eriq Augustine; Alon Albalak; William Yang Wang; Lise Getoor (IJCAI, 2023)

Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data. - Alon Albalak; Colin A. Raffel; William Yang Wang (NeurIPS, 2023)

RWKV: Reinventing RNNs for the Transformer Era. - Bo Peng; Eric Alcaide; Quentin Anthony; Alon Albalak; Samuel Arcadinho; Huanqi Cao; Xin Cheng; Michael Chung; Matteo Grella; Kranthi Kiran G. V.; Xuzheng He; Haowen Hou; et al. (CoRR, 2023)

Efficient Online Data Mixing For Language Model Pre-Training. - Alon Albalak; Liangming Pan; Colin Raffel; William Yang Wang (CoRR, 2023)

DataComp-LM: In search of the next generation of training sets for language models. - Jeffrey Li; Alex Fang; Georgios Smyrnis; Maor Ivgi; Matt Jordan; Samir Yitzhak Gadre; Hritik Bansal; Etash Kumar Guha; Sedrick Scott Keh; Kushal Arora; Saurabh Garg; Rui Xin; et al. (NeurIPS, 2024)

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence. - Bo Peng; Daniel Goldstein; Quentin Anthony; Alon Albalak; Eric Alcaide; Stella Biderman; Eugene Cheah; Xingjian Du; Teddy Ferdinan; Haowen Hou; Przemyslaw Kazienko; Kranthi Kiran GV; et al. (CoRR, 2024)

A Mathematical Framework, a Taxonomy of Modeling Paradigms, and a Suite of Learning Techniques for Neural-Symbolic Systems. - Charles Dickens; Connor Pryor; Changyu Gao; Alon Albalak; Eriq Augustine; William Yang Wang; Stephen J. Wright 001; Lise Getoor (CoRR, 2024)

Generative Reward Models. - Dakota Mahan; Duy Phung; Rafael Rafailov; Chase Blagden; Nathan Lile; Louis Castricato; Jan-Philipp Fränken; Chelsea Finn; Alon Albalak (CoRR, 2024)

Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Models. - Alex Havrilla; Andrew Dai 001; Laura O'Mahony; Koen Oostermeijer; Vera Zisler; Alon Albalak; Fabrizio Milo; Sharath Chandra Raparthy; Kanishk Gandhi; Baber Abbasi; Duy Phung; Maia Iyer; et al. (CoRR, 2024)

A Survey on Data Selection for Language Models. - Alon Albalak; Yanai Elazar; Sang Michael Xie; Shayne Longpre; Nathan Lambert 001; Xinyi Wang 003; Niklas Muennighoff; Bairu Hou; Liangming Pan; Haewon Jeong; Colin Raffel; Shiyu Chang; et al. (Trans. Mach. Learn. Res., 2024)

The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources. - Shayne Longpre; Stella Biderman; Alon Albalak; Hailey Schoelkopf; Daniel McDuff; Sayash Kapoor; Kevin Klyman; Kyle Lo; Gabriel Ilharco; Nay San; Maribeth Rauh; Aviya Skowron; et al. (Trans. Mach. Learn. Res., 2024)

Understanding and Improving Language Models Through a Data-Centric Lens - Alon Albalak (2024)

Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Data. - Xinyi Wang 003; Antonis Antoniades; Yanai Elazar; Alfonso Amayuelas; Alon Albalak; Kexun Zhang; William Yang Wang (ICLR, 2025)

Towards System 2 Reasoning in LLMs: Learning How to Think With Meta Chain-of-Thought. - Violet Xiang; Charlie Snell; Kanishk Gandhi; Alon Albalak; Anikait Singh; Chase Blagden; Duy Phung; Rafael Rafailov; Nathan Lile; Dakota Mahan; Louis Castricato; Jan-Philipp Fränken; et al. (CoRR, 2025)

Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models. - Alon Albalak; Duy Phung; Nathan Lile; Rafael Rafailov; Kanishk Gandhi; Louis Castricato; Anikait Singh; Chase Blagden; Violet Xiang; Dakota Mahan; Nick Haber (CoRR, 2025)

OpenThoughts: Data Recipes for Reasoning Models. - Etash Kumar Guha; Ryan Marten; Sedrick Keh; Negin Raoof; Georgios Smyrnis; Hritik Bansal; Marianna Nezhurina; Jean Mercat; Trung Vu 002; Zayne Sprague; Ashima Suvarna; Benjamin Feuer; et al. (CoRR, 2025)

The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text. - Nikhil Kandpal; Brian Lester; Colin Raffel; Sebastian Majstorovic; Stella Biderman; Baber Abbasi; Luca Soldaini; Enrico Shippole; A. Feder Cooper; Aviya Skowron; John Kirchenbauer; Shayne Longpre; et al. (CoRR, 2025)

MAGPIE: A dataset for Multi-AGent contextual PrIvacy Evaluation. - Gurusha Juneja; Alon Albalak; Wenyue Hua; William Yang Wang (CoRR, 2025)