A Framework for (Under)specifying Dependency Syntax without Overloading Annotators. - Nathan Schneider 001; Brendan O'Connor 001; Naomi Saphra; David Bamman; Manaal Faruqui; Noah A. Smith; Chris Dyer; Jason Baldridge (LAW@ACL, 2013)

Understanding Objects in Detail with Fine-Grained Attributes. - Andrea Vedaldi; Siddharth Mahendran; Stavros Tsogkas; Subhransu Maji; Ross B. Girshick; Juho Kannala; Esa Rahtu; Iasonas Kokkinos; Matthew B. Blaschko; David J. Weiss; Ben Taskar; Karen Simonyan; et al. (CVPR, 2014)

AMRICA: an AMR Inspector for Cross-language Alignments. - Naomi Saphra; Adam Lopez (HLT-NAACL, 2015)

Evaluating Informal-Domain Word Representations With UrbanDictionary. - Naomi Saphra (RepEval@ACL, 2016)

Evaluating Informal-Domain Word Representations With UrbanDictionary. - Naomi Saphra; Adam Lopez (CoRR, 2016)

DyNet: The Dynamic Neural Network Toolkit. - Graham Neubig; Chris Dyer; Yoav Goldberg; Austin Matthews; Waleed Ammar; Antonios Anastasopoulos; Miguel Ballesteros; David Chiang 001; Daniel Clothiaux; Trevor Cohn; Kevin Duh; Manaal Faruqui; et al. (CoRR, 2017)

Language Models Learn POS First. - Naomi Saphra; Adam Lopez (BlackboxNLP@EMNLP, 2018)

Understanding Learning Dynamics Of Language Models with SVCCA. - Naomi Saphra; Adam Lopez (NAACL-HLT (1), 2019)

Sparsity Emerges Naturally in Neural Language Models. - Naomi Saphra; Adam Lopez (CoRR, 2019)

How to Evaluate Word Representations of Informal Domain? - Yekun Chai; Naomi Saphra; Adam Lopez (CoRR, 2019)

Understanding Privacy-Related Questions on Stack Overflow. - Mohammad Tahaei; Kami Vaniea; Naomi Saphra (CHI, 2020)

Pareto Probing: Trading Off Accuracy for Complexity. - Tiago Pimentel; Naomi Saphra; Adina Williams; Ryan Cotterell (EMNLP (1), 2020)

LSTMS Compose - and Learn - Bottom-Up. - Naomi Saphra; Adam Lopez (EMNLP (Findings), 2020)

Word Interdependence Exposes How LSTMs Compose Representations. - Naomi Saphra; Adam Lopez (CoRR, 2020)

A Non-Linear Structural Probe. - Jennifer C. White; Tiago Pimentel; Naomi Saphra; Ryan Cotterell (NAACL-HLT, 2021)

Benchmarking Compositionality with Formal Languages. - Josef Valvoda; Naomi Saphra; Jonathan Rawski; Adina Williams; Ryan Cotterell (COLING, 2022)

The MultiBERTs: BERT Reproductions for Robustness Analysis. - Thibault Sellam; Steve Yadlowsky; Ian Tenney; Jason Wei; Naomi Saphra; Alexander D'Amour; Tal Linzen; Jasmijn Bastings; Iulia Raluca Turc; Jacob Eisenstein; Dipanjan Das 001; Ellie Pavlick (ICLR, 2022)

Learning Transductions to Test Systematic Compositionality. - Josef Valvoda; Naomi Saphra; Jonathan Rawski; Ryan Cotterell; Adina Williams (CoRR, 2022)

State-of-the-art generalisation research in NLP: a taxonomy and review. - Dieuwke Hupkes; Mario Giulianelli; Verna Dankers; Mikel Artetxe; Yanai Elazar; Tiago Pimentel; Christos Christodoulopoulos 001; Karim Lasri; Naomi Saphra; Arabella Sinclair; Dennis Ulmer; Florian Schottmann; et al. (CoRR, 2022)

One Venue, Two Conferences: The Separation of Chinese and American Citation Networks. - Bingchen Zhao; Yuling Gu; Jessica Zosa Forde; Naomi Saphra (CoRR, 2022)

Linear Connectivity Reveals Generalization Strategies. - Jeevesh Juneja; Rachit Bansal; Kyunghyun Cho; João Sedoc; Naomi Saphra (ICLR, 2023)

Towards out-of-distribution generalization in large-scale astronomical surveys: robust networks learn similar representations. - Yash Gondhalekar; Sultan Hassan; Naomi Saphra; Sambatra Andrianomena (CoRR, 2023)

Latent State Models of Training Dynamics. - Michael Y. Hu; Angelica Chen; Naomi Saphra; Kyunghyun Cho (Trans. Mach. Learn. Res., 2023)

A taxonomy and review of generalization research in NLP. - Dieuwke Hupkes; Mario Giulianelli; Verna Dankers; Mikel Artetxe; Yanai Elazar; Tiago Pimentel; Christos E. Christodoulopoulos; Karim Lasri; Naomi Saphra; Arabella Sinclair; Dennis Ulmer; Florian Schottmann; et al. (Nat. Mac. Intell., 2023)

Dynamic Masking Rate Schedules for MLM Pretraining. - Zachary Ankner; Naomi Saphra; Davis W. Blalock; Jonathan Frankle; Matthew L. Leavitt (EACL (2), 2024)

Attribute Diversity Determines the Systematicity Gap in VQA. - Ian Berlot-Attwell; Kumar Krishna Agrawal; Annabelle Michael Carrell; Yash Sharma; Naomi Saphra (EMNLP, 2024)

ChatGPT Doesn't Trust Chargers Fans: Guardrail Sensitivity in Context. - Victoria R. Li; Yida Chen; Naomi Saphra (EMNLP, 2024)

Fast Forwarding Low-Rank Training. - Adir Rahamim; Naomi Saphra; Sara Kangaslahti; Yonatan Belinkov (EMNLP, 2024)

Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs. - Angelica Chen; Ravid Shwartz-Ziv; Kyunghyun Cho; Matthew L. Leavitt; Naomi Saphra (ICLR, 2024)

TRAM: Bridging Trust Regions and Sharpness Aware Minimization. - Tom Sherborne; Naomi Saphra; Pradeep Dasigi; Hao Peng 009 (ICLR, 2024)

First Tragedy, then Parse: History Repeats Itself in the New Era of Large Language Models. - Naomi Saphra; Eve Fleisig; Kyunghyun Cho; Adam Lopez (NAACL-HLT, 2024)

Transcendence: Generative Models Can Outperform The Experts That Train Them. - Edwin Zhang; Vincent Zhu; Naomi Saphra; Anat Kleiman; Benjamin L. Edelman; Milind Tambe; Sham M. Kakade; Eran Malach (NeurIPS, 2024)

Knowing Your Nonlinearities: Shapley Interactions Reveal the Underlying Structure of Data. - Divyansh Singhvi; Andrej Erkelens; Raghav Jain; Diganta Misra; Naomi Saphra (CoRR, 2024)

Benchmarks as Microscopes: A Call for Model Metrology. - Michael Saxon; Ari Holtzman; Peter West; William Yang Wang; Naomi Saphra (CoRR, 2024)

Mechanistic? - Naomi Saphra; Sarah Wiegreffe (CoRR, 2024)

Sometimes I am a Tree: Data Drives Unstable Hierarchical Generalization. - Tian Qin; Naomi Saphra; David Alvarez-Melis (CoRR, 2024)

Using Shapley interactions to understand how models use structure. - Divyansh Singhvi; Diganta Misra; Andrej Erkelens; Raghav Jain; Isabel Papadimitriou; Naomi Saphra (ACL (1), 2025)

Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon. - USVSN Sai Prashanth; Alvin Deng; Kyle O'Brien; Jyothir S. V; Mohammad Aflah Khan; Jaydeep Borkar; Christopher A. Choquette-Choo; Jacob Ray Fuehne; Stella Biderman; Tracy Ke; Katherine Lee; Naomi Saphra (ICLR, 2025)

PolyPythias: Stability and Outliers across Fifty Language Model Pre-Training Runs. - Oskar van der Wal; Pietro Lesci; Max Müller-Eberstein; Naomi Saphra; Hailey Schoelkopf; Willem H. Zuidema; Stella Biderman (ICLR, 2025)

Distributional Scaling Laws for Emergent Capabilities. - Rosie Zhao; Tian Qin; David Alvarez-Melis; Sham M. Kakade; Naomi Saphra (CoRR, 2025)

Interpreting the Linear Structure of Vision-language Model Embedding Spaces. - Isabel Papadimitriou; Huangyuan Su; Thomas Fel; Naomi Saphra; Sham M. Kakade; Stephanie Gil (CoRR, 2025)

Hidden Breakthroughs in Language Model Training. - Sara Kangaslahti; Elan Rosenfeld; Naomi Saphra (CoRR, 2025)

Can Interpretation Predict Behavior on Unseen Data? - Victoria R. Li; Jenny Kaufmann; Martin Wattenberg; David Alvarez-Melis; Naomi Saphra (CoRR, 2025)