Structural Priming Demonstrates Abstract Grammatical Representations in Multilingual Language Models. - James A. Michaelov; Catherine Arnett; Tyler A. Chang; Ben Bergen 001 (EMNLP, 2023)

Crosslingual Structural Priming and the Pre-Training Dynamics of Bilingual Language Models. - Catherine Arnett; Tyler A. Chang; James A. Michaelov; Benjamin K. Bergen 001 (CoRR, 2023)

When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languages. - Tyler A. Chang; Catherine Arnett; Zhuowen Tu; Ben Bergen 001 (EMNLP, 2024)

BPE Gets Picky: Efficient Vocabulary Refinement During Tokenizer Training. - Pavel Chizhov; Catherine Arnett; Elizaveta Korotkova; Ivan P. Yamshchikov (EMNLP, 2024)

A Bit of a Problem: Measurement Disparities in Dataset Sizes Across Languages. - Catherine Arnett; Tyler A. Chang; Benjamin K. Bergen 001 (CoRR, 2024)

Different Tokenization Schemes Lead to Comparable Performance in Spanish Number Agreement. - Catherine Arnett; Pamela D. Rivière; Tyler A. Chang; Sean Trott (CoRR, 2024)

Revenge of the Fallen? Recurrent Models Match Transformers at Predicting Human Language Comprehension Metrics. - James A. Michaelov; Catherine Arnett; Benjamin K. Bergen 001 (CoRR, 2024)

Goldfish: Monolingual Language Models for 350 Languages. - Tyler A. Chang; Catherine Arnett; Zhuowen Tu; Benjamin K. Bergen 001 (CoRR, 2024)

Toxicity of the Commons: Curating Open-Source Pre-Training Data. - Catherine Arnett; Eliot Jones; Ivan P. Yamshchikov; Pierre-Carl Langlais (CoRR, 2024)

On the Acquisition of Shared Grammatical Representations in Bilingual Language Models. - Catherine Arnett; Tyler A. Chang; James A. Michaelov; Ben Bergen 001 (ACL (1), 2025)

Why do language models perform worse for morphologically complex languages? - Catherine Arnett; Benjamin Bergen 001 (COLING, 2025)

BPE Stays on SCRIPT: Structured Encoding for Robust Multilingual Pretokenization. - Sander Land; Catherine Arnett (CoRR, 2025)

Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Training. - Pierre-Carl Langlais; Carlos Rosas Hinostroza; Mattia Nee; Catherine Arnett; Pavel Chizhov; Eliot Jones; Irène Girard; David Mach; Anastasia Stasenko; Ivan P. Yamshchikov (CoRR, 2025)

Evaluating Morphological Alignment of Tokenizers in 70 Languages. - Catherine Arnett; Marisa Hudspeth; Brendan T. O'Connor 001 (CoRR, 2025)