Catherine Arnett

According to our database, Catherine Arnett authored at least 21 papers between 2023 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2026

Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs.

Guijin Son, Seungone Kim, Catherine Arnett, Hyunwoo Ko, Hyein Lee, Hyeonah Kang, Jiang Longxi, Jin Yun, JungYup Lee, Kyungmin Lee, Sam Yoosuk Kim, Sang Park, Seunghyeok Hong, SeungJae Lee, Seungyeop Yi, Shinae Shin, SunHye Bok, Sunyoung Shin, Yonghoon Ji, Youngtaek Kim, Hanearl Jung, Akari Asai, Graham Neubig, Sean Welleck, Youngjae Yu, Akshelin R, Alexander B. Ivanov, Boboev Muhammadjon, Chae Young Han, Christian Stump, Cooper R. Anderson, Dmitrii Karp, Dohyun Kwon, Dongryung Yi, DoYong Kwon, Duk-Soon Oh, Eunho Choi, Giovanni Resta, Greta Panova, Huiyun Noh, Hyungryul Baik, Hyungsun Bae, Inomov Mashrafdzhon, Jeewon Kim, Jeong-Rae Kim, Ji Eun Lee, Jiaqi Liu, Jieui Kang, Jimin Kim, Jon-Lark Kim, Joonyeong Won, Junseo Yoon, Junwoo Jo, Kibeom Kim, Kiwoon Kwon, Mario Kummer, Max Mercer, Min Hoon Kim, Minjun Kim, Nahyun Lee, Ng Ze-An, Nicolas Libedinsky, Rafal Marcin Lochowski, Raphaël Lachièze-Rey, Robert Auffarth, Ruichen Zhang, Sejin Park, Seonguk Seo, Shin Jaehoon, Sunatullo, Taewoong Eom, Yeachan Park, Yongseok Jang, Youchan Oh, Zhaoyang Wang, Zoltán Kovács

CoRR, May, 2026

Weight Tying Biases Token Embeddings Towards the Output Space.

Antonio Lopardo, Avyukth Harish, Catherine Arnett, Akshat Gupta

CoRR, March, 2026

How Open Must Language Models be to Enable Reliable Scientific Inference?

James A. Michaelov, Catherine Arnett, Tyler A. Chang, Pamela D. Rivière, Samuel M. Taylor, Cameron R. Jones, Sean Trott, Roger P. Levy, Benjamin K. Bergen, Micah Altman

CoRR, March, 2026

CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web Data.

Pedro Ortiz Suarez, Laurie Burchell, Catherine Arnett, Rafael Mosquera Gómez, Sara Hincapié Monsalve, Thom Vaughan, Damian Stewart, Malte Ostendorff, Idris Abdulmumin, Vukosi Marivate, Shamsuddeen Hassan Muhammad, Atnafu Lambebo Tonja, Hend Al-Khalifa, Nadia Ghezaiel Hammouda, Verrah Otiende, Tack Hwa Wong, Jakhongir Saydaliev, Melika Nobakhtian, Muhammad Ravi Shulthan Habibi, Kranti Chalamalasetti, Carol Muchemi, Khang Nguyen, Faisal Muhammad Adam, Luis Frentzen Salim, Reem Alqifari, Cynthia Amol, Joseph Marvin Imperial, Ilker Kesen, Ahmad Mustafid, Pavel Stepachev, Leshem Choshen, David Anugraha, Hamada Nayel, Seid Muhie Yimam, Vallerie Alexandra Putra, My Chiffon Nguyen, Azmine Toushik Wasi, Gouthami Vadithya, Rob van der Goot, Lanwenn Ar C'horr, Karan Dua, Andrew Yates, Mithil Bangera, Yeshil Bangera, Hitesh Laxmichand Patel, Shu Okabe, Fenal Ashokbhai Ilasariya, Dmitry Gaynullin, Genta Indra Winata, Yiyuan Li, Juan Pablo Martínez, Amit Agarwal, Ikhlasul Akmal Hanif, Raia Abu Ahmad, Esther Adenuga, Filbert Aurelian Tjiaranata, Weerayut Buaphet, Michael Anugraha, Sowmya Vajjala, Benjamin Rice, Azril Hafizi Amirudin, Jesujoba O. Alabi, Srikant Panda, Yassine Toughrai, Bruhan Kyomuhendo, Daniel Ruffinelli, Akshata A, Manuel Goulão, Ej Zhou, Ingrid Gabriela Franco Ramirez, Cristina Aggazzotti, Konstantin Dobler, Jun Kevin, Quentin Pagès, Nicholas Andrews, Nuhu Ibrahim, Mattes Ruckdeschel, Amr Keleg, Mike Zhang, Casper Muziri, Saron Samuel, Sotaro Takeshita, Kun Kerdthaisong, Luca Foppiano, Rasul Dent, Tommaso Green, Ahmad Mustapha Wali, Kamohelo Makaaka, Vicky Feliren, Inshirah Idris, Hande Çelikkanat, Abdulhamid Abubakar, Jean Maillard, Benoît Sagot, Thibault Clérice, Kenton Murray, Sarah Luger

CoRR, January, 2026

2025

Disaggregation Reveals Hidden Training Dynamics: The Case of Agreement Attraction.

James A. Michaelov, Catherine Arnett

CoRR, October, 2025

Global PIQA: Evaluating Physical Commonsense Reasoning Across 100+ Languages and Cultures.

Tyler A. Chang, Catherine Arnett

CoRR, October, 2025

Explaining and Mitigating Crosslingual Tokenizer Inequities.

Catherine Arnett, Tyler A. Chang, Stella Biderman, Benjamin K. Bergen

CoRR, October, 2025

Evaluating Morphological Alignment of Tokenizers in 70 Languages.

Catherine Arnett, Marisa Hudspeth, Brendan T. O'Connor

CoRR, July, 2025

Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Training.

Pierre-Carl Langlais, Carlos Rosas Hinostroza, Mattia Nee, Catherine Arnett, Pavel Chizhov, Eliot Jones, Irène Girard, David Mach, Anastasia Stasenko, Ivan P. Yamshchikov

CoRR, June, 2025

BPE Stays on SCRIPT: Structured Encoding for Robust Multilingual Pretokenization.

Sander Land, Catherine Arnett

CoRR, May, 2025

Why do language models perform worse for morphologically complex languages?

Catherine Arnett, Benjamin Bergen

Proceedings of the 31st International Conference on Computational Linguistics, 2025

On the Acquisition of Shared Grammatical Representations in Bilingual Language Models.

Catherine Arnett, Tyler A. Chang, James A. Michaelov, Ben Bergen

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

2024

Toxicity of the Commons: Curating Open-Source Pre-Training Data.

Catherine Arnett, Eliot Jones, Ivan P. Yamshchikov, Pierre-Carl Langlais

CoRR, 2024

Goldfish: Monolingual Language Models for 350 Languages.

Tyler A. Chang, Catherine Arnett, Zhuowen Tu, Benjamin K. Bergen

CoRR, 2024

Revenge of the Fallen? Recurrent Models Match Transformers at Predicting Human Language Comprehension Metrics.

James A. Michaelov, Catherine Arnett, Benjamin K. Bergen

CoRR, 2024

Different Tokenization Schemes Lead to Comparable Performance in Spanish Number Agreement.

Catherine Arnett, Pamela D. Rivière, Tyler A. Chang, Sean Trott

CoRR, 2024

A Bit of a Problem: Measurement Disparities in Dataset Sizes Across Languages.

Catherine Arnett, Tyler A. Chang, Benjamin K. Bergen

CoRR, 2024

BPE Gets Picky: Efficient Vocabulary Refinement During Tokenizer Training.

Pavel Chizhov, Catherine Arnett, Elizaveta Korotkova, Ivan P. Yamshchikov

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languages.

Tyler A. Chang, Catherine Arnett, Zhuowen Tu, Ben Bergen

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

2023

Crosslingual Structural Priming and the Pre-Training Dynamics of Bilingual Language Models.

Catherine Arnett, Tyler A. Chang, James A. Michaelov, Benjamin K. Bergen

CoRR, 2023

Structural Priming Demonstrates Abstract Grammatical Representations in Multilingual Language Models.

James A. Michaelov, Catherine Arnett, Tyler A. Chang, Ben Bergen

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023