BigBio: A Framework for Data-Centric Biomedical Natural Language Processing. - Jason A. Fries; Leon Weber; Natasha Seelam; Gabriel Altay; Debajyoti Datta; Samuele Garda; Sunny Kang; Rosaline Su; Wojciech Kusa; Samuel Cahyawijaya; Fabio Barth; Simon Ott; et al. (NeurIPS, 2022)

BigBIO: A Framework for Data-Centric Biomedical Natural Language Processing. - Jason Alan Fries; Leon Weber; Natasha Seelam; Gabriel Altay; Debajyoti Datta; Samuele Garda; Myungsun Kang; Ruisi Su; Wojciech Kusa; Samuel Cahyawijaya; Fabio Barth; Simon Ott; et al. (CoRR, 2022)

MusicLDM: Enhancing Novelty in text-to-music Generation Using Beat-Synchronous mixup Strategies. - Ke Chen 021; Yusong Wu; Haohe Liu; Marianna Nezhurina; Taylor Berg-Kirkpatrick; Shlomo Dubnov (ICASSP, 2024)

DataComp-LM: In search of the next generation of training sets for language models. - Jeffrey Li; Alex Fang; Georgios Smyrnis; Maor Ivgi; Matt Jordan; Samir Yitzhak Gadre; Hritik Bansal; Etash Kumar Guha; Sedrick Scott Keh; Kushal Arora; Saurabh Garg; Rui Xin; et al. (NeurIPS, 2024)

Language models scale reliably with over-training and on downstream tasks. - Samir Yitzhak Gadre; Georgios Smyrnis; Vaishaal Shankar; Suchin Gururangan; Mitchell Wortsman; Rulin Shao; Jean Mercat; Alex Fang; Jeffrey Li; Sedrick Keh; Rui Xin; Marianna Nezhurina; et al. (CoRR, 2024)

Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Models. - Marianna Nezhurina; Lucia Cipolina-Kun; Mehdi Cherti; Jenia Jitsev (CoRR, 2024)

Language models scale reliably with over-training and on downstream tasks. - Samir Yitzhak Gadre; Georgios Smyrnis; Vaishaal Shankar; Suchin Gururangan; Mitchell Wortsman; Rulin Shao; Jean Mercat; Alex Fang; Jeffrey Li; Sedrick Keh; Rui Xin; Marianna Nezhurina; et al. (ICLR, 2025)

ChemPile: A 250GB Diverse and Curated Dataset for Chemical Foundation Models. - Adrian Mirza; Nawaf Alampara; Martiño Ríos-García; Mohamed Abdelalim; Jack Butler; Bethany Connolly; Tunca Dogan; Marianna Nezhurina; Bünyamin Sen; Santosh Tirunagari; Mark Worrall; Adamo Young; et al. (CoRR, 2025)

Learning in Compact Spaces with Approximately Normalized Transformers. - Jörg K. H. Franke; Urs Spiegelhalter; Marianna Nezhurina; Jenia Jitsev; Frank Hutter; Michael Hefenbrock (CoRR, 2025)

OpenThoughts: Data Recipes for Reasoning Models. - Etash Kumar Guha; Ryan Marten; Sedrick Keh; Negin Raoof; Georgios Smyrnis; Hritik Bansal; Marianna Nezhurina; Jean Mercat; Trung Vu 002; Zayne Sprague; Ashima Suvarna; Benjamin Feuer; et al. (CoRR, 2025)

Scaling Laws for Robust Comparison of Open Foundation Language-Vision Models and Datasets. - Marianna Nezhurina; Tomer Porian; Giovanni Pucceti; Tommie Kerssies; Romain Beaumont; Mehdi Cherti; Jenia Jitsev (CoRR, 2025)

Game Reasoning Arena: A Framework and Benchmark for Assessing Reasoning Capabilities of Large Language Models via Game Play. - Lucia Cipolina-Kun; Marianna Nezhurina; Jenia Jitsev (CoRR, 2025)

Open-sci-ref-0.01: open and reproducible reference baselines for language model and dataset comparison. - Marianna Nezhurina; Jörg K. H. Franke; Taishi Nakamura; Timur Carstensen; Niccolò Ajroldi; Ville Komulainen; David Salinas; Jenia Jitsev (CoRR, 2025)

MixtureVitae: Open Web-Scale Pretraining Dataset With High Quality Instruction and Reasoning Data Built from Permissive-First Text Sources. - Huu Nguyen; Victor May; Harsh Raj; Marianna Nezhurina; Yishan Wang; Yanqi Luo; Minh Chien Vu; Taishi Nakamura; Ken Tsui; Van Khue Nguyen; David Salinas; Aleksandra Krasnodebska; et al. (CoRR, 2025)