Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations. - Alexander Hägele; Elie Bakouch; Atli Kosson; Loubna Ben Allal; Leandro von Werra; Martin Jaggi (NeurIPS, 2024)

INTELLECT-1 Technical Report. - Sami Jaghouar; Jack Min Ong; Manveer Basra; Fares Obeid; Jannik Straube; Michael Keiblinger; Elie Bakouch; Lucas Atkins; Maziyar Panahi; Charles Goddard; Max Ryabinin; Johannes Hagemann (CoRR, 2024)

SmolLM2: When Smol Goes Big - Data-Centric Training of a Small Language Model. - Loubna Ben Allal; Anton Lozhkov; Elie Bakouch; Gabriel Martín Blázquez; Guilherme Penedo; Lewis Tunstall; Andrés Marafioti; Hynek Kydlícek; Agustín Piqueres Lajarín; Vaibhav Srivastav; Joshua Lochner; Caleb Fahlgren; et al. (CoRR, 2025)

SmolVLM: Redefining small and efficient multimodal models. - Andrés Marafioti; Orr Zohar; Miquel Farré; Merve Noyan; Elie Bakouch; Pedro Cuenca 002; Cyril Zakka; Loubna Ben Allal; Anton Lozhkov; Nouamane Tazi; Vaibhav Srivastav; Joshua Lochner; et al. (CoRR, 2025)

The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text. - Nikhil Kandpal; Brian Lester; Colin Raffel; Sebastian Majstorovic; Stella Biderman; Baber Abbasi; Luca Soldaini; Enrico Shippole; A. Feder Cooper; Aviya Skowron; John Kirchenbauer; Shayne Longpre; et al. (CoRR, 2025)