Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning. - Jean-Bastien Grill; Florian Strub; Florent Altché; Corentin Tallec; Pierre H. Richemond; Elena Buchatskaya; Carl Doersch; Bernardo Ávila Pires; Zhaohan Guo; Mohammad Gheshlaghi Azar; Bilal Piot; Koray Kavukcuoglu; et al. (NeurIPS, 2020)

Scaling Language Models: Methods, Analysis & Insights from Training Gopher. - Jack W. Rae; Sebastian Borgeaud; Trevor Cai; Katie Millican; Jordan Hoffmann; H. Francis Song; John Aslanides; Sarah Henderson; Roman Ring; Susannah Young; Eliza Rutherford; Tom Hennigan; et al. (CoRR, 2021)

Unified Scaling Laws for Routed Language Models. - Aidan Clark; Diego de Las Casas; Aurelia Guy; Arthur Mensch; Michela Paganini; Jordan Hoffmann; Bogdan Damoc; Blake A. Hechtman; Trevor Cai; Sebastian Borgeaud; George van den Driessche 002; Eliza Rutherford; et al. (ICML, 2022)

An empirical analysis of compute-optimal large language model training. - Jordan Hoffmann; Sebastian Borgeaud; Arthur Mensch; Elena Buchatskaya; Trevor Cai; Eliza Rutherford; Diego de Las Casas; Lisa Anne Hendricks; Johannes Welbl; Aidan Clark; Tom Hennigan; Eric Noland; et al. (NeurIPS, 2022)

Unified Scaling Laws for Routed Language Models. - Aidan Clark; Diego de Las Casas; Aurelia Guy; Arthur Mensch; Michela Paganini; Jordan Hoffmann; Bogdan Damoc; Blake A. Hechtman; Trevor Cai; Sebastian Borgeaud; George van den Driessche 002; Eliza Rutherford; et al. (CoRR, 2022)

Training Compute-Optimal Large Language Models. - Jordan Hoffmann; Sebastian Borgeaud; Arthur Mensch; Elena Buchatskaya; Trevor Cai; Eliza Rutherford; Diego de Las Casas; Lisa Anne Hendricks; Johannes Welbl; Aidan Clark; Tom Hennigan; Eric Noland; et al. (CoRR, 2022)

Gemma: Open Models Based on Gemini Research and Technology. - Thomas Mesnard; Cassidy Hardin; Robert Dadashi; Surya Bhupatiraju; Shreya Pathak; Laurent Sifre; Morgane Rivière; Mihir Sanjay Kale; Juliette Love; Pouya Tafti; Léonard Hussenot; Aakanksha Chowdhery; et al. (CoRR, 2024)

Gemma 3 Technical Report. - Aishwarya Kamath; Johan Ferret; Shreya Pathak; Nino Vieillard; Ramona Merhej; Sarah Perrin; Tatiana Matejovicova; Alexandre Ramé; Morgane Rivière; Louis Rouillard; Thomas Mesnard; Geoffrey Cideron; et al. (CoRR, 2025)

MedGemma Technical Report. - Andrew Sellergren; Sahar Kazemzadeh; Tiam Jaroensri; Atilla P. Kiraly; Madeleine Traverse; Timo Kohlberger; Shawn Xu; Fayaz Jamil; Cían Hughes; Charles Lau; Justin Chen; Fereshteh Mahvar; et al. (CoRR, 2025)