Scaling Language Models: Methods, Analysis & Insights from Training Gopher. - Jack W. Rae; Sebastian Borgeaud; Trevor Cai; Katie Millican; Jordan Hoffmann; H. Francis Song; John Aslanides; Sarah Henderson; Roman Ring; Susannah Young; Eliza Rutherford; Tom Hennigan; et al. (CoRR, 2021)

Improving Language Models by Retrieving from Trillions of Tokens. - Sebastian Borgeaud; Arthur Mensch; Jordan Hoffmann; Trevor Cai; Eliza Rutherford; Katie Millican; George van den Driessche 002; Jean-Baptiste Lespiau; Bogdan Damoc; Aidan Clark; Diego de Las Casas; Aurelia Guy; et al. (ICML, 2022)

Unified Scaling Laws for Routed Language Models. - Aidan Clark; Diego de Las Casas; Aurelia Guy; Arthur Mensch; Michela Paganini; Jordan Hoffmann; Bogdan Damoc; Blake A. Hechtman; Trevor Cai; Sebastian Borgeaud; George van den Driessche 002; Eliza Rutherford; et al. (ICML, 2022)

Flamingo: a Visual Language Model for Few-Shot Learning. - Jean-Baptiste Alayrac; Jeff Donahue; Pauline Luc; Antoine Miech; Iain Barr; Yana Hasson; Karel Lenc; Arthur Mensch; Katherine Millican; Malcolm Reynolds; Roman Ring; Eliza Rutherford; et al. (NeurIPS, 2022)

An empirical analysis of compute-optimal large language model training. - Jordan Hoffmann; Sebastian Borgeaud; Arthur Mensch; Elena Buchatskaya; Trevor Cai; Eliza Rutherford; Diego de Las Casas; Lisa Anne Hendricks; Johannes Welbl; Aidan Clark; Tom Hennigan; Eric Noland; et al. (NeurIPS, 2022)

Unified Scaling Laws for Routed Language Models. - Aidan Clark; Diego de Las Casas; Aurelia Guy; Arthur Mensch; Michela Paganini; Jordan Hoffmann; Bogdan Damoc; Blake A. Hechtman; Trevor Cai; Sebastian Borgeaud; George van den Driessche 002; Eliza Rutherford; et al. (CoRR, 2022)

Training Compute-Optimal Large Language Models. - Jordan Hoffmann; Sebastian Borgeaud; Arthur Mensch; Elena Buchatskaya; Trevor Cai; Eliza Rutherford; Diego de Las Casas; Lisa Anne Hendricks; Johannes Welbl; Aidan Clark; Tom Hennigan; Eric Noland; et al. (CoRR, 2022)

Flamingo: a Visual Language Model for Few-Shot Learning. - Jean-Baptiste Alayrac; Jeff Donahue; Pauline Luc; Antoine Miech; Iain Barr; Yana Hasson; Karel Lenc; Arthur Mensch; Katie Millican; Malcolm Reynolds; Roman Ring; Eliza Rutherford; et al. (CoRR, 2022)

Gemini: A Family of Highly Capable Multimodal Models. - Rohan Anil; Sebastian Borgeaud; Yonghui Wu; Jean-Baptiste Alayrac; Jiahui Yu; Radu Soricut; Johan Schalkwyk; Andrew M. Dai; Anja Hauth; Katie Millican; David Silver; Slav Petrov; et al. (CoRR, 2023)

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. - Machel Reid; Nikolay Savinov; Denis Teplyashin; Dmitry Lepikhin; Timothy P. Lillicrap; Jean-Baptiste Alayrac; Radu Soricut; Angeliki Lazaridou; Orhan Firat; Julian Schrittwieser; Ioannis Antonoglou; Rohan Anil; et al. (CoRR, 2024)