Improving Language Models by Retrieving from Trillions of Tokens. - Sebastian Borgeaud; Arthur Mensch; Jordan Hoffmann; Trevor Cai; Eliza Rutherford; Katie Millican; George van den Driessche 002; Jean-Baptiste Lespiau; Bogdan Damoc; Aidan Clark; Diego de Las Casas; Aurelia Guy; et al. (ICML, 2022)

Unified Scaling Laws for Routed Language Models. - Aidan Clark; Diego de Las Casas; Aurelia Guy; Arthur Mensch; Michela Paganini; Jordan Hoffmann; Bogdan Damoc; Blake A. Hechtman; Trevor Cai; Sebastian Borgeaud; George van den Driessche 002; Eliza Rutherford; et al. (ICML, 2022)

An empirical analysis of compute-optimal large language model training. - Jordan Hoffmann; Sebastian Borgeaud; Arthur Mensch; Elena Buchatskaya; Trevor Cai; Eliza Rutherford; Diego de Las Casas; Lisa Anne Hendricks; Johannes Welbl; Aidan Clark; Tom Hennigan; Eric Noland; et al. (NeurIPS, 2022)

Unified Scaling Laws for Routed Language Models. - Aidan Clark; Diego de Las Casas; Aurelia Guy; Arthur Mensch; Michela Paganini; Jordan Hoffmann; Bogdan Damoc; Blake A. Hechtman; Trevor Cai; Sebastian Borgeaud; George van den Driessche 002; Eliza Rutherford; et al. (CoRR, 2022)

Training Compute-Optimal Large Language Models. - Jordan Hoffmann; Sebastian Borgeaud; Arthur Mensch; Elena Buchatskaya; Trevor Cai; Eliza Rutherford; Diego de Las Casas; Lisa Anne Hendricks; Johannes Welbl; Aidan Clark; Tom Hennigan; Eric Noland; et al. (CoRR, 2022)