The Cost of Down-Scaling Language Models: Fact Recall Deteriorates before In-Context Learning. - Tian Jin; Nolan Clement; Xin Dong; Vaishnavh Nagarajan; Michael Carbin; Jonathan Ragan-Kelley; Gintare Karolina Dziugaite (CoRR, 2023)

The Cost of Scaling Down Large Language Models: Reducing Model Size Affects Memory before In-context Learning. - Tian Jin; Nolan Clement; Xin Dong; Vaishnavh Nagarajan; Michael Carbin; Jonathan Ragan-Kelley; Gintare Karolina Dziugaite (ICLR, 2024)