Caliban: Docker-based job manager for reproducible workflows. - Sam Ritchie; Ambrose Slone; Vinay V. Ramasesh (J. Open Source Softw., 2020)

The geometry of integration in text classification RNNs. - Kyle Aitken; Vinay Venkatesh Ramasesh; Ankush Garg; Yuan Cao; David Sussillo; Niru Maheswaranathan (ICLR, 2021)

Anatomy of Catastrophic Forgetting: Hidden Representations and Task Semantics. - Vinay Venkatesh Ramasesh; Ethan Dyer; Maithra Raghu (ICLR, 2021)

Understanding How Encoder-Decoder Architectures Attend. - Kyle Aitken; Vinay V. Ramasesh; Yuan Cao; Niru Maheswaranathan (NeurIPS, 2021)

Effect of scale on catastrophic forgetting in neural networks. - Vinay Venkatesh Ramasesh; Aitor Lewkowycz; Ethan Dyer (ICLR, 2022)

Exploring Length Generalization in Large Language Models. - Cem Anil; Yuhuai Wu; Anders Andreassen; Aitor Lewkowycz; Vedant Misra; Vinay V. Ramasesh; Ambrose Slone; Guy Gur-Ari; Ethan Dyer; Behnam Neyshabur (NeurIPS, 2022)

Solving Quantitative Reasoning Problems with Language Models. - Aitor Lewkowycz; Anders Andreassen; David Dohan; Ethan Dyer; Henryk Michalewski; Vinay V. Ramasesh; Ambrose Slone; Cem Anil; Imanol Schlag; Theo Gutman-Solo; Yuhuai Wu; Behnam Neyshabur; et al. (NeurIPS, 2022)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. - Aarohi Srivastava; Abhinav Rastogi; Abhishek Rao; Abu Awal Md Shoeb; Abubakar Abid; Adam Fisch; Adam R. Brown; Adam Santoro; Aditya Gupta; Adrià Garriga-Alonso; Agnieszka Kluska; Aitor Lewkowycz; et al. (Trans. Mach. Learn. Res., 2023)

Michelangelo: Long Context Evaluations Beyond Haystacks via Latent Structure Queries. - Kiran Vodrahalli; Santiago Ontanon; Nilesh Tripuraneni; Kelvin Xu; Sanil Jain; Rakesh Shivanna; Jeffrey Hui; Nishanth Dikkala; Mehran Kazemi; Bahare Fatemi; Rohan Anil; Ethan Dyer; et al. (CoRR, 2024)