Extractive Summary as Discrete Latent Variables. - Aran Komatsuzaki (CoRR, 2018)

One Epoch Is All You Need. - Aran Komatsuzaki (CoRR, 2019)

Current Limitations of Language Models: What You Need is Retrieval. - Aran Komatsuzaki (CoRR, 2020)

LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs. - Christoph Schuhmann; Richard Vencu; Romain Beaumont; Robert Kaczmarczyk; Clayton Mullis; Aarush Katta; Theo Coombes; Jenia Jitsev; Aran Komatsuzaki (CoRR, 2021)

Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints. - Aran Komatsuzaki; Joan Puigcerver; James Lee-Thorp; Carlos Riquelme Ruiz; Basil Mustafa; Joshua Ainslie; Yi Tay; Mostafa Dehghani 001; Neil Houlsby (ICLR, 2023)

ARB: Advanced Reasoning Benchmark for Large Language Models. - Tomohiro Sawada; Daniel Paleka; Alexander Havrilla; Pranav Tadepalli; Paula Vidas; Alexander Kranias; John J. Nay; Kshitij Gupta; Aran Komatsuzaki (CoRR, 2023)

Improving Foundation Models. - Aran Komatsuzaki (2024)