Aya 23: Open Weight Releases to Further Multilingual Progress. - Viraat Aryabumi; John Dang; Dwarak Talupuru; Saurabh Dash; David Cairuz; Hangyu Lin; Bharat Venkitesh; Madeline Smith; Jon Ander Campos; Yi Chern Tan; Kelly Marchisio; Max Bartolo; et al. (CoRR, 2024)

Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models. - Laura Ruis; Maximilian Mozes; Juhan Bae; Siddhartha Rao Kamalakara; Dwarak Talupuru; Acyr Locatelli; Robert Kirk; Tim Rocktäschel; Edward Grefenstette; Max Bartolo (CoRR, 2024)

Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier. - John Dang; Shivalika Singh; Daniel D'souza; Arash Ahmadian; Alejandro Salamanca; Madeline Smith; Aidan Peppin; Sungjin Hong; Manoj Govindassamy; Terrence Zhao; Sandra Kublik; Meor Amer; et al. (CoRR, 2024)

Rope to Nope and Back Again: A New Hybrid Attention Strategy. - Bowen Yang; Bharat Venkitesh; Dwarak Talupuru; Hangyu Lin; David Cairuz; Phil Blunsom; Acyr Locatelli (CoRR, 2025)