BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts. - Qizhen (Irene) Zhang; Nikolas Gritsch; Dwaraknath Gnaneshwar; Simon Guo 003; David Cairuz; Bharat Venkitesh; Jakob N. Foerster; Phil Blunsom; Sebastian Ruder; Ahmet Üstün; Acyr Locatelli (NeurIPS, 2024)

Aya 23: Open Weight Releases to Further Multilingual Progress. - Viraat Aryabumi; John Dang; Dwarak Talupuru; Saurabh Dash; David Cairuz; Hangyu Lin; Bharat Venkitesh; Madeline Smith; Jon Ander Campos; Yi Chern Tan; Kelly Marchisio; Max Bartolo; et al. (CoRR, 2024)

Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier. - John Dang; Shivalika Singh; Daniel D'souza; Arash Ahmadian; Alejandro Salamanca; Madeline Smith; Aidan Peppin; Sungjin Hong; Manoj Govindassamy; Terrence Zhao; Sandra Kublik; Meor Amer; et al. (CoRR, 2024)

Rope to Nope and Back Again: A New Hybrid Attention Strategy. - Bowen Yang; Bharat Venkitesh; Dwarak Talupuru; Hangyu Lin; David Cairuz; Phil Blunsom; Acyr Locatelli (CoRR, 2025)

Command A: An Enterprise-Ready Large Language Model. - Aakanksha; Arash Ahmadian; Marwan Ahmed; Jay Alammar; Milad Alizadeh; Yazeed Alnumay; Sophia Althammer; Arkady Arkhangorodsky; Viraat Aryabumi; Dennis Aumiller; Raphaël Avalos; Zahara Aviv; et al. (CoRR, 2025)