Efficiency Pentathlon: A Standardized Arena for Efficiency Evaluation. - Hao Peng 009; Qingqing Cao; Jesse Dodge; Matthew E. Peters; Jared Fernandez; Tom Sherborne; Kyle Lo; Sam Skjonsberg; Emma Strubell; Darrell Plessas; Iz Beltagy; Evan Pete Walsh; et al. (CoRR, 2023)

OLMo: Accelerating the Science of Language Models. - Dirk Groeneveld; Iz Beltagy; Evan Pete Walsh; Akshita Bhagia; Rodney Kinney; Oyvind Tafjord; Ananya Harsh Jha; Hamish Ivison; Ian Magnusson; Yizhong Wang; Shane Arora; David Atkinson; et al. (ACL (1), 2024)

What's In My Big Data? - Yanai Elazar; Akshita Bhagia; Ian Magnusson; Abhilasha Ravichander; Dustin Schwenk; Alane Suhr; Evan Pete Walsh; Dirk Groeneveld; Luca Soldaini; Sameer Singh 001; Hannaneh Hajishirzi; Noah A. Smith; et al. (ICLR, 2024)

Paloma: A Benchmark for Evaluating Language Model Fit. - Ian Magnusson; Akshita Bhagia; Valentin Hofmann; Luca Soldaini; Ananya Harsh Jha; Oyvind Tafjord; Dustin Schwenk; Evan Pete Walsh; Yanai Elazar; Kyle Lo; Dirk Groeneveld; Iz Beltagy; et al. (NeurIPS, 2024)

OLMoE: Open Mixture-of-Experts Language Models. - Niklas Muennighoff; Luca Soldaini; Dirk Groeneveld; Kyle Lo; Jacob Morrison; Sewon Min; Weijia Shi; Evan Pete Walsh; Oyvind Tafjord; Nathan Lambert 001; Yuling Gu; Shane Arora; et al. (ICLR, 2025)