On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization. - Shruti Palaskar; Akshita Bhagia; Yonatan Bisk; Florian Metze; Alan W. Black; Ana Marasovic (EMNLP (Findings), 2022)

Continued Pretraining for Better Zero- and Few-Shot Promptability. - Zhaofeng Wu; Robert L. Logan IV; Pete Walsh; Akshita Bhagia; Dirk Groeneveld; Sameer Singh 001; Iz Beltagy (EMNLP, 2022)

Findings of the WMT'22 Shared Task on Large-Scale Machine Translation Evaluation for African Languages. - David Ifeoluwa Adelani; Md Mahfuz Ibn Alam; Antonios Anastasopoulos; Akshita Bhagia; Marta R. Costa-jussà; Jesse Dodge; Fahim Faisal; Christian Federmann; Natalia Fedorova; Francisco Guzmán; Sergey Koshelev; Jean Maillard; et al. (WMT, 2022)

HINT: Hypernetwork Instruction Tuning for Efficient Zero-Shot Generalisation. - Hamish Ivison; Akshita Bhagia; Yizhong Wang; Hannaneh Hajishirzi; Matthew E. Peters (CoRR, 2022)

HINT: Hypernetwork Instruction Tuning for Efficient Zero- and Few-Shot Generalisation. - Hamish Ivison; Akshita Bhagia; Yizhong Wang; Hannaneh Hajishirzi; Matthew E. Peters (ACL (1), 2023)

What's In My Big Data? - Yanai Elazar; Akshita Bhagia; Ian Magnusson; Abhilasha Ravichander; Dustin Schwenk; Alane Suhr; Pete Walsh; Dirk Groeneveld; Luca Soldaini; Sameer Singh 001; Hanna Hajishirzi; Noah A. Smith; et al. (CoRR, 2023)

Catwalk: A Unified Language Model Evaluation Framework for Many Datasets. - Dirk Groeneveld; Anas Awadalla; Iz Beltagy; Akshita Bhagia; Ian Magnusson; Hao Peng 009; Oyvind Tafjord; Pete Walsh; Kyle Richardson 001; Jesse Dodge (CoRR, 2023)

OLMo: Accelerating the Science of Language Models. - Dirk Groeneveld; Iz Beltagy; Evan Pete Walsh; Akshita Bhagia; Rodney Kinney; Oyvind Tafjord; Ananya Harsh Jha; Hamish Ivison; Ian Magnusson; Yizhong Wang; Shane Arora; David Atkinson; et al. (ACL (1), 2024)

Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research. - Luca Soldaini; Rodney Kinney; Akshita Bhagia; Dustin Schwenk; David Atkinson; Russell Authur; Ben Bogin; Khyathi Raghavi Chandu; Jennifer Dumas; Yanai Elazar; Valentin Hofmann; Ananya Harsh Jha; et al. (ACL (1), 2024)

What's In My Big Data? - Yanai Elazar; Akshita Bhagia; Ian Magnusson; Abhilasha Ravichander; Dustin Schwenk; Alane Suhr; Evan Pete Walsh; Dirk Groeneveld; Luca Soldaini; Sameer Singh 001; Hannaneh Hajishirzi; Noah A. Smith; et al. (ICLR, 2024)

Paloma: A Benchmark for Evaluating Language Model Fit. - Ian Magnusson; Akshita Bhagia; Valentin Hofmann; Luca Soldaini; Ananya Harsh Jha; Oyvind Tafjord; Dustin Schwenk; Evan Pete Walsh; Yanai Elazar; Kyle Lo; Dirk Groeneveld; Iz Beltagy; et al. (NeurIPS, 2024)

OLMo: Accelerating the Science of Language Models. - Dirk Groeneveld; Iz Beltagy; Pete Walsh; Akshita Bhagia; Rodney Kinney; Oyvind Tafjord; Ananya Harsh Jha; Hamish Ivison; Ian Magnusson; Yizhong Wang; Shane Arora; David Atkinson; et al. (CoRR, 2024)

OLMoE: Open Mixture-of-Experts Language Models. - Niklas Muennighoff; Luca Soldaini; Dirk Groeneveld; Kyle Lo; Jacob Morrison; Sewon Min; Weijia Shi; Pete Walsh; Oyvind Tafjord; Nathan Lambert 001; Yuling Gu; Shane Arora; et al. (CoRR, 2024)

Establishing Task Scaling Laws via Compute-Efficient Model Ladders. - Akshita Bhagia; Jiacheng Liu 010; Alexander Wettig; David Heineman; Oyvind Tafjord; Ananya Harsh Jha; Luca Soldaini; Noah A. Smith; Dirk Groeneveld; Pang Wei Koh; Jesse Dodge; Hannaneh Hajishirzi (CoRR, 2024)

OLMoE: Open Mixture-of-Experts Language Models. - Niklas Muennighoff; Luca Soldaini; Dirk Groeneveld; Kyle Lo; Jacob Morrison; Sewon Min; Weijia Shi; Evan Pete Walsh; Oyvind Tafjord; Nathan Lambert 001; Yuling Gu; Shane Arora; et al. (ICLR, 2025)

2 OLMo 2 Furious. - Team OLMo; Pete Walsh; Luca Soldaini; Dirk Groeneveld; Kyle Lo; Shane Arora; Akshita Bhagia; Yuling Gu; Shengyi Huang; Matt Jordan; Nathan Lambert 001; Dustin Schwenk; et al. (CoRR, 2025)

DataDecide: How to Predict Best Pretraining Data with Small Experiments. - Ian Magnusson; Nguyen Tai; Ben Bogin; David Heineman; Jena D. Hwang; Luca Soldaini; Akshita Bhagia; Jiacheng Liu 010; Dirk Groeneveld; Oyvind Tafjord; Noah A. Smith; Pang Wei Koh; et al. (CoRR, 2025)

FlexOlmo: Open Language Models for Flexible Data Use. - Weijia Shi; Akshita Bhagia; Kevin Farhat; Niklas Muennighoff; Pete Walsh; Jacob Morrison; Dustin Schwenk; Shayne Longpre; Jake Poznanski; Allyson Ettinger; Daogao Liu; Margaret Li; et al. (CoRR, 2025)