Data Processing Matters: SRPH-Konvergen AI's Machine Translation System for WMT'21. - Lintang Sutawika; Jan Christian Blaise Cruz (WMT@EMNLP, 2021)

Multitask Prompted Training Enables Zero-Shot Task Generalization. - Victor Sanh; Albert Webson; Colin Raffel; Stephen H. Bach; Lintang Sutawika; Zaid Alyafeai; Antoine Chaffin; Arnaud Stiegler; Teven Le Scao; Arun Raja; Manan Dey; M. Saiful Bari; et al. (CoRR, 2021)

Towards better structured and less noisy Web data: Oscar with Register annotations. - Veronika Laippala; Anna Salmela; Samuel Rönnqvist; Alham Fikri Aji; Li-Hsin Chang; Asma Dhifallah; Larissa Goulart; Henna Kortelainen; Marc Pàmies; Deise Prina Dutra; Valtteri Skantsi; Lintang Sutawika; et al. (W-NUT@COLING, 2022)

What Language Model to Train if You Have One Million GPU Hours? - Teven Le Scao; Thomas Wang; Daniel Hesslow; Lucile Saulnier; Stas Bekman; M. Saiful Bari; Stella Biderman; Hady Elsahar; Niklas Muennighoff; Jason Phang; Ofir Press; Colin Raffel; et al. (EMNLP (Findings), 2022)

Multitask Prompted Training Enables Zero-Shot Task Generalization. - Victor Sanh; Albert Webson; Colin Raffel; Stephen H. Bach; Lintang Sutawika; Zaid Alyafeai; Antoine Chaffin; Arnaud Stiegler; Arun Raja; Manan Dey; M Saiful Bari; Canwen Xu; et al. (ICLR, 2022)

Samsung Research Philippines - Datasaur AI's Submission for the WMT22 Large Scale Multilingual Translation Task. - Jan Christian Blaise Cruz; Lintang Sutawika (WMT, 2022)

BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting. - Zheng Xin Yong; Hailey Schoelkopf; Niklas Muennighoff; Alham Fikri Aji; David Ifeoluwa Adelani; Khalid Almubarak; M. Saiful Bari; Lintang Sutawika; Jungo Kasai; Ahmed Baruwa; Genta Indra Winata; Stella Biderman; et al. (CoRR, 2022)

Crosslingual Generalization through Multitask Finetuning. - Niklas Muennighoff; Thomas Wang; Lintang Sutawika; Adam Roberts; Stella Biderman; Teven Le Scao; M. Saiful Bari; Sheng Shen 001; Zheng Xin Yong; Hailey Schoelkopf; Xiangru Tang; Dragomir Radev; et al. (ACL (1), 2023)

BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting. - Zheng Xin Yong; Hailey Schoelkopf; Niklas Muennighoff; Alham Fikri Aji; David Ifeoluwa Adelani; Khalid Almubarak; M. Saiful Bari; Lintang Sutawika; Jungo Kasai; Ahmed Baruwa; Genta Indra Winata; Stella Biderman; et al. (ACL (1), 2023)

Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling. - Stella Biderman; Hailey Schoelkopf; Quentin Gregory Anthony; Herbie Bradley; Kyle O'Brien; Eric Hallahan; Mohammad Aflah Khan; Shivanshu Purohit; USVSN Sai Prashanth; Edward Raff; Aviya Skowron; Lintang Sutawika; et al. (ICML, 2023)

Emergent and Predictable Memorization in Large Language Models. - Stella Biderman; USVSN Sai Prashanth; Lintang Sutawika; Hailey Schoelkopf; Quentin Anthony; Shivanshu Purohit; Edward Raff (NeurIPS, 2023)

Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languages. - Zheng Xin Yong; Ruochen Zhang; Jessica Zosa Forde; Skyler Wang; Samuel Cahyawijaya; Holy Lovenia; Genta Indra Winata; Lintang Sutawika; Jan Christian Blaise Cruz; Long Phan; Yin Lin Tan; Alham Fikri Aji (CoRR, 2023)

Utilizing Weak Supervision To Generate Indonesian Conservation Dataset. - Mega Fransiska; Diah Pitaloka; Saripudin; Satrio Putra; Lintang Sutawika (CoRR, 2023)

Re-Evaluating Evaluation for Multilingual Summarization. - Jessica Forde; Ruochen Zhang; Lintang Sutawika; Alham Fikri Aji; Samuel Cahyawijaya; Genta Indra Winata; Minghao Wu; Carsten Eickhoff; Stella Biderman; Ellie Pavlick (EMNLP, 2024)

Lessons from the Trenches on Reproducible Evaluation of Language Models. - Stella Biderman; Hailey Schoelkopf; Lintang Sutawika; Leo Gao; Jonathan Tow; Baber Abbasi; Alham Fikri Aji; Pawan Sasanka Ammanamanchi; Sidney Black; Jordan Clive; Anthony DiPofi; Julen Etxaniz; et al. (CoRR, 2024)

Pangea: A Fully Open Multilingual Multimodal LLM for 39 Languages. - Xiang Yue; Yueqi Song; Akari Asai; Seungone Kim; Jean de Dieu Nyandwi; Simran Khanuja; Anjali Kantharuban; Lintang Sutawika; Sathyanarayanan Ramamoorthy; Graham Neubig (ICLR, 2025)

Not-Just-Scaling Laws: Towards a Better Understanding of the Downstream Impact of Language Model Design Decisions. - Emmy Liu; Amanda Bertsch; Lintang Sutawika; Lindia Tjuatja; Patrick Fernandes; Lara Marinov; Michael Chen; Shreya Singhal; Carolin Lawrence; Aditi Raghunathan; Kiril Gashteovski; Graham Neubig (CoRR, 2025)

The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text. - Nikhil Kandpal; Brian Lester; Colin Raffel; Sebastian Majstorovic; Stella Biderman; Baber Abbasi; Luca Soldaini; Enrico Shippole; A. Feder Cooper; Aviya Skowron; John Kirchenbauer; Shayne Longpre; et al. (CoRR, 2025)