GPT-NeoX-20B: An Open-Source Autoregressive Language Model. - Sid Black; Stella Biderman; Eric Hallahan; Quentin Anthony; Leo Gao; Laurence Golding; Horace He; Connor Leahy; Kyle McDonell; Jason Phang; Michael Pieler; USVSN Sai Prashanth; et al. (CoRR, 2022)

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model. - Teven Le Scao; Angela Fan; Christopher Akiki; Ellie Pavlick; Suzana Ilic; Daniel Hesslow; Roman Castagné; Alexandra Sasha Luccioni; François Yvon; Matthias Gallé; Jonathan Tow; Alexander M. Rush; et al. (CoRR, 2022)

trlX: A Framework for Large Scale Reinforcement Learning from Human Feedback. - Alexander Havrilla; Maksym Zhuravinskyi; Duy Phung; Aman Tiwari; Jonathan Tow; Stella Biderman; Quentin Anthony; Louis Castricato (EMNLP, 2023)

Rephrasing natural text data with different languages and quality levels for Large Language Model pre-training. - Michael Pieler; Marco Bellagente; Hannah Teufel; Duy Phung; Nathan Cooper; Jonathan Tow; Paulo Rocha; Reshinth Adithyan; Zaid Alyafeai; Nikhil Pinnaparaju; Maksym Zhuravinskyi; Carlos Riquelme (ENLSP, 2024)

Stable LM 2 1.6B Technical Report. - Marco Bellagente; Jonathan Tow; Dakota Mahan; Duy Phung; Maksym Zhuravinskyi; Reshinth Adithyan; James Baicoianu; Ben Brooks; Nathan Cooper; Ashish Datta; Meng Lee; Emad Mostaque; et al. (CoRR, 2024)

Stable Code Technical Report. - Nikhil Pinnaparaju; Reshinth Adithyan; Duy Phung; Jonathan Tow; James Baicoianu; Ashish Datta; Maksym Zhuravinskyi; Dakota Mahan; Marco Bellagente; Carlos Riquelme; Nathan Cooper (CoRR, 2024)

Lessons from the Trenches on Reproducible Evaluation of Language Models. - Stella Biderman; Hailey Schoelkopf; Lintang Sutawika; Leo Gao; Jonathan Tow; Baber Abbasi; Alham Fikri Aji; Pawan Sasanka Ammanamanchi; Sidney Black; Jordan Clive; Anthony DiPofi; Julen Etxaniz; et al. (CoRR, 2024)

Arabic Stable LM: Adapting Stable LM 2 1.6B to Arabic. - Zaid Alyafeai; Michael Pieler; Hannah Teufel; Jonathan Tow; Marco Bellagente; Duy Phung; Nikhil Pinnaparaju; Reshinth Adithyan; Paulo Rocha; Maksym Zhuravinskyi; Carlos Riquelme (CoRR, 2024)