GPT-NeoX-20B: An Open-Source Autoregressive Language Model. - Sid Black; Stella Biderman; Eric Hallahan; Quentin Anthony; Leo Gao; Laurence Golding; Horace He; Connor Leahy; Kyle McDonell; Jason Phang; Michael Pieler; USVSN Sai Prashanth; et al. (CoRR, 2022)

Robust Preference Learning for Storytelling via Contrastive Reinforcement Learning. - Louis Castricato; Alexander Havrilla; Shahbuland Matiana; Michael Pieler; Anbang Ye; Ian Yang; Spencer Frazier; Mark O. Riedl (CoRR, 2022)

Few-shot Adaptation Works with UnpredicTable Data. - Jun Shern Chan; Michael Pieler; Jonathan Jao; Jérémy Scheurer; Ethan Perez (ACL (1), 2023)

14 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathon. - Kevin Maik Jablonka; Qianxiang Ai; Alexander Al-Feghali; Shruti Badhwar; Joshua D. Bocarsly; Andres M. Bran; Stefan Bringuier; L. Catherine Brinson; Kamal Choudhary; Defne Circi; Sam Cox; Wibe A. de Jong; et al. (CoRR, 2023)

Inverse Scaling: When Bigger Isn't Better. - Ian R. McKenzie; Alexander Lyzhov; Michael Pieler; Alicia Parrish; Aaron Mueller; Ameya Prabhu; Euan McLean; Aaron Kirtland; Alexis Ross; Alisa Liu; Andrew Gritsevskiy; Daniel Wurgaft; et al. (Trans. Mach. Learn. Res., 2023)

Rephrasing natural text data with different languages and quality levels for Large Language Model pre-training. - Michael Pieler; Marco Bellagente; Hannah Teufel; Duy Phung; Nathan Cooper; Jonathan Tow; Paulo Rocha; Reshinth Adithyan; Zaid Alyafeai; Nikhil Pinnaparaju; Maksym Zhuravinskyi; Carlos Riquelme (ENLSP, 2024)

Stable LM 2 1.6B Technical Report. - Marco Bellagente; Jonathan Tow; Dakota Mahan; Duy Phung; Maksym Zhuravinskyi; Reshinth Adithyan; James Baicoianu; Ben Brooks; Nathan Cooper; Ashish Datta; Meng Lee; Emad Mostaque; et al. (CoRR, 2024)

Are large language models superhuman chemists? - Adrian Mirza; Nawaf Alampara; Sreekanth Kunchapu; Benedict Emoekabu; Aswanth Krishnan; Mara Wilhelmi; Macjonathan Okereke; Juliane Eberhardt; Amir Mohammad Elahi; Maximilian Greiner; Caroline T. Holick; Tanya Gupta; et al. (CoRR, 2024)

Arabic Stable LM: Adapting Stable LM 2 1.6B to Arabic. - Zaid Alyafeai; Michael Pieler; Hannah Teufel; Jonathan Tow; Marco Bellagente; Duy Phung; Nikhil Pinnaparaju; Reshinth Adithyan; Paulo Rocha; Maksym Zhuravinskyi; Carlos Riquelme (CoRR, 2024)

ChemPile: A 250GB Diverse and Curated Dataset for Chemical Foundation Models. - Adrian Mirza; Nawaf Alampara; Martiño Ríos-García; Mohamed Abdelalim; Jack Butler; Bethany Connolly; Tunca Dogan; Marianna Nezhurina; Bünyamin Sen; Santosh Tirunagari; Mark Worrall; Adamo Young; et al. (CoRR, 2025)