The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset. - Hugo Laurençon; Lucile Saulnier; Thomas Wang; Christopher Akiki; Albert Villanova del Moral; Teven Le Scao; Leandro von Werra; Chenghao Mou; Eduardo González Ponferrada; Huu Nguyen; Jörg Frohberg; Mario Sasko; et al. (NeurIPS, 2022)

Documenting Geographically and Contextually Diverse Data Sources: The BigScience Catalogue of Language Data and Resources. - Angelina McMillan-Major; Zaid Alyafeai; Stella Biderman; Kimbo Chen; Francesco De Toni; Gérard Dupont; Hady Elsahar; Chris Emezue; Alham Fikri Aji; Suzana Ilic; Nurulaqilla Khamis; Colin Leong; et al. (CoRR, 2022)

Entities, Dates, and Languages: Zero-Shot on Historical Texts with T0. - Francesco De Toni; Christopher Akiki; Javier de la Rosa 001; Clémentine Fourrier; Enrique Manjavacas; Stefan Schweter; Daniel van Strien (CoRR, 2022)

SantaCoder: don't reach for the stars! - Loubna Ben Allal; Raymond Li; Denis Kocetkov; Chenghao Mou; Christopher Akiki; Carlos Muñoz Ferrandis; Niklas Muennighoff; Mayank Mishra; Alex Gu; Manan Dey; Logesh Kumar Umapathi; Carolyn Jane Anderson; et al. (CoRR, 2023)