SantaCoder: don't reach for the stars! - Loubna Ben Allal; Raymond Li; Denis Kocetkov; Chenghao Mou; Christopher Akiki; Carlos Muñoz Ferrandis; Niklas Muennighoff; Mayank Mishra; Alex Gu; Manan Dey; Logesh Kumar Umapathi; Carolyn Jane Anderson; et al. (CoRR, 2023)

The BigCode Project Governance Card. - Sean Hughes; Harm de Vries; Jennifer Robinson; Carlos Muñoz Ferrandis; Loubna Ben Allal; Leandro von Werra; Jennifer Ding; Sébastien Paquet; Yacine Jernite (CoRR, 2023)

The Stack: 3 TB of permissively licensed source code. - Denis Kocetkov; Raymond Li; Loubna Ben Allal; Jia Li 015; Chenghao Mou; Yacine Jernite; Margaret Mitchell; Carlos Muñoz Ferrandis; Sean Hughes; Thomas Wolf 008; Dzmitry Bahdanau; Leandro von Werra; et al. (Trans. Mach. Learn. Res., 2023)

StarCoder: may the source be with you! - Raymond Li; Loubna Ben Allal; Yangtian Zi; Niklas Muennighoff; Denis Kocetkov; Chenghao Mou; Marc Marone; Christopher Akiki; Jia Li 015; Jenny Chim; Qian Liu 012; Evgenii Zheltonozhskii; et al. (Trans. Mach. Learn. Res., 2023)

BigDocs: An Open and Permissively-Licensed Dataset for Training Multimodal Models on Document and Code Tasks. - Juan A. Rodríguez; Xiangru Jian; Siba Smarak Panigrahi; Tianyu Zhang; Aarash Feizi; Abhay Puri; Akshay Kalkunte; François Savard; Ahmed Masry; Shravan Nayak; Rabiul Awal; Mahsa Massoud; et al. (CoRR, 2024)