The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset. - Hugo Laurençon; Lucile Saulnier; Thomas Wang; Christopher Akiki; Albert Villanova del Moral; Teven Le Scao; Leandro von Werra; Chenghao Mou; Eduardo González Ponferrada; Huu Nguyen; Jörg Frohberg; Mario Sasko; et al. (NeurIPS, 2022)

Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order. - Taishi Nakamura; Mayank Mishra; Simone Tedeschi; Yekun Chai; Jason T. Stillerman; Felix Friedrich; Prateek Yadav; Tanmay Laud; Minh Chien Vu; Terry Yue Zhuo; Diganta Misra; Ben Bogin; et al. (CoRR, 2024)

Aurora-M: Open Source Continual Pre-training for Multilingual Language and Code. - Taishi Nakamura; Mayank Mishra; Simone Tedeschi; Yekun Chai; Jason T. Stillerman; Felix Friedrich; Prateek Yadav; Tanmay Laud; Minh Chien Vu; Terry Yue Zhuo; Diganta Misra; Ben Bogin; et al. (COLING (Industry), 2025)