The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset. - Hugo Laurençon; Lucile Saulnier; Thomas Wang; Christopher Akiki; Albert Villanova del Moral; Teven Le Scao; Leandro von Werra; Chenghao Mou; Eduardo González Ponferrada; Huu Nguyen; Jörg Frohberg; Mario Sasko; et al. (NeurIPS, 2022)

BERTIN: Efficient Pre-Training of a Spanish Language Model using Perplexity Sampling. - Javier de la Rosa 001; Eduardo G. Ponferrada; Manu Romero; Paulo Villegas; Pablo González de Prado Salas; María Grandury (Proces. del Leng. Natural, 2022)