Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoning. - Alexandre Tamborrino; Nicola Pellicanò; Baptiste Pannier; Pascal Voitot; Louise Naudin (ACL, 2020)

PAGnol: An Extra-Large French Generative Model. - Julien Launay; E. L. Tommasone; Baptiste Pannier; François Boniface; Amélie Chatelain; Alessandro Cappelli; Iacopo Poli; Djamé Seddah (LREC, 2022)

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data Only. - Guilherme Penedo; Quentin Malartic; Daniel Hesslow; Ruxandra Cojocaru; Hamza Alobeidli; Alessandro Cappelli; Baptiste Pannier; Ebtesam Almazrouei; Julien Launay (NeurIPS, 2023)

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only. - Guilherme Penedo; Quentin Malartic; Daniel Hesslow; Ruxandra Cojocaru; Alessandro Cappelli; Hamza Alobeidli; Baptiste Pannier; Ebtesam Almazrouei; Julien Launay (CoRR, 2023)

The Falcon Series of Open Language Models. - Ebtesam Almazrouei; Hamza Alobeidli; Abdulaziz Alshamsi; Alessandro Cappelli; Ruxandra Cojocaru; Mérouane Debbah; Étienne Goffinet; Daniel Hesslow; Julien Launay; Quentin Malartic; Daniele Mazzotta; Badreddine Noune; et al. (CoRR, 2023)