Real-time Inference in Multi-sentence Tasks with Deep Pretrained Transformers. - Samuel Humeau 001; Kurt Shuster 001; Marie-Anne Lachaux; Jason Weston (CoRR, 2019)

Target Conditioning for One-to-Many Generation. - Marie-Anne Lachaux; Armand Joulin; Guillaume Lample (EMNLP (Findings), 2020)

Poly-encoders: Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring. - Samuel Humeau 001; Kurt Shuster 001; Marie-Anne Lachaux; Jason Weston (ICLR, 2020)

CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data. - Guillaume Wenzek; Marie-Anne Lachaux; Alexis Conneau; Vishrav Chaudhary; Francisco Guzmán; Armand Joulin; Edouard Grave (LREC, 2020)

Unsupervised Translation of Programming Languages. - Baptiste Rozière; Marie-Anne Lachaux; Lowik Chanussot; Guillaume Lample (NeurIPS, 2020)

DOBF: A Deobfuscation Pre-Training Objective for Programming Languages. - Marie-Anne Lachaux; Baptiste Rozière; Marc Szafraniec; Guillaume Lample (NeurIPS, 2021)

HyperTree Proof Search for Neural Theorem Proving. - Guillaume Lample; Timothée Lacroix; Marie-Anne Lachaux; Aurélien Rodriguez; Amaury Hayat; Thibaut Lavril; Gabriel Ebner; Xavier Martinet (NeurIPS, 2022)

LLaMA: Open and Efficient Foundation Language Models. - Hugo Touvron; Thibaut Lavril; Gautier Izacard; Xavier Martinet; Marie-Anne Lachaux; Timothée Lacroix; Baptiste Rozière; Naman Goyal 001; Eric Hambro; Faisal Azhar; Aurélien Rodriguez; Armand Joulin; et al. (CoRR, 2023)

Llama 2: Open Foundation and Fine-Tuned Chat Models. - Hugo Touvron; Louis Martin; Kevin Stone; Peter Albert; Amjad Almahairi; Yasmine Babaei; Nikolay Bashlykov; Soumya Batra; Prajjwal Bhargava; Shruti Bhosale; Dan Bikel; Lukas Blecher; et al. (CoRR, 2023)

Mistral 7B. - Albert Q. Jiang; Alexandre Sablayrolles; Arthur Mensch; Chris Bamford 001; Devendra Singh Chaplot; Diego de Las Casas; Florian Bressand; Gianna Lengyel; Guillaume Lample; Lucile Saulnier; Lélio Renard Lavaud; Marie-Anne Lachaux; et al. (CoRR, 2023)

Mixtral of Experts. - Albert Q. Jiang; Alexandre Sablayrolles; Antoine Roux; Arthur Mensch; Blanche Savary; Chris Bamford 001; Devendra Singh Chaplot; Diego de Las Casas; Emma Bou Hanna; Florian Bressand; Gianna Lengyel; Guillaume Bour; et al. (CoRR, 2024)