Meta-Prod2Vec: Product Embeddings Using Side-Information for Recommendation. - Flavian Vasile; Elena Smirnova; Alexis Conneau (RecSys, 2016)

Very Deep Convolutional Networks for Natural Language Processing. - Alexis Conneau; Holger Schwenk; Loïc Barrault; Yann LeCun (CoRR, 2016)

Very Deep Convolutional Networks for Text Classification. - Alexis Conneau; Holger Schwenk; Loïc Barrault; Yann LeCun (EACL (1), 2017)

Supervised Learning of Universal Sentence Representations from Natural Language Inference Data. - Alexis Conneau; Douwe Kiela; Holger Schwenk; Loïc Barrault; Antoine Bordes (EMNLP, 2017)

What you can cram into a single $&!#* vector: Probing sentence embeddings for linguistic properties. - Alexis Conneau; Germán Kruszewski; Guillaume Lample; Loïc Barrault; Marco Baroni (ACL (1), 2018)

XNLI: Evaluating Cross-lingual Sentence Representations. - Alexis Conneau; Ruty Rinott; Guillaume Lample; Adina Williams; Samuel R. Bowman; Holger Schwenk; Veselin Stoyanov (EMNLP, 2018)

Phrase-Based & Neural Unsupervised Machine Translation. - Guillaume Lample; Myle Ott; Alexis Conneau; Ludovic Denoyer; Marc'Aurelio Ranzato (EMNLP, 2018)

Unsupervised Machine Translation Using Monolingual Corpora Only. - Guillaume Lample; Alexis Conneau; Ludovic Denoyer; Marc'Aurelio Ranzato (ICLR (Poster), 2018)

Word translation without parallel data. - Guillaume Lample; Alexis Conneau; Marc'Aurelio Ranzato; Ludovic Denoyer; Hervé Jégou (ICLR (Poster), 2018)

SentEval: An Evaluation Toolkit for Universal Sentence Representations. - Alexis Conneau; Douwe Kiela (LREC, 2018)

Learning Visually Grounded Sentence Representations. - Douwe Kiela; Alexis Conneau; Allan Jabri; Maximilian Nickel (NAACL-HLT, 2018)

Cross-lingual Language Model Pretraining. - Alexis Conneau; Guillaume Lample (NeurIPS, 2019)

Learning distributed representations of sentences using neural networks. (Apprentissage et applications de représentations multilingues distribuées). - Alexis Conneau (2019)

Unsupervised Cross-lingual Representation Learning at Scale. - Alexis Conneau; Kartikay Khandelwal; Naman Goyal 001; Vishrav Chaudhary; Guillaume Wenzek; Francisco Guzmán; Edouard Grave; Myle Ott; Luke Zettlemoyer; Veselin Stoyanov (ACL, 2020)

Emerging Cross-lingual Structure in Pretrained Language Models. - Alexis Conneau; Shijie Wu; Haoran Li 007; Luke Zettlemoyer; Veselin Stoyanov (ACL, 2020)

CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data. - Guillaume Wenzek; Marie-Anne Lachaux; Alexis Conneau; Vishrav Chaudhary; Francisco Guzmán; Armand Joulin; Edouard Grave (LREC, 2020)

Multilingual Speech Translation from Efficient Finetuning of Pretrained Models. - Xian Li 003; Changhan Wang; Yun Tang 002; Chau Tran; Yuqing Tang; Juan Miguel Pino; Alexei Baevski; Alexis Conneau; Michael Auli (ACL/IJCNLP (1), 2021)

Self-Training and Pre-Training are Complementary for Speech Recognition. - Qiantong Xu; Alexei Baevski; Tatiana Likhomanenko; Paden Tomasello; Alexis Conneau; Ronan Collobert; Gabriel Synnaeve; Michael Auli (ICASSP, 2021)

Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning. - Beliz Gunel; Jingfei Du; Alexis Conneau; Veselin Stoyanov (ICLR, 2021)

Unsupervised Cross-Lingual Representation Learning for Speech Recognition. - Alexis Conneau; Alexei Baevski; Ronan Collobert; Abdelrahman Mohamed; Michael Auli (Interspeech, 2021)

Large-Scale Self- and Semi-Supervised Learning for Speech Translation. - Changhan Wang; Anne Wu; Juan Pino 001; Alexei Baevski; Michael Auli; Alexis Conneau (Interspeech, 2021)

Self-training Improves Pre-training for Natural Language Understanding. - Jingfei Du; Edouard Grave; Beliz Gunel; Vishrav Chaudhary; Onur Celebi; Michael Auli; Veselin Stoyanov; Alexis Conneau (NAACL-HLT, 2021)

Unsupervised Speech Recognition. - Alexei Baevski; Wei-Ning Hsu; Alexis Conneau; Michael Auli (NeurIPS, 2021)

Larger-Scale Transformers for Multilingual Masked Language Modeling. - Naman Goyal 001; Jingfei Du; Myle Ott; Giri Anantharaman; Alexis Conneau (RepL4NLP@ACL-IJCNLP, 2021)

SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training. - Ankur Bapna; Yu-An Chung; Nan Wu; Anmol Gulati; Ye Jia; Jonathan H. Clark; Melvin Johnson; Jason Riesa; Alexis Conneau; Yu Zhang 033 (CoRR, 2021)

Improved Language Identification Through Cross-Lingual Self-Supervised Learning. - Andros Tjandra; Diptanu Gon Choudhury; Frank Zhang 001; Kritika Singh; Alexis Conneau; Alexei Baevski; Assaf Sela; Yatharth Saraf; Michael Auli (ICASSP, 2022)

XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale. - Arun Babu; Changhan Wang; Andros Tjandra; Kushal Lakhotia; Qiantong Xu; Naman Goyal 001; Kritika Singh; Patrick von Platen; Yatharth Saraf; Juan Pino 001; Alexei Baevski; Alexis Conneau; et al. (INTERSPEECH, 2022)

XTREME-S: Evaluating Cross-lingual Speech Representations. - Alexis Conneau; Ankur Bapna; Yu Zhang 033; Min Ma; Patrick von Platen; Anton Lozhkov; Colin Cherry; Ye Jia; Clara Rivera; Mihir Kale; Daan van Esch; Vera Axelrod; et al. (INTERSPEECH, 2022)

Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translation. - Ye Jia; Yifan Ding; Ankur Bapna; Colin Cherry; Yu Zhang 033; Alexis Conneau; Nobu Morioka (INTERSPEECH, 2022)

FLEURS: FEW-Shot Learning Evaluation of Universal Representations of Speech. - Alexis Conneau; Min Ma; Simran Khanuja; Yu Zhang 033; Vera Axelrod; Siddharth Dalmia; Jason Riesa; Clara Rivera; Ankur Bapna (SLT, 2022)

mSLAM: Massively multilingual joint pre-training for speech and text. - Ankur Bapna; Colin Cherry; Yu Zhang 033; Ye Jia; Melvin Johnson; Yong Cheng; Simran Khanuja; Jason Riesa; Alexis Conneau (CoRR, 2022)

Toward Joint Language Modeling for Speech Units and Text. - Ju-Chieh Chou; Chung-Ming Chien; Wei-Ning Hsu; Karen Livescu; Arun Babu; Alexis Conneau; Alexei Baevski; Michael Auli (EMNLP (Findings), 2023)

Scaling Laws for Generative Mixed-Modal Language Models. - Armen Aghajanyan; Lili Yu; Alexis Conneau; Wei-Ning Hsu; Karen Hambardzumyan; Susan Zhang; Stephen Roller; Naman Goyal 001; Omer Levy; Luke Zettlemoyer (ICML, 2023)

Textually Pretrained Speech Language Models. - Michael Hassid; Tal Remez; Tu Anh Nguyen; Itai Gat; Alexis Conneau; Felix Kreuk; Jade Copet; Alexandre Défossez; Gabriel Synnaeve; Emmanuel Dupoux; Roy Schwartz 001; Yossi Adi (NeurIPS, 2023)

GPT-4o System Card. - Aaron Hurst; Adam Lerer; Adam P. Goucher; Adam Perelman; Aditya Ramesh; Aidan Clark; AJ Ostrow; Akila Welihinda; Alan Hayes; Alec Radford; Aleksander Madry; Alex Baker-Whitcomb; et al. (CoRR, 2024)

Scaling Speech Technology to 1, 000+ Languages. - Vineel Pratap; Andros Tjandra; Bowen Shi; Paden Tomasello; Arun Babu; Sayani Kundu; Ali Elkahky; Zhaoheng Ni; Apoorv Vyas; Maryam Fazel-Zarandi; Alexei Baevski; Yossi Adi; et al. (J. Mach. Learn. Res., 2024)