Cloze-driven Pretraining of Self-attention Networks. - Alexei Baevski; Sergey Edunov; Yinhan Liu; Luke Zettlemoyer; Michael Auli (EMNLP/IJCNLP (1), 2019)

Adaptive Input Representations for Neural Language Modeling. - Alexei Baevski; Michael Auli (ICLR (Poster), 2019)

Pay Less Attention with Lightweight and Dynamic Convolutions. - Felix Wu; Angela Fan; Alexei Baevski; Yann N. Dauphin; Michael Auli (ICLR, 2019)

wav2vec: Unsupervised Pre-Training for Speech Recognition. - Steffen Schneider 001; Alexei Baevski; Ronan Collobert; Michael Auli (INTERSPEECH, 2019)

Pre-trained language model representations for language generation. - Sergey Edunov; Alexei Baevski; Michael Auli (NAACL-HLT (1), 2019)

fairseq: A Fast, Extensible Toolkit for Sequence Modeling. - Myle Ott; Sergey Edunov; Alexei Baevski; Angela Fan; Sam Gross; Nathan Ng 001; David Grangier; Michael Auli (NAACL-HLT (Demonstrations), 2019)

Facebook FAIR's WMT19 News Translation Task Submission. - Nathan Ng 001; Kyra Yee; Alexei Baevski; Myle Ott; Michael Auli; Sergey Edunov (WMT (2), 2019)

Effectiveness of self-supervised pre-training for speech recognition. - Alexei Baevski; Michael Auli; Abdelrahman Mohamed (CoRR, 2019)

Effectiveness of Self-Supervised Pre-Training for ASR. - Alexei Baevski; Abdelrahman Mohamed (ICASSP, 2020)

vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations. - Alexei Baevski; Steffen Schneider 001; Michael Auli (ICLR, 2020)

wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations. - Alexei Baevski; Yuhao Zhou; Abdelrahman Mohamed; Michael Auli (NeurIPS, 2020)

wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations. - Alexei Baevski; Henry Zhou; Abdelrahman Mohamed; Michael Auli (CoRR, 2020)

The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling. - Tu Anh Nguyen; Maureen de Seyssel; Patricia Rozé; Morgane Rivière; Evgeny Kharitonov; Alexei Baevski; Ewan Dunbar; Emmanuel Dupoux (CoRR, 2020)

Reservoir Transformer. - Sheng Shen 001; Alexei Baevski; Ari S. Morcos; Kurt Keutzer; Michael Auli; Douwe Kiela (CoRR, 2020)

Multilingual Speech Translation from Efficient Finetuning of Pretrained Models. - Xian Li 003; Changhan Wang; Yun Tang 002; Chau Tran; Yuqing Tang; Juan Miguel Pino; Alexei Baevski; Alexis Conneau; Michael Auli (ACL/IJCNLP (1), 2021)

Reservoir Transformers. - Sheng Shen 001; Alexei Baevski; Ari S. Morcos; Kurt Keutzer; Michael Auli; Douwe Kiela (ACL/IJCNLP (1), 2021)

Self-Training and Pre-Training are Complementary for Speech Recognition. - Qiantong Xu; Alexei Baevski; Tatiana Likhomanenko; Paden Tomasello; Alexis Conneau; Ronan Collobert; Gabriel Synnaeve; Michael Auli (ICASSP, 2021)

A Comparison of Discrete Latent Variable Models for Speech Representation Learning. - Henry Zhou; Alexei Baevski; Michael Auli (ICASSP, 2021)

Unsupervised Cross-Lingual Representation Learning for Speech Recognition. - Alexis Conneau; Alexei Baevski; Ronan Collobert; Abdelrahman Mohamed; Michael Auli (Interspeech, 2021)

Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training. - Wei-Ning Hsu; Anuroop Sriram; Alexei Baevski; Tatiana Likhomanenko; Qiantong Xu; Vineel Pratap; Jacob Kahn; Ann Lee 001; Ronan Collobert; Gabriel Synnaeve; Michael Auli (Interspeech, 2021)

Large-Scale Self- and Semi-Supervised Learning for Speech Translation. - Changhan Wang; Anne Wu; Juan Pino 001; Alexei Baevski; Michael Auli; Alexis Conneau (Interspeech, 2021)

Unsupervised Speech Recognition. - Alexei Baevski; Wei-Ning Hsu; Alexis Conneau; Michael Auli (NeurIPS, 2021)

Generative Spoken Language Modeling from Raw Audio. - Kushal Lakhotia; Evgeny Kharitonov; Wei-Ning Hsu; Yossi Adi; Adam Polyak; Benjamin Bolte; Tu Anh Nguyen; Jade Copet; Alexei Baevski; Adelrahman Mohamed; Emmanuel Dupoux (CoRR, 2021)

Improved Language Identification Through Cross-Lingual Self-Supervised Learning. - Andros Tjandra; Diptanu Gon Choudhury; Frank Zhang 001; Kritika Singh; Alexei Baevski; Assaf Sela; Yatharth Saraf; Michael Auli (CoRR, 2021)

Unified Speech-Text Pre-training for Speech Translation and Recognition. - Yun Tang 002; Hongyu Gong; Ning Dong; Changhan Wang; Wei-Ning Hsu; Jiatao Gu; Alexei Baevski; Xian Li 003; Abdelrahman Mohamed; Michael Auli; Juan Miguel Pino (ACL (1), 2022)

Improved Language Identification Through Cross-Lingual Self-Supervised Learning. - Andros Tjandra; Diptanu Gon Choudhury; Frank Zhang 001; Kritika Singh; Alexis Conneau; Alexei Baevski; Assaf Sela; Yatharth Saraf; Michael Auli (ICASSP, 2022)

data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language. - Alexei Baevski; Wei-Ning Hsu; Qiantong Xu; Arun Babu; Jiatao Gu; Michael Auli (ICML, 2022)

XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale. - Arun Babu; Changhan Wang; Andros Tjandra; Kushal Lakhotia; Qiantong Xu; Naman Goyal 001; Kritika Singh; Patrick von Platen; Yatharth Saraf; Juan Pino 001; Alexei Baevski; Alexis Conneau; et al. (INTERSPEECH, 2022)

Simple and Effective Unsupervised Speech Synthesis. - Alexander H. Liu; Cheng-I Lai; Wei-Ning Hsu; Michael Auli; Alexei Baevski; James R. Glass (INTERSPEECH, 2022)

Wav2Vec-Aug: Improved self-supervised training with limited data. - Anuroop Sriram; Michael Auli; Alexei Baevski (INTERSPEECH, 2022)

On-demand compute reduction with stochastic wav2vec 2.0. - Apoorv Vyas; Wei-Ning Hsu; Michael Auli; Alexei Baevski (INTERSPEECH, 2022)

Simple and Effective Zero-shot Cross-lingual Phoneme Recognition. - Qiantong Xu; Alexei Baevski; Michael Auli (INTERSPEECH, 2022)

Masked Autoencoders that Listen. - Po-Yao Huang 001; Hu Xu 001; Juncheng Li 001; Alexei Baevski; Michael Auli; Wojciech Galuba; Florian Metze; Christoph Feichtenhofer (NeurIPS, 2022)

Towards End-to-End Unsupervised Speech Recognition. - Alexander H. Liu; Wei-Ning Hsu; Michael Auli; Alexei Baevski (SLT, 2022)

Measuring the Impact of Individual Domain Factors in Self-Supervised Pre-Training. - Ramon Sanabria; Wei-Ning Hsu; Alexei Baevski; Michael Auli (CoRR, 2022)

Offline Visual Representation Learning for Embodied Navigation. - Karmesh Yadav; Ram Ramrakhya; Arjun Majumdar; Vincent-Pierre Berges; Sachit Kuhar; Dhruv Batra; Alexei Baevski; Oleksandr Maksymets (CoRR, 2022)

Introducing Semantics into Speech Encoders. - Derek Xu; Shuyan Dong; Changhan Wang; Suyoun Kim; Zhaojiang Lin; Akshat Shrivastava; Shang-Wen Li 001; Liang-Hsuan Tseng; Alexei Baevski; Guan-Ting Lin; Hung-yi Lee; Yizhou Sun; et al. (CoRR, 2022)

Introducing Semantics into Speech Encoders. - Derek Xu; Shuyan Dong; Changhan Wang; Suyoun Kim; Zhaojiang Lin; Bing Liu; Akshat Shrivastava; Shang-Wen Li 001; Liang-Hsuan Tseng; Guan-Ting Lin; Alexei Baevski; Hung-yi Lee; et al. (ACL (1), 2023)

Av-Data2Vec: Self-Supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representations. - Jiachen Lian; Alexei Baevski; Wei-Ning Hsu; Michael Auli (ASRU, 2023)

Toward Joint Language Modeling for Speech Units and Text. - Ju-Chieh Chou; Chung-Ming Chien; Wei-Ning Hsu; Karen Livescu; Arun Babu; Alexis Conneau; Alexei Baevski; Michael Auli (EMNLP (Findings), 2023)

Measuring the Impact of Domain Factors in Self-Supervised Pre-Training. - Ramon Sanabria; Wei-Ning Hsu; Alexei Baevski; Michael Auli (ICASSP Workshops, 2023)

Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language. - Alexei Baevski; Arun Babu; Wei-Ning Hsu; Michael Auli (ICML, 2023)

OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNav. - Karmesh Yadav; Arjun Majumdar; Ram Ramrakhya; Naoki Yokoyama; Alexei Baevski; Zsolt Kira; Oleksandr Maksymets; Dhruv Batra (CoRR, 2023)

Scaling Speech Technology to 1, 000+ Languages. - Vineel Pratap; Andros Tjandra; Bowen Shi; Paden Tomasello; Arun Babu; Sayani Kundu; Ali Elkahky; Zhaoheng Ni; Apoorv Vyas; Maryam Fazel-Zarandi; Alexei Baevski; Yossi Adi; et al. (J. Mach. Learn. Res., 2024)