Towards Zero-Shot Frame Semantic Parsing for Domain Scaling. - Ankur Bapna; Gökhan Tür; Dilek Hakkani-Tür; Larry P. Heck (INTERSPEECH, 2017)

Sequential Dialogue Context Modeling for Spoken Language Understanding. - Ankur Bapna; Gökhan Tür; Dilek Hakkani-Tür; Larry P. Heck (SIGDIAL Conference, 2017)

Improving Frame Semantic Parsing with Hierarchical Dialogue Encoders. - Ankur Bapna; Gökhan Tür; Dilek Hakkani-Tür; Larry P. Heck (CoRR, 2017)

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. - Mia Xu Chen; Orhan Firat; Ankur Bapna; Melvin Johnson; Wolfgang Macherey; George F. Foster; Llion Jones; Mike Schuster; Noam Shazeer; Niki Parmar; Ashish Vaswani; Jakob Uszkoreit; et al. (ACL (1), 2018)

Training Deeper Neural Machine Translation Models with Transparent Attention. - Ankur Bapna; Mia Xu Chen; Orhan Firat; Yuan Cao 007; Yonghui Wu (EMNLP, 2018)

Revisiting Character-Based Neural Machine Translation with Capacity and Compression. - Colin Cherry; George F. Foster; Ankur Bapna; Orhan Firat; Wolfgang Macherey (EMNLP, 2018)

Building a Conversational Agent Overnight with Dialogue Self-Play. - Pararth Shah; Dilek Hakkani-Tür; Gökhan Tür; Abhinav Rastogi; Ankur Bapna; Neha Nayak; Larry P. Heck (CoRR, 2018)

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. - Mia Xu Chen; Orhan Firat; Ankur Bapna; Melvin Johnson; Wolfgang Macherey; George F. Foster; Llion Jones; Niki Parmar; Mike Schuster; Zhifeng Chen; Yonghui Wu; Macduff Hughes (CoRR, 2018)

Simple, Scalable Adaptation for Neural Machine Translation. - Ankur Bapna; Orhan Firat (EMNLP/IJCNLP (1), 2019)

Investigating Multilingual NMT Representations at Scale. - Sneha Reddy Kudugunta; Ankur Bapna; Isaac Caswell; Orhan Firat (EMNLP/IJCNLP (1), 2019)

Large-Scale Multilingual Speech Recognition with a Streaming End-to-End Model. - Anjuli Kannan; Arindrima Datta; Tara N. Sainath; Eugene Weinstein; Bhuvana Ramabhadran; Yonghui Wu; Ankur Bapna; Zhifeng Chen; Seungji Lee (INTERSPEECH, 2019)

Non-Parametric Adaptation for Neural Machine Translation. - Ankur Bapna; Orhan Firat (NAACL-HLT (1), 2019)

GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism. - Yanping Huang; Youlong Cheng; Ankur Bapna; Orhan Firat; Dehao Chen; Mia Xu Chen; HyoukJoong Lee; Jiquan Ngiam; Quoc V. Le; Yonghui Wu; Zhifeng Chen (NeurIPS, 2019)

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling. - Jonathan Shen; Patrick Nguyen; Yonghui Wu; Zhifeng Chen; Mia Xu Chen; Ye Jia; Anjuli Kannan; Tara N. Sainath; Yuan Cao 007; Chung-Cheng Chiu; Yanzhang He; Jan Chorowski; et al. (CoRR, 2019)

The Missing Ingredient in Zero-Shot Neural Machine Translation. - Naveen Arivazhagan; Ankur Bapna; Orhan Firat; Roee Aharoni; Melvin Johnson; Wolfgang Macherey (CoRR, 2019)

Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges. - Naveen Arivazhagan; Ankur Bapna; Orhan Firat; Dmitry Lepikhin; Melvin Johnson; Maxim Krikun; Mia Xu Chen; Yuan Cao 007; George F. Foster; Colin Cherry; Wolfgang Macherey; Zhifeng Chen; et al. (CoRR, 2019)

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation. - Aditya Siddhant; Melvin Johnson; Henry Tsai; Naveen Arivazhagan; Jason Riesa; Ankur Bapna; Orhan Firat; Karthik Raman 001 (CoRR, 2019)

Investigating Multilingual NMT Representations at Scale. - Sneha Reddy Kudugunta; Ankur Bapna; Isaac Caswell; Naveen Arivazhagan; Orhan Firat (CoRR, 2019)

Simple, Scalable Adaptation for Neural Machine Translation. - Ankur Bapna; Naveen Arivazhagan; Orhan Firat (CoRR, 2019)

Fill in the Blanks: Imputing Missing Sentences for Larger-Context Neural Machine Translation. - Sébastien Jean; Ankur Bapna; Orhan Firat (CoRR, 2019)

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation. - Aditya Siddhant; Melvin Johnson; Henry Tsai; Naveen Ari; Jason Riesa; Ankur Bapna; Orhan Firat; Karthik Raman 001 (AAAI, 2020)

Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation. - Aditya Siddhant; Ankur Bapna; Yuan Cao 007; Orhan Firat; Mia Xu Chen; Sneha Reddy Kudugunta; Naveen Arivazhagan; Yonghui Wu (ACL, 2020)

Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus. - Isaac Caswell; Theresa Breiner; Daan van Esch; Ankur Bapna (COLING, 2020)

Faster Transformer Decoding: N-gram Masked Self-Attention. - Ciprian Chelba; Mia Xu Chen; Ankur Bapna; Noam Shazeer (CoRR, 2020)

Controlling Computation versus Quality for Neural Sequence Models. - Ankur Bapna; Naveen Arivazhagan; Orhan Firat (CoRR, 2020)

Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference. - Sneha Kudugunta; Yanping Huang; Ankur Bapna; Maxim Krikun; Dmitry Lepikhin; Minh-Thang Luong; Orhan Firat (EMNLP (Findings), 2021)

Share or Not? Learning to Schedule Language-Specific Capacity for Multilingual Translation. - Biao Zhang 006; Ankur Bapna; Rico Sennrich; Orhan Firat (ICLR, 2021)

Gradient-guided Loss Masking for Neural Machine Translation. - Xinyi Wang 001; Ankur Bapna; Melvin Johnson; Orhan Firat (CoRR, 2021)

SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training. - Ankur Bapna; Yu-An Chung; Nan Wu; Anmol Gulati; Ye Jia; Jonathan H. Clark; Melvin Johnson; Jason Riesa; Alexis Conneau; Yu Zhang 033 (CoRR, 2021)

Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translation. - Yong Cheng; Ankur Bapna; Orhan Firat; Yuan Cao 007; Pidong Wang; Wolfgang Macherey (ACL (1), 2022)

Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents. - Biao Zhang 006; Ankur Bapna; Melvin Johnson; Ali Dabirmoghaddam; Naveen Arivazhagan; Orhan Firat (ACL (1), 2022)

Joint Unsupervised and Supervised Training for Multilingual ASR. - Junwen Bai; Bo Li 028; Yu Zhang 033; Ankur Bapna; Nikhil Siddhartha; Khe Chai Sim; Tara N. Sainath (ICASSP, 2022)

Scaling Laws for Neural Machine Translation. - Behrooz Ghorbani; Orhan Firat; Markus Freitag; Ankur Bapna; Maxim Krikun; Xavier Garcia; Ciprian Chelba; Colin Cherry (ICLR, 2022)

Examining Scaling and Transfer of Language Model Architectures for Machine Translation. - Biao Zhang 006; Behrooz Ghorbani; Ankur Bapna; Yong Cheng; Xavier Garcia; Jonathan Shen; Orhan Firat (ICML, 2022)

MAESTRO: Matched Speech Text Representations through Modality Matching. - Zhehuai Chen; Yu Zhang 033; Andrew Rosenberg; Bhuvana Ramabhadran; Pedro J. Moreno 001; Ankur Bapna; Heiga Zen (INTERSPEECH, 2022)

XTREME-S: Evaluating Cross-lingual Speech Representations. - Alexis Conneau; Ankur Bapna; Yu Zhang 033; Min Ma; Patrick von Platen; Anton Lozhkov; Colin Cherry; Ye Jia; Clara Rivera; Mihir Kale; Daan van Esch; Vera Axelrod; et al. (INTERSPEECH, 2022)

Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translation. - Ye Jia; Yifan Ding; Ankur Bapna; Colin Cherry; Yu Zhang 033; Alexis Conneau; Nobu Morioka (INTERSPEECH, 2022)

Maestro-U: Leveraging Joint Speech-Text Representation Learning for Zero Supervised Speech ASR. - Zhehuai Chen; Ankur Bapna; Andrew Rosenberg; Yu Zhang 033; Bhuvana Ramabhadran; Pedro J. Moreno 001; Nanxin Chen (SLT, 2022)

FLEURS: FEW-Shot Learning Evaluation of Universal Representations of Speech. - Alexis Conneau; Min Ma; Simran Khanuja; Yu Zhang 033; Vera Axelrod; Siddharth Dalmia; Jason Riesa; Clara Rivera; Ankur Bapna (SLT, 2022)

JOIST: A Joint Speech and Text Streaming Model for ASR. - Tara N. Sainath; Rohit Prabhavalkar; Ankur Bapna; Yu Zhang 033; Zhouyuan Huo; Zhehuai Chen; Bo Li 028; Weiran Wang; Trevor Strohman (SLT, 2022)

Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learning. - Aditya Siddhant; Ankur Bapna; Orhan Firat; Yuan Cao 007; Mia Xu Chen; Isaac Caswell; Xavier Garcia (CoRR, 2022)

mSLAM: Massively multilingual joint pre-training for speech and text. - Ankur Bapna; Colin Cherry; Yu Zhang 033; Ye Jia; Melvin Johnson; Yong Cheng; Simran Khanuja; Jason Riesa; Alexis Conneau (CoRR, 2022)

Building Machine Translation Systems for the Next Thousand Languages. - Ankur Bapna; Isaac Caswell; Julia Kreutzer; Orhan Firat; Daan van Esch; Aditya Siddhant; Mengmeng Niu; Pallavi Baljekar; Xavier Garcia; Wolfgang Macherey; Theresa Breiner; Vera Axelrod; et al. (CoRR, 2022)

Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets. - Julia Kreutzer; Isaac Caswell; Lisa Wang; Ahsan Wahab; Daan van Esch; Nasanbayar Ulzii-Orshikh; Allahsera Tapo; Nishant Subramani; Artem Sokolov; Claytone Sikasote; Monang Setyawan; Supheakmungkol Sarin; et al. (Trans. Assoc. Comput. Linguistics, 2022)

Virtuoso: Massive Multilingual Speech-Text Joint Semi-Supervised Learning for Text-to-Speech. - Takaaki Saeki; Heiga Zen; Zhehuai Chen; Nobuyuki Morioka; Gary Wang; Yu Zhang 033; Ankur Bapna; Andrew Rosenberg; Bhuvana Ramabhadran (ICASSP, 2023)

SQuId: Measuring Speech Naturalness in Many Languages. - Thibault Sellam; Ankur Bapna; Joshua Camp; Diana Mackinnon; Ankur P. Parikh; Jason Riesa (ICASSP, 2023)

Understanding Shared Speech-Text Representations. - Gary Wang; Kyle Kastner; Ankur Bapna; Zhehuai Chen; Andrew Rosenberg; Bhuvana Ramabhadran; Yu Zhang 033 (ICASSP, 2023)

Mu2SLAM: Multitask, Multilingual Speech and Language Models. - Yong Cheng; Yu Zhang 033; Melvin Johnson; Wolfgang Macherey; Ankur Bapna (ICML, 2023)

LibriTTS-R: A Restored Multi-Speaker Text-to-Speech Corpus. - Yuma Koizumi; Heiga Zen; Shigeki Karita; Yifan Ding; Kohei Yatabe; Nobuyuki Morioka; Michiel Bacchiani; Yu Zhang 033; Wei Han 002; Ankur Bapna (INTERSPEECH, 2023)

Label Aware Speech Representation Learning For Language Identification. - Shikhar Vashishth; Shikhar Bharadwaj; Sriram Ganapathy; Ankur Bapna; Min Ma; Wei Han 002; Vera Axelrod; Partha Talukdar (INTERSPEECH, 2023)

PronScribe: Highly Accurate Multimodal Phonemic Transcription From Speech and Text. - Yang Yu; Matthew Perez; Ankur Bapna; Fadi Haik; Siamak Tazari; Yu Zhang (INTERSPEECH, 2023)

MADLAD-400: A Multilingual And Document-Level Large Audited Dataset. - Sneha Kudugunta; Isaac Caswell; Biao Zhang 006; Xavier Garcia; Derrick Xin; Aditya Kusupati; Romi Stella; Ankur Bapna; Orhan Firat (NeurIPS, 2023)

Miipher: A Robust Speech Restoration Model Integrating Self-Supervised Speech and Text Representations. - Yuma Koizumi; Heiga Zen; Shigeki Karita; Yifan Ding; Kohei Yatabe; Nobuyuki Morioka; Yu Zhang 033; Wei Han 002; Ankur Bapna; Michiel Bacchiani (WASPAA, 2023)

Google USM: Scaling Automatic Speech Recognition Beyond 100 Languages. - Yu Zhang 033; Wei Han 002; James Qin; Yongqiang Wang; Ankur Bapna; Zhehuai Chen; Nanxin Chen; Bo Li 028; Vera Axelrod; Gary Wang; Zhong Meng; Ke Hu; et al. (CoRR, 2023)

AudioPaLM: A Large Language Model That Can Speak and Listen. - Paul K. Rubenstein; Chulayuth Asawaroengchai; Duc Dung Nguyen; Ankur Bapna; Zalán Borsos; Félix de Chaumont Quitry; Peter Chen; Dalia El Badawy; Wei Han 002; Eugene Kharitonov; Hannah Muckenhirn; Dirk Padfield; et al. (CoRR, 2023)

MADLAD-400: A Multilingual And Document-Level Large Audited Dataset. - Sneha Kudugunta; Isaac Caswell; Biao Zhang 006; Xavier Garcia; Christopher A. Choquette-Choo; Katherine Lee; Derrick Xin; Aditya Kusupati; Romi Stella; Ankur Bapna; Orhan Firat (CoRR, 2023)

Multimodal Modeling For Spoken Language Identification. - Shikhar Bharadwaj; Min Ma; Shikhar Vashishth; Ankur Bapna; Sriram Ganapathy; Vera Axelrod; Siddharth Dalmia; Wei Han 002; Yu Zhang 033; Daan van Esch; Sandy Ritchie; Partha Talukdar; et al. (CoRR, 2023)

Multimodal Modeling for Spoken Language Identification. - Shikhar Bharadwaj; Min Ma; Shikhar Vashishth; Ankur Bapna; Sriram Ganapathy; Vera Axelrod; Siddharth Dalmia; Wei Han; Yu Zhang; Daan van Esch; Sandy Ritchie; Partha Talukdar; et al. (ICASSP, 2024)

STAB: Speech Tokenizer Assessment Benchmark. - Shikhar Vashishth; Harman Singh; Shikhar Bharadwaj; Sriram Ganapathy; Chulayuth Asawaroengchai; Kartik Audhkhasi; Andrew Rosenberg; Ankur Bapna; Bhuvana Ramabhadran (CoRR, 2024)

Gemma 3 Technical Report. - Aishwarya Kamath; Johan Ferret; Shreya Pathak; Nino Vieillard; Ramona Merhej; Sarah Perrin; Tatiana Matejovicova; Alexandre Ramé; Morgane Rivière; Louis Rouillard; Thomas Mesnard; Geoffrey Cideron; et al. (CoRR, 2025)