Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation. - Yonghui Wu; Mike Schuster; Zhifeng Chen; Quoc V. Le; Mohammad Norouzi 002; Wolfgang Macherey; Maxim Krikun; Yuan Cao 007; Qin Gao; Klaus Macherey; Jeff Klingner; Apurva Shah; et al. (CoRR, 2016)

Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation. - Melvin Johnson; Mike Schuster; Quoc V. Le; Maxim Krikun; Yonghui Wu; Zhifeng Chen; Nikhil Thorat; Fernanda B. Viégas; Martin Wattenberg; Greg Corrado; Macduff Hughes; Jeffrey Dean (Trans. Assoc. Comput. Linguistics, 2017)

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. - Mia Xu Chen; Orhan Firat; Ankur Bapna; Melvin Johnson; Wolfgang Macherey; George F. Foster; Llion Jones; Mike Schuster; Noam Shazeer; Niki Parmar; Ashish Vaswani; Jakob Uszkoreit; et al. (ACL (1), 2018)

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. - Mia Xu Chen; Orhan Firat; Ankur Bapna; Melvin Johnson; Wolfgang Macherey; George F. Foster; Llion Jones; Niki Parmar; Mike Schuster; Zhifeng Chen; Yonghui Wu; Macduff Hughes (CoRR, 2018)

Zero-Shot Cross-lingual Classification Using Multilingual Neural Machine Translation. - Akiko Eriguchi; Melvin Johnson; Orhan Firat; Hideto Kazawa; Wolfgang Macherey (CoRR, 2018)

Small and Practical BERT Models for Sequence Labeling. - Henry Tsai; Jason Riesa; Melvin Johnson; Naveen Arivazhagan; Xin Li; Amelia Archer (EMNLP/IJCNLP (1), 2019)

Leveraging Weakly Supervised Data to Improve End-to-end Speech-to-text Translation. - Ye Jia; Melvin Johnson; Wolfgang Macherey; Ron J. Weiss; Yuan Cao 007; Chung-Cheng Chiu; Naveen Ari; Stella Laurenzo; Yonghui Wu (ICASSP, 2019)

Direct Speech-to-Speech Translation with a Sequence-to-Sequence Model. - Ye Jia; Ron J. Weiss; Fadi Biadsy; Wolfgang Macherey; Melvin Johnson; Zhifeng Chen; Yonghui Wu (INTERSPEECH, 2019)

Massively Multilingual Neural Machine Translation. - Roee Aharoni; Melvin Johnson; Orhan Firat (NAACL-HLT (1), 2019)

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling. - Jonathan Shen; Patrick Nguyen; Yonghui Wu; Zhifeng Chen; Mia Xu Chen; Ye Jia; Anjuli Kannan; Tara N. Sainath; Yuan Cao 007; Chung-Cheng Chiu; Yanzhang He; Jan Chorowski; et al. (CoRR, 2019)

The Missing Ingredient in Zero-Shot Neural Machine Translation. - Naveen Arivazhagan; Ankur Bapna; Orhan Firat; Roee Aharoni; Melvin Johnson; Wolfgang Macherey (CoRR, 2019)

Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges. - Naveen Arivazhagan; Ankur Bapna; Orhan Firat; Dmitry Lepikhin; Melvin Johnson; Maxim Krikun; Mia Xu Chen; Yuan Cao 007; George F. Foster; Colin Cherry; Wolfgang Macherey; Zhifeng Chen; et al. (CoRR, 2019)

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation. - Aditya Siddhant; Melvin Johnson; Henry Tsai; Naveen Arivazhagan; Jason Riesa; Ankur Bapna; Orhan Firat; Karthik Raman 001 (CoRR, 2019)

Adaptive Scheduling for Multi-Task Learning. - Sébastien Jean; Orhan Firat; Melvin Johnson (CoRR, 2019)

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation. - Aditya Siddhant; Melvin Johnson; Henry Tsai; Naveen Ari; Jason Riesa; Ankur Bapna; Orhan Firat; Karthik Raman 001 (AAAI, 2020)

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation. - Junjie Hu 001; Sebastian Ruder; Aditya Siddhant; Graham Neubig; Orhan Firat; Melvin Johnson (ICML, 2020)

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization. - Junjie Hu 001; Sebastian Ruder; Aditya Siddhant; Graham Neubig; Orhan Firat; Melvin Johnson (CoRR, 2020)

nmT5 - Is parallel data still relevant for pre-training massively multilingual language models? - Mihir Kale; Aditya Siddhant; Rami Al-Rfou; Linting Xue; Noah Constant; Melvin Johnson (ACL/IJCNLP (2), 2021)

MergeDistill: Merging Language Models using Pre-trained Distillation. - Simran Khanuja; Melvin Johnson; Partha P. Talukdar (ACL/IJCNLP (Findings), 2021)

HintedBT: Augmenting Back-Translation with Quality and Transliteration Hints. - Sahana Ramnath; Melvin Johnson; Abhirut Gupta; Aravindan Raghuveer (EMNLP (1), 2021)

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. - Sebastian Ruder; Noah Constant; Jan A. Botha; Aditya Siddhant; Orhan Firat; Jinlan Fu; Pengfei Liu 003; Junjie Hu 001; Dan Garrette; Graham Neubig; Melvin Johnson (EMNLP (1), 2021)

Rethinking Embedding Coupling in Pre-trained Language Models. - Hyung Won Chung; Thibault Févry; Henry Tsai; Melvin Johnson; Sebastian Ruder (ICLR, 2021)

Explicit Alignment Objectives for Multilingual Bidirectional Encoders. - Junjie Hu 001; Melvin Johnson; Orhan Firat; Aditya Siddhant; Graham Neubig (NAACL-HLT, 2021)

Distilling Large Language Models into Tiny and Effective Students using pQRNN. - Prabhu Kaliamoorthi; Aditya Siddhant; Edward Li; Melvin Johnson (CoRR, 2021)

They, Them, Theirs: Rewriting with Gender-Neutral English. - Tony Sun; Kellie Webster; Apurva Shah; William Yang Wang; Melvin Johnson (CoRR, 2021)

Gradient-guided Loss Masking for Neural Machine Translation. - Xinyi Wang 001; Ankur Bapna; Melvin Johnson; Orhan Firat (CoRR, 2021)

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. - Sebastian Ruder; Noah Constant; Jan A. Botha; Aditya Siddhant; Orhan Firat; Jinlan Fu; Pengfei Liu 003; Junjie Hu 001; Graham Neubig; Melvin Johnson (CoRR, 2021)

MergeDistill: Merging Pre-trained Language Models using Distillation. - Simran Khanuja; Melvin Johnson; Partha P. Talukdar (CoRR, 2021)

SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training. - Ankur Bapna; Yu-An Chung; Nan Wu; Anmol Gulati; Ye Jia; Jonathan H. Clark; Melvin Johnson; Jason Riesa; Alexis Conneau; Yu Zhang 033 (CoRR, 2021)

Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents. - Biao Zhang 006; Ankur Bapna; Melvin Johnson; Ali Dabirmoghaddam; Naveen Arivazhagan; Orhan Firat (ACL (1), 2022)

XTREME-S: Evaluating Cross-lingual Speech Representations. - Alexis Conneau; Ankur Bapna; Yu Zhang 033; Min Ma; Patrick von Platen; Anton Lozhkov; Colin Cherry; Ye Jia; Clara Rivera; Mihir Kale; Daan van Esch; Vera Axelrod; et al. (INTERSPEECH, 2022)

DOCmT5: Document-Level Pretraining of Multilingual Language Models. - Chia-Hsuan Lee 001; Aditya Siddhant; Viresh Ratnakar; Melvin Johnson (NAACL-HLT (Findings), 2022)

Domain Curricula for Code-Switched MT at MixMT 2022. - Lekan Raheem; Maab Elrashid; Melvin Johnson; Julia Kreutzer (WMT, 2022)

mSLAM: Massively multilingual joint pre-training for speech and text. - Ankur Bapna; Colin Cherry; Yu Zhang 033; Ye Jia; Melvin Johnson; Yong Cheng; Simran Khanuja; Jason Riesa; Alexis Conneau (CoRR, 2022)

XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages. - Sebastian Ruder; Jonathan H. Clark; Alexander Gutkin; Mihir Kale; Min Ma; Massimo Nicosia; Shruti Rijhwani; Parker Riley; Jean Michel A. Sarr; Xinyi Wang 001; John Wieting; Nitish Gupta; et al. (EMNLP (Findings), 2023)

Mu2SLAM: Multitask, Multilingual Speech and Language Models. - Yong Cheng; Yu Zhang 033; Melvin Johnson; Wolfgang Macherey; Ankur Bapna (ICML, 2023)

The Unreasonable Effectiveness of Few-shot Learning for Machine Translation. - Xavier Garcia; Yamini Bansal; Colin Cherry; George F. Foster; Maxim Krikun; Melvin Johnson; Orhan Firat (ICML, 2023)

The unreasonable effectiveness of few-shot learning for machine translation. - Xavier Garcia; Yamini Bansal; Colin Cherry; George F. Foster; Maxim Krikun; Fangxiaoyu Feng; Melvin Johnson; Orhan Firat (CoRR, 2023)

PaLM 2 Technical Report. - Rohan Anil; Andrew M. Dai; Orhan Firat; Melvin Johnson; Dmitry Lepikhin; Alexandre Passos; Siamak Shakeri; Emanuel Taropa; Paige Bailey; Zhifeng Chen; Eric Chu; Jonathan H. Clark; et al. (CoRR, 2023)

Gemini: A Family of Highly Capable Multimodal Models. - Rohan Anil; Sebastian Borgeaud; Yonghui Wu; Jean-Baptiste Alayrac; Jiahui Yu; Radu Soricut; Johan Schalkwyk; Andrew M. Dai; Anja Hauth; Katie Millican; David Silver; Slav Petrov; et al. (CoRR, 2023)

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. - Machel Reid; Nikolay Savinov; Denis Teplyashin; Dmitry Lepikhin; Timothy P. Lillicrap; Jean-Baptiste Alayrac; Radu Soricut; Angeliki Lazaridou; Orhan Firat; Julian Schrittwieser; Ioannis Antonoglou; Rohan Anil; et al. (CoRR, 2024)

Capabilities of Gemini Models in Medicine. - Khaled Saab 003; Tao Tu 001; Wei-Hung Weng; Ryutaro Tanno; David Stutz; Ellery Wulczyn; Fan Zhang; Tim Strother; Chunjong Park; Elahe Vedadi; Juanma Zambrano Chaves; Szu-Yeu Hu; et al. (CoRR, 2024)