A Joint Model of Rhetorical Discourse Structure and Summarization. - Naman Goyal 001; Jacob Eisenstein (SPNLP@EMNLP, 2016)

Active Learning in Multi-objective Evolutionary Algorithms for Sustainable Building Design. - Siamak Safarzadegan Gilan; Naman Goyal 001; Bistra Dilkina (GECCO, 2016)

The Social Dynamics of Language Change in Online Networks. - Rahul Goel; Sandeep Soni; Naman Goyal 001; John Paparrizos; Hanna M. Wallach; Fernando Diaz 001; Jacob Eisenstein (SocInfo (1), 2016)

LearningToQuestion at SemEval 2017 Task 3: Ranking Similar Questions by Learning to Rank Using Rich Features. - Naman Goyal 001 (SemEval@ACL, 2017)

RoBERTa: A Robustly Optimized BERT Pretraining Approach. - Yinhan Liu; Myle Ott; Naman Goyal 001; Jingfei Du; Mandar Joshi; Danqi Chen 001; Omer Levy; Mike Lewis; Luke Zettlemoyer; Veselin Stoyanov (CoRR, 2019)

Unsupervised Cross-lingual Representation Learning at Scale. - Alexis Conneau; Kartikay Khandelwal; Naman Goyal 001; Vishrav Chaudhary; Guillaume Wenzek; Francisco Guzmán; Edouard Grave; Myle Ott; Luke Zettlemoyer; Veselin Stoyanov (ACL, 2020)

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. - Mike Lewis; Yinhan Liu; Naman Goyal 001; Marjan Ghazvininejad; Abdelrahman Mohamed; Omer Levy; Veselin Stoyanov; Luke Zettlemoyer (ACL, 2020)

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. - Patrick Lewis 001; Ethan Perez; Aleksandra Piktus; Fabio Petroni; Vladimir Karpukhin; Naman Goyal 001; Heinrich Küttler; Mike Lewis; Wen-tau Yih; Tim Rocktäschel; Sebastian Riedel 001; Douwe Kiela (NeurIPS, 2020)

Facebook AI's WMT20 News Translation Task Submission. - Peng-Jen Chen; Ann Lee 001; Changhan Wang; Naman Goyal 001; Angela Fan; Mary Williamson; Jiatao Gu (WMT@EMNLP, 2020)

Findings of the WMT 2020 Shared Task on Parallel Corpus Filtering and Alignment. - Philipp Koehn; Vishrav Chaudhary; Ahmed El-Kishky; Naman Goyal 001; Peng-Jen Chen; Francisco Guzmán (WMT@EMNLP, 2020)

Recipes for building an open-domain chatbot. - Stephen Roller; Emily Dinan; Naman Goyal 001; Da Ju; Mary Williamson; Yinhan Liu; Jing Xu; Myle Ott; Kurt Shuster 001; Eric Michael Smith; Y-Lan Boureau; Jason Weston (CoRR, 2020)

Multilingual Translation with Extensible Multilingual Pretraining and Finetuning. - Yuqing Tang; Chau Tran; Xian Li 003; Peng-Jen Chen; Naman Goyal 001; Vishrav Chaudhary; Jiatao Gu; Angela Fan (CoRR, 2020)

Beyond English-Centric Multilingual Machine Translation. - Angela Fan; Shruti Bhosale; Holger Schwenk; Zhiyi Ma; Ahmed El-Kishky; Siddharth Goyal; Mandeep Baines; Onur Celebi; Guillaume Wenzek; Vishrav Chaudhary; Naman Goyal 001; Tom Birch; et al. (CoRR, 2020)

Multilingual Denoising Pre-training for Neural Machine Translation. - Yinhan Liu; Jiatao Gu; Naman Goyal 001; Xian Li 003; Sergey Edunov; Marjan Ghazvininejad; Mike Lewis; Luke Zettlemoyer (Trans. Assoc. Comput. Linguistics, 2020)

Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data. - Wei-Jen Ko; Ahmed El-Kishky; Adithya Renduchintala; Vishrav Chaudhary; Naman Goyal 001; Francisco Guzmán; Pascale Fung; Philipp Koehn; Mona T. Diab (ACL/IJCNLP (1), 2021)

Multilingual Translation from Denoising Pre-Training. - Yuqing Tang; Chau Tran; Xian Li 003; Peng-Jen Chen; Naman Goyal 001; Vishrav Chaudhary; Jiatao Gu; Angela Fan (ACL/IJCNLP (Findings), 2021)

Recipes for Building an Open-Domain Chatbot. - Stephen Roller; Emily Dinan; Naman Goyal 001; Da Ju; Mary Williamson; Yinhan Liu; Jing Xu; Myle Ott; Eric Michael Smith; Y-Lan Boureau; Jason Weston (EACL, 2021)

Better Fine-Tuning by Reducing Representational Collapse. - Armen Aghajanyan; Akshat Shrivastava; Anchit Gupta; Naman Goyal 001; Luke Zettlemoyer; Sonal Gupta (ICLR, 2021)

BASE Layers: Simplifying Training of Large, Sparse Models. - Mike Lewis; Shruti Bhosale; Tim Dettmers; Naman Goyal 001; Luke Zettlemoyer (ICML, 2021)

FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task. - Yun Tang 002; Hongyu Gong; Xian Li 003; Changhan Wang; Juan Miguel Pino; Holger Schwenk; Naman Goyal 001 (IWSLT, 2021)

Larger-Scale Transformers for Multilingual Masked Language Modeling. - Naman Goyal 001; Jingfei Du; Myle Ott; Giri Anantharaman; Alexis Conneau (RepL4NLP@ACL-IJCNLP, 2021)

Findings of the WMT 2021 Shared Task on Large-Scale Multilingual Machine Translation. - Guillaume Wenzek; Vishrav Chaudhary; Angela Fan; Sahir Gomez; Naman Goyal 001; Somya Jain; Douwe Kiela; Tristan Thrush; Francisco Guzmán (WMT@EMNLP, 2021)

Few-shot Learning with Multilingual Language Models. - Xi Victoria Lin; Todor Mihaylov; Mikel Artetxe; Tianlu Wang; Shuohui Chen; Daniel Simig; Myle Ott; Naman Goyal 001; Shruti Bhosale; Jingfei Du; Ramakanth Pasunuru; Sam Shleifer; et al. (CoRR, 2021)

Efficient Large Scale Language Modeling with Mixtures of Experts. - Mikel Artetxe; Shruti Bhosale; Naman Goyal 001; Todor Mihaylov; Myle Ott; Sam Shleifer; Xi Victoria Lin; Jingfei Du; Srinivasan Iyer 001; Ramakanth Pasunuru; Giri Anantharaman; Xian Li 003; et al. (CoRR, 2021)

Beyond English-Centric Multilingual Machine Translation. - Angela Fan; Shruti Bhosale; Holger Schwenk; Zhiyi Ma; Ahmed El-Kishky; Siddharth Goyal; Mandeep Baines; Onur Celebi; Guillaume Wenzek; Vishrav Chaudhary; Naman Goyal 001; Tom Birch; et al. (J. Mach. Learn. Res., 2021)

How Robust is Neural Machine Translation to Language Imbalance in Multilingual Tokenizer Training? - Shiyue Zhang 001; Vishrav Chaudhary; Naman Goyal 001; James Cross 003; Guillaume Wenzek; Mohit Bansal; Francisco Guzmán (AMTA, 2022)

Efficient Large Scale Language Modeling with Mixtures of Experts. - Mikel Artetxe; Shruti Bhosale; Naman Goyal 001; Todor Mihaylov; Myle Ott; Sam Shleifer; Xi Victoria Lin; Jingfei Du; Srinivasan Iyer 001; Ramakanth Pasunuru; Giridharan Anantharaman; Xian Li 003; et al. (EMNLP, 2022)

On the Role of Bidirectionality in Language Model Pre-Training. - Mikel Artetxe; Jingfei Du; Naman Goyal 001; Luke Zettlemoyer; Veselin Stoyanov (EMNLP (Findings), 2022)

Few-shot Learning with Multilingual Generative Language Models. - Xi Victoria Lin; Todor Mihaylov; Mikel Artetxe; Tianlu Wang; Shuohui Chen; Daniel Simig; Myle Ott; Naman Goyal 001; Shruti Bhosale; Jingfei Du; Ramakanth Pasunuru; Sam Shleifer; et al. (EMNLP, 2022)

XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale. - Arun Babu; Changhan Wang; Andros Tjandra; Kushal Lakhotia; Qiantong Xu; Naman Goyal 001; Kritika Singh; Patrick von Platen; Yatharth Saraf; Juan Pino 001; Alexei Baevski; Alexis Conneau; et al. (INTERSPEECH, 2022)

Lifting the Curse of Multilinguality by Pre-training Modular Transformers. - Jonas Pfeiffer; Naman Goyal 001; Xi Victoria Lin; Xian Li 003; James Cross 003; Sebastian Riedel 001; Mikel Artetxe (NAACL-HLT, 2022)

CM3: A Causal Masked Multimodal Model of the Internet. - Armen Aghajanyan; Bernie Huang; Candace Ross; Vladimir Karpukhin; Hu Xu 001; Naman Goyal 001; Dmytro Okhonko; Mandar Joshi; Gargi Ghosh; Mike Lewis; Luke Zettlemoyer (CoRR, 2022)

OPT: Open Pre-trained Transformer Language Models. - Susan Zhang; Stephen Roller; Naman Goyal 001; Mikel Artetxe; Moya Chen; Shuohui Chen; Christopher Dewan; Mona T. Diab; Xian Li 003; Xi Victoria Lin; Todor Mihaylov; Myle Ott; et al. (CoRR, 2022)

BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage. - Kurt Shuster 001; Jing Xu; Mojtaba Komeili; Da Ju; Eric Michael Smith; Stephen Roller; Megan Ung; Moya Chen; Kushal Arora; Joshua Lane; Morteza Behrooz; William Ngan; et al. (CoRR, 2022)

Multilingual Autoregressive Entity Linking. - Nicola De Cao; Ledell Wu; Kashyap Popat; Mikel Artetxe; Naman Goyal 001; Mikhail Plekhanov; Luke Zettlemoyer; Nicola Cancedda; Sebastian Riedel 001; Fabio Petroni (Trans. Assoc. Comput. Linguistics, 2022)

The Flores-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation. - Naman Goyal 001; Cynthia Gao; Vishrav Chaudhary; Peng-Jen Chen; Guillaume Wenzek; Da Ju; Sanjana Krishnan; Marc'Aurelio Ranzato; Francisco Guzmán; Angela Fan (Trans. Assoc. Comput. Linguistics, 2022)

XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models. - Davis Liang; Hila Gonen; Yuning Mao; Rui Hou; Naman Goyal 001; Marjan Ghazvininejad; Luke Zettlemoyer; Madian Khabsa (EMNLP, 2023)

Don't forget the nullspace! Nullspace occupancy as a mechanism for out of distribution failure. - Daksh Idnani; Vivek Madan; Naman Goyal 001; David J. Schwab; Ramakrishna Vedantam (ICLR, 2023)

Scaling Laws for Generative Mixed-Modal Language Models. - Armen Aghajanyan; Lili Yu; Alexis Conneau; Wei-Ning Hsu; Karen Hambardzumyan; Susan Zhang; Stephen Roller; Naman Goyal 001; Omer Levy; Luke Zettlemoyer (ICML, 2023)

Text-To-4D Dynamic Scene Generation. - Uriel Singer; Shelly Sheynin; Adam Polyak; Oron Ashual; Iurii Makarov; Filippos Kokkinos; Naman Goyal 001; Andrea Vedaldi; Devi Parikh; Justin Johnson 001; Yaniv Taigman (ICML, 2023)

LLaMA: Open and Efficient Foundation Language Models. - Hugo Touvron; Thibaut Lavril; Gautier Izacard; Xavier Martinet; Marie-Anne Lachaux; Timothée Lacroix; Baptiste Rozière; Naman Goyal 001; Eric Hambro; Faisal Azhar; Aurélien Rodriguez; Armand Joulin; et al. (CoRR, 2023)

A Theory on Adam Instability in Large-Scale Machine Learning. - Igor Molybog; Peter Albert; Moya Chen; Zachary DeVito; David Esiobu; Naman Goyal 001; Punit Singh Koura; Sharan Narang; Andrew Poulton; Ruan Silva; Binh Tang; Diana Liskovich; et al. (CoRR, 2023)

Llama 2: Open Foundation and Fine-Tuned Chat Models. - Hugo Touvron; Louis Martin; Kevin Stone; Peter Albert; Amjad Almahairi; Yasmine Babaei; Nikolay Bashlykov; Soumya Batra; Prajjwal Bhargava; Shruti Bhosale; Dan Bikel; Lukas Blecher; et al. (CoRR, 2023)

The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants. - Lucas Bandarkar; Davis Liang; Benjamin Muller; Mikel Artetxe; Satya Narayan Shukla; Donald Husa; Naman Goyal 001; Abhinandan Krishnan; Luke Zettlemoyer; Madian Khabsa (ACL (1), 2024)

Scaling Llama 3 Training with Efficient Parallelism Strategies. - Weiwei Chu; Xinfeng Xie; Jiecao Yu; Jie Wang 022; Amar Phanishayee; Chunqiang Tang; Yuchen Hao; Jianyu Huang; Mustafa Ozdal; Jun Wang; Vedanuj Goswami; Naman Goyal 001; et al. (ISCA, 2025)