Beyond English-Centric Multilingual Machine Translation. - Angela Fan; Shruti Bhosale; Holger Schwenk; Zhiyi Ma; Ahmed El-Kishky; Siddharth Goyal; Mandeep Baines; Onur Celebi; Guillaume Wenzek; Vishrav Chaudhary; Naman Goyal 001; Tom Birch; et al. (CoRR, 2020)

Efficient Large Scale Language Modeling with Mixtures of Experts. - Mikel Artetxe; Shruti Bhosale; Naman Goyal 001; Todor Mihaylov; Myle Ott; Sam Shleifer; Xi Victoria Lin; Jingfei Du; Srinivasan Iyer 001; Ramakanth Pasunuru; Giri Anantharaman; Xian Li 003; et al. (CoRR, 2021)

Beyond English-Centric Multilingual Machine Translation. - Angela Fan; Shruti Bhosale; Holger Schwenk; Zhiyi Ma; Ahmed El-Kishky; Siddharth Goyal; Mandeep Baines; Onur Celebi; Guillaume Wenzek; Vishrav Chaudhary; Naman Goyal 001; Tom Birch; et al. (J. Mach. Learn. Res., 2021)

Efficient Large Scale Language Modeling with Mixtures of Experts. - Mikel Artetxe; Shruti Bhosale; Naman Goyal 001; Todor Mihaylov; Myle Ott; Sam Shleifer; Xi Victoria Lin; Jingfei Du; Srinivasan Iyer 001; Ramakanth Pasunuru; Giridharan Anantharaman; Xian Li 003; et al. (EMNLP, 2022)

Unity: Accelerating DNN Training Through Joint Optimization of Algebraic Transformations and Parallelization. - Colin Unger; Zhihao Jia; Wei Wu 016; Sina Lin; Mandeep Baines; Carlos Efrain Quintero Narvaez; Vinay Ramakrishnaiah; Nirmal Prajapati; Patrick S. McCormick; Jamaludin Mohd-Yusof; Xi Luo; Dheevatsa Mudigere; et al. (OSDI, 2022)