Efficient Large Scale Language Modeling with Mixtures of Experts. - Mikel Artetxe; Shruti Bhosale; Naman Goyal 001; Todor Mihaylov; Myle Ott; Sam Shleifer; Xi Victoria Lin; Jingfei Du; Srinivasan Iyer 001; Ramakanth Pasunuru; Giri Anantharaman; Xian Li 003; et al. (CoRR, 2021)

Efficient Large Scale Language Modeling with Mixtures of Experts. - Mikel Artetxe; Shruti Bhosale; Naman Goyal 001; Todor Mihaylov; Myle Ott; Sam Shleifer; Xi Victoria Lin; Jingfei Du; Srinivasan Iyer 001; Ramakanth Pasunuru; Giridharan Anantharaman; Xian Li 003; et al. (EMNLP, 2022)