A very large diversity space of synthetically accessible compounds for use with drug design programs. - Sergey Nikitin; Natalia Zaitseva; Olga Demina; Vera Solovieva; Evgeny Mazin; Sergey Mikhalev; Maxim Smolov; Anatoliy Rubinov; Peter Vlasov; Dmitry Lepikhin; Denis Khachko; Valery Fokin; et al. (J. Comput. Aided Mol. Des., 2005)

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling. - Jonathan Shen; Patrick Nguyen; Yonghui Wu; Zhifeng Chen; Mia Xu Chen; Ye Jia; Anjuli Kannan; Tara N. Sainath; Yuan Cao 007; Chung-Cheng Chiu; Yanzhang He; Jan Chorowski; et al. (CoRR, 2019)

Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges. - Naveen Arivazhagan; Ankur Bapna; Orhan Firat; Dmitry Lepikhin; Melvin Johnson; Maxim Krikun; Mia Xu Chen; Yuan Cao 007; George F. Foster; Colin Cherry; Wolfgang Macherey; Zhifeng Chen; et al. (CoRR, 2019)

Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference. - Sneha Kudugunta; Yanping Huang; Ankur Bapna; Maxim Krikun; Dmitry Lepikhin; Minh-Thang Luong; Orhan Firat (EMNLP (Findings), 2021)

GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding. - Dmitry Lepikhin; HyoukJoong Lee; Yuanzhong Xu; Dehao Chen; Orhan Firat; Yanping Huang; Maxim Krikun; Noam Shazeer; Zhifeng Chen (ICLR, 2021)

GSPMD: General and Scalable Parallelization for ML Computation Graphs. - Yuanzhong Xu; HyoukJoong Lee; Dehao Chen; Blake A. Hechtman; Yanping Huang; Rahul Joshi; Maxim Krikun; Dmitry Lepikhin; Andy Ly; Marcello Maggioni; Ruoming Pang; Noam Shazeer; et al. (CoRR, 2021)

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts. - Nan Du 002; Yanping Huang; Andrew M. Dai; Simon Tong; Dmitry Lepikhin; Yuanzhong Xu; Maxim Krikun; Yanqi Zhou; Adams Wei Yu; Orhan Firat; Barret Zoph; Liam Fedus; et al. (ICML, 2022)

LaMDA: Language Models for Dialog Applications. - Romal Thoppilan; Daniel De Freitas; Jamie Hall; Noam Shazeer; Apoorv Kulshreshtha; Heng-Tze Cheng; Alicia Jin; Taylor Bos; Leslie Baker; Yu Du; YaGuang Li; Hongrae Lee; et al. (CoRR, 2022)

PaLM 2 Technical Report. - Rohan Anil; Andrew M. Dai; Orhan Firat; Melvin Johnson; Dmitry Lepikhin; Alexandre Passos; Siamak Shakeri; Emanuel Taropa; Paige Bailey; Zhifeng Chen; Eric Chu; Jonathan H. Clark; et al. (CoRR, 2023)

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. - Machel Reid; Nikolay Savinov; Denis Teplyashin; Dmitry Lepikhin; Timothy P. Lillicrap; Jean-Baptiste Alayrac; Radu Soricut; Angeliki Lazaridou; Orhan Firat; Julian Schrittwieser; Ioannis Antonoglou; Rohan Anil; et al. (CoRR, 2024)

MedGemma Technical Report. - Andrew Sellergren; Sahar Kazemzadeh; Tiam Jaroensri; Atilla P. Kiraly; Madeleine Traverse; Timo Kohlberger; Shawn Xu; Fayaz Jamil; Cían Hughes; Charles Lau; Justin Chen; Fereshteh Mahvar; et al. (CoRR, 2025)