Tensor2Tensor for Neural Machine Translation. - Ashish Vaswani; Samy Bengio; Eugene Brevdo; François Chollet; Aidan N. Gomez; Stephan Gouws; Llion Jones; Lukasz Kaiser; Nal Kalchbrenner; Niki Parmar; Ryan Sepassi; Noam Shazeer; et al. (AMTA (1), 2018)

Generating Wikipedia by Summarizing Long Sequences. - Peter J. Liu; Mohammad Saleh; Etienne Pot; Ben Goodrich; Ryan Sepassi; Lukasz Kaiser; Noam Shazeer (ICLR (Poster), 2018)

Mesh-TensorFlow: Deep Learning for Supercomputers. - Noam Shazeer; Youlong Cheng; Niki Parmar; Dustin Tran; Ashish Vaswani; Penporn Koanantakool; Peter Hawkins; HyoukJoong Lee; Mingsheng Hong; Cliff Young; Ryan Sepassi; Blake A. Hechtman (NeurIPS, 2018)

Model-Based Reinforcement Learning for Atari. - Lukasz Kaiser; Mohammad Babaeizadeh; Piotr Milos; Blazej Osinski; Roy H. Campbell; Konrad Czechowski; Dumitru Erhan; Chelsea Finn; Piotr Kozakowski; Sergey Levine; Ryan Sepassi; George Tucker; et al. (CoRR, 2019)

Model Based Reinforcement Learning for Atari. - Lukasz Kaiser; Mohammad Babaeizadeh; Piotr Milos; Blazej Osinski; Roy H. Campbell; Konrad Czechowski; Dumitru Erhan; Chelsea Finn; Piotr Kozakowski; Sergey Levine; Afroz Mohiuddin; Ryan Sepassi; et al. (ICLR, 2020)

Pathways: Asynchronous Distributed Dataflow for ML. - Paul Barham 001; Aakanksha Chowdhery; Jeff Dean; Sanjay Ghemawat; Steven Hand 001; Dan Hurt; Michael Isard; Hyeontaek Lim; Ruoming Pang; Sudip Roy 002; Brennan Saeta; Parker Schuh; et al. (MLSys, 2022)

Scaling Up Models and Data with t5x and seqio. - Adam Roberts; Hyung Won Chung; Anselm Levskaya; Gaurav Mishra; James Bradbury; Daniel Andor; Sharan Narang; Brian Lester; Colin Gaffney; Afroz Mohiuddin; Curtis Hawthorne; Aitor Lewkowycz; et al. (CoRR, 2022)

PaLM: Scaling Language Modeling with Pathways. - Aakanksha Chowdhery; Sharan Narang; Jacob Devlin; Maarten Bosma; Gaurav Mishra; Adam Roberts; Paul Barham 001; Hyung Won Chung; Charles Sutton; Sebastian Gehrmann; Parker Schuh; Kensen Shi; et al. (J. Mach. Learn. Res., 2023)

Scaling Up Models and Data with t5x and seqio. - Adam Roberts; Hyung Won Chung; Gaurav Mishra; Anselm Levskaya; James Bradbury; Daniel Andor; Sharan Narang; Brian Lester; Colin Gaffney; Afroz Mohiuddin; Curtis Hawthorne; Aitor Lewkowycz; et al. (J. Mach. Learn. Res., 2023)