How Much Information Does a Human Translator Add to the Original? - Barret Zoph; Marjan Ghazvininejad; Kevin Knight (EMNLP, 2015)

Transfer Learning for Low-Resource Neural Machine Translation. - Barret Zoph; Deniz Yuret; Jonathan May; Kevin Knight (EMNLP, 2016)

Multi-Source Neural Translation. - Barret Zoph; Kevin Knight (HLT-NAACL, 2016)

Simple, Fast Noise-Contrastive Estimation for Large RNN Vocabularies. - Barret Zoph; Ashish Vaswani; Jonathan May; Kevin Knight (HLT-NAACL, 2016)

Neural Architecture Search with Reinforcement Learning. - Barret Zoph; Quoc V. Le (ICLR, 2017)

Neural Optimizer Search with Reinforcement Learning. - Irwan Bello; Barret Zoph; Vijay Vasudevan; Quoc V. Le (ICML, 2017)

Progressive Neural Architecture Search. - Chenxi Liu 001; Barret Zoph; Jonathon Shlens; Wei Hua; Li-Jia Li 001; Li Fei-Fei 001; Alan L. Yuille; Jonathan Huang; Kevin Murphy 002 (CoRR, 2017)

Learning Transferable Architectures for Scalable Image Recognition. - Barret Zoph; Vijay Vasudevan; Jonathon Shlens; Quoc V. Le (CVPR, 2018)

Progressive Neural Architecture Search. - Chenxi Liu 001; Barret Zoph; Maxim Neumann; Jonathon Shlens; Wei Hua; Li-Jia Li 001; Li Fei-Fei 001; Alan L. Yuille; Jonathan Huang; Kevin Murphy 002 (ECCV (1), 2018)

Intriguing Properties of Adversarial Examples. - Ekin Dogus Cubuk; Barret Zoph; Samuel S. Schoenholz; Quoc V. Le (ICLR (Workshop), 2018)

Faster Discovery of Neural Architectures by Searching for Paths in a Large Model. - Hieu Pham 001; Melody Y. Guan; Barret Zoph; Quoc V. Le; Jeff Dean (ICLR (Workshop), 2018)

Searching for Activation Functions. - Prajit Ramachandran; Barret Zoph; Quoc V. Le (ICLR (Workshop), 2018)

Understanding and Simplifying One-Shot Architecture Search. - Gabriel Bender; Pieter-Jan Kindermans; Barret Zoph; Vijay Vasudevan; Quoc V. Le (ICML, 2018)

Efficient Neural Architecture Search via Parameter Sharing. - Hieu Pham 001; Melody Y. Guan; Barret Zoph; Quoc V. Le; Jeff Dean (ICML, 2018)

Searching for Efficient Multi-Scale Architectures for Dense Image Prediction. - Liang-Chieh Chen; Maxwell D. Collins; Yukun Zhu; George Papandreou; Barret Zoph; Florian Schroff; Hartwig Adam; Jonathon Shlens (NeurIPS, 2018)

AutoAugment: Learning Augmentation Policies from Data. - Ekin Dogus Cubuk; Barret Zoph; Dandelion Mané; Vijay Vasudevan; Quoc V. Le (CoRR, 2018)

Backprop Evolution. - Maximilian Alber; Irwan Bello; Barret Zoph; Pieter-Jan Kindermans; Prajit Ramachandran; Quoc V. Le (CoRR, 2018)

AutoAugment: Learning Augmentation Strategies From Data. - Ekin D. Cubuk; Barret Zoph; Dandelion Mané; Vijay Vasudevan; Quoc V. Le (CVPR, 2019)

Attention Augmented Convolutional Networks. - Irwan Bello; Barret Zoph; Quoc Le 001; Ashish Vaswani; Jonathon Shlens (ICCV, 2019)

SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition. - Daniel S. Park; William Chan; Yu Zhang 033; Chung-Cheng Chiu; Barret Zoph; Ekin D. Cubuk; Quoc V. Le (INTERSPEECH, 2019)

RandAugment: Practical data augmentation with no separate search. - Ekin D. Cubuk; Barret Zoph; Jonathon Shlens; Quoc V. Le (CoRR, 2019)

Naive-Student: Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation. - Liang-Chieh Chen; Raphael Gontijo Lopes; Bowen Cheng; Maxwell D. Collins; Ekin D. Cubuk; Barret Zoph; Hartwig Adam; Jonathon Shlens (ECCV (9), 2020)

Improving 3D Object Detection Through Progressive Population Based Augmentation. - Shuyang Cheng; Zhaoqi Leng; Ekin Dogus Cubuk; Barret Zoph; Chunyan Bai; Jiquan Ngiam; Yang Song; Benjamin Caine; Vijay Vasudevan; Congcong Li; Quoc V. Le; Jonathon Shlens; et al. (ECCV (21), 2020)

Learning Data Augmentation Strategies for Object Detection. - Barret Zoph; Ekin D. Cubuk; Golnaz Ghiasi; Tsung-Yi Lin; Jonathon Shlens; Quoc V. Le (ECCV (27), 2020)

AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty. - Dan Hendrycks; Norman Mu; Ekin Dogus Cubuk; Barret Zoph; Justin Gilmer; Balaji Lakshminarayanan (ICLR, 2020)

RandAugment: Practical Automated Data Augmentation with a Reduced Search Space. - Ekin Dogus Cubuk; Barret Zoph; Jonathon Shlens; Quoc Le 001 (NeurIPS, 2020)

Rethinking Pre-training and Self-training. - Barret Zoph; Golnaz Ghiasi; Tsung-Yi Lin; Yin Cui; Hanxiao Liu; Ekin Dogus Cubuk; Quoc Le 001 (NeurIPS, 2020)

Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation. - Liang-Chieh Chen; Raphael Gontijo Lopes; Bowen Cheng; Maxwell D. Collins; Ekin D. Cubuk; Barret Zoph; Hartwig Adam; Jonathon Shlens (CoRR, 2020)

Does Data Augmentation Benefit from Split BatchNorms. - Amil Merchant; Barret Zoph; Ekin Dogus Cubuk (CoRR, 2020)

Simple Copy-Paste Is a Strong Data Augmentation Method for Instance Segmentation. - Golnaz Ghiasi; Yin Cui; Aravind Srinivas; Rui Qian; Tsung-Yi Lin; Ekin D. Cubuk; Quoc V. Le; Barret Zoph (CVPR, 2021)

Multi-Task Self-Training for Learning General Representations. - Golnaz Ghiasi; Barret Zoph; Ekin D. Cubuk; Quoc V. Le; Tsung-Yi Lin (ICCV, 2021)

Revisiting ResNets: Improved Training and Scaling Strategies. - Irwan Bello; William Fedus; Xianzhi Du; Ekin Dogus Cubuk; Aravind Srinivas; Tsung-Yi Lin; Jonathon Shlens; Barret Zoph (NeurIPS, 2021)

Simple Training Strategies and Model Scaling for Object Detection. - Xianzhi Du; Barret Zoph; Wei-Chih Hung; Tsung-Yi Lin (CoRR, 2021)

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts. - Nan Du 002; Yanping Huang; Andrew M. Dai; Simon Tong; Dmitry Lepikhin; Yuanzhong Xu; Maxim Krikun; Yanqi Zhou; Adams Wei Yu; Orhan Firat; Barret Zoph; Liam Fedus; et al. (ICML, 2022)

Designing Effective Sparse Expert Models. - Barret Zoph (IPDPS Workshops, 2022)

Designing Effective Sparse Expert Models. - Barret Zoph; Irwan Bello; Sameer Kumar; Nan Du 002; Yanping Huang; Jeff Dean; Noam Shazeer; William Fedus (CoRR, 2022)

A Review of Sparse Expert Models in Deep Learning. - William Fedus; Jeff Dean; Barret Zoph (CoRR, 2022)

Scaling Instruction-Finetuned Language Models. - Hyung Won Chung; Le Hou; Shayne Longpre; Barret Zoph; Yi Tay; William Fedus; Eric Li; Xuezhi Wang 002; Mostafa Dehghani 001; Siddhartha Brahma; Albert Webson; Shixiang Shane Gu; et al. (CoRR, 2022)

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity. - William Fedus; Barret Zoph; Noam Shazeer (J. Mach. Learn. Res., 2022)

Emergent Abilities of Large Language Models. - Jason Wei; Yi Tay; Rishi Bommasani; Colin Raffel; Barret Zoph; Sebastian Borgeaud; Dani Yogatama; Maarten Bosma; Denny Zhou; Donald Metzler; Ed H. Chi; Tatsunori Hashimoto; et al. (Trans. Mach. Learn. Res., 2022)

The Flan Collection: Designing Data and Methods for Effective Instruction Tuning. - Shayne Longpre; Le Hou; Tu Vu; Albert Webson; Hyung Won Chung; Yi Tay; Denny Zhou; Quoc V. Le; Barret Zoph; Jason Wei; Adam Roberts (ICML, 2023)

Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts. - Sheng Shen 001; Le Hou; Yanqi Zhou; Nan Du 002; Shayne Longpre; Jason Wei; Hyung Won Chung; Barret Zoph; William Fedus; Xinyun Chen; Tu Vu; Yuexin Wu; et al. (CoRR, 2023)

PaLM: Scaling Language Modeling with Pathways. - Aakanksha Chowdhery; Sharan Narang; Jacob Devlin; Maarten Bosma; Gaurav Mishra; Adam Roberts; Paul Barham 001; Hyung Won Chung; Charles Sutton; Sebastian Gehrmann; Parker Schuh; Kensen Shi; et al. (J. Mach. Learn. Res., 2023)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. - Aarohi Srivastava; Abhinav Rastogi; Abhishek Rao; Abu Awal Md Shoeb; Abubakar Abid; Adam Fisch; Adam R. Brown; Adam Santoro; Aditya Gupta; Adrià Garriga-Alonso; Agnieszka Kluska; Aitor Lewkowycz; et al. (Trans. Mach. Learn. Res., 2023)

Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models. - Sheng Shen 001; Le Hou; Yanqi Zhou; Nan Du 002; Shayne Longpre; Jason Wei; Hyung Won Chung; Barret Zoph; William Fedus; Xinyun Chen; Tu Vu; Yuexin Wu; et al. (ICLR, 2024)

A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity. - Shayne Longpre; Gregory Yauney; Emily Reif; Katherine Lee; Adam Roberts; Barret Zoph; Denny Zhou; Jason Wei; Kevin Robinson; David Mimno; Daphne Ippolito (NAACL-HLT, 2024)

GPT-4o System Card. - Aaron Hurst; Adam Lerer; Adam P. Goucher; Adam Perelman; Aditya Ramesh; Aidan Clark; AJ Ostrow; Akila Welihinda; Alan Hayes; Alec Radford; Aleksander Madry; Alex Baker-Whitcomb; et al. (CoRR, 2024)

OpenAI o1 System Card. - Aaron Jaech; Adam Kalai; Adam Lerer; Adam Richardson; Ahmed El-Kishky; Aiden Low; Alec Helyar; Aleksander Madry; Alex Beutel; Alex Carney; Alex Iftimie; Alex Karpenko; et al. (CoRR, 2024)

Scaling Instruction-Finetuned Language Models. - Hyung Won Chung; Le Hou; Shayne Longpre; Barret Zoph; Yi Tay; William Fedus; Yunxuan Li; Xuezhi Wang 002; Mostafa Dehghani 001; Siddhartha Brahma; Albert Webson; Shixiang Shane Gu; et al. (J. Mach. Learn. Res., 2024)