Barret Zoph

According to our database, Barret Zoph authored at least 44 papers between 2015 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2023

PaLM: Scaling Language Modeling with Pathways.

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel

J. Mach. Learn. Res., 2023

Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts.

Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Longpre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vincent Y. Zhao, Hongkun Yu, Kurt Keutzer, Trevor Darrell, Denny Zhou

CoRR, 2023

A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity.

Shayne Longpre, Gregory Yauney, Emily Reif, Katherine Lee, Adam Roberts, Barret Zoph, Denny Zhou, Jason Wei, Kevin Robinson, David Mimno, Daphne Ippolito

CoRR, 2023

The Flan Collection: Designing Data and Methods for Effective Instruction Tuning.

Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V. Le, Barret Zoph, Jason Wei, Adam Roberts

Proceedings of the International Conference on Machine Learning, 2023

2022

Emergent Abilities of Large Language Models.

Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, William Fedus

Trans. Mach. Learn. Res., 2022

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity.

William Fedus, Barret Zoph, Noam Shazeer

J. Mach. Learn. Res., 2022

Scaling Instruction-Finetuned Language Models.

Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei

CoRR, 2022

A Review of Sparse Expert Models in Deep Learning.

William Fedus, Jeff Dean, Barret Zoph

CoRR, 2022

Designing Effective Sparse Expert Models.

Barret Zoph, Irwan Bello, Sameer Kumar, Nan Du, Yanping Huang, Jeff Dean, Noam Shazeer, William Fedus

CoRR, 2022

Designing Effective Sparse Expert Models.

Barret Zoph

Proceedings of the IEEE International Parallel and Distributed Processing Symposium, 2022

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts.

Nan Du, Yanping Huang, Andrew M. Dai, Simon Tong, Dmitry Lepikhin, Yuanzhong Xu, Maxim Krikun, Yanqi Zhou, Adams Wei Yu, Orhan Firat, Barret Zoph, Liam Fedus, Maarten P. Bosma, Zongwei Zhou, Tao Wang, Yu Emma Wang, Kellie Webster, Marie Pellat, Kevin Robinson, Kathleen S. Meier-Hellstern, Toju Duke, Lucas Dixon, Kun Zhang, Quoc V. Le, Yonghui Wu, Zhifeng Chen, Claire Cui

Proceedings of the International Conference on Machine Learning, 2022

2021

Simple Training Strategies and Model Scaling for Object Detection.

Xianzhi Du, Barret Zoph, Wei-Chih Hung, Tsung-Yi Lin

CoRR, 2021

Revisiting ResNets: Improved Training and Scaling Strategies.

Irwan Bello, William Fedus, Xianzhi Du, Ekin Dogus Cubuk, Aravind Srinivas, Tsung-Yi Lin, Jonathon Shlens, Barret Zoph

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Multi-Task Self-Training for Learning General Representations.

Golnaz Ghiasi, Barret Zoph, Ekin D. Cubuk, Quoc V. Le, Tsung-Yi Lin

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

Simple Copy-Paste Is a Strong Data Augmentation Method for Instance Segmentation.

Golnaz Ghiasi, Yin Cui, Aravind Srinivas, Rui Qian, Tsung-Yi Lin, Ekin D. Cubuk, Quoc V. Le, Barret Zoph

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

2020

Does Data Augmentation Benefit from Split BatchNorms.

Amil Merchant, Barret Zoph, Ekin Dogus Cubuk

CoRR, 2020

Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation.

Liang-Chieh Chen, Raphael Gontijo Lopes, Bowen Cheng, Maxwell D. Collins, Ekin D. Cubuk, Barret Zoph, Hartwig Adam, Jonathon Shlens

CoRR, 2020

Rethinking Pre-training and Self-training.

Barret Zoph, Golnaz Ghiasi, Tsung-Yi Lin, Yin Cui, Hanxiao Liu, Ekin Dogus Cubuk, Quoc Le

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty.

Dan Hendrycks, Norman Mu, Ekin Dogus Cubuk, Barret Zoph, Justin Gilmer, Balaji Lakshminarayanan

Proceedings of the 8th International Conference on Learning Representations, 2020

Learning Data Augmentation Strategies for Object Detection.

Barret Zoph, Ekin D. Cubuk, Golnaz Ghiasi, Tsung-Yi Lin, Jonathon Shlens, Quoc V. Le

Proceedings of the Computer Vision - ECCV 2020, 2020

Improving 3D Object Detection Through Progressive Population Based Augmentation.

Shuyang Cheng, Zhaoqi Leng, Ekin Dogus Cubuk, Barret Zoph, Chunyan Bai, Jiquan Ngiam, Yang Song, Benjamin Caine, Vijay Vasudevan, Congcong Li, Quoc V. Le, Jonathon Shlens, Dragomir Anguelov

Proceedings of the Computer Vision - ECCV 2020, 2020

Naive-Student: Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation.

Liang-Chieh Chen, Raphael Gontijo Lopes, Bowen Cheng, Maxwell D. Collins, Ekin D. Cubuk, Barret Zoph, Hartwig Adam, Jonathon Shlens

Proceedings of the Computer Vision - ECCV 2020, 2020

Randaugment: Practical automated data augmentation with a reduced search space.

Ekin D. Cubuk, Barret Zoph, Jonathon Shlens, Quoc V. Le

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

2019

RandAugment: Practical data augmentation with no separate search.

Ekin D. Cubuk, Barret Zoph, Jonathon Shlens, Quoc V. Le

CoRR, 2019

SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition.

Daniel S. Park, William Chan, Yu Zhang, Chung-Cheng Chiu, Barret Zoph, Ekin D. Cubuk, Quoc V. Le

Proceedings of the Interspeech 2019, 2019

Attention Augmented Convolutional Networks.

Irwan Bello, Barret Zoph, Quoc Le, Ashish Vaswani, Jonathon Shlens

Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, 2019

AutoAugment: Learning Augmentation Strategies From Data.

Ekin D. Cubuk, Barret Zoph, Dandelion Mané, Vijay Vasudevan, Quoc V. Le

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

2018

Backprop Evolution.

Maximilian Alber, Irwan Bello, Barret Zoph, Pieter-Jan Kindermans, Prajit Ramachandran, Quoc V. Le

CoRR, 2018

AutoAugment: Learning Augmentation Policies from Data.

Ekin Dogus Cubuk, Barret Zoph, Dandelion Mané, Vijay Vasudevan, Quoc V. Le

CoRR, 2018

Searching for Efficient Multi-Scale Architectures for Dense Image Prediction.

Liang-Chieh Chen, Maxwell D. Collins, Yukun Zhu, George Papandreou, Barret Zoph, Florian Schroff, Hartwig Adam, Jonathon Shlens

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Efficient Neural Architecture Search via Parameter Sharing.

Hieu Pham, Melody Y. Guan, Barret Zoph, Quoc V. Le, Jeff Dean

Proceedings of the 35th International Conference on Machine Learning, 2018

Understanding and Simplifying One-Shot Architecture Search.

Gabriel Bender, Pieter-Jan Kindermans, Barret Zoph, Vijay Vasudevan, Quoc V. Le

Proceedings of the 35th International Conference on Machine Learning, 2018

Searching for Activation Functions.

Prajit Ramachandran, Barret Zoph, Quoc V. Le

Proceedings of the 6th International Conference on Learning Representations, 2018

Faster Discovery of Neural Architectures by Searching for Paths in a Large Model.

Hieu Pham, Melody Y. Guan, Barret Zoph, Quoc V. Le, Jeff Dean

Proceedings of the 6th International Conference on Learning Representations, 2018

Intriguing Properties of Adversarial Examples.

Ekin Dogus Cubuk, Barret Zoph, Samuel S. Schoenholz, Quoc V. Le

Proceedings of the 6th International Conference on Learning Representations, 2018

Progressive Neural Architecture Search.

Chenxi Liu, Barret Zoph, Maxim Neumann, Jonathon Shlens, Wei Hua, Li-Jia Li, Li Fei-Fei, Alan L. Yuille, Jonathan Huang, Kevin Murphy

Proceedings of the Computer Vision - ECCV 2018, 2018

Learning Transferable Architectures for Scalable Image Recognition.

Barret Zoph, Vijay Vasudevan, Jonathon Shlens, Quoc V. Le

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

2017

Progressive Neural Architecture Search.

Chenxi Liu, Barret Zoph, Jonathon Shlens, Wei Hua, Li-Jia Li, Li Fei-Fei, Alan L. Yuille, Jonathan Huang, Kevin Murphy

CoRR, 2017

Neural Optimizer Search with Reinforcement Learning.

Irwan Bello, Barret Zoph, Vijay Vasudevan, Quoc V. Le

Proceedings of the 34th International Conference on Machine Learning, 2017

Neural Architecture Search with Reinforcement Learning.

Barret Zoph, Quoc V. Le

Proceedings of the 5th International Conference on Learning Representations, 2017

2016

Simple, Fast Noise-Contrastive Estimation for Large RNN Vocabularies.

Barret Zoph, Ashish Vaswani, Jonathan May, Kevin Knight

Proceedings of the NAACL HLT 2016, 2016

Multi-Source Neural Translation.

Barret Zoph, Kevin Knight

Proceedings of the NAACL HLT 2016, 2016

Transfer Learning for Low-Resource Neural Machine Translation.

Barret Zoph, Deniz Yuret, Jonathan May, Kevin Knight

Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016

2015

How Much Information Does a Human Translator Add to the Original?

Barret Zoph, Marjan Ghazvininejad, Kevin Knight

Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015