Zihang Dai

According to our database, Zihang Dai authored at least 31 papers between 2016 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2023

Combined scaling for zero-shot transfer learning.

Hieu Pham, Zihang Dai, Golnaz Ghiasi, Kenji Kawaguchi, Hanxiao Liu, Adams Wei Yu, Jiahui Yu, Yi-Ting Chen, Minh-Thang Luong, Yonghui Wu, Mingxing Tan, Quoc V. Le

Neurocomputing, October, 2023

2022

Transformer Quality in Linear Time.

Weizhe Hua, Zihang Dai, Hanxiao Liu, Quoc V. Le

Proceedings of the International Conference on Machine Learning, 2022

SimVLM: Simple Visual Language Model Pretraining with Weak Supervision.

Zirui Wang, Jiahui Yu, Adams Wei Yu, Zihang Dai, Yulia Tsvetkov, Yuan Cao

Proceedings of the Tenth International Conference on Learning Representations, 2022

2021

Combined Scaling for Zero-shot Transfer Learning.

Hieu Pham, Zihang Dai, Golnaz Ghiasi, Hanxiao Liu, Adams Wei Yu, Minh-Thang Luong, Mingxing Tan, Quoc V. Le

CoRR, 2021

Primer: Searching for Efficient Transformers for Language Modeling.

David R. So, Wojciech Manke, Hanxiao Liu, Zihang Dai, Noam Shazeer, Quoc V. Le

CoRR, 2021

Searching for Efficient Transformers for Language Modeling.

David R. So, Wojciech Manke, Hanxiao Liu, Zihang Dai, Noam Shazeer, Quoc V. Le

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Combiner: Full Attention Transformer with Sparse Computation Cost.

Hongyu Ren, Hanjun Dai, Zihang Dai, Mengjiao Yang, Jure Leskovec, Dale Schuurmans, Bo Dai

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Pay Attention to MLPs.

Hanxiao Liu, Zihang Dai, David R. So, Quoc V. Le

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

CoAtNet: Marrying Convolution and Attention for All Data Sizes.

Zihang Dai, Hanxiao Liu, Quoc V. Le, Mingxing Tan

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Meta Pseudo Labels.

Hieu Pham, Zihang Dai, Qizhe Xie, Quoc V. Le

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

2020

Unsupervised Parallel Corpus Mining on Web Data.

Guokun Lai, Zihang Dai, Yiming Yang

CoRR, 2020

Unsupervised Data Augmentation for Consistency Training.

Qizhe Xie, Zihang Dai, Eduard H. Hovy, Thang Luong, Quoc Le

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing.

Zihang Dai, Guokun Lai, Yiming Yang, Quoc Le

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Wiki-40B: Multilingual Language Model Dataset.

Mandy Guo, Zihang Dai, Denny Vrandecic, Rami Al-Rfou

Proceedings of The 12th Language Resources and Evaluation Conference, 2020

A Mutual Information Maximization Perspective of Language Representation Learning.

Lingpeng Kong, Cyprien de Masson d'Autume, Lei Yu, Wang Ling, Zihang Dai, Dani Yogatama

Proceedings of the 8th International Conference on Learning Representations, 2020

2019

Unsupervised Data Augmentation.

Qizhe Xie, Zihang Dai, Eduard H. Hovy, Minh-Thang Luong, Quoc V. Le

CoRR, 2019

XLNet: Generalized Autoregressive Pretraining for Language Understanding.

Zhilin Yang, Zihang Dai, Yiming Yang, Jaime G. Carbonell, Ruslan Salakhutdinov, Quoc V. Le

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Re-examination of the Role of Latent Variables in Sequence Modeling.

Guokun Lai, Zihang Dai, Yiming Yang, Shinjae Yoo

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Characterizing and Avoiding Negative Transfer.

Zirui Wang, Zihang Dai, Barnabás Póczos, Jaime G. Carbonell

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

Transformer-XL: Attentive Language Models beyond a Fixed-Length Context.

Zihang Dai, Zhilin Yang, Yiming Yang, Jaime G. Carbonell, Quoc Viet Le, Ruslan Salakhutdinov

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

Fast and Simple Mixture of Softmaxes with BPE and Hybrid-LightRNN for Language Generation.

Xiang Kong, Qizhe Xie, Zihang Dai, Eduard H. Hovy

Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019

2018

Breaking the Softmax Bottleneck: A High-Rank RNN Language Model.

Zhilin Yang, Zihang Dai, Ruslan Salakhutdinov, William W. Cohen

Proceedings of the 6th International Conference on Learning Representations, 2018

Large-scale Cloze Test Dataset Created by Teachers.

Qizhe Xie, Guokun Lai, Zihang Dai, Eduard H. Hovy

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

SwitchOut: an Efficient Data Augmentation Algorithm for Neural Machine Translation.

Xinyi Wang, Hieu Pham, Zihang Dai, Graham Neubig

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

From Credit Assignment to Entropy Regularization: Two New Algorithms for Neural Sequence Prediction.

Zihang Dai, Qizhe Xie, Eduard H. Hovy

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

Large-scale Cloze Test Dataset Designed by Teachers.

Qizhe Xie, Guokun Lai, Zihang Dai, Eduard H. Hovy

CoRR, 2017

Controllable Invariance through Adversarial Feature Learning.

Qizhe Xie, Zihang Dai, Yulun Du, Eduard H. Hovy, Graham Neubig

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Good Semi-supervised Learning That Requires a Bad GAN.

Zihang Dai, Zhilin Yang, Fan Yang, William W. Cohen, Ruslan Salakhutdinov

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Calibrating Energy-based Generative Adversarial Networks.

Zihang Dai, Amjad Almahairi, Philip Bachman, Eduard H. Hovy, Aaron C. Courville

Proceedings of the 5th International Conference on Learning Representations, 2017

An Interpretable Knowledge Transfer Model for Knowledge Base Completion.

Qizhe Xie, Xuezhe Ma, Zihang Dai, Eduard H. Hovy

Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, 2017

2016

CFO: Conditional Focused Neural Question Answering with Large-scale Knowledge Bases.

Zihang Dai, Lei Li, Wei Xu

Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, 2016