Dara Bahri

According to our database, Dara Bahri authored at least 34 papers between 2018 and 2023.

Collaborative distances:

• Dijkstra number of three.
• Erdős number of four.

2023

Efficient Transformers: A Survey.

Yi Tay, Mostafa Dehghani, Dara Bahri, Donald Metzler

ACM Comput. Surv., 2023

Surprise: Result List Truncation via Extreme Value Theory.

Dara Bahri, Che Zheng, Yi Tay, Donald Metzler, Andrew Tomkins

Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2023

Sharpness-Aware Minimization Leads to Low-Rank Features.

Maksym Andriushchenko, Dara Bahri, Hossein Mobahi, Nicolas Flammarion

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

UL2: Unifying Language Learning Paradigms.

Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Jason Wei, Xuezhi Wang, Hyung Won Chung, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Denny Zhou, Neil Houlsby, Donald Metzler

Proceedings of the Eleventh International Conference on Learning Representations, 2023

2022

Is margin all you need? An extensive empirical study of active learning on tabular data.

Dara Bahri, Heinrich Jiang, Tal Schuster, Afshin Rostamizadeh

CoRR, 2022

Confident Adaptive Language Modeling.

Tal Schuster, Adam Fisch, Jai Prakash Gupta, Mostafa Dehghani, Dara Bahri, Vinh Q. Tran, Yi Tay, Donald Metzler

CoRR, 2022

Unifying Language Learning Paradigms.

Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Neil Houlsby, Donald Metzler

CoRR, 2022

Transformer Memory as a Differentiable Search Index.

Yi Tay, Vinh Tran, Mostafa Dehghani, Jianmo Ni, Dara Bahri, Harsh Mehta, Zhen Qin, Kai Hui, Zhe Zhao, Jai Prakash Gupta, Tal Schuster, William W. Cohen, Donald Metzler

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Confident Adaptive Language Modeling.

Tal Schuster, Adam Fisch, Jai Gupta, Mostafa Dehghani, Dara Bahri, Vinh Tran, Yi Tay, Donald Metzler

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Charformer: Fast Character Transformers via Gradient-based Subword Tokenization.

Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Prakash Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler

Proceedings of the Tenth International Conference on Learning Representations, 2022

Churn Reduction via Distillation.

Heinrich Jiang, Harikrishna Narasimhan, Dara Bahri, Andrew Cotter, Afshin Rostamizadeh

Proceedings of the Tenth International Conference on Learning Representations, 2022

Scarf: Self-Supervised Contrastive Learning using Random Feature Corruption.

Dara Bahri, Heinrich Jiang, Yi Tay, Donald Metzler

Proceedings of the Tenth International Conference on Learning Representations, 2022

ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning.

Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q. Tran, Dara Bahri, Jianmo Ni, Jai Prakash Gupta, Kai Hui, Sebastian Ruder, Donald Metzler

Proceedings of the Tenth International Conference on Learning Representations, 2022

Sharpness-Aware Minimization Improves Language Model Generalization.

Dara Bahri, Hossein Mobahi, Yi Tay

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference.

Kai Hui, Honglei Zhuang, Tao Chen, Zhen Qin, Jing Lu, Dara Bahri, Ji Ma, Jai Prakash Gupta, Cícero Nogueira dos Santos, Yi Tay, Donald Metzler

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022

2021

Rethinking search: making domain experts out of dilettantes.

Donald Metzler, Yi Tay, Dara Bahri, Marc Najork

SIGIR Forum, 2021

Are Pre-trained Convolutions Better than Pre-trained Transformers?

Yi Tay, Mostafa Dehghani, Jai Prakash Gupta, Dara Bahri, Vamsi Aribandi, Zhen Qin, Donald Metzler

CoRR, 2021

Rethinking Search: Making Experts out of Dilettantes.

Donald Metzler, Yi Tay, Dara Bahri, Marc Najork

CoRR, 2021

Locally Adaptive Label Smoothing for Predictive Churn.

Dara Bahri, Heinrich Jiang

CoRR, 2021

Label Smoothed Embedding Hypothesis for Out-of-Distribution Detection.

Dara Bahri, Heinrich Jiang, Yi Tay, Donald Metzler

CoRR, 2021

Generative Models are Unsupervised Predictors of Page Quality: A Colossal-Scale Study.

Dara Bahri, Yi Tay, Che Zheng, Cliff Brunk, Donald Metzler, Andrew Tomkins

Proceedings of the WSDM '21, 2021

Synthesizer: Rethinking Self-Attention for Transformer Models.

Yi Tay, Dara Bahri, Donald Metzler, Da-Cheng Juan, Zhe Zhao, Che Zheng

Proceedings of the 38th International Conference on Machine Learning, 2021

OmniNet: Omnidirectional Representations from Transformers.

Yi Tay, Mostafa Dehghani, Vamsi Aribandi, Jai Prakash Gupta, Philip Pham, Zhen Qin, Dara Bahri, Da-Cheng Juan, Donald Metzler

Proceedings of the 38th International Conference on Machine Learning, 2021

Locally Adaptive Label Smoothing Improves Predictive Churn.

Dara Bahri, Heinrich Jiang

Proceedings of the 38th International Conference on Machine Learning, 2021

HyperGrid Transformers: Towards A Single Model for Multiple Tasks.

Yi Tay, Zhe Zhao, Dara Bahri, Donald Metzler, Da-Cheng Juan

Proceedings of the 9th International Conference on Learning Representations, 2021

Long Range Arena : A Benchmark for Efficient Transformers.

Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler

Proceedings of the 9th International Conference on Learning Representations, 2021

Are Pretrained Convolutions Better than Pretrained Transformers?

Yi Tay, Mostafa Dehghani, Jai Prakash Gupta, Vamsi Aribandi, Dara Bahri, Zhen Qin, Donald Metzler

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling.

Yikang Shen, Yi Tay, Che Zheng, Dara Bahri, Donald Metzler, Aaron C. Courville

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

HyperGrid: Efficient Multi-Task Transformers with Grid-wise Decomposable Hyper Projections.

Yi Tay, Zhe Zhao, Dara Bahri, Donald Metzler, Da-Cheng Juan

CoRR, 2020

Choppy: Cut Transformer for Ranked List Truncation.

Dara Bahri, Yi Tay, Che Zheng, Donald Metzler, Andrew Tomkins

Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, 2020

Sparse Sinkhorn Attention.

Yi Tay, Dara Bahri, Liu Yang, Donald Metzler, Da-Cheng Juan

Proceedings of the 37th International Conference on Machine Learning, 2020

Deep k-NN for Noisy Labels.

Dara Bahri, Heinrich Jiang, Maya R. Gupta

Proceedings of the 37th International Conference on Machine Learning, 2020

Reverse Engineering Configurations of Neural Text Generation Models.

Yi Tay, Dara Bahri, Che Zheng, Clifford Brunk, Donald Metzler, Andrew Tomkins

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2018

Diminishing Returns Shape Constraints for Interpretability and Regularization.

Maya R. Gupta, Dara Bahri, Andrew Cotter, Kevin Robert Canini

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018