Tao Lei

According to our database, Tao Lei authored at least 46 papers between 2012 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2026

Parallel Track Transformers: Enabling Fast GPU Inference with Reduced Synchronization.

Chong Wang, Nan Du, Tom Gunter, Tao Lei, Kulin Seth, Senyu Tong, Jianyu Wang, Guoli Yin, Xiyou Zhou, Kelvin Zou, Ruoming Pang

CoRR, February, 2026

SPLA: Block Sparse Plus Linear Attention for Long Context Modeling.

Bailin Wang, Dan Friedman, Tao Lei, Chong Wang

CoRR, January, 2026

2025

AXLearn: Modular Large Model Training on Heterogeneous Infrastructure.

Mark Lee, Tom Gunter, Chang Lan, John Peebles, Hanzhi Zhou, Kelvin Zou, Sneha Bangalore, Chung-Cheng Chiu, Nan Du, Xianzhi Du, Philipp Dufter, Ruixuan Hou, Haoshuo Huang, Dongseong Hwang, Xiang Kong, Jinhao Lei, Tao Lei, Meng Li, Li Li, Jiarui Lu, Zhiyun Lu, Yiping Ma, David Qiu, Vivek Rathod, Senyu Tong, Zhucheng Tu, Jianyu Wang, Yongqiang Wang, Zirui Wang, Floris Weers, Sam Wiseman, Guoli Yin, Bowen Zhang, Xiyou Zhou, Danyang Zhuo, Cheng Leong, Ruoming Pang

CoRR, July, 2025

IDEA Prune: An Integrated Enlarge-and-Prune Pipeline in Generative Language Model Pretraining.

Yixiao Li, Xianzhi Du, Ajay Jaiswal, Tao Lei, Tuo Zhao, Chong Wang, Jianyu Wang

CoRR, March, 2025

Instruction-Following Pruning for Large Language Models.

Bairu Hou, Qibin Chen, Jianyu Wang, Guoli Yin, Chong Wang, Nan Du, Ruoming Pang, Shiyu Chang, Tao Lei

Proceedings of the Forty-second International Conference on Machine Learning, 2025

EC-DIT: Scaling Diffusion Transformers with Adaptive Expert-Choice Routing.

Haotian Sun, Tao Lei, Bowen Zhang, Yanghao Li, Haoshuo Huang, Ruoming Pang, Bo Dai, Nan Du

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training.

Brandon McKinzie, Zhe Gan, Jean-Philippe Fauconnier, Sam Dodge, Bowen Zhang, Philipp Dufter, Dhruti Shah, Xianzhi Du, Futang Peng, Floris Weers, Anton Belyi, Haotian Zhang, Karanjeet Singh, Doug Kang, Ankur Jain, Hongyu Hè, Max Schwarzer, Tom Gunter, Xiang Kong, Aonan Zhang, Jianyu Wang, Chong Wang, Nan Du, Tao Lei, Sam Wiseman, Guoli Yin, Mark Lee, Zirui Wang, Ruoming Pang, Peter Grasch, Alexander Toshev, Yinfei Yang

CoRR, 2024

MM1: Methods, Analysis and Insights from Multimodal LLM Pre-training.

Brandon McKinzie, Zhe Gan, Jean-Philippe Fauconnier, Sam Dodge, Bowen Zhang, Philipp Dufter, Dhruti Shah, Xianzhi Du, Futang Peng, Anton Belyi, Haotian Zhang, Karanjeet Singh, Doug Kang, Hongyu Hè, Max Schwarzer, Tom Gunter, Xiang Kong, Aonan Zhang, Jianyu Wang, Chong Wang, Nan Du, Tao Lei, Sam Wiseman, Mark Lee, Zirui Wang, Ruoming Pang, Peter Grasch, Alexander Toshev, Yinfei Yang

Proceedings of the Computer Vision - ECCV 2024, 2024

2023

Learning to Skip for Language Modeling.

Dewen Zeng, Nan Du, Tao Wang, Yuanzhong Xu, Tao Lei, Zhifeng Chen, Claire Cui

CoRR, 2023

Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference.

Tao Lei, Junwen Bai, Siddhartha Brahma, Joshua Ainslie, Kenton Lee, Yanqi Zhou, Nan Du, Vincent Y. Zhao, Yuexin Wu, Bo Li, Yu Zhang, Ming-Wei Chang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Rethinking the Role of Token Retrieval in Multi-Vector Retrieval.

Jinhyuk Lee, Zhuyun Dai, Sai Meher Karthik Duddu, Tao Lei, Iftekhar Naim, Ming-Wei Chang, Vincent Y. Zhao

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

CoLT5: Faster Long-Range Transformers with Conditional Computation.

Joshua Ainslie, Tao Lei, Michiel de Jong, Santiago Ontañón, Siddhartha Brahma, Yury Zemlyanskiy, David C. Uthus, Mandy Guo, James Lee-Thorp, Yi Tay, Yun-Hsuan Sung, Sumit Sanghai

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

2022

Multi-Vector Retrieval as Sparse Alignment.

Yujie Qian, Jinhyuk Lee, Sai Meher Karthik Duddu, Zhuyun Dai, Siddhartha Brahma, Iftekhar Naim, Tao Lei, Vincent Y. Zhao

CoRR, 2022

Mixture-of-Experts with Expert Choice Routing.

Yanqi Zhou, Tao Lei, Hanxiao Liu, Nan Du, Yanping Huang, Vincent Y. Zhao, Andrew M. Dai, Zhifeng Chen, Quoc V. Le, James Laudon

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

SRU++: Pioneering Fast Recurrence with Attention for Speech Recognition.

Jing Pan, Tao Lei, Kwangyoun Kim, Kyu Jeong Han, Shinji Watanabe

Proceedings of the IEEE International Conference on Acoustics, 2022

2021

Nutribullets Hybrid: Multi-document Health Summarization.

Darsh J. Shah, Lili Yu, Tao Lei, Regina Barzilay

CoRR, 2021

Nutri-bullets Hybrid: Consensual Multi-document Summarization.

Darsh J. Shah, Lili Yu, Tao Lei, Regina Barzilay

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Nutri-bullets: Summarizing Health Studies by Composing Segments.

Darsh J. Shah, Lili Yu, Tao Lei, Regina Barzilay

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

ASAPP-ASR: Multistream CNN and Self-Attentive SRU for SOTA Speech Recognition.

Jing Pan, Joshua Shapiro, Jeremy Wohlwend, Kyu Jeong Han, Tao Lei, Tao Ma

Proceedings of the 21st Annual Conference of the International Speech Communication Association, 2020

Structured Pruning of Large Language Models.

Ziheng Wang, Jeremy Wohlwend, Tao Lei

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Autoregressive Knowledge Distillation through Imitation Learning.

Alexander Lin, Jeremy Wohlwend, Howard Chen, Tao Lei

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Interactive Classification by Asking Informative Questions.

Lili Yu, Howard Chen, Sida I. Wang, Tao Lei, Yoav Artzi

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

Rationalizing Text Matching: Learning Sparse Alignments via Optimal Transport.

Kyle Swanson, Lili Yu, Tao Lei

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Building a Production Model for Retrieval-Based Chatbots.

Kyle Swanson, Lili Yu, Christopher Fox, Jeremy Wohlwend, Tao Lei

CoRR, 2019

Metric Learning for Dynamic Text Classification.

Jeremy Wohlwend, Ethan R. Elenberg, Sam Altschul, Shawn Henry, Tao Lei

Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP, 2019

2018

Adversarial Domain Adaptation for Duplicate Question Detection.

Darsh J. Shah, Tao Lei, Alessandro Moschitti, Salvatore Romeo, Preslav Nakov

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

Simple Recurrent Units for Highly Parallelizable Recurrence.

Tao Lei, Yu Zhang, Sida I. Wang, Hui Dai, Yoav Artzi

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

2017

Interpretable neural models for natural language processing.

Tao Lei

PhD thesis, 2017

Training RNNs as Fast as CNNs.

Tao Lei, Yu Zhang, Yoav Artzi

CoRR, 2017

Style Transfer from Non-Parallel Text by Cross-Alignment.

Tianxiao Shen, Tao Lei, Regina Barzilay, Tommi S. Jaakkola

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Deriving Neural Architectures from Sequence and Graph Kernels.

Tao Lei, Wengong Jin, Regina Barzilay, Tommi S. Jaakkola

Proceedings of the 34th International Conference on Machine Learning, 2017

2016

SLS at SemEval-2016 Task 3: Neural-based Approaches for Ranking in Community Question Answering.

Mitra Mohtarami, Yonatan Belinkov, Wei-Ning Hsu, Yu Zhang, Tao Lei, Kfir Bar, Scott Cyphers, James R. Glass

Proceedings of the 10th International Workshop on Semantic Evaluation, 2016

Making Dependency Labeling Simple, Fast and Accurate.

Tianxiao Shen, Tao Lei, Regina Barzilay

Proceedings of the NAACL HLT 2016, 2016

Semi-supervised Question Retrieval with Gated Convolutions.

Tao Lei, Hrishikesh Joshi, Regina Barzilay, Tommi S. Jaakkola, Kateryna Tymoshenko, Alessandro Moschitti, Lluís Màrquez

Proceedings of the NAACL HLT 2016, 2016

Rationalizing Neural Predictions.

Tao Lei, Regina Barzilay, Tommi S. Jaakkola

Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016

Learning to refine text based recommendations.

Youyang Gu, Tao Lei, Regina Barzilay, Tommi S. Jaakkola

Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016

2015

Erratum: "Exploring Compositional Architectures and Word Vector Representations for Prepositional Phrase Attachment".

Yonatan Belinkov, Tao Lei, Regina Barzilay, Amir Globerson

Trans. Assoc. Comput. Linguistics, 2015

Denoising Bodies to Titles: Retrieving Similar Questions with Recurrent Convolutional Models.

Tao Lei, Hrishikesh Joshi, Regina Barzilay, Tommi S. Jaakkola, Kateryna Tymoshenko, Alessandro Moschitti, Lluís Màrquez i Villodre

CoRR, 2015

High-Order Low-Rank Tensors for Semantic Role Labeling.

Tao Lei, Yuan Zhang, Lluís Màrquez i Villodre, Alessandro Moschitti, Regina Barzilay

Proceedings of the NAACL HLT 2015, The 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Denver, Colorado, USA, May 31, 2015

Molding CNNs for text: non-linear, non-consecutive convolutions.

Tao Lei, Regina Barzilay, Tommi S. Jaakkola

Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015

2014

Exploring Compositional Architectures and Word Vector Representations for Prepositional Phrase Attachment.

Yonatan Belinkov, Tao Lei, Regina Barzilay, Amir Globerson

Trans. Assoc. Comput. Linguistics, 2014

Greed is Good if Randomized: New Inference for Dependency Parsing.

Yuan Zhang, Tao Lei, Regina Barzilay, Tommi S. Jaakkola

Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, 2014

Steps to Excellence: Simple Inference with Refined Scoring of Dependency Trees.

Yuan Zhang, Tao Lei, Regina Barzilay, Tommi S. Jaakkola, Amir Globerson

Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014

Low-Rank Tensors for Scoring Dependency Structures.

Tao Lei, Yu Xin, Yuan Zhang, Regina Barzilay, Tommi S. Jaakkola

Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014

2013

From Natural Language Specifications to Program Input Parsers.

Tao Lei, Fan Long, Regina Barzilay, Martin C. Rinard

Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, 2013

2012

Learning High-Level Planning from Text.

S. R. K. Branavan, Nate Kushman, Tao Lei, Regina Barzilay

Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, July 8-14, 2012, Jeju Island, Korea, 2012