Ashish Vaswani

According to our database, Ashish Vaswani authored at least 42 papers between 2006 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2023

Guest Editorial Introduction to the Special Section on Transformer Models in Vision.

Salman H. Khan, Fahad Shahbaz Khan, Ashish Vaswani, Niki Parmar, Ming-Hsuan Yang, Mubarak Shah

IEEE Trans. Pattern Anal. Mach. Intell., November, 2023

2022

Scale Efficiently: Insights from Pretraining and Finetuning Transformers.

Yi Tay, Mostafa Dehghani, Jinfeng Rao, William Fedus, Samira Abnar, Hyung Won Chung, Sharan Narang, Dani Yogatama, Ashish Vaswani, Donald Metzler

Proceedings of the Tenth International Conference on Learning Representations, 2022

The Efficiency Misnomer.

Mostafa Dehghani, Yi Tay, Anurag Arnab, Lucas Beyer, Ashish Vaswani

Proceedings of the Tenth International Conference on Learning Representations, 2022

2021

Efficient Content-Based Sparse Attention with Routing Transformers.

Aurko Roy, Mohammad Saffar, Ashish Vaswani, David Grangier

Trans. Assoc. Comput. Linguistics, 2021

Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers.

Yi Tay, Mostafa Dehghani, Jinfeng Rao, William Fedus, Samira Abnar, Hyung Won Chung, Sharan Narang, Dani Yogatama, Ashish Vaswani, Donald Metzler

CoRR, 2021

Simple and Efficient ways to Improve REALM.

Vidhisha Balachandran, Ashish Vaswani, Yulia Tsvetkov, Niki Parmar

CoRR, 2021

Scaling Local Self-Attention for Parameter Efficient Visual Backbones.

Ashish Vaswani, Prajit Ramachandran, Aravind Srinivas, Niki Parmar, Blake A. Hechtman, Jonathon Shlens

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Bottleneck Transformers for Visual Recognition.

Aravind Srinivas, Tsung-Yi Lin, Niki Parmar, Jonathon Shlens, Pieter Abbeel, Ashish Vaswani

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

2019

Stand-Alone Self-Attention in Vision Models.

Niki Parmar, Prajit Ramachandran, Ashish Vaswani, Irwan Bello, Anselm Levskaya, Jonathon Shlens

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Music Transformer: Generating Music with Long-Term Structure.

Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Ian Simon, Curtis Hawthorne, Noam Shazeer, Andrew M. Dai, Matthew D. Hoffman, Monica Dinculescu, Douglas Eck

Proceedings of the 7th International Conference on Learning Representations, 2019

Attention Augmented Convolutional Networks.

Irwan Bello, Barret Zoph, Quoc Le, Ashish Vaswani, Jonathon Shlens

Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, 2019

Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation.

Vihan Jain, Gabriel Magalhães, Alexander Ku, Ashish Vaswani, Eugene Ie, Jason Baldridge

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

An Improved Relative Self-Attention Mechanism for Transformer with Application to Music Generation.

Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Noam Shazeer, Curtis Hawthorne, Andrew M. Dai, Matthew D. Hoffman, Douglas Eck

CoRR, 2018

Relational inductive biases, deep learning, and graph networks.

Peter W. Battaglia, Jessica B. Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vinícius Flores Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, Çaglar Gülçehre, H. Francis Song, Andrew J. Ballard, Justin Gilmer, George E. Dahl, Ashish Vaswani, Kelsey R. Allen, Charles Nash, Victoria Langston, Chris Dyer, Nicolas Heess, Daan Wierstra, Pushmeet Kohli, Matthew M. Botvinick, Oriol Vinyals, Yujia Li, Razvan Pascanu

CoRR, 2018

Theory and Experiments on Vector Quantized Autoencoders.

Aurko Roy, Ashish Vaswani, Arvind Neelakantan, Niki Parmar

CoRR, 2018

Image Transformer.

Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku

CoRR, 2018

Mesh-TensorFlow: Deep Learning for Supercomputers.

Noam Shazeer, Youlong Cheng, Niki Parmar, Dustin Tran, Ashish Vaswani, Penporn Koanantakool, Peter Hawkins, HyoukJoong Lee, Mingsheng Hong, Cliff Young, Ryan Sepassi, Blake A. Hechtman

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Self-Attention with Relative Position Representations.

Peter Shaw, Jakob Uszkoreit, Ashish Vaswani

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Image Transformer.

Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku, Dustin Tran

Proceedings of the 35th International Conference on Machine Learning, 2018

Fast Decoding in Sequence Models Using Discrete Latent Variables.

Lukasz Kaiser, Samy Bengio, Aurko Roy, Ashish Vaswani, Niki Parmar, Jakob Uszkoreit, Noam Shazeer

Proceedings of the 35th International Conference on Machine Learning, 2018

Tensor2Tensor for Neural Machine Translation.

Ashish Vaswani, Samy Bengio, Eugene Brevdo, François Chollet, Aidan N. Gomez, Stephan Gouws, Llion Jones, Lukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, Jakob Uszkoreit

Proceedings of the 13th Conference of the Association for Machine Translation in the Americas, 2018

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation.

Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George F. Foster, Llion Jones, Mike Schuster, Noam Shazeer, Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Zhifeng Chen, Yonghui Wu, Macduff Hughes

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

One Model To Learn Them All.

Lukasz Kaiser, Aidan N. Gomez, Noam Shazeer, Ashish Vaswani, Niki Parmar, Llion Jones, Jakob Uszkoreit

CoRR, 2017

Attention is All you Need.

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

2016

Efficient Structured Inference for Transition-Based Parsing with Neural Networks and Error States.

Ashish Vaswani, Kenji Sagae

Trans. Assoc. Comput. Linguistics, 2016

Simple, Fast Noise-Contrastive Estimation for Large RNN Vocabularies.

Barret Zoph, Ashish Vaswani, Jonathan May, Kevin Knight

Proceedings of the NAACL HLT 2016, 2016

Name Tagging for Low-resource Incident Languages based on Expectation-driven Learning.

Boliang Zhang, Xiaoman Pan, Tianlu Wang, Ashish Vaswani, Heng Ji, Kevin Knight, Daniel Marcu

Proceedings of the NAACL HLT 2016, 2016

Supertagging With LSTMs.

Ashish Vaswani, Yonatan Bisk, Kenji Sagae, Ryan Musa

Proceedings of the NAACL HLT 2016, 2016

Unsupervised Neural Hidden Markov Models.

Ke M. Tran, Yonatan Bisk, Ashish Vaswani, Daniel Marcu, Kevin Knight

Proceedings of the Workshop on Structured Prediction for NLP@EMNLP 2016, 2016

2015

Model Invertibility Regularization: Sequence Alignment With or Without Parallel Data.

Tomer Levinboim, Ashish Vaswani, David Chiang

Proceedings of the NAACL HLT 2015, The 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Denver, Colorado, USA, May 31, 2015

Unifying Bayesian Inference and Vector Space Models for Improved Decipherment.

Qing Dou, Ashish Vaswani, Kevin Knight, Chris Dyer

Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, 2015

2014

Aligning context-based statistical models of language with brain activity during reading.

Leila Wehbe, Ashish Vaswani, Kevin Knight, Tom M. Mitchell

Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, 2014

Beyond Parallel Data: Joint Word Alignment and Decipherment Improves Machine Translation.

Qing Dou, Ashish Vaswani, Kevin Knight

Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, 2014

2013

Learning Whom to Trust with MACE.

Dirk Hovy, Taylor Berg-Kirkpatrick, Ashish Vaswani, Eduard H. Hovy

Proceedings of the Human Language Technologies: Conference of the North American Chapter of the Association of Computational Linguistics, 2013

Decoding with Large-Scale Neural Language Models Improves Translation.

Ashish Vaswani, Yinggong Zhao, Victoria Fossum, David Chiang

Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, 2013

2012

Smaller Alignment Models for Better Translations: Unsupervised Word Alignment with the l0-norm.

Ashish Vaswani, Liang Huang, David Chiang

Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, July 8-14, 2012, Jeju Island, Korea, 2012

2011

Rule Markov Models for Fast Tree-to-String Translation.

Ashish Vaswani, Haitao Mi, Liang Huang, David Chiang

Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, 2011

Models and Training for Unsupervised Preposition Sense Disambiguation.

Dirk Hovy, Ashish Vaswani, Stephen Tratz, David Chiang, Eduard H. Hovy

Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference, 19-24 June, 2011, Portland, Oregon, USA, 2011

2010

Fast, Greedy Model Minimization for Unsupervised Tagging.

Sujith Ravi, Ashish Vaswani, Kevin Knight, David Chiang

Proceedings of the COLING 2010, 2010

Efficient Optimization of an MDL-Inspired Objective Function for Unsupervised Part-Of-Speech Tagging.

Ashish Vaswani, Adam Pauls, David Chiang

Proceedings of the ACL 2010, 2010

2007

Hassan: A Virtual Human for Tactical Questioning.

David R. Traum, Antonio Roque, Anton Leuski, Panayiotis G. Georgiou, Jillian Gerten, Bilyana Martinovski, Shrikanth Narayanan, Susan Robinson, Ashish Vaswani

Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue, 2007

2006

Radiobot-CFF: a spoken dialogue system for military training.

Antonio Roque, Anton Leuski, Vivek Kumar Rangarajan Sridhar, Susan Robinson, Ashish Vaswani, Shrikanth S. Narayanan, David R. Traum

Proceedings of the INTERSPEECH 2006, 2006