Attention is All you Need. - Ashish Vaswani; Noam Shazeer; Niki Parmar; Jakob Uszkoreit; Llion Jones; Aidan N. Gomez; Lukasz Kaiser; Illia Polosukhin (NIPS, 2017)

One Model To Learn Them All. - Lukasz Kaiser; Aidan N. Gomez; Noam Shazeer; Ashish Vaswani; Niki Parmar; Llion Jones; Jakob Uszkoreit (CoRR, 2017)

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. - Mia Xu Chen; Orhan Firat; Ankur Bapna; Melvin Johnson; Wolfgang Macherey; George F. Foster; Llion Jones; Mike Schuster; Noam Shazeer; Niki Parmar; Ashish Vaswani; Jakob Uszkoreit; et al. (ACL (1), 2018)

Tensor2Tensor for Neural Machine Translation. - Ashish Vaswani; Samy Bengio; Eugene Brevdo; François Chollet; Aidan N. Gomez; Stephan Gouws; Llion Jones; Lukasz Kaiser; Nal Kalchbrenner; Niki Parmar; Ryan Sepassi; Noam Shazeer; et al. (AMTA (1), 2018)

Fast Decoding in Sequence Models Using Discrete Latent Variables. - Lukasz Kaiser; Samy Bengio; Aurko Roy; Ashish Vaswani; Niki Parmar; Jakob Uszkoreit; Noam Shazeer (ICML, 2018)

Image Transformer. - Niki Parmar; Ashish Vaswani; Jakob Uszkoreit; Lukasz Kaiser; Noam Shazeer; Alexander Ku; Dustin Tran (ICML, 2018)

Mesh-TensorFlow: Deep Learning for Supercomputers. - Noam Shazeer; Youlong Cheng; Niki Parmar; Dustin Tran; Ashish Vaswani; Penporn Koanantakool; Peter Hawkins; HyoukJoong Lee; Mingsheng Hong; Cliff Young; Ryan Sepassi; Blake A. Hechtman (NeurIPS, 2018)

Image Transformer. - Niki Parmar; Ashish Vaswani; Jakob Uszkoreit; Lukasz Kaiser; Noam Shazeer; Alexander Ku (CoRR, 2018)

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. - Mia Xu Chen; Orhan Firat; Ankur Bapna; Melvin Johnson; Wolfgang Macherey; George F. Foster; Llion Jones; Niki Parmar; Mike Schuster; Zhifeng Chen; Yonghui Wu; Macduff Hughes (CoRR, 2018)

Theory and Experiments on Vector Quantized Autoencoders. - Aurko Roy; Ashish Vaswani; Arvind Neelakantan; Niki Parmar (CoRR, 2018)

Weakly Supervised Grammatical Error Correction using Iterative Decoding. - Jared Lichtarge; Christopher Alberti; Shankar Kumar; Noam Shazeer; Niki Parmar (CoRR, 2018)

Corpora Generation for Grammatical Error Correction. - Jared Lichtarge; Chris Alberti; Shankar Kumar; Noam Shazeer; Niki Parmar; Simon Tong (NAACL-HLT (1), 2019)

Stand-Alone Self-Attention in Vision Models. - Niki Parmar; Prajit Ramachandran; Ashish Vaswani; Irwan Bello; Anselm Levskaya; Jonathon Shlens (NeurIPS, 2019)

High Resolution Medical Image Analysis with Spatial Partitioning. - Le Hou; Youlong Cheng; Noam Shazeer; Niki Parmar; Yeqing Li; Panagiotis Korfiatis; Travis M. Drucker; Daniel J. Blezek; Xiaodan Song (CoRR, 2019)

Conformer: Convolution-augmented Transformer for Speech Recognition. - Anmol Gulati; James Qin; Chung-Cheng Chiu; Niki Parmar; Yu Zhang 033; Jiahui Yu; Wei Han 002; Shibo Wang; Zhengdong Zhang; Yonghui Wu; Ruoming Pang (INTERSPEECH, 2020)

Bottleneck Transformers for Visual Recognition. - Aravind Srinivas; Tsung-Yi Lin; Niki Parmar; Jonathon Shlens; Pieter Abbeel; Ashish Vaswani (CVPR, 2021)

Scaling Local Self-Attention for Parameter Efficient Visual Backbones. - Ashish Vaswani; Prajit Ramachandran; Aravind Srinivas; Niki Parmar; Blake A. Hechtman; Jonathon Shlens (CVPR, 2021)

Simple and Efficient ways to Improve REALM. - Vidhisha Balachandran; Ashish Vaswani; Yulia Tsvetkov; Niki Parmar (CoRR, 2021)

Denoising Pretraining for Semantic Segmentation. - Emmanuel Asiedu Brempong; Simon Kornblith; Ting Chen 007; Niki Parmar; Matthias Minderer; Mohammad Norouzi 002 (CVPR Workshops, 2022)

Decoder Denoising Pretraining for Semantic Segmentation. - Emmanuel Asiedu Brempong; Simon Kornblith; Ting Chen 007; Niki Parmar; Matthias Minderer; Mohammad Norouzi 002 (Trans. Mach. Learn. Res., 2022)

Guest Editorial Introduction to the Special Section on Transformer Models in Vision. - Salman H. Khan 001; Fahad Shahbaz Khan; Ashish Vaswani; Niki Parmar; Ming-Hsuan Yang 001; Mubarak Shah (IEEE Trans. Pattern Anal. Mach. Intell., 2023)