Jakob Uszkoreit

According to our database, Jakob Uszkoreit authored at least 38 papers between 2008 and 2022.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2022

How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers.

Andreas Steiner, Alexander Kolesnikov, Xiaohua Zhai, Ross Wightman, Jakob Uszkoreit, Lucas Beyer

Trans. Mach. Learn. Res., 2022

Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representations.

Mehdi S. M. Sajjadi, Henning Meyer, Etienne Pot, Urs Bergmann, Klaus Greff, Noha Radwan, Suhani Vora, Mario Lucic, Daniel Duckworth, Alexey Dosovitskiy, Jakob Uszkoreit, Thomas A. Funkhouser, Andrea Tagliasacchi

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

2021

MLP-Mixer: An all-MLP Architecture for Vision.

Ilya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Thomas Unterthiner, Jessica Yung, Andreas Steiner, Daniel Keysers, Jakob Uszkoreit, Mario Lucic, Alexey Dosovitskiy

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.

Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, Neil Houlsby

Proceedings of the 9th International Conference on Learning Representations, 2021

Differentiable Patch Selection for Image Recognition.

Jean-Baptiste Cordonnier, Aravindh Mahendran, Alexey Dosovitskiy, Dirk Weissenborn, Jakob Uszkoreit, Thomas Unterthiner

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

2020

Towards End-to-End In-Image Neural Machine Translation.

Elman Mansimov, Mitchell Stern, Mia Xu Chen, Orhan Firat, Jakob Uszkoreit, Puneet Jain

CoRR, 2020

Object-Centric Learning with Slot Attention.

Francesco Locatello, Dirk Weissenborn, Thomas Unterthiner, Aravindh Mahendran, Georg Heigold, Jakob Uszkoreit, Alexey Dosovitskiy, Thomas Kipf

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Scaling Autoregressive Video Models.

Dirk Weissenborn, Oscar Täckström, Jakob Uszkoreit

Proceedings of the 8th International Conference on Learning Representations, 2020

An Empirical Study of Generation Order for Machine Translation.

William Chan, Mitchell Stern, Jamie Kiros, Jakob Uszkoreit

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

2019

Natural Questions: a Benchmark for Question Answering Research.

Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur P. Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, Slav Petrov

Trans. Assoc. Comput. Linguistics, 2019

KERMIT: Generative Insertion-Based Modeling for Sequences.

William Chan, Nikita Kitaev, Kelvin Guu, Mitchell Stern, Jakob Uszkoreit

CoRR, 2019

Insertion Transformer: Flexible Sequence Generation via Insertion Operations.

Mitchell Stern, William Chan, Jamie Kiros, Jakob Uszkoreit

Proceedings of the 36th International Conference on Machine Learning, 2019

Music Transformer: Generating Music with Long-Term Structure.

Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Ian Simon, Curtis Hawthorne, Noam Shazeer, Andrew M. Dai, Matthew D. Hoffman, Monica Dinculescu, Douglas Eck

Proceedings of the 7th International Conference on Learning Representations, 2019

Universal Transformers.

Mostafa Dehghani, Stephan Gouws, Oriol Vinyals, Jakob Uszkoreit, Lukasz Kaiser

Proceedings of the 7th International Conference on Learning Representations, 2019

2018

An Improved Relative Self-Attention Mechanism for Transformer with Application to Music Generation.

Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Noam Shazeer, Curtis Hawthorne, Andrew M. Dai, Matthew D. Hoffman, Douglas Eck

CoRR, 2018

Image Transformer.

Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku

CoRR, 2018

Blockwise Parallel Decoding for Deep Autoregressive Models.

Mitchell Stern, Noam Shazeer, Jakob Uszkoreit

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Self-Attention with Relative Position Representations.

Peter Shaw, Jakob Uszkoreit, Ashish Vaswani

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Image Transformer.

Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku, Dustin Tran

Proceedings of the 35th International Conference on Machine Learning, 2018

Fast Decoding in Sequence Models Using Discrete Latent Variables.

Lukasz Kaiser, Samy Bengio, Aurko Roy, Ashish Vaswani, Niki Parmar, Jakob Uszkoreit, Noam Shazeer

Proceedings of the 35th International Conference on Machine Learning, 2018

Tensor2Tensor for Neural Machine Translation.

Ashish Vaswani, Samy Bengio, Eugene Brevdo, François Chollet, Aidan N. Gomez, Stephan Gouws, Llion Jones, Lukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, Jakob Uszkoreit

Proceedings of the 13th Conference of the Association for Machine Translation in the Americas, 2018

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation.

Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George F. Foster, Llion Jones, Mike Schuster, Noam Shazeer, Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Zhifeng Chen, Yonghui Wu, Macduff Hughes

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

One Model To Learn Them All.

Lukasz Kaiser, Aidan N. Gomez, Noam Shazeer, Ashish Vaswani, Niki Parmar, Llion Jones, Jakob Uszkoreit

CoRR, 2017

Attention is All you Need.

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Neural Paraphrase Identification of Questions with Noisy Pretraining.

Gaurav Singh Tomar, Thyago Duque, Oscar Täckström, Jakob Uszkoreit, Dipanjan Das

Proceedings of the First Workshop on Subword and Character Level Models in NLP, 2017

Coarse-to-Fine Question Answering for Long Documents.

Eunsol Choi, Daniel Hewlett, Jakob Uszkoreit, Illia Polosukhin, Alexandre Lacoste, Jonathan Berant

Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, 2017

2016

Hierarchical Question Answering for Long Documents.

Eunsol Choi, Daniel Hewlett, Alexandre Lacoste, Illia Polosukhin, Jakob Uszkoreit, Jonathan Berant

CoRR, 2016

A Decomposable Attention Model for Natural Language Inference.

Ankur P. Parikh, Oscar Täckström, Dipanjan Das, Jakob Uszkoreit

Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016

2013

Language-Independent Discriminative Parsing of Temporal Expressions.

Gabor Angeli, Jakob Uszkoreit

Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, 2013

2012

Cross-lingual Word Clusters for Direct Transfer of Linguistic Structure.

Oscar Täckström, Ryan T. McDonald, Jakob Uszkoreit

Proceedings of the Human Language Technologies: Conference of the North American Chapter of the Association of Computational Linguistics, 2012

A Feature-Rich Constituent Context Model for Grammar Induction.

Dave Golland, John DeNero, Jakob Uszkoreit

Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, July 8-14, 2012, Jeju Island, Korea, 2012

2011

Watermarking the Outputs of Structured Prediction with an application in Statistical Machine Translation.

Ashish Venugopal, Jakob Uszkoreit, David Talbot, Franz Josef Och, Juri Ganitkevitch

Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, 2011

Inducing Sentence Structure from Parallel Corpora for Reordering.

John DeNero, Jakob Uszkoreit

Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, 2011

2010

'Poetic' Statistical Machine Translation: Rhyme and Meter.

Dmitriy Genzel, Jakob Uszkoreit, Franz Josef Och

Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, 2010

Large Scale Parallel Document Mining for Machine Translation.

Jakob Uszkoreit, Jay Ponte, Ashok C. Popat, Moshe Dubiner

Proceedings of the COLING 2010, 2010

2009

Creating a High-Quality Machine Translation System for a Low-Resource Language: Yiddish.

Dmitriy Genzel, Klaus Macherey, Jakob Uszkoreit

Proceedings of Machine Translation Summit XII: Papers, 2009

2008

Lattice-based Minimum Error Rate Training for Statistical Machine Translation.

Wolfgang Macherey, Franz Josef Och, Ignacio Thayer, Jakob Uszkoreit

Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, 2008

Distributed Word Clustering for Large Scale Class-Based Language Modeling in Machine Translation.

Jakob Uszkoreit, Thorsten Brants

Proceedings of the ACL 2008, 2008