Aurko Roy

According to our database, Aurko Roy authored at least 18 papers between 2014 and 2025.

Collaborative distances:

• Dijkstra number of three.
• Erdős number of three.

2025

Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities.

Gheorghe Comanici, Eric Bieber, Mike Schaekermann, Ice Pasupat, Noveen Sachdeva, Inderjit S. Dhillon, Marcel Blistein, Ori Ram, Dan Zhang, Evan Rosen, Luke Marris, Sam Petulla, Colin Gaffney, Asaf Aharoni, Nathan Lintz, Tiago Cardal Pais, Henrik Jacobsson, Idan Szpektor, Nan-Jiang Jiang, Krishna Haridasan, Ahmed Omran, Nikunj Saunshi, Dara Bahri, Gaurav Mishra, Eric Chu, Toby Boyd, Brad Hekman, Aaron Parisi, Chaoyi Zhang, Kornraphop Kawintiranon, Tania Bedrax-Weiss, Oliver Wang, Ya Xu, Ollie Purkiss, Uri Mendlovic, Ilaï Deutel, Nam Nguyen, Adam Langley, Flip Korn, Lucia Rossazza, Alexandre Ramé, Sagar Waghmare, Helen Miller, Nathan Byrd, Ashrith Sheshan, Raia Hadsell Sangnie Bhardwaj, Pawel Janus, Tero Rissa, Dan Horgan, Sharon Silver, Ayzaan Wahid, Sergey Brin, Yves Raimond, Klemen Kloboves, Cindy Wang, Nitesh Bharadwaj Gundavarapu, Ilia Shumailov, Bo Wang, Mantas Pajarskas, Joe Heyward, Martin Nikoltchev, Maciej Kula, Hao Zhou, Zachary Garrett, Sushant Kafle, Sercan Arik, Ankita Goel, Mingyao Yang, Jiho Park, Koji Kojima, Parsa Mahmoudieh, Koray Kavukcuoglu, Grace Chen, Doug Fritz, Anton Bulyenov, Sudeshna Roy, Dimitris Paparas, Hadar Shemtov, Bo-Juen Chen, Robin Strudel, David Reitter, Aurko Roy, Andrey Vlasov, Changwan Ryu, Chas Leichner, Haichuan Yang, Zelda Mariet, Denis Vnukov, Tim Sohn, Amy Stuart, Wei Liang, Minmin Chen, Praynaa Rawlani, Christy Koh, JD Co-Reyes, Guangda Lai, Praseem Banzal, Dimitrios Vytiniotis, Jieru Mei, Mu Cai

CoRR, July, 2025

Fast and Simplex: 2-Simplicial Attention in Triton.

Aurko Roy, Timothy Chou, Sai Surya Duvvuri, Sijia Chen, Jiecao Yu, Xiaodong Wang, Manzil Zaheer, Rohan Anil

CoRR, July, 2025

2022

N-Grammer: Augmenting Transformers with latent n-grams.

Aurko Roy, Rohan Anil, Guangda Lai, Benjamin Lee, Jeffrey Zhao, Shuyuan Zhang, Shibo Wang, Ye Zhang, Shen Wu, Rigel Swavely, Tao Yu, Phuong Dao, Christopher Fifty, Zhifeng Chen, Yonghui Wu

CoRR, 2022

2021

Efficient Content-Based Sparse Attention with Routing Transformers.

Aurko Roy, Mohammad Saffar, Ashish Vaswani, David Grangier

Trans. Assoc. Comput. Linguistics, 2021

Hurdles to Progress in Long-form Question Answering.

Kalpesh Krishna, Aurko Roy, Mohit Iyyer

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

2019

Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizer.

David Berthelot, Colin Raffel, Aurko Roy, Ian J. Goodfellow

Proceedings of the 7th International Conference on Learning Representations, 2019

Unsupervised Paraphrasing without Translation.

Aurko Roy, David Grangier

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

Theory and Experiments on Vector Quantized Autoencoders.

Aurko Roy, Ashish Vaswani, Arvind Neelakantan, Niki Parmar

CoRR, 2018

Fast Decoding in Sequence Models Using Discrete Latent Variables.

Lukasz Kaiser, Samy Bengio, Aurko Roy, Ashish Vaswani, Niki Parmar, Jakob Uszkoreit, Noam Shazeer

Proceedings of the 35th International Conference on Machine Learning, 2018

Thermometer Encoding: One Hot Way To Resist Adversarial Examples.

Jacob Buckman, Aurko Roy, Colin Raffel, Ian J. Goodfellow

Proceedings of the 6th International Conference on Learning Representations, 2018

2017

LP and SDP extended formulations: Lower bounds and approximation algorithms.

Aurko Roy

PhD thesis, 2017

Adversarial Patch.

Tom B. Brown, Dandelion Mané, Aurko Roy, Martín Abadi, Justin Gilmer

CoRR, 2017

Reinforcement Learning under Model Mismatch.

Aurko Roy, Huan Xu, Sebastian Pokutta

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Learning to Remember Rare Events.

Lukasz Kaiser, Ofir Nachum, Aurko Roy, Samy Bengio

Proceedings of the 5th International Conference on Learning Representations, 2017

2016

The matching problem has no small symmetric SDP.

Gábor Braun, Jonah Brown-Cohen, Arefin Huq, Sebastian Pokutta, Prasad Raghavendra, Aurko Roy, Benjamin Weitz, Daniel Zink

Proceedings of the Twenty-Seventh Annual ACM-SIAM Symposium on Discrete Algorithms, 2016

Hierarchical Clustering via Spreading Metrics.

Aurko Roy, Sebastian Pokutta

Proceedings of the Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, 2016

Strong Reductions for Extended Formulations.

Gábor Braun, Sebastian Pokutta, Aurko Roy

Proceedings of the Integer Programming and Combinatorial Optimization, 2016

2014

Deterministic polynomial factoring under the assumption of the Extended Riemann Hypothesis (ERH).

Aurko Roy

CoRR, 2014