Making the Case for Query-by-Voice with EchoQuery. - Gabriel Lyons; Vinh Tran 002; Carsten Binnig; Ugur Çetintemel; Tim Kraska (SIGMOD Conference, 2016)

AgreeSum: Agreement-Oriented Multi-Document Summarization. - Richard Yuanzhe Pang; Ádám Dániel Lelkes; Vinh Q. Tran 002; Cong Yu 001 (ACL/IJCNLP (Findings), 2021)

Quiz-Style Question Generation for News Stories. - Ádám D. Lelkes; Vinh Q. Tran 002; Cong Yu 001 (WWW, 2021)

Dense Feature Memory Augmented Transformers for COVID-19 Vaccination Search Classification. - Jai Gupta 001; Yi Tay; Chaitanya Kamath; Vinh Tran 002; Donald Metzler; Shailesh Bavadekar; Mimi Sun; Evgeniy Gabrilovich (EMNLP (Industry Track), 2022)

ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning. - Vamsi Aribandi; Yi Tay; Tal Schuster; Jinfeng Rao; Huaixiu Steven Zheng; Sanket Vaibhav Mehta; Honglei Zhuang; Vinh Q. Tran 002; Dara Bahri; Jianmo Ni; Jai Prakash Gupta 001; Kai Hui 001; et al. (ICLR, 2022)

Charformer: Fast Character Transformers via Gradient-based Subword Tokenization. - Yi Tay; Vinh Q. Tran 002; Sebastian Ruder; Jai Prakash Gupta 001; Hyung Won Chung; Dara Bahri; Zhen Qin 001; Simon Baumgartner; Cong Yu 001; Donald Metzler (ICLR, 2022)

A New Generation of Perspective API: Efficient Multilingual Character-level Transformers. - Alyssa Lees; Vinh Q. Tran 002; Yi Tay; Jeffrey Sorensen; Jai Prakash Gupta 001; Donald Metzler; Lucy Vasserman (KDD, 2022)

Confident Adaptive Language Modeling. - Tal Schuster; Adam Fisch; Jai Gupta 001; Mostafa Dehghani 001; Dara Bahri; Vinh Tran 002; Yi Tay; Donald Metzler (NeurIPS, 2022)

Transformer Memory as a Differentiable Search Index. - Yi Tay; Vinh Tran 002; Mostafa Dehghani 001; Jianmo Ni; Dara Bahri; Harsh Mehta; Zhen Qin 001; Kai Hui 001; Zhe Zhao 001; Jai Prakash Gupta 001; Tal Schuster; William W. Cohen; et al. (NeurIPS, 2022)

Unifying Language Learning Paradigms. - Yi Tay; Mostafa Dehghani 001; Vinh Q. Tran 002; Xavier Garcia; Dara Bahri; Tal Schuster; Huaixiu Steven Zheng; Neil Houlsby; Donald Metzler (CoRR, 2022)

Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Models. - Bernd Bohnet; Vinh Q. Tran 002; Pat Verga; Roee Aharoni; Daniel Andor; Livio Baldini Soares; Jacob Eisenstein; Kuzman Ganchev; Jonathan Herzig; Kai Hui 001; Tom Kwiatkowski; Ji Ma 004; et al. (CoRR, 2022)

DSI++: Updating Transformer Memory with New Documents. - Sanket Vaibhav Mehta; Jai Gupta 001; Yi Tay; Mostafa Dehghani 001; Vinh Q. Tran 002; Jinfeng Rao; Marc Najork; Emma Strubell; Donald Metzler (EMNLP, 2023)

How Does Generative Retrieval Scale to Millions of Passages? - Ronak Pradeep; Kai Hui 001; Jai Gupta 001; Ádám D. Lelkes; Honglei Zhuang; Jimmy Lin; Donald Metzler; Vinh Q. Tran 002 (EMNLP, 2023)

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling? - Yi Tay; Mostafa Dehghani 001; Samira Abnar; Hyung Won Chung; William Fedus; Jinfeng Rao; Sharan Narang; Vinh Q. Tran 002; Dani Yogatama; Donald Metzler (EMNLP (Findings), 2023)

Transcending Scaling Laws with 0.1% Extra Compute. - Yi Tay; Jason Wei; Hyung Won Chung; Vinh Q. Tran 002; David R. So; Siamak Shakeri; Xavier Garcia; Huaixiu Steven Zheng; Jinfeng Rao; Aakanksha Chowdhery; Denny Zhou; Donald Metzler; et al. (EMNLP, 2023)

UL2: Unifying Language Learning Paradigms. - Yi Tay; Mostafa Dehghani 001; Vinh Q. Tran 002; Xavier Garcia; Jason Wei; Xuezhi Wang 002; Hyung Won Chung; Dara Bahri; Tal Schuster; Huaixiu Steven Zheng; Denny Zhou; Neil Houlsby; et al. (ICLR, 2023)

Recommender Systems with Generative Retrieval. - Shashank Rajput; Nikhil Mehta 002; Anima Singh; Raghunandan Hulikal Keshavan; Trung Vu 002; Lukasz Heldt; Lichan Hong; Yi Tay; Vinh Q. Tran 002; Jonah Samost; Maciej Kula; Ed H. Chi; et al. (NeurIPS, 2023)

Fractal Patterns May Illuminate the Success of Next-Token Prediction. - Ibrahim M. Alabdulmohsin; Vinh Q. Tran 002; Mostafa Dehghani 001 (NeurIPS, 2024)

Fractal Patterns May Unravel the Intelligence in Next-Token Prediction. - Ibrahim Alabdulmohsin; Vinh Q. Tran 002; Mostafa Dehghani 001 (CoRR, 2024)

Tomato, Tomahto, Tomate: Measuring the Role of Shared Semantics among Subwords in Multilingual Language Models. - Xinyu Zhang 018; Jing Lu; Vinh Q. Tran 002; Tal Schuster; Donald Metzler; Jimmy Lin (CoRR, 2024)

BIG-Bench Extra Hard. - Mehran Kazemi; Bahare Fatemi; Hritik Bansal; John Palowitch; Chrysovalantis Anastasiou; Sanket Vaibhav Mehta; Lalit K. Jain; Virginia Aglietti; Disha Jindal; Peter Chen; Nishanth Dikkala; Gladys Tyen; et al. (ACL (1), 2025)

Smaller, Weaker, Yet Better: Training LLM Reasoners via Compute-Optimal Sampling. - Hritik Bansal; Arian Hosseini; Rishabh Agarwal; Vinh Q. Tran 002; Mehran Kazemi (ICLR, 2025)

Tomato, Tomahto, Tomate: Do Multilingual Language Models Understand Based on Subword-Level Semantic Concepts? - Crystina Zhang; Jing Lu; Vinh Q. Tran 002; Tal Schuster; Donald Metzler; Jimmy Lin (NAACL (Findings), 2025)

BIG-Bench Extra Hard. - Mehran Kazemi; Bahare Fatemi; Hritik Bansal; John Palowitch; Chrysovalantis Anastasiou; Sanket Vaibhav Mehta; Kshitij Jain 001; Virginia Aglietti; Disha Jindal; Peter Chen; Nishanth Dikkala; Gladys Tyen; et al. (CoRR, 2025)