Rami Al-Rfou

According to our database, Rami Al-Rfou authored at least 40 papers between 2012 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Let Your Graph Do the Talking: Encoding Structured Data for LLMs.

Bryan Perozzi, Bahare Fatemi, Dustin Zelle, Anton Tsitsulin, Seyed Mehran Kazemi, Rami Al-Rfou, Jonathan Halcrow

CoRR, 2024

2023

VN-Transformer: Rotation-Equivariant Attention for Vector Neurons.

Serge Assaad, Carlton Downey, Rami Al-Rfou', Nigamaa Nayakanti, Benjamin Sapp

Trans. Mach. Learn. Res., 2023

Fine-Tashkeel: Finetuning Byte-Level Models for Accurate Arabic Text Diacritization.

Bashar Al-Rfooh, Gheith A. Abandah, Rami Al-Rfou

CoRR, 2023

Wayformer: Motion Forecasting via Simple & Efficient Attention Networks.

Nigamaa Nayakanti, Rami Al-Rfou, Aurick Zhou, Kratarth Goel, Khaled S. Refaat, Benjamin Sapp

Proceedings of the IEEE International Conference on Robotics and Automation, 2023

MotionLM: Multi-Agent Motion Forecasting as Language Modeling.

Ari Seff, Brian Cera, Dian Chen, Mason Ng, Aurick Zhou, Nigamaa Nayakanti, Khaled S. Refaat, Rami Al-Rfou, Benjamin Sapp

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

2022

ByT5: Towards a Token-Free Future with Pre-trained Byte-to-Byte Models.

Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, Colin Raffel

Trans. Assoc. Comput. Linguistics, 2022

Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecasting.

DiJia Su, Bertrand Douillard, Rami Al-Rfou, Cheolho Park, Benjamin Sapp

CoRR, 2022

Narrowing the coordinate-frame gap in behavior prediction models: Distillation for efficient and accurate scene-centric motion forecasting.

DiJia Andy Su, Bertrand Douillard, Rami Al-Rfou, Cheol Park, Benjamin Sapp

Proceedings of the 2022 International Conference on Robotics and Automation, 2022

SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer.

Tu Vu, Brian Lester, Noah Constant, Rami Al-Rfou', Daniel Cer

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer.

Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, Colin Raffel

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training.

Oshin Agarwal, Heming Ge, Siamak Shakeri, Rami Al-Rfou

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

The Power of Scale for Parameter-Efficient Prompt Tuning.

Brian Lester, Rami Al-Rfou, Noah Constant

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

nmT5 - Is parallel data still relevant for pre-training massively multilingual language models?

Mihir Kale, Aditya Siddhant, Rami Al-Rfou, Linting Xue, Noah Constant, Melvin Johnson

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

Large Scale Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training.

Oshin Agarwal, Heming Ge, Siamak Shakeri, Rami Al-Rfou

CoRR, 2020

Wiki-40B: Multilingual Language Model Dataset.

Mandy Guo, Zihang Dai, Denny Vrandecic, Rami Al-Rfou

Proceedings of The 12th Language Resources and Evaluation Conference, 2020

LAReQA: Language-Agnostic Answer Retrieval from a Multilingual Pool.

Uma Roy, Noah Constant, Rami Al-Rfou, Aditya Barua, Aaron Phillips, Yinfei Yang

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

2019

Bridging the Gap for Tokenizer-Free Language Models.

Dokook Choe, Rami Al-Rfou, Mandy Guo, Heeyoung Lee, Noah Constant

CoRR, 2019

DDGK: Learning Graph Representations for Deep Divergence Graph Kernels.

Rami Al-Rfou, Bryan Perozzi, Dustin Zelle

Proceedings of the World Wide Web Conference, 2019

Character-Level Language Modeling with Deeper Self-Attention.

Rami Al-Rfou, Dokook Choe, Noah Constant, Mandy Guo, Llion Jones

Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019

2018

A Tutorial on Network Embeddings.

Haochen Chen, Bryan Perozzi, Rami Al-Rfou, Steven Skiena

CoRR, 2018

Watch Your Step: Learning Node Embeddings via Graph Attention.

Sami Abu-El-Haija, Bryan Perozzi, Rami Al-Rfou, Alexander A. Alemi

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

2017

Watch Your Step: Learning Graph Embeddings Through Attention.

Sami Abu-El-Haija, Bryan Perozzi, Rami Al-Rfou, Alex Alemi

CoRR, 2017

Creating Virtual Universes Using Generative Adversarial Networks.

Mustafa Mustafa, Deborah Bard, Wahid Bhimji, Rami Al-Rfou, Zarija Lukic

CoRR, 2017

Efficient Natural Language Response Suggestion for Smart Reply.

Matthew L. Henderson, Rami Al-Rfou, Brian Strope, Yun-Hsuan Sung, László Lukács, Ruiqi Guo, Sanjiv Kumar, Balint Miklos, Ray Kurzweil

CoRR, 2017

Detecting English Writing Styles For Non Native Speakers.

Yanging Chen, Rami Al-Rfou', Yejin Choi

CoRR, 2017

Learning Edge Representations via Low-Rank Asymmetric Projections.

Sami Abu-El-Haija, Bryan Perozzi, Rami Al-Rfou

Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, 2017

2016

A Growing Long-term Episodic & Semantic Memory.

Marc Pickett, Rami Al-Rfou, Louis Shao, Chris Tar

CoRR, 2016

Visualizing Linguistic Shift.

Salman Mahmood, Rami Al-Rfou, Klaus Mueller

CoRR, 2016

Conversational Contextual Cues: The Case of Personalization and History for Response Ranking.

Rami Al-Rfou, Marc Pickett, Javier Snaider, Yun-Hsuan Sung, Brian Strope, Ray Kurzweil

CoRR, 2016

Theano: A Python framework for fast computation of mathematical expressions.

Rami Al-Rfou, Guillaume Alain, Amjad Almahairi, Christof Angermüller, Dzmitry Bahdanau, Nicolas Ballas, Frédéric Bastien, Justin Bayer, Anatoly Belikov, Alexander Belopolsky, Yoshua Bengio, Arnaud Bergeron, James Bergstra, Valentin Bisson, Josh Bleecher Snyder, Nicolas Bouchard, Nicolas Boulanger-Lewandowski, Xavier Bouthillier, Alexandre de Brébisson, Olivier Breuleux, Pierre Luc Carrier, Kyunghyun Cho, Jan Chorowski, Paul F. Christiano, Tim Cooijmans, Marc-Alexandre Côté, Myriam Côté, Aaron C. Courville, Yann N. Dauphin, Olivier Delalleau, Julien Demouth, Guillaume Desjardins, Sander Dieleman, Laurent Dinh, Melanie Ducoffe, Vincent Dumoulin, Samira Ebrahimi Kahou, Dumitru Erhan, Ziye Fan, Orhan Firat, Mathieu Germain, Xavier Glorot, Ian J. Goodfellow, Matthew Graham, Çaglar Gülçehre, Philippe Hamel, Iban Harlouchet, Jean-Philippe Heng, Balázs Hidasi, Sina Honari, Arjun Jain, Sébastien Jean, Kai Jia, Mikhail Korobov, Vivek Kulkarni, Alex Lamb, Pascal Lamblin, Eric Larsen, César Laurent, Sean Lee, Simon Lefrançois, Simon Lemieux, Nicholas Léonard, Zhouhan Lin, Jesse A. Livezey, Cory Lorenz, Jeremiah Lowin, Qianli Ma, Pierre-Antoine Manzagol, Olivier Mastropietro, Robert McGibbon, Roland Memisevic, Bart van Merriënboer, Vincent Michalski, Mehdi Mirza, Alberto Orlandi, Christopher Joseph Pal, Razvan Pascanu, Mohammad Pezeshki, Colin Raffel, Daniel Renshaw, Matthew Rocklin, Adriana Romero, Markus Roth, Peter Sadowski, John Salvatier, François Savard, Jan Schlüter, John Schulman, Gabriel Schwartz, Iulian Vlad Serban, Dmitriy Serdyuk, Samira Shabanian, Étienne Simon, Sigurd Spieckermann, S. Ramana Subramanyam, Jakub Sygnowski, Jérémie Tanguay, Gijs van Tulder, Joseph P. Turian, Sebastian Urban, Pascal Vincent, Francesco Visin, Harm de Vries, David Warde-Farley, Dustin J. Webb, Matthew Willson, Kelvin Xu, Lijun Xue, Li Yao, Saizheng Zhang, Ying Zhang

CoRR, 2016

2015

Statistically Significant Detection of Linguistic Change.

Vivek Kulkarni, Rami Al-Rfou, Bryan Perozzi, Steven Skiena

Proceedings of the 24th International Conference on World Wide Web, 2015

POLYGLOT-NER: Massive Multilingual Named Entity Recognition.

Rami Al-Rfou, Vivek Kulkarni, Bryan Perozzi, Steven Skiena

Proceedings of the 2015 SIAM International Conference on Data Mining, Vancouver, BC, Canada, April 30, 2015

2014

Exploring the power of GPU's for training Polyglot language models.

Vivek Kulkarni, Rami Al-Rfou', Bryan Perozzi, Steven Skiena

CoRR, 2014

DeepWalk: online learning of social representations.

Bryan Perozzi, Rami Al-Rfou, Steven Skiena

Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2014

Inducing Language Networks from Continuous Space Word Representations.

Bryan Perozzi, Rami Al-Rfou', Vivek Kulkarni, Steven Skiena

Proceedings of the Complex Networks V, 2014

2013

The Expressive Power of Word Embeddings

Yanqing Chen, Bryan Perozzi, Rami Al-Rfou', Steven Skiena

CoRR, 2013

Polyglot: Distributed Word Representations for Multilingual NLP.

Rami Al-Rfou', Bryan Perozzi, Steven Skiena

Proceedings of the Seventeenth Conference on Computational Natural Language Learning, 2013

2012

Detecting English Writing Styles For Non-native Speakers

Rami Al-Rfou'

CoRR, 2012

TrackMeNot-so-good-after-all

Rami Al-Rfou', William Jannen, Nikhil Patwardhan

CoRR, 2012

SpeedRead: A Fast Named Entity Recognition Pipeline.

Rami Al-Rfou', Steven Skiena

Proceedings of the COLING 2012, 2012