Omer Levy

According to our database, Omer Levy authored at least 86 papers between 2012 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2023

Branch-Solve-Merge Improves Large Language Model Evaluation and Generation.

Swarnadeep Saha, Omer Levy, Asli Celikyilmaz, Mohit Bansal, Jason Weston, Xian Li

CoRR, 2023

The Temporal Structure of Language Processing in the Human Brain Corresponds to The Layered Hierarchy of Deep Language Models.

Ariel Goldstein, Eric Ham, Mariano Schain, Samuel A. Nastase, Zaid Zada, Avigail Dabush, Bobbi Aubrey, Harshvardhan Gazula, Amir Feder, Werner K. Doyle, Sasha Devore, Patricia Dugan, Daniel Friedman, Roi Reichart, Michael P. Brenner, Avinatan Hassidim, Orrin Devinsky, Adeen Flinker, Omer Levy, Uri Hasson

CoRR, 2023

Self-Alignment with Instruction Backtranslation.

Xian Li, Ping Yu, Chunting Zhou, Timo Schick, Luke Zettlemoyer, Omer Levy, Jason Weston, Mike Lewis

CoRR, 2023

X&Fuse: Fusing Visual Information in Text-to-Image Generation.

Yuval Kirstain, Omer Levy, Adam Polyak

CoRR, 2023

LIMA: Less Is More for Alignment.

Chunting Zhou, Pengfei Liu, Puxin Xu, Srinivasan Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili Yu, Susan Zhang, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer, Omer Levy

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation.

Yuval Kirstain, Adam Polyak, Uriel Singer, Shahbuland Matiana, Joe Penna, Omer Levy

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Scaling Laws for Generative Mixed-Modal Language Models.

Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer

Proceedings of the International Conference on Machine Learning, 2023

ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding.

Uri Shaham, Maor Ivgi, Avia Efrat, Jonathan Berant, Omer Levy

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Vision Transformers with Mixed-Resolution Tokenization.

Tomer Ronen, Omer Levy, Avram Golbert

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor.

Or Honovich, Thomas Scialom, Omer Levy, Timo Schick

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Instruction Induction: From Few Examples to Natural Language Task Descriptions.

Or Honovich, Uri Shaham, Samuel R. Bowman, Omer Levy

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

LMentry: A Language Model Benchmark of Elementary Language Tasks.

Avia Efrat, Or Honovich, Omer Levy

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

Causes and Cures for Interference in Multilingual Translation.

Uri Shaham, Maha Elbayad, Vedanuj Goswami, Omer Levy, Shruti Bhosale

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

A Simple Baseline for Beam Search Reranking.

Lior Vassertail, Omer Levy

CoRR, 2022

Breaking Character: Are Subwords Good Enough for MRLs After All?

Omri Keren, Tal Avinari, Reut Tsarfaty, Omer Levy

CoRR, 2022

Are Mutually Intelligible Languages Easier to Translate?

Avital Friedland, Jonathan Zeltser, Omer Levy

CoRR, 2022

Simple Local Attentions Remain Competitive for Long-Context Tasks.

Wenhan Xiong, Barlas Oguz, Anchit Gupta, Xilun Chen, Diana Liskovich, Omer Levy, Scott Yih, Yashar Mehdad

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Learning to Retrieve Passages without Supervision.

Ori Ram, Gal Shachaf, Omer Levy, Jonathan Berant, Amir Globerson

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens.

Itay Itzhak, Omer Levy

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

A Few More Examples May Be Worth Billions of Parameters.

Yuval Kirstain, Patrick S. H. Lewis, Sebastian Riedel, Omer Levy

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Transformer Language Models without Positional Encodings Still Learn Positional Information.

Adi Haviv, Ori Ram, Ofir Press, Peter Izsak, Omer Levy

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

SCROLLS: Standardized CompaRison Over Long Language Sequences.

Uri Shaham, Elad Segal, Maor Ivgi, Avia Efrat, Ori Yoran, Adi Haviv, Ankit Gupta, Wenhan Xiong, Mor Geva, Jonathan Berant, Omer Levy

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

What Do You Get When You Cross Beam Search with Nucleus Sampling?

Uri Shaham, Omer Levy

Proceedings of the Third Workshop on Insights from Negative Results in NLP, 2022

2021

Understanding large-scale software systems - structure and flows.

Omer Levy, Dror G. Feitelson

Empir. Softw. Eng., 2021

ParaShoot: A Hebrew Question Answering Dataset.

Omri Keren, Omer Levy

CoRR, 2021

How Optimal is Greedy Decoding for Extractive Question Answering?

Or Castel, Ori Ram, Avia Efrat, Omer Levy

CoRR, 2021

Neural Machine Translation without Embeddings.

Uri Shaham, Omer Levy

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Can Latent Alignments Improve Autoregressive Machine Translation?

Adi Haviv, Lior Vassertail, Omer Levy

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

How to Train BERT with an Academic Budget.

Peter Izsak, Moshe Berchansky, Omer Levy

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Transformer Feed-Forward Layers Are Key-Value Memories.

Mor Geva, Roei Schuster, Jonathan Berant, Omer Levy

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Cryptonite: A Cryptic Crossword Benchmark for Extreme Ambiguity in Language.

Avia Efrat, Uri Shaham, Dan Kilman, Omer Levy

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Few-Shot Question Answering by Pretraining Span Selection.

Ori Ram, Yuval Kirstain, Jonathan Berant, Amir Globerson, Omer Levy

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

Coreference Resolution without Span Representations.

Yuval Kirstain, Ori Ram, Omer Levy

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

SpanBERT: Improving Pre-training by Representing and Predicting Spans.

Mandar Joshi, Danqi Chen, Yinhan Liu, Daniel S. Weld, Luke Zettlemoyer, Omer Levy

Trans. Assoc. Comput. Linguistics, 2020

Emergent linguistic structure in artificial neural networks trained by self-supervision.

Christopher D. Manning, Kevin Clark, John Hewitt, Urvashi Khandelwal, Omer Levy

Proc. Natl. Acad. Sci. USA, 2020

The Turking Test: Can Language Models Understand Instructions?

Avia Efrat, Omer Levy

CoRR, 2020

Semi-Autoregressive Training Improves Mask-Predict Decoding.

Marjan Ghazvininejad, Omer Levy, Luke Zettlemoyer

CoRR, 2020

Aligned Cross Entropy for Non-Autoregressive Machine Translation.

Marjan Ghazvininejad, Vladimir Karpukhin, Luke Zettlemoyer, Omer Levy

Proceedings of the 37th International Conference on Machine Learning, 2020

Structural Language Models of Code.

Uri Alon, Roy Sadaka, Omer Levy, Eran Yahav

Proceedings of the 37th International Conference on Machine Learning, 2020

Generalization through Memorization: Nearest Neighbor Language Models.

Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, Mike Lewis

Proceedings of the 8th International Conference on Learning Representations, 2020

Blockwise Self-Attention for Long Document Understanding.

Jiezhong Qiu, Hao Ma, Omer Levy, Wen-tau Yih, Sinong Wang, Jie Tang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020

Improving Transformer Models by Reordering their Sublayers.

Ofir Press, Noah A. Smith, Omer Levy

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension.

Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, Luke Zettlemoyer

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

code2vec: learning distributed representations of code.

Uri Alon, Meital Zilberstein, Omer Levy, Eran Yahav

Proc. ACM Program. Lang., 2019

Structural Language Models for Any-Code Generation.

Uri Alon, Roy Sadaka, Omer Levy, Eran Yahav

CoRR, 2019

RoBERTa: A Robustly Optimized BERT Pretraining Approach.

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, Veselin Stoyanov

CoRR, 2019

Constant-Time Machine Translation with Conditional Masked Language Models.

Marjan Ghazvininejad, Omer Levy, Yinhan Liu, Luke Zettlemoyer

CoRR, 2019

SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems.

Alex Wang, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, Samuel R. Bowman

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Are Sixteen Heads Really Better than One?

Paul Michel, Omer Levy, Graham Neubig

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference.

Mandar Joshi, Eunsol Choi, Omer Levy, Daniel S. Weld, Luke Zettlemoyer

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Understanding large-scale software: a hierarchical view.

Omer Levy, Dror G. Feitelson

Proceedings of the 27th International Conference on Program Comprehension, 2019

code2seq: Generating Sequences from Structured Representations of Code.

Uri Alon, Shaked Brody, Omer Levy, Eran Yahav

Proceedings of the 7th International Conference on Learning Representations, 2019

BERT for Coreference Resolution: Baselines and Analysis.

Mandar Joshi, Omer Levy, Luke Zettlemoyer, Daniel S. Weld

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Mask-Predict: Parallel Decoding of Conditional Masked Language Models.

Marjan Ghazvininejad, Omer Levy, Yinhan Liu, Luke Zettlemoyer

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

What Does BERT Look at? An Analysis of BERT's Attention.

Kevin Clark, Urvashi Khandelwal, Omer Levy, Christopher D. Manning

Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, 2019

Training on Synthetic Noise Improves Robustness to Natural Noise in Machine Translation.

Vladimir Karpukhin, Omer Levy, Jacob Eisenstein, Marjan Ghazvininejad

Proceedings of the 5th Workshop on Noisy User-generated Text, 2019

2018

code2seq: Generating Sequences from Structured Representations of Code.

Uri Alon, Omer Levy, Eran Yahav

CoRR, 2018

LSTMs Exploit Linguistic Attributes of Data.

Nelson F. Liu, Omer Levy, Roy Schwartz, Chenhao Tan, Noah A. Smith

Proceedings of The Third Workshop on Representation Learning for NLP, 2018

A general path-based representation for predicting program properties.

Uri Alon, Meital Zilberstein, Omer Levy, Eran Yahav

Proceedings of the 39th ACM SIGPLAN Conference on Programming Language Design and Implementation, 2018

Annotation Artifacts in Natural Language Inference Data.

Suchin Gururangan, Swabha Swayamdipta, Omer Levy, Roy Schwartz, Samuel R. Bowman, Noah A. Smith

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Simulating Action Dynamics with Neural Process Networks.

Antoine Bosselut, Omer Levy, Ari Holtzman, Corin Ennis, Dieter Fox, Yejin Choi

Proceedings of the 6th International Conference on Learning Representations, 2018

GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding.

Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, Samuel R. Bowman

Proceedings of the Workshop: Analyzing and Interpreting Neural Networks for NLP, 2018

Ultra-Fine Entity Typing.

Eunsol Choi, Omer Levy, Yejin Choi, Luke Zettlemoyer

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

Long Short-Term Memory as a Dynamically Computed Element-wise Weighted Sum.

Omer Levy, Kenton Lee, Nicholas FitzGerald, Luke Zettlemoyer

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling.

Luheng He, Kenton Lee, Omer Levy, Luke Zettlemoyer

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

Deep RNNs Encode Soft Hierarchical Syntax.

Terra Blevins, Omer Levy, Luke Zettlemoyer

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

Recurrent Additive Networks.

Kenton Lee, Omer Levy, Luke Zettlemoyer

CoRR, 2017

A Strong Baseline for Learning Cross-Lingual Word Embeddings from Sentence Alignments.

Omer Levy, Anders Søgaard, Yoav Goldberg

Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, 2017

Zero-Shot Relation Extraction via Reading Comprehension.

Omer Levy, Minjoon Seo, Eunsol Choi, Luke Zettlemoyer

Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), 2017

Named Entity Disambiguation for Noisy Text.

Yotam Eshel, Noam Cohen, Kira Radinsky, Shaul Markovitch, Ikuya Yamada, Omer Levy

Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), 2017

2016

Reconsidering Cross-lingual Word Embeddings.

Omer Levy, Anders Søgaard, Yoav Goldberg

CoRR, 2016

Modeling Extractive Sentence Intersection via Subtree Entailment.

Omer Levy, Ido Dagan, Gabriel Stanovsky, Judith Eckle-Kohler, Iryna Gurevych

Proceedings of the COLING 2016, 2016

Annotating Relation Inference in Context via Question Answering.

Omer Levy, Ido Dagan

Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, 2016

2015

Improving Distributional Similarity with Lessons Learned from Word Embeddings.

Omer Levy, Yoav Goldberg, Ido Dagan

Trans. Assoc. Comput. Linguistics, 2015

A Simple Word Embedding Model for Lexical Substitution.

Oren Melamud, Omer Levy, Ido Dagan

Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing, 2015

Do Supervised Distributional Methods Really Learn Lexical Inference Relations?

Omer Levy, Steffen Remus, Chris Biemann, Ido Dagan

Proceedings of the NAACL HLT 2015, The 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Denver, Colorado, USA, May 31, 2015

Learning to Exploit Structured Resources for Lexical Inference.

Vered Shwartz, Omer Levy, Ido Dagan, Jacob Goldberger

Proceedings of the 19th Conference on Computational Natural Language Learning, 2015

2014

word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding method.

Yoav Goldberg, Omer Levy

CoRR, 2014

Neural Word Embedding as Implicit Matrix Factorization.

Omer Levy, Yoav Goldberg

Proceedings of the Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, 2014

Linguistic Regularities in Sparse and Explicit Word Representations.

Omer Levy, Yoav Goldberg

Proceedings of the Eighteenth Conference on Computational Natural Language Learning, 2014

Focused Entailment Graphs for Open IE Propositions.

Omer Levy, Ido Dagan, Jacob Goldberger

Proceedings of the Eighteenth Conference on Computational Natural Language Learning, 2014

The Excitement Open Platform for Textual Inferences.

Bernardo Magnini, Roberto Zanoli, Ido Dagan, Kathrin Eichler, Guenter Neumann, Tae-Gil Noh, Sebastian Padó, Asher Stern, Omer Levy

Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014

Dependency-Based Word Embeddings.

Omer Levy, Yoav Goldberg

Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014

2013

UKP-BIU: Similarity and Entailment Metrics for Student Response Analysis.

Omer Levy, Torsten Zesch, Ido Dagan, Iryna Gurevych

Proceedings of the 7th International Workshop on Semantic Evaluation, 2013

Recognizing Partial Textual Entailment.

Omer Levy, Torsten Zesch, Ido Dagan, Iryna Gurevych

Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, 2013

2012

Teaching Machines to Learn by Metaphors.

Omer Levy, Shaul Markovitch

Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, 2012