Teaching Machines to Learn by Metaphors. - Omer Levy; Shaul Markovitch (AAAI, 2012)

Recognizing Partial Textual Entailment. - Omer Levy; Torsten Zesch; Ido Dagan; Iryna Gurevych (ACL (2), 2013)

UKP-BIU: Similarity and Entailment Metrics for Student Response Analysis. - Omer Levy; Torsten Zesch; Ido Dagan; Iryna Gurevych (SemEval@NAACL-HLT, 2013)

Dependency-Based Word Embeddings. - Omer Levy; Yoav Goldberg (ACL (2), 2014)

The Excitement Open Platform for Textual Inferences. - Bernardo Magnini; Roberto Zanoli; Ido Dagan; Kathrin Eichler; Guenter Neumann; Tae-Gil Noh; Sebastian Padó; Asher Stern 001; Omer Levy (ACL (System Demonstrations), 2014)

Focused Entailment Graphs for Open IE Propositions. - Omer Levy; Ido Dagan; Jacob Goldberger (CoNLL, 2014)

Linguistic Regularities in Sparse and Explicit Word Representations. - Omer Levy; Yoav Goldberg (CoNLL, 2014)

Neural Word Embedding as Implicit Matrix Factorization. - Omer Levy; Yoav Goldberg (NIPS, 2014)

word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding method. - Yoav Goldberg; Omer Levy (CoRR, 2014)

Learning to Exploit Structured Resources for Lexical Inference. - Vered Shwartz; Omer Levy; Ido Dagan; Jacob Goldberger (CoNLL, 2015)

Do Supervised Distributional Methods Really Learn Lexical Inference Relations? - Omer Levy; Steffen Remus; Chris Biemann; Ido Dagan (HLT-NAACL, 2015)

A Simple Word Embedding Model for Lexical Substitution. - Oren Melamud; Omer Levy; Ido Dagan (VS@HLT-NAACL, 2015)

Improving Distributional Similarity with Lessons Learned from Word Embeddings. - Omer Levy; Yoav Goldberg; Ido Dagan (Trans. Assoc. Comput. Linguistics, 2015)

Annotating Relation Inference in Context via Question Answering. - Omer Levy; Ido Dagan (ACL (2), 2016)

Modeling Extractive Sentence Intersection via Subtree Entailment. - Omer Levy; Ido Dagan; Gabriel Stanovsky; Judith Eckle-Kohler; Iryna Gurevych (COLING, 2016)

Reconsidering Cross-lingual Word Embeddings. - Omer Levy; Anders Søgaard; Yoav Goldberg (CoRR, 2016)

Named Entity Disambiguation for Noisy Text. - Yotam Eshel; Noam Cohen; Kira Radinsky; Shaul Markovitch; Ikuya Yamada; Omer Levy (CoNLL, 2017)

Zero-Shot Relation Extraction via Reading Comprehension. - Omer Levy; Minjoon Seo; Eunsol Choi; Luke Zettlemoyer (CoNLL, 2017)

A Strong Baseline for Learning Cross-Lingual Word Embeddings from Sentence Alignments. - Omer Levy; Anders Søgaard; Yoav Goldberg (EACL (1), 2017)

Recurrent Additive Networks. - Kenton Lee; Omer Levy; Luke Zettlemoyer (CoRR, 2017)

Deep RNNs Encode Soft Hierarchical Syntax. - Terra Blevins; Omer Levy; Luke Zettlemoyer (ACL (2), 2018)

Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling. - Luheng He; Kenton Lee; Omer Levy; Luke Zettlemoyer (ACL (2), 2018)

Long Short-Term Memory as a Dynamically Computed Element-wise Weighted Sum. - Omer Levy; Kenton Lee; Nicholas FitzGerald; Luke Zettlemoyer (ACL (2), 2018)

Ultra-Fine Entity Typing. - Eunsol Choi; Omer Levy; Yejin Choi 001; Luke Zettlemoyer (ACL (1), 2018)

GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding. - Alex Wang; Amanpreet Singh; Julian Michael; Felix Hill; Omer Levy; Samuel R. Bowman (BlackboxNLP@EMNLP, 2018)

Simulating Action Dynamics with Neural Process Networks. - Antoine Bosselut; Omer Levy; Ari Holtzman; Corin Ennis; Dieter Fox; Yejin Choi 001 (ICLR (Poster), 2018)

Annotation Artifacts in Natural Language Inference Data. - Suchin Gururangan; Swabha Swayamdipta; Omer Levy; Roy Schwartz 001; Samuel R. Bowman; Noah A. Smith (NAACL-HLT (2), 2018)

A general path-based representation for predicting program properties. - Uri Alon 002; Meital Zilberstein; Omer Levy; Eran Yahav (PLDI, 2018)

LSTMs Exploit Linguistic Attributes of Data. - Nelson F. Liu; Omer Levy; Roy Schwartz 001; Chenhao Tan; Noah A. Smith (Rep4NLP@ACL, 2018)

code2seq: Generating Sequences from Structured Representations of Code. - Uri Alon 002; Omer Levy; Eran Yahav (CoRR, 2018)

Training on Synthetic Noise Improves Robustness to Natural Noise in Machine Translation. - Vladimir Karpukhin; Omer Levy; Jacob Eisenstein; Marjan Ghazvininejad (W-NUT@EMNLP, 2019)

What Does BERT Look at? An Analysis of BERT's Attention. - Kevin Clark; Urvashi Khandelwal; Omer Levy; Christopher D. Manning (BlackboxNLP@ACL, 2019)

Mask-Predict: Parallel Decoding of Conditional Masked Language Models. - Marjan Ghazvininejad; Omer Levy; Yinhan Liu; Luke Zettlemoyer (EMNLP/IJCNLP (1), 2019)

BERT for Coreference Resolution: Baselines and Analysis. - Mandar Joshi; Omer Levy; Luke Zettlemoyer; Daniel S. Weld (EMNLP/IJCNLP (1), 2019)

code2seq: Generating Sequences from Structured Representations of Code. - Uri Alon 002; Shaked Brody; Omer Levy; Eran Yahav (ICLR (Poster), 2019)

Understanding large-scale software: a hierarchical view. - Omer Levy; Dror G. Feitelson (ICPC, 2019)

pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference. - Mandar Joshi; Eunsol Choi; Omer Levy; Daniel S. Weld; Luke Zettlemoyer (NAACL-HLT (1), 2019)

Are Sixteen Heads Really Better than One? - Paul Michel; Omer Levy; Graham Neubig (NeurIPS, 2019)

SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems. - Alex Wang; Yada Pruksachatkun; Nikita Nangia; Amanpreet Singh; Julian Michael; Felix Hill; Omer Levy; Samuel R. Bowman (NeurIPS, 2019)

Constant-Time Machine Translation with Conditional Masked Language Models. - Marjan Ghazvininejad; Omer Levy; Yinhan Liu; Luke Zettlemoyer (CoRR, 2019)

RoBERTa: A Robustly Optimized BERT Pretraining Approach. - Yinhan Liu; Myle Ott; Naman Goyal 001; Jingfei Du; Mandar Joshi; Danqi Chen 001; Omer Levy; Mike Lewis; Luke Zettlemoyer; Veselin Stoyanov (CoRR, 2019)

Structural Language Models for Any-Code Generation. - Uri Alon 002; Roy Sadaka; Omer Levy; Eran Yahav (CoRR, 2019)

code2vec: learning distributed representations of code. - Uri Alon 002; Meital Zilberstein; Omer Levy; Eran Yahav (Proc. ACM Program. Lang., 2019)

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. - Mike Lewis; Yinhan Liu; Naman Goyal 001; Marjan Ghazvininejad; Abdelrahman Mohamed; Omer Levy; Veselin Stoyanov; Luke Zettlemoyer (ACL, 2020)

Improving Transformer Models by Reordering their Sublayers. - Ofir Press; Noah A. Smith; Omer Levy (ACL, 2020)

Blockwise Self-Attention for Long Document Understanding. - Jiezhong Qiu; Hao Ma 001; Omer Levy; Wen-tau Yih; Sinong Wang; Jie Tang 001 (EMNLP (Findings), 2020)

Generalization through Memorization: Nearest Neighbor Language Models. - Urvashi Khandelwal; Omer Levy; Dan Jurafsky; Luke Zettlemoyer; Mike Lewis (ICLR, 2020)

Structural Language Models of Code. - Uri Alon 002; Roy Sadaka; Omer Levy; Eran Yahav (ICML, 2020)

Aligned Cross Entropy for Non-Autoregressive Machine Translation. - Marjan Ghazvininejad; Vladimir Karpukhin; Luke Zettlemoyer; Omer Levy (ICML, 2020)

Semi-Autoregressive Training Improves Mask-Predict Decoding. - Marjan Ghazvininejad; Omer Levy; Luke Zettlemoyer (CoRR, 2020)

The Turking Test: Can Language Models Understand Instructions? - Avia Efrat; Omer Levy (CoRR, 2020)

Emergent linguistic structure in artificial neural networks trained by self-supervision. - Christopher D. Manning; Kevin Clark; John Hewitt; Urvashi Khandelwal; Omer Levy (Proc. Natl. Acad. Sci. USA, 2020)

SpanBERT: Improving Pre-training by Representing and Predicting Spans. - Mandar Joshi; Danqi Chen 001; Yinhan Liu; Daniel S. Weld; Luke Zettlemoyer; Omer Levy (Trans. Assoc. Comput. Linguistics, 2020)

Coreference Resolution without Span Representations. - Yuval Kirstain; Ori Ram; Omer Levy (ACL/IJCNLP (2), 2021)

Few-Shot Question Answering by Pretraining Span Selection. - Ori Ram; Yuval Kirstain; Jonathan Berant; Amir Globerson; Omer Levy (ACL/IJCNLP (1), 2021)

Cryptonite: A Cryptic Crossword Benchmark for Extreme Ambiguity in Language. - Avia Efrat; Uri Shaham 002; Dan Kilman; Omer Levy (EMNLP (1), 2021)

Transformer Feed-Forward Layers Are Key-Value Memories. - Mor Geva; Roei Schuster; Jonathan Berant; Omer Levy (EMNLP (1), 2021)

How to Train BERT with an Academic Budget. - Peter Izsak; Moshe Berchansky; Omer Levy (EMNLP (1), 2021)

Can Latent Alignments Improve Autoregressive Machine Translation? - Adi Haviv; Lior Vassertail; Omer Levy (NAACL-HLT, 2021)

Neural Machine Translation without Embeddings. - Uri Shaham 002; Omer Levy (NAACL-HLT, 2021)

ParaShoot: A Hebrew Question Answering Dataset. - Omri Keren; Omer Levy (CoRR, 2021)

Understanding large-scale software systems - structure and flows. - Omer Levy; Dror G. Feitelson (Empir. Softw. Eng., 2021)

What Do You Get When You Cross Beam Search with Nucleus Sampling? - Uri Shaham 002; Omer Levy (Insights@ACL, 2022)

How Optimal is Greedy Decoding for Extractive Question Answering? - Or Castel; Ori Ram; Avia Efrat; Omer Levy (AKBC, 2022)

SCROLLS: Standardized CompaRison Over Long Language Sequences. - Uri Shaham 002; Elad Segal; Maor Ivgi; Avia Efrat; Ori Yoran; Adi Haviv; Ankit Gupta 001; Wenhan Xiong; Mor Geva; Jonathan Berant; Omer Levy (EMNLP, 2022)

Transformer Language Models without Positional Encodings Still Learn Positional Information. - Adi Haviv; Ori Ram; Ofir Press; Peter Izsak; Omer Levy (EMNLP (Findings), 2022)

A Few More Examples May Be Worth Billions of Parameters. - Yuval Kirstain; Patrick Lewis 001; Sebastian Riedel 001; Omer Levy (EMNLP (Findings), 2022)

Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens. - Itay Itzhak; Omer Levy (NAACL-HLT, 2022)

Learning to Retrieve Passages without Supervision. - Ori Ram; Gal Shachaf; Omer Levy; Jonathan Berant; Amir Globerson (NAACL-HLT, 2022)

Simple Local Attentions Remain Competitive for Long-Context Tasks. - Wenhan Xiong; Barlas Oguz; Anchit Gupta; Xilun Chen 002; Diana Liskovich; Omer Levy; Scott Yih; Yashar Mehdad (NAACL-HLT, 2022)

Are Mutually Intelligible Languages Easier to Translate? - Avital Friedland; Jonathan Zeltser; Omer Levy (CoRR, 2022)

Breaking Character: Are Subwords Good Enough for MRLs After All? - Omri Keren; Tal Avinari; Reut Tsarfaty; Omer Levy (CoRR, 2022)

A Simple Baseline for Beam Search Reranking. - Lior Vassertail; Omer Levy (CoRR, 2022)

Causes and Cures for Interference in Multilingual Translation. - Uri Shaham 002; Maha Elbayad; Vedanuj Goswami; Omer Levy; Shruti Bhosale (ACL (1), 2023)

LMentry: A Language Model Benchmark of Elementary Language Tasks. - Avia Efrat; Or Honovich; Omer Levy (ACL (Findings), 2023)

Instruction Induction: From Few Examples to Natural Language Task Descriptions. - Or Honovich; Uri Shaham 002; Samuel R. Bowman; Omer Levy (ACL (1), 2023)

Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor. - Or Honovich; Thomas Scialom; Omer Levy; Timo Schick (ACL (1), 2023)

Vision Transformers with Mixed-Resolution Tokenization. - Tomer Ronen; Omer Levy; Avram Golbert (CVPR Workshops, 2023)

ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding. - Uri Shaham 002; Maor Ivgi; Avia Efrat; Jonathan Berant; Omer Levy (EMNLP (Findings), 2023)

Scaling Laws for Generative Mixed-Modal Language Models. - Armen Aghajanyan; Lili Yu; Alexis Conneau; Wei-Ning Hsu; Karen Hambardzumyan; Susan Zhang; Stephen Roller; Naman Goyal 001; Omer Levy; Luke Zettlemoyer (ICML, 2023)

Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation. - Yuval Kirstain; Adam Polyak; Uriel Singer; Shahbuland Matiana; Joe Penna; Omer Levy (NeurIPS, 2023)

LIMA: Less Is More for Alignment. - Chunting Zhou; Pengfei Liu; Puxin Xu; Srinivasan Iyer 001; Jiao Sun; Yuning Mao; Xuezhe Ma; Avia Efrat; Ping Yu; Lili Yu; Susan Zhang; Gargi Ghosh; et al. (NeurIPS, 2023)

X&Fuse: Fusing Visual Information in Text-to-Image Generation. - Yuval Kirstain; Omer Levy; Adam Polyak (CoRR, 2023)

The Temporal Structure of Language Processing in the Human Brain Corresponds to The Layered Hierarchy of Deep Language Models. - Ariel Goldstein; Eric Ham; Mariano Schain; Samuel A. Nastase; Zaid Zada; Avigail Dabush; Bobbi Aubrey; Harshvardhan Gazula; Amir Feder; Werner K. Doyle; Sasha Devore; Patricia Dugan; et al. (CoRR, 2023)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. - Aarohi Srivastava; Abhinav Rastogi; Abhishek Rao; Abu Awal Md Shoeb; Abubakar Abid; Adam Fisch; Adam R. Brown; Adam Santoro; Aditya Gupta; Adrià Garriga-Alonso; Agnieszka Kluska; Aitor Lewkowycz; et al. (Trans. Mach. Learn. Res., 2023)

Altogether: Image Captioning via Re-aligning Alt-text. - Hu Xu 001; Po-Yao Huang 001; Xiaoqing Ellen Tan; Ching-Feng Yeh; Jacob Kahn; Christine Jou; Gargi Ghosh; Omer Levy; Luke Zettlemoyer; Wen-tau Yih; Shang-Wen Li 001; Saining Xie; et al. (EMNLP, 2024)

Self-Alignment with Instruction Backtranslation. - Xian Li 003; Ping Yu; Chunting Zhou; Timo Schick; Omer Levy; Luke Zettlemoyer; Jason Weston; Mike Lewis (ICLR, 2024)

Branch-Solve-Merge Improves Large Language Model Evaluation and Generation. - Swarnadeep Saha; Omer Levy; Asli Celikyilmaz; Mohit Bansal; Jason Weston; Xian Li 003 (NAACL-HLT, 2024)

Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length. - Xuezhe Ma; Xiaomeng Yang; Wenhan Xiong; Beidi Chen; Lili Yu; Hao Zhang 025; Jonathan May; Luke Zettlemoyer; Omer Levy; Chunting Zhou (NeurIPS, 2024)

Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model. - Chunting Zhou; Lili Yu; Arun Babu; Kushal Tirumala; Michihiro Yasunaga; Leonid Shamis; Jacob Kahn; Xuezhe Ma; Luke Zettlemoyer; Omer Levy (ICLR, 2025)

Keep Guessing? When Considering Inference Scaling, Mind the Baselines. - Gal Yona; Or Honovich; Omer Levy; Roee Aharoni (NAACL (Findings), 2025)