Ofir Press

According to our database, Ofir Press authored at least 13 papers between 2017 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2023

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Carlos E. Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, Karthik Narasimhan

CoRR, 2023

How Language Model Hallucinations Can Snowball.

Muru Zhang, Ofir Press, William Merrill, Alisa Liu, Noah A. Smith

CoRR, 2023

Measuring and Narrowing the Compositionality Gap in Language Models.

Ofir Press, Muru Zhang, Sewon Min, Ludwig Schmidt, Noah A. Smith, Mike Lewis

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

2022

What Language Model to Train if You Have One Million GPU Hours?

Teven Le Scao, Thomas Wang, Daniel Hesslow, Lucile Saulnier, Stas Bekman, M. Saiful Bari, Stella Biderman, Hady Elsahar, Niklas Muennighoff, Jason Phang, Ofir Press, Colin Raffel, Victor Sanh, Sheng Shen, Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, Iz Beltagy

CoRR, 2022

Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation.

Ofir Press, Noah A. Smith, Mike Lewis

Proceedings of the Tenth International Conference on Learning Representations, 2022

What Language Model to Train if You Have One Million GPU Hours?

Teven Le Scao, Thomas Wang, Daniel Hesslow, Stas Bekman, M. Saiful Bari, Stella Biderman, Hady Elsahar, Niklas Muennighoff, Jason Phang, Ofir Press, Colin Raffel, Victor Sanh, Sheng Shen, Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, Iz Beltagy

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Transformer Language Models without Positional Encodings Still Learn Positional Information.

Adi Haviv, Ori Ram, Ofir Press, Peter Izsak, Omer Levy

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

2021

Shortformer: Better Language Modeling using Shorter Inputs.

Ofir Press, Noah A. Smith, Mike Lewis

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

Improving Transformer Models by Reordering their Sublayers.

Ofir Press, Noah A. Smith, Omer Levy

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Partially Shuffling the Training Data to Improve Language Models.

Ofir Press

CoRR, 2019

2018

You May Not Need Attention.

Ofir Press, Noah A. Smith

CoRR, 2018

2017

Language Generation with Recurrent Generative Adversarial Networks without Pre-training.

Ofir Press, Amir Bar, Ben Bogin, Jonathan Berant, Lior Wolf

CoRR, 2017

Using the Output Embedding to Improve Language Models.

Ofir Press, Lior Wolf

Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, 2017