Using the Output Embedding to Improve Language Models. - Ofir Press; Lior Wolf (EACL (2), 2017)

Language Generation with Recurrent Generative Adversarial Networks without Pre-training. - Ofir Press; Amir Bar; Ben Bogin; Jonathan Berant; Lior Wolf (CoRR, 2017)

You May Not Need Attention. - Ofir Press; Noah A. Smith (CoRR, 2018)

Partially Shuffling the Training Data to Improve Language Models. - Ofir Press (CoRR, 2019)

Improving Transformer Models by Reordering their Sublayers. - Ofir Press; Noah A. Smith; Omer Levy (ACL, 2020)

Shortformer: Better Language Modeling using Shorter Inputs. - Ofir Press; Noah A. Smith; Mike Lewis (ACL/IJCNLP (1), 2021)

Transformer Language Models without Positional Encodings Still Learn Positional Information. - Adi Haviv; Ori Ram; Ofir Press; Peter Izsak; Omer Levy (EMNLP (Findings), 2022)

What Language Model to Train if You Have One Million GPU Hours? - Teven Le Scao; Thomas Wang; Daniel Hesslow; Lucile Saulnier; Stas Bekman; M. Saiful Bari; Stella Biderman; Hady Elsahar; Niklas Muennighoff; Jason Phang; Ofir Press; Colin Raffel; et al. (EMNLP (Findings), 2022)

Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation. - Ofir Press; Noah A. Smith; Mike Lewis (ICLR, 2022)

Measuring and Narrowing the Compositionality Gap in Language Models. - Ofir Press; Muru Zhang; Sewon Min; Ludwig Schmidt; Noah A. Smith; Mike Lewis (EMNLP (Findings), 2023)

Complementing Scale: Novel Guidance Methods for Improving Language Models - Ofir Press (2023)

AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks? - Ori Yoran; Samuel Joseph Amouyal; Chaitanya Malaviya; Ben Bogin; Ofir Press; Jonathan Berant (EMNLP, 2024)

SWE-bench: Can Language Models Resolve Real-world Github Issues? - Carlos E. Jimenez; John Yang 002; Alexander Wettig; Shunyu Yao; Kexin Pei; Ofir Press; Karthik R. Narasimhan (ICLR, 2024)

How Language Model Hallucinations Can Snowball. - Muru Zhang; Ofir Press; William Merrill; Alisa Liu; Noah A. Smith (ICML, 2024)

CiteME: Can Language Models Accurately Cite Scientific Claims? - Ori Press; Andreas Hochlehnert; Ameya Prabhu; Vishaal Udandarao; Ofir Press; Matthias Bethge (NeurIPS, 2024)

SciCode: A Research Coding Benchmark Curated by Scientists. - Minyang Tian; Luyu Gao; Shizhuo Dylan Zhang; Xinan Chen; Cunwei Fan; Xuefei Guo; Roland Haas; Pan Ji; Kittithat Krongchon; Yao Li; Shengyan Liu; Di Luo; et al. (NeurIPS, 2024)

SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering. - John Yang 002; Carlos E. Jimenez; Alexander Wettig; Kilian Lieret; Shunyu Yao; Karthik Narasimhan; Ofir Press (NeurIPS, 2024)

SciCode: A Research Coding Benchmark Curated by Scientists. - Minyang Tian; Luyu Gao; Shizhuo Dylan Zhang; Xinan Chen; Cunwei Fan; Xuefei Guo; Roland Haas; Pan Ji; Kittithat Krongchon; Yao Li; Shengyan Liu; Di Luo; et al. (CoRR, 2024)

EnIGMA: Enhanced Interactive Generative Model Agent for CTF Challenges. - Talor Abramovich; Meet Udeshi; Minghao Shao; Kilian Lieret; Haoran Xi; Kimberly Milner; Sofija Jancheska; John Yang 002; Carlos E. Jimenez; Farshad Khorrami; Prashanth Krishnamurthy; Brendan Dolan-Gavitt; et al. (CoRR, 2024)

SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains? - John Yang 002; Carlos E. Jimenez; Alex L. Zhang; Kilian Lieret; Joyce Yang; Xindi Wu; Ori Press; Niklas Muennighoff; Gabriel Synnaeve; Karthik R. Narasimhan; Diyi Yang; Sida Wang 001; et al. (ICLR, 2025)

SWE-smith: Scaling Data for Software Engineering Agents. - John Yang 002; Kilian Leret; Carlos E. Jimenez; Alexander Wettig; Kabir Khandpur; Yanzhe Zhang; Binyuan Hui; Ofir Press; Ludwig Schmidt; Diyi Yang (CoRR, 2025)

VideoGameBench: Can Vision-Language Models complete popular video games? - Alex L. Zhang; Thomas L. Griffiths 001; Karthik R. Narasimhan; Ofir Press (CoRR, 2025)

AlgoTune: Can Language Models Speed Up General-Purpose Numerical Programs? - Ori Press; Brandon Amos; Haoyu Zhao; Yikai Wu 001; Samuel K. Ainsworth; Dominik Krupke; Patrick Kidger; Touqir Sajed; Bartolomeo Stellato; Jisun Park 003; Nathanael Bosch; Eli Meril; et al. (CoRR, 2025)