Pythia: AI-assisted Code Completion System. - Alexey Svyatkovskiy; Ying Zhao; Shengyu Fu; Neel Sundaresan (KDD, 2019)

IntelliCode compose: code generation using transformer. - Alexey Svyatkovskiy; Shao Kun Deng; Shengyu Fu; Neel Sundaresan (ESEC/SIGSOFT FSE, 2020)

GraphCodeBERT: Pre-training Code Representations with Data Flow. - Daya Guo; Shuo Ren; Shuai Lu; Zhangyin Feng; Duyu Tang; Shujie Liu 001; Long Zhou; Nan Duan; Alexey Svyatkovskiy; Shengyu Fu; Michele Tufano; Shao Kun Deng; et al. (ICLR, 2021)

CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation. - Shuai Lu; Daya Guo; Shuo Ren; Junjie Huang 008; Alexey Svyatkovskiy; Ambrosio Blanco; Colin B. Clement; Dawn Drain; Daxin Jiang; Duyu Tang; Ge Li 001; Lidong Zhou; et al. (NeurIPS Datasets and Benchmarks, 2021)

Automating code review activities by large-scale pre-training. - Zhiyu Li; Shuai Lu; Daya Guo; Nan Duan; Shailesh Jannu; Grant Jenks; Deep Majumder; Jared Green; Alexey Svyatkovskiy; Shengyu Fu; Neel Sundaresan (ESEC/SIGSOFT FSE, 2022)

CodeReviewer: Pre-Training for Automating Code Review Activities. - Zhiyu Li; Shuai Lu; Daya Guo; Nan Duan; Shailesh Jannu; Grant Jenks; Deep Majumder; Jared Green; Alexey Svyatkovskiy; Shengyu Fu; Neel Sundaresan (CoRR, 2022)

Code Execution with Pre-trained Language Models. - Chenxiao Liu; Shuai Lu; Weizhu Chen; Daxin Jiang; Alexey Svyatkovskiy; Shengyu Fu; Neel Sundaresan; Nan Duan (ACL (Findings), 2023)

SWE-bench Goes Live! - Linghao Zhang; Shilin He; Chaoyun Zhang; Yu Kang 006; Bowen Li 002; Chengxing Xie; Junhao Wang; Maoquan Wang; Yufan Huang; Shengyu Fu; Elsie Nallipogu; Qingwei Lin; et al. (CoRR, 2025)