Large-scale text processing pipeline with Apache Spark. - Alexey Svyatkovskiy; Kosuke Imai; Mary Kroeger; Yuki Shiraito (IEEE BigData, 2016)

Training distributed deep recurrent neural networks with mixed precision on GPU clusters. - Alexey Svyatkovskiy; Julian Kates-Harbeck; William Tang 002 (MLHPC@SC, 2017)

Big Data in HEP: A comprehensive use case study. - Oliver Gutsche; Matteo Cremonesi; Peter Elmer; Bo Jayatilaka; Jim Kowalkowski; Jim Pivarski; Saba Sehrish; Cristina Mantilla Suarez; Alexey Svyatkovskiy; Nhan Tran (CoRR, 2017)

CMS Analysis and Data Reduction with Apache Spark. - Oliver Gutsche; Luca Canali; Illia Cremer; Matteo Cremonesi; Peter Elmer; Ian Fisk; Maria Girone; Bo Jayatilaka; Jim Kowalkowski; Viktor Khristenko; Evangelos Motesnitsalis; Jim Pivarski; et al. (CoRR, 2017)

Pythia: AI-assisted Code Completion System. - Alexey Svyatkovskiy; Ying Zhao; Shengyu Fu; Neel Sundaresan (KDD, 2019)

Using Big Data Technologies for HEP Analysis. - Matteo Cremonesi; Claudio Bellini; Bianny Bian; Luca Canali; Vasileios Dimakopoulos; Peter Elmer; Ian Fisk; Maria Girone; Oliver Gutsche; Siew-Yan Hoh; Bo Jayatilaka; Viktor Khristenko; et al. (CoRR, 2019)

Predicting disruptive instabilities in controlled fusion plasmas through deep learning. - Julian Kates-Harbeck; Alexey Svyatkovskiy; William Tang 002 (Nat., 2019)

PyMT5: multi-mode translation of natural language and Python code with transformers. - Colin B. Clement; Dawn Drain; Jonathan Timcheck; Alexey Svyatkovskiy; Neel Sundaresan (EMNLP (1), 2020)

IntelliCode compose: code generation using transformer. - Alexey Svyatkovskiy; Shao Kun Deng; Shengyu Fu; Neel Sundaresan (ESEC/SIGSOFT FSE, 2020)

Unit Test Case Generation with Transformers. - Michele Tufano; Dawn Drain; Alexey Svyatkovskiy; Shao Kun Deng; Neel Sundaresan (CoRR, 2020)

Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy. - Colin B. Clement; Shuai Lu; Xiaoyu Liu; Michele Tufano; Dawn Drain; Nan Duan; Neel Sundaresan; Alexey Svyatkovskiy (EMNLP (1), 2021)

GraphCodeBERT: Pre-training Code Representations with Data Flow. - Daya Guo; Shuo Ren; Shuai Lu; Zhangyin Feng; Duyu Tang; Shujie Liu 001; Long Zhou; Nan Duan; Alexey Svyatkovskiy; Shengyu Fu; Michele Tufano; Shao Kun Deng; et al. (ICLR, 2021)

Fast and Memory-Efficient Neural Code Completion. - Alexey Svyatkovskiy; Sebastian Lee; Anna Hadjitofi; Maik Riechert; Juliana Vicente Franco; Miltiadis Allamanis (MSR, 2021)

CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation. - Shuai Lu; Daya Guo; Shuo Ren; Junjie Huang 008; Alexey Svyatkovskiy; Ambrosio Blanco; Colin B. Clement; Dawn Drain; Daxin Jiang; Duyu Tang; Ge Li 001; Lidong Zhou; et al. (NeurIPS Datasets and Benchmarks, 2021)

Generating bug-fixes using pretrained transformers. - Dawn Drain; Chen Wu; Alexey Svyatkovskiy; Neel Sundaresan (MAPS@PLDI, 2021)

Learning to Generate Code Sketches. - Daya Guo; Alexey Svyatkovskiy; Jian Yin 001; Nan Duan; Marc Brockschmidt; Miltiadis Allamanis (CoRR, 2021)

MergeBERT: Program Merge Conflict Resolution via Neural Transformers. - Alexey Svyatkovskiy; Todd Mytkowicz; Negar Ghorbani; Sarah Fakhoury; Elizabeth Dinella; Christian Bird; Neel Sundaresan; Shuvendu K. Lahiri (CoRR, 2021)

ReACC: A Retrieval-Augmented Code Completion Framework. - Shuai Lu; Nan Duan; Hojae Han; Daya Guo; Seung-won Hwang; Alexey Svyatkovskiy (ACL (1), 2022)

Generating Accurate Assert Statements for Unit Test Cases using Pretrained Transformers. - Michele Tufano; Dawn Drain; Alexey Svyatkovskiy; Neel Sundaresan (AST@ICSE, 2022)

Learning to Complete Code with Sketches. - Daya Guo; Alexey Svyatkovskiy; Jian Yin 001; Nan Duan; Marc Brockschmidt; Miltiadis Allamanis (ICLR, 2022)

METHODS2TEST: A dataset of focal methods mapped to test cases. - Michele Tufano; Shao Kun Deng; Neel Sundaresan; Alexey Svyatkovskiy (MSR, 2022)

Automating code review activities by large-scale pre-training. - Zhiyu Li; Shuai Lu; Daya Guo; Nan Duan; Shailesh Jannu; Grant Jenks; Deep Majumder; Jared Green; Alexey Svyatkovskiy; Shengyu Fu; Neel Sundaresan (ESEC/SIGSOFT FSE, 2022)

Program merge conflict resolution via neural transformers. - Alexey Svyatkovskiy; Sarah Fakhoury; Negar Ghorbani; Todd Mytkowicz; Elizabeth Dinella; Christian Bird; Jinu Jang; Neel Sundaresan; Shuvendu K. Lahiri (ESEC/SIGSOFT FSE, 2022)

Exploring and evaluating personalized models for code generation. - Andrei Zlotchevski; Dawn Drain; Alexey Svyatkovskiy; Colin B. Clement; Neel Sundaresan; Michele Tufano (ESEC/SIGSOFT FSE, 2022)

CodeReviewer: Pre-Training for Automating Code Review Activities. - Zhiyu Li; Shuai Lu; Daya Guo; Nan Duan; Shailesh Jannu; Grant Jenks; Deep Majumder; Jared Green; Alexey Svyatkovskiy; Shengyu Fu; Neel Sundaresan (CoRR, 2022)

AdaptivePaste: Code Adaptation through Learning Semantics-aware Variable Usage Representations. - Xiaoyu Liu; Jinu Jang; Neel Sundaresan; Miltiadis Allamanis; Alexey Svyatkovskiy (CoRR, 2022)

Code Execution with Pre-trained Language Models. - Chenxiao Liu; Shuai Lu; Weizhu Chen; Daxin Jiang; Alexey Svyatkovskiy; Shengyu Fu; Neel Sundaresan; Nan Duan (ACL (Findings), 2023)

InferFix: End-to-End Program Repair with LLMs. - Matthew Jin; Syed Shahriar; Michele Tufano; Xin Shi; Shuai Lu; Neel Sundaresan; Alexey Svyatkovskiy (ESEC/SIGSOFT FSE, 2023)

AdaptivePaste: Intelligent Copy-Paste in IDE. - Xiaoyu Liu; Jinu Jang; Neel Sundaresan; Miltiadis Allamanis; Alexey Svyatkovskiy (ESEC/SIGSOFT FSE, 2023)

DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies. - Shuaiwen Leon Song; Bonnie Kruft; Minjia Zhang; Conglong Li; Shiyang Chen 004; Chengming Zhang 006; Masahiro Tanaka; Xiaoxia Wu; Jeff Rasley; Ammar Ahmad Awan; Connor Holmes; Martin Cai; et al. (CoRR, 2023)

DeepMerge: Learning to Merge Programs. - Elizabeth Dinella; Todd Mytkowicz; Alexey Svyatkovskiy; Christian Bird; Mayur Naik; Shuvendu K. Lahiri (IEEE Trans. Software Eng., 2023)

Program Merge: What's Deep Learning Got to Do with It?: A discussion with Shuvendu Lahiri, Alexey Svyatkovskiy, Christian Bird, Erik Meijer and Terry Coatta. - Shuvendu K. Lahiri; Alexey Svyatkovskiy; Christian Bird; Erik Meijer 001; Terry Coatta (ACM Queue, 2024)

Reinforcement Learning from Automatic Feedback for High-Quality Unit Test Generation. - Benjamin Steenhoek; Michele Tufano; Neel Sundaresan; Alexey Svyatkovskiy (DeepTest, 2025)

Program Merge: What's Deep Learning Got to Do with It? - Shuvendu K. Lahiri; Alexey Svyatkovskiy; Christian Bird; Erik Miejer; Terry Coatta (Commun. ACM, 2025)