A Scalable and Extensible Approach to Benchmarking NL2Code for 18 Programming Languages. - Federico Cassano; John Gouwar; Daniel Nguyen; Sydney Nguyen; Luna Phipps-Costin; Donald Pinckney; Ming-Ho Yee; Yangtian Zi; Carolyn Jane Anderson; Molly Q. Feldman; Arjun Guha; Michael Greenberg 002; et al. (CoRR, 2022)

MultiPL-E: A Scalable and Polyglot Approach to Benchmarking Neural Code Generation. - Federico Cassano; John Gouwar; Daniel Nguyen; Sydney Nguyen; Luna Phipps-Costin; Donald Pinckney; Ming-Ho Yee; Yangtian Zi; Carolyn Jane Anderson; Molly Q. Feldman; Arjun Guha; Michael Greenberg 002; et al. (IEEE Trans. Software Eng., 2023)

StudentEval: A Benchmark of Student-Written Prompts for Large Language Models of Code. - Hannah McLean Babe; Sydney Nguyen; Yangtian Zi; Arjun Guha; Molly Q. Feldman; Carolyn Jane Anderson (ACL (Findings), 2024)

How Beginning Programmers and Code LLMs (Mis)read Each Other. - Sydney Nguyen; Hannah McLean Babe; Yangtian Zi; Arjun Guha; Carolyn Jane Anderson; Molly Q. Feldman (CHI, 2024)