Enabling Transformers to Understand Low-Level Programs. - Zifan Carl Guo; William S. Moses (HPEC, 2022)

Algorithmic progress in language models. - Anson Ho; Tamay Besiroglu; Ege Erdil; Zifan Carl Guo; David Owen 001; Robi Rahman; David Atkinson; Neil Thompson; Jaime Sevilla (NeurIPS, 2024)

Opening the AI black box: program synthesis via mechanistic interpretability. - Eric J. Michaud; Isaac Liao; Vedang Lad; Ziming Liu; Anish Mudide; Chloe Loughridge; Zifan Carl Guo; Tara Rezaei Kheirkhah; Mateja Vukelic; Max Tegmark (CoRR, 2024)

Survival of the Fittest Representation: A Case Study with Modular Addition. - Xiaoman Delores Ding; Zifan Carl Guo; Eric J. Michaud; Ziming Liu; Max Tegmark (CoRR, 2024)

Universal Neurons in GPT2 Language Models. - Wes Gurnee; Theo Horsley; Zifan Carl Guo; Tara Rezaei Kheirkhah; Qinyi Sun; Will Hathaway; Neel Nanda; Dimitris Bertsimas (Trans. Mach. Learn. Res., 2024)

(How) Do Language Models Track State? - Belinda Z. Li; Zifan Carl Guo; Jacob Andreas (CoRR, 2025)