Towards Automated Circuit Discovery for Mechanistic Interpretability. - Arthur Conmy; Augustine N. Mavor-Parker; Aengus Lynch; Stefan Heimersheim; Adrià Garriga-Alonso (NeurIPS, 2023)

How to use and interpret activation patching. - Stefan Heimersheim; Neel Nanda (CoRR, 2024)

Using Degeneracy in the Loss Landscape for Mechanistic Interpretability. - Lucius Bushnaq; Jake Mendel; Stefan Heimersheim; Dan Braun; Nicholas Goldowsky-Dill; Kaarel Hänni; Cindy Wu; Marius Hobbhahn (CoRR, 2024)

The Local Interaction Basis: Identifying Computationally-Relevant and Sparsely Interacting Features in Neural Networks. - Lucius Bushnaq; Stefan Heimersheim; Nicholas Goldowsky-Dill; Dan Braun; Jake Mendel; Kaarel Hänni; Avery Griffin; Jörn Stöhler; Magdalena Wache; Marius Hobbhahn (CoRR, 2024)

You can remove GPT2's LayerNorm by fine-tuning. - Stefan Heimersheim (CoRR, 2024)

Evaluating Synthetic Activations composed of SAE Latents in GPT-2. - Giorgi Giglemiani; Nora Petrova; Chatrik Singh Mangat; Jett Janiak; Stefan Heimersheim (CoRR, 2024)

Characterizing stable regions in the residual stream of LLMs. - Jett Janiak; Jacek Karwowski; Chatrik Singh Mangat; Giorgi Giglemiani; Nora Petrova; Stefan Heimersheim (CoRR, 2024)

Evolution of SAE Features Across Layers in LLMs. - Daniel Balcells; Benjamin Lerner; Michael Oesterle; Ediz Ucar; Stefan Heimersheim (CoRR, 2024)

Investigating Sensitive Directions in GPT-2: An Improved Baseline and Comparative Analysis of SAEs. - Daniel J. Lee; Stefan Heimersheim (CoRR, 2024)

Interpretability in Parameter Space: Minimizing Mechanistic Description Length with Attribution-based Parameter Decomposition. - Dan Braun; Lucius Bushnaq; Stefan Heimersheim; Jake Mendel; Lee Sharkey (CoRR, 2025)

Open Problems in Mechanistic Interpretability. - Lee Sharkey; Bilal Chughtai; Joshua Batson; Jack Lindsey; Jeff Wu 003; Lucius Bushnaq; Nicholas Goldowsky-Dill; Stefan Heimersheim; Alejandro Ortega; Joseph Isaac Bloom; Stella Biderman; Adrià Garriga-Alonso; et al. (CoRR, 2025)

Detecting Strategic Deception Using Linear Probes. - Nicholas Goldowsky-Dill; Bilal Chughtai; Stefan Heimersheim; Marius Hobbhahn (CoRR, 2025)

Transformers Don't Need LayerNorm at Inference Time: Scaling LayerNorm Removal to GPT-2 XL and the Implications for Mechanistic Interpretability. - Luca Baroni; Galvin Khara; Joachim Schaeffer; Marat Subkhankulov; Stefan Heimersheim (CoRR, 2025)

Benchmarking Deception Probes via Black-to-White Performance Boosts. - Avi Parrack; Carlo Leonardo Attubato; Stefan Heimersheim (CoRR, 2025)