A journey in ESN and LSTM visualisations on a language task. - Alexandre Variengien; Xavier Hinaut (CoRR, 2020)

Towards self-organized control: Using neural cellular automata to robustly control a cart-pole agent. - Alexandre Variengien; Stefano Nichele; Tom Eivind Glover; Sidney Pontes-Filho (CoRR, 2021)

Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 Small. - Kevin Ro Wang; Alexandre Variengien; Arthur Conmy; Buck Shlegeris; Jacob Steinhardt (ICLR, 2023)

How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model. - Michael Hanna 001; Ollie Liu; Alexandre Variengien (NeurIPS, 2023)

Look Before You Leap: A Universal Emergent Decomposition of Retrieval Tasks in Language Models. - Alexandre Variengien; Eric Winsor (CoRR, 2023)

BELLS: A Framework Towards Future Proof Benchmarks for the Evaluation of LLM Safeguards. - Diego Dorn; Alexandre Variengien; Charbel-Raphaël Ségerie; Vincent Corruble (CoRR, 2024)

Look Before You Leap: Universal Emergent Mechanism for Retrieval in Language Models. - Alexandre Variengien; Eric Winsor (ICLR, 2025)