Clustering and Alignment: Understanding the Training Dynamics in Modular Addition. - Tiberiu Musat (CoRR, 2024)

Mechanism and Emergence of Stacked Attention Heads in Multi-Layer Transformers. - Tiberiu Musat (ICLR, 2025)

On the Emergence of Induction Heads for In-Context Learning. - Tiberiu Musat; Tiago Pimentel; Lorenzo Noci; Alessandro Stolfo; Mrinmaya Sachan; Thomas Hofmann 001 (CoRR, 2025)

The Geometry of Grokking: Norm Minimization on the Zero-Loss Manifold. - Tiberiu Musat (CoRR, 2025)