Uncovering mesa-optimization algorithms in Transformers. - Johannes von Oswald; Eyvind Niklasson; Maximilian Schlegel; Seijin Kobayashi; Nicolas Zucchet; Nino Scherrer; Nolan Miller; Mark Sandler 002; Blaise Agüera y Arcas; Max Vladymyrov; Razvan Pascanu; João Sacramento (CoRR, 2023)

MesaNet: Sequence Modeling by Locally Optimal Test-Time Training. - Johannes von Oswald; Nino Scherrer; Seijin Kobayashi; Luca Versari; Songlin Yang; Maximilian Schlegel; Kaitlin Maile; Yanick Schimpf; Oliver Sieberling; Alexander Meulemans; Rif A. Saurous; Guillaume Lajoie; et al. (CoRR, 2025)