Ancient Roman Coin Recognition in the Wild Using Deep Learning Based Recognition of Artistically Depicted Face Profiles. - Imanol Schlag; Ognjen Arandjelovic (ICCV Workshops, 2017)

Learning to Reason with Third Order Tensor Products. - Imanol Schlag; Jürgen Schmidhuber (NeurIPS, 2018)

Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving. - Imanol Schlag; Paul Smolensky; Roland Fernandez; Nebojsa Jojic; Jürgen Schmidhuber; Jianfeng Gao 001 (CoRR, 2019)

Learning Associative Inference Using Fast Weight Memory. - Imanol Schlag; Tsendsuren Munkhdalai; Jürgen Schmidhuber (ICLR, 2021)

Linear Transformers Are Secretly Fast Weight Programmers. - Imanol Schlag; Kazuki Irie; Jürgen Schmidhuber (ICML, 2021)

Going Beyond Linear Transformers with Recurrent Fast Weight Programmers. - Kazuki Irie; Imanol Schlag; Róbert Csordás; Jürgen Schmidhuber (NeurIPS, 2021)

Linear Transformers Are Secretly Fast Weight Memory Systems. - Imanol Schlag; Kazuki Irie; Jürgen Schmidhuber (CoRR, 2021)

Improving Baselines in the Wild. - Kazuki Irie; Imanol Schlag; Róbert Csordás; Jürgen Schmidhuber (CoRR, 2021)

A Modern Self-Referential Weight Matrix That Learns to Modify Itself. - Kazuki Irie; Imanol Schlag; Róbert Csordás; Jürgen Schmidhuber (ICML, 2022)

Block-Recurrent Transformers. - DeLesley Hutchins; Imanol Schlag; Yuhuai Wu; Ethan Dyer; Behnam Neyshabur (NeurIPS, 2022)

Solving Quantitative Reasoning Problems with Language Models. - Aitor Lewkowycz; Anders Andreassen; David Dohan; Ethan Dyer; Henryk Michalewski; Vinay V. Ramasesh; Ambrose Slone; Cem Anil; Imanol Schlag; Theo Gutman-Solo; Yuhuai Wu; Behnam Neyshabur; et al. (NeurIPS, 2022)

Large Language Model Programs. - Imanol Schlag; Sainbayar Sukhbaatar; Asli Celikyilmaz; Wen-tau Yih; Jason Weston; Jürgen Schmidhuber; Xian Li 003 (CoRR, 2023)

The Languini Kitchen: Enabling Language Modelling Research at Different Scales of Compute. - Aleksandar Stanic; Dylan R. Ashley; Oleg Serikov; Louis Kirsch; Francesco Faccio; Jürgen Schmidhuber; Thomas Hofmann 001; Imanol Schlag (CoRR, 2023)

On the Effect of (Near) Duplicate Subwords in Language Modelling. - Anton Schäfer; Thomas Hofmann 001; Imanol Schlag; Tiago Pimentel (ACL (Findings), 2024)

Navigating Scaling Laws: Compute Optimality in Adaptive Model Training. - Sotiris Anagnostidis; Gregor Bachmann; Imanol Schlag; Thomas Hofmann 001 (ICML, 2024)

Understanding and Minimising Outlier Features in Transformer Training. - Bobby He; Lorenzo Noci; Daniele Paliotta; Imanol Schlag; Thomas Hofmann 001 (NeurIPS, 2024)

Language Imbalance Can Boost Cross-lingual Generalisation. - Anton Schäfer; Shauli Ravfogel; Thomas Hofmann 001; Tiago Pimentel; Imanol Schlag (CoRR, 2024)

Understanding and Minimising Outlier Features in Neural Network Training. - Bobby He; Lorenzo Noci; Daniele Paliotta; Imanol Schlag; Thomas Hofmann 001 (CoRR, 2024)

INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge. - Angelika Romanou; Negar Foroutan; Anna Sotnikova; Zeming Chen 001; Sree Harsha Nelaturu; Shivalika Singh; Rishabh Maheshwary; Micol Altomare; Mohamed A. Haggag; Imanol Schlag; Marzieh Fadaee; Sara Hooker; et al. (ICLR, 2025)

Mindstorms in Natural Language-Based Societies of Mind. - Mingchen Zhuge; Haozhe Liu; Francesco Faccio; Dylan R. Ashley; Róbert Csordás; Anand Gopalakrishnan; Abdullah Hamdi; Hasan Abed Al Kader Hammoud; Vincent Herrmann; Kazuki Irie; Louis Kirsch; Bing Li 024; et al. (Comput. Vis. Media, 2025)

Can Performant LLMs Be Ethical? Quantifying the Impact of Web Crawling Opt-Outs. - Dongyang Fan; Vinko Sabolcec; Matin Ansaripour; Ayush Kumar Tarun; Martin Jaggi; Antoine Bosselut; Imanol Schlag (CoRR, 2025)

Positional Fragility in LLMs: How Offset Effects Reshape Our Understanding of Memorization Risks. - Yixuan Xu; Antoni-Joan Solergibert i Llaquet; Antoine Bosselut; Imanol Schlag (CoRR, 2025)

Towards Fully FP8 GEMM LLM Training at Scale. - Alejandro Hernández-Cano; Dhia Garbaya; Imanol Schlag; Martin Jaggi (CoRR, 2025)