Imanol Schlag

According to our database, Imanol Schlag authored at least 23 papers between 2017 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

Towards Fully FP8 GEMM LLM Training at Scale.

Alejandro Hernández-Cano, Dhia Garbaya, Imanol Schlag, Martin Jaggi

CoRR, May, 2025

Positional Fragility in LLMs: How Offset Effects Reshape Our Understanding of Memorization Risks.

Yixuan Xu, Antoni-Joan Solergibert i Llaquet, Antoine Bosselut, Imanol Schlag

CoRR, May, 2025

Can Performant LLMs Be Ethical? Quantifying the Impact of Web Crawling Opt-Outs.

Dongyang Fan, Vinko Sabolcec, Matin Ansaripour, Ayush Kumar Tarun, Martin Jaggi, Antoine Bosselut, Imanol Schlag

CoRR, April, 2025

Mindstorms in Natural Language-Based Societies of Mind.

Mingchen Zhuge, Haozhe Liu, Francesco Faccio, Dylan R. Ashley, Róbert Csordás, Anand Gopalakrishnan, Abdullah Hamdi, Hasan Abed Al Kader Hammoud, Vincent Herrmann, Kazuki Irie, Louis Kirsch, Bing Li, Guohao Li, Shuming Liu, Jinjie Mai, Piotr Piekos, Aditya A. Ramesh, Imanol Schlag, Weimin Shi, Aleksandar Stanic, Wenyi Wang, Yuhui Wang, Mengmeng Xu, Deng-Ping Fan, Bernard Ghanem, Jürgen Schmidhuber

Comput. Vis. Media, 2025

INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge.

Angelika Romanou, Negar Foroutan, Anna Sotnikova, Zeming Chen, Sree Harsha Nelaturu, Shivalika Singh, Rishabh Maheshwary, Micol Altomare, Mohamed A. Haggag, Imanol Schlag, Marzieh Fadaee, Sara Hooker, Antoine Bosselut, Snegha A, Alfonso Amayuelas, Azril Hafizi Amirudin, Viraat Aryabumi, Danylo Boiko, Michael Chang, Jenny Chim, Gal Cohen, Aditya Kumar Dalmia, Abraham Diress, Sharad Duwal, Daniil Dzenhaliou, Daniel Fernando Erazo Florez, Fabian Farestam, Joseph Marvin Imperial, Shayekh Bin Islam, Perttu Isotalo, Maral Jabbarishiviari, Börje F. Karlsson, Eldar Khalilov, Christopher Klamm, Fajri Koto, Dominik Krzeminski, Gabriel Adriano de Melo, Syrielle Montariol, Yiyang Nan, Joel Niklaus, Jekaterina Novikova, Johan Samir Obando-Ceron, Debjit Paul, Esther Ploeger, Jebish Purbey, Swati Rajwal, Selvan Sunitha Ravi, Sara Rydell, Roshan Santhosh, Drishti Sharma, Marjana Prifti Skenduli, Arshia Soltani Moakhar, Bardia Soltani Moakhar, Ran Tamir, Ayush Kumar Tarun, Azmine Toushik Wasi, Thenuka Ovin Weerasinghe, Serhan Yilmaz, Mike Zhang

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

Understanding and Minimising Outlier Features in Neural Network Training.

Bobby He, Lorenzo Noci, Daniele Paliotta, Imanol Schlag, Thomas Hofmann

CoRR, 2024

Language Imbalance Can Boost Cross-lingual Generalisation.

Anton Schäfer, Shauli Ravfogel, Thomas Hofmann, Tiago Pimentel, Imanol Schlag

CoRR, 2024

Understanding and Minimising Outlier Features in Transformer Training.

Bobby He, Lorenzo Noci, Daniele Paliotta, Imanol Schlag, Thomas Hofmann

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024

Navigating Scaling Laws: Compute Optimality in Adaptive Model Training.

Sotiris Anagnostidis, Gregor Bachmann, Imanol Schlag, Thomas Hofmann

Proceedings of the Forty-first International Conference on Machine Learning, 2024

On the Effect of (Near) Duplicate Subwords in Language Modelling.

Anton Schäfer, Thomas Hofmann, Imanol Schlag, Tiago Pimentel

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

The Languini Kitchen: Enabling Language Modelling Research at Different Scales of Compute.

Aleksandar Stanic, Dylan R. Ashley, Oleg Serikov, Louis Kirsch, Francesco Faccio, Jürgen Schmidhuber, Thomas Hofmann, Imanol Schlag

CoRR, 2023

Large Language Model Programs.

Imanol Schlag, Sainbayar Sukhbaatar, Asli Celikyilmaz, Wen-tau Yih, Jason Weston, Jürgen Schmidhuber, Xian Li

CoRR, 2023

2022

Solving Quantitative Reasoning Problems with Language Models.

Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay V. Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, Yuhuai Wu, Behnam Neyshabur, Guy Gur-Ari, Vedant Misra

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Block-Recurrent Transformers.

DeLesley Hutchins, Imanol Schlag, Yuhuai Wu, Ethan Dyer, Behnam Neyshabur

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

A Modern Self-Referential Weight Matrix That Learns to Modify Itself.

Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

Proceedings of the International Conference on Machine Learning, 2022

2021

Improving Baselines in the Wild.

Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

CoRR, 2021

Linear Transformers Are Secretly Fast Weight Memory Systems.

Imanol Schlag, Kazuki Irie, Jürgen Schmidhuber

CoRR, 2021

Going Beyond Linear Transformers with Recurrent Fast Weight Programmers.

Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Linear Transformers Are Secretly Fast Weight Programmers.

Imanol Schlag, Kazuki Irie, Jürgen Schmidhuber

Proceedings of the 38th International Conference on Machine Learning, 2021

Learning Associative Inference Using Fast Weight Memory.

Imanol Schlag, Tsendsuren Munkhdalai, Jürgen Schmidhuber

Proceedings of the 9th International Conference on Learning Representations, 2021

2019

Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving.

Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao

CoRR, 2019

2018

Learning to Reason with Third Order Tensor Products.

Imanol Schlag, Jürgen Schmidhuber

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

2017

Ancient Roman Coin Recognition in the Wild Using Deep Learning Based Recognition of Artistically Depicted Face Profiles.

Imanol Schlag, Ognjen Arandjelovic

Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops, 2017