Róbert Csordás

According to our database, Róbert Csordás authored at least 18 papers between 2015 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2023

SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention.

Róbert Csordás, Piotr Piekos, Kazuki Irie, Jürgen Schmidhuber

CoRR, 2023

Automating Continual Learning.

Kazuki Irie, Róbert Csordás, Jürgen Schmidhuber

CoRR, 2023

Mindstorms in Natural Language-Based Societies of Mind.

Mingchen Zhuge, Haozhe Liu, Francesco Faccio, Dylan R. Ashley, Róbert Csordás, Anand Gopalakrishnan, Abdullah Hamdi, Hasan Abed Al Kader Hammoud, Vincent Herrmann, Kazuki Irie, Louis Kirsch, Bing Li, Guohao Li, Shuming Liu, Jinjie Mai, Piotr Piekos, Aditya Ramesh, Imanol Schlag, Weimin Shi, Aleksandar Stanic, Wenyi Wang, Yuhui Wang, Mengmeng Xu, Deng-Ping Fan, Bernard Ghanem, Jürgen Schmidhuber

CoRR, 2023

Topological Neural Discrete Representation Learning à la Kohonen.

Kazuki Irie, Róbert Csordás, Jürgen Schmidhuber

CoRR, 2023

Practical Computational Power of Linear Transformers and Their Recurrent and Self-Referential Extensions.

Kazuki Irie, Róbert Csordás, Jürgen Schmidhuber

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Approximating Two-Layer Feedforward Networks for Efficient Transformers.

Róbert Csordás, Kazuki Irie, Jürgen Schmidhuber

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Randomized Positional Encodings Boost Length Generalization of Transformers.

Anian Ruoss, Grégoire Delétang, Tim Genewein, Jordi Grau-Moya, Róbert Csordás, Mehdi Bennani, Shane Legg, Joel Veness

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2023

2022

A Generalist Neural Algorithmic Learner.

Borja Ibarz, Vitaly Kurin, George Papamakarios, Kyriacos Nikiforou, Mehdi Bennani, Róbert Csordás, Andrew Joseph Dudzik, Matko Bosnjak, Alex Vitvitskyi, Yulia Rubanova, Andreea Deac, Beatrice Bevilacqua, Yaroslav Ganin, Charles Blundell, Petar Velickovic

Proceedings of the Learning on Graphs Conference, 2022

A Modern Self-Referential Weight Matrix That Learns to Modify Itself.

Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

Proceedings of the International Conference on Machine Learning, 2022

The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns via Spotlights of Attention.

Kazuki Irie, Róbert Csordás, Jürgen Schmidhuber

Proceedings of the International Conference on Machine Learning, 2022

The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization.

Róbert Csordás, Kazuki Irie, Jürgen Schmidhuber

Proceedings of the Tenth International Conference on Learning Representations, 2022

CTL++: Evaluating Generalization on Never-Seen Compositional Patterns of Known Functions, and Compatibility of Neural Representations.

Róbert Csordás, Kazuki Irie, Jürgen Schmidhuber

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

2021

Improving Baselines in the Wild.

Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

CoRR, 2021

Going Beyond Linear Transformers with Recurrent Fast Weight Programmers.

Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks.

Róbert Csordás, Sjoerd van Steenkiste, Jürgen Schmidhuber

Proceedings of the 9th International Conference on Learning Representations, 2021

The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers.

Róbert Csordás, Kazuki Irie, Jürgen Schmidhuber

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

2019

Improving Differentiable Neural Computers Through Memory Masking, De-allocation, and Link Distribution Sharpness Control.

Róbert Csordás, Jürgen Schmidhuber

Proceedings of the 7th International Conference on Learning Representations, 2019

2015

Detecting Objects Thrown over Fence in Outdoor Scenes.

Róbert Csordás, László Havasi, Tamás Szirányi

Proceedings of the VISAPP 2015, 2015