Sparsified SGD with Memory. - Sebastian U. Stich; Jean-Baptiste Cordonnier; Martin Jaggi (NeurIPS, 2018)

Extrapolating Paths with Graph Neural Networks. - Jean-Baptiste Cordonnier; Andreas Loukas (IJCAI, 2019)

Robust Cross-lingual Embeddings from Parallel Sentences. - Ali Sabet; Prakhar Gupta; Jean-Baptiste Cordonnier; Robert West 001; Martin Jaggi (CoRR, 2019)

On the Relationship between Self-Attention and Convolutional Layers. - Jean-Baptiste Cordonnier; Andreas Loukas; Martin Jaggi (ICLR, 2020)

Multi-Head Attention: Collaborate Instead of Concatenate. - Jean-Baptiste Cordonnier; Andreas Loukas; Martin Jaggi (CoRR, 2020)

Differentiable Patch Selection for Image Recognition. - Jean-Baptiste Cordonnier; Aravindh Mahendran; Alexey Dosovitskiy; Dirk Weissenborn; Jakob Uszkoreit; Thomas Unterthiner (CVPR, 2021)

Group Equivariant Stand-Alone Self-Attention For Vision. - David W. Romero; Jean-Baptiste Cordonnier (ICLR, 2021)

Attention is not all you need: pure attention loses rank doubly exponentially with depth. - Yihe Dong; Jean-Baptiste Cordonnier; Andreas Loukas (ICML, 2021)