From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers. - Krzysztof Choromanski; Han Lin; Haoxian Chen 002; Tianyi Zhang; Arijit Sehanobish; Valerii Likhosherstov; Jack Parker-Holder; Tamás Sarlós; Adrian Weller; Thomas Weingarten (ICML, 2022)

Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers. - Krzysztof Choromanski; Shanda Li; Valerii Likhosherstov; Kumar Avinava Dubey; Shengjie Luo; Di He 001; Yiming Yang; Tamás Sarlós; Thomas Weingarten; Adrian Weller (AISTATS, 2024)