Inference and Sampling of K33-free Ising Models. - Valerii Likhosherstov; Yury Maximov; Michael Chertkov (CoRR, 2018)

Inference and Sampling of $K_33$-free Ising Models. - Valerii Likhosherstov; Yury Maximov; Misha Chertkov (ICML, 2019)

A New Family of Tractable Ising Models. - Valerii Likhosherstov; Yury Maximov; Michael Chertkov (CoRR, 2019)

Tractable Minor-free Generalization of Planar Zero-field Ising Models. - Valerii Likhosherstov; Yury Maximov; Michael Chertkov (CoRR, 2019)

Stochastic Flows and Geometric Optimization on the Orthogonal Group. - Krzysztof Choromanski; David Cheikhi; Jared Davis; Valerii Likhosherstov; Achille Nazaret; Achraf Bahamou; Xingyou Song; Mrugank Akarte; Jack Parker-Holder; Jacob Bergquist; Yuan Gao; Aldo Pacchiano; et al. (ICML, 2020)

Ode to an ODE. - Krzysztof Marcin Choromanski; Jared Quincy Davis; Valerii Likhosherstov; Xingyou Song; Jean-Jacques E. Slotine; Jacob Varley; Honglak Lee; Adrian Weller; Vikas Sindhwani (NeurIPS, 2020)

CWY Parametrization for Scalable Learning of Orthogonal and Stiefel Matrices. - Valerii Likhosherstov; Jared Davis; Krzysztof Choromanski; Adrian Weller (CoRR, 2020)

Masked Language Modeling for Proteins via Linearly Scalable Long-Context Transformers. - Krzysztof Choromanski; Valerii Likhosherstov; David Dohan; Xingyou Song; Jared Davis; Tamás Sarlós; David Belanger 002; Lucy J. Colwell; Adrian Weller (CoRR, 2020)

UFO-BLO: Unbiased First-Order Bilevel Optimization. - Valerii Likhosherstov; Xingyou Song; Krzysztof Choromanski; Jared Davis; Adrian Weller (CoRR, 2020)

An Ode to an ODE. - Krzysztof Choromanski; Jared Quincy Davis; Valerii Likhosherstov; Xingyou Song; Jean-Jacques E. Slotine; Jacob Varley; Honglak Lee; Adrian Weller; Vikas Sindhwani (CoRR, 2020)

CWY Parametrization: a Solution for Parallelized Optimization of Orthogonal and Stiefel Matrices. - Valerii Likhosherstov; Jared Davis; Krzysztof Choromanski; Adrian Weller (AISTATS, 2021)

Rethinking Attention with Performers. - Krzysztof Marcin Choromanski; Valerii Likhosherstov; David Dohan; Xingyou Song; Andreea Gane; Tamás Sarlós; Peter Hawkins; Jared Quincy Davis; Afroz Mohiuddin; Lukasz Kaiser; David Benjamin Belanger; Lucy J. Colwell; et al. (ICLR, 2021)

Debiasing a First-order Heuristic for Approximate Bi-level Optimization. - Valerii Likhosherstov; Xingyou Song; Krzysztof Choromanski; Jared Quincy Davis; Adrian Weller (ICML, 2021)

Sub-Linear Memory: How to Make Performers SLiM. - Valerii Likhosherstov; Krzysztof Marcin Choromanski; Jared Quincy Davis; Xingyou Song; Adrian Weller (NeurIPS, 2021)

Unlocking Pixels for Reinforcement Learning via Implicit Attention. - Krzysztof Choromanski; Deepali Jain; Jack Parker-Holder; Xingyou Song; Valerii Likhosherstov; Anirban Santara; Aldo Pacchiano; Yunhao Tang; Adrian Weller (CoRR, 2021)

On the Expressive Power of Self-Attention Matrices. - Valerii Likhosherstov; Krzysztof Choromanski; Adrian Weller (CoRR, 2021)

PolyViT: Co-training Vision Transformers on Images, Videos and Audio. - Valerii Likhosherstov; Anurag Arnab; Krzysztof Choromanski; Mario Lucic; Yi Tay; Adrian Weller; Mostafa Dehghani 001 (CoRR, 2021)

Hybrid Random Features. - Krzysztof Marcin Choromanski; Han Lin; Haoxian Chen 002; Arijit Sehanobish; Yuanzhe Ma; Deepali Jain; Jake Varley; Andy Zeng 001; Michael S. Ryoo; Valerii Likhosherstov; Dmitry Kalashnikov; Vikas Sindhwani; et al. (ICLR, 2022)

From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers. - Krzysztof Choromanski; Han Lin; Haoxian Chen 002; Tianyi Zhang; Arijit Sehanobish; Valerii Likhosherstov; Jack Parker-Holder; Tamás Sarlós; Adrian Weller; Thomas Weingarten (ICML, 2022)

Chefs' Random Tables: Non-Trigonometric Random Features. - Valerii Likhosherstov; Krzysztof Marcin Choromanski; Kumar Avinava Dubey; Frederick Liu; Tamás Sarlós; Adrian Weller (NeurIPS, 2022)

Automated Deep Aberration Detection from Chromosome Karyotype Images. - Zahra Shamsi; Drew Bryant; Jacob Wilson; Xiaoyu Qu; Avinava Dubey; Konik Kothari; Mostafa Dehghani 001; Mariya Chavarha; Valerii Likhosherstov; Brian Williams; Michael Frumkin; Fred Appelbaum; et al. (CoRR, 2022)

On the Expressive Flexibility of Self-Attention Matrices. - Valerii Likhosherstov; Krzysztof Choromanski; Adrian Weller (AAAI, 2023)

Efficient Graph Field Integrators Meet Point Clouds. - Krzysztof Marcin Choromanski; Arijit Sehanobish; Han Lin; Yunfan Zhao; Eli Berger; Tetiana Parshakova; Alvin Pan; David Watkins; Tianyi Zhang; Valerii Likhosherstov; Somnath Basu Roy Chowdhury; Kumar Avinava Dubey; et al. (ICML, 2023)

Simplex Random Features. - Isaac Reid; Krzysztof Marcin Choromanski; Valerii Likhosherstov; Adrian Weller (ICML, 2023)

Adaptive Computation with Elastic Input Sequence. - Fuzhao Xue; Valerii Likhosherstov; Anurag Arnab; Neil Houlsby; Mostafa Dehghani 001; Yang You 001 (ICML, 2023)

Dense-Exponential Random Features: Sharp Positive Estimators of the Gaussian Kernel. - Valerii Likhosherstov; Krzysztof Marcin Choromanski; Kumar Avinava Dubey; Frederick Liu; Tamás Sarlós; Adrian Weller (NeurIPS, 2023)

FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Features. - Valerii Likhosherstov; Krzysztof Choromanski; Avinava Dubey; Frederick Liu; Tamás Sarlós; Adrian Weller (CoRR, 2023)

PolyViT: Co-training Vision Transformers on Images, Videos and Audio. - Valerii Likhosherstov; Anurag Arnab; Krzysztof Marcin Choromanski; Mario Lucic; Yi Tay; Mostafa Dehghani 001 (Trans. Mach. Learn. Res., 2023)

Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers. - Krzysztof Choromanski; Shanda Li; Valerii Likhosherstov; Kumar Avinava Dubey; Shengjie Luo; Di He 001; Yiming Yang; Tamás Sarlós; Thomas Weingarten; Adrian Weller (AISTATS, 2024)

Scalable Neural Network Kernels. - Arijit Sehanobish; Krzysztof Marcin Choromanski; Yunfan Zhao; Kumar Avinava Dubey; Valerii Likhosherstov (ICLR, 2024)

UniGen: Unified Modeling of Initial Agent States and Trajectories for Generating Autonomous Driving Scenarios. - Reza Mahjourian; Rongbing Mu; Valerii Likhosherstov; Paul Mougin; Xiukun Huang; João V. Messias; Shimon Whiteson (ICRA, 2024)