iBox: Internet in a Box. - Sachin Ashok; Sai Surya Duvvuri; Nagarajan Natarajan; Venkata N. Padmanabhan; Sundararajan Sellamanickam; Johannes Gehrke (HotNets, 2020)

A Computationally Efficient Sparsified Online Newton Method. - Devvrit; Sai Surya Duvvuri; Rohan Anil; Vineet Gupta 001; Cho-Jui Hsieh; Inderjit S. Dhillon (NeurIPS, 2023)

Block Low-Rank Preconditioner with Shared Basis for Stochastic Optimization. - Jui-Nan Yen; Sai Surya Duvvuri; Inderjit S. Dhillon; Cho-Jui Hsieh (NeurIPS, 2023)

Combining Axes Preconditioners through Kronecker Approximation for Deep Learning. - Sai Surya Duvvuri; Devvrit; Rohan Anil; Cho-Jui Hsieh; Inderjit S. Dhillon (ICLR, 2024)

LASER: Attention with Exponential Transformation. - Sai Surya Duvvuri; Inderjit S. Dhillon (CoRR, 2024)

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization. - Jui-Nan Yen; Si Si; Zhao Meng; Felix X. Yu; Sai Surya Duvvuri; Inderjit S. Dhillon; Cho-Jui Hsieh; Sanjiv Kumar (ICLR, 2025)

Fast and Simplex: 2-Simplicial Attention in Triton. - Aurko Roy; Timothy Chou; Sai Surya Duvvuri; Sijia Chen; Jiecao Yu; Xiaodong Wang; Manzil Zaheer; Rohan Anil (CoRR, 2025)