Optimal Lottery Tickets via Subset Sum: Logarithmic Over-Parameterization is Sufficient. - Ankit Pensia; Shashank Rajput; Alliot Nagle; Harit Vishwakarma; Dimitris S. Papailiopoulos (NeurIPS, 2020)

Optimal Lottery Tickets via SubsetSum: Logarithmic Over-Parameterization is Sufficient. - Ankit Pensia; Shashank Rajput; Alliot Nagle; Harit Vishwakarma; Dimitris S. Papailiopoulos (CoRR, 2020)

Rare Gems: Finding Lottery Tickets at Initialization. - Kartik Sreenivasan; Jy-yong Sohn; Liu Yang 001; Matthew Grinde; Alliot Nagle; Hongyi Wang 001; Eric P. Xing; Kangwook Lee 001; Dimitris S. Papailiopoulos (NeurIPS, 2022)

Rare Gems: Finding Lottery Tickets at Initialization. - Kartik Sreenivasan; Jy-yong Sohn; Liu Yang 001; Matthew Grinde; Alliot Nagle; Hongyi Wang 001; Kangwook Lee 001; Dimitris S. Papailiopoulos (CoRR, 2022)

High-dimensional multivariate autoregressive model estimation of human electrophysiological data using fMRI priors. - Alliot Nagle; Josh P. Gerrelts; Bryan M. Krause; Aaron D. Boes; Joel Bruss; Kirill V. Nourski; Matthew I. Banks; Barry D. Van Veen (NeuroImage, 2023)

Local to Global: Learning Dynamics and Effect of Initialization for Transformers. - Ashok Vardhan Makkuva; Marco Bondaschi; Adway Girish; Alliot Nagle; Hyeji Kim; Michael Gastpar; Chanakya Ekbote (NeurIPS, 2024)

Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models. - Alliot Nagle; Adway Girish; Marco Bondaschi; Michael Gastpar; Ashok Vardhan Makkuva; Hyeji Kim (NeurIPS, 2024)

Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains. - Ashok Vardhan Makkuva; Marco Bondaschi; Adway Girish; Alliot Nagle; Martin Jaggi; Hyeji Kim; Michael Gastpar (CoRR, 2024)

Neural Distributed Source Coding. - Jay Whang; Alliot Nagle; Anish Acharya; Hyeji Kim; Alexandros G. Dimakis (IEEE J. Sel. Areas Inf. Theory, 2024)

Attention with Markov: A Curious Case of Single-layer Transformers. - Ashok Vardhan Makkuva; Marco Bondaschi; Adway Girish; Alliot Nagle; Martin Jaggi; Hyeji Kim; Michael Gastpar (ICLR, 2025)