Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions. - Stefano Massaroli; Michael Poli; Daniel Y. Fu; Hermann Kumbong; Rom N. Parnichkun; David W. Romero; Aman Timalsina; Quinn McIntyre; Beidi Chen; Atri Rudra; Ce Zhang 001; Christopher Ré; et al. (NeurIPS, 2023)

FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores. - Daniel Y. Fu; Hermann Kumbong; Eric Nguyen; Christopher Ré (ICLR, 2024)

The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry. - Michael Zhang; Kush Bhatia; Hermann Kumbong; Christopher Ré (ICLR, 2024)

HMAR: Efficient Hierarchical Masked Auto-Regressive Image Generation. - Hermann Kumbong; Xian Liu; Tsung-Yi Lin; Ming-Yu Liu 001; Xihui Liu; Ziwei Liu; Daniel Y. Fu; Christopher Ré; David W. Romero (CVPR, 2025)

LowRA: Accurate and Efficient LoRA Fine-Tuning of LLMs under 2 Bits. - Zikai Zhou; Qizheng Zhang; Hermann Kumbong; Kunle Olukotun (CoRR, 2025)