CAPS: A Practical Partition Index for Filtered Similarity Search. - Gaurav Gupta; Jonah Yi; Benjamin Coleman; Chen Luo 001; Vihan Lakshman; Anshumali Shrivastava (CoRR, 2023)

KV Cache is 1 Bit Per Channel: Efficient Large Language Model Inference with Coupled Quantization. - Tianyi Zhang 011; Jonah Yi; Zhaozhuo Xu; Anshumali Shrivastava (NeurIPS, 2024)

NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention. - Tianyi Zhang 011; Jonah Yi; Bowen Yao; Zhaozhuo Xu; Anshumali Shrivastava (NeurIPS, 2024)