Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference. - Yuan Feng; Junlin Lv; Yukun Cao; Xike Xie; S. Kevin Zhou (CoRR, 2024)

CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMs. - Junlin Lv; Yuan Feng; Xike Xie; Xin Jia; Qirong Peng; Guiming Xie (ICASSP, 2025)

Identify Critical KV Cache in LLM Inference from an Output Perturbation Perspective. - Yuan Feng; Junlin Lv; Yukun Cao; Xike Xie; S. Kevin Zhou (CoRR, 2025)