ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction. - Renze Chen; Zhuofeng Wang; Beiquan Cao; Tong Wu; Size Zheng 001; Xiuhong Li; Xuechao Wei; Shengen Yan; Meng Li 004; Yun Liang 001 (NeurIPS, 2024)