BUZZ: Beehive-structured Sparse KV Cache with Segmented Heavy Hitters for Efficient LLM Inference. - Junqi Zhao; Zhijin Fang; Shu Li; Shaohui Yang; Shichao He (CoRR, 2024)