A Training-Free Sub-quadratic Cost Transformer Model Serving Framework with Hierarchically Pruned Attention. - Heejun Lee; Geon Park; Youngwan Lee; Jaduk Suh; Jina Kim; Wonyong Jeong; Bumsik Kim; Hyemin Lee; Myeongjae Jeon; Sung Ju Hwang (ICLR, 2025)

InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU. - Heejun Lee; Geon Park; Jaduk Suh; Sung Ju Hwang (CoRR, 2025)