Tender: Accelerating Large Language Models via Tensor Decomposition and Runtime Requantization. - Jungi Lee; Wonbeom Lee; Jaewoong Sim (ISCA, 2024)

InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management. - Wonbeom Lee; Jungi Lee; Junghwan Seo; Jaewoong Sim (OSDI, 2024)