Yuhan Liu

According to our database, Yuhan Liu authored at least 28 papers between 2023 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2026

VeriCache: Turning Lossy KV Cache into Lossless LLM Inference.

Jiayi Yao, Samuel Shen, Kuntai Du, Shaoting Feng, Dongjoo Seo, Rui Zhang, Yuyang Huang, Yuhan Liu, Shan Lu, Junchen Jiang

CoRR, May, 2026

The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project.

Huamin Chen, Xunzhuo Liu, Bowei He, Fuyuan Lyu, Yankai Chen, Xue Liu, Yuhan Liu, Junchen Jiang

CoRR, March, 2026

The 1/W Law: An Analytical Study of Context-Length Routing Topology and GPU Generation Gains for LLM Inference Energy Efficiency.

Huamin Chen, Xunzhuo Liu, Yuhan Liu, Junchen Jiang, Bowei He, Xue Liu

CoRR, March, 2026

FleetOpt: Analytical Fleet Provisioning for LLM Inference with Compress-and-Route as Implementation Mechanism.

Huamin Chen, Xunzhuo Liu, Yuhan Liu, Junchen Jiang, Bowei He, Xue Liu

CoRR, March, 2026

inference-fleet-sim: A Queueing-Theory-Grounded Fleet Capacity Planner for LLM Inference.

Huamin Chen, Xunzhuo Liu, Yuhan Liu, Junchen Jiang, Bowei He, Xue Liu

CoRR, March, 2026

Keeper: Automated Testing and Fixing of Machine Learning Software - RCR Report.

Chengcheng Wan, Shicheng Liu, Sophie Xie, Yuhan Liu, Michael Maire, Henry Hoffmann, Shan Lu

ACM Trans. Softw. Eng. Methodol., February, 2026

DroidSpeak: KV Cache Sharing Across Fine-tuned Model Variants.

Yuhan Liu, Yuyang Huang, Jiayi Yao, Shaoting Feng, Zhuohan Gu, Kuntai Du, Hanchen Li, Yihua Cheng, Junchen Jiang, Shan Lu, Madan Musuvathi, Esha Choukse

Proceedings of the 23rd USENIX Symposium on Networked Systems Design and Implementation, 2026

2025

EVICPRESS: Joint KV-Cache Compression and Eviction for Efficient LLM Serving.

Shaoting Feng, Yuhan Liu, Hanchen Li, Xiaokun Chen, Samuel Shen, Kuntai Du, Zhuohan Gu, Rui Zhang, Yuyang Huang, Yihua Cheng, Jiayi Yao, Qizheng Zhang, Ganesh Ananthanarayanan, Junchen Jiang

CoRR, December, 2025

LMCache: An Efficient KV Cache Layer for Enterprise-Scale LLM Inference.

Yihua Cheng, Yuhan Liu, Jiayi Yao, Yuwei An, Xiaokun Chen, Shaoting Feng, Yuyang Huang, Samuel Shen, Kuntai Du, Junchen Jiang

CoRR, October, 2025

When to Reason: Semantic Router for vLLM.

Chen Wang, Xunzhuo Liu, Yuhan Liu, Yue Zhu, Xiangxi Mo, Junchen Jiang, Huamin Chen

CoRR, October, 2025

ShadowServe: Interference-Free KV Cache Fetching for Distributed Prefix Caching.

Xingyu Xiang, Raj Joshi, Yuhan Liu, Jiayi Yao, Chenxingyu Zhao, Junchen Jiang, Yang Zhou, Eddie Kohler, Minlan Yu

CoRR, September, 2025

AdaptCache: KV Cache Native Storage Hierarchy for Low-Delay and High-Quality Language Model Serving.

Shaoting Feng, Hanchen Li, Kuntai Du, Zhuohan Gu, Yuhan Liu, Jiayi Yao, Siddhant Ray, Samuel Shen, Yihua Cheng, Ganesh Ananthanarayanan, Junchen Jiang

CoRR, September, 2025

Towards More Economical Context-Augmented LLM Generation by Reusing Stored KV Cache.

Hanchen Li, Yuhan Liu, Yihua Cheng, Kuntai Du, Junchen Jiang

CoRR, March, 2025

Artifact for "Keeper: Automated Testing and Fixing of Machine Learning Software".

Chengcheng Wan, Shicheng Liu, Sophie Xie, Yuhan Liu, Henry Hoffmann, Michael Maire, Shan Lu

Dataset, March, 2025

CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion.

Jiayi Yao, Hanchen Li, Yuhan Liu, Siddhant Ray, Yihua Cheng, Qizheng Zhang, Kuntai Du, Shan Lu, Junchen Jiang

Proceedings of the Twentieth European Conference on Computer Systems, 2025

2024

Keeper: Automated Testing and Fixing of Machine Learning Software.

Chengcheng Wan, Shicheng Liu, Sophie Xie, Yuhan Liu, Henry Hoffmann, Michael Maire, Shan Lu

ACM Trans. Softw. Eng. Methodol., September, 2024

Artifact for "Keeper: Automated Testing and Fixing of Machine Learning Software".

Chengcheng Wan, Shicheng Liu, Sophie Xie, Yuhan Liu, Henry Hoffmann, Michael Maire, Shan Lu

Dataset, May, 2024

Artifact for "Keeper: Automated Testing and Fixing of Machine Learning Software".

Chengcheng Wan, Shicheng Liu, Sophie Xie, Yuhan Liu, Henry Hoffmann, Michael Maire, Shan Lu

Dataset, April, 2024

DroidSpeak: Enhancing Cross-LLM Communication.

Yuhan Liu, Esha Choukse, Shan Lu, Junchen Jiang, Madan Musuvathi

CoRR, 2024

Chatterbox: Robust Transport for LLM Token Streaming under Unstable Network.

Hanchen Li, Yuhan Liu, Yihua Cheng, Siddhant Ray, Kuntai Du, Junchen Jiang

CoRR, 2024

CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving.

Yuhan Liu, Hanchen Li, Yihua Cheng, Siddhant Ray, Yuyang Huang, Qizheng Zhang, Kuntai Du, Jiayi Yao, Shan Lu, Ganesh Ananthanarayanan, Michael Maire, Henry Hoffmann, Ari Holtzman, Junchen Jiang

Proceedings of the ACM SIGCOMM 2024 Conference, 2024

ChameleonAPI: Automatic and Efficient Customization of Neural Networks for ML Applications.

Yuhan Liu, Chengcheng Wan, Kuntai Du, Henry Hoffmann, Junchen Jiang, Shan Lu, Michael Maire

Proceedings of the 18th USENIX Symposium on Operating Systems Design and Implementation, 2024

GRACE: Loss-Resilient Real-Time Video through Neural Codecs.

Yihua Cheng, Ziyi Zhang, Hanchen Li, Anton Arapin, Yue Zhang, Qizheng Zhang, Yuhan Liu, Kuntai Du, Xu Zhang, Francis Y. Yan, Amrita Mazumdar, Nick Feamster, Junchen Jiang

Proceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation, 2024

Eloquent: A More Robust Transmission Scheme for LLM Token Streaming.

Hanchen Li, Yuhan Liu, Yihua Cheng, Siddhant Ray, Kuntai Du, Junchen Jiang

Proceedings of the 2024 SIGCOMM Workshop on Networks for AI Computing, 2024

2023

Run-Time Prevention of Software Integration Failures of Machine Learning APIs.

Chengcheng Wan, Yuhan Liu, Kuntai Du, Henry Hoffmann, Junchen Jiang, Michael Maire, Shan Lu

Proc. ACM Program. Lang., October, 2023

CacheGen: Fast Context Loading for Language Model Applications.

Yuhan Liu, Hanchen Li, Kuntai Du, Jiayi Yao, Yihua Cheng, Yuyang Huang, Shan Lu, Michael Maire, Henry Hoffmann, Ari Holtzman, Ganesh Ananthanarayanan, Junchen Jiang

CoRR, 2023

Automatic and Efficient Customization of Neural Networks for ML Applications.

Yuhan Liu, Chengcheng Wan, Kuntai Du, Henry Hoffmann, Junchen Jiang, Shan Lu, Michael Maire

CoRR, 2023

OneAdapt: Fast Adaptation for Deep Learning Applications via Backpropagation.

Kuntai Du, Yuhan Liu, Yitian Hao, Qizheng Zhang, Haodong Wang, Yuyang Huang, Ganesh Ananthanarayanan, Junchen Jiang

Proceedings of the 2023 ACM Symposium on Cloud Computing, SoCC 2023, 2023