OneAdapt: Fast Adaptation for Deep Learning Applications via Backpropagation. - Kuntai Du; Yuhan Liu 004; Yitian Hao; Qizheng Zhang; Haodong Wang; Yuyang Huang; Ganesh Ananthanarayanan; Junchen Jiang (SoCC, 2023)

Automatic and Efficient Customization of Neural Networks for ML Applications. - Yuhan Liu 004; Chengcheng Wan 001; Kuntai Du; Henry Hoffmann; Junchen Jiang; Shan Lu 001; Michael Maire (CoRR, 2023)

CacheGen: Fast Context Loading for Language Model Applications. - Yuhan Liu 004; Hanchen Li; Kuntai Du; Jiayi Yao; Yihua Cheng; Yuyang Huang; Shan Lu 001; Michael Maire; Henry Hoffmann; Ari Holtzman; Ganesh Ananthanarayanan; Junchen Jiang (CoRR, 2023)

Run-Time Prevention of Software Integration Failures of Machine Learning APIs. - Chengcheng Wan 001; Yuhan Liu 004; Kuntai Du; Henry Hoffmann; Junchen Jiang; Michael Maire; Shan Lu 001 (Proc. ACM Program. Lang., 2023)

Eloquent: A More Robust Transmission Scheme for LLM Token Streaming. - Hanchen Li; Yuhan Liu 004; Yihua Cheng; Siddhant Ray; Kuntai Du; Junchen Jiang (NAIC, 2024)

GRACE: Loss-Resilient Real-Time Video through Neural Codecs. - Yihua Cheng; Ziyi Zhang; Hanchen Li; Anton Arapin; Yue Zhang; Qizheng Zhang; Yuhan Liu 004; Kuntai Du; Xu Zhang; Francis Y. Yan; Amrita Mazumdar; Nick Feamster; et al. (NSDI, 2024)

ChameleonAPI: Automatic and Efficient Customization of Neural Networks for ML Applications. - Yuhan Liu 004; Chengcheng Wan 001; Kuntai Du; Henry Hoffmann; Junchen Jiang; Shan Lu 001; Michael Maire (OSDI, 2024)

CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving. - Yuhan Liu 004; Hanchen Li; Yihua Cheng; Siddhant Ray; Yuyang Huang; Qizheng Zhang; Kuntai Du; Jiayi Yao; Shan Lu 001; Ganesh Ananthanarayanan; Michael Maire; Henry Hoffmann; et al. (SIGCOMM, 2024)

Chatterbox: Robust Transport for LLM Token Streaming under Unstable Network. - Hanchen Li; Yuhan Liu 004; Yihua Cheng; Siddhant Ray; Kuntai Du; Junchen Jiang (CoRR, 2024)

DroidSpeak: Enhancing Cross-LLM Communication. - Yuhan Liu 004; Esha Choukse; Shan Lu 001; Junchen Jiang; Madan Musuvathi (CoRR, 2024)

Artifact for "Keeper: Automated Testing and Fixing of Machine Learning Software". - Chengcheng Wan 001; Shicheng Liu; Sophie Xie; Yuhan Liu 004; Henry Hoffmann; Michael Maire; Shan Lu 001 (Zenodo, 2024)

Artifact for "Keeper: Automated Testing and Fixing of Machine Learning Software". - Chengcheng Wan 001; Shicheng Liu; Sophie Xie; Yuhan Liu 004; Henry Hoffmann; Michael Maire; Shan Lu 001 (Zenodo, 2024)

Keeper: Automated Testing and Fixing of Machine Learning Software. - Chengcheng Wan 001; Shicheng Liu; Sophie Xie; Yuhan Liu 004; Henry Hoffmann; Michael Maire; Shan Lu 001 (ACM Trans. Softw. Eng. Methodol., 2024)

CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion. - Jiayi Yao; Hanchen Li; Yuhan Liu 004; Siddhant Ray; Yihua Cheng; Qizheng Zhang; Kuntai Du; Shan Lu 001; Junchen Jiang (EuroSys, 2025)

Artifact for "Keeper: Automated Testing and Fixing of Machine Learning Software". - Chengcheng Wan 001; Shicheng Liu; Sophie Xie; Yuhan Liu 004; Henry Hoffmann; Michael Maire; Shan Lu 001 (Zenodo, 2025)

Towards More Economical Context-Augmented LLM Generation by Reusing Stored KV Cache. - Hanchen Li; Yuhan Liu 004; Yihua Cheng; Kuntai Du; Junchen Jiang (CoRR, 2025)

AdaptCache: KV Cache Native Storage Hierarchy for Low-Delay and High-Quality Language Model Serving. - Shaoting Feng; Hanchen Li; Kuntai Du; Zhuohan Gu; Yuhan Liu 004; Jiayi Yao; Siddhant Ray; Samuel Shen; Yihua Cheng; Ganesh Ananthanarayanan; Junchen Jiang (CoRR, 2025)

ShadowServe: Interference-Free KV Cache Fetching for Distributed Prefix Caching. - Xingyu Xiang; Raj Joshi; Yuhan Liu 004; Jiayi Yao; Chenxingyu Zhao; Junchen Jiang; Yang Zhou 008; Eddie Kohler; Minlan Yu (CoRR, 2025)

When to Reason: Semantic Router for vLLM. - Chen Wang 039; Xunzhuo Liu; Yuhan Liu 004; Yue Zhu; Xiangxi Mo; Junchen Jiang; Huamin Chen (CoRR, 2025)

LMCache: An Efficient KV Cache Layer for Enterprise-Scale LLM Inference. - Yihua Cheng; Yuhan Liu 004; Jiayi Yao; Yuwei An; Xiaokun Chen; Shaoting Feng; Yuyang Huang; Samuel Shen; Kuntai Du; Junchen Jiang (CoRR, 2025)

EVICPRESS: Joint KV-Cache Compression and Eviction for Efficient LLM Serving. - Shaoting Feng; Yuhan Liu 004; Hanchen Li; Xiaokun Chen; Samuel Shen; Kuntai Du; Zhuohan Gu; Rui Zhang; Yuyang Huang; Yihua Cheng; Jiayi Yao; Qizheng Zhang; et al. (CoRR, 2025)

DroidSpeak: KV Cache Sharing Across Fine-tuned Model Variants. - Yuhan Liu 004; Yuyang Huang; Jiayi Yao; Shaoting Feng; Zhuohan Gu; Kuntai Du; Hanchen Li; Yihua Cheng; Junchen Jiang; Shan Lu 001; Madan Musuvathi; Esha Choukse (NSDI, 2026)

Keeper: Automated Testing and Fixing of Machine Learning Software - RCR Report. - Chengcheng Wan 001; Shicheng Liu; Sophie Xie; Yuhan Liu 004; Michael Maire; Henry Hoffmann; Shan Lu 001 (ACM Trans. Softw. Eng. Methodol., 2026)

inference-fleet-sim: A Queueing-Theory-Grounded Fleet Capacity Planner for LLM Inference. - Huamin Chen; Xunzhuo Liu; Yuhan Liu 004; Junchen Jiang; Bowei He; Xue Liu 001 (CoRR, 2026)

FleetOpt: Analytical Fleet Provisioning for LLM Inference with Compress-and-Route as Implementation Mechanism. - Huamin Chen; Xunzhuo Liu; Yuhan Liu 004; Junchen Jiang; Bowei He; Xue Liu 001 (CoRR, 2026)

The 1/W Law: An Analytical Study of Context-Length Routing Topology and GPU Generation Gains for LLM Inference Energy Efficiency. - Huamin Chen; Xunzhuo Liu; Yuhan Liu 004; Junchen Jiang; Bowei He; Xue Liu 001 (CoRR, 2026)

The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project. - Huamin Chen; Xunzhuo Liu; Bowei He; Fuyuan Lyu; Yankai Chen 001; Xue Liu 001; Yuhan Liu 004; Junchen Jiang (CoRR, 2026)

VeriCache: Turning Lossy KV Cache into Lossless LLM Inference. - Jiayi Yao; Samuel Shen; Kuntai Du; Shaoting Feng; Dongjoo Seo; Rui Zhang; Yuyang Huang; Yuhan Liu 004; Shan Lu 001; Junchen Jiang (CoRR, 2026)