Kan Zhu

According to our database, Kan Zhu authored at least 15 papers between 2016 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

BlendServe: Optimizing Offline Inference with Resource-Aware Batching.

Yilong Zhao, Shuo Yang, Kan Zhu, Lianmin Zheng, Baris Kasikci, Yifan Qiao, Yang Zhou, Jiarong Xing, Ion Stoica

Proceedings of the 31st ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2026

2025

Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding.

Yilong Zhao, Jiaming Tang, Kan Zhu, Zihao Ye, Chi-Chih Chang, Chaofan Lin, Jongseok Park, Guangxuan Xiao, Mohamed S. Abdelfattah, Mingyu Gao, Baris Kasikci, Song Han, Ion Stoica

CoRR, December, 2025

PolyServe: Efficient Multi-SLO Serving at Scale.

Kan Zhu, Haiyang Shi, Le Xu, Jiaxin Shan, Arvind Krishnamurthy, Baris Kasikci, Liguang Xie

CoRR, July, 2025

TeleRAG: Efficient Retrieval-Augmented Generation Inference with Lookahead Retrieval.

Chien-Yu Lin, Keisuke Kamahori, Yiyu Liu, Xiaoxiang Shi, Madhav Mahesh Kashyap, Yile Gu, Rulin Shao, Zihao Ye, Kan Zhu, Stephanie Wang, Arvind Krishnamurthy, Rohan Kadekodi, Luis Ceze, Baris Kasikci

CoRR, February, 2025

Tactic: Adaptive Sparse Attention with Clustering and Distribution Fitting for Long-Context LLMs.

Kan Zhu, Tian Tang, Qinyu Xu, Yile Gu, Zhichen Zeng, Rohan Kadekodi, Liangyu Zhao, Ang Li, Arvind Krishnamurthy, Baris Kasikci

CoRR, February, 2025

NanoFlow: Towards Optimal Large Language Model Serving Throughput.

Kan Zhu, Yufei Gao, Yilong Zhao, Liangyu Zhao, Gefei Zuo, Yile Gu, Dedong Xie, Zihao Ye, Keisuke Kamahori, Chien-Yu Lin, Ziren Wang, Stephanie Wang, Arvind Krishnamurthy, Baris Kasikci

Proceedings of the 19th USENIX Symposium on Operating Systems Design and Implementation, 2025

Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models.

Keisuke Kamahori, Tian Tang, Yile Gu, Kan Zhu, Baris Kasikci

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

From Optimal to Practical: Efficient Micro-op Cache Replacement Policies for Data Center Applications.

Kan Zhu, Yilong Zhao, Yufei Gao, Peter Braun, Tanvir Ahmed Khan, Heiner Litz, Baris Kasikci, Shuwen Deng

Proceedings of the IEEE International Symposium on High Performance Computer Architecture, 2025

2024

BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching.

Yilong Zhao, Shuo Yang, Kan Zhu, Lianmin Zheng, Baris Kasikci, Yang Zhou, Jiarong Xing, Ion Stoica

CoRR, 2024

NanoFlow: Towards Optimal Large Language Model Serving Throughput.

Kan Zhu, Yilong Zhao, Liangyu Zhao, Gefei Zuo, Yile Gu, Dedong Xie, Yufei Gao, Qinyu Xu, Tian Tang, Zihao Ye, Keisuke Kamahori, Chien-Yu Lin, Stephanie Wang, Arvind Krishnamurthy, Baris Kasikci

CoRR, 2024

Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models.

Keisuke Kamahori, Yile Gu, Kan Zhu, Baris Kasikci

CoRR, 2024

Atom: Low-Bit Quantization for Efficient and Accurate LLM Serving.

Yilong Zhao, Chien-Yu Lin, Kan Zhu, Zihao Ye, Lequn Chen, Size Zheng, Luis Ceze, Arvind Krishnamurthy, Tianqi Chen, Baris Kasikci

Proceedings of the Seventh Annual Conference on Machine Learning and Systems, 2024

QUEST: Query-Aware Sparsity for Efficient Long-Context LLM Inference.

Jiaming Tang, Yilong Zhao, Kan Zhu, Guangxuan Xiao, Baris Kasikci, Song Han

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Can Storage Devices be Power Adaptive?

Dedong Xie, Theano Stavrinos, Kan Zhu, Simon Peter, Baris Kasikci, Thomas E. Anderson

Proceedings of the 16th ACM Workshop on Hot Topics in Storage and File Systems, 2024

2016

Practical Algorithms for Learning Near-Isometric Linear Embeddings.

Jerry Luo, Kayla Shapiro, Hao-Jun Michael Shi, Qi Yang, Kan Zhu

CoRR, 2016