Zhuomin He

According to our database, Zhuomin He authored at least 5 papers between 2024 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

Online Context Caching for Distributed Large Language Models Serving.

Bin Gao, Zhuomin He, Yizhen Yao, Zhanzhi Lou Lou, Zhi Zhou, Weng-Fai Wong

Proceedings of the IEEE INFOCOM 2025, 2025

AdaSkip: Adaptive Sublayer Skipping for Accelerating Long-Context LLM Inference.

Zhuomin He, Yizhen Yao, Pengfei Zuo, Bin Gao, Qinya Li, Zhenzhe Zheng, Fan Wu

Proceedings of the AAAI-25, Sponsored by the Association for the Advancement of Artificial Intelligence, February 25, 2025

2024

AttentionStore: Cost-effective Attention Reuse across Multi-turn Conversations in Large Language Model Serving.

Bin Gao, Zhuomin He, Puru Sharma, Qingxuan Kang, Djordje Jevdjic, Junbo Deng, Xingkun Yang, Zhou Yu, Pengfei Zuo

CoRR, 2024

Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention.

Bin Gao, Zhuomin He, Puru Sharma, Qingxuan Kang, Djordje Jevdjic, Junbo Deng, Xingkun Yang, Zhou Yu, Pengfei Zuo

Proceedings of the 2024 USENIX Annual Technical Conference, 2024

IMI: In-memory Multi-job Inference Acceleration for Large Language Models.

Bin Gao, Zhehui Wang, Zhuomin He, Tao Luo, Weng-Fai Wong, Zhi Zhou

Proceedings of the 53rd International Conference on Parallel Processing, 2024