IMI: In-memory Multi-job Inference Acceleration for Large Language Models. - Bin Gao; Zhehui Wang; Zhuomin He; Tao Luo 014; Weng-Fai Wong; Zhi Zhou 006 (ICPP, 2024)

Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention. - Bin Gao; Zhuomin He; Puru Sharma; Qingxuan Kang; Djordje Jevdjic; Junbo Deng; Xingkun Yang; Zhou Yu; Pengfei Zuo (USENIX ATC, 2024)

AttentionStore: Cost-effective Attention Reuse across Multi-turn Conversations in Large Language Model Serving. - Bin Gao; Zhuomin He; Puru Sharma; Qingxuan Kang; Djordje Jevdjic; Junbo Deng; Xingkun Yang; Zhou Yu; Pengfei Zuo (CoRR, 2024)

AdaSkip: Adaptive Sublayer Skipping for Accelerating Long-Context LLM Inference. - Zhuomin He; Yizhen Yao; Pengfei Zuo; Bin Gao; Qinya Li; Zhenzhe Zheng; Fan Wu 006 (AAAI, 2025)

Online Context Caching for Distributed Large Language Models Serving. - Bin Gao; Zhuomin He; Yizhen Yao; Zhanzhi Lou Lou; Zhi Zhou 006; Weng-Fai Wong (INFOCOM, 2025)