Luohe Shi

According to our database, Luohe Shi authored at least 7 papers between 2024 and 2026.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of four.

2026

Scaling LLM Speculative Decoding: Non-Autoregressive Forecasting in Large-Batch Scenarios.

Luohe Shi, Zuchao Li, Lefei Zhang, Baoyuan Qi, Guoming Liu, Hai Zhao

Proceedings of the Fortieth AAAI Conference on Artificial Intelligence, 2026

2025

Faster MoE LLM Inference for Extremely Large Models.

Haoqi Yang, Luohe Shi, Qiwei Li, Zuchao Li, Ping Wang, Bo Du, Mengjia Shen, Hai Zhao

CoRR, May, 2025

From Parameters to Performance: A Data-Driven Study on LLM Structure and Development.

Suqing Wang, Zuchao Li, Luohe Shi, Bo Du, Hai Zhao, Yun Li, Qianren Wang

Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025

SpindleKV: A Novel KV Cache Reduction Method Balancing Both Shallow and Deep Layers.

Zicong Tang, Luohe Shi, Zuchao Li, Baoyuan Qi, Guoming Liu, Lefei Zhang, Ping Wang

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

KV-Latent: Dimensional-level KV Cache Reduction with Frequency-aware Rotary Positional Embedding.

Luohe Shi, Zuchao Li, Lefei Zhang, Baoyuan Qi, Guoming Liu, Hai Zhao

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

2024

Keep the Cost Down: A Review on Methods to Optimize LLM' s KV-Cache Consumption.

Luohe Shi, Hongyi Zhang, Yao Yao, Zuchao Li, Hai Zhao

CoRR, 2024

Reference Trustable Decoding: A Training-Free Augmentation Paradigm for Large Language Models.

Luohe Shi, Yao Yao, Zuchao Li, Lefei Zhang, Hai Zhao

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024