SIMPLE: Disaggregating Sampling from GPU Inference into a Decision Plane for Faster Distributed LLM Serving. - Bohan Zhao; Zane Cao; Yongchao He (CoRR, 2025)

A Unified Sparse Attention via Multi-Granularity Compression. - Siran Liu; Zane Cao; Yongchao He (CoRR, 2025)

L4: Low-Latency and Load-Balanced LLM Serving via Length-Aware Scheduling. - Yitao Yuan; Chenqi Zhao; Bohan Zhao; Zane Cao; Yongchao He; Wenfei Wu (CoRR, 2025)