Online Detection of Outstanding Quantiles with QuantileFilter. - Yuhan Wu 001; Aomufei Yuan; Zhouran Shi; Yuanpeng Li 002; Yikai Zhao 001; Peiqing Chen; Tong Yang 003; Bin Cui 001 (ICDE, 2024)

Prediction Is All MoE Needs: Expert Load Distribution Goes from Fluctuating to Stabilizing. - Peizhuang Cong; Aomufei Yuan; Shimao Chen; Yuxuan Tian; Bowen Ye; Tong Yang 003 (CoRR, 2024)

FairKV: Balancing Per-Head KV Cache for Fast Multi-GPU Inference. - Bingzhe Zhao; Ke Cheng; Aomufei Yuan; Yuxuan Tian; Ruiguang Zhong; Chengchen Hu; Tong Yang; Lian Yu (CoRR, 2025)

KeepKV: Eliminating Output Perturbation in KV Cache Compression for Efficient LLMs Inference. - Yuxuan Tian; Zihan Wang; Yebo Peng; Aomufei Yuan; Zhiming Wang; Bairen Yi; Xin Liu; Yong Cui 001; Tong Yang 003 (CoRR, 2025)