Embracing Uncertainty for Equity in Resource Allocation in ML Training. - Suraiya Tairin; Haiying Shen; Zeyu Zhang 005 (ICPP, 2023)

Zero-Delay QKV Compression for Mitigating KV Cache and Network Bottlenecks in LLM Inference. - Zeyu Zhang 005; Haiying Shen (CoRR, 2024)

CSPS: A Communication-Efficient Sequence-Parallelism based Serving System for Transformer based Models with Long Prompts. - Zeyu Zhang 005; Haiying Shen (CoRR, 2024)

Towards Efficient Large Multimodal Model Serving. - Haoran Qiu; Anish Biswas; Zihan Zhao; Jayashree Mohan; Alind Khare; Esha Choukse; Íñigo Goiri; Zeyu Zhang 005; Haiying Shen; Chetan Bansal; Ramachandran Ramjee; Rodrigo Fonseca (CoRR, 2025)

HACK: Homomorphic Acceleration via Compression of the Key-Value Cache for Disaggregated LLM Inference. - Zeyu Zhang 005; Haiying Shen; Shay Vargaftik; Ran Ben Basat; Michael Mitzenmacher; Minlan Yu (CoRR, 2025)