Zhihao Zhang

According to our database, Zhihao Zhang authored at least 13 papers between 2020 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2025

SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning.

Rui Pan, Yinwei Dai, Zhihao Zhang, Gabriele Oliaro, Zhihao Jia, Ravi Netravali

CoRR, April, 2025

AdaServe: SLO-Customized LLM Serving with Fine-Grained Speculative Decoding.

Zikun Li, Zhuofu Chen, Remi Delacourt, Gabriele Oliaro, Zeyu Wang, Qinghan Chen, Shuhuai Lin, April Yang, Zhihao Zhang, Zhuoming Chen, Sean Lai, Xupeng Miao, Zhihao Jia

CoRR, January, 2025

TidalDecode: Fast and Accurate LLM Decoding with Position Persistent Sparse Attention.

Lijie Yang, Zhihao Zhang, Zhuofu Chen, Zikun Li, Zhihao Jia

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

Accelerating Retrieval-Augmented Language Model Serving with Speculation.

Zhihao Zhang, Alan Zhu, Lijie Yang, Yihua Xu, Lanting Li, Phitchaya Mangpo Phothilimthana, Zhihao Jia

CoRR, 2024

Communication Bounds for the Distributed Experts Problem.

Zhihao Jia, Qi Pang, Trung Tran, David P. Woodruff, Zhihao Zhang, Wenting Zheng

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024

Accelerating Iterative Retrieval-augmented Language Model Serving with Speculation.

Zhihao Zhang, Alan Zhu, Lijie Yang, Yihua Xu, Lanting Li, Phitchaya Mangpo Phothilimthana, Zhihao Jia

Proceedings of the Forty-first International Conference on Machine Learning, 2024

SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification.

Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Zeyu Wang, Zhengxin Zhang, Rae Ying Yee Wong, Alan Zhu, Lijie Yang, Xiaoxiang Shi, Chunan Shi, Zhuoming Chen, Daiyaan Arfeen, Reyna Abhyankar, Zhihao Jia

Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, 2024

Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models.

Zhengxin Zhang, Dan Zhao, Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Qing Li, Yong Jiang, Zhihao Jia

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems.

Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Hongyi Jin, Tianqi Chen, Zhihao Jia

CoRR, 2023

SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification.

Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Zeyu Wang, Rae Ying Yee Wong, Zhuoming Chen, Daiyaan Arfeen, Reyna Abhyankar, Zhihao Jia

CoRR, 2023

2022

Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Tracking.

Jiachen Li, Hengbo Ma, Zhihao Zhang, Jinning Li, Masayoshi Tomizuka

IEEE Trans. Intell. Transp. Syst., 2022

GradSign: Model Performance Inference with Theoretical Insights.

Zhihao Zhang, Zhihao Jia

Proceedings of the Tenth International Conference on Learning Representations, 2022

2020

Social-WaGDAT: Interaction-aware Trajectory Prediction via Wasserstein Graph Double-Attention Network.

Jiachen Li, Hengbo Ma, Zhihao Zhang, Masayoshi Tomizuka

CoRR, 2020