Social-WaGDAT: Interaction-aware Trajectory Prediction via Wasserstein Graph Double-Attention Network. - Jiachen Li 001; Hengbo Ma; Zhihao Zhang 001; Masayoshi Tomizuka (CoRR, 2020)

GradSign: Model Performance Inference with Theoretical Insights. - Zhihao Zhang 001; Zhihao Jia (ICLR, 2022)

Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Tracking. - Jiachen Li 001; Hengbo Ma; Zhihao Zhang 001; Jinning Li 002; Masayoshi Tomizuka (IEEE Trans. Intell. Transp. Syst., 2022)

SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification. - Xupeng Miao; Gabriele Oliaro; Zhihao Zhang 001; Xinhao Cheng; Zeyu Wang; Rae Ying Yee Wong; Zhuoming Chen; Daiyaan Arfeen; Reyna Abhyankar; Zhihao Jia (CoRR, 2023)

Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems. - Xupeng Miao; Gabriele Oliaro; Zhihao Zhang 001; Xinhao Cheng; Hongyi Jin; Tianqi Chen 001; Zhihao Jia (CoRR, 2023)

Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models. - Zhengxin Zhang; Dan Zhao 003; Xupeng Miao; Gabriele Oliaro; Zhihao Zhang 001; Qing Li 006; Yong Jiang 001; Zhihao Jia (ACL (1), 2024)

SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification. - Xupeng Miao; Gabriele Oliaro; Zhihao Zhang 001; Xinhao Cheng; Zeyu Wang; Zhengxin Zhang; Rae Ying Yee Wong; Alan Zhu 001; Lijie Yang 003; Xiaoxiang Shi; Chunan Shi; Zhuoming Chen; et al. (ASPLOS (3), 2024)

Accelerating Iterative Retrieval-augmented Language Model Serving with Speculation. - Zhihao Zhang 001; Alan Zhu 001; Lijie Yang 003; Yihua Xu; Lanting Li; Phitchaya Mangpo Phothilimthana; Zhihao Jia (ICML, 2024)

Communication Bounds for the Distributed Experts Problem. - Zhihao Jia; Qi Pang; Trung Tran; David P. Woodruff; Zhihao Zhang 001; Wenting Zheng (NeurIPS, 2024)

Accelerating Retrieval-Augmented Language Model Serving with Speculation. - Zhihao Zhang 001; Alan Zhu 001; Lijie Yang 003; Yihua Xu; Lanting Li; Phitchaya Mangpo Phothilimthana; Zhihao Jia (CoRR, 2024)

TidalDecode: Fast and Accurate LLM Decoding with Position Persistent Sparse Attention. - Lijie Yang 003; Zhihao Zhang 001; Zhuofu Chen; Zikun Li; Zhihao Jia (ICLR, 2025)

AdaServe: SLO-Customized LLM Serving with Fine-Grained Speculative Decoding. - Zikun Li; Zhuofu Chen; Remi Delacourt; Gabriele Oliaro; Zeyu Wang; Qinghan Chen; Shuhuai Lin; April Yang; Zhihao Zhang 001; Zhuoming Chen; Sean Lai; Xupeng Miao; et al. (CoRR, 2025)

SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning. - Rui Pan 003; Yinwei Dai; Zhihao Zhang 001; Gabriele Oliaro; Zhihao Jia; Ravi Netravali (CoRR, 2025)