SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification. - Xupeng Miao; Gabriele Oliaro; Zhihao Zhang 001; Xinhao Cheng; Zeyu Wang; Zhengxin Zhang; Rae Ying Yee Wong; Alan Zhu 001; Lijie Yang 003; Xiaoxiang Shi; Chunan Shi; Zhuoming Chen; et al. (ASPLOS (3), 2024)

Accelerating Iterative Retrieval-augmented Language Model Serving with Speculation. - Zhihao Zhang 001; Alan Zhu 001; Lijie Yang 003; Yihua Xu; Lanting Li; Phitchaya Mangpo Phothilimthana; Zhihao Jia (ICML, 2024)

Accelerating Retrieval-Augmented Language Model Serving with Speculation. - Zhihao Zhang 001; Alan Zhu 001; Lijie Yang 003; Yihua Xu; Lanting Li; Phitchaya Mangpo Phothilimthana; Zhihao Jia (CoRR, 2024)

TidalDecode: Fast and Accurate LLM Decoding with Position Persistent Sparse Attention. - Lijie Yang 003; Zhihao Zhang 001; Zhuofu Chen; Zikun Li; Zhihao Jia (ICLR, 2025)