SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification. - Xupeng Miao; Gabriele Oliaro; Zhihao Zhang 001; Xinhao Cheng; Zeyu Wang; Rae Ying Yee Wong; Zhuoming Chen; Daiyaan Arfeen; Reyna Abhyankar; Zhihao Jia (CoRR, 2023)

SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification. - Xupeng Miao; Gabriele Oliaro; Zhihao Zhang 001; Xinhao Cheng; Zeyu Wang; Zhengxin Zhang; Rae Ying Yee Wong; Alan Zhu 001; Lijie Yang 003; Xiaoxiang Shi; Chunan Shi; Zhuoming Chen; et al. (ASPLOS (3), 2024)

InferCept: Efficient Intercept Support for Augmented Large Language Model Inference. - Reyna Abhyankar; Zijian He; Vikranth Srivatsa; Hao Zhang; Yiying Zhang 005 (ICML, 2024)

APIServe: Efficient API Support for Large-Language Model Inferencing. - Reyna Abhyankar; Zijian He; Vikranth Srivatsa; Hao Zhang; Yiying Zhang 005 (CoRR, 2024)

Preble: Efficient Distributed Prompt Scheduling for LLM Serving. - Vikranth Srivatsa; Zijian He; Reyna Abhyankar; Dongming Li; Yiying Zhang 005 (ICLR, 2025)

Cognify: Supercharging Gen-AI Workflows With Hierarchical Autotuning. - Zijian He; Reyna Abhyankar; Vikranth Srivatsa; Yiying Zhang 005 (CoRR, 2025)

OSWorld-Human: Benchmarking the Efficiency of Computer-Use Agents. - Reyna Abhyankar; Qi Qi; Yiying Zhang (CoRR, 2025)