Zero-CPU Collection with Direct Telemetry Access. - Jonatan Langlet; Ran Ben-Basat; Sivaramakrishnan Ramanathan; Gabriele Oliaro; Michael Mitzenmacher; Minlan Yu; Gianni Antichi (HotNets, 2021)

Direct Telemetry Access. - Jonatan Langlet; Ran Ben Basat; Sivaramakrishnan Ramanathan; Gabriele Oliaro; Michael Mitzenmacher; Minlan Yu; Gianni Antichi (CoRR, 2022)

Direct Telemetry Access. - Jonatan Langlet; Ran Ben Basat; Gabriele Oliaro; Michael Mitzenmacher; Minlan Yu; Gianni Antichi (SIGCOMM, 2023)

SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification. - Xupeng Miao; Gabriele Oliaro; Zhihao Zhang 001; Xinhao Cheng; Zeyu Wang; Rae Ying Yee Wong; Zhuoming Chen; Daiyaan Arfeen; Reyna Abhyankar; Zhihao Jia (CoRR, 2023)

Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems. - Xupeng Miao; Gabriele Oliaro; Zhihao Zhang 001; Xinhao Cheng; Hongyi Jin; Tianqi Chen 001; Zhihao Jia (CoRR, 2023)

Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models. - Zhengxin Zhang; Dan Zhao 003; Xupeng Miao; Gabriele Oliaro; Zhihao Zhang 001; Qing Li 006; Yong Jiang 001; Zhihao Jia (ACL (1), 2024)

Optimal Kernel Orchestration for Tensor Programs with Korch. - Muyan Hu; Ashwin Venkatram; Shreyashri Biswas; Balamurugan Marimuthu; Bohan Hou; Gabriele Oliaro; Haojie Wang; Liyan Zheng 001; Xupeng Miao; Jidong Zhai; Zhihao Jia (ASPLOS (3), 2024)

SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification. - Xupeng Miao; Gabriele Oliaro; Zhihao Zhang 001; Xinhao Cheng; Zeyu Wang; Zhengxin Zhang; Rae Ying Yee Wong; Alan Zhu 001; Lijie Yang 003; Xiaoxiang Shi; Chunan Shi; Zhuoming Chen; et al. (ASPLOS (3), 2024)

Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models. - Zhengxin Zhang; Dan Zhao 003; Xupeng Miao; Gabriele Oliaro; Qing Li 006; Yong Jiang 001; Zhihao Jia (CoRR, 2024)

FlexLLM: A System for Co-Serving Large Language Model Inference and Parameter-Efficient Finetuning. - Xupeng Miao; Gabriele Oliaro; Xinhao Cheng; Mengdi Wu; Colin Unger; Zhihao Jia (CoRR, 2024)

SuffixDecoding: A Model-Free Approach to Speeding Up Large Language Model Inference. - Gabriele Oliaro; Zhihao Jia; Daniel F. Campos; Aurick Qiao (CoRR, 2024)

AdaServe: SLO-Customized LLM Serving with Fine-Grained Speculative Decoding. - Zikun Li; Zhuofu Chen; Remi Delacourt; Gabriele Oliaro; Zeyu Wang; Qinghan Chen; Shuhuai Lin; April Yang; Zhihao Zhang 001; Zhuoming Chen; Sean Lai; Xupeng Miao; et al. (CoRR, 2025)

SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning. - Rui Pan 003; Yinwei Dai; Zhihao Zhang 001; Gabriele Oliaro; Zhihao Jia; Ravi Netravali (CoRR, 2025)