Efficient flow scheduling in distributed deep learning training with echelon formation. - Rui Pan 003; Yiming Lei; Jialong Li 006; Zhiqiang Xie; Binhang Yuan; Yiting Xia (HotNets, 2022)

Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning. - Pengfei Zheng; Rui Pan 003; Tarannum Khan; Shivaram Venkataraman; Aditya Akella (NSDI, 2023)

Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving. - Yinwei Dai; Rui Pan 003; Anand P. Iyer; Kai Li 001; Ravi Netravali (SOSP, 2024)

Improving DNN Inference Throughput Using Practical, Per-Input Compute Adaptation. - Anand Padmanabha Iyer; Mingyu Guan; Yinwei Dai; Rui Pan 003; Swapnil Gandhi; Ravi Netravali (SOSP, 2024)

Tarzan: Passively-Learned Real-Time Rate Control for Video Conferencing. - Neil Agarwal; Rui Pan 003; Francis Y. Yan; Ravi Netravali (CoRR, 2024)

Optimizing Mixture-of-Experts Inference Time Combining Model Deployment and Communication Scheduling. - Jialong Li 006; Shreyansh Tripathi; Lakshay Rastogi; Yiming Lei; Rui Pan 003; Yiting Xia (CoRR, 2024)

Marconi: Prefix Caching for the Era of Hybrid LLMs. - Rui Pan 003; Zhuang Wang; Zhen Jia; Can Karakus; Luca Zancato; Tri Dao; Ravi Netravali; Yida Wang (CoRR, 2024)

RAGServe: Fast Quality-Aware RAG Systems with Configuration Adaptation. - Siddhant Ray; Rui Pan 003; Zhuohan Gu; Kuntai Du; Ganesh Ananthanarayanan; Ravi Netravali; Junchen Jiang (CoRR, 2024)

Mowgli: Passively Learned Rate Control for Real-Time Video. - Neil Agarwal; Rui Pan 003; Francis Y. Yan; Ravi Netravali (NSDI, 2025)

SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning. - Rui Pan 003; Yinwei Dai; Zhihao Zhang 001; Gabriele Oliaro; Zhihao Jia; Ravi Netravali (CoRR, 2025)