Melon: breaking the memory wall for resource-efficient on-device machine learning. - Qipeng Wang 001; Mengwei Xu 001; Chao Jin 007; Xinran Dong; Jinliang Yuan; Xin Jin 008; Gang Huang 001; Yunxin Liu 001; Xuanzhe Liu (MobiSys, 2022)

Fast, Approximate Vector Queries on Very Large Unstructured Datasets. - Zili Zhang; Chao Jin 007; Linpeng Tang; Xuanzhe Liu; Xin Jin 008 (NSDI, 2023)

Ditto: Efficient Serverless Analytics with Elastic Parallelism. - Chao Jin 007; Zili Zhang; Xingyu Xiang; Songyun Zou; Gang Huang 001; Xuanzhe Liu; Xin Jin 008 (SIGCOMM, 2023)

Jolteon: Unleashing the Promise of Serverless for Serverless Workflows. - Zili Zhang; Chao Jin 007; Xin Jin 008 (NSDI, 2024)

RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation. - Chao Jin 007; Zili Zhang; Xuanlin Jiang; Fangyue Liu; Xin Liu 086; Xuanzhe Liu; Xin Jin 008 (CoRR, 2024)

Pyxis: Scheduling Mixed Tasks in Disaggregated Datacenters. - Sheng Qi; Chao Jin 007; Mosharaf Chowdhury; Zhenming Liu; Xuanzhe Liu; Xin Jin 008 (IEEE Trans. Parallel Distributed Syst., 2024)

MegaScale-Infer: Efficient Mixture-of-Experts Model Serving with Disaggregated Expert Parallelism. - Ruidong Zhu; Ziheng Jiang; Chao Jin 007; Peng Wu; Cesar A. Stuardo; Dongyang Wang; Xinlei Zhang; Huaping Zhou; Haoran Wei; Yang Cheng; Jianzhe Xiao; Xinyi Zhang; et al. (SIGCOMM, 2025)

FaaSPR: Latency-Oriented Placement and Routing Optimization for Serverless Workflow Processing. - Yunshan Jia; Chao Jin 007; Qing Li 028; Xuanzhe Liu; Xin Jin 008 (IEEE Trans. Netw., 2025)

Towards Swift Serverless LLM Cold Starts with ParaServe. - Chiheng Lou; Sheng Qi; Chao Jin 007; Dapeng Nie; Haoran Yang; Xuanzhe Liu; Xin Jin 008 (CoRR, 2025)

MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism. - Ruidong Zhu; Ziheng Jiang; Chao Jin 007; Peng Wu; Cesar A. Stuardo; Dongyang Wang; Xinlei Zhang; Huaping Zhou; Haoran Wei; Yang Cheng; Jianzhe Xiao; Xinyi Zhang; et al. (CoRR, 2025)

MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production. - Chao Jin 007; Ziheng Jiang; Zhihao Bai; Zheng Zhong; Juncai Liu; Xiang Li 067; Ningxin Zheng; Xi Wang; Cong Xie; Qi Huang 001; Wen Heng; Yiyuan Ma; et al. (CoRR, 2025)

MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production. - Chao Jin 007; Ziheng Jiang; Zhihao Bai; Zheng Zhong; Juncai Liu; Xiang Li 067; Ningxin Zheng; Xi Wang; Cong Xie; Qi Huang 001; Wen Heng; Yiyuan Ma; et al. (EuroSys, 2026)

HydraServe: Minimizing Cold Start Latency for Serverless LLM Serving in Public Clouds. - Chiheng Lou; Sheng Qi; Chao Jin 007; Dapeng Nie; Haoran Yang; Yu Ding; Xuanzhe Liu; Xin Jin 008 (NSDI, 2026)

RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation. - Chao Jin 007; Zili Zhang; Xuanlin Jiang; Fangyue Liu; Shufan Liu; Xuanzhe Liu; Xin Jin 008 (ACM Trans. Comput. Syst., 2026)

Heddle: A Distributed Orchestration System for Agentic RL Rollout. - Zili Zhang; Yinmin Zhong; Chengxu Yang; Chao Jin 007; Bingyang Wu; Xinming Wei; Yuliang Liu; Xin Jin 008 (CoRR, 2026)

ReLibra: Routing-Replay-Guided Load Balancing for MoE Training in Reinforcement Learning. - Chao Jin 007; Xinming Wei; Yinmin Zhong; Chengxu Yang; Bingyang Wu; Ruidong Zhu; Zili Zhang; Yuliang Liu; Xin Jin 008 (CoRR, 2026)

BigMac: Breaking the Pareto Frontier of Compute and Memory in Multimodal LLM Training. - Zili Zhang; Chengxu Yang; Shenglong Zhang; Chenyu Wang; Yufan Zhang; Tuo Dai; Zhouyang Li; Yuhong Ge; Chao Jin 007; Xin Jin 008; Yuliang Liu (CoRR, 2026)