Chao Jin

According to our database, Chao Jin authored at least 17 papers between 2022 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

BigMac: Breaking the Pareto Frontier of Compute and Memory in Multimodal LLM Training.

Zili Zhang, Chengxu Yang, Shenglong Zhang, Chenyu Wang, Yufan Zhang, Tuo Dai, Zhouyang Li, Yuhong Ge, Chao Jin, Xin Jin, Yuliang Liu

CoRR, May, 2026

ReLibra: Routing-Replay-Guided Load Balancing for MoE Training in Reinforcement Learning.

Chao Jin, Xinming Wei, Yinmin Zhong, Chengxu Yang, Bingyang Wu, Ruidong Zhu, Zili Zhang, Yuliang Liu, Xin Jin

CoRR, May, 2026

Heddle: A Distributed Orchestration System for Agentic RL Rollout.

Zili Zhang, Yinmin Zhong, Chengxu Yang, Chao Jin, Bingyang Wu, Xinming Wei, Yuliang Liu, Xin Jin

CoRR, March, 2026

RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation.

Chao Jin, Zili Zhang, Xuanlin Jiang, Fangyue Liu, Shufan Liu, Xuanzhe Liu, Xin Jin

ACM Trans. Comput. Syst., February, 2026

HydraServe: Minimizing Cold Start Latency for Serverless LLM Serving in Public Clouds.

Chiheng Lou, Sheng Qi, Chao Jin, Dapeng Nie, Haoran Yang, Yu Ding, Xuanzhe Liu, Xin Jin

Proceedings of the 23rd USENIX Symposium on Networked Systems Design and Implementation, 2026

MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production.

Chao Jin, Ziheng Jiang, Zhihao Bai, Zheng Zhong, Juncai Liu, Xiang Li, Ningxin Zheng, Xi Wang, Cong Xie, Qi Huang, Wen Heng, Yiyuan Ma, Wenlei Bao, Size Zheng, Xuegui Zheng, Yanghua Peng, Haibin Lin, Xuanzhe Liu, Xin Jin, Xin Liu

Proceedings of the 21st European Conference on Computer Systems, 2026

2025

MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production.

Chao Jin, Ziheng Jiang, Zhihao Bai, Zheng Zhong, Juncai Liu, Xiang Li, Ningxin Zheng, Xi Wang, Cong Xie, Qi Huang, Wen Heng, Yiyuan Ma, Wenlei Bao, Size Zheng, Yanghua Peng, Haibin Lin, Xuanzhe Liu, Xin Jin, Xin Liu

CoRR, May, 2025

MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism.

Ruidong Zhu, Ziheng Jiang, Chao Jin, Peng Wu, Cesar A. Stuardo, Dongyang Wang, Xinlei Zhang, Huaping Zhou, Haoran Wei, Yang Cheng, Jianzhe Xiao, Xinyi Zhang, Lingjun Liu, Haibin Lin, Li-Wen Chang, Jianxi Ye, Xiao Yu, Xuanzhe Liu, Xin Jin, Xin Liu

CoRR, April, 2025

Towards Swift Serverless LLM Cold Starts with ParaServe.

Chiheng Lou, Sheng Qi, Chao Jin, Dapeng Nie, Haoran Yang, Xuanzhe Liu, Xin Jin

CoRR, February, 2025

FaaSPR: Latency-Oriented Placement and Routing Optimization for Serverless Workflow Processing.

Yunshan Jia, Chao Jin, Qing Li, Xuanzhe Liu, Xin Jin

IEEE Trans. Netw., 2025

MegaScale-Infer: Efficient Mixture-of-Experts Model Serving with Disaggregated Expert Parallelism.

Ruidong Zhu, Ziheng Jiang, Chao Jin, Peng Wu, Cesar A. Stuardo, Dongyang Wang, Xinlei Zhang, Huaping Zhou, Haoran Wei, Yang Cheng, Jianzhe Xiao, Xinyi Zhang, Lingjun Liu, Haibin Lin, Li-Wen Chang, Jianxi Ye, Xiao Yu, Xuanzhe Liu, Xin Jin, Xin Liu

Proceedings of the ACM SIGCOMM 2025 Conference, 2025

2024

Pyxis: Scheduling Mixed Tasks in Disaggregated Datacenters.

Sheng Qi, Chao Jin, Mosharaf Chowdhury, Zhenming Liu, Xuanzhe Liu, Xin Jin

IEEE Trans. Parallel Distributed Syst., September, 2024

RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation.

Chao Jin, Zili Zhang, Xuanlin Jiang, Fangyue Liu, Xin Liu, Xuanzhe Liu, Xin Jin

CoRR, 2024

Jolteon: Unleashing the Promise of Serverless for Serverless Workflows.

Zili Zhang, Chao Jin, Xin Jin

Proceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation, 2024

2023

Ditto: Efficient Serverless Analytics with Elastic Parallelism.

Chao Jin, Zili Zhang, Xingyu Xiang, Songyun Zou, Gang Huang, Xuanzhe Liu, Xin Jin

Proceedings of the ACM SIGCOMM 2023 Conference, 2023

Fast, Approximate Vector Queries on Very Large Unstructured Datasets.

Zili Zhang, Chao Jin, Linpeng Tang, Xuanzhe Liu, Xin Jin

Proceedings of the 20th USENIX Symposium on Networked Systems Design and Implementation, 2023

2022

Melon: breaking the memory wall for resource-efficient on-device machine learning.

Qipeng Wang, Mengwei Xu, Chao Jin, Xinran Dong, Jinliang Yuan, Xin Jin, Gang Huang, Yunxin Liu, Xuanzhe Liu

Proceedings of the MobiSys '22: The 20th Annual International Conference on Mobile Systems, Applications and Services, Portland, Oregon, 27 June 2022, 2022