Yao Fu

According to our database, Yao Fu authored at least 7 papers between 2022 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

HybridServe: Efficient Serving of Large AI Models with Confidence-Based Cascade Routing.

Leyang Xue, Yao Fu, Luo Mai, Mahesh K. Marina

CoRR, May, 2025

2024

MoE-CAP: Cost-Accuracy-Performance Benchmarking for Mixture-of-Experts Systems.

Yao Fu, Yinsicheng Jiang, Yeqi Huang, Ping Nie, Zhan Lu, Leyang Xue, Congjie He, Man-Kit Sit, Jilong Xue, Li Dong, Ziming Miao, Kai Zou, Edoardo M. Ponti, Luo Mai

CoRR, 2024

MoE-Infinity: Activation-Aware Expert Offloading for Efficient MoE Serving.

Leyang Xue, Yao Fu, Zhan Lu, Luo Mai, Mahesh K. Marina

CoRR, 2024

ServerlessLLM: Locality-Enhanced Serverless Inference for Large Language Models.

Yao Fu, Leyang Xue, Yeqi Huang, Andrei-Octavian Brabete, Dmitrii Ustiugov, Yuvraj Patel, Luo Mai

CoRR, 2024

ServerlessLLM: Low-Latency Serverless Inference for Large Language Models.

Yao Fu, Leyang Xue, Yeqi Huang, Andrei-Octavian Brabete, Dmitrii Ustiugov, Yuvraj Patel, Luo Mai

Proceedings of the 18th USENIX Symposium on Operating Systems Design and Implementation, 2024

2023

TorchOpt: An Efficient Library for Differentiable Optimization.

Jie Ren, Xidong Feng, Bo Liu, Xuehai Pan, Yao Fu, Luo Mai, Yaodong Yang

J. Mach. Learn. Res., 2023

2022

Ekko: A Large-Scale Deep Learning Recommender System with Low-Latency Model Update.

Chijun Sima, Yao Fu, Man-Kit Sit, Liyi Guo, Xuri Gong, Feng Lin, Junyu Wu, Yongsheng Li, Haidong Rong, Pierre-Louis Aublin, Luo Mai

Proceedings of the 16th USENIX Symposium on Operating Systems Design and Implementation, 2022