MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving. - Jiangfei Duan; Runyu Lu; Haojie Duanmu; Xiuhong Li; Xingcheng Zhang; Dahua Lin; Ion Stoica; Hao Zhang 025 (ICML, 2024)

WKVQuant: Quantizing Weight and Key/Value Cache for Large Language Models Gains More. - Yuxuan Yue; Zhihang Yuan; Haojie Duanmu; Sifan Zhou; Jianlong Wu; Liqiang Nie (CoRR, 2024)

MuxServe: Flexible Multiplexing for Efficient Multiple LLM Serving. - Jiangfei Duan; Runyu Lu; Haojie Duanmu; Xiuhong Li; Xingcheng Zhang; Dahua Lin; Ion Stoica; Hao Zhang 025 (CoRR, 2024)

SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models. - Haojie Duanmu; Zhihang Yuan; Xiuhong Li; Jiangfei Duan; Xingcheng Zhang; Dahua Lin (CoRR, 2024)

Triton-distributed: Programming Overlapping Kernels on Distributed AI Systems with the Triton Compiler. - Size Zheng 001; Wenlei Bao; Qi Hou; Xuegui Zheng; Jin Fang; Chenhui Huang; Tianqi Li; Haojie Duanmu; Renze Chen; Ruifan Xu; Yifan Guo; Ningxin Zheng; et al. (CoRR, 2025)

MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design. - Haojie Duanmu; Xiuhong Li; Zhihang Yuan; Size Zheng 001; Jiangfei Duan; Xingcheng Zhang; Dahua Lin (CoRR, 2025)