FlashDecoding++: Faster Large Language Model Inference on GPUs. - Ke Hong; Guohao Dai; Jiaming Xu; Qiuli Mao; Xiuhong Li; Jun Liu 071; Kangdi Chen; Yuhan Dong; Yu Wang 002 (CoRR, 2023)

FEASTA: A Flexible and Efficient Accelerator for Sparse Tensor Algebra in Machine Learning. - Kai Zhong; Zhenhua Zhu; Guohao Dai; Hongyi Wang; Xinhao Yang; Haoyu Zhang; Jin Si; Qiuli Mao; Shulin Zeng; Ke Hong; Genghan Zhang; Huazhong Yang; et al. (ASPLOS (3), 2024)

FlashDecoding++: Faster Large Language Model Inference with Asynchronization, Flat GEMM Optimization, and Heuristics. - Ke Hong; Guohao Dai; Jiaming Xu; Qiuli Mao; Xiuhong Li; Jun Liu 071; Kangdi Chen; Yuhan Dong; Yu Wang 002 (MLSys, 2024)

FlashOverlap: A Lightweight Design for Efficiently Overlapping Communication and Computation. - Ke Hong; Xiuhong Li; Minxu Liu; Qiuli Mao; Tianqi Wu; Zixiao Huang; Lufang Chen; Zhong Wang; Yichong Zhang; Zhenhua Zhu; Guohao Dai; Yu Wang 002 (CoRR, 2025)

semi-PD: Towards Efficient LLM Serving via Phase-Wise Disaggregated Computation and Unified Storage. - Ke Hong; Lufang Chen; Zhong Wang; Xiuhong Li; Qiuli Mao; Jianping Ma; Chao Xiong; Guanyu Wu; Buhe Han; Guohao Dai; Yu Wang 002 (CoRR, 2025)