PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU. - Yixin Song; Zeyu Mi; Haotong Xie; Haibo Chen 001 (SOSP, 2024)

Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters. - Yixin Song; Haotong Xie; Zhengyan Zhang; Bo Wen; Li Ma; Zeyu Mi; Haibo Chen 001 (CoRR, 2024)