NanoFlow: Towards Optimal Large Language Model Serving Throughput. - Kan Zhu; Yilong Zhao 002; Liangyu Zhao; Gefei Zuo; Yile Gu; Dedong Xie; Yufei Gao; Qinyu Xu; Tian Tang 001; Zihao Ye 001; Keisuke Kamahori; Chien-Yu Lin; et al. (CoRR, 2024)

Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models. - Keisuke Kamahori; Tian Tang 001; Yile Gu; Kan Zhu; Baris Kasikci (ICLR, 2025)

Twilight: Adaptive Attention Sparsity with Hierarchical Top-$p$ Pruning. - Chaofan Lin; Jiaming Tang; Shuo Yang 011; Hanshuo Wang; Tian Tang 001; Boyu Tian; Ion Stoica; Song Han 003; Mingyu Gao 001 (NeurIPS, 2025)

Twilight: Adaptive Attention Sparsity with Hierarchical Top-p Pruning. - Chaofan Lin; Jiaming Tang; Shuo Yang 011; Hanshuo Wang; Tian Tang 001; Boyu Tian; Ion Stoica; Song Han 003; Mingyu Gao 001 (CoRR, 2025)

Tactic: Adaptive Sparse Attention with Clustering and Distribution Fitting for Long-Context LLMs. - Kan Zhu; Tian Tang 001; Qinyu Xu; Yile Gu; Zhichen Zeng 002; Rohan Kadekodi; Liangyu Zhao; Ang Li; Arvind Krishnamurthy; Baris Kasikci (CoRR, 2025)

Expert-as-a-Service: Towards Efficient, Scalable, and Robust Large-scale MoE Serving. - Ziming Liu; Boyu Tian; Guoteng Wang; Zhen Jiang; Peng Sun 006; Zhenhua Han; Tian Tang 001; Xiaohe Hu; Yanmin Jia; Yan Zhang; He Liu; Mingjun Zhang; et al. (CoRR, 2025)

CROPHE: Cross-Operator Dataflow Optimization for Fully Homomorphic Encryption Accelerators. - Xinhua Chen; Jiangbin Dong; Hongren Zheng; Tian Tang 001; Mingyu Gao 001 (HPCA, 2026)

CONCUR: High-Throughput Agentic Batch Inference of LLM via Congestion-Based Concurrency Control. - Qiaoling Chen; Zhisheng Ye 002; Tian Tang 001; Peng Sun 006; Boyu Tian; Guoteng Wang; Shenggui Li; Yonggang Wen 001; Zhenhua Han; Tianwei Zhang 004 (CoRR, 2026)

PlexRL: Cluster-Level Orchestration of Serviceized LLM Execution for RLVR. - Yiqi Zhang; Fangzheng Jiao; Tian Tang 001; Boyu Tian; Hangyu Wang; Qiaoling Chen; Guoteng Wang; Zhen Jiang; Peng Sun 006; Ping Zhang; Xiaohe Hu; Ziming Liu; et al. (CoRR, 2026)