PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation. - Ningxin Zheng; Huiqiang Jiang; Quanlu Zhang; Zhenhua Han; Lingxiao Ma; Yuqing Yang 001; Fan Yang 024; Chengruidong Zhang; Lili Qiu; Mao Yang 004; Lidong Zhou (SOSP, 2023)

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens. - Yiran Ding; Li Lyna Zhang; Chengruidong Zhang; Yuanyuan Xu; Ning Shang; Jiahang Xu; Fan Yang 024; Mao Yang 004 (ICML, 2024)

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention. - Huiqiang Jiang; Yucheng Li; Chengruidong Zhang; Qianhui Wu; Xufang Luo; Surin Ahn; Zhenhua Han; Amir H. Abdi; Dongsheng Li 002; Chin-Yew Lin; Yuqing Yang 001; Lili Qiu (NeurIPS, 2024)

LitePred: Transferable and Scalable Latency Prediction for Hardware-Aware Neural Architecture Search. - Chengquan Feng; Li Lyna Zhang; Yuanchi Liu; Jiahang Xu; Chengruidong Zhang; Zhiyuan Wang; Ting Cao; Mao Yang 004; Haisheng Tan (NSDI, 2024)

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable. - Chaofan Lin; Zhenhua Han; Chengruidong Zhang; Yuqing Yang 001; Fan Yang 024; Chen Chen 067; Lili Qiu (OSDI, 2024)

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone. - Marah I Abdin; Sam Ade Jacobs; Ammar Ahmad Awan; Jyoti Aneja; Ahmed Awadallah 001; Hany Awadalla; Nguyen Bach; Amit Bahree; Arash Bakhtiari; Harkirat S. Behl; Alon Benhaim; Misha Bilenko; et al. (CoRR, 2024)

RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval. - Di Liu; Meng Chen; Baotong Lu; Huiqiang Jiang; Zhenhua Han; Qianxi Zhang; Qi Chen 009; Chengruidong Zhang; Bailu Ding; Kai Zhang; Chen Chen 067; Fan Yang 024; et al. (CoRR, 2024)

GRIN: GRadient-INformed MoE. - Liyuan Liu; Young Jin Kim 001; Shuohang Wang; Chen Liang 006; Yelong Shen; Hao Cheng 002; Xiaodong Liu 003; Masahiro Tanaka; Xiaoxia Wu; Wenxiang Hu; Vishrav Chaudhary; Zeqi Lin; et al. (CoRR, 2024)

SCBench: A KV Cache-Centric Analysis of Long-Context Methods. - Yucheng Li; Huiqiang Jiang; Qianhui Wu; Xufang Luo; Surin Ahn; Chengruidong Zhang; Amir H. Abdi; Dongsheng Li 002; Jianfeng Gao 001; Yuqing Yang 001; Lili Qiu (ICLR, 2025)

Region-Adaptive Sampling for Diffusion Transformers. - Ziming Liu; Yifan Yang 004; Chengruidong Zhang; Yiqi Zhang; Lili Qiu; Yang You 001; Yuqing Yang 001 (CoRR, 2025)

MMInference: Accelerating Pre-filling for Long-Context VLMs via Modality-Aware Permutation Sparse Attention. - Yucheng Li; Huiqiang Jiang; Chengruidong Zhang; Qianhui Wu; Xufang Luo; Surin Ahn; Amir H. Abdi; Dongsheng Li 002; Jianfeng Gao 001; Yuqing Yang 001; Lili Qiu (CoRR, 2025)

RetroInfer: A Vector-Storage Approach for Scalable Long-Context LLM Inference. - Yaoqi Chen; Jinkai Zhang; Baotong Lu; Qianxi Zhang; Chengruidong Zhang; Jingjia Luo; Di Liu; Huiqiang Jiang; Qi Chen; Jing Liu; Bailu Ding; Xiao Yan; et al. (CoRR, 2025)

Chain-of-Model Learning for Language Model. - Kaitao Song; Xiaohua Wang; Xu Tan 003; Huiqiang Jiang; Chengruidong Zhang; Yongliang Shen 001; Cen LU; Zihao Li 006; Zifan Song; Caihua Shan; Yansen Wang; Kan Ren; et al. (CoRR, 2025)

TriangleMix: A Lossless and Efficient Attention Pattern for Long Context Prefilling. - Zhiyuan He; Yike Zhang; Chengruidong Zhang; Huiqiang Jiang; Yuqing Yang 001; Lili Qiu (CoRR, 2025)

LeanK: Learnable K Cache Channel Pruning for Efficient Decoding. - Yike Zhang; Zhiyuan He; Huiqiang Jiang; Chengruidong Zhang; Yuqing Yang 001; Jianyong Wang 001; Lili Qiu (CoRR, 2025)