How Far Does BERT Look At: Distance-based Clustering and Analysis of BERT's Attention. - Yue Guan 003; Jingwen Leng; Chao Li 009; Quan Chen 002; Minyi Guo (COLING, 2020)

Accelerating sparse DNN models without hardware-support via tile-wise sparsity. - Cong Guo 003; Bo Yang Hsueh; Jingwen Leng; Yuxian Qiu; Yue Guan 003; Zehuan Wang; Xiaoying Jia 001; Xipeng Li; Minyi Guo; Yuhao Zhu 001 (SC, 2020)

Co-Design of Binary Processing in Memory ReRAM Array and DNN Model Optimization Algorithm. - Yue Guan 003; Takashi Ohsawa (IEICE Trans. Electron., 2020)

Block-Skim: Efficient Question Answering for Transformer. - Yue Guan 003; Zhengyi Li 002; Zhouhan Lin; Yuhao Zhu 001; Jingwen Leng; Minyi Guo (AAAI, 2022)

Transkimmer: Transformer Learns to Layer-wise Skim. - Yue Guan 003; Zhengyi Li 002; Jingwen Leng; Zhouhan Lin; Minyi Guo (ACL (1), 2022)

PAME: precision-aware multi-exit DNN serving for reducing latencies of batched inferences. - Shulai Zhang; Weihao Cui; Quan Chen 002; Zhengnian Zhang; Yue Guan 003; Jingwen Leng; Chao Li 009; Minyi Guo (ICS, 2022)

Amanda: Unified Instrumentation Framework for Deep Neural Networks. - Yue Guan 003; Yuxian Qiu; Jingwen Leng; Fan Yang 024; Shuo Yu 006; Yunxin Liu 001; Yu Feng 007; Yuhao Zhu 001; Lidong Zhou; Yun Liang 001; Chen Zhang 001; Chao Li 009; et al. (ASPLOS (1), 2024)

Fractal: Joint Multi-Level Sparse Pattern Tuning of Accuracy and Performance for DNN Pruning. - Yue Guan 003; Changming Yu; Yangjie Zhou 001; Jingwen Leng; Chao Li 009; Minyi Guo (ASPLOS (3), 2024)

Accelerating Sparse DNNs Based on Tiled GEMM. - Cong Guo 003; Fengchen Xue; Jingwen Leng; Yuxian Qiu; Yue Guan 003; Weihao Cui; Quan Chen 002; Minyi Guo (IEEE Trans. Computers, 2024)

VQ-LLM: High-performance Code Generation for Vector Quantization Augmented LLM Inference. - Zihan Liu 002; Xinhao Luo; Junxian Guo; Wentao Ni; Yangjie Zhou 001; Yue Guan 003; Cong Guo 003; Weihao Cui; Yu Feng 007; Minyi Guo; Yuhao Zhu 001; Minjia Zhang; et al. (HPCA, 2025)

M-ANT: Efficient Low-bit Group Quantization for LLMs via Mathematically Adaptive Numerical Type. - Weiming Hu 005; Haoyan Zhang; Cong Guo 003; Yu Feng 007; Renyang Guan; Zhendong Hua; Zihan Liu 002; Yue Guan 003; Minyi Guo; Jingwen Leng (HPCA, 2025)

WLB-LLM: Workload-Balanced 4D Parallelism for Large Language Model Training. - Zheng Wang 075; Anna Cai; Xinfeng Xie; Zaifeng Pan; Yue Guan 003; Weiwei Chu; Jie Wang 022; Shikai Li; Jianyu Huang; Chris Cai; Yuchen Hao; Yufei Ding 001 (OSDI, 2025)

KPerfIR: Towards a Open and Compiler-centric Ecosystem for GPU Kernel Performance Tooling on Modern AI Workloads. - Yue Guan 003; Yuanwei Fang; Keren Zhou 001; Corbin Robeck; Manman Ren; Zhongkai Yu; Yufei Ding 001; Adnan Aziz (OSDI, 2025)

Mercury: Unlocking Multi-GPU Operator Optimization for LLMs via Remote Memory Scheduling. - Yue Guan 003; Xinwei Qiang; Zaifeng Pan; Daniels Johnson; Yuanwei Fang; Keren Zhou 001; Yuke Wang; Wanlu Li; Yufei Ding 001; Adnan Aziz (SOSP, 2025)

An Efficient Private GPT Never Autoregressively Decodes. - Zhengyi Li 002; Yue Guan 003; Kang Yang 002; Yu Feng 007; Ning Liu; Yu Yu 001; Jingwen Leng; Minyi Guo (CoRR, 2025)

KPerfIR: Towards an Open and Compiler-centric Ecosystem for GPU Kernel Performance Tooling on Modern AI Workloads. - Yue Guan 003; Yuanwei Fang; Keren Zhou 001; Corbin Robeck; Manman Ren; Zhongkai Yu; Yufei Ding 001; Adnan Aziz (CoRR, 2025)

KVFlow: Efficient Prefix Caching for Accelerating LLM-Based Multi-Agent Workflows. - Zaifeng Pan; Ajjkumar Patel; Zhengding Hu; Yipeng Shen; Yue Guan 003; Wan-Lu Li; Lianhui Qin; Yida Wang; Yufei Ding 001 (CoRR, 2025)

Orders in Chaos: Enhancing Large-Scale MoE LLM Serving with Data Movement Forecasting. - Zhongkai Yu; Yue Guan 003; Zihao Yu; Chenyang Zhou; Shuyi Pei; Yangwook Kang; Yufei Ding 001; Po-An Tsai (CoRR, 2025)