Red Alarm for Pre-trained Models: Universal Vulnerabilities by Neuron-Level Backdoor Attacks. - Zhengyan Zhang; Guangxuan Xiao; Yongwei Li; Tian Lv; Fanchao Qi; Zhiyuan Liu 001; Yasheng Wang; Xin Jiang 002; Maosong Sun 001 (CoRR, 2021)

Sparse and Local Networks for Hypergraph Reasoning. - Guangxuan Xiao; Leslie Pack Kaelbling; Jiajun Wu 001; Jiayuan Mao (LoG, 2022)

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models. - Guangxuan Xiao; Ji Lin 002; Mickaël Seznec; Julien Demouth; Song Han 003 (CoRR, 2022)

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models. - Guangxuan Xiao; Ji Lin 002; Mickaël Seznec; Hao Wu; Julien Demouth; Song Han 003 (ICML, 2023)

ReFresh: Reducing Memory Access from Exploiting Stable Historical Embeddings for Graph Neural Network Training. - Kezhao Huang; Haitian Jiang; Minjie Wang; Guangxuan Xiao; David Wipf; Xiang Song 003; Quan Gan; Zengfeng Huang; Jidong Zhai; Zheng Zhang 001 (CoRR, 2023)

Offsite-Tuning: Transfer Learning without Full Model. - Guangxuan Xiao; Ji Lin 002; Song Han 003 (CoRR, 2023)

Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-level Backdoor Attacks. - Zhengyan Zhang; Guangxuan Xiao; Yongwei Li; Tian Lv; Fanchao Qi; Zhiyuan Liu 001; Yasheng Wang; Xin Jiang 002; Maosong Sun 001 (Mach. Intell. Res., 2023)

Efficient Streaming Language Models with Attention Sinks. - Guangxuan Xiao; Yuandong Tian; Beidi Chen; Song Han 003; Mike Lewis (ICLR, 2024)

QUEST: Query-Aware Sparsity for Efficient Long-Context LLM Inference. - Jiaming Tang; Yilong Zhao; Kan Zhu; Guangxuan Xiao; Baris Kasikci; Song Han 003 (ICML, 2024)

AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration. - Ji Lin 002; Jiaming Tang; Haotian Tang; Shang Yang; Wei-Ming Chen; Wei-Chen Wang 002; Guangxuan Xiao; Xingyu Dang; Chuang Gan 001; Song Han 003 (MLSys, 2024)

BitDelta: Your Fine-Tune May Only Be Worth One Bit. - James Liu; Guangxuan Xiao; Kai Li; Jason D. Lee; Song Han 003; Tri Dao; Tianle Cai (NeurIPS, 2024)

InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory. - Chaojun Xiao; Pengle Zhang; Xu Han 007; Guangxuan Xiao; Yankai Lin; Zhengyan Zhang; Zhiyuan Liu 001; Maosong Sun 001 (NeurIPS, 2024)

InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory. - Chaojun Xiao; Pengle Zhang; Xu Han 007; Guangxuan Xiao; Yankai Lin; Zhengyan Zhang; Zhiyuan Liu 001; Song Han 003; Maosong Sun 001 (CoRR, 2024)

QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving. - Yujun Lin 001; Haotian Tang; Shang Yang; Zhekai Zhang; Guangxuan Xiao; Chuang Gan 001; Song Han 003 (CoRR, 2024)

FreshGNN: Reducing Memory Access via Stable Historical Embeddings for Graph Neural Network Training. - Kezhao Huang; Haitian Jiang; Minjie Wang; Guangxuan Xiao; David Wipf; Xiang Song 003; Quan Gan; Zengfeng Huang; Jidong Zhai; Zheng Zhang 001 (Proc. VLDB Endow., 2024)

Correction to: Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-level Backdoor Attacks. - Zhengyan Zhang; Guangxuan Xiao; Yongwei Li; Tian Lv; Fanchao Qi; Zhiyuan Liu 001; Yasheng Wang; Xin Jiang 002; Maosong Sun 001 (Mach. Intell. Res., 2024)

AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration. - Ji Lin 002; Jiaming Tang; Haotian Tang; Shang Yang; Guangxuan Xiao; Song Han 003 (GetMobile Mob. Comput. Commun., 2024)

Retrieval Head Mechanistically Explains Long-Context Factuality. - Wenhao Wu; Yizhong Wang; Guangxuan Xiao; Hao Peng 018; Yao Fu (ICLR, 2025)

DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads. - Guangxuan Xiao; Jiaming Tang; Jingwei Zuo; Junxian Guo; Shang Yang; Haotian Tang; Yao Fu; Song Han 003 (ICLR, 2025)

LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention. - Shang Yang; Junxian Guo; Haotian Tang; Qinghao Hu 004; Guangxuan Xiao; Jiaming Tang; Yujun Lin 001; Zhijian Liu; Yao Lu 006; Song Han 003 (CoRR, 2025)

XAttention: Block Sparse Attention with Antidiagonal Scoring. - Ruyi Xu; Guangxuan Xiao; Haofeng Huang; Junxian Guo; Song Han (CoRR, 2025)

FastComposer: Tuning-Free Multi-subject Image Generation with Localized Attention. - Guangxuan Xiao; Tianwei Yin; William T. Freeman; Frédo Durand; Song Han 003 (Int. J. Comput. Vis., 2025)