AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration. - Ji Lin 002; Jiaming Tang; Haotian Tang; Shang Yang; Xingyu Dang; Song Han 003 (CoRR, 2023)

AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration. - Ji Lin 002; Jiaming Tang; Haotian Tang; Shang Yang; Wei-Ming Chen; Wei-Chen Wang 002; Guangxuan Xiao; Xingyu Dang; Chuang Gan 001; Song Han 003 (MLSys, 2024)

RNNs are not Transformers (Yet): The Key Bottleneck on In-Context Retrieval. - Kaiyue Wen; Xingyu Dang; Kaifeng Lyu (ICLR, 2025)

Weight Ensembling Improves Reasoning in Language Models. - Xingyu Dang; Christina Baek; Kaiyue Wen; Zico Kolter; Aditi Raghunathan (CoRR, 2025)