Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs. - Wenhua Cheng; Weiwei Zhang; Haihao Shen; Yiyang Cai; Xin He 018; Kaokao Lv (CoRR, 2023)

Efficient Post-training Quantization with FP8 Formats. - Haihao Shen; Naveen Mellempudi; Xin He 018; Qun Gao; Chang Wang; Mengni Wang (MLSys, 2024)