FPTQ: Fine-grained Post-Training Quantization for Large Language Models. - Qingyuan Li 001; Yifan Zhang 001; Liang Li 003; Peng Yao; Bo Zhang 046; Xiangxiang Chu; Yerui Sun; Li Du; Yuchen Xie (CoRR, 2023)

A Speed Odyssey for Deployable Quantization of LLMs. - Qingyuan Li 001; Ran Meng; Yiduo Li; Bo Zhang 046; Liang Li 003; Yifan Lu; Xiangxiang Chu; Yerui Sun; Yuchen Xie (CoRR, 2023)

Integer Scale: A Free Lunch for Faster Fine-grained Quantization of LLMs. - Qingyuan Li 001; Ran Meng; Yiduo Li; Bo Zhang 046; Yifan Lu; Yerui Sun; Lin Ma 002; Yuchen Xie (CoRR, 2024)

Flash Communication: Reducing Tensor Parallelization Bottleneck for Fast Large Language Model Inference. - Qingyuan Li 001; Bo Zhang 046; Liang Ye; Yifan Zhang 001; Wei Wu; Yerui Sun; Lin Ma 002; Yuchen Xie (CoRR, 2024)