Towards End-to-end 4-Bit Inference on Generative Large Language Models. - Saleh Ashkboos; Ilia Markov; Elias Frantar; Tingxuan Zhong; Xincheng Wang; Jie Ren; Torsten Hoefler; Dan Alistarh (CoRR, 2023)

QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models. - Saleh Ashkboos; Ilia Markov; Elias Frantar; Tingxuan Zhong; Xincheng Wang; Jie Ren; Torsten Hoefler; Dan Alistarh (EMNLP, 2024)