emnlp-main.197
QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
Ashkboos, Saleh Markov, Ilia Frantar, Elias Zhong, Tingxuan Wang, Xincheng Ren, Jie Hoefler, Torsten Alistarh, Dan