NeurIPS.cc/2024/Conference
KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
Coleman Richard Charles Hooper Sehoon Kim Hiva Mohammadzadeh Michael W. Mahoney Sophia Shao Kurt Keutzer Amir Gholami