NeurIPS.cc/2024/Conference
QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs
Saleh Ashkboos Amirkeivan Mohtashami Maximilian L. Croci Bo Li Pashmina Cameron Martin Jaggi Dan Alistarh Torsten Hoefler James Hensman