text
Check out AutoRound, SOTA LLM quantization algorithm across 2-4 bits without adding any inference overhead to any model
Check out AutoRound, SOTA LLM quantization algorithm across 2-4 bits without adding any inference overhead to any model
new_line
text
paper: 
paper: 
link
https://arxiv.org/abs/2309.05516
https://arxiv.org/abs/2309.05516
new_line
text
github: 
github: 
link
https://github.com/intel/auto-round
https://github.com/intel/auto-round
new_line
text
lowbits leaderboard: 
lowbits leaderboard: 
link
https://huggingface.co/spaces/Intel/low-bit-leaderboard
https://huggingface.co/spaces/Intel/low-bit-leaderboard
new_line
Check out AutoRound, SOTA LLM quantization algorithm across 2-4 bits without adding any inference overhead to any model
paper: https://arxiv.org/abs/2309.05516
github: https://github.com/intel/auto-round
lowbits leaderboard: https://huggingface.co/spaces/Intel/low-bit-leaderboard
