Learn how to quantize models in the Quantization guide.

AqlmConfig
[[autodoc]] AqlmConfig
AwqConfig
[[autodoc]] AwqConfig
GPTQConfig
[[autodoc]] GPTQConfig
BitsAndBytesConfig
[[autodoc]] BitsAndBytesConfig
HfQuantizer
[[autodoc]] quantizers.base.HfQuantizer