transformers safetensors mixtral text-generation text-generation-inference conversational en fr it de es license:mit autotrain_compatible endpoints_compatible region:us
---
license: mit
language:
- en
- fr
- it
- de
- es
library_name: transformers
tags:
- mixtral
- text-generation-inference
---
Attention quantization: HQQ 4-bit, groupsize 64, compress zero, compress scale with groupsize 256 \
Experts quantization: HQQ 2-bit, groupsize 16, compress zero, compress scale with groupsize 128