Attention quantization: HQQ 4-bit, groupsize 64, compress zero, compress scale with groupsize 256 \
Experts quantization: HQQ 3-bit, groupsize 64, compress zero, compress scale with groupsize 128
{"language": ["en", "fr", "it", "de", "es"], "license": "mit", "library_name": "transformers", "tags": ["mixtral", "text-generation-inference"]}
transformers safetensors mixtral text-generation text-generation-inference conversational en fr it de es license:mit autotrain_compatible endpoints_compatible region:us