This is a 5-bit exl2 quant of https://huggingface.co/ericpolewski/AIRIC-The-Mistral

8-bit available at https://huggingface.co/ericpolewski/AIRIC-The-Mistral-8.0bpw-exl2
{}
transformers llama text-generation autotrain_compatible endpoints_compatible text-generation-inference region:us