Shani123
/

Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-GPTQ / model-00001-of-00036.safetensors

Commit History

Mixtral - branch gptq-4bit-32g-actorder_True

f5967fa

Ubuntu commited on Dec 19, 2023