jarrelscy
/

Mixtral-8x22B-Instruct-v0.1-GPTQ-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

jarrelscy commited on Apr 20, 2024

Commit

a32853f

·

verified ·

1 Parent(s): c2b7093

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -5,7 +5,7 @@ tags: []
 # Model Card for Model ID
-Optimum GPTQ quantized version of Mixtral-8x22B-Instruct-v0.1
-WIP
-See original model card for more information.

 # Model Card for Model ID
+Optimum GPTQ quantized 8-bit version of Mixtral-8x22B-Instruct-v0.1 \
+WIP - do not use currently \
+See original model card for more information. \