
Converted version of [Mixtral Instruct](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) to 4-bit using bitsandbytes. For more information about the model, refer to the model's page.

### Prompt Pattern
Here is a reminder of the command pattern to interact with the model if the add_special_tokens option is disabled (otherwise, do not include the BOS symbol and space at the beginning of the sequence):
```verbatim
<s> [INST] {user_prompt_1} [/INST] model_answer_1</s> [INST] {user_prompt_2} [/INST] model_answer_2</s>
```
{"language": ["en", "fr", "de", "es", "it"], "license": "apache-2.0", "tags": ["moe"]}
transformers safetensors mixtral text-generation moe conversational en fr de es it license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference 4-bit region:us