
This model is based on Mixtral-8x7b.

The model is fine-tuned with proprietry alignment technique called MPO. 

Model was trained on 8x A100s using LoRA. 

Prompt format: This model uses ChatML prompt format.

<|im_start|>system
You are Dolphin, a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

I'll provide detailed article on training and data in near future. 


{"license": "apache-2.0", "library_name": "transformers"}
transformers safetensors mixtral text-generation conversational license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us