


 * [This is DPO improved version of cloudyu/Mixtral_11Bx2_MoE_19B](https://huggingface.co/cloudyu/Mixtral_11Bx2_MoE_19B)

 * [DPO Trainer](https://huggingface.co/docs/trl/main/en/dpo_trainer)

 * metrics not test!

 * 
{"license": "cc-by-nc-4.0"}
transformers safetensors mixtral text-generation conversational license:cc-by-nc-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us