
this is a 4 bit DPO fine-tuned MoE model for [TomGrc/FusionNet_34Bx2_MoE_v0.1](https://huggingface.co/TomGrc/FusionNet_34Bx2_MoE_v0.1)


   ```
DPO Trainer
TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023. 
   ```
Metrics
![Metrics](4bit.vs.16.jpg)


{"license": "other", "tags": ["yi", "moe"], "license_name": "yi-license", "license_link": "https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE"}
transformers safetensors mixtral text-generation yi moe conversational license:other autotrain_compatible endpoints_compatible text-generation-inference 4-bit region:us