
This is an experimental model to make an MoE of Nous Hermes 2 Yi 34B as Mixture of Expert.

The base model is Yi-34B.

All credits belong to NousResearch for fine tuned Yi model, 01-AI for Yi model, and Charles O. Goddard for the 'mergekit'.
{"license": "apache-2.0"}
transformers safetensors mixtral text-generation license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us