
# DraftReasoner-2x7B-MoE-v0.1

Experimental 2-expert MoE merge using mlabonne/Marcoro14-7B-slerp as base.

* [Marcoro14-7B-slerp](https://huggingface.co/mlabonne/Marcoro14-7B-slerp ) as base.
* [OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) as model 0.
* [WizardMath-7B-V1.1](https://huggingface.co/WizardLM/WizardMath-7B-V1.1) as model 1.

![](https://i.imgur.com/cDQS6rq.jpg)

## Notes

Please evaluate before use in any application pipeline. Activation for Math part of the model would be `'math'`, `'reason'`, `'solve'`, `'count'`.






{"license": "unknown", "tags": ["merge", "mergekit", "WizardLM/WizardMath-7B-V1.1", "teknium/OpenHermes-2.5-Mistral-7B", "mlabonne/Marcoro14-7B-slerp"]}
transformers safetensors mixtral text-generation merge mergekit WizardLM/WizardMath-7B-V1.1 teknium/OpenHermes-2.5-Mistral-7B mlabonne/Marcoro14-7B-slerp license:unknown autotrain_compatible endpoints_compatible text-generation-inference region:us