# Zephyr-8x7b:Zephyr Models but Mixtral 8x7B

We present to you the Zephyr-8x7b, a Mixtral 8x7B MoE model that SFT-only training on a dataset of nearly four million conversation corpora.

It has demonstrated strong contextual understanding, reasoning, and human moral alignment without alignment techniques like DPO, and we invite you to participate in our exploration!
{"language": ["zh", "en"], "license": "mit", "tags": ["Mistral"], "datasets": ["vicgalle/alpaca-gpt4", "BelleGroup/train_1M_CN", "stingning/ultrachat", "HuggingFaceH4/no_robots", "Open-Orca/OpenOrca"], "pipeline_tag": "conversational"}
transformers safetensors mixtral text-generation Mistral conversational zh en dataset:vicgalle/alpaca-gpt4 dataset:BelleGroup/train_1M_CN dataset:stingning/ultrachat dataset:HuggingFaceH4/no_robots dataset:Open-Orca/OpenOrca doi:10.57967/hf/1522 license:mit autotrain_compatible endpoints_compatible text-generation-inference region:us