
# Air-Striker-Mixtral-8x7B-ZLoss

Experimental model, trained using config and [Transformers/Axolotl](https://github.com/DocShotgun/axolotl) forks provided by [Doctor-Shotgun](https://huggingface.co/Doctor-Shotgun)

Model was fine-tuned from [Mixtral-8x7B-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) with airoboros-3.2 dataset, for 4 epochs, ChatML prompt format at 8K context length.


{"language": ["en"], "license": "apache-2.0", "library_name": "transformers", "tags": ["mixtral"], "datasets": ["jondurbin/airoboros-3.2"], "inference": false, "pipeline_tag": "text-generation"}
transformers safetensors mixtral text-generation en dataset:jondurbin/airoboros-3.2 license:apache-2.0 autotrain_compatible text-generation-inference 4-bit region:us