
# Model Description

This is fine-tuned model based on EmbeddedLLM/Mistral-7B-Merge-14-v0.3 for 9984 steps. 

The dataset used are:

* dophin
* dolphin-coder
* Magicoder-OSS-Instruct-75K
* openhermes
* Synthia-v1.3

## Chat Template

Prompt format: This model uses ChatML prompt format.
```
<|im_start|>system
You are Dolphin, a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```

# Training

The model is scheduled to be fine-tuned for 3 epochs on 4 A100s using axolotl.

# Shout-Out to OSS

Thank you to the Open Source AI community for bringing together marvelous code frameworks and datasets.
{"language": ["en"], "license": "apache-2.0", "tags": ["merge", "fine-tuned"], "datasets": ["cognitivecomputations/dolphin", "cognitivecomputations/dolphin-coder", "ise-uiuc/Magicoder-OSS-Instruct-75K", "teknium/openhermes", "migtissera/Synthia-v1.3"], "base_model": ["mistralai/Mistral-7B-Instruct-v0.2", "ehartford/dolphin-2.2.1-mistral-7b", "SciPhi/SciPhi-Mistral-7B-32k", "ehartford/samantha-1.2-mistral-7b", "Arc53/docsgpt-7b-mistral", "HuggingFaceH4/zephyr-7b-beta", "meta-math/MetaMath-Mistral-7B", "Open-Orca/Mistral-7B-OpenOrca", "openchat/openchat-3.5-1210", "beowolx/MistralHermes-CodePro-7B-v1", "TIGER-Lab/MAmmoTH-7B-Mistral", "teknium/OpenHermes-2.5-Mistral-7B", "Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp", "mlabonne/NeuralHermes-2.5-Mistral-7B"]}
transformers pytorch safetensors mistral text-generation merge fine-tuned en dataset:cognitivecomputations/dolphin dataset:cognitivecomputations/dolphin-coder dataset:ise-uiuc/Magicoder-OSS-Instruct-75K dataset:teknium/openhermes dataset:migtissera/Synthia-v1.3 base_model:mistralai/Mistral-7B-Instruct-v0.2 base_model:ehartford/dolphin-2.2.1-mistral-7b base_model:SciPhi/SciPhi-Mistral-7B-32k base_model:ehartford/samantha-1.2-mistral-7b base_model:Arc53/docsgpt-7b-mistral base_model:HuggingFaceH4/zephyr-7b-beta base_model:meta-math/MetaMath-Mistral-7B base_model:Open-Orca/Mistral-7B-OpenOrca base_model:openchat/openchat-3.5-1210 base_model:beowolx/MistralHermes-CodePro-7B-v1 base_model:TIGER-Lab/MAmmoTH-7B-Mistral base_model:teknium/OpenHermes-2.5-Mistral-7B base_model:Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp base_model:mlabonne/NeuralHermes-2.5-Mistral-7B license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us