
# Description
GGUF version of [Locutusque/TinyMistral-248M-v2-Instruct](https://huggingface.co/Locutusque/TinyMistral-248M-v2-Instruct).

# Recommended inference parameters
```
do_sample: true
temperature: 0.1
top_p: 0.14
top_k: 12
repetition_penalty: 1.1
```

# Recommended prompt template
```
<|im_start|>user\n{user message}<|im_end|>\n<|im_start|>assistant\n{assistant message}<|endoftext|>
```
{"language": ["en"], "license": "apache-2.0", "datasets": ["HuggingFaceH4/ultrachat_200k"], "base_model": "Locutusque/TinyMistral-248M-v2-Instruct"}
gguf en dataset:HuggingFaceH4/ultrachat_200k base_model:Locutusque/TinyMistral-248M-v2-Instruct license:apache-2.0 region:us