
<!-- header start -->
<!-- 200823 -->
## Description

Quantified [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) into F16 and converted to LLaMa CPP (GGUF) format.

### About GGUF

GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.

<!-- prompt-template start -->
## Prompt template: Mistral

```
<s>[INST] {prompt} [/INST]
```

<!-- prompt-template end -->
{"license": "apache-2.0", "model_name": "Mistral 7B Instruct v0.2", "base_model": "mistralai/Mistral-7B-Instruct-v0.2", "model_creator": "Mistral AI", "model_type": "mistral", "pipeline_tag": "text-generation", "prompt_template": "<s>[INST]{prompt} [/INST]\n", "quantized_by": "Rocwo"}
gguf text-generation base_model:mistralai/Mistral-7B-Instruct-v0.2 license:apache-2.0 region:us