# Felladrin/TinyMistral-248M-Alpaca-GGUF

Quantized GGUF model files for [TinyMistral-248M-Alpaca](https://huggingface.co/Felladrin/TinyMistral-248M-Alpaca) from [Felladrin](https://huggingface.co/Felladrin)


| Name | Quant method | Size |
| ---- | ---- | ---- |
| [tinymistral-248m-alpaca.q2_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q2_k.gguf) | q2_k | 115.26 MB  |
| [tinymistral-248m-alpaca.q3_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q3_k_m.gguf) | q3_k_m | 130.08 MB  |
| [tinymistral-248m-alpaca.q4_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q4_k_m.gguf) | q4_k_m | 155.67 MB  |
| [tinymistral-248m-alpaca.q5_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q5_k_m.gguf) | q5_k_m | 179.23 MB  |
| [tinymistral-248m-alpaca.q6_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q6_k.gguf) | q6_k | 204.26 MB  |
| [tinymistral-248m-alpaca.q8_0.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q8_0.gguf) | q8_0 | 264.32 MB  |



## Original Model Card:
# Locutusque's TinyMistral-248M Trained trained on the Alpaca dataset using AutoTrain

- Base model: [Locutusque/TinyMistral-248M](https://huggingface.co/Locutusque/TinyMistral-248M)
- Dataset: [tatsu-lab/alpaca](https://huggingface.co/datasets/tatsu-lab/alpaca)
- Trained for 3 epochs.

## Prompt format

The training used these two following formats.

### Prompt format #1

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
<instruction>

### Response:
```

### Prompt format #2

```
Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

### Instruction:
<instruction>

### Input:
<input>

### Response:
```
{"license": "apache-2.0", "tags": ["autotrain", "text-generation", "gguf", "ggml", "quantized", "q2_k", "q3_k_m", "q4_k_m", "q5_k_m", "q6_k", "q8_0"], "datasets": ["tatsu-lab/alpaca"], "model_name": "TinyMistral-248M-Alpaca", "base_model": "Felladrin/TinyMistral-248M-Alpaca", "inference": false, "model_creator": "Felladrin", "pipeline_tag": "text-generation", "quantized_by": "afrideva", "widget": [{"text": "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\nTell me all you know about the Earth.\n\n### Response:"}]}
gguf autotrain text-generation ggml quantized q2_k q3_k_m q4_k_m q5_k_m q6_k q8_0 dataset:tatsu-lab/alpaca base_model:Felladrin/TinyMistral-248M-Alpaca license:apache-2.0 region:us