transformers safetensors llama text-generation license:cc-by-nc-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: cc-by-nc-4.0
---

# FlatOrcamaid-13b-v0.2 8BPW
Exllama quants of [NeverSleep/FlatOrcamaid-13b-v0.2](https://huggingface.co/NeverSleep/FlatOrcamaid-13b-v0.2)

Other Quants

-MLX: [8bit](https://huggingface.co/Kooten/FlatOrcamaid-13b-v0.2-8bit-mlx), [4bit](https://huggingface.co/Kooten/FlatOrcamaid-13b-v0.2-4bit-mlx)

-Exllama: [8bpw](https://huggingface.co/Kooten/FlatOrcamaid-13b-v0.2-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/FlatOrcamaid-13b-v0.2-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/FlatOrcamaid-13b-v0.2-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/FlatOrcamaid-13b-v0.2-4bpw-exl2)

## Prompt template: Custom format, or Alpaca

### Custom format:
SillyTavern config files: [Context](https://files.catbox.moe/ifmhai.json), [Instruct](https://files.catbox.moe/ttw1l9.json).

### Alpaca:
```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

```

### Contact
Kooten on discord.
