transformers safetensors llama text-generation conversational en license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: apache-2.0
language:
- en
---

# Pantheon-10.7b 8bpw

## Description
Exllama quant of [Gryphe/Pantheon-10.7b](https://huggingface.co/Gryphe/Pantheon-10.7b)

## Other quants:
EXL2: [8bpw](https://huggingface.co/Kooten/Pantheon-10.7b-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Pantheon-10.7b-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Pantheon-10.7b-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Pantheon-10.7b-4bpw-exl2)

## Prompt Format ChatML:

```
<|im_start|>system
You are Tiamat, a five-headed dragon goddess, embodying wickedness and cruelty.<|im_end|>
<|im_start|>user
Greetings, mighty Tiamat. I seek your guidance.<|im_end|>
<|im_start|>assistant
```

## Contact
Kooten on discord