transformers safetensors mixtral text-generation not-for-all-audiences nsfw license:cc-by-nc-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: cc-by-nc-4.0
tags:
- not-for-all-audiences
- nsfw
---

# OpenDolphinMaid-4x7b 6bpw
Exllama quant of [Undi95/OpenDolphinMaid-4x7b](https://huggingface.co/Undi95/OpenDolphinMaid-4x7b)

## Other quants:
EXL2: [6bpw](https://huggingface.co/Kooten/OpenDolphinMaid-4x7b-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/OpenDolphinMaid-4x7b-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/OpenDolphinMaid-4x7b-4bpw-exl2)

## Prompt template: Chatml

```
<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```
## Contact
Kooten on discord