transformers safetensors mistral text-generation license:cc-by-nc-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: cc-by-nc-4.0
---

# Noromaid-7B-0.4-DPO 4bpw EXL2

## Description
Exllama quant of [NeverSleep/Noromaid-7B-0.4-DPO](https://huggingface.co/NeverSleep/Noromaid-7B-0.4-DPO)

## Other quants:
EXL2: [8bpw](https://huggingface.co/Kooten/Noromaid-7B-0.4-DPO-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Noromaid-7B-0.4-DPO-6bpw-exl2), [4bpw](https://huggingface.co/Kooten/Noromaid-7B-0.4-DPO-4bpw-exl2)

## Prompt format: Chatml
```
<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>
```

## Contact
Kooten on discord