transformers pytorch llama text-generation not-for-all-audiences nsfw conversational license:cc-by-nc-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: cc-by-nc-4.0
tags:
- not-for-all-audiences
- nsfw
---
# MiquMaid-v2-70B-DPO 3bpw

## Description
Exllama quant of [NeverSleep/MiquMaid-v2-70B-DPO](https://huggingface.co/NeverSleep/MiquMaid-v2-70B-DPO)

## Other quants:
EXL2: [4bpw](https://huggingface.co/Kooten/MiquMaid-v2-70B-DPO-4bpw-exl2), [3.5bpw](https://huggingface.co/Kooten/MiquMaid-v2-70B-DPO-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/MiquMaid-v2-70B-DPO-3bpw-exl2), [2.4bpw](https://huggingface.co/Kooten/MiquMaid-v2-70B-DPO-2.4bpw-exl2), [2.3bpw](https://huggingface.co/Kooten/MiquMaid-v2-70B-DPO-2.3bpw-exl2)

2.4bpw is probably the most you can fit in a 24gb card

GGUF:
[2bit Imatrix GGUF](https://huggingface.co/Kooten/MiquMaid-v2-70B-DPO-Imatrix-GGUF)


## Prompt format: Alpaca

```
### Instruction:
{system prompt}

### Input:
{input}

### Response:
{reply}
```

## Contact
Kooten on discord

[ko-fi.com/kooten](https://ko-fi.com/kooten)