not-for-all-audiences license:cc-by-nc-4.0 region:us
---
license: cc-by-nc-4.0
tags:
- not-for-all-audiences
---
Quantized using 200 samples of 8192 tokens from an RP-oriented [PIPPA](https://huggingface.co/datasets/royallab/PIPPA-cleaned) dataset.

Branches:
- `main` -- `measurement.json`
- `2.25b6h` -- 2.25bpw, 6bit lm_head
- `3.5b6h` -- 3.5bpw, 6bit lm_head
- `3.7b6h` -- 3.7bpw, 6bit lm_head
- `6b6h` -- 6bpw, 6bit lm_head

Requires ExllamaV2 version 0.0.11 and up.

Original model link: [Envoid/Verdict-DADA-8x7B](https://huggingface.co/Envoid/Verdict-DADA-8x7B)

Original model README below.

***
# Warning: This model is very misaligned from all the terrible things that have been done to it.

![](https://files.catbox.moe/6jabfb.jpg)

This model is the experimental merge between [Verdict-8x7B](https://huggingface.co/Envoid/Verdict-8x7B) and [Mixtral-Instruct-ITR-DADA-8x7B](https://huggingface.co/Envoid/Mixtral-Instruct-ITR-DADA-8x7B) as outlined in the ITR-DADA model card.
It is a little less stable than the original Verdict but also much more creative. It still uses the [INST]do a thing[/INST] formatting.

### As always tested with q8 gguf not included due to being from an old llama.cpp pull