transformers llama text-generation license:other autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: other
license_name: other
license_link: LICENSE
---

6BPW exl2 quant of MiquMaid 70B.

Original model card:

## MiquMaid

---

# Disclaimer:
## This model is HIGHLY EXPERIMENTAL, do not expect everything to work.

This model uses the Alpaca **prompting format**

---

Quick train to see if miqu finetuned results in good models

## Credits:
- Undi
- IkariDev

<!-- description start -->
## Description

<!-- [Recommended settings - contributed by localfultonextractor](https://files.catbox.moe/ue0tja.json) -->

This repo contains FP16 files of MiquMaid-v1-70B.

[FP16 - by IkariDev and Undi](https://huggingface.co/NeverSleep/MiquMaid-v1-70B)

<!-- [GGUF - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GGUF)-->

<!-- [GPTQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GPTQ)-->

<!-- [exl2[8bpw-8h] - by AzureBlack](https://huggingface.co/AzureBlack/Echidna-13b-v0.3-8bpw-8h-exl2)-->

<!-- [AWQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-AWQ)-->

<!-- [fp16 - by IkariDev+Undi95](https://huggingface.co/IkariDev/Athena-v4)-->

[GGUF - by IkariDev and Undi](https://huggingface.co/NeverSleep/MiquMaid-v1-70B-GGUF)
<!-- [OLD(GGUF - by IkariDev+Undi95)](https://huggingface.co/IkariDev/Athena-v4-GGUF)-->

## Ratings:

Note: We have permission of all users to upload their ratings, we DONT screenshot random reviews without asking if we can put them here!

No ratings yet!

If you want your rating to be here, send us a message over on DC and we'll put up a screenshot of it here. DC name is "ikaridev" and "undi".

<!-- description end -->
<!-- prompt-template start -->
### Custom format:
```
### Instruction:
{system prompt}

### Input:
{input}

### Response:
{reply}
```

## Others

Undi: If you want to support me, you can [here](https://ko-fi.com/undiai).

IkariDev: Visit my [retro/neocities style website](https://ikaridevgit.github.io/) please kek