transformers safetensors mistral text-generation roleplay en license:cc-by-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: cc-by-4.0
language:
- en
library_name: transformers
pipeline_tag: text-generation
tags:
- roleplay
---

# LemonadeRP-4.5.3 5bpw
Exllama quant of [KatyTheCutie/LemonadeRP-4.5.3](https://huggingface.co/KatyTheCutie/LemonadeRP-4.5.3)
> 7B roleplay focused model, creativity and less cliché is the focus of this merge.

## Other quants:
EXL2: [8bpw](https://huggingface.co/Kooten/LemonadeRP-4.5.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/LemonadeRP-4.5.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/LemonadeRP-4.5.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/LemonadeRP-4.5.3-4bpw-exl2)


## Prompt format: Chatml
Based on the models going in to this I would assume Chatml is the appropriate format.
```
<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>
```

## Contact
Kooten on discord

[ko-fi.com/kooten](https://ko-fi.com/kooten) if you would like to support me
