transformers safetensors mistral text-generation autotrain_compatible endpoints_compatible text-generation-inference 4-bit bitsandbytes region:us
This is a Mistral-7b finetune meant exclusively for, and only for, roleplaying. Everything is open sourced.

It is not recommended you use this model for anything besides roleplay, as it has not seen any assistant data during finetuning.

This model was trained on top of https://huggingface.co/G-reen/TheatreLM-m7b-v1.0-chat with https://huggingface.co/datasets/G-reen/TheatreLM-v1.0-DPO, which includes a description of how the dataset was generated. No other datasets were used, no merging was done.

### Prompt format: Vicuna with REPLY instead of ASSISTANT
```
[SYSTEM]
USER: [Message]
REPLY: [AI RESPONSE] </s>
USER: [Message 2]
REPLY: 
```

### Trained for 1 epoch using Unsloth on a Kaggle notebook with a lora rank of 16, alpha of 32, and learning rate of 0.000005. 

4 bit gguf quant: https://huggingface.co/G-reen/TheatreLM-m7b-v1.0-DPO-GGUF-Q4_K_M