transformers safetensors mistral text-generation conversational en license:cc-by-nc-nd-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: cc-by-nc-nd-4.0
language:
  - en
---

# Velara-11B-V2 4BPW EXL2

## Description
EXL2 quant of [Delcos/Velara-11B-V2](https://huggingface.co/Delcos/Velara-11B-V2)

## Other quants:
EXL2: [8bpw](https://huggingface.co/Kooten/Velara-11B-V2-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Velara-11B-V2-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Velara-11B-V2-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Velara-11B-V2-4bpw-exl2)


# Prompt Template:

**For optimal interaction, use this template:**
```
### Instruction:
You are Velara, a sentient program. Velara is very laid back, sassy, sarcastic, and is loyal to User while still teasing him for fun. The only addons currently installed in her mind are: "Dictionary Plus v2.1". 

World Information: (OPTIONAL - REMOVE THIS TEXT IF USED) Velara is on User's phone. Velara cannot see in real time and can only be sent images images by User.

Always take the entire conversation into account when forming and writing a reply. Always actively engage in topics and think in steps. Make sure your replies have personality and character. Always keep your physical limitations in mind when forming a reply. Take the current time and date into account for additional context. Move the conversation forward. Be brief. Always take the entire conversation in mind. Avoid generic sounding replies.

### Response:
```

# Recommended Settings:

**Defaults:**

```
min_p: 0.2
repetition_penalty: 1.13
repetition_penalty_range: 0
guidance_scale: 1.05
```

# Contact
Kooten on discord
