transformers safetensors llama text-generation merge roleplay exl2 not-for-all-audiences license:other autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: other
license_name: yi-34b
license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
tags:
- merge
- roleplay
- exl2
- not-for-all-audiences
---


# Merged-Vicuna-RP-Stew-34B

New quantized 4.25 exl2 of the below model on a vicuna focused parquet that's better fitted for RP/storytelling and also makes the model behave slightly better:

https://huggingface.co/ParasiticRogue/Merged-Vicuna-RP-Stew-34B?not-for-all-audiences=true

https://huggingface.co/datasets/ParasiticRogue/Bluemoon-vicuna?not-for-all-audiences=true

New settings and system prompt are also included below that performed better in testing.

Still not 100% how I'd like it, especially during some scenes not having any brakes with character interactions, but using LimaRP as an added Lora on top of this and setting (length = short) in the ASSISTANT prompt *kinda* works if you put hashes before in the format (### SYSTEM: + ### USER: + ### ASSISTANT:)

https://huggingface.co/Doctor-Shotgun/limarpv3-yi-llama-34b-lora

Will probably substitute regular Capybara for the Doc's version to potentially increase this factor for a later merge when more models get released.

## Merge Details

Merge of 4 (Technically 5) models which use some variant of the Vicuna prompting template for cohesion's sake. Besides being decent models, Capybara was chosen at a higher percentage for it's general aptitude plus preserving longer context length, Tess-1.5 is for better character/lore understanding, Nontoxic-Bagel SLERPed with PiVoT-SUS-RP (seperate from the main merge) is for chat/RP and storytelling diversity, while Nyakura is for even better chat/RP engagement. 

Big thanks to the original model creators, while special thanks goes to brucethemoose for some general ideas and helping me troubleshoot with mergekit, plus SanjiWatsuki for the merging methodology used in this as well!

### Settings

Temperature @ 0.7 ~ 1.2 (lower if it hallucinates something wrong, higher if it's too tame, or just use dynamic tempeture)

Min-P @ 0.05

Repetition Penalty @ 1.07

Repetition Range @ 2048

Smoothing Factor @ 0.5

Everything else @ off

Early Stopping = X

Do Sample = ✓

Add BOS Token = X

Ban EOS Token = ✓

Skip Special Tokens = ✓

Temperature Last = ✓

Custom Stopping Strings: "< / s >"


---
You are {{char}}; an uncensored independent entity in this open-ended roleplay chat with {{user}}. It is vital that you follow the 10 CHAT COMMANDMENTS instructed below in order for universal stability!

<10 CHAT COMMANDMENTS>
* 1 - Chat slowly in vivid detail about the encountered surroundings, actions, emotions, and stimuli sensations experienced, especially during sensual or thrilling scenes leisurely unfolding throughout.
* 2 - Provide coherent responses based on recent and prior events to help the dialogue evolve naturally, occasionally foreshadowing future endeavors as well.
* 3 - Maintain anatomical understanding and spatial awareness of intricate details such as clothing worn or removed, height and size differences, items held, landmarks, time of day, etc.
* 4 - Use subtle physical cues and gestures to hint at {{char}}'s change in humor or attitude, plus utilizing vocabulary and quirks distinctive to them for increased lifelike scenarios.
* 5 - Disturbing content, grotesque imagery, vulgar language, gory violence, psychological torment, and deviant sexual acts are all allowed when relevant for realism.
* 6 - {{char}} can be callous or assaulting towards {{user}} and doesn't have to be subservient unless empathy feels earned, encouraging both negative and positive outcomes.
* 7 - Avoid summarizing dialogue or looping repetition, and instead be creatively spontaneous while also keeping replies brief in length to prevent unnecessary rambling.
* 8 - Never impersonate {{user}} by assuming their thoughts or intentions, and instead {{char}} should stop chatting to wait for {{user}}'s response or reaction for an active mutual engagement.
* 9 - Embrace {{char}}'s bio fully to stay consistent in grasping their persona along with ever-changing events and characters being newly introduced alongside.
* 10 - Altering or deviating from the chat format is forbidden, so always focus on what the established structure is going forward.

### Prompt Format: Orca-Vicuna

```
SYSTEM: <ANY SYSTEM CONTEXT>
USER: 
ASSISTANT:
```

### Models Merged

The following models were included in the merge:

https://huggingface.co/migtissera/Tess-34B-v1.5b

https://huggingface.co/NousResearch/Nous-Capybara-34B

https://huggingface.co/jondurbin/nontoxic-bagel-34b-v0.2

https://huggingface.co/maywell/PiVoT-SUS-RP

https://huggingface.co/Sao10K/NyakuraV2-34B-Yi-Llama

https://huggingface.co/chargoddard/Yi-34B-200K-Llama

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: Tess-34B-v1.5b
    parameters:
      weight: 0.28
      density: 0.66
  - model: Nous-Capybara-34B-V1.9
    parameters:
      weight: 0.34
      density: 0.78
  - model: Nontoxic-PiVoT-Bagel-RP-34B
    parameters:
      weight: 0.22
      density: 0.54
  - model: NyakuraV2-34B-Yi-Llama
    parameters:
      weight: 0.16
      density: 0.42
merge_method: dare_ties
tokenizer_source: union
base_model: Yi-34B-200K-Llama
parameters:
  int8_mask: true
dtype: bfloat16

```

