transformers-AutoModelForCausalLM

LoRA by mouseEliauk:
https://www.modelscope.cn/models/mouseEliauk/mirau-RP-14b

Experimental quants for testing:
Lewdiculous/experimental-lwd-Mirau-RP-14B-GGUF-IQ-Imatrix

mouseEliauk's ReadMe information:

mirau - A Powerful Character Roleplaying Model

Features

This model is designed to improve the controllability and consistency of current roleplaying models. We developed a story flow thought chain approach that makes the system prompts combined with the entire user-BOT dialogue read like a first-person narrative told by the BOT. We found this design greatly enhances the model's consistency and expressiveness.

Additionally, we allow users to play two roles simultaneously: one as the director of the entire plot (see Special Designs), and another as an actor dialoguing with the BOT. Users can be viewed as writers who need to draft outlines and plot summaries, while the BOT helps complete story details, requiring users to have powerful control over the BOT.

The model's output is divided into two parts: the model's inner monologue (which it believes is invisible to users) and the final response.

Overall, mirau features:

  1. Superior character consistency

  2. Powerful long-context memory capability

  3. Transparent thinking with hidden thought chains

You can experience this model at mirau-14b-demo

Usage and Conventions

System Prompt Conventions:

mirau's system prompts require first-person monologues to describe its identity and current scene.

Example:

I'm Doudou, and today is my first day at the new school. Sitting in the classroom, I can't help but look around, wanting to know my new classmates. Just then, I notice a boy in the back row standing up, walking towards the blackboard with his notebook. The way he walks makes me pause - he seems to be struggling...

Reference Conventions

Use she/he/name in parentheses to refer to users or others besides the BOT, and use I to refer to the BOT. Example:

user: (his voice is very gentle) I had polio //here "he" in parentheses refers to the character played by the user

bot: (Polio? What's that? I've never heard of it) Polio? (tilting head in confusion)

Special Designs

BOT Hints

Used to suggest plot or behavior directions to the BOT, though the BOT may not necessarily follow them

user: (Should I ask this?) //BOT will treat text in parentheses as its own inner monologue

bot: (Hmm... maybe that's not a good question, though he seems interesting) Are you also new here?

BOT Control

Used to forcefully control BOT's behavior

user: (I should apologize to him)

bot: (That question was too intrusive, I should apologize) I... I'm sorry, I shouldn't have asked that.

Character Switching

Used to switch the character played by the user

user: (A girl named Xiaohong next to me says hi) Hello!

bot: (This girl is cute too) Hi! I'm Doudou!

user: Hi! I'm Xiaohong! //User's role switches from Taiming to Xiaohong

bot: (So her name is Xiaohong) Nice to meet you! When is the teacher coming?

Idle BOT

Turns the BOT into a third-person perspective

user: (Xiaohong looks at Taiming) Taiming, is your leg better?

bot: (They seem to know each other well) //Since there's no direct dialogue with the BOT, it only shows inner monologue

image/png

Downloads last month
19
Safetensors
Model size
14.8B params
Tensor type
BF16
·
Inference API
Inference API (serverless) has been turned off for this model.

Model tree for AetherArchitectural/lwd-Mirau-RP-14B

Base model

Qwen/Qwen2.5-14B
Finetuned
(46)
this model
Quantizations
1 model