solidrust
/

LemonadeRP-4.5.3-AWQ

Text Generation

4-bit precision

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

KatyTheCutie/LemonadeRP-4.5.3 AWQ

Model creator: KatyTheCutie
Original model: LemonadeRP-4.5.3

Model Summary

8192 context length. - Reports of context up-to 32K working!

7B roleplay focused model, creativity and less cliché is the focus of this merge. SillyTavern settings:

Models used in merge:

NeverSleep/Noromaid-7B-0.4-DPO
cgato/Thespis-7b-v0.5-SFTTest-2Epoch
NurtureAI/neural-chat-7b-v3-1-16k
cgato/Thespis-CurtainCall-7b-v0.2.2
tavtav/eros-7b-test

Downloads last month: 6

Safetensors

Model size

1.2B params

Tensor type

I32

·

FP16

·

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for solidrust/LemonadeRP-4.5.3-AWQ

Base model

NeverSleep/Noromaid-7B-0.4-DPO

Finetuned

KatyTheCutie/LemonadeRP-4.5.3

Quantized

(4)

this model