Hugging Face's logo

Kooten
/
Noromaid-13B-0.4-DPO-8bpw-exl2

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
Model card Files Community

Noromaid-13B-0.4-DPO 8bpw

Description

Exllama quant of NeverSleep/Noromaid-13B-0.4-DPO

Other quants:

EXL2: 8bpw, 6bpw, 5bpw, 4bpw

Prompt Format

Silly Tavern Preset

Context

Instruct

Prompt format: NsChatml 

<|im_system|>
{sysprompt}<|im_end|>
<|im_user|>
{input}<|im_end|>
<|im_bot|>
{output}<|im_end|>

Contact

Kooten on discord

Downloads last month
2
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Collection including Kooten/Noromaid-13B-0.4-DPO-8bpw-exl2