
```
>:3
```

Okay, normal description.

## Description

An another experiment with moe merge.

## Model used and sauce

All in [this confih file](https://huggingface.co/beberik/rawr/blob/main/config.yaml).

## Prompt template

Just use chatml. Or alpaca. Or any you like. Maybe it will work. 



I use [mergekit](https://github.com/cg123/mergekit) for all the manipulation told here.

{"license": "cc-by-nc-4.0", "tags": ["merge"]}
transformers safetensors mixtral text-generation merge conversational license:cc-by-nc-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us