# **Introduction**
Yi-32b-x2-v2.0 is an MoE model created with mergekit + custom prompts. The following base models are used:
```
Weyaxi/Bagel-Hermes-34B-Slerp
one-man-army/UNA-34Beagles-32K-bf16-v1
```

## Details
### Used Librarys
- mergekit
- transformers
  
## How to use

```python
# pip install transformers==4.35.2
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("sumo43/Yi-32b-x2-v2.0")
model = AutoModelForCausalLM.from_pretrained(
    "sumo43/Yi-32b-x2-v2.0"
)
```
{"language": ["en"], "license": "mit", "tags": ["merge"]}
transformers safetensors mixtral text-generation merge conversational en license:mit autotrain_compatible endpoints_compatible text-generation-inference region:us