
# Model Description
This is for testing, it is a MoE 4x13B, made for code and instruct.

# Models Used:
- MysticFusion-13B
- vicuna-13b-v1.5-16k
- lmsys/vicuna-13b-v1.5
- Gryphe/MythoMax-L2-13b


# Evaluation:
Model | Average ⬆️ | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
--- | --- | --- | --- | --- | --- | --- | --- |
Walmart-the-bag/openchat-3.5-Infinity 📑 | 67.95 | 62.63 | 84.05 | 64.65 | 51.99 | 80.11 | 64.29 |
Walmart-the-bag/Misted-7B 📑 | 66.94 | 63.65 | 84.14 | 63.94 | 52 | 78.3 | 59.59 |
**Walmart-the-bag/Influxient-4x13B 📑** | **60.57** | **61.26** | **83.42** | **57.25** | **54.1** | **74.35** | **33.06** |
Walmart-the-bag/Yi-6B-Infinity-Chat 📑 | 59.83 | 56.57 | 77.66 | 64.05 | 50.75 | 73.95 | 36.01 |
Walmart-the-bag/MysticFusion-13B 📑 | 59.31 | 61.35 | 84.43 | 57.29 | 51.98 | 76.01 | 24.79 |
{"license": "cc-by-sa-3.0"}
transformers safetensors mixtral text-generation license:cc-by-sa-3.0 autotrain_compatible endpoints_compatible text-generation-inference region:us