
# SOLAR-10.7B

### Model Details
- Base Model: [yanolja/KoSOLAR-10.7B-v0.1](https://huggingface.co/yanolja/KoSOLAR-10.7B-v0.1)

### Datasets
- sampling and translate [Open-Orca/SlimOrca](https://huggingface.co/datasets/Open-Orca/SlimOrca)
- sampling and translate [Anthropic/hh-rlhf](https://huggingface.co/datasets/Anthropic/hh-rlhf)

### Benchmark
- SOTA model as of Jan 1, 2024 (https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).

| Model | Average |Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
| --- | --- | --- | --- | --- | --- | --- |
| **hyeogi/SOLAR-10.7B-dpo-v0.1 (Ours)**	| **56.29** | 47.95 | 59.49 | 51.29 | 60.97 | 61.75 |
| [jeonsworld/CarbonVillain-10.7B-v1](https://huggingface.co/jeonsworld/CarbonVillain-10.7B-v1) | 55.33 | 49.91 | 60.65 | 55.04 | 48.22 | 62.81 |
| [Megastudy/M-SOLAR-10.7B-v1.1-beta](https://huggingface.co/Megastudy/M-SOLAR-10.7B-v1.1-beta) | 55.25 | 51.71 | 60.86 | 54.24 | 47.12 | 62.34 |

![image/png](https://cdn-uploads.huggingface.co/production/uploads/656e98a02c331f3e079e427f/CO_MGNX8kvzTTC9OSOwWK.png)


{"language": ["ko"], "tags": ["SOLAR-10.7B"], "pipeline_tag": "text-generation"}
transformers safetensors llama text-generation SOLAR-10.7B ko autotrain_compatible endpoints_compatible text-generation-inference region:us