
# Base Model - SOLAR-10.7B

This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral.

Please check specific details in the GitHub Repository.

GitHub Repository: https://github.com/gauss5930/iDUS

# 🏆 HuggingFace Open LLM Leaderboard

|Model|ARC|HellaSwag|MMLU|TruthfulQA|Winogrande|GSM8K|Average|
|---|---|---|---|---|---|---|---|
|Llama2_init_Mistral|60.07|83.3|64.09|42.15|78.37|37.91|60.98|
{"license": "apache-2.0"}
transformers safetensors llama text-generation license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us