Update README.md
Browse files
README.md
CHANGED
@@ -74,9 +74,9 @@ output_text = tokenizer.decode(output[0], skip_special_tokens=True)
|
|
74 |
|
75 |
### Overview
|
76 |
- We conducted a performance evaluation based on the tasks being evaluated on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).
|
77 |
-
We evaluated our model on four benchmark datasets, which include `ARC-Challenge`, `HellaSwag`, `MMLU`, and `TruthfulQA
|
78 |
We used the [lm-evaluation-harness repository](https://github.com/EleutherAI/lm-evaluation-harness), specifically commit [b281b0921b636bc36ad05c0b0b0763bd6dd43463](https://github.com/EleutherAI/lm-evaluation-harness/tree/b281b0921b636bc36ad05c0b0b0763bd6dd43463).
|
79 |
-
- We used [MT-bench](https://github.com/lm-sys/FastChat/tree/main/fastchat/llm_judge), a set of challenging multi-turn open-ended questions, to evaluate the models
|
80 |
|
81 |
### Main Results
|
82 |
| Model | H4(Avg) | ARC | HellaSwag | MMLU | TruthfulQA | | MT_Bench |
|
@@ -104,9 +104,9 @@ cd lm-evaluation-harness
|
|
104 |
## Ethical Issues
|
105 |
|
106 |
### Ethical Considerations
|
107 |
-
- There were no ethical issues involved, as we did not include the benchmark test set or the training set in the model's training process
|
108 |
|
109 |
## Contact Us
|
110 |
|
111 |
### Why Upstage LLM?
|
112 |
-
- [Upstage](https://en.upstage.ai)'s LLM research has yielded remarkable results. Our 70B model **outperforms all models around the world**, positioning itself as the leading performer. Recognizing the immense potential in implementing private LLM to actual businesses, we invite you to easily apply private LLM and fine-tune it with your own data. For a seamless and tailored solution, please do not hesitate to reach out to us. ► [click here to contact](https://www.upstage.ai/private-llm?utm_source=huggingface&utm_medium=link&utm_campaign=privatellm)
|
|
|
74 |
|
75 |
### Overview
|
76 |
- We conducted a performance evaluation based on the tasks being evaluated on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).
|
77 |
+
We evaluated our model on four benchmark datasets, which include `ARC-Challenge`, `HellaSwag`, `MMLU`, and `TruthfulQA`
|
78 |
We used the [lm-evaluation-harness repository](https://github.com/EleutherAI/lm-evaluation-harness), specifically commit [b281b0921b636bc36ad05c0b0b0763bd6dd43463](https://github.com/EleutherAI/lm-evaluation-harness/tree/b281b0921b636bc36ad05c0b0b0763bd6dd43463).
|
79 |
+
- We used [MT-bench](https://github.com/lm-sys/FastChat/tree/main/fastchat/llm_judge), a set of challenging multi-turn open-ended questions, to evaluate the models
|
80 |
|
81 |
### Main Results
|
82 |
| Model | H4(Avg) | ARC | HellaSwag | MMLU | TruthfulQA | | MT_Bench |
|
|
|
104 |
## Ethical Issues
|
105 |
|
106 |
### Ethical Considerations
|
107 |
+
- There were no ethical issues involved, as we did not include the benchmark test set or the training set in the model's training process
|
108 |
|
109 |
## Contact Us
|
110 |
|
111 |
### Why Upstage LLM?
|
112 |
+
- [Upstage](https://en.upstage.ai)'s LLM research has yielded remarkable results. Our 70B model **outperforms all models around the world**, positioning itself as the leading performer. Recognizing the immense potential in implementing private LLM to actual businesses, we invite you to easily apply private LLM and fine-tune it with your own data. For a seamless and tailored solution, please do not hesitate to reach out to us. ► [click here to contact](https://www.upstage.ai/private-llm?utm_source=huggingface&utm_medium=link&utm_campaign=privatellm)
|