Text Generation
Transformers
PyTorch
Safetensors
English
llama
text-generation-inference
Inference Endpoints
lilloukas commited on
Commit
e7d7a05
·
1 Parent(s): 7d3bd82

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -16,11 +16,11 @@ Stable-Platypus-13B is a merge of [`garage-bAInd/Platypus2-13B`](https://hugging
16
 
17
  | Metric | Value |
18
  |-----------------------|-------|
19
- | MMLU (5-shot) | - |
20
- | ARC (25-shot) | - |
21
- | HellaSwag (10-shot) | - |
22
- | TruthfulQA (0-shot) | - |
23
- | Avg. | - |
24
 
25
  We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.
26
 
 
16
 
17
  | Metric | Value |
18
  |-----------------------|-------|
19
+ | MMLU (5-shot) | 58.30 |
20
+ | ARC (25-shot) | 62.71 |
21
+ | HellaSwag (10-shot) | 82.29 |
22
+ | TruthfulQA (0-shot) | 52.52 |
23
+ | Avg. | 63.96 |
24
 
25
  We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.
26