walid-iguider commited on
Commit
42dabe6
·
verified ·
1 Parent(s): 1b781b3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -1
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  language:
3
- - en
4
  license: apache-2.0
5
  tags:
6
  - text-generation-inference
@@ -17,6 +17,18 @@ base_model: unsloth/llama-3-8b-Instruct-bnb-4bit
17
  - **License:** apache-2.0
18
  - **Finetuned from model :** unsloth/llama-3-8b-Instruct-bnb-4bit
19
 
 
 
 
 
 
 
 
 
 
 
20
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
21
 
22
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
1
  ---
2
  language:
3
+ - it
4
  license: apache-2.0
5
  tags:
6
  - text-generation-inference
 
17
  - **License:** apache-2.0
18
  - **Finetuned from model :** unsloth/llama-3-8b-Instruct-bnb-4bit
19
 
20
+ ## Evaluation
21
+
22
+ For a detailed comparison of model performance, check out the [Leaderboard for Italian Language Models](https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard).
23
+
24
+ Here's a breakdown of the performance metrics:
25
+ | Metric | hellaswag_it acc_norm | arc_it acc_norm | m_mmlu_it 5-shot acc | Average |
26
+ |:----------------------------|:----------------------|:----------------|:---------------------|:--------|
27
+ | **Accuracy Normalized** | 0.5912 | 0.4474 | 0.5365 | 0.5250 |
28
+
29
+
30
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
31
 
32
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
33
+
34
+