kyujinpy commited on
Commit
1c8c5ef
·
1 Parent(s): 87a4aee

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -27,7 +27,8 @@ license: cc-by-nc-4.0
27
 
28
  **Model Architecture**
29
 
30
- Llama-2-Ko is an auto-regressive language model that uses an optimized transformer architecture based on Llama-2.
 
31
 
32
  **Vocab Expansion**
33
 
@@ -64,6 +65,18 @@ TBD
64
 
65
  TBD
66
 
 
 
 
 
 
 
 
 
 
 
 
 
67
  ### BoolQ (F1)
68
 
69
  TBD
 
27
 
28
  **Model Architecture**
29
 
30
+ KOrca-Platypus2 is transformer architecture based on OpenOrca-Platyplus2.
31
+ Platyplus is a model based on llama-2 and tuned with LoRA, and they used a high-quality [OpenOrca dataset](https://huggingface.co/datasets/Open-Orca/OpenOrca) to suggest appropriate fine-tuning and merging methods, leading to high performance.
32
 
33
  **Vocab Expansion**
34
 
 
65
 
66
  TBD
67
 
68
+ | Model | 0-shot | 5-shot | 10-shot | 50-shot |
69
+ | --- | --- | --- | --- | --- |
70
+ | [Polyglot-ko-1.3b](https://huggingface.co/EleutherAI/polyglot-ko-1.3b) | 0.5247 | 0.5260 | 0.5278 | 0.5427 |
71
+ | [Polyglot-ko-3.8b](https://huggingface.co/EleutherAI/polyglot-ko-3.8b) | 0.5707 | 0.5830 | 0.5670 | 0.5787 |
72
+ | [Polyglot-ko-5.8b](https://huggingface.co/EleutherAI/polyglot-ko-5.8b) | 0.5976 | 0.5998 | 0.5979 | 0.6208 |
73
+ | [Polyglot-ko-12.8b](https://huggingface.co/EleutherAI/polyglot-ko-12.8b) | 0.5954 | 0.6306 | 0.6098 | 0.6118 |
74
+ | [Llama-2](https://huggingface.co/meta-llama/Llama-2-7b-hf) | 0.415390 | 0.431382 | 0.421342 | 0.442003 |
75
+ | [Llama-2-Ko-7b 20B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.451757 | 0.466751 | 0.472607 | 0.482776 |
76
+ | [Llama-2-Ko-7b 40B](https://huggingface.co/beomi/llama-2-ko-7b) | 0.456246 | 0.465665 | 0.469810 | 0.477374 |
77
+ | [OpenOrca-Platyplus2-13B](https://huggingface.co/Open-Orca/OpenOrca-Platypus2-13B) | NaN | NaN | NaN | NaN |
78
+ | KOpenOrca-Platyplus2-13B (ours) | NaN | NaN | NaN | NaN |
79
+
80
  ### BoolQ (F1)
81
 
82
  TBD