Update README.md
Browse files
README.md
CHANGED
@@ -13,7 +13,6 @@ tags:
|
|
13 |
This is the result of step 1 of the upscaling of [Boreas-7B](https://huggingface.co/yhavinga/Boreas-7B) with [mergekit](https://github.com/cg123/mergekit).
|
14 |
It is trying to reproduce the upscaling described in the [SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling](https://arxiv.org/abs/2312.15166)
|
15 |
paper.
|
16 |
-
The original model upscaled is the finetuned
|
17 |
This model is the result after step 1 from the figure below:
|
18 |
|
19 |
![SOLAR 10.7B Depth up scaling](img_2.png)
|
|
|
13 |
This is the result of step 1 of the upscaling of [Boreas-7B](https://huggingface.co/yhavinga/Boreas-7B) with [mergekit](https://github.com/cg123/mergekit).
|
14 |
It is trying to reproduce the upscaling described in the [SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling](https://arxiv.org/abs/2312.15166)
|
15 |
paper.
|
|
|
16 |
This model is the result after step 1 from the figure below:
|
17 |
|
18 |
![SOLAR 10.7B Depth up scaling](img_2.png)
|