yhavinga commited on
Commit
77e6dfb
·
verified ·
1 Parent(s): 7800fb4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -1
README.md CHANGED
@@ -13,7 +13,6 @@ tags:
13
  This is the result of step 1 of the upscaling of [Boreas-7B](https://huggingface.co/yhavinga/Boreas-7B) with [mergekit](https://github.com/cg123/mergekit).
14
  It is trying to reproduce the upscaling described in the [SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling](https://arxiv.org/abs/2312.15166)
15
  paper.
16
- The original model upscaled is the finetuned
17
  This model is the result after step 1 from the figure below:
18
 
19
  ![SOLAR 10.7B Depth up scaling](img_2.png)
 
13
  This is the result of step 1 of the upscaling of [Boreas-7B](https://huggingface.co/yhavinga/Boreas-7B) with [mergekit](https://github.com/cg123/mergekit).
14
  It is trying to reproduce the upscaling described in the [SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling](https://arxiv.org/abs/2312.15166)
15
  paper.
 
16
  This model is the result after step 1 from the figure below:
17
 
18
  ![SOLAR 10.7B Depth up scaling](img_2.png)