Update README.md
Browse files
README.md
CHANGED
|
@@ -5,6 +5,8 @@ This is a converted tinyllama model using the following script:
|
|
| 5 |
|
| 6 |
https://huggingface.co/Josephgflowers/Differential-Attention-Liquid-Metal-Tinyllama/blob/main/LM-Diff.py
|
| 7 |
|
|
|
|
|
|
|
| 8 |
|
| 9 |
1. Overall Flow in the Model
|
| 10 |
|
|
|
|
| 5 |
|
| 6 |
https://huggingface.co/Josephgflowers/Differential-Attention-Liquid-Metal-Tinyllama/blob/main/LM-Diff.py
|
| 7 |
|
| 8 |
+
Continued training for healing consisted of around 30000 steps full training on common datasets like open orca, ultrachat, and textbooks are all you need style datasets.
|
| 9 |
+
|
| 10 |
|
| 11 |
1. Overall Flow in the Model
|
| 12 |
|