Update README.md
Browse files
README.md
CHANGED
@@ -48,7 +48,7 @@ Original model README below.
|
|
48 |
|
49 |
Oh boy, here we go. Low-rank (`r=16, alpha=32`) LoRA on top of [WizardLM-2-8x22B](https://huggingface.co/alpindale/WizardLM-2-8x22B), trained on 2 epochs of (cleaned & deduped) c2-logs. As far as I can tell, this is an upgrade from `WizardLM-2-8x22B` for RP purposes.
|
50 |
|
51 |
-
Alongside this ready-to-use release
|
52 |
|
53 |
## Why A LoRA?
|
54 |
|
|
|
48 |
|
49 |
Oh boy, here we go. Low-rank (`r=16, alpha=32`) LoRA on top of [WizardLM-2-8x22B](https://huggingface.co/alpindale/WizardLM-2-8x22B), trained on 2 epochs of (cleaned & deduped) c2-logs. As far as I can tell, this is an upgrade from `WizardLM-2-8x22B` for RP purposes.
|
50 |
|
51 |
+
Alongside this ready-to-use release I'm also releasing the LoRA itself as well as the earlier `epoch1`-checkpoint of the LoRA.
|
52 |
|
53 |
## Why A LoRA?
|
54 |
|