rAIfle commited on
Commit
767fed8
·
verified ·
1 Parent(s): 73e1cc9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -48,7 +48,7 @@ Original model README below.
48
 
49
  Oh boy, here we go. Low-rank (`r=16, alpha=32`) LoRA on top of [WizardLM-2-8x22B](https://huggingface.co/alpindale/WizardLM-2-8x22B), trained on 2 epochs of (cleaned & deduped) c2-logs. As far as I can tell, this is an upgrade from `WizardLM-2-8x22B` for RP purposes.
50
 
51
- Alongside this ready-to-use release there is also two alternatives released that are "mergebait", `rAIfle/sorcLM-epoch1-bf16` and `rAIfle/sorcLM-epoch2-bf16`. These are very experimental and likely not fit for use, but could be interesting for merging.
52
 
53
  ## Why A LoRA?
54
 
 
48
 
49
  Oh boy, here we go. Low-rank (`r=16, alpha=32`) LoRA on top of [WizardLM-2-8x22B](https://huggingface.co/alpindale/WizardLM-2-8x22B), trained on 2 epochs of (cleaned & deduped) c2-logs. As far as I can tell, this is an upgrade from `WizardLM-2-8x22B` for RP purposes.
50
 
51
+ Alongside this ready-to-use release I'm also releasing the LoRA itself as well as the earlier `epoch1`-checkpoint of the LoRA.
52
 
53
  ## Why A LoRA?
54