Update README.md
Browse files
README.md
CHANGED
@@ -18,9 +18,7 @@ datasets:
|
|
18 |
|
19 |
RWKV-4 3B is a L32-D2560 causal language model trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
|
20 |
|
21 |
-
|
22 |
-
|
23 |
-
At this moment you have to use my Github code (https://github.com/BlinkDL/RWKV-LM) to run it.
|
24 |
|
25 |
New checkpoint: RWKV-4-Pile-3B-20221110-ctx4096.pth : Fine-tuned to ctx_len = 4096
|
26 |
* LAMBADA ppl 5.25, acc 63.96%
|
|
|
18 |
|
19 |
RWKV-4 3B is a L32-D2560 causal language model trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
|
20 |
|
21 |
+
Use https://github.com/BlinkDL/ChatRWKV to run it.
|
|
|
|
|
22 |
|
23 |
New checkpoint: RWKV-4-Pile-3B-20221110-ctx4096.pth : Fine-tuned to ctx_len = 4096
|
24 |
* LAMBADA ppl 5.25, acc 63.96%
|