BlinkDL commited on
Commit
1551178
1 Parent(s): 3e859ce

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -3
README.md CHANGED
@@ -18,9 +18,7 @@ datasets:
18
 
19
  RWKV-4 3B is a L32-D2560 causal language model trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
20
 
21
- ** Note: It's a BF16 model, and it may overflow if you are using FP16 (probably fixable by rescaling the weights). **
22
-
23
- At this moment you have to use my Github code (https://github.com/BlinkDL/RWKV-LM) to run it.
24
 
25
  New checkpoint: RWKV-4-Pile-3B-20221110-ctx4096.pth : Fine-tuned to ctx_len = 4096
26
  * LAMBADA ppl 5.25, acc 63.96%
 
18
 
19
  RWKV-4 3B is a L32-D2560 causal language model trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
20
 
21
+ Use https://github.com/BlinkDL/ChatRWKV to run it.
 
 
22
 
23
  New checkpoint: RWKV-4-Pile-3B-20221110-ctx4096.pth : Fine-tuned to ctx_len = 4096
24
  * LAMBADA ppl 5.25, acc 63.96%