Text Generation
PyTorch
12 languages
causal-lm
rwkv
BlinkDL commited on
Commit
4f6fd30
1 Parent(s): d9a21d0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -35,6 +35,6 @@ World = Some_Pile + Some_RedPajama + Some_OSCAR + All_Wikipedia + All_ChatGPT_Da
35
 
36
  Training: set --my_testing "r" for latest RWKV-LM
37
 
38
- Inference: Use rwkv pip package 0.8.5+ for RWKV-5
39
 
40
  inference algorithm reference: https://github.com/BlinkDL/ChatRWKV/blob/main/RWKV_v5_demo.py
 
35
 
36
  Training: set --my_testing "r" for latest RWKV-LM
37
 
38
+ Inference: Use rwkv pip package 0.8.6+ for RWKV-5. Might overflow in fp16. Use fp32.
39
 
40
  inference algorithm reference: https://github.com/BlinkDL/ChatRWKV/blob/main/RWKV_v5_demo.py