Text Generation
PyTorch
causal-lm
rwkv
BlinkDL commited on
Commit
be0946a
1 Parent(s): 94639ab

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -29,6 +29,8 @@ datasets:
29
 
30
  RWKV-4 trained on 100+ world languages (70% English, 15% multilang, 15% code).
31
 
 
 
32
  How to use:
33
  * use latest rwkv pip package (0.7.4+)
34
  * use https://github.com/BlinkDL/ChatRWKV/blob/main/v2/benchmark_world.py to test it
 
29
 
30
  RWKV-4 trained on 100+ world languages (70% English, 15% multilang, 15% code).
31
 
32
+ Some_Pile + Some_RedPajama + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
33
+
34
  How to use:
35
  * use latest rwkv pip package (0.7.4+)
36
  * use https://github.com/BlinkDL/ChatRWKV/blob/main/v2/benchmark_world.py to test it