Text Generation
PyTorch
causal-lm
rwkv
BlinkDL commited on
Commit
b8e3aa1
1 Parent(s): 3e133f4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -29,7 +29,9 @@ datasets:
29
 
30
  RWKV-4 trained on 100+ world languages (70% English, 15% multilang, 15% code).
31
 
32
- Some_Pile + Some_RedPajama + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
 
 
33
 
34
  How to use:
35
  * use https://github.com/josStorer/RWKV-Runner for GUI
 
29
 
30
  RWKV-4 trained on 100+ world languages (70% English, 15% multilang, 15% code).
31
 
32
+ World = Some_Pile + Some_RedPajama + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
33
+
34
+ XXXtuned = finetune of World on MC4, OSCAR, wiki, etc.
35
 
36
  How to use:
37
  * use https://github.com/josStorer/RWKV-Runner for GUI