Update README.md
Browse files
README.md
CHANGED
|
@@ -45,7 +45,7 @@ RWKV-5 trained on 100+ world languages (70% English, 15% multilang, 15% code).
|
|
| 45 |
|
| 46 |
World = Some_Pile + Some_SlimPajama + Some_StarCoder + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
|
| 47 |
|
| 48 |
-
RWKV-5 training: set --my_testing "
|
| 49 |
|
| 50 |
World v1 = 0.59T tokens
|
| 51 |
|
|
|
|
| 45 |
|
| 46 |
World = Some_Pile + Some_SlimPajama + Some_StarCoder + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
|
| 47 |
|
| 48 |
+
RWKV-5 training: set --my_testing "r2r4" in latest RWKV-LM v4neo: https://github.com/BlinkDL/RWKV-LM
|
| 49 |
|
| 50 |
World v1 = 0.59T tokens
|
| 51 |
|