Update README.md
Browse files
README.md
CHANGED
|
@@ -35,7 +35,7 @@ How it works: https://twitter.com/BlinkDL_AI/status/1685230712247795713
|
|
| 35 |
|
| 36 |
RWKV-5 trained on 100+ world languages (70% English, 15% multilang, 15% code).
|
| 37 |
|
| 38 |
-
World = Some_Pile + Some_SlimPajama + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
|
| 39 |
|
| 40 |
RWKV-5 training: set --my_testing "r4" in latest RWKV-LM v4neo
|
| 41 |
|
|
|
|
| 35 |
|
| 36 |
RWKV-5 trained on 100+ world languages (70% English, 15% multilang, 15% code).
|
| 37 |
|
| 38 |
+
World = Some_Pile + Some_SlimPajama + Some_StarCoder + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
|
| 39 |
|
| 40 |
RWKV-5 training: set --my_testing "r4" in latest RWKV-LM v4neo
|
| 41 |
|