Update README.md
Browse files
README.md
CHANGED
|
@@ -35,13 +35,15 @@ GUI: https://github.com/josStorer/RWKV-Runner (see Releases)
|
|
| 35 |
|
| 36 |
How it works: https://twitter.com/BlinkDL_AI/status/1685230712247795713
|
| 37 |
|
|
|
|
|
|
|
| 38 |
## Model Description
|
| 39 |
|
| 40 |
RWKV-5 trained on 100+ world languages (70% English, 15% multilang, 15% code).
|
| 41 |
|
| 42 |
World = Some_Pile + Some_SlimPajama + Some_StarCoder + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
|
| 43 |
|
| 44 |
-
RWKV-5 training: set --my_testing "r4" in latest RWKV-LM v4neo
|
| 45 |
|
| 46 |
World v1 = 0.59T tokens
|
| 47 |
|
|
|
|
| 35 |
|
| 36 |
How it works: https://twitter.com/BlinkDL_AI/status/1685230712247795713
|
| 37 |
|
| 38 |
+
https://www.rwkv.com/
|
| 39 |
+
|
| 40 |
## Model Description
|
| 41 |
|
| 42 |
RWKV-5 trained on 100+ world languages (70% English, 15% multilang, 15% code).
|
| 43 |
|
| 44 |
World = Some_Pile + Some_SlimPajama + Some_StarCoder + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
|
| 45 |
|
| 46 |
+
RWKV-5 training: set --my_testing "r4" in latest RWKV-LM v4neo: https://github.com/BlinkDL/RWKV-LM
|
| 47 |
|
| 48 |
World v1 = 0.59T tokens
|
| 49 |
|