Update README.md

README.md

@@ -20,27 +20,21 @@ tags:
 license: apache-2.0
 datasets:
 - EleutherAI/pile
-- togethercomputer/RedPajama-Data-1T
+- cerebras/SlimPajama-627B
 ---
 
 # RWKV-5 World (Training in Progress)
 
-RWKV-5 Details: https://twitter.com/BlinkDL_AI/status/1685230712247795713
+Use rwkv pip package 0.8.14+ for RWKV-5 inference.
 
-Use rwkv pip package 0.8.7+ for RWKV-5 inference.
+GUI: https://github.com/josStorer/RWKV-Runner (see Releases)
+
+How it works: https://twitter.com/BlinkDL_AI/status/1685230712247795713
 
 ## Model Description
 
 RWKV-5 trained on 100+ world languages (70% English, 15% multilang, 15% code).
 
-World = Some_Pile + Some_RedPajama + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
-
-RWKV-5 training: set --my_testing "r" ("r2" is better) in latest RWKV-LM
-
-RWKV-5 inference implementation reference: https://github.com/BlinkDL/ChatRWKV/blob/main/RWKV_v5_demo.py
-
-0.1B world:
-
-RWKV-5 37% trained = LAMBADA ppl 18.1 acc 42.93%
+World = Some_Pile + Some_SlimPajama + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
 
-RWKV-4 100% trained = LAMBADA ppl 25.5 acc 36.29%
+RWKV-5 training: set --my_testing "2r4" in latest RWKV-LM