Update README.md

README.md

@@ -26,16 +26,9 @@ ctx_len = 1024
 n_layer = 32
 n_embd = 2560
 
-Preview checkpoint: RWKV-4-Pile-3B-20220921-3047.pth : Trained on the Pile for 125B tokens.
-* Pile loss 2.0026
-* LAMBADA ppl 5.72, acc 61.36%
-* PIQA acc 73.39%
-* SC2016 acc 68.84%
-* Hellaswag acc_norm 56.57%
-
-Preview checkpoint: RWKV-4-Pile-3B-20220915-1207.pth : Trained on the Pile for 50B tokens.
-* Pile loss 2.0902
-* LAMBADA ppl 7.01, acc 57.11%
-* PIQA acc 72.52%
-* SC2016 acc 68.36%
-* Hellaswag acc_norm 52.17%
+Preview checkpoint: RWKV-4-Pile-3B-20220923-3822.pth : Trained on the Pile for 157B tokens.
+* Pile loss 1.9857
+* LAMBADA ppl 5.61, acc 61.87%
+* PIQA acc 73.78%
+* SC2016 acc 69.80%
+* Hellaswag acc_norm 57.46%