Update README.md

README.md

@@ -24,9 +24,10 @@ ctx_len = 1024
 n_layer = 32
 n_embd = 4096
 
-(There are ctx_len 2048 and 4096 models too. Use them only when your ctxlen is long. Might be slightly weaker for short ctxlens.)
+RWKV-4-Pile-7B-20230109-ctx4096.pth
+* Likely better. Please test.
 
-Final checkpoint: RWKV-4-Pile-7B-20221115-8047.pth : Trained on the Pile for 332B tokens.
+RWKV-4-Pile-7B-20221115-8047.pth : Trained on the Pile for 332B tokens.
 * Pile loss 1.8415T
 * LAMBADA ppl 4.38, acc 67.18%
 * PIQA acc 76.06%