Update README.md
Browse files
README.md
CHANGED
|
@@ -36,3 +36,5 @@ Final checkpoint: RWKV-4-Pile-3B-20221008-8023.pth : Trained on the Pile for 331
|
|
| 36 |
* SC2016 acc 70.28%
|
| 37 |
* Hellaswag acc_norm 59.63%
|
| 38 |
* ctx_len = 1024 n_layer = 32 n_embd = 2560
|
|
|
|
|
|
|
|
|
| 36 |
* SC2016 acc 70.28%
|
| 37 |
* Hellaswag acc_norm 59.63%
|
| 38 |
* ctx_len = 1024 n_layer = 32 n_embd = 2560
|
| 39 |
+
|
| 40 |
+
## Warning: 4 / 4a / 4b models ARE NOT compatible!!! Use RWKV-4 unless you know what you are doing.
|