Update README.md
Browse files
README.md
CHANGED
|
@@ -8,7 +8,7 @@ tags:
|
|
| 8 |
- rwkv
|
| 9 |
license: apache-2.0
|
| 10 |
datasets:
|
| 11 |
-
-
|
| 12 |
|
| 13 |
---
|
| 14 |
|
|
@@ -48,3 +48,5 @@ Preview checkpoint: RWKV-4-Pile-1B5-20220814-4526.pth : Trained on the Pile for
|
|
| 48 |
* PIQA acc 71.44%
|
| 49 |
* SC2016 acc 68.25%
|
| 50 |
* Hellaswag acc_norm 51.60%
|
|
|
|
|
|
|
|
|
| 8 |
- rwkv
|
| 9 |
license: apache-2.0
|
| 10 |
datasets:
|
| 11 |
+
- the_pile
|
| 12 |
|
| 13 |
---
|
| 14 |
|
|
|
|
| 48 |
* PIQA acc 71.44%
|
| 49 |
* SC2016 acc 68.25%
|
| 50 |
* Hellaswag acc_norm 51.60%
|
| 51 |
+
|
| 52 |
+
## Warning: 4 / 4a / 4b models ARE NOT compatible!!! Use RWKV-4 unless you know what you are doing.
|