Commit
•
e3b9136
1
Parent(s):
41667bc
Update README.md (#1)
Browse files- Update README.md (42280124772a9792493b62e90ea7637e21e7fbf3)
- Update README.md (dbcf77465f55cec43b9238671e591b6c59074d5d)
README.md
CHANGED
|
@@ -2,3 +2,9 @@
|
|
| 2 |
license: gpl-3.0
|
| 3 |
---
|
| 4 |
Experiments on training 0.4B RWKV models around midi notation in a manner similar to [this already existing](https://huggingface.co/brianflakes/rwkv-midi-piano) midi model.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
license: gpl-3.0
|
| 3 |
---
|
| 4 |
Experiments on training 0.4B RWKV models around midi notation in a manner similar to [this already existing](https://huggingface.co/brianflakes/rwkv-midi-piano) midi model.
|
| 5 |
+
|
| 6 |
+
* RWKV v4neo based, 20 epoch: Loss of about 2.7ish
|
| 7 |
+
|
| 8 |
+
|
| 9 |
+
|
| 10 |
+
* WIP v6 pretrain.
|