smashmaster
commited on
Commit
•
e3b9136
1
Parent(s):
41667bc
Update README.md (#1)
Browse files- Update README.md (42280124772a9792493b62e90ea7637e21e7fbf3)
- Update README.md (dbcf77465f55cec43b9238671e591b6c59074d5d)
README.md
CHANGED
@@ -2,3 +2,9 @@
|
|
2 |
license: gpl-3.0
|
3 |
---
|
4 |
Experiments on training 0.4B RWKV models around midi notation in a manner similar to [this already existing](https://huggingface.co/brianflakes/rwkv-midi-piano) midi model.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
license: gpl-3.0
|
3 |
---
|
4 |
Experiments on training 0.4B RWKV models around midi notation in a manner similar to [this already existing](https://huggingface.co/brianflakes/rwkv-midi-piano) midi model.
|
5 |
+
|
6 |
+
* RWKV v4neo based, 20 epoch: Loss of about 2.7ish
|
7 |
+
|
8 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6352287eef8786433ecdb736/zPg9n76e40lEl-HzF7TvF.png)
|
9 |
+
|
10 |
+
* WIP v6 pretrain.
|