Hugging Face's logo

smashmaster
/
RWKV-Piano-Experiments

Model card Files Community
1
smashmaster commited on
Commit
dbcf774
•
1 Parent(s): 4228012

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -3,6 +3,8 @@ license: gpl-3.0
3
  ---
4
  Experiments on training 0.4B RWKV models around midi notation in a manner similar to [this already existing](https://huggingface.co/brianflakes/rwkv-midi-piano) midi model.
5
 
6
- * v4 20 epoch: Loss of about 2.7ish
7
 
8
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6352287eef8786433ecdb736/zPg9n76e40lEl-HzF7TvF.png)
 
 
 
3
  ---
4
  Experiments on training 0.4B RWKV models around midi notation in a manner similar to [this already existing](https://huggingface.co/brianflakes/rwkv-midi-piano) midi model.
5
 
6
+ * RWKV v4neo based, 20 epoch: Loss of about 2.7ish
7
 
8
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6352287eef8786433ecdb736/zPg9n76e40lEl-HzF7TvF.png)
9
+
10
+ * WIP v6 pretrain.