smashmaster
/

RWKV-Piano-Experiments

Model card Files Files and versions Community

smashmaster commited on Mar 24

Commit

2f42cfc

•

1 Parent(s): b956d5d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -7,4 +7,4 @@ Experiments on training 0.4B RWKV models around midi notation in a manner simila
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6352287eef8786433ecdb736/zPg9n76e40lEl-HzF7TvF.png)
-* WIP v6 pretrain.


7
8	![image/png](https://cdn-uploads.huggingface.co/production/uploads/6352287eef8786433ecdb736/zPg9n76e40lEl-HzF7TvF.png)
9
10	+ * WIP v6 pretrain that also sucks. Loss was around 2.3 to 2.5 but I'm guessing it ended up at 2.5, kind of sad but this can be used as a base I guess?