Commit
•
2f42cfc
1
Parent(s):
b956d5d
Update README.md
Browse files
README.md
CHANGED
@@ -7,4 +7,4 @@ Experiments on training 0.4B RWKV models around midi notation in a manner simila
|
|
7 |
|
8 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6352287eef8786433ecdb736/zPg9n76e40lEl-HzF7TvF.png)
|
9 |
|
10 |
-
* WIP v6 pretrain.
|
|
|
7 |
|
8 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6352287eef8786433ecdb736/zPg9n76e40lEl-HzF7TvF.png)
|
9 |
|
10 |
+
* WIP v6 pretrain that also sucks. Loss was around 2.3 to 2.5 but I'm guessing it ended up at 2.5, kind of sad but this can be used as a base I guess?
|