brianflakes
commited on
Commit
•
acf0a0b
1
Parent(s):
f1e2244
Update README.md
Browse files
README.md
CHANGED
@@ -7,10 +7,9 @@ tags:
|
|
7 |
step650 model was trained in 48hr on an RTX3090,
|
8 |
step1100 model initially experimentally trained to add tiny attenion (RWKV-4b), but then finetuned again to remove it. Final finetuning was done with ctx 4096.
|
9 |
|
10 |
-
See training history: https://wandb.ai/brianflakes/rwkv-midi
|
11 |
|
12 |
-
Trained using GiantMIDI-Piano dataset, augmented 30x.
|
13 |
|
14 |
To run, use the rwkv pip package: https://pypi.org/project/rwkv/
|
15 |
|
16 |
-
To convert to MIDI, use https://github.com/briansemrau/MIDI-LLM-tokenizer
|
|
|
7 |
step650 model was trained in 48hr on an RTX3090,
|
8 |
step1100 model initially experimentally trained to add tiny attenion (RWKV-4b), but then finetuned again to remove it. Final finetuning was done with ctx 4096.
|
9 |
|
|
|
10 |
|
11 |
+
Trained using GiantMIDI-Piano dataset, augmented 30x. See training history: https://wandb.ai/brianflakes/rwkv-midi
|
12 |
|
13 |
To run, use the rwkv pip package: https://pypi.org/project/rwkv/
|
14 |
|
15 |
+
To convert outputs to MIDI, use https://github.com/briansemrau/MIDI-LLM-tokenizer
|