BlinkDL commited on
Commit
67020bd
1 Parent(s): 128167b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -4
README.md CHANGED
@@ -2,10 +2,18 @@
2
  license: apache-2.0
3
  ---
4
 
5
- Use rwkv pip package 0.8.7+ for RWKV-5 inference.
6
 
7
- Interesting fact: RWKV-5 is great at benchmarks (excellent zeroshot performance), but generates quite worse music (just like GPT models) despite lower loss.
8
 
9
- This fits my theory: Dot-product is good for uncreative work, while Channelwise is good for creative work.
10
 
11
- Therefore use https://huggingface.co/BlinkDL/rwkv-4-music for better music. Or let's see if someone can find a better sampling method to improve RWKV-5 results.
 
 
 
 
 
 
 
 
 
2
  license: apache-2.0
3
  ---
4
 
5
+ Use https://github.com/BlinkDL/ChatRWKV/tree/main/music to run rwkv-music models.
6
 
7
+ https://huggingface.co/BlinkDL/rwkv-4-music
8
 
9
+ https://huggingface.co/BlinkDL/rwkv-5-music
10
 
11
+ MIDI model (RWKV-4 sounds better):
12
+
13
+ Training data: https://huggingface.co/datasets/breadlicker45/bread-midi-dataset
14
+
15
+ ABC model (RWKV-5 sounds better):
16
+
17
+ Training data: ```load_dataset("sander-wood/massive_abcnotation_dataset")["train"]```
18
+
19
+ https://huggingface.co/datasets/sander-wood/massive_abcnotation_dataset