Update README.md
Browse files
README.md
CHANGED
@@ -25,14 +25,13 @@ margin. Our work reveals that LLMs can be an excellent compressor for music, but
|
|
25 |
|
26 |
<!-- <audio controls src="https://cdn-uploads.huggingface.co/production/uploads/5fd6f670053c8345eddc1b68/8NSONUjIF7KGUCfwzPCd9.mpga"></audio> -->
|
27 |
|
28 |
-
##
|
29 |
|
30 |
**Our model produces symbolic music(ABC notation) well in the following prompts.** Here are some musical tasks.
|
31 |
|
32 |
### Function: Text2music
|
33 |
|
34 |
```
|
35 |
-
Prompt:
|
36 |
Using ABC notation, recreate the given text as a musical score.
|
37 |
Meter C
|
38 |
Notes The parts are commonly interchanged.
|
@@ -40,173 +39,45 @@ Transcription 1997 by John Chambers
|
|
40 |
Key D
|
41 |
Note Length 1/8
|
42 |
Rhythm reel
|
43 |
-
|
44 |
-
Response:
|
45 |
-
X:1
|
46 |
-
L:1/8
|
47 |
-
M:2/2
|
48 |
-
K:D
|
49 |
-
"A7" FE |"D" D2 FA dAFD |"A7" CDEF G2 FE |"D" D2 FA dcdf |"E7" edcB"A7" AGFE | |"D" D2 FA dAFD |
|
50 |
-
"A7" CDEF G2 FG |"D" AdcB"A7" AGFE |"D" D2 F2 D2 :: de |"D" fefg fedc |"Em" B^ABc B2 cd |
|
51 |
-
"E7" e^def e=dcB |"A" A2 ce aABc | |"D" dcde fdAF |"G" GFGA BdcB |"D" AdcB"A7" Agec |
|
52 |
-
"D" d2 f2 d2 :|
|
53 |
```
|
54 |
```
|
55 |
-
Prompt:
|
56 |
Develop a tune influenced by Bach's compositions.
|
57 |
-
|
58 |
-
Response:
|
59 |
-
X:1
|
60 |
-
X:1
|
61 |
-
T:Music21 Fragment
|
62 |
-
T:Music21 Fragment
|
63 |
-
T:Music21
|
64 |
-
C:Music21
|
65 |
-
%%score 1 2 3 4
|
66 |
-
L:1/8
|
67 |
-
M:4/4
|
68 |
-
K:C
|
69 |
-
V:1 treble nm="Piano" snm="Pno"
|
70 |
-
%%MIDI program 0
|
71 |
-
%%MIDI control 7 100
|
72 |
-
%%MIDI control 10 64
|
73 |
-
L:1/4
|
74 |
-
V:2 treble nm="Piano" snm="Pno"
|
75 |
-
%%MIDI channel 3
|
76 |
-
%%MIDI program 0
|
77 |
-
%%MIDI control 7 100
|
78 |
-
%%MIDI control 10 64
|
79 |
-
V:3 bass nm="Piano" snm="Pno"
|
80 |
-
%%MIDI channel 4
|
81 |
-
%%MIDI program 0
|
82 |
-
%%MIDI control 7 100
|
83 |
-
%%MIDI control 10 64
|
84 |
-
V:4 bass nm="Piano" snm="Pno"
|
85 |
-
%%MIDI channel 5
|
86 |
-
%%MIDI program 0
|
87 |
-
%%MIDI control 7 100
|
88 |
-
%%MIDI control 10 64
|
89 |
-
V:1
|
90 |
-
z3 c | B A G F | E D !fermata!E c | d e d c | !fermata!B2 z c | B A G F | E D !fermata!E c | %7
|
91 |
-
d e d c | !fermata!B2 z e | f e d c | B A !fermata!B B | c d e d | !fermata!c2 z e | d c B A | %14
|
92 |
-
G A B c | d e d c | !fermata!B2 z e | d c B A | G A B c | d e d c | !fermata!c2 z B | A G F E | %22
|
93 |
-
D C !fermata!D c | B c d e | d c B A | !fermata!G2 z c | B A G F | E D !fermata!E c | d e d c | %29
|
94 |
-
!fermata!B2 z e | d c B A | G A B c | d e d c | !fermata!c2 z e | d c B A | G A B c | d e d c | %36
|
95 |
-
!fermata!c2 z B | A G F E | D C !fermata!D c | B c d e | d c B A | !fermata!G2 z2 |] %42
|
96 |
-
V:2
|
97 |
-
z6 CD | EF ED C2 CD | EF ED !fermata!C2 CD | EF GF ED C2 | !fermata!C6 CD | EF ED C2 CD | %6
|
98 |
-
EF ED !fermata!C2 CD | EF GF ED C2 | !fermata!C6 CD | EF GA GF ED | C2 DE !fermata!F2 DC | %11
|
99 |
-
B,C DB, C2 CD | !fermata!E6 CD | EF GA GF ED | C2 DE !fermata!F2 DC | B,C DB, C2 CD | %16
|
100 |
-
!fermata!E6 CD | EF GA GF ED | C2 DE !fermata!F2 DC | B,C DB, C2 CD | !fermata!E6 B,C | %21
|
101 |
-
DE ^FE D=C B,A, | G,^F, G,2 !fermata!G,2 =F,2 | G,2 A,B, CD EF | !fermata!G6 B,C | DE ^FE D=C B,A, | %26
|
102 |
-
G,^F, G,2 !fermata!G,2 =F,2 | G,2 A,B, CD EF | !fermata!G6 B,C | DE ^FE D=C B,A, | %30
|
103 |
-
G,^F, G,2 !fermata!G,2 =F,2 | G,2 A,B, CD EF | !fermata!G6 B,C | DE ^FE D=C B,A, | %34
|
104 |
-
G,^F, G,2 !fermata!G,2 =F,2 | G,2 A,B, CD EF | !fermata!G6 z2 |] %37
|
105 |
-
V:3
|
106 |
-
z6 G,2 | A,2 G,2 G,2 G,2 | G,2 G,2 !fermata!G,2 G,2 | G,2 A,2 B,2 C2 | !fermata!C6 G,2 | %6
|
107 |
-
A,2 G,2 G,2 G,2 | G,2 G,2 !fermata!G,2 G,2 | G,2 A,2 B,2 C2 | !fermata!C6 G,2 | G,2 A,2 B,2 C2 | %11
|
108 |
-
C2 B,2 !fermata!C2 B,2 | C2 D2 E2 D2 | !fermata!C6 G,2 | A,2 G,2 G,2 G,2 | G,2 G,2 !fermata!G,2 G,2 | %16
|
109 |
-
G,2 A,2 B,2 C2 | !fermata!C6 G,2 | G,2 A,2 B,2 C2 | C2 B,2 !fermata!C2 B,2 | C2 D2 E2 D2 | %21
|
110 |
-
!fermata!C6 B,2 | A,2 G,2 G,2 G,2 | G,2 G,2 !fermata!G,2 G,2 | G,2 A,2 B,2 C2 | !fermata!C6 B,2 | %26
|
111 |
-
A,2 G,2 G,2 G,2 | G,2 G,2 !fermata!G,2 G,2 | G,2 A,2 B,2 C2 | !fermata!C6 B,2 | A,2 G,2 G,2 G,2 | %31
|
112 |
-
G,2 G,2 !fermata!G,2 G,2 | G,2 A,2 B,2 C2 | !fermata!C6 z2 |] %34
|
113 |
-
V:4
|
114 |
-
z6"C" C,2 |"Am" A,,2"Em" E,2"C" C,2"C" C,2 |"Am" A,,2"Em" E,2"C" !fermata!C,2"C" C,2 | %3
|
115 |
-
"G" G,,2"Am" A,,2"G" B,,2"C" C,2 |"C" !fermata!C,6"C" C,2 |"Am" A,,2"Em" E,2"C" C,2"C" C,2 | %6
|
116 |
-
"Am" A,,2"Em" E,2"C" !fermata!C,2"C" C,2 |"G" G,,2"Am" A,,2"G" B,,2"C" C,2 |"C" !fermata!C,6"C" C,2 | %9
|
117 |
-
"G" G,,2"Am" A,,2"G" B,,2"C" C,2 |"C" C,2"G" G,,2"C" !fermata!C,2"C" C,2 | %11
|
118 |
-
"C" C,2"G" G,,2"Am" A,,2"G" B,,2 |"C" !fermata!C,6"C" C,2 |"G" G,,2"Am" A,,2"G" B,,2"C" C,2 | %14
|
119 |
-
"C" C,2"G" G,,2"C" !fermata!C,2"C" C,2 |"G" G,,2"Am" A,,2"G" B,,2"C" C,2 |"C" !fermata!C,6"C" C,2 | %17
|
120 |
-
"G" G,,2"Am" A,,2"G" B,,2"C" C,2 |"C" C,2"G" G,,2"C" !fermata!C,2"C" C,2 | %19
|
121 |
-
"G" G,,2"Am" A,,2"G" B,,2"C" C,2 |"C" !fermata!C,6"E" E,2 |"Am" A,,2"Em" E,2"C" C,2"C" C,2 | %
|
122 |
```
|
123 |
|
124 |
### Function: Melody Harmonization
|
125 |
|
126 |
```
|
127 |
-
Prompt:
|
128 |
Construct smooth-flowing chord progressions for the supplied music.
|
129 |
|
130 |
|: BA | G2 g2"^(C)" edeg | B2 BA"^(D7)" BcBA | G2 g2 edeg | dBAG A2 BA |
|
131 |
G2 g2"^(C)" edeg | B2 BA B2 d2 | e2 ef e2 (3def | gedB A2 :: BA | G2 BG dGBe |
|
132 |
dBBA"^(D7)" B3 A | G2 BG dGBe | dBAG A4 | G2 BG dGBe | dBBA B3 d |
|
133 |
e2 ef e2 (3def | gedB A2 :|
|
134 |
-
|
135 |
-
Response:
|
136 |
-
X:1
|
137 |
-
L:1/8
|
138 |
-
M:2/2
|
139 |
-
K:G
|
140 |
-
|: BA |"G" G2 g2"^(C)" edeg |"G" B2 BA"^(D7)" BcBA |"G" G2 g2"Em" edeg |"Am" A2 AG"D7" AcBA |
|
141 |
-
"G" G2 g2"^(C)" edeg |"G" B2 BA B2 d2 |"C" e2 ef e2 (3def |"D7" gedB A2 :: BA |"G" G2 BG dGBG |
|
142 |
-
"G" B2 BA"^(D7)" BcBA |"G" G2 BG"Em" dGBG |"Am" A2 AG"D7" AcBA |"G" G2 BG dGBe | dBBA B2 d2 |
|
143 |
-
"C" e2 ef e2 (3def |"D7" gedB A2 :|
|
144 |
```
|
145 |
```
|
146 |
-
Prompt:
|
147 |
Develop a series of chord pairings that amplify the harmonious elements in the given music piece.
|
148 |
|
149 |
E |: EAA ABc | Bee e2 d | cBA ABc | BEE E2 D | EAA ABc | Bee e2 d |
|
150 |
cBA ^GAB |1 A2 A A2 E :|2 A2 A GAB || c3 cdc | Bgg g2 ^g | aed cBA |
|
151 |
^GAB E^F^G | A^GA BAB | cde fed | cBA ^GAB |1 A2 A GAB :|2 \n A3 A2 ||
|
152 |
-
|
153 |
-
Response:
|
154 |
-
X:1
|
155 |
-
L:1/8
|
156 |
-
M:6/8
|
157 |
-
K:Amin
|
158 |
-
E |:"Am" EAA ABc |"E7" Bee e2 d |"Am" cBA ABc |"E7" BGE E2 E |
|
159 |
-
"Am" EAA ABc |"E7" Bee e2 d |"Am" cBA"E7" ^GAB |1"Am" A2 A A2 E :|2
|
160 |
-
"Am" A2 A GAB ||"C" c3 cdc |"G" Bgg g2 ^g |"Am" aed cBA |
|
161 |
-
"E7" ^GAB E^F^G |"Am" A^GA"E7" BAB |"Am" cde"Dm" fed |
|
162 |
-
"Am" cBA"E7" ^GAB |1"Am" A2 A GAB :|2 "Am" A2 A A2 ||
|
163 |
```
|
164 |
|
165 |
### Function: Chord Conditioned Music Generation
|
166 |
```
|
167 |
-
Prompt:
|
168 |
Develop a musical piece using the given chord progression. 'Dm', 'C', 'Dm', 'Dm', 'C', 'Dm', 'C', 'Dm'
|
169 |
-
|
170 |
-
Response:
|
171 |
-
X:1
|
172 |
-
L:1/8
|
173 |
-
M:6/8
|
174 |
-
K:F
|
175 |
-
z4 z D |"Dm" A2 A"C" G2 F |"Dm" FE D D2 D |
|
176 |
-
"Dm" A2 A"C" G2 A |"Dm" D3 D2 D |"Dm" A2 A"C" G2 F |
|
177 |
-
"Dm" FE D D2 D |"Dm" F2 G"C" E2 C |"Dm" D3 D2 D |
|
178 |
-
"F" F2 F F2 c |"Bb" d2 c"^(Gm)" B2 A |
|
179 |
-
"Gm" G2 G G2 B |"Am" A2 G"A7" FE D |"Dm" F2 F F2 c |
|
180 |
-
"Bb" d2 c"^(Gm)" B2 A |"Gm" G2 G"A7" A2 G |
|
181 |
-
"Dm" FE D D2 z |]
|
182 |
```
|
183 |
|
184 |
### Function: Musical Form Conditioned Music Generation
|
185 |
|
186 |
```
|
187 |
-
Prompt:
|
188 |
Develop a composition by incorporating elements from the given melodic structure.
|
189 |
|
190 |
Ternary, Sectional: Verse/Chorus/Bridge
|
191 |
-
|
192 |
-
Response:
|
193 |
-
X:1
|
194 |
-
L:1/8
|
195 |
-
M:6/8
|
196 |
-
K:Gmin
|
197 |
-
|:"Gm" GAB AG^F | GAB c2 c | d2 d cdB | A2 d cBA |
|
198 |
-
GAB AG^F | GAB c2 c | d2 d cdB |1 AG^F G2 D :|2
|
199 |
-
AG^F GAB |: c2 c cBA | c2 c cBA | c2 c cBA |
|
200 |
-
ABA GAB | c2 c cBA | c2 c cBA | d2 d cdB |1
|
201 |
-
AG^F GAB :|2 AG^F G2 A |:"Bbm" B3 dcB | f2 e dcB |
|
202 |
-
c2 f c2 c | cfc cBA | ABB dcB | f2 e dcB |
|
203 |
-
d2 d edc |1 cBA B2 B :|2 cBA G3 ||
|
204 |
```
|
205 |
|
206 |
### Function: Motif and Form Conditioned Music Generation
|
207 |
|
208 |
```
|
209 |
-
Text Input:
|
210 |
Create music by incorporating the assigned motif into the predetermined musical arrangement.
|
211 |
|
212 |
Musical Form Input: Only One Section
|
@@ -217,27 +88,11 @@ L:1/8
|
|
217 |
M:9/8
|
218 |
K:Emin
|
219 |
vB2 E E2 F G2 A
|
220 |
-
|
221 |
-
Response:
|
222 |
-
X:1
|
223 |
-
L:1/8
|
224 |
-
M:9/8
|
225 |
-
K:Emin
|
226 |
-
|:"Em" vB2 E E2 F G2 A |"D" B2 e e2 ^d e3 |
|
227 |
-
"Bm" B2 E E2 F G2 A |"G" B2 G A2 F"C" G2 E |
|
228 |
-
"Em" vB2 E E2 F G2 A |"D" B2 e e2 ^d"C" e3 |
|
229 |
-
"Em" ve2 B"^Av" A2 F"Bm" G2 A |1"G" B2 G"D" A2 F"Em" G2 E :|
|
230 |
-
2"G" B2 G"D" A2 F"G" G3 |"^(C)" ABc"^(D)" ded"G" dBG |
|
231 |
-
"^(C)" cde"D" dcB"G" A2 G |"^(C)" E2 E"Am" ABc"D" def |
|
232 |
-
"Em" g2 G"D" FAF"G" G3 |"^(C)" ABc"^(D)" ded"G" dBG |
|
233 |
-
"^(C)" cde"D" dcB"G" A2 G |"Em" e2 B"^Av" A2 F"Bm" G2 A |
|
234 |
-
"G" B2 G"D" A2 F"Em" G2 E |]
|
235 |
```
|
236 |
|
237 |
### Function: Music Understanding
|
238 |
|
239 |
```
|
240 |
-
Prompt:
|
241 |
Investigate the aspects of this musical work and convey its structural organization using suitable musical words.
|
242 |
|
243 |
X:1
|
@@ -254,13 +109,9 @@ G2 dc BAGB | ABcd efge |1 aged cAFA :|2 aged ^cdef |:
|
|
254 |
g2 af g2 ef | gedc BAGB | Aaag ageg | aged ^cdef |
|
255 |
gbaf g2 ef | gedc BAGB | ABcd efge |1
|
256 |
aged ^cdef :|2 aged cAFA ||
|
257 |
-
|
258 |
-
Response:
|
259 |
-
Compound Binary
|
260 |
```
|
261 |
|
262 |
```
|
263 |
-
Prompt:
|
264 |
Analyze the musical work and pinpoint the consistent melodic element in every section.
|
265 |
|
266 |
X:1
|
@@ -271,13 +122,6 @@ ge | d2 G2 cBAG | d2 G2 cBAG | e2 A2 ABcd | edcB A2 Bc |
|
|
271 |
d2 cB g2 fe | edcB cBAG | BAGE DEGA | B2 G2 G2 :: ga |
|
272 |
b2 gb a2 fa | g2 eg edcB | e2 A2 ABcd | edcB A2 ga |
|
273 |
b2 gb a2 fa | g2 eg edcB | cBAG DEGA | B2 G2 G2 :|
|
274 |
-
|
275 |
-
Response:
|
276 |
-
X:1
|
277 |
-
L:1/8
|
278 |
-
M:4/4
|
279 |
-
K:G
|
280 |
-
ge d2 G2 cBAG d2 G2 cBAG
|
281 |
```
|
282 |
|
283 |
## Training Data
|
|
|
25 |
|
26 |
<!-- <audio controls src="https://cdn-uploads.huggingface.co/production/uploads/5fd6f670053c8345eddc1b68/8NSONUjIF7KGUCfwzPCd9.mpga"></audio> -->
|
27 |
|
28 |
+
## Example Prompts
|
29 |
|
30 |
**Our model produces symbolic music(ABC notation) well in the following prompts.** Here are some musical tasks.
|
31 |
|
32 |
### Function: Text2music
|
33 |
|
34 |
```
|
|
|
35 |
Using ABC notation, recreate the given text as a musical score.
|
36 |
Meter C
|
37 |
Notes The parts are commonly interchanged.
|
|
|
39 |
Key D
|
40 |
Note Length 1/8
|
41 |
Rhythm reel
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
42 |
```
|
43 |
```
|
|
|
44 |
Develop a tune influenced by Bach's compositions.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
45 |
```
|
46 |
|
47 |
### Function: Melody Harmonization
|
48 |
|
49 |
```
|
|
|
50 |
Construct smooth-flowing chord progressions for the supplied music.
|
51 |
|
52 |
|: BA | G2 g2"^(C)" edeg | B2 BA"^(D7)" BcBA | G2 g2 edeg | dBAG A2 BA |
|
53 |
G2 g2"^(C)" edeg | B2 BA B2 d2 | e2 ef e2 (3def | gedB A2 :: BA | G2 BG dGBe |
|
54 |
dBBA"^(D7)" B3 A | G2 BG dGBe | dBAG A4 | G2 BG dGBe | dBBA B3 d |
|
55 |
e2 ef e2 (3def | gedB A2 :|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
56 |
```
|
57 |
```
|
|
|
58 |
Develop a series of chord pairings that amplify the harmonious elements in the given music piece.
|
59 |
|
60 |
E |: EAA ABc | Bee e2 d | cBA ABc | BEE E2 D | EAA ABc | Bee e2 d |
|
61 |
cBA ^GAB |1 A2 A A2 E :|2 A2 A GAB || c3 cdc | Bgg g2 ^g | aed cBA |
|
62 |
^GAB E^F^G | A^GA BAB | cde fed | cBA ^GAB |1 A2 A GAB :|2 \n A3 A2 ||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
63 |
```
|
64 |
|
65 |
### Function: Chord Conditioned Music Generation
|
66 |
```
|
|
|
67 |
Develop a musical piece using the given chord progression. 'Dm', 'C', 'Dm', 'Dm', 'C', 'Dm', 'C', 'Dm'
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
68 |
```
|
69 |
|
70 |
### Function: Musical Form Conditioned Music Generation
|
71 |
|
72 |
```
|
|
|
73 |
Develop a composition by incorporating elements from the given melodic structure.
|
74 |
|
75 |
Ternary, Sectional: Verse/Chorus/Bridge
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
76 |
```
|
77 |
|
78 |
### Function: Motif and Form Conditioned Music Generation
|
79 |
|
80 |
```
|
|
|
81 |
Create music by incorporating the assigned motif into the predetermined musical arrangement.
|
82 |
|
83 |
Musical Form Input: Only One Section
|
|
|
88 |
M:9/8
|
89 |
K:Emin
|
90 |
vB2 E E2 F G2 A
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
91 |
```
|
92 |
|
93 |
### Function: Music Understanding
|
94 |
|
95 |
```
|
|
|
96 |
Investigate the aspects of this musical work and convey its structural organization using suitable musical words.
|
97 |
|
98 |
X:1
|
|
|
109 |
g2 af g2 ef | gedc BAGB | Aaag ageg | aged ^cdef |
|
110 |
gbaf g2 ef | gedc BAGB | ABcd efge |1
|
111 |
aged ^cdef :|2 aged cAFA ||
|
|
|
|
|
|
|
112 |
```
|
113 |
|
114 |
```
|
|
|
115 |
Analyze the musical work and pinpoint the consistent melodic element in every section.
|
116 |
|
117 |
X:1
|
|
|
122 |
d2 cB g2 fe | edcB cBAG | BAGE DEGA | B2 G2 G2 :: ga |
|
123 |
b2 gb a2 fa | g2 eg edcB | e2 A2 ABcd | edcB A2 ga |
|
124 |
b2 gb a2 fa | g2 eg edcB | cBAG DEGA | B2 G2 G2 :|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
125 |
```
|
126 |
|
127 |
## Training Data
|