m3hrdadfi commited on
Commit
6eb7465
1 Parent(s): 716393c
README.md ADDED
@@ -0,0 +1,440 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: jonatasgrosman/wav2vec2-large-xlsr-53-english
4
+ tags:
5
+ - generated_from_trainer
6
+ - audio
7
+ - automatic-speech-recognition
8
+ - speech
9
+ - speech-emotion-recognition
10
+ - audio-classification
11
+ widget:
12
+ - example_title: IEMOCAP clip "happy"
13
+ src: >-
14
+ https://cdn-media.huggingface.co/speech_samples/IEMOCAP_Ses01F_impro03_F013.wav
15
+ - example_title: IEMOCAP clip "neutral"
16
+ src: >-
17
+ https://cdn-media.huggingface.co/speech_samples/IEMOCAP_Ses01F_impro04_F000.wav
18
+ metrics:
19
+ - accuracy
20
+ model-index:
21
+ - name: wav2vec2-large-xlsr-53-english-ser-cosine
22
+ results: []
23
+
24
+ ---
25
+
26
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
27
+ should probably proofread and complete it, then remove this comment. -->
28
+
29
+ # wav2vec2-large-xlsr-53-english-ser-cosine
30
+
31
+ This model is a fine-tuned version of [jonatasgrosman/wav2vec2-large-xlsr-53-english](https://huggingface.co/jonatasgrosman/wav2vec2-large-xlsr-53-english) on an unknown dataset.
32
+ It achieves the following results on the evaluation set:
33
+ - Loss: 0.4677
34
+ - Accuracy: 0.8677
35
+
36
+ ## Model description
37
+
38
+ More information needed
39
+
40
+ ## Intended uses & limitations
41
+
42
+ More information needed
43
+
44
+ ## Training and evaluation data
45
+
46
+ More information needed
47
+
48
+ ## Training procedure
49
+
50
+ ### Training hyperparameters
51
+
52
+ The following hyperparameters were used during training:
53
+ - learning_rate: 0.0001076429938136877
54
+ - train_batch_size: 4
55
+ - eval_batch_size: 4
56
+ - seed: 42
57
+ - gradient_accumulation_steps: 2
58
+ - total_train_batch_size: 8
59
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
60
+ - lr_scheduler_type: cosine_with_restarts
61
+ - lr_scheduler_warmup_steps: 18
62
+ - num_epochs: 3.0
63
+ - mixed_precision_training: Native AMP
64
+
65
+ ### Training results
66
+
67
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
68
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
69
+ | 1.7885 | 0.01 | 10 | 1.7963 | 0.1791 |
70
+ | 1.7907 | 0.02 | 20 | 1.7973 | 0.2638 |
71
+ | 1.8288 | 0.02 | 30 | 1.7546 | 0.2465 |
72
+ | 1.7803 | 0.03 | 40 | 1.7500 | 0.2087 |
73
+ | 1.7941 | 0.04 | 50 | 1.6953 | 0.2950 |
74
+ | 1.7934 | 0.05 | 60 | 1.6342 | 0.3714 |
75
+ | 1.6559 | 0.06 | 70 | 1.6199 | 0.2892 |
76
+ | 1.6214 | 0.07 | 80 | 1.5400 | 0.4117 |
77
+ | 1.5226 | 0.07 | 90 | 1.3802 | 0.4519 |
78
+ | 1.4954 | 0.08 | 100 | 1.3506 | 0.4717 |
79
+ | 1.4062 | 0.09 | 110 | 1.3328 | 0.4766 |
80
+ | 1.4507 | 0.1 | 120 | 1.1985 | 0.5464 |
81
+ | 1.2812 | 0.11 | 130 | 1.2826 | 0.4922 |
82
+ | 1.1494 | 0.12 | 140 | 1.0960 | 0.6187 |
83
+ | 1.1035 | 0.12 | 150 | 1.1925 | 0.5645 |
84
+ | 1.2784 | 0.13 | 160 | 1.0955 | 0.6015 |
85
+ | 1.0302 | 0.14 | 170 | 1.0418 | 0.6072 |
86
+ | 1.0068 | 0.15 | 180 | 0.9261 | 0.6804 |
87
+ | 1.112 | 0.16 | 190 | 1.1529 | 0.5867 |
88
+ | 1.0308 | 0.16 | 200 | 0.8637 | 0.7058 |
89
+ | 1.0464 | 0.17 | 210 | 0.9205 | 0.6426 |
90
+ | 0.9531 | 0.18 | 220 | 0.9363 | 0.6886 |
91
+ | 1.0228 | 0.19 | 230 | 0.9637 | 0.6615 |
92
+ | 1.1446 | 0.2 | 240 | 1.3015 | 0.5489 |
93
+ | 1.1146 | 0.21 | 250 | 0.9328 | 0.6483 |
94
+ | 0.849 | 0.21 | 260 | 0.8504 | 0.6746 |
95
+ | 0.7977 | 0.22 | 270 | 0.9533 | 0.6697 |
96
+ | 0.9397 | 0.23 | 280 | 0.9300 | 0.7083 |
97
+ | 0.8625 | 0.24 | 290 | 1.1020 | 0.6401 |
98
+ | 1.333 | 0.25 | 300 | 0.9816 | 0.6442 |
99
+ | 1.0022 | 0.25 | 310 | 0.8472 | 0.7067 |
100
+ | 0.8002 | 0.26 | 320 | 0.7866 | 0.7149 |
101
+ | 0.8987 | 0.27 | 330 | 0.7979 | 0.6976 |
102
+ | 0.9473 | 0.28 | 340 | 0.8600 | 0.6878 |
103
+ | 0.9001 | 0.29 | 350 | 0.8141 | 0.7034 |
104
+ | 0.9793 | 0.3 | 360 | 0.9872 | 0.6450 |
105
+ | 0.9189 | 0.3 | 370 | 0.8561 | 0.6845 |
106
+ | 0.9281 | 0.31 | 380 | 0.9055 | 0.6919 |
107
+ | 0.7118 | 0.32 | 390 | 0.7937 | 0.6984 |
108
+ | 1.0565 | 0.33 | 400 | 0.7339 | 0.7313 |
109
+ | 0.8467 | 0.34 | 410 | 0.8262 | 0.6836 |
110
+ | 0.9601 | 0.35 | 420 | 0.7464 | 0.7346 |
111
+ | 0.8911 | 0.35 | 430 | 0.7229 | 0.7338 |
112
+ | 0.9033 | 0.36 | 440 | 0.7393 | 0.7223 |
113
+ | 0.8961 | 0.37 | 450 | 0.7272 | 0.7428 |
114
+ | 0.7216 | 0.38 | 460 | 0.7183 | 0.7436 |
115
+ | 0.6935 | 0.39 | 470 | 0.8003 | 0.7083 |
116
+ | 0.7588 | 0.39 | 480 | 0.8471 | 0.7116 |
117
+ | 0.8766 | 0.4 | 490 | 0.6976 | 0.7379 |
118
+ | 0.6866 | 0.41 | 500 | 0.6806 | 0.7584 |
119
+ | 0.6822 | 0.42 | 510 | 0.7669 | 0.7256 |
120
+ | 0.7067 | 0.43 | 520 | 0.6885 | 0.7461 |
121
+ | 0.6159 | 0.44 | 530 | 0.7020 | 0.7535 |
122
+ | 0.8814 | 0.44 | 540 | 0.7478 | 0.7256 |
123
+ | 0.7786 | 0.45 | 550 | 0.6302 | 0.7691 |
124
+ | 0.6363 | 0.46 | 560 | 0.6745 | 0.7691 |
125
+ | 0.8518 | 0.47 | 570 | 0.6242 | 0.7666 |
126
+ | 0.8194 | 0.48 | 580 | 0.7154 | 0.7379 |
127
+ | 0.6755 | 0.49 | 590 | 0.7056 | 0.7543 |
128
+ | 0.7743 | 0.49 | 600 | 0.6823 | 0.7486 |
129
+ | 0.6457 | 0.5 | 610 | 0.7160 | 0.7502 |
130
+ | 0.4976 | 0.51 | 620 | 0.8222 | 0.7149 |
131
+ | 0.929 | 0.52 | 630 | 0.7318 | 0.7371 |
132
+ | 0.7981 | 0.53 | 640 | 0.7417 | 0.7461 |
133
+ | 0.7243 | 0.53 | 650 | 0.6831 | 0.7461 |
134
+ | 0.7332 | 0.54 | 660 | 0.6273 | 0.7592 |
135
+ | 0.7827 | 0.55 | 670 | 0.6158 | 0.7724 |
136
+ | 0.7733 | 0.56 | 680 | 0.7515 | 0.7371 |
137
+ | 0.8527 | 0.57 | 690 | 0.7200 | 0.7412 |
138
+ | 0.8355 | 0.58 | 700 | 0.7738 | 0.7436 |
139
+ | 0.5383 | 0.58 | 710 | 0.9081 | 0.7132 |
140
+ | 1.0851 | 0.59 | 720 | 0.6135 | 0.7831 |
141
+ | 0.7345 | 0.6 | 730 | 0.7032 | 0.7642 |
142
+ | 0.6648 | 0.61 | 740 | 0.6146 | 0.7781 |
143
+ | 0.612 | 0.62 | 750 | 0.6338 | 0.7732 |
144
+ | 0.6101 | 0.62 | 760 | 0.6772 | 0.7740 |
145
+ | 0.6498 | 0.63 | 770 | 0.7153 | 0.7601 |
146
+ | 0.6258 | 0.64 | 780 | 0.7871 | 0.7329 |
147
+ | 0.7943 | 0.65 | 790 | 0.6975 | 0.7691 |
148
+ | 0.8176 | 0.66 | 800 | 0.7692 | 0.7313 |
149
+ | 0.6682 | 0.67 | 810 | 0.5766 | 0.8012 |
150
+ | 0.4808 | 0.67 | 820 | 0.5882 | 0.7847 |
151
+ | 0.6331 | 0.68 | 830 | 0.5855 | 0.7896 |
152
+ | 0.874 | 0.69 | 840 | 0.7082 | 0.7568 |
153
+ | 0.8984 | 0.7 | 850 | 0.6078 | 0.7732 |
154
+ | 0.5861 | 0.71 | 860 | 0.6469 | 0.7814 |
155
+ | 0.6896 | 0.72 | 870 | 0.6997 | 0.7560 |
156
+ | 0.8237 | 0.72 | 880 | 0.6279 | 0.7650 |
157
+ | 0.5818 | 0.73 | 890 | 0.6763 | 0.7691 |
158
+ | 0.4781 | 0.74 | 900 | 0.6867 | 0.7592 |
159
+ | 0.6851 | 0.75 | 910 | 0.6142 | 0.7724 |
160
+ | 0.455 | 0.76 | 920 | 0.9159 | 0.7141 |
161
+ | 0.808 | 0.76 | 930 | 0.7518 | 0.7617 |
162
+ | 1.0634 | 0.77 | 940 | 0.6015 | 0.7839 |
163
+ | 0.6956 | 0.78 | 950 | 0.5895 | 0.7872 |
164
+ | 0.5169 | 0.79 | 960 | 0.6394 | 0.7773 |
165
+ | 0.6213 | 0.8 | 970 | 0.6890 | 0.7699 |
166
+ | 0.5506 | 0.81 | 980 | 0.7471 | 0.7560 |
167
+ | 0.6233 | 0.81 | 990 | 0.6525 | 0.7872 |
168
+ | 0.7666 | 0.82 | 1000 | 0.8002 | 0.7403 |
169
+ | 0.5644 | 0.83 | 1010 | 0.7067 | 0.7387 |
170
+ | 0.6038 | 0.84 | 1020 | 0.6091 | 0.7823 |
171
+ | 0.6211 | 0.85 | 1030 | 0.6749 | 0.7707 |
172
+ | 0.6758 | 0.86 | 1040 | 0.7102 | 0.7502 |
173
+ | 0.7353 | 0.86 | 1050 | 0.6959 | 0.7560 |
174
+ | 0.5687 | 0.87 | 1060 | 0.6831 | 0.7675 |
175
+ | 0.5606 | 0.88 | 1070 | 0.5945 | 0.7847 |
176
+ | 0.7309 | 0.89 | 1080 | 0.6737 | 0.7412 |
177
+ | 0.5951 | 0.9 | 1090 | 0.6574 | 0.7675 |
178
+ | 0.6062 | 0.9 | 1100 | 0.6740 | 0.7502 |
179
+ | 0.9606 | 0.91 | 1110 | 0.5730 | 0.7839 |
180
+ | 0.6625 | 0.92 | 1120 | 0.5922 | 0.7749 |
181
+ | 0.7908 | 0.93 | 1130 | 0.5652 | 0.7823 |
182
+ | 0.6387 | 0.94 | 1140 | 0.5268 | 0.8118 |
183
+ | 0.7141 | 0.95 | 1150 | 0.5628 | 0.7896 |
184
+ | 0.5587 | 0.95 | 1160 | 0.6479 | 0.7609 |
185
+ | 0.4817 | 0.96 | 1170 | 0.5410 | 0.8044 |
186
+ | 0.4444 | 0.97 | 1180 | 0.5950 | 0.8044 |
187
+ | 0.6776 | 0.98 | 1190 | 0.5993 | 0.8012 |
188
+ | 0.5989 | 0.99 | 1200 | 0.5745 | 0.7987 |
189
+ | 0.6334 | 1.0 | 1210 | 0.6220 | 0.7913 |
190
+ | 0.5216 | 1.0 | 1220 | 0.5936 | 0.7938 |
191
+ | 0.5127 | 1.01 | 1230 | 0.6741 | 0.7839 |
192
+ | 0.5632 | 1.02 | 1240 | 0.6501 | 0.7954 |
193
+ | 0.5335 | 1.03 | 1250 | 0.5721 | 0.8061 |
194
+ | 0.511 | 1.04 | 1260 | 0.5630 | 0.8102 |
195
+ | 0.5424 | 1.04 | 1270 | 0.5396 | 0.8135 |
196
+ | 0.771 | 1.05 | 1280 | 0.5580 | 0.8012 |
197
+ | 0.435 | 1.06 | 1290 | 0.5764 | 0.8036 |
198
+ | 0.5203 | 1.07 | 1300 | 0.6032 | 0.7913 |
199
+ | 0.4689 | 1.08 | 1310 | 0.6431 | 0.7872 |
200
+ | 0.481 | 1.09 | 1320 | 0.6019 | 0.7987 |
201
+ | 0.5938 | 1.09 | 1330 | 0.6198 | 0.7938 |
202
+ | 0.3972 | 1.1 | 1340 | 0.5842 | 0.8061 |
203
+ | 0.368 | 1.11 | 1350 | 0.5066 | 0.8127 |
204
+ | 0.4644 | 1.12 | 1360 | 0.6058 | 0.8012 |
205
+ | 0.6914 | 1.13 | 1370 | 0.5384 | 0.8217 |
206
+ | 0.3341 | 1.13 | 1380 | 0.5535 | 0.8143 |
207
+ | 0.5301 | 1.14 | 1390 | 0.5916 | 0.8020 |
208
+ | 0.5294 | 1.15 | 1400 | 0.6297 | 0.7938 |
209
+ | 0.7029 | 1.16 | 1410 | 0.5581 | 0.8102 |
210
+ | 0.322 | 1.17 | 1420 | 0.6066 | 0.7831 |
211
+ | 0.6871 | 1.18 | 1430 | 0.5141 | 0.8151 |
212
+ | 0.4026 | 1.18 | 1440 | 0.6888 | 0.7716 |
213
+ | 0.4484 | 1.19 | 1450 | 0.5499 | 0.8077 |
214
+ | 0.3767 | 1.2 | 1460 | 0.4825 | 0.8225 |
215
+ | 0.4274 | 1.21 | 1470 | 0.4932 | 0.8274 |
216
+ | 0.4584 | 1.22 | 1480 | 0.5168 | 0.8299 |
217
+ | 0.5741 | 1.23 | 1490 | 0.6384 | 0.7798 |
218
+ | 0.3877 | 1.23 | 1500 | 0.5789 | 0.8044 |
219
+ | 0.3734 | 1.24 | 1510 | 0.6415 | 0.7855 |
220
+ | 0.7986 | 1.25 | 1520 | 0.5575 | 0.8077 |
221
+ | 0.5634 | 1.26 | 1530 | 0.5684 | 0.8143 |
222
+ | 0.5136 | 1.27 | 1540 | 0.5393 | 0.8143 |
223
+ | 0.5331 | 1.27 | 1550 | 0.5203 | 0.8176 |
224
+ | 0.2918 | 1.28 | 1560 | 0.5510 | 0.8151 |
225
+ | 0.4425 | 1.29 | 1570 | 0.5783 | 0.8094 |
226
+ | 0.4245 | 1.3 | 1580 | 0.5433 | 0.8209 |
227
+ | 0.3317 | 1.31 | 1590 | 0.5845 | 0.8085 |
228
+ | 0.4583 | 1.32 | 1600 | 0.6147 | 0.7954 |
229
+ | 0.3298 | 1.32 | 1610 | 0.6249 | 0.8053 |
230
+ | 0.5248 | 1.33 | 1620 | 0.5722 | 0.8094 |
231
+ | 0.665 | 1.34 | 1630 | 0.5446 | 0.8217 |
232
+ | 0.3917 | 1.35 | 1640 | 0.5316 | 0.8258 |
233
+ | 0.4321 | 1.36 | 1650 | 0.5598 | 0.8217 |
234
+ | 0.3005 | 1.37 | 1660 | 0.6190 | 0.8151 |
235
+ | 0.4992 | 1.37 | 1670 | 0.5546 | 0.8184 |
236
+ | 0.586 | 1.38 | 1680 | 0.6416 | 0.7913 |
237
+ | 0.6481 | 1.39 | 1690 | 0.5324 | 0.8135 |
238
+ | 0.4008 | 1.4 | 1700 | 0.5786 | 0.8012 |
239
+ | 0.3463 | 1.41 | 1710 | 0.5145 | 0.8209 |
240
+ | 0.4994 | 1.41 | 1720 | 0.5650 | 0.8192 |
241
+ | 0.4093 | 1.42 | 1730 | 0.5191 | 0.8365 |
242
+ | 0.6375 | 1.43 | 1740 | 0.5734 | 0.8135 |
243
+ | 0.2303 | 1.44 | 1750 | 0.5447 | 0.8102 |
244
+ | 0.4824 | 1.45 | 1760 | 0.5139 | 0.8250 |
245
+ | 0.5439 | 1.46 | 1770 | 0.4979 | 0.8258 |
246
+ | 0.4751 | 1.46 | 1780 | 0.4896 | 0.8340 |
247
+ | 0.534 | 1.47 | 1790 | 0.4656 | 0.8348 |
248
+ | 0.4526 | 1.48 | 1800 | 0.5322 | 0.8316 |
249
+ | 0.4618 | 1.49 | 1810 | 0.5216 | 0.8233 |
250
+ | 0.3825 | 1.5 | 1820 | 0.4792 | 0.8225 |
251
+ | 0.4557 | 1.5 | 1830 | 0.5071 | 0.8118 |
252
+ | 0.5725 | 1.51 | 1840 | 0.5152 | 0.8102 |
253
+ | 0.7004 | 1.52 | 1850 | 0.5080 | 0.8217 |
254
+ | 0.4367 | 1.53 | 1860 | 0.4920 | 0.8357 |
255
+ | 0.3682 | 1.54 | 1870 | 0.5253 | 0.8299 |
256
+ | 0.4411 | 1.55 | 1880 | 0.6186 | 0.8069 |
257
+ | 0.5391 | 1.55 | 1890 | 0.5074 | 0.8283 |
258
+ | 0.4673 | 1.56 | 1900 | 0.4858 | 0.8398 |
259
+ | 0.3542 | 1.57 | 1910 | 0.4767 | 0.8381 |
260
+ | 0.6483 | 1.58 | 1920 | 0.4694 | 0.8373 |
261
+ | 0.3837 | 1.59 | 1930 | 0.4678 | 0.8472 |
262
+ | 0.363 | 1.6 | 1940 | 0.4684 | 0.8463 |
263
+ | 0.6446 | 1.6 | 1950 | 0.4696 | 0.8365 |
264
+ | 0.5627 | 1.61 | 1960 | 0.4651 | 0.8472 |
265
+ | 0.3733 | 1.62 | 1970 | 0.5138 | 0.8291 |
266
+ | 0.5972 | 1.63 | 1980 | 0.5244 | 0.8250 |
267
+ | 0.2388 | 1.64 | 1990 | 0.5020 | 0.8266 |
268
+ | 0.6279 | 1.64 | 2000 | 0.5865 | 0.8118 |
269
+ | 0.5827 | 1.65 | 2010 | 0.5717 | 0.8176 |
270
+ | 0.4598 | 1.66 | 2020 | 0.4691 | 0.8439 |
271
+ | 0.3817 | 1.67 | 2030 | 0.5084 | 0.8340 |
272
+ | 0.2973 | 1.68 | 2040 | 0.4568 | 0.8447 |
273
+ | 0.4039 | 1.69 | 2050 | 0.4681 | 0.8505 |
274
+ | 0.4572 | 1.69 | 2060 | 0.4718 | 0.8389 |
275
+ | 0.3481 | 1.7 | 2070 | 0.4849 | 0.8283 |
276
+ | 0.4553 | 1.71 | 2080 | 0.4574 | 0.8414 |
277
+ | 0.4055 | 1.72 | 2090 | 0.4640 | 0.8463 |
278
+ | 0.4384 | 1.73 | 2100 | 0.5049 | 0.8431 |
279
+ | 0.5593 | 1.74 | 2110 | 0.5192 | 0.8513 |
280
+ | 0.3486 | 1.74 | 2120 | 0.4764 | 0.8480 |
281
+ | 0.4698 | 1.75 | 2130 | 0.4858 | 0.8447 |
282
+ | 0.211 | 1.76 | 2140 | 0.4976 | 0.8398 |
283
+ | 0.5209 | 1.77 | 2150 | 0.4934 | 0.8472 |
284
+ | 0.4281 | 1.78 | 2160 | 0.4714 | 0.8578 |
285
+ | 0.3902 | 1.78 | 2170 | 0.4863 | 0.8463 |
286
+ | 0.3083 | 1.79 | 2180 | 0.4807 | 0.8431 |
287
+ | 0.4642 | 1.8 | 2190 | 0.4712 | 0.8472 |
288
+ | 0.2382 | 1.81 | 2200 | 0.4641 | 0.8513 |
289
+ | 0.4154 | 1.82 | 2210 | 0.4900 | 0.8447 |
290
+ | 0.3637 | 1.83 | 2220 | 0.4790 | 0.8488 |
291
+ | 0.4864 | 1.83 | 2230 | 0.4742 | 0.8513 |
292
+ | 0.5024 | 1.84 | 2240 | 0.4803 | 0.8529 |
293
+ | 0.4139 | 1.85 | 2250 | 0.4672 | 0.8521 |
294
+ | 0.4131 | 1.86 | 2260 | 0.4895 | 0.8431 |
295
+ | 0.4851 | 1.87 | 2270 | 0.4432 | 0.8529 |
296
+ | 0.3846 | 1.88 | 2280 | 0.4417 | 0.8422 |
297
+ | 0.3778 | 1.88 | 2290 | 0.4477 | 0.8439 |
298
+ | 0.4128 | 1.89 | 2300 | 0.4336 | 0.8513 |
299
+ | 0.3755 | 1.9 | 2310 | 0.4678 | 0.8439 |
300
+ | 0.4672 | 1.91 | 2320 | 0.4740 | 0.8373 |
301
+ | 0.5216 | 1.92 | 2330 | 0.4343 | 0.8472 |
302
+ | 0.3469 | 1.92 | 2340 | 0.4542 | 0.8316 |
303
+ | 0.3283 | 1.93 | 2350 | 0.4587 | 0.8447 |
304
+ | 0.3495 | 1.94 | 2360 | 0.5050 | 0.8348 |
305
+ | 0.4518 | 1.95 | 2370 | 0.5309 | 0.8266 |
306
+ | 0.3023 | 1.96 | 2380 | 0.5113 | 0.8332 |
307
+ | 0.4014 | 1.97 | 2390 | 0.4989 | 0.8332 |
308
+ | 0.4963 | 1.97 | 2400 | 0.4539 | 0.8505 |
309
+ | 0.3421 | 1.98 | 2410 | 0.4889 | 0.8455 |
310
+ | 0.4126 | 1.99 | 2420 | 0.4696 | 0.8463 |
311
+ | 0.479 | 2.0 | 2430 | 0.4498 | 0.8513 |
312
+ | 0.3319 | 2.01 | 2440 | 0.4686 | 0.8488 |
313
+ | 0.2787 | 2.01 | 2450 | 0.4650 | 0.8447 |
314
+ | 0.2105 | 2.02 | 2460 | 0.4665 | 0.8505 |
315
+ | 0.4944 | 2.03 | 2470 | 0.4667 | 0.8488 |
316
+ | 0.2236 | 2.04 | 2480 | 0.4678 | 0.8463 |
317
+ | 0.3076 | 2.05 | 2490 | 0.4621 | 0.8513 |
318
+ | 0.2813 | 2.06 | 2500 | 0.4451 | 0.8562 |
319
+ | 0.2207 | 2.06 | 2510 | 0.4559 | 0.8562 |
320
+ | 0.3693 | 2.07 | 2520 | 0.4634 | 0.8513 |
321
+ | 0.3682 | 2.08 | 2530 | 0.4390 | 0.8562 |
322
+ | 0.2618 | 2.09 | 2540 | 0.4417 | 0.8529 |
323
+ | 0.3139 | 2.1 | 2550 | 0.4618 | 0.8529 |
324
+ | 0.1739 | 2.11 | 2560 | 0.4938 | 0.8488 |
325
+ | 0.4258 | 2.11 | 2570 | 0.4574 | 0.8496 |
326
+ | 0.2136 | 2.12 | 2580 | 0.4495 | 0.8529 |
327
+ | 0.2625 | 2.13 | 2590 | 0.4555 | 0.8570 |
328
+ | 0.3161 | 2.14 | 2600 | 0.4696 | 0.8537 |
329
+ | 0.2515 | 2.15 | 2610 | 0.4649 | 0.8661 |
330
+ | 0.3097 | 2.15 | 2620 | 0.4474 | 0.8685 |
331
+ | 0.3544 | 2.16 | 2630 | 0.4458 | 0.8603 |
332
+ | 0.2967 | 2.17 | 2640 | 0.4555 | 0.8669 |
333
+ | 0.4015 | 2.18 | 2650 | 0.4486 | 0.8652 |
334
+ | 0.079 | 2.19 | 2660 | 0.4624 | 0.8620 |
335
+ | 0.1754 | 2.2 | 2670 | 0.4805 | 0.8587 |
336
+ | 0.1854 | 2.2 | 2680 | 0.4803 | 0.8628 |
337
+ | 0.3181 | 2.21 | 2690 | 0.4792 | 0.8595 |
338
+ | 0.0808 | 2.22 | 2700 | 0.4740 | 0.8628 |
339
+ | 0.2027 | 2.23 | 2710 | 0.4846 | 0.8587 |
340
+ | 0.3211 | 2.24 | 2720 | 0.5074 | 0.8505 |
341
+ | 0.2448 | 2.25 | 2730 | 0.5276 | 0.8414 |
342
+ | 0.3618 | 2.25 | 2740 | 0.5133 | 0.8488 |
343
+ | 0.1822 | 2.26 | 2750 | 0.5002 | 0.8578 |
344
+ | 0.3095 | 2.27 | 2760 | 0.4827 | 0.8603 |
345
+ | 0.0762 | 2.28 | 2770 | 0.4792 | 0.8644 |
346
+ | 0.187 | 2.29 | 2780 | 0.4897 | 0.8644 |
347
+ | 0.5779 | 2.29 | 2790 | 0.4901 | 0.8652 |
348
+ | 0.292 | 2.3 | 2800 | 0.4764 | 0.8603 |
349
+ | 0.1865 | 2.31 | 2810 | 0.4798 | 0.8644 |
350
+ | 0.3594 | 2.32 | 2820 | 0.4837 | 0.8620 |
351
+ | 0.421 | 2.33 | 2830 | 0.4812 | 0.8562 |
352
+ | 0.1173 | 2.34 | 2840 | 0.4708 | 0.8603 |
353
+ | 0.278 | 2.34 | 2850 | 0.4693 | 0.8685 |
354
+ | 0.2294 | 2.35 | 2860 | 0.4724 | 0.8628 |
355
+ | 0.243 | 2.36 | 2870 | 0.4749 | 0.8620 |
356
+ | 0.3979 | 2.37 | 2880 | 0.4633 | 0.8628 |
357
+ | 0.4518 | 2.38 | 2890 | 0.4603 | 0.8669 |
358
+ | 0.2739 | 2.38 | 2900 | 0.4625 | 0.8685 |
359
+ | 0.1782 | 2.39 | 2910 | 0.4652 | 0.8677 |
360
+ | 0.3536 | 2.4 | 2920 | 0.4613 | 0.8644 |
361
+ | 0.0904 | 2.41 | 2930 | 0.4642 | 0.8611 |
362
+ | 0.2315 | 2.42 | 2940 | 0.4613 | 0.8661 |
363
+ | 0.1236 | 2.43 | 2950 | 0.4628 | 0.8652 |
364
+ | 0.1842 | 2.43 | 2960 | 0.4706 | 0.8620 |
365
+ | 0.2414 | 2.44 | 2970 | 0.4683 | 0.8652 |
366
+ | 0.3419 | 2.45 | 2980 | 0.4645 | 0.8677 |
367
+ | 0.2877 | 2.46 | 2990 | 0.4657 | 0.8636 |
368
+ | 0.2524 | 2.47 | 3000 | 0.4701 | 0.8652 |
369
+ | 0.1731 | 2.48 | 3010 | 0.4733 | 0.8644 |
370
+ | 0.1731 | 2.48 | 3020 | 0.4830 | 0.8595 |
371
+ | 0.0921 | 2.49 | 3030 | 0.4904 | 0.8603 |
372
+ | 0.1593 | 2.5 | 3040 | 0.4836 | 0.8595 |
373
+ | 0.467 | 2.51 | 3050 | 0.4706 | 0.8628 |
374
+ | 0.4225 | 2.52 | 3060 | 0.4598 | 0.8644 |
375
+ | 0.1251 | 2.52 | 3070 | 0.4511 | 0.8694 |
376
+ | 0.2181 | 2.53 | 3080 | 0.4487 | 0.8735 |
377
+ | 0.2247 | 2.54 | 3090 | 0.4452 | 0.8767 |
378
+ | 0.3722 | 2.55 | 3100 | 0.4469 | 0.8759 |
379
+ | 0.1069 | 2.56 | 3110 | 0.4536 | 0.8735 |
380
+ | 0.2174 | 2.57 | 3120 | 0.4571 | 0.8710 |
381
+ | 0.2586 | 2.57 | 3130 | 0.4626 | 0.8685 |
382
+ | 0.2803 | 2.58 | 3140 | 0.4665 | 0.8677 |
383
+ | 0.4484 | 2.59 | 3150 | 0.4581 | 0.8694 |
384
+ | 0.3104 | 2.6 | 3160 | 0.4539 | 0.8735 |
385
+ | 0.2411 | 2.61 | 3170 | 0.4531 | 0.8726 |
386
+ | 0.2157 | 2.62 | 3180 | 0.4565 | 0.8694 |
387
+ | 0.2342 | 2.62 | 3190 | 0.4549 | 0.8694 |
388
+ | 0.2921 | 2.63 | 3200 | 0.4570 | 0.8677 |
389
+ | 0.1988 | 2.64 | 3210 | 0.4590 | 0.8677 |
390
+ | 0.2142 | 2.65 | 3220 | 0.4601 | 0.8661 |
391
+ | 0.1666 | 2.66 | 3230 | 0.4652 | 0.8661 |
392
+ | 0.2296 | 2.66 | 3240 | 0.4709 | 0.8611 |
393
+ | 0.3847 | 2.67 | 3250 | 0.4676 | 0.8636 |
394
+ | 0.4149 | 2.68 | 3260 | 0.4654 | 0.8636 |
395
+ | 0.2602 | 2.69 | 3270 | 0.4614 | 0.8661 |
396
+ | 0.3786 | 2.7 | 3280 | 0.4605 | 0.8661 |
397
+ | 0.3509 | 2.71 | 3290 | 0.4590 | 0.8661 |
398
+ | 0.2254 | 2.71 | 3300 | 0.4564 | 0.8677 |
399
+ | 0.1775 | 2.72 | 3310 | 0.4553 | 0.8694 |
400
+ | 0.2269 | 2.73 | 3320 | 0.4546 | 0.8669 |
401
+ | 0.1792 | 2.74 | 3330 | 0.4549 | 0.8644 |
402
+ | 0.1107 | 2.75 | 3340 | 0.4580 | 0.8661 |
403
+ | 0.2062 | 2.75 | 3350 | 0.4598 | 0.8636 |
404
+ | 0.1641 | 2.76 | 3360 | 0.4621 | 0.8652 |
405
+ | 0.18 | 2.77 | 3370 | 0.4651 | 0.8652 |
406
+ | 0.0959 | 2.78 | 3380 | 0.4673 | 0.8661 |
407
+ | 0.217 | 2.79 | 3390 | 0.4672 | 0.8652 |
408
+ | 0.3293 | 2.8 | 3400 | 0.4673 | 0.8644 |
409
+ | 0.2691 | 2.8 | 3410 | 0.4669 | 0.8644 |
410
+ | 0.1945 | 2.81 | 3420 | 0.4659 | 0.8652 |
411
+ | 0.2712 | 2.82 | 3430 | 0.4660 | 0.8677 |
412
+ | 0.2287 | 2.83 | 3440 | 0.4663 | 0.8677 |
413
+ | 0.2103 | 2.84 | 3450 | 0.4661 | 0.8669 |
414
+ | 0.2713 | 2.85 | 3460 | 0.4663 | 0.8669 |
415
+ | 0.3182 | 2.85 | 3470 | 0.4665 | 0.8677 |
416
+ | 0.1698 | 2.86 | 3480 | 0.4668 | 0.8669 |
417
+ | 0.2663 | 2.87 | 3490 | 0.4669 | 0.8677 |
418
+ | 0.2091 | 2.88 | 3500 | 0.4670 | 0.8685 |
419
+ | 0.1406 | 2.89 | 3510 | 0.4677 | 0.8669 |
420
+ | 0.16 | 2.89 | 3520 | 0.4682 | 0.8661 |
421
+ | 0.1413 | 2.9 | 3530 | 0.4686 | 0.8661 |
422
+ | 0.3499 | 2.91 | 3540 | 0.4690 | 0.8661 |
423
+ | 0.205 | 2.92 | 3550 | 0.4688 | 0.8661 |
424
+ | 0.3849 | 2.93 | 3560 | 0.4684 | 0.8661 |
425
+ | 0.209 | 2.94 | 3570 | 0.4680 | 0.8669 |
426
+ | 0.1985 | 2.94 | 3580 | 0.4678 | 0.8677 |
427
+ | 0.1989 | 2.95 | 3590 | 0.4678 | 0.8677 |
428
+ | 0.2031 | 2.96 | 3600 | 0.4677 | 0.8677 |
429
+ | 0.2401 | 2.97 | 3610 | 0.4677 | 0.8677 |
430
+ | 0.2717 | 2.98 | 3620 | 0.4678 | 0.8677 |
431
+ | 0.2821 | 2.99 | 3630 | 0.4678 | 0.8677 |
432
+ | 0.1735 | 2.99 | 3640 | 0.4677 | 0.8677 |
433
+
434
+
435
+ ### Framework versions
436
+
437
+ - Transformers 4.40.0.dev0
438
+ - Pytorch 2.2.1+cu121
439
+ - Datasets 2.18.1.dev0
440
+ - Tokenizers 0.15.2
config.json ADDED
@@ -0,0 +1,135 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "jonatasgrosman/wav2vec2-large-xlsr-53-english",
3
+ "activation_dropout": 0.05,
4
+ "adapter_attn_dim": null,
5
+ "adapter_kernel_size": 3,
6
+ "adapter_stride": 2,
7
+ "add_adapter": false,
8
+ "apply_spec_augment": true,
9
+ "architectures": [
10
+ "Wav2Vec2ForSpeechClassification"
11
+ ],
12
+ "attention_dropout": 0.1,
13
+ "bos_token_id": 1,
14
+ "classifier_proj_size": 256,
15
+ "codevector_dim": 256,
16
+ "contrastive_logits_temperature": 0.1,
17
+ "conv_bias": true,
18
+ "conv_dim": [
19
+ 512,
20
+ 512,
21
+ 512,
22
+ 512,
23
+ 512,
24
+ 512,
25
+ 512
26
+ ],
27
+ "conv_kernel": [
28
+ 10,
29
+ 3,
30
+ 3,
31
+ 3,
32
+ 3,
33
+ 2,
34
+ 2
35
+ ],
36
+ "conv_stride": [
37
+ 5,
38
+ 2,
39
+ 2,
40
+ 2,
41
+ 2,
42
+ 2,
43
+ 2
44
+ ],
45
+ "ctc_loss_reduction": "mean",
46
+ "ctc_zero_infinity": true,
47
+ "diversity_loss_weight": 0.1,
48
+ "do_stable_layer_norm": true,
49
+ "eos_token_id": 2,
50
+ "feat_extract_activation": "gelu",
51
+ "feat_extract_dropout": 0.0,
52
+ "feat_extract_norm": "layer",
53
+ "feat_proj_dropout": 0.05,
54
+ "feat_quantizer_dropout": 0.0,
55
+ "final_dropout": 0.0,
56
+ "finetuning_task": "wav2vec2_clf",
57
+ "hidden_act": "gelu",
58
+ "hidden_dropout": 0.05,
59
+ "hidden_size": 1024,
60
+ "id2label": {
61
+ "0": "angry",
62
+ "1": "disgust",
63
+ "2": "fear",
64
+ "3": "happy",
65
+ "4": "neutral",
66
+ "5": "sad"
67
+ },
68
+ "initializer_range": 0.02,
69
+ "intermediate_size": 4096,
70
+ "label2id": {
71
+ "angry": 0,
72
+ "disgust": 1,
73
+ "fear": 2,
74
+ "happy": 3,
75
+ "neutral": 4,
76
+ "sad": 5
77
+ },
78
+ "layer_norm_eps": 1e-05,
79
+ "layerdrop": 0.05,
80
+ "mask_channel_length": 10,
81
+ "mask_channel_min_space": 1,
82
+ "mask_channel_other": 0.0,
83
+ "mask_channel_prob": 0.0,
84
+ "mask_channel_selection": "static",
85
+ "mask_feature_length": 10,
86
+ "mask_feature_min_masks": 0,
87
+ "mask_feature_prob": 0.0,
88
+ "mask_time_length": 10,
89
+ "mask_time_min_masks": 2,
90
+ "mask_time_min_space": 1,
91
+ "mask_time_other": 0.0,
92
+ "mask_time_prob": 0.05,
93
+ "mask_time_selection": "static",
94
+ "model_type": "wav2vec2",
95
+ "num_adapter_layers": 3,
96
+ "num_attention_heads": 16,
97
+ "num_codevector_groups": 2,
98
+ "num_codevectors_per_group": 320,
99
+ "num_conv_pos_embedding_groups": 16,
100
+ "num_conv_pos_embeddings": 128,
101
+ "num_feat_extract_layers": 7,
102
+ "num_hidden_layers": 24,
103
+ "num_negatives": 100,
104
+ "output_hidden_size": 1024,
105
+ "pad_token_id": 0,
106
+ "pooling_mode": "mean",
107
+ "problem_type": "single_label_classification",
108
+ "proj_codevector_dim": 256,
109
+ "tdnn_dilation": [
110
+ 1,
111
+ 2,
112
+ 3,
113
+ 1,
114
+ 1
115
+ ],
116
+ "tdnn_dim": [
117
+ 512,
118
+ 512,
119
+ 512,
120
+ 512,
121
+ 1500
122
+ ],
123
+ "tdnn_kernel": [
124
+ 5,
125
+ 3,
126
+ 3,
127
+ 1,
128
+ 1
129
+ ],
130
+ "torch_dtype": "float32",
131
+ "transformers_version": "4.40.0.dev0",
132
+ "use_weighted_layer_sum": false,
133
+ "vocab_size": 33,
134
+ "xvector_output_dim": 512
135
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:56ad9560968a8b62033b03001b9d130e789c12a8690b7315d18e8695ed2a3ce3
3
+ size 1266030704
preprocessor_config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "do_normalize": true,
3
+ "feature_extractor_type": "Wav2Vec2FeatureExtractor",
4
+ "feature_size": 1,
5
+ "padding_side": "right",
6
+ "padding_value": 0.0,
7
+ "processor_class": "Wav2Vec2ProcessorWithLM",
8
+ "return_attention_mask": true,
9
+ "sampling_rate": 16000
10
+ }
runs/Mar29_12-50-29_instance-20240308-111517/events.out.tfevents.1711716633.instance-20240308-111517 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d52cd2ab1a3906bfb8afa3de83965208062a741c544dcf26b1ae684660300ca8
3
+ size 7407
runs/Mar29_12-55-18_instance-20240308-111517/events.out.tfevents.1711716924.instance-20240308-111517 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60c86b25b38db4e9a162311c598cd7fc33aae695dfda0c61cc0621a340f12232
3
+ size 59633
runs/Mar29_15-30-04_instance-20240308-111517/events.out.tfevents.1711726208.instance-20240308-111517 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d4193645b170b35565face620ff26510977ed0cba23a50eb4b4fee5c1741018
3
+ size 136672
runs/Mar30_13-33-42_instance-20240308-111517/events.out.tfevents.1711805628.instance-20240308-111517 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9e97688a51cd2e9e47eb7da94c2f870beba507f4386c1359a8bf5b616a62972
3
+ size 22253
runs/Mar30_14-20-51_instance-20240308-111517/events.out.tfevents.1711808455.instance-20240308-111517 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ea18a40e212202977cef8bf18399c4a8dc395e41ced745de71980f6fbf78344
3
+ size 201286
runs/Mar31_16-38-42_instance-20240308-111517/events.out.tfevents.1711903128.instance-20240308-111517 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:468f6bd5f9f143e62a1ff7d03d70c23f23f97520fb911b5840ed6ec847306c8f
3
+ size 33250
runs/Mar31_20-09-55_instance-20240308-111517/events.out.tfevents.1711915822.instance-20240308-111517 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd90d41f6f786b775b76a15029f4ecc64b0e5127eba6e652f860c934768522b9
3
+ size 113056
special_tokens_map.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": "<s>",
3
+ "eos_token": "</s>",
4
+ "pad_token": "<pad>",
5
+ "unk_token": "<unk>"
6
+ }
tokenizer_config.json ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "<pad>",
5
+ "lstrip": true,
6
+ "normalized": false,
7
+ "rstrip": true,
8
+ "single_word": false,
9
+ "special": false
10
+ },
11
+ "1": {
12
+ "content": "<s>",
13
+ "lstrip": true,
14
+ "normalized": false,
15
+ "rstrip": true,
16
+ "single_word": false,
17
+ "special": false
18
+ },
19
+ "2": {
20
+ "content": "</s>",
21
+ "lstrip": true,
22
+ "normalized": false,
23
+ "rstrip": true,
24
+ "single_word": false,
25
+ "special": false
26
+ },
27
+ "3": {
28
+ "content": "<unk>",
29
+ "lstrip": true,
30
+ "normalized": false,
31
+ "rstrip": true,
32
+ "single_word": false,
33
+ "special": false
34
+ }
35
+ },
36
+ "bos_token": "<s>",
37
+ "clean_up_tokenization_spaces": true,
38
+ "do_lower_case": false,
39
+ "eos_token": "</s>",
40
+ "model_max_length": 1000000000000000019884624838656,
41
+ "pad_token": "<pad>",
42
+ "replace_word_delimiter_char": " ",
43
+ "target_lang": null,
44
+ "tokenizer_class": "Wav2Vec2CTCTokenizer",
45
+ "unk_token": "<unk>",
46
+ "word_delimiter_token": "|"
47
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0b83a0a4b47399c4723833cadb9adfcfe916c37a1bfa9d2a04000819e677f5f
3
+ size 5048
vocab.json ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "'": 5,
3
+ "-": 6,
4
+ "</s>": 2,
5
+ "<pad>": 0,
6
+ "<s>": 1,
7
+ "<unk>": 3,
8
+ "a": 7,
9
+ "b": 8,
10
+ "c": 9,
11
+ "d": 10,
12
+ "e": 11,
13
+ "f": 12,
14
+ "g": 13,
15
+ "h": 14,
16
+ "i": 15,
17
+ "j": 16,
18
+ "k": 17,
19
+ "l": 18,
20
+ "m": 19,
21
+ "n": 20,
22
+ "o": 21,
23
+ "p": 22,
24
+ "q": 23,
25
+ "r": 24,
26
+ "s": 25,
27
+ "t": 26,
28
+ "u": 27,
29
+ "v": 28,
30
+ "w": 29,
31
+ "x": 30,
32
+ "y": 31,
33
+ "z": 32,
34
+ "|": 4
35
+ }