File size: 24,518 Bytes
6eb7465
 
 
fea22d0
 
 
 
 
 
6eb7465
fea22d0
 
 
 
 
 
6eb7465
 
 
 
 
fea22d0
6eb7465
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
---
license: apache-2.0
tags:
- generated_from_trainer
- audio
- automatic-speech-recognition
- speech
- speech-emotion-recognition
- audio-classification
widget:
- example_title: IEMOCAP clip "happy"
  src: >-
    https://cdn-media.huggingface.co/speech_samples/IEMOCAP_Ses01F_impro03_F013.wav
- example_title: IEMOCAP clip "neutral"
  src: >-
    https://cdn-media.huggingface.co/speech_samples/IEMOCAP_Ses01F_impro04_F000.wav
metrics:
- accuracy
model-index:
- name: wav2vec2-large-xlsr-53-english-ser-cosine
  results: []
pipeline_tag: audio-classification
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# wav2vec2-large-xlsr-53-english-ser-cosine

This model is a fine-tuned version of [jonatasgrosman/wav2vec2-large-xlsr-53-english](https://huggingface.co/jonatasgrosman/wav2vec2-large-xlsr-53-english) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.4677
- Accuracy: 0.8677

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001076429938136877
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- gradient_accumulation_steps: 2
- total_train_batch_size: 8
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine_with_restarts
- lr_scheduler_warmup_steps: 18
- num_epochs: 3.0
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
| 1.7885        | 0.01  | 10   | 1.7963          | 0.1791   |
| 1.7907        | 0.02  | 20   | 1.7973          | 0.2638   |
| 1.8288        | 0.02  | 30   | 1.7546          | 0.2465   |
| 1.7803        | 0.03  | 40   | 1.7500          | 0.2087   |
| 1.7941        | 0.04  | 50   | 1.6953          | 0.2950   |
| 1.7934        | 0.05  | 60   | 1.6342          | 0.3714   |
| 1.6559        | 0.06  | 70   | 1.6199          | 0.2892   |
| 1.6214        | 0.07  | 80   | 1.5400          | 0.4117   |
| 1.5226        | 0.07  | 90   | 1.3802          | 0.4519   |
| 1.4954        | 0.08  | 100  | 1.3506          | 0.4717   |
| 1.4062        | 0.09  | 110  | 1.3328          | 0.4766   |
| 1.4507        | 0.1   | 120  | 1.1985          | 0.5464   |
| 1.2812        | 0.11  | 130  | 1.2826          | 0.4922   |
| 1.1494        | 0.12  | 140  | 1.0960          | 0.6187   |
| 1.1035        | 0.12  | 150  | 1.1925          | 0.5645   |
| 1.2784        | 0.13  | 160  | 1.0955          | 0.6015   |
| 1.0302        | 0.14  | 170  | 1.0418          | 0.6072   |
| 1.0068        | 0.15  | 180  | 0.9261          | 0.6804   |
| 1.112         | 0.16  | 190  | 1.1529          | 0.5867   |
| 1.0308        | 0.16  | 200  | 0.8637          | 0.7058   |
| 1.0464        | 0.17  | 210  | 0.9205          | 0.6426   |
| 0.9531        | 0.18  | 220  | 0.9363          | 0.6886   |
| 1.0228        | 0.19  | 230  | 0.9637          | 0.6615   |
| 1.1446        | 0.2   | 240  | 1.3015          | 0.5489   |
| 1.1146        | 0.21  | 250  | 0.9328          | 0.6483   |
| 0.849         | 0.21  | 260  | 0.8504          | 0.6746   |
| 0.7977        | 0.22  | 270  | 0.9533          | 0.6697   |
| 0.9397        | 0.23  | 280  | 0.9300          | 0.7083   |
| 0.8625        | 0.24  | 290  | 1.1020          | 0.6401   |
| 1.333         | 0.25  | 300  | 0.9816          | 0.6442   |
| 1.0022        | 0.25  | 310  | 0.8472          | 0.7067   |
| 0.8002        | 0.26  | 320  | 0.7866          | 0.7149   |
| 0.8987        | 0.27  | 330  | 0.7979          | 0.6976   |
| 0.9473        | 0.28  | 340  | 0.8600          | 0.6878   |
| 0.9001        | 0.29  | 350  | 0.8141          | 0.7034   |
| 0.9793        | 0.3   | 360  | 0.9872          | 0.6450   |
| 0.9189        | 0.3   | 370  | 0.8561          | 0.6845   |
| 0.9281        | 0.31  | 380  | 0.9055          | 0.6919   |
| 0.7118        | 0.32  | 390  | 0.7937          | 0.6984   |
| 1.0565        | 0.33  | 400  | 0.7339          | 0.7313   |
| 0.8467        | 0.34  | 410  | 0.8262          | 0.6836   |
| 0.9601        | 0.35  | 420  | 0.7464          | 0.7346   |
| 0.8911        | 0.35  | 430  | 0.7229          | 0.7338   |
| 0.9033        | 0.36  | 440  | 0.7393          | 0.7223   |
| 0.8961        | 0.37  | 450  | 0.7272          | 0.7428   |
| 0.7216        | 0.38  | 460  | 0.7183          | 0.7436   |
| 0.6935        | 0.39  | 470  | 0.8003          | 0.7083   |
| 0.7588        | 0.39  | 480  | 0.8471          | 0.7116   |
| 0.8766        | 0.4   | 490  | 0.6976          | 0.7379   |
| 0.6866        | 0.41  | 500  | 0.6806          | 0.7584   |
| 0.6822        | 0.42  | 510  | 0.7669          | 0.7256   |
| 0.7067        | 0.43  | 520  | 0.6885          | 0.7461   |
| 0.6159        | 0.44  | 530  | 0.7020          | 0.7535   |
| 0.8814        | 0.44  | 540  | 0.7478          | 0.7256   |
| 0.7786        | 0.45  | 550  | 0.6302          | 0.7691   |
| 0.6363        | 0.46  | 560  | 0.6745          | 0.7691   |
| 0.8518        | 0.47  | 570  | 0.6242          | 0.7666   |
| 0.8194        | 0.48  | 580  | 0.7154          | 0.7379   |
| 0.6755        | 0.49  | 590  | 0.7056          | 0.7543   |
| 0.7743        | 0.49  | 600  | 0.6823          | 0.7486   |
| 0.6457        | 0.5   | 610  | 0.7160          | 0.7502   |
| 0.4976        | 0.51  | 620  | 0.8222          | 0.7149   |
| 0.929         | 0.52  | 630  | 0.7318          | 0.7371   |
| 0.7981        | 0.53  | 640  | 0.7417          | 0.7461   |
| 0.7243        | 0.53  | 650  | 0.6831          | 0.7461   |
| 0.7332        | 0.54  | 660  | 0.6273          | 0.7592   |
| 0.7827        | 0.55  | 670  | 0.6158          | 0.7724   |
| 0.7733        | 0.56  | 680  | 0.7515          | 0.7371   |
| 0.8527        | 0.57  | 690  | 0.7200          | 0.7412   |
| 0.8355        | 0.58  | 700  | 0.7738          | 0.7436   |
| 0.5383        | 0.58  | 710  | 0.9081          | 0.7132   |
| 1.0851        | 0.59  | 720  | 0.6135          | 0.7831   |
| 0.7345        | 0.6   | 730  | 0.7032          | 0.7642   |
| 0.6648        | 0.61  | 740  | 0.6146          | 0.7781   |
| 0.612         | 0.62  | 750  | 0.6338          | 0.7732   |
| 0.6101        | 0.62  | 760  | 0.6772          | 0.7740   |
| 0.6498        | 0.63  | 770  | 0.7153          | 0.7601   |
| 0.6258        | 0.64  | 780  | 0.7871          | 0.7329   |
| 0.7943        | 0.65  | 790  | 0.6975          | 0.7691   |
| 0.8176        | 0.66  | 800  | 0.7692          | 0.7313   |
| 0.6682        | 0.67  | 810  | 0.5766          | 0.8012   |
| 0.4808        | 0.67  | 820  | 0.5882          | 0.7847   |
| 0.6331        | 0.68  | 830  | 0.5855          | 0.7896   |
| 0.874         | 0.69  | 840  | 0.7082          | 0.7568   |
| 0.8984        | 0.7   | 850  | 0.6078          | 0.7732   |
| 0.5861        | 0.71  | 860  | 0.6469          | 0.7814   |
| 0.6896        | 0.72  | 870  | 0.6997          | 0.7560   |
| 0.8237        | 0.72  | 880  | 0.6279          | 0.7650   |
| 0.5818        | 0.73  | 890  | 0.6763          | 0.7691   |
| 0.4781        | 0.74  | 900  | 0.6867          | 0.7592   |
| 0.6851        | 0.75  | 910  | 0.6142          | 0.7724   |
| 0.455         | 0.76  | 920  | 0.9159          | 0.7141   |
| 0.808         | 0.76  | 930  | 0.7518          | 0.7617   |
| 1.0634        | 0.77  | 940  | 0.6015          | 0.7839   |
| 0.6956        | 0.78  | 950  | 0.5895          | 0.7872   |
| 0.5169        | 0.79  | 960  | 0.6394          | 0.7773   |
| 0.6213        | 0.8   | 970  | 0.6890          | 0.7699   |
| 0.5506        | 0.81  | 980  | 0.7471          | 0.7560   |
| 0.6233        | 0.81  | 990  | 0.6525          | 0.7872   |
| 0.7666        | 0.82  | 1000 | 0.8002          | 0.7403   |
| 0.5644        | 0.83  | 1010 | 0.7067          | 0.7387   |
| 0.6038        | 0.84  | 1020 | 0.6091          | 0.7823   |
| 0.6211        | 0.85  | 1030 | 0.6749          | 0.7707   |
| 0.6758        | 0.86  | 1040 | 0.7102          | 0.7502   |
| 0.7353        | 0.86  | 1050 | 0.6959          | 0.7560   |
| 0.5687        | 0.87  | 1060 | 0.6831          | 0.7675   |
| 0.5606        | 0.88  | 1070 | 0.5945          | 0.7847   |
| 0.7309        | 0.89  | 1080 | 0.6737          | 0.7412   |
| 0.5951        | 0.9   | 1090 | 0.6574          | 0.7675   |
| 0.6062        | 0.9   | 1100 | 0.6740          | 0.7502   |
| 0.9606        | 0.91  | 1110 | 0.5730          | 0.7839   |
| 0.6625        | 0.92  | 1120 | 0.5922          | 0.7749   |
| 0.7908        | 0.93  | 1130 | 0.5652          | 0.7823   |
| 0.6387        | 0.94  | 1140 | 0.5268          | 0.8118   |
| 0.7141        | 0.95  | 1150 | 0.5628          | 0.7896   |
| 0.5587        | 0.95  | 1160 | 0.6479          | 0.7609   |
| 0.4817        | 0.96  | 1170 | 0.5410          | 0.8044   |
| 0.4444        | 0.97  | 1180 | 0.5950          | 0.8044   |
| 0.6776        | 0.98  | 1190 | 0.5993          | 0.8012   |
| 0.5989        | 0.99  | 1200 | 0.5745          | 0.7987   |
| 0.6334        | 1.0   | 1210 | 0.6220          | 0.7913   |
| 0.5216        | 1.0   | 1220 | 0.5936          | 0.7938   |
| 0.5127        | 1.01  | 1230 | 0.6741          | 0.7839   |
| 0.5632        | 1.02  | 1240 | 0.6501          | 0.7954   |
| 0.5335        | 1.03  | 1250 | 0.5721          | 0.8061   |
| 0.511         | 1.04  | 1260 | 0.5630          | 0.8102   |
| 0.5424        | 1.04  | 1270 | 0.5396          | 0.8135   |
| 0.771         | 1.05  | 1280 | 0.5580          | 0.8012   |
| 0.435         | 1.06  | 1290 | 0.5764          | 0.8036   |
| 0.5203        | 1.07  | 1300 | 0.6032          | 0.7913   |
| 0.4689        | 1.08  | 1310 | 0.6431          | 0.7872   |
| 0.481         | 1.09  | 1320 | 0.6019          | 0.7987   |
| 0.5938        | 1.09  | 1330 | 0.6198          | 0.7938   |
| 0.3972        | 1.1   | 1340 | 0.5842          | 0.8061   |
| 0.368         | 1.11  | 1350 | 0.5066          | 0.8127   |
| 0.4644        | 1.12  | 1360 | 0.6058          | 0.8012   |
| 0.6914        | 1.13  | 1370 | 0.5384          | 0.8217   |
| 0.3341        | 1.13  | 1380 | 0.5535          | 0.8143   |
| 0.5301        | 1.14  | 1390 | 0.5916          | 0.8020   |
| 0.5294        | 1.15  | 1400 | 0.6297          | 0.7938   |
| 0.7029        | 1.16  | 1410 | 0.5581          | 0.8102   |
| 0.322         | 1.17  | 1420 | 0.6066          | 0.7831   |
| 0.6871        | 1.18  | 1430 | 0.5141          | 0.8151   |
| 0.4026        | 1.18  | 1440 | 0.6888          | 0.7716   |
| 0.4484        | 1.19  | 1450 | 0.5499          | 0.8077   |
| 0.3767        | 1.2   | 1460 | 0.4825          | 0.8225   |
| 0.4274        | 1.21  | 1470 | 0.4932          | 0.8274   |
| 0.4584        | 1.22  | 1480 | 0.5168          | 0.8299   |
| 0.5741        | 1.23  | 1490 | 0.6384          | 0.7798   |
| 0.3877        | 1.23  | 1500 | 0.5789          | 0.8044   |
| 0.3734        | 1.24  | 1510 | 0.6415          | 0.7855   |
| 0.7986        | 1.25  | 1520 | 0.5575          | 0.8077   |
| 0.5634        | 1.26  | 1530 | 0.5684          | 0.8143   |
| 0.5136        | 1.27  | 1540 | 0.5393          | 0.8143   |
| 0.5331        | 1.27  | 1550 | 0.5203          | 0.8176   |
| 0.2918        | 1.28  | 1560 | 0.5510          | 0.8151   |
| 0.4425        | 1.29  | 1570 | 0.5783          | 0.8094   |
| 0.4245        | 1.3   | 1580 | 0.5433          | 0.8209   |
| 0.3317        | 1.31  | 1590 | 0.5845          | 0.8085   |
| 0.4583        | 1.32  | 1600 | 0.6147          | 0.7954   |
| 0.3298        | 1.32  | 1610 | 0.6249          | 0.8053   |
| 0.5248        | 1.33  | 1620 | 0.5722          | 0.8094   |
| 0.665         | 1.34  | 1630 | 0.5446          | 0.8217   |
| 0.3917        | 1.35  | 1640 | 0.5316          | 0.8258   |
| 0.4321        | 1.36  | 1650 | 0.5598          | 0.8217   |
| 0.3005        | 1.37  | 1660 | 0.6190          | 0.8151   |
| 0.4992        | 1.37  | 1670 | 0.5546          | 0.8184   |
| 0.586         | 1.38  | 1680 | 0.6416          | 0.7913   |
| 0.6481        | 1.39  | 1690 | 0.5324          | 0.8135   |
| 0.4008        | 1.4   | 1700 | 0.5786          | 0.8012   |
| 0.3463        | 1.41  | 1710 | 0.5145          | 0.8209   |
| 0.4994        | 1.41  | 1720 | 0.5650          | 0.8192   |
| 0.4093        | 1.42  | 1730 | 0.5191          | 0.8365   |
| 0.6375        | 1.43  | 1740 | 0.5734          | 0.8135   |
| 0.2303        | 1.44  | 1750 | 0.5447          | 0.8102   |
| 0.4824        | 1.45  | 1760 | 0.5139          | 0.8250   |
| 0.5439        | 1.46  | 1770 | 0.4979          | 0.8258   |
| 0.4751        | 1.46  | 1780 | 0.4896          | 0.8340   |
| 0.534         | 1.47  | 1790 | 0.4656          | 0.8348   |
| 0.4526        | 1.48  | 1800 | 0.5322          | 0.8316   |
| 0.4618        | 1.49  | 1810 | 0.5216          | 0.8233   |
| 0.3825        | 1.5   | 1820 | 0.4792          | 0.8225   |
| 0.4557        | 1.5   | 1830 | 0.5071          | 0.8118   |
| 0.5725        | 1.51  | 1840 | 0.5152          | 0.8102   |
| 0.7004        | 1.52  | 1850 | 0.5080          | 0.8217   |
| 0.4367        | 1.53  | 1860 | 0.4920          | 0.8357   |
| 0.3682        | 1.54  | 1870 | 0.5253          | 0.8299   |
| 0.4411        | 1.55  | 1880 | 0.6186          | 0.8069   |
| 0.5391        | 1.55  | 1890 | 0.5074          | 0.8283   |
| 0.4673        | 1.56  | 1900 | 0.4858          | 0.8398   |
| 0.3542        | 1.57  | 1910 | 0.4767          | 0.8381   |
| 0.6483        | 1.58  | 1920 | 0.4694          | 0.8373   |
| 0.3837        | 1.59  | 1930 | 0.4678          | 0.8472   |
| 0.363         | 1.6   | 1940 | 0.4684          | 0.8463   |
| 0.6446        | 1.6   | 1950 | 0.4696          | 0.8365   |
| 0.5627        | 1.61  | 1960 | 0.4651          | 0.8472   |
| 0.3733        | 1.62  | 1970 | 0.5138          | 0.8291   |
| 0.5972        | 1.63  | 1980 | 0.5244          | 0.8250   |
| 0.2388        | 1.64  | 1990 | 0.5020          | 0.8266   |
| 0.6279        | 1.64  | 2000 | 0.5865          | 0.8118   |
| 0.5827        | 1.65  | 2010 | 0.5717          | 0.8176   |
| 0.4598        | 1.66  | 2020 | 0.4691          | 0.8439   |
| 0.3817        | 1.67  | 2030 | 0.5084          | 0.8340   |
| 0.2973        | 1.68  | 2040 | 0.4568          | 0.8447   |
| 0.4039        | 1.69  | 2050 | 0.4681          | 0.8505   |
| 0.4572        | 1.69  | 2060 | 0.4718          | 0.8389   |
| 0.3481        | 1.7   | 2070 | 0.4849          | 0.8283   |
| 0.4553        | 1.71  | 2080 | 0.4574          | 0.8414   |
| 0.4055        | 1.72  | 2090 | 0.4640          | 0.8463   |
| 0.4384        | 1.73  | 2100 | 0.5049          | 0.8431   |
| 0.5593        | 1.74  | 2110 | 0.5192          | 0.8513   |
| 0.3486        | 1.74  | 2120 | 0.4764          | 0.8480   |
| 0.4698        | 1.75  | 2130 | 0.4858          | 0.8447   |
| 0.211         | 1.76  | 2140 | 0.4976          | 0.8398   |
| 0.5209        | 1.77  | 2150 | 0.4934          | 0.8472   |
| 0.4281        | 1.78  | 2160 | 0.4714          | 0.8578   |
| 0.3902        | 1.78  | 2170 | 0.4863          | 0.8463   |
| 0.3083        | 1.79  | 2180 | 0.4807          | 0.8431   |
| 0.4642        | 1.8   | 2190 | 0.4712          | 0.8472   |
| 0.2382        | 1.81  | 2200 | 0.4641          | 0.8513   |
| 0.4154        | 1.82  | 2210 | 0.4900          | 0.8447   |
| 0.3637        | 1.83  | 2220 | 0.4790          | 0.8488   |
| 0.4864        | 1.83  | 2230 | 0.4742          | 0.8513   |
| 0.5024        | 1.84  | 2240 | 0.4803          | 0.8529   |
| 0.4139        | 1.85  | 2250 | 0.4672          | 0.8521   |
| 0.4131        | 1.86  | 2260 | 0.4895          | 0.8431   |
| 0.4851        | 1.87  | 2270 | 0.4432          | 0.8529   |
| 0.3846        | 1.88  | 2280 | 0.4417          | 0.8422   |
| 0.3778        | 1.88  | 2290 | 0.4477          | 0.8439   |
| 0.4128        | 1.89  | 2300 | 0.4336          | 0.8513   |
| 0.3755        | 1.9   | 2310 | 0.4678          | 0.8439   |
| 0.4672        | 1.91  | 2320 | 0.4740          | 0.8373   |
| 0.5216        | 1.92  | 2330 | 0.4343          | 0.8472   |
| 0.3469        | 1.92  | 2340 | 0.4542          | 0.8316   |
| 0.3283        | 1.93  | 2350 | 0.4587          | 0.8447   |
| 0.3495        | 1.94  | 2360 | 0.5050          | 0.8348   |
| 0.4518        | 1.95  | 2370 | 0.5309          | 0.8266   |
| 0.3023        | 1.96  | 2380 | 0.5113          | 0.8332   |
| 0.4014        | 1.97  | 2390 | 0.4989          | 0.8332   |
| 0.4963        | 1.97  | 2400 | 0.4539          | 0.8505   |
| 0.3421        | 1.98  | 2410 | 0.4889          | 0.8455   |
| 0.4126        | 1.99  | 2420 | 0.4696          | 0.8463   |
| 0.479         | 2.0   | 2430 | 0.4498          | 0.8513   |
| 0.3319        | 2.01  | 2440 | 0.4686          | 0.8488   |
| 0.2787        | 2.01  | 2450 | 0.4650          | 0.8447   |
| 0.2105        | 2.02  | 2460 | 0.4665          | 0.8505   |
| 0.4944        | 2.03  | 2470 | 0.4667          | 0.8488   |
| 0.2236        | 2.04  | 2480 | 0.4678          | 0.8463   |
| 0.3076        | 2.05  | 2490 | 0.4621          | 0.8513   |
| 0.2813        | 2.06  | 2500 | 0.4451          | 0.8562   |
| 0.2207        | 2.06  | 2510 | 0.4559          | 0.8562   |
| 0.3693        | 2.07  | 2520 | 0.4634          | 0.8513   |
| 0.3682        | 2.08  | 2530 | 0.4390          | 0.8562   |
| 0.2618        | 2.09  | 2540 | 0.4417          | 0.8529   |
| 0.3139        | 2.1   | 2550 | 0.4618          | 0.8529   |
| 0.1739        | 2.11  | 2560 | 0.4938          | 0.8488   |
| 0.4258        | 2.11  | 2570 | 0.4574          | 0.8496   |
| 0.2136        | 2.12  | 2580 | 0.4495          | 0.8529   |
| 0.2625        | 2.13  | 2590 | 0.4555          | 0.8570   |
| 0.3161        | 2.14  | 2600 | 0.4696          | 0.8537   |
| 0.2515        | 2.15  | 2610 | 0.4649          | 0.8661   |
| 0.3097        | 2.15  | 2620 | 0.4474          | 0.8685   |
| 0.3544        | 2.16  | 2630 | 0.4458          | 0.8603   |
| 0.2967        | 2.17  | 2640 | 0.4555          | 0.8669   |
| 0.4015        | 2.18  | 2650 | 0.4486          | 0.8652   |
| 0.079         | 2.19  | 2660 | 0.4624          | 0.8620   |
| 0.1754        | 2.2   | 2670 | 0.4805          | 0.8587   |
| 0.1854        | 2.2   | 2680 | 0.4803          | 0.8628   |
| 0.3181        | 2.21  | 2690 | 0.4792          | 0.8595   |
| 0.0808        | 2.22  | 2700 | 0.4740          | 0.8628   |
| 0.2027        | 2.23  | 2710 | 0.4846          | 0.8587   |
| 0.3211        | 2.24  | 2720 | 0.5074          | 0.8505   |
| 0.2448        | 2.25  | 2730 | 0.5276          | 0.8414   |
| 0.3618        | 2.25  | 2740 | 0.5133          | 0.8488   |
| 0.1822        | 2.26  | 2750 | 0.5002          | 0.8578   |
| 0.3095        | 2.27  | 2760 | 0.4827          | 0.8603   |
| 0.0762        | 2.28  | 2770 | 0.4792          | 0.8644   |
| 0.187         | 2.29  | 2780 | 0.4897          | 0.8644   |
| 0.5779        | 2.29  | 2790 | 0.4901          | 0.8652   |
| 0.292         | 2.3   | 2800 | 0.4764          | 0.8603   |
| 0.1865        | 2.31  | 2810 | 0.4798          | 0.8644   |
| 0.3594        | 2.32  | 2820 | 0.4837          | 0.8620   |
| 0.421         | 2.33  | 2830 | 0.4812          | 0.8562   |
| 0.1173        | 2.34  | 2840 | 0.4708          | 0.8603   |
| 0.278         | 2.34  | 2850 | 0.4693          | 0.8685   |
| 0.2294        | 2.35  | 2860 | 0.4724          | 0.8628   |
| 0.243         | 2.36  | 2870 | 0.4749          | 0.8620   |
| 0.3979        | 2.37  | 2880 | 0.4633          | 0.8628   |
| 0.4518        | 2.38  | 2890 | 0.4603          | 0.8669   |
| 0.2739        | 2.38  | 2900 | 0.4625          | 0.8685   |
| 0.1782        | 2.39  | 2910 | 0.4652          | 0.8677   |
| 0.3536        | 2.4   | 2920 | 0.4613          | 0.8644   |
| 0.0904        | 2.41  | 2930 | 0.4642          | 0.8611   |
| 0.2315        | 2.42  | 2940 | 0.4613          | 0.8661   |
| 0.1236        | 2.43  | 2950 | 0.4628          | 0.8652   |
| 0.1842        | 2.43  | 2960 | 0.4706          | 0.8620   |
| 0.2414        | 2.44  | 2970 | 0.4683          | 0.8652   |
| 0.3419        | 2.45  | 2980 | 0.4645          | 0.8677   |
| 0.2877        | 2.46  | 2990 | 0.4657          | 0.8636   |
| 0.2524        | 2.47  | 3000 | 0.4701          | 0.8652   |
| 0.1731        | 2.48  | 3010 | 0.4733          | 0.8644   |
| 0.1731        | 2.48  | 3020 | 0.4830          | 0.8595   |
| 0.0921        | 2.49  | 3030 | 0.4904          | 0.8603   |
| 0.1593        | 2.5   | 3040 | 0.4836          | 0.8595   |
| 0.467         | 2.51  | 3050 | 0.4706          | 0.8628   |
| 0.4225        | 2.52  | 3060 | 0.4598          | 0.8644   |
| 0.1251        | 2.52  | 3070 | 0.4511          | 0.8694   |
| 0.2181        | 2.53  | 3080 | 0.4487          | 0.8735   |
| 0.2247        | 2.54  | 3090 | 0.4452          | 0.8767   |
| 0.3722        | 2.55  | 3100 | 0.4469          | 0.8759   |
| 0.1069        | 2.56  | 3110 | 0.4536          | 0.8735   |
| 0.2174        | 2.57  | 3120 | 0.4571          | 0.8710   |
| 0.2586        | 2.57  | 3130 | 0.4626          | 0.8685   |
| 0.2803        | 2.58  | 3140 | 0.4665          | 0.8677   |
| 0.4484        | 2.59  | 3150 | 0.4581          | 0.8694   |
| 0.3104        | 2.6   | 3160 | 0.4539          | 0.8735   |
| 0.2411        | 2.61  | 3170 | 0.4531          | 0.8726   |
| 0.2157        | 2.62  | 3180 | 0.4565          | 0.8694   |
| 0.2342        | 2.62  | 3190 | 0.4549          | 0.8694   |
| 0.2921        | 2.63  | 3200 | 0.4570          | 0.8677   |
| 0.1988        | 2.64  | 3210 | 0.4590          | 0.8677   |
| 0.2142        | 2.65  | 3220 | 0.4601          | 0.8661   |
| 0.1666        | 2.66  | 3230 | 0.4652          | 0.8661   |
| 0.2296        | 2.66  | 3240 | 0.4709          | 0.8611   |
| 0.3847        | 2.67  | 3250 | 0.4676          | 0.8636   |
| 0.4149        | 2.68  | 3260 | 0.4654          | 0.8636   |
| 0.2602        | 2.69  | 3270 | 0.4614          | 0.8661   |
| 0.3786        | 2.7   | 3280 | 0.4605          | 0.8661   |
| 0.3509        | 2.71  | 3290 | 0.4590          | 0.8661   |
| 0.2254        | 2.71  | 3300 | 0.4564          | 0.8677   |
| 0.1775        | 2.72  | 3310 | 0.4553          | 0.8694   |
| 0.2269        | 2.73  | 3320 | 0.4546          | 0.8669   |
| 0.1792        | 2.74  | 3330 | 0.4549          | 0.8644   |
| 0.1107        | 2.75  | 3340 | 0.4580          | 0.8661   |
| 0.2062        | 2.75  | 3350 | 0.4598          | 0.8636   |
| 0.1641        | 2.76  | 3360 | 0.4621          | 0.8652   |
| 0.18          | 2.77  | 3370 | 0.4651          | 0.8652   |
| 0.0959        | 2.78  | 3380 | 0.4673          | 0.8661   |
| 0.217         | 2.79  | 3390 | 0.4672          | 0.8652   |
| 0.3293        | 2.8   | 3400 | 0.4673          | 0.8644   |
| 0.2691        | 2.8   | 3410 | 0.4669          | 0.8644   |
| 0.1945        | 2.81  | 3420 | 0.4659          | 0.8652   |
| 0.2712        | 2.82  | 3430 | 0.4660          | 0.8677   |
| 0.2287        | 2.83  | 3440 | 0.4663          | 0.8677   |
| 0.2103        | 2.84  | 3450 | 0.4661          | 0.8669   |
| 0.2713        | 2.85  | 3460 | 0.4663          | 0.8669   |
| 0.3182        | 2.85  | 3470 | 0.4665          | 0.8677   |
| 0.1698        | 2.86  | 3480 | 0.4668          | 0.8669   |
| 0.2663        | 2.87  | 3490 | 0.4669          | 0.8677   |
| 0.2091        | 2.88  | 3500 | 0.4670          | 0.8685   |
| 0.1406        | 2.89  | 3510 | 0.4677          | 0.8669   |
| 0.16          | 2.89  | 3520 | 0.4682          | 0.8661   |
| 0.1413        | 2.9   | 3530 | 0.4686          | 0.8661   |
| 0.3499        | 2.91  | 3540 | 0.4690          | 0.8661   |
| 0.205         | 2.92  | 3550 | 0.4688          | 0.8661   |
| 0.3849        | 2.93  | 3560 | 0.4684          | 0.8661   |
| 0.209         | 2.94  | 3570 | 0.4680          | 0.8669   |
| 0.1985        | 2.94  | 3580 | 0.4678          | 0.8677   |
| 0.1989        | 2.95  | 3590 | 0.4678          | 0.8677   |
| 0.2031        | 2.96  | 3600 | 0.4677          | 0.8677   |
| 0.2401        | 2.97  | 3610 | 0.4677          | 0.8677   |
| 0.2717        | 2.98  | 3620 | 0.4678          | 0.8677   |
| 0.2821        | 2.99  | 3630 | 0.4678          | 0.8677   |
| 0.1735        | 2.99  | 3640 | 0.4677          | 0.8677   |


### Framework versions

- Transformers 4.40.0.dev0
- Pytorch 2.2.1+cu121
- Datasets 2.18.1.dev0
- Tokenizers 0.15.2