File size: 21,659 Bytes
bbd05c0
69eedea
 
 
 
 
 
 
bbd05c0
 
69eedea
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
---
tags:
- vision
- image-segmentation
- generated_from_trainer
model-index:
- name: kelp-from-scratch-segformer-b1-lr-0.0001-cleaned
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# kelp-from-scratch-segformer-b1-lr-0.0001-cleaned

This model is a fine-tuned version of [](https://huggingface.co/) on the samitizerxu/kelp_data_rgbagg_swin_nir_int_cleaned dataset.
It achieves the following results on the evaluation set:
- Iou Kelp: 0.1757
- Loss: 0.7377

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 22
- eval_batch_size: 22
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- num_epochs: 50

### Training results

| Training Loss | Epoch | Step | Iou Kelp | Validation Loss |
|:-------------:|:-----:|:----:|:--------:|:---------------:|
| 0.9943        | 0.15  | 30   | 0.0093   | 0.9841          |
| 0.9987        | 0.3   | 60   | 0.0091   | 0.9797          |
| 0.9912        | 0.46  | 90   | 0.0093   | 0.9822          |
| 0.9809        | 0.61  | 120  | 0.0089   | 0.9788          |
| 0.9882        | 0.76  | 150  | 0.0096   | 0.9791          |
| 0.9804        | 0.91  | 180  | 0.0070   | 0.9799          |
| 0.9987        | 1.07  | 210  | 0.0104   | 0.9275          |
| 0.997         | 1.22  | 240  | 0.0086   | 0.9696          |
| 0.8985        | 1.37  | 270  | 0.0086   | 0.9513          |
| 0.9921        | 1.52  | 300  | 0.0234   | 0.8703          |
| 0.9656        | 1.68  | 330  | 0.0115   | 0.9610          |
| 0.9229        | 1.83  | 360  | 0.0235   | 0.8871          |
| 0.9999        | 1.98  | 390  | 0.0117   | 0.9416          |
| 0.8409        | 2.13  | 420  | 0.0172   | 0.9212          |
| 0.9533        | 2.28  | 450  | 0.0322   | 0.8209          |
| 0.9815        | 2.44  | 480  | 0.0167   | 0.9070          |
| 0.9567        | 2.59  | 510  | 0.0314   | 0.8028          |
| 0.9747        | 2.74  | 540  | 0.0300   | 0.8489          |
| 0.983         | 2.89  | 570  | 0.0176   | 0.9069          |
| 0.963         | 3.05  | 600  | 0.0312   | 0.8878          |
| 0.9616        | 3.2   | 630  | 0.0249   | 0.8482          |
| 0.9395        | 3.35  | 660  | 0.0418   | 0.7781          |
| 0.8966        | 3.5   | 690  | 0.0155   | 0.8981          |
| 0.9939        | 3.65  | 720  | 0.0219   | 0.8737          |
| 0.9895        | 3.81  | 750  | 0.0107   | 0.9480          |
| 0.9434        | 3.96  | 780  | 0.0266   | 0.8413          |
| 0.9813        | 4.11  | 810  | 0.0323   | 0.8320          |
| 0.9051        | 4.26  | 840  | 0.0379   | 0.8097          |
| 0.9629        | 4.42  | 870  | 0.0447   | 0.7619          |
| 0.9067        | 4.57  | 900  | 0.0330   | 0.8137          |
| 0.9245        | 4.72  | 930  | 0.0253   | 0.8327          |
| 1.0           | 4.87  | 960  | 0.0273   | 0.8226          |
| 0.9869        | 5.03  | 990  | 0.0182   | 0.8993          |
| 0.9236        | 5.18  | 1020 | 0.0390   | 0.7772          |
| 0.9487        | 5.33  | 1050 | 0.0433   | 0.7845          |
| 0.9085        | 5.48  | 1080 | 0.0181   | 0.9285          |
| 0.9518        | 5.63  | 1110 | 0.0514   | 0.7551          |
| 0.9768        | 5.79  | 1140 | 0.0344   | 0.8475          |
| 0.8779        | 5.94  | 1170 | 0.0123   | 0.9069          |
| 0.9556        | 6.09  | 1200 | 0.0183   | 0.9066          |
| 0.8875        | 6.24  | 1230 | 0.1934   | 0.7787          |
| 0.9932        | 6.4   | 1260 | 0.0543   | 0.8902          |
| 0.9991        | 6.55  | 1290 | 0.0467   | 0.7678          |
| 0.9654        | 6.7   | 1320 | 0.0420   | 0.8434          |
| 0.9794        | 6.85  | 1350 | 0.0190   | 0.9163          |
| 0.9659        | 7.01  | 1380 | 0.0345   | 0.9441          |
| 0.8959        | 7.16  | 1410 | 0.0255   | 0.8717          |
| 0.9775        | 7.31  | 1440 | 0.0296   | 0.9072          |
| 0.9406        | 7.46  | 1470 | 0.0331   | 0.8282          |
| 0.9702        | 7.61  | 1500 | 0.0283   | 0.8532          |
| 0.9828        | 7.77  | 1530 | 0.0164   | 0.8719          |
| 0.9511        | 7.92  | 1560 | 0.0248   | 0.8392          |
| 0.9046        | 8.07  | 1590 | 0.0116   | 0.9260          |
| 0.9508        | 8.22  | 1620 | 0.0243   | 0.8499          |
| 0.9535        | 8.38  | 1650 | 0.0185   | 0.8567          |
| 0.9586        | 8.53  | 1680 | 0.0176   | 0.8867          |
| 0.947         | 8.68  | 1710 | 0.0296   | 0.7973          |
| 0.9404        | 8.83  | 1740 | 0.0137   | 0.8879          |
| 1.0           | 8.98  | 1770 | 0.0227   | 0.8902          |
| 0.9618        | 9.14  | 1800 | 0.0419   | 0.8119          |
| 0.8463        | 9.29  | 1830 | 0.0500   | 0.8065          |
| 0.9683        | 9.44  | 1860 | 0.0136   | 0.9266          |
| 0.9087        | 9.59  | 1890 | 0.0357   | 0.8041          |
| 0.946         | 9.75  | 1920 | 0.0426   | 0.8023          |
| 0.9723        | 9.9   | 1950 | 0.0470   | 0.7823          |
| 0.9487        | 10.05 | 1980 | 0.0218   | 0.8771          |
| 0.9483        | 10.2  | 2010 | 0.0265   | 0.8317          |
| 0.9678        | 10.36 | 2040 | 0.0512   | 0.7447          |
| 0.9909        | 10.51 | 2070 | 0.0266   | 0.8505          |
| 0.9688        | 10.66 | 2100 | 0.0315   | 0.8457          |
| 0.9617        | 10.81 | 2130 | 0.0388   | 0.7916          |
| 0.9105        | 10.96 | 2160 | 0.0641   | 0.7939          |
| 0.9447        | 11.12 | 2190 | 0.0338   | 0.8046          |
| 0.9127        | 11.27 | 2220 | 0.0883   | 0.7771          |
| 0.9151        | 11.42 | 2250 | 0.0285   | 0.8568          |
| 0.9339        | 11.57 | 2280 | 0.0773   | 0.7554          |
| 1.0           | 11.73 | 2310 | 0.0452   | 0.7623          |
| 0.9428        | 11.88 | 2340 | 0.0147   | 0.9230          |
| 1.0           | 12.03 | 2370 | 0.0266   | 0.8265          |
| 0.9432        | 12.18 | 2400 | 0.0284   | 0.8732          |
| 0.9436        | 12.34 | 2430 | 0.0398   | 0.7938          |
| 0.9772        | 12.49 | 2460 | 0.0345   | 0.8073          |
| 0.9552        | 12.64 | 2490 | 0.0125   | 0.9084          |
| 1.0           | 12.79 | 2520 | 0.0255   | 0.8099          |
| 0.953         | 12.94 | 2550 | 0.0694   | 0.7384          |
| 0.9225        | 13.1  | 2580 | 0.0286   | 0.8104          |
| 0.9119        | 13.25 | 2610 | 0.0312   | 0.8538          |
| 0.9726        | 13.4  | 2640 | 0.0511   | 0.7505          |
| 0.9674        | 13.55 | 2670 | 0.0504   | 0.7473          |
| 0.972         | 13.71 | 2700 | 0.0496   | 0.8009          |
| 0.9238        | 13.86 | 2730 | 0.0179   | 0.8479          |
| 0.9535        | 14.01 | 2760 | 0.1306   | 0.7997          |
| 0.9509        | 14.16 | 2790 | 0.0254   | 0.8065          |
| 0.8756        | 14.31 | 2820 | 0.0584   | 0.7479          |
| 0.9335        | 14.47 | 2850 | 0.0297   | 0.7988          |
| 0.956         | 14.62 | 2880 | 0.0311   | 0.8155          |
| 0.9544        | 14.77 | 2910 | 0.0526   | 0.8159          |
| 0.8577        | 14.92 | 2940 | 0.0770   | 0.7906          |
| 0.965         | 15.08 | 2970 | 0.0709   | 0.7446          |
| 0.987         | 15.23 | 3000 | 0.0479   | 0.7767          |
| 0.9692        | 15.38 | 3030 | 0.0895   | 0.8900          |
| 0.9602        | 15.53 | 3060 | 0.1262   | 0.8408          |
| 0.9586        | 15.69 | 3090 | 0.0643   | 0.7370          |
| 0.8871        | 15.84 | 3120 | 0.1753   | 0.7848          |
| 0.9259        | 15.99 | 3150 | 0.1110   | 0.7571          |
| 0.9463        | 16.14 | 3180 | 0.0651   | 0.7799          |
| 0.9489        | 16.29 | 3210 | 0.0627   | 0.7776          |
| 0.9814        | 16.45 | 3240 | 0.0476   | 0.7595          |
| 0.926         | 16.6  | 3270 | 0.0588   | 0.7354          |
| 0.8921        | 16.75 | 3300 | 0.0608   | 0.7637          |
| 0.9722        | 16.9  | 3330 | 0.0404   | 0.7916          |
| 0.9535        | 17.06 | 3360 | 0.0520   | 0.8781          |
| 0.9442        | 17.21 | 3390 | 0.0326   | 0.8189          |
| 0.945         | 17.36 | 3420 | 0.1141   | 0.8753          |
| 0.9799        | 17.51 | 3450 | 0.0678   | 0.7472          |
| 0.8504        | 17.66 | 3480 | 0.1633   | 0.8211          |
| 1.0           | 17.82 | 3510 | 0.0479   | 0.7849          |
| 0.9681        | 17.97 | 3540 | 0.0585   | 0.7741          |
| 0.9492        | 18.12 | 3570 | 0.0656   | 0.7374          |
| 0.9481        | 18.27 | 3600 | 0.0817   | 0.7382          |
| 0.9405        | 18.43 | 3630 | 0.0805   | 0.9278          |
| 0.8967        | 18.58 | 3660 | 0.0457   | 0.7692          |
| 0.9215        | 18.73 | 3690 | 0.0615   | 0.8308          |
| 0.9722        | 18.88 | 3720 | 0.1454   | 0.8367          |
| 0.9352        | 19.04 | 3750 | 0.1014   | 0.7641          |
| 0.9581        | 19.19 | 3780 | 0.1549   | 0.8425          |
| 0.9438        | 19.34 | 3810 | 0.0689   | 0.7524          |
| 0.976         | 19.49 | 3840 | 0.1321   | 0.8181          |
| 0.9248        | 19.64 | 3870 | 0.1782   | 0.8164          |
| 0.9114        | 19.8  | 3900 | 0.1553   | 0.7879          |
| 0.8975        | 19.95 | 3930 | 0.1875   | 0.7522          |
| 0.9696        | 20.1  | 3960 | 0.1521   | 0.8031          |
| 0.9217        | 20.25 | 3990 | 0.0667   | 0.7436          |
| 0.9375        | 20.41 | 4020 | 0.0902   | 0.9042          |
| 0.886         | 20.56 | 4050 | 0.0672   | 0.7541          |
| 0.9647        | 20.71 | 4080 | 0.1952   | 0.7983          |
| 0.9029        | 20.86 | 4110 | 0.0600   | 0.8339          |
| 0.9865        | 21.02 | 4140 | 0.0353   | 0.8191          |
| 0.9348        | 21.17 | 4170 | 0.0683   | 0.9285          |
| 0.965         | 21.32 | 4200 | 0.1153   | 0.7778          |
| 0.9006        | 21.47 | 4230 | 0.2049   | 0.7928          |
| 0.9726        | 21.62 | 4260 | 0.0687   | 0.7431          |
| 0.8811        | 21.78 | 4290 | 0.1643   | 0.7903          |
| 0.9622        | 21.93 | 4320 | 0.1069   | 0.7641          |
| 0.9267        | 22.08 | 4350 | 0.0647   | 0.7764          |
| 0.9729        | 22.23 | 4380 | 0.0770   | 0.7323          |
| 0.951         | 22.39 | 4410 | 0.1069   | 0.8905          |
| 0.976         | 22.54 | 4440 | 0.1024   | 0.7324          |
| 0.9763        | 22.69 | 4470 | 0.0679   | 0.8286          |
| 0.912         | 22.84 | 4500 | 0.1492   | 0.7784          |
| 0.8856        | 22.99 | 4530 | 0.1400   | 0.7411          |
| 0.9663        | 23.15 | 4560 | 0.1588   | 0.8195          |
| 0.9577        | 23.3  | 4590 | 0.0532   | 0.7803          |
| 0.9898        | 23.45 | 4620 | 0.1014   | 0.7892          |
| 0.9079        | 23.6  | 4650 | 0.0457   | 0.7695          |
| 0.9014        | 23.76 | 4680 | 0.1119   | 0.7742          |
| 0.959         | 23.91 | 4710 | 0.0781   | 0.7461          |
| 0.9762        | 24.06 | 4740 | 0.0852   | 0.8429          |
| 0.952         | 24.21 | 4770 | 0.0978   | 0.7348          |
| 0.9606        | 24.37 | 4800 | 0.0966   | 0.7263          |
| 0.93          | 24.52 | 4830 | 0.0707   | 0.7334          |
| 0.9514        | 24.67 | 4860 | 0.2207   | 0.7526          |
| 0.9639        | 24.82 | 4890 | 0.0877   | 0.7545          |
| 0.8319        | 24.97 | 4920 | 0.0751   | 0.7816          |
| 0.959         | 25.13 | 4950 | 0.0457   | 0.7726          |
| 0.9875        | 25.28 | 4980 | 0.0877   | 0.9052          |
| 0.9567        | 25.43 | 5010 | 0.0875   | 0.7308          |
| 0.8535        | 25.58 | 5040 | 0.1697   | 0.8189          |
| 0.903         | 25.74 | 5070 | 0.2176   | 0.7322          |
| 0.9654        | 25.89 | 5100 | 0.2082   | 0.7325          |
| 0.9139        | 26.04 | 5130 | 0.0856   | 0.7604          |
| 0.9684        | 26.19 | 5160 | 0.1764   | 0.8378          |
| 0.9869        | 26.35 | 5190 | 0.0372   | 0.8459          |
| 0.9325        | 26.5  | 5220 | 0.2127   | 0.7494          |
| 0.9396        | 26.65 | 5250 | 0.2123   | 0.7630          |
| 0.9522        | 26.8  | 5280 | 0.1121   | 0.7878          |
| 0.9404        | 26.95 | 5310 | 0.0783   | 0.7300          |
| 0.8336        | 27.11 | 5340 | 0.0862   | 0.8091          |
| 0.9827        | 27.26 | 5370 | 0.1633   | 0.7761          |
| 0.9743        | 27.41 | 5400 | 0.1033   | 0.7903          |
| 0.8255        | 27.56 | 5430 | 0.1535   | 0.7349          |
| 0.9828        | 27.72 | 5460 | 0.0835   | 0.7236          |
| 0.9607        | 27.87 | 5490 | 0.1012   | 0.7503          |
| 0.9659        | 28.02 | 5520 | 0.1087   | 0.7412          |
| 0.9467        | 28.17 | 5550 | 0.0687   | 0.7867          |
| 0.9261        | 28.32 | 5580 | 0.1773   | 0.8152          |
| 1.0           | 28.48 | 5610 | 0.0922   | 0.7728          |
| 0.9543        | 28.63 | 5640 | 0.2284   | 0.7482          |
| 0.9198        | 28.78 | 5670 | 0.2101   | 0.7313          |
| 0.9667        | 28.93 | 5700 | 0.1985   | 0.7698          |
| 0.8591        | 29.09 | 5730 | 0.0994   | 0.7528          |
| 0.9697        | 29.24 | 5760 | 0.1437   | 0.7865          |
| 0.9313        | 29.39 | 5790 | 0.1197   | 0.7443          |
| 0.9457        | 29.54 | 5820 | 0.1529   | 0.8172          |
| 0.9283        | 29.7  | 5850 | 0.1204   | 0.7310          |
| 0.8794        | 29.85 | 5880 | 0.2253   | 0.7703          |
| 0.9999        | 30.0  | 5910 | 0.0922   | 0.7463          |
| 1.0           | 30.15 | 5940 | 0.0763   | 0.7472          |
| 0.9674        | 30.3  | 5970 | 0.0678   | 0.7574          |
| 0.9543        | 30.46 | 6000 | 0.1619   | 0.7388          |
| 0.96          | 30.61 | 6030 | 0.1436   | 0.8416          |
| 0.9778        | 30.76 | 6060 | 0.0994   | 0.7353          |
| 0.9436        | 30.91 | 6090 | 0.1649   | 0.7740          |
| 0.9054        | 31.07 | 6120 | 0.1537   | 0.7387          |
| 0.967         | 31.22 | 6150 | 0.1574   | 0.7569          |
| 0.9174        | 31.37 | 6180 | 0.1378   | 0.7870          |
| 0.9667        | 31.52 | 6210 | 0.1505   | 0.7650          |
| 0.9848        | 31.68 | 6240 | 0.1231   | 0.7584          |
| 0.9514        | 31.83 | 6270 | 0.1188   | 0.7533          |
| 0.9179        | 31.98 | 6300 | 0.2073   | 0.7696          |
| 0.9733        | 32.13 | 6330 | 0.0941   | 0.7400          |
| 0.9177        | 32.28 | 6360 | 0.1431   | 0.8260          |
| 0.9338        | 32.44 | 6390 | 0.1259   | 0.7474          |
| 0.9704        | 32.59 | 6420 | 0.2298   | 0.7447          |
| 0.9133        | 32.74 | 6450 | 0.1500   | 0.7347          |
| 0.9121        | 32.89 | 6480 | 0.1538   | 0.7280          |
| 0.9649        | 33.05 | 6510 | 0.1617   | 0.7385          |
| 0.9113        | 33.2  | 6540 | 0.1399   | 0.7408          |
| 0.998         | 33.35 | 6570 | 0.1663   | 0.7621          |
| 0.9567        | 33.5  | 6600 | 0.1559   | 0.7560          |
| 0.9421        | 33.65 | 6630 | 0.1966   | 0.7766          |
| 0.9441        | 33.81 | 6660 | 0.1558   | 0.7314          |
| 0.934         | 33.96 | 6690 | 0.1846   | 0.7564          |
| 0.9874        | 34.11 | 6720 | 0.2541   | 0.7462          |
| 0.8515        | 34.26 | 6750 | 0.2071   | 0.7591          |
| 0.9204        | 34.42 | 6780 | 0.1673   | 0.7342          |
| 0.9358        | 34.57 | 6810 | 0.1883   | 0.7930          |
| 0.8267        | 34.72 | 6840 | 0.2290   | 0.7462          |
| 0.8998        | 34.87 | 6870 | 0.2199   | 0.7532          |
| 0.9496        | 35.03 | 6900 | 0.1121   | 0.7522          |
| 0.9854        | 35.18 | 6930 | 0.1238   | 0.7288          |
| 0.9971        | 35.33 | 6960 | 0.1982   | 0.7527          |
| 0.9621        | 35.48 | 6990 | 0.1837   | 0.7460          |
| 0.9626        | 35.63 | 7020 | 0.1268   | 0.7404          |
| 0.9037        | 35.79 | 7050 | 0.1184   | 0.7267          |
| 0.908         | 35.94 | 7080 | 0.1914   | 0.7388          |
| 0.996         | 36.09 | 7110 | 0.2036   | 0.7363          |
| 0.9635        | 36.24 | 7140 | 0.1858   | 0.7450          |
| 0.9446        | 36.4  | 7170 | 0.1363   | 0.7285          |
| 0.9808        | 36.55 | 7200 | 0.1578   | 0.7666          |
| 0.9212        | 36.7  | 7230 | 0.2064   | 0.7660          |
| 0.8472        | 36.85 | 7260 | 0.1804   | 0.7241          |
| 0.9328        | 37.01 | 7290 | 0.1143   | 0.7270          |
| 0.9276        | 37.16 | 7320 | 0.2104   | 0.7725          |
| 0.9599        | 37.31 | 7350 | 0.2237   | 0.7334          |
| 0.9058        | 37.46 | 7380 | 0.1586   | 0.7304          |
| 0.8654        | 37.61 | 7410 | 0.1439   | 0.7490          |
| 0.9653        | 37.77 | 7440 | 0.1785   | 0.7817          |
| 0.9201        | 37.92 | 7470 | 0.1178   | 0.7317          |
| 0.9545        | 38.07 | 7500 | 0.1523   | 0.7752          |
| 0.9484        | 38.22 | 7530 | 0.1208   | 0.7194          |
| 0.8723        | 38.38 | 7560 | 0.2017   | 0.7564          |
| 0.9555        | 38.53 | 7590 | 0.1065   | 0.7323          |
| 0.9654        | 38.68 | 7620 | 0.1721   | 0.7586          |
| 0.9044        | 38.83 | 7650 | 0.1482   | 0.7538          |
| 0.9745        | 38.98 | 7680 | 0.1507   | 0.7523          |
| 0.991         | 39.14 | 7710 | 0.1344   | 0.7389          |
| 0.9504        | 39.29 | 7740 | 0.1108   | 0.7170          |
| 0.9948        | 39.44 | 7770 | 0.1555   | 0.7555          |
| 0.9458        | 39.59 | 7800 | 0.1324   | 0.7640          |
| 0.9725        | 39.75 | 7830 | 0.1792   | 0.7599          |
| 0.9747        | 39.9  | 7860 | 0.1785   | 0.7485          |
| 0.9779        | 40.05 | 7890 | 0.1751   | 0.7391          |
| 0.9325        | 40.2  | 7920 | 0.2171   | 0.7406          |
| 0.8857        | 40.36 | 7950 | 0.1687   | 0.7203          |
| 0.9229        | 40.51 | 7980 | 0.2092   | 0.7256          |
| 0.9177        | 40.66 | 8010 | 0.1453   | 0.7217          |
| 0.9315        | 40.81 | 8040 | 0.1878   | 0.7415          |
| 0.9942        | 40.96 | 8070 | 0.1602   | 0.7443          |
| 0.9101        | 41.12 | 8100 | 0.1596   | 0.7546          |
| 0.9029        | 41.27 | 8130 | 0.1510   | 0.7346          |
| 0.994         | 41.42 | 8160 | 0.1474   | 0.7336          |
| 0.9862        | 41.57 | 8190 | 0.1274   | 0.7234          |
| 0.9136        | 41.73 | 8220 | 0.1425   | 0.7433          |
| 0.9723        | 41.88 | 8250 | 0.1138   | 0.7286          |
| 0.937         | 42.03 | 8280 | 0.1345   | 0.7425          |
| 0.9773        | 42.18 | 8310 | 0.1405   | 0.7342          |
| 0.9655        | 42.34 | 8340 | 0.1193   | 0.7290          |
| 0.9165        | 42.49 | 8370 | 0.1306   | 0.7318          |
| 0.9409        | 42.64 | 8400 | 0.1504   | 0.7364          |
| 0.976         | 42.79 | 8430 | 0.2013   | 0.7437          |
| 1.0           | 42.94 | 8460 | 0.1821   | 0.7342          |
| 0.967         | 43.1  | 8490 | 0.1685   | 0.7384          |
| 0.9877        | 43.25 | 8520 | 0.1471   | 0.7409          |
| 0.9736        | 43.4  | 8550 | 0.1682   | 0.7372          |
| 1.0           | 43.55 | 8580 | 0.1467   | 0.7332          |
| 0.8718        | 43.71 | 8610 | 0.1380   | 0.7329          |
| 0.997         | 43.86 | 8640 | 0.1314   | 0.7350          |
| 1.0           | 44.01 | 8670 | 0.1372   | 0.7361          |
| 1.0           | 44.16 | 8700 | 0.1442   | 0.7400          |
| 0.8811        | 44.31 | 8730 | 0.1603   | 0.7432          |
| 1.0           | 44.47 | 8760 | 0.1651   | 0.7373          |
| 0.9233        | 44.62 | 8790 | 0.2112   | 0.7484          |
| 0.9555        | 44.77 | 8820 | 0.1837   | 0.7375          |
| 0.8655        | 44.92 | 8850 | 0.1394   | 0.7348          |
| 0.9908        | 45.08 | 8880 | 0.1355   | 0.7375          |
| 0.8959        | 45.23 | 8910 | 0.1391   | 0.7354          |
| 0.9595        | 45.38 | 8940 | 0.1437   | 0.7325          |
| 0.9383        | 45.53 | 8970 | 0.1448   | 0.7382          |
| 0.9417        | 45.69 | 9000 | 0.1793   | 0.7486          |
| 0.9317        | 45.84 | 9030 | 0.1720   | 0.7391          |
| 0.9744        | 45.99 | 9060 | 0.1552   | 0.7388          |
| 0.9443        | 46.14 | 9090 | 0.1486   | 0.7345          |
| 0.9325        | 46.29 | 9120 | 0.1391   | 0.7383          |
| 0.9421        | 46.45 | 9150 | 0.1539   | 0.7393          |
| 0.9451        | 46.6  | 9180 | 0.1436   | 0.7328          |
| 0.9538        | 46.75 | 9210 | 0.1419   | 0.7342          |
| 0.955         | 46.9  | 9240 | 0.1581   | 0.7433          |
| 0.9611        | 47.06 | 9270 | 0.1652   | 0.7407          |
| 0.9296        | 47.21 | 9300 | 0.1716   | 0.7377          |
| 0.9413        | 47.36 | 9330 | 0.1567   | 0.7374          |
| 0.9372        | 47.51 | 9360 | 0.1511   | 0.7376          |
| 0.9524        | 47.66 | 9390 | 0.1586   | 0.7369          |
| 0.9681        | 47.82 | 9420 | 0.1411   | 0.7370          |
| 0.9295        | 47.97 | 9450 | 0.1506   | 0.7394          |
| 0.9983        | 48.12 | 9480 | 0.1503   | 0.7318          |
| 0.8795        | 48.27 | 9510 | 0.1363   | 0.7276          |
| 0.9147        | 48.43 | 9540 | 0.1502   | 0.7331          |
| 0.9063        | 48.58 | 9570 | 0.1556   | 0.7400          |
| 0.9501        | 48.73 | 9600 | 0.1616   | 0.7346          |
| 1.0           | 48.88 | 9630 | 0.1546   | 0.7307          |
| 0.9565        | 49.04 | 9660 | 0.1458   | 0.7335          |
| 0.9266        | 49.19 | 9690 | 0.1525   | 0.7336          |
| 0.935         | 49.34 | 9720 | 0.1516   | 0.7333          |
| 0.8765        | 49.49 | 9750 | 0.1364   | 0.7313          |
| 0.9403        | 49.64 | 9780 | 0.1501   | 0.7282          |
| 0.91          | 49.8  | 9810 | 0.1577   | 0.7422          |
| 0.9521        | 49.95 | 9840 | 0.1757   | 0.7377          |


### Framework versions

- Transformers 4.37.1
- Pytorch 2.1.2
- Datasets 2.16.1
- Tokenizers 0.15.1