File size: 29,399 Bytes
2ad4f39
 
 
791afae
 
2ad4f39
 
 
 
 
 
 
 
 
 
 
791afae
2ad4f39
d046ddf
 
 
 
2ad4f39
d046ddf
 
2ad4f39
d046ddf
 
2ad4f39
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d046ddf
2ad4f39
 
 
d926f7d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d046ddf
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2ad4f39
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
---
license: other
tags:
- vision
- image-segmentation
- generated_from_trainer
model-index:
- name: safety-utcustom-train-SF-RGB-b5
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# safety-utcustom-train-SF-RGB-b5

This model is a fine-tuned version of [nvidia/mit-b5](https://huggingface.co/nvidia/mit-b5) on the sam1120/safety-utcustom-TRAIN dataset.
It achieves the following results on the evaluation set:
- Loss: 0.2236
- Mean Iou: 0.5051
- Mean Accuracy: 0.8441
- Overall Accuracy: 0.9820
- Accuracy Unlabeled: nan
- Accuracy Safe: 0.6977
- Accuracy Unsafe: 0.9906
- Iou Unlabeled: 0.0
- Iou Safe: 0.5337
- Iou Unsafe: 0.9816

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 3e-06
- train_batch_size: 15
- eval_batch_size: 15
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.05
- num_epochs: 130

### Training results

| Training Loss | Epoch  | Step | Accuracy Safe | Accuracy Unlabeled | Accuracy Unsafe | Iou Safe | Iou Unlabeled | Iou Unsafe | Validation Loss | Mean Accuracy | Mean Iou | Overall Accuracy |
|:-------------:|:------:|:----:|:-------------:|:------------------:|:---------------:|:--------:|:-------------:|:----------:|:---------------:|:-------------:|:--------:|:----------------:|
| 1.2239        | 0.91   | 10   | 0.3992        | nan                | 0.2951          | 0.0314   | 0.0           | 0.2939     | 1.1103          | 0.3472        | 0.1084   | 0.2982           |
| 1.1948        | 1.82   | 20   | 0.5219        | nan                | 0.3705          | 0.0440   | 0.0           | 0.3689     | 1.0963          | 0.4462        | 0.1376   | 0.3750           |
| 1.1661        | 2.73   | 30   | 0.5863        | nan                | 0.4988          | 0.0647   | 0.0           | 0.4961     | 1.0516          | 0.5426        | 0.1870   | 0.5014           |
| 1.1112        | 3.64   | 40   | 0.5459        | nan                | 0.5794          | 0.0900   | 0.0           | 0.5754     | 1.0048          | 0.5626        | 0.2218   | 0.5784           |
| 1.0907        | 4.55   | 50   | 0.5993        | nan                | 0.6367          | 0.1094   | 0.0           | 0.6321     | 0.9690          | 0.6180        | 0.2472   | 0.6356           |
| 1.047         | 5.45   | 60   | 0.6692        | nan                | 0.6699          | 0.1159   | 0.0           | 0.6656     | 0.9437          | 0.6695        | 0.2605   | 0.6699           |
| 1.0112        | 6.36   | 70   | 0.6673        | nan                | 0.7189          | 0.1349   | 0.0           | 0.7137     | 0.9084          | 0.6931        | 0.2829   | 0.7173           |
| 0.9925        | 7.27   | 80   | 0.6842        | nan                | 0.7665          | 0.1452   | 0.0           | 0.7605     | 0.8647          | 0.7254        | 0.3019   | 0.7641           |
| 0.9395        | 8.18   | 90   | 0.6818        | nan                | 0.7921          | 0.1620   | 0.0           | 0.7856     | 0.8319          | 0.7369        | 0.3159   | 0.7888           |
| 0.8902        | 9.09   | 100  | 0.6806        | nan                | 0.8142          | 0.1770   | 0.0           | 0.8072     | 0.8014          | 0.7474        | 0.3281   | 0.8102           |
| 0.9057        | 10.0   | 110  | 0.6984        | nan                | 0.8179          | 0.1733   | 0.0           | 0.8109     | 0.7867          | 0.7581        | 0.3281   | 0.8143           |
| 0.8321        | 10.91  | 120  | 0.6744        | nan                | 0.8494          | 0.1862   | 0.0           | 0.8413     | 0.7440          | 0.7619        | 0.3425   | 0.8442           |
| 0.8152        | 11.82  | 130  | 0.6688        | nan                | 0.8590          | 0.2006   | 0.0           | 0.8507     | 0.7270          | 0.7639        | 0.3504   | 0.8534           |
| 0.7929        | 12.73  | 140  | 0.6660        | nan                | 0.8657          | 0.2085   | 0.0           | 0.8572     | 0.7045          | 0.7658        | 0.3553   | 0.8598           |
| 0.7568        | 13.64  | 150  | 0.6571        | nan                | 0.8838          | 0.2185   | 0.0           | 0.8748     | 0.6744          | 0.7704        | 0.3644   | 0.8771           |
| 0.7085        | 14.55  | 160  | 0.6519        | nan                | 0.8934          | 0.2260   | 0.0           | 0.8842     | 0.6556          | 0.7727        | 0.3701   | 0.8863           |
| 0.7147        | 15.45  | 170  | 0.6561        | nan                | 0.8964          | 0.2283   | 0.0           | 0.8872     | 0.6509          | 0.7762        | 0.3718   | 0.8893           |
| 0.6991        | 16.36  | 180  | 0.6620        | nan                | 0.8964          | 0.2267   | 0.0           | 0.8874     | 0.6502          | 0.7792        | 0.3714   | 0.8895           |
| 0.6357        | 17.27  | 190  | 0.6612        | nan                | 0.9051          | 0.2411   | 0.0           | 0.8960     | 0.6230          | 0.7831        | 0.3790   | 0.8979           |
| 0.6815        | 18.18  | 200  | 0.6484        | nan                | 0.9178          | 0.2594   | 0.0           | 0.9082     | 0.5993          | 0.7831        | 0.3892   | 0.9098           |
| 0.6398        | 19.09  | 210  | 0.6414        | nan                | 0.9258          | 0.2682   | 0.0           | 0.9159     | 0.5785          | 0.7836        | 0.3947   | 0.9174           |
| 0.5845        | 20.0   | 220  | 0.6426        | nan                | 0.9286          | 0.2698   | 0.0           | 0.9187     | 0.5641          | 0.7856        | 0.3962   | 0.9202           |
| 0.6062        | 20.91  | 230  | 0.6520        | nan                | 0.9252          | 0.2641   | 0.0           | 0.9156     | 0.5693          | 0.7886        | 0.3932   | 0.9171           |
| 0.6071        | 21.82  | 240  | 0.6592        | nan                | 0.9283          | 0.2675   | 0.0           | 0.9188     | 0.5627          | 0.7937        | 0.3955   | 0.9203           |
| 0.6209        | 22.73  | 250  | 0.6619        | nan                | 0.9300          | 0.2724   | 0.0           | 0.9205     | 0.5632          | 0.7959        | 0.3977   | 0.9220           |
| 0.5609        | 23.64  | 260  | 0.6505        | nan                | 0.9379          | 0.2868   | 0.0           | 0.9281     | 0.5416          | 0.7942        | 0.4050   | 0.9294           |
| 0.5752        | 24.55  | 270  | 0.6412        | nan                | 0.9451          | 0.2983   | 0.0           | 0.9350     | 0.5141          | 0.7932        | 0.4111   | 0.9362           |
| 0.6004        | 25.45  | 280  | 0.6492        | nan                | 0.9412          | 0.2907   | 0.0           | 0.9313     | 0.5255          | 0.7952        | 0.4073   | 0.9326           |
| 0.5524        | 26.36  | 290  | 0.6588        | nan                | 0.9387          | 0.2868   | 0.0           | 0.9291     | 0.5314          | 0.7987        | 0.4053   | 0.9304           |
| 0.5758        | 27.27  | 300  | 0.6544        | nan                | 0.9423          | 0.2913   | 0.0           | 0.9326     | 0.5268          | 0.7984        | 0.4080   | 0.9338           |
| 0.5598        | 28.18  | 310  | 0.6605        | nan                | 0.9408          | 0.2897   | 0.0           | 0.9312     | 0.5240          | 0.8006        | 0.4070   | 0.9325           |
| 0.5505        | 29.09  | 320  | 0.6582        | nan                | 0.9421          | 0.2959   | 0.0           | 0.9324     | 0.5165          | 0.8002        | 0.4094   | 0.9337           |
| 0.5754        | 30.0   | 330  | 0.6578        | nan                | 0.9433          | 0.2959   | 0.0           | 0.9336     | 0.5145          | 0.8005        | 0.4098   | 0.9348           |
| 0.5284        | 30.91  | 340  | 0.6719        | nan                | 0.9411          | 0.2941   | 0.0           | 0.9318     | 0.5175          | 0.8065        | 0.4086   | 0.9331           |
| 0.5463        | 31.82  | 350  | 0.6684        | nan                | 0.9448          | 0.3020   | 0.0           | 0.9354     | 0.5016          | 0.8066        | 0.4125   | 0.9367           |
| 0.4923        | 32.73  | 360  | 0.6688        | nan                | 0.9463          | 0.3066   | 0.0           | 0.9369     | 0.4947          | 0.8075        | 0.4145   | 0.9381           |
| 0.4922        | 33.64  | 370  | 0.6685        | nan                | 0.9504          | 0.3165   | 0.0           | 0.9409     | 0.4738          | 0.8094        | 0.4191   | 0.9420           |
| 0.4976        | 34.55  | 380  | 0.6748        | nan                | 0.9535          | 0.3233   | 0.0           | 0.9443     | 0.4663          | 0.8142        | 0.4225   | 0.9453           |
| 0.4922        | 35.45  | 390  | 0.6509        | nan                | 0.9653          | 0.3484   | 0.0           | 0.9552     | 0.4295          | 0.8081        | 0.4345   | 0.9560           |
| 0.4608        | 36.36  | 400  | 0.6580        | nan                | 0.9637          | 0.3507   | 0.0           | 0.9538     | 0.4434          | 0.8109        | 0.4348   | 0.9547           |
| 0.4836        | 37.27  | 410  | 0.6522        | nan                | 0.9662          | 0.3588   | 0.0           | 0.9561     | 0.4328          | 0.8092        | 0.4383   | 0.9569           |
| 0.459         | 38.18  | 420  | 0.6477        | nan                | 0.9691          | 0.3632   | 0.0           | 0.9588     | 0.4211          | 0.8084        | 0.4407   | 0.9596           |
| 0.4528        | 39.09  | 430  | 0.6593        | nan                | 0.9668          | 0.3574   | 0.0           | 0.9569     | 0.4239          | 0.8131        | 0.4381   | 0.9577           |
| 0.4202        | 40.0   | 440  | 0.6572        | nan                | 0.9689          | 0.3650   | 0.0           | 0.9590     | 0.4141          | 0.8130        | 0.4413   | 0.9597           |
| 0.4805        | 40.91  | 450  | 0.6470        | nan                | 0.9724          | 0.3754   | 0.0           | 0.9621     | 0.4012          | 0.8097        | 0.4458   | 0.9628           |
| 0.4611        | 41.82  | 460  | 0.6525        | nan                | 0.9718          | 0.3716   | 0.0           | 0.9617     | 0.4025          | 0.8122        | 0.4444   | 0.9624           |
| 0.4339        | 42.73  | 470  | 0.6487        | nan                | 0.9726          | 0.3744   | 0.0           | 0.9624     | 0.3951          | 0.8107        | 0.4456   | 0.9631           |
| 0.4361        | 43.64  | 480  | 0.6448        | nan                | 0.9740          | 0.3769   | 0.0           | 0.9636     | 0.3946          | 0.8094        | 0.4468   | 0.9643           |
| 0.4416        | 44.55  | 490  | 0.6447        | nan                | 0.9746          | 0.3783   | 0.0           | 0.9642     | 0.3871          | 0.8097        | 0.4475   | 0.9649           |
| 0.4524        | 45.45  | 500  | 0.6589        | nan                | 0.9712          | 0.3701   | 0.0           | 0.9612     | 0.4025          | 0.8151        | 0.4438   | 0.9620           |
| 0.4319        | 46.36  | 510  | 0.6730        | nan                | 0.9673          | 0.3594   | 0.0           | 0.9578     | 0.4169          | 0.8202        | 0.4391   | 0.9586           |
| 0.4224        | 47.27  | 520  | 0.6603        | nan                | 0.9712          | 0.3716   | 0.0           | 0.9613     | 0.3986          | 0.8158        | 0.4443   | 0.9620           |
| 0.4333        | 48.18  | 530  | 0.6650        | nan                | 0.9703          | 0.3724   | 0.0           | 0.9605     | 0.4038          | 0.8176        | 0.4443   | 0.9612           |
| 0.3916        | 49.09  | 540  | 0.6624        | nan                | 0.9724          | 0.3781   | 0.0           | 0.9626     | 0.3968          | 0.8174        | 0.4469   | 0.9633           |
| 0.4803        | 50.0   | 550  | 0.6680        | nan                | 0.9726          | 0.3809   | 0.0           | 0.9629     | 0.3942          | 0.8203        | 0.4479   | 0.9636           |
| 0.3543        | 50.91  | 560  | 0.6473        | nan                | 0.9777          | 0.3952   | 0.0           | 0.9673     | 0.3697          | 0.8125        | 0.4542   | 0.9680           |
| 0.3684        | 51.82  | 570  | 0.6515        | nan                | 0.9772          | 0.3951   | 0.0           | 0.9670     | 0.3708          | 0.8143        | 0.4540   | 0.9676           |
| 0.4004        | 52.73  | 580  | 0.6437        | nan                | 0.9793          | 0.4014   | 0.0           | 0.9688     | 0.3585          | 0.8115        | 0.4567   | 0.9694           |
| 0.3656        | 53.64  | 590  | 0.6559        | nan                | 0.9780          | 0.4010   | 0.0           | 0.9679     | 0.3654          | 0.8169        | 0.4563   | 0.9685           |
| 0.3918        | 54.55  | 600  | 0.6432        | nan                | 0.9809          | 0.4115   | 0.0           | 0.9704     | 0.3527          | 0.8121        | 0.4606   | 0.9709           |
| 0.3741        | 55.45  | 610  | 0.6393        | nan                | 0.9827          | 0.4185   | 0.0           | 0.9720     | 0.3361          | 0.8110        | 0.4635   | 0.9726           |
| 0.3656        | 56.36  | 620  | 0.6540        | nan                | 0.9807          | 0.4147   | 0.0           | 0.9705     | 0.3473          | 0.8174        | 0.4617   | 0.9710           |
| 0.3341        | 57.27  | 630  | 0.6258        | nan                | 0.9845          | 0.4247   | 0.0           | 0.9734     | 0.3335          | 0.8052        | 0.4660   | 0.9739           |
| 0.3669        | 58.18  | 640  | 0.6495        | nan                | 0.9815          | 0.4190   | 0.0           | 0.9712     | 0.3395          | 0.8155        | 0.4634   | 0.9717           |
| 0.3347        | 59.09  | 650  | 0.6612        | nan                | 0.9800          | 0.4174   | 0.0           | 0.9700     | 0.3416          | 0.8206        | 0.4625   | 0.9706           |
| 0.4287        | 60.0   | 660  | 0.6673        | nan                | 0.9797          | 0.4185   | 0.0           | 0.9699     | 0.3419          | 0.8235        | 0.4628   | 0.9705           |
| 0.3838        | 60.91  | 670  | 0.6611        | nan                | 0.9812          | 0.4227   | 0.0           | 0.9712     | 0.3381          | 0.8211        | 0.4646   | 0.9718           |
| 0.352         | 61.82  | 680  | 0.6407        | nan                | 0.9845          | 0.4318   | 0.0           | 0.9738     | 0.3216          | 0.8126        | 0.4685   | 0.9743           |
| 0.3343        | 62.73  | 690  | 0.6499        | nan                | 0.9837          | 0.4311   | 0.0           | 0.9733     | 0.3275          | 0.8168        | 0.4681   | 0.9738           |
| 0.3443        | 63.64  | 700  | 0.6528        | nan                | 0.9836          | 0.4324   | 0.0           | 0.9733     | 0.3273          | 0.8182        | 0.4686   | 0.9738           |
| 0.3183        | 64.55  | 710  | 0.6456        | nan                | 0.9848          | 0.4367   | 0.0           | 0.9743     | 0.3155          | 0.8152        | 0.4703   | 0.9748           |
| 0.3346        | 65.45  | 720  | 0.6517        | nan                | 0.9841          | 0.4356   | 0.0           | 0.9738     | 0.3212          | 0.8179        | 0.4698   | 0.9743           |
| 0.3225        | 66.36  | 730  | 0.6367        | nan                | 0.9863          | 0.4432   | 0.0           | 0.9755     | 0.3052          | 0.8115        | 0.4729   | 0.9759           |
| 0.3792        | 67.27  | 740  | 0.6381        | nan                | 0.9861          | 0.4429   | 0.0           | 0.9753     | 0.3037          | 0.8121        | 0.4728   | 0.9758           |
| 0.3177        | 68.18  | 750  | 0.6345        | nan                | 0.9865          | 0.4446   | 0.0           | 0.9756     | 0.2989          | 0.8105        | 0.4734   | 0.9761           |
| 0.3295        | 69.09  | 760  | 0.6404        | nan                | 0.9859          | 0.4426   | 0.0           | 0.9752     | 0.3064          | 0.8131        | 0.4726   | 0.9757           |
| 0.3847        | 70.0   | 770  | 0.6429        | nan                | 0.9857          | 0.4439   | 0.0           | 0.9751     | 0.3054          | 0.8143        | 0.4730   | 0.9756           |
| 0.3406        | 70.91  | 780  | 0.6443        | nan                | 0.9862          | 0.4476   | 0.0           | 0.9756     | 0.3075          | 0.8152        | 0.4744   | 0.9761           |
| 0.3847        | 71.82  | 790  | 0.6343        | nan                | 0.9877          | 0.4546   | 0.0           | 0.9769     | 0.2911          | 0.8110        | 0.4772   | 0.9773           |
| 0.3292        | 72.73  | 800  | 0.6328        | nan                | 0.9881          | 0.4567   | 0.0           | 0.9771     | 0.2905          | 0.8105        | 0.4779   | 0.9776           |
| 0.3156        | 73.64  | 810  | 0.6318        | nan                | 0.9882          | 0.4579   | 0.0           | 0.9773     | 0.2865          | 0.8100        | 0.4784   | 0.9777           |
| 0.3106        | 74.55  | 820  | 0.6333        | nan                | 0.9884          | 0.4600   | 0.0           | 0.9775     | 0.2812          | 0.8109        | 0.4792   | 0.9779           |
| 0.3004        | 75.45  | 830  | 0.6232        | nan                | 0.9893          | 0.4632   | 0.0           | 0.9781     | 0.2798          | 0.8063        | 0.4804   | 0.9785           |
| 0.3336        | 76.36  | 840  | 0.6485        | nan                | 0.9872          | 0.4593   | 0.0           | 0.9768     | 0.2954          | 0.8178        | 0.4787   | 0.9772           |
| 0.299         | 77.27  | 850  | 0.6490        | nan                | 0.9874          | 0.4613   | 0.0           | 0.9769     | 0.2909          | 0.8182        | 0.4794   | 0.9774           |
| 0.292         | 78.18  | 860  | 0.6497        | nan                | 0.9875          | 0.4629   | 0.0           | 0.9771     | 0.2853          | 0.8186        | 0.4800   | 0.9775           |
| 0.2922        | 79.09  | 870  | 0.6586        | nan                | 0.9866          | 0.4601   | 0.0           | 0.9765     | 0.2917          | 0.8226        | 0.4789   | 0.9770           |
| 0.3583        | 80.0   | 880  | 0.6515        | nan                | 0.9876          | 0.4644   | 0.0           | 0.9772     | 0.2876          | 0.8195        | 0.4805   | 0.9776           |
| 0.293         | 80.91  | 890  | 0.6465        | nan                | 0.9882          | 0.4674   | 0.0           | 0.9777     | 0.2767          | 0.8173        | 0.4817   | 0.9781           |
| 0.3287        | 81.82  | 900  | 0.6518        | nan                | 0.9876          | 0.4652   | 0.0           | 0.9773     | 0.2858          | 0.8197        | 0.4808   | 0.9777           |
| 0.3067        | 82.73  | 910  | 0.6528        | nan                | 0.9875          | 0.4654   | 0.0           | 0.9772     | 0.2861          | 0.8202        | 0.4809   | 0.9776           |
| 0.3374        | 83.64  | 920  | 0.6577        | nan                | 0.9870          | 0.4631   | 0.0           | 0.9768     | 0.2869          | 0.8224        | 0.4800   | 0.9773           |
| 0.3171        | 84.55  | 930  | 0.6442        | nan                | 0.9887          | 0.4714   | 0.0           | 0.9781     | 0.2706          | 0.8164        | 0.4832   | 0.9785           |
| 0.3156        | 85.45  | 940  | 0.6321        | nan                | 0.9899          | 0.4757   | 0.0           | 0.9789     | 0.2708          | 0.8110        | 0.4849   | 0.9793           |
| 0.2749        | 86.36  | 950  | 0.6518        | nan                | 0.9887          | 0.4765   | 0.0           | 0.9783     | 0.2760          | 0.8202        | 0.4850   | 0.9787           |
| 0.2725        | 87.27  | 960  | 0.6681        | nan                | 0.9876          | 0.4765   | 0.0           | 0.9777     | 0.2780          | 0.8279        | 0.4847   | 0.9782           |
| 0.2948        | 88.18  | 970  | 0.6565        | nan                | 0.9891          | 0.4845   | 0.0           | 0.9788     | 0.2636          | 0.8228        | 0.4878   | 0.9793           |
| 0.2972        | 89.09  | 980  | 0.6722        | nan                | 0.9879          | 0.4829   | 0.0           | 0.9782     | 0.2770          | 0.8301        | 0.4870   | 0.9786           |
| 0.3101        | 90.0   | 990  | 0.6711        | nan                | 0.9882          | 0.4859   | 0.0           | 0.9784     | 0.2765          | 0.8297        | 0.4881   | 0.9788           |
| 0.2874        | 90.91  | 1000 | 0.6689        | nan                | 0.9888          | 0.4899   | 0.0           | 0.9789     | 0.2690          | 0.8288        | 0.4896   | 0.9793           |
| 0.275         | 91.82  | 1010 | 0.6542        | nan                | 0.9901          | 0.4947   | 0.0           | 0.9798     | 0.2593          | 0.8221        | 0.4915   | 0.9802           |
| 0.2711        | 92.73  | 1020 | 0.6673        | nan                | 0.9893          | 0.4957   | 0.0           | 0.9794     | 0.2608          | 0.8283        | 0.4917   | 0.9798           |
| 0.2691        | 93.64  | 1030 | 0.6819        | nan                | 0.9884          | 0.4954   | 0.0           | 0.9789     | 0.2609          | 0.8352        | 0.4915   | 0.9794           |
| 0.274         | 94.55  | 1040 | 0.6722        | nan                | 0.9895          | 0.5007   | 0.0           | 0.9797     | 0.2542          | 0.8309        | 0.4935   | 0.9801           |
| 0.27          | 95.45  | 1050 | 0.6436        | nan                | 0.9919          | 0.5087   | 0.0           | 0.9812     | 0.2357          | 0.8177        | 0.4966   | 0.9816           |
| 0.255         | 96.36  | 1060 | 0.6671        | nan                | 0.9903          | 0.5074   | 0.0           | 0.9804     | 0.2460          | 0.8287        | 0.4959   | 0.9808           |
| 0.2756        | 97.27  | 1070 | 0.6634        | nan                | 0.9909          | 0.5113   | 0.0           | 0.9809     | 0.2411          | 0.8271        | 0.4974   | 0.9812           |
| 0.2473        | 98.18  | 1080 | 0.6724        | nan                | 0.9904          | 0.5116   | 0.0           | 0.9806     | 0.2447          | 0.8314        | 0.4974   | 0.9810           |
| 0.266         | 99.09  | 1090 | 0.6778        | nan                | 0.9901          | 0.5118   | 0.0           | 0.9804     | 0.2455          | 0.8339        | 0.4974   | 0.9808           |
| 0.2682        | 100.0  | 1100 | 0.6651        | nan                | 0.9911          | 0.5156   | 0.0           | 0.9811     | 0.2359          | 0.8281        | 0.4989   | 0.9815           |
| 0.2607        | 100.91 | 1110 | 0.6739        | nan                | 0.9905          | 0.5144   | 0.0           | 0.9808     | 0.2376          | 0.8322        | 0.4984   | 0.9812           |
| 0.2506        | 101.82 | 1120 | 0.6727        | nan                | 0.9907          | 0.5153   | 0.0           | 0.9809     | 0.2380          | 0.8317        | 0.4987   | 0.9813           |
| 0.2729        | 102.73 | 1130 | 0.6802        | nan                | 0.9902          | 0.5146   | 0.0           | 0.9806     | 0.2375          | 0.8352        | 0.4984   | 0.9810           |
| 0.2348        | 103.64 | 1140 | 0.6731        | nan                | 0.9908          | 0.5172   | 0.0           | 0.9810     | 0.2335          | 0.8319        | 0.4994   | 0.9814           |
| 0.2409        | 104.55 | 1150 | 0.6781        | nan                | 0.9904          | 0.5164   | 0.0           | 0.9808     | 0.2385          | 0.8343        | 0.4991   | 0.9812           |
| 0.2737        | 105.45 | 1160 | 0.6774        | nan                | 0.9906          | 0.5177   | 0.0           | 0.9809     | 0.2357          | 0.8340        | 0.4995   | 0.9813           |
| 0.2857        | 106.36 | 1170 | 0.6659        | nan                | 0.9915          | 0.5203   | 0.0           | 0.9815     | 0.2304          | 0.8287        | 0.5006   | 0.9818           |
| 0.2503        | 107.27 | 1180 | 0.6822        | nan                | 0.9902          | 0.5172   | 0.0           | 0.9807     | 0.2397          | 0.8362        | 0.4993   | 0.9811           |
| 0.2524        | 108.18 | 1190 | 0.6741        | nan                | 0.9909          | 0.5199   | 0.0           | 0.9812     | 0.2294          | 0.8325        | 0.5004   | 0.9816           |
| 0.2722        | 109.09 | 1200 | 0.6928        | nan                | 0.9894          | 0.5145   | 0.0           | 0.9802     | 0.2461          | 0.8411        | 0.4982   | 0.9806           |
| 0.2761        | 110.0  | 1210 | 0.2530        | 0.4979             | 0.8435          | 0.9804   | nan           | 0.6981     | 0.9889          | 0.0           | 0.5136   | 0.9799           |
| 0.2595        | 110.91 | 1220 | 0.2386        | 0.5002             | 0.8395          | 0.9811   | nan           | 0.6891     | 0.9900          | 0.0           | 0.5197   | 0.9808           |
| 0.2877        | 111.82 | 1230 | 0.2260        | 0.5022             | 0.8345          | 0.9819   | nan           | 0.6779     | 0.9911          | 0.0           | 0.5251   | 0.9815           |
| 0.2307        | 112.73 | 1240 | 0.2219        | 0.5031             | 0.8317          | 0.9822   | nan           | 0.6717     | 0.9916          | 0.0           | 0.5275   | 0.9818           |
| 0.2559        | 113.64 | 1250 | 0.2382        | 0.5011             | 0.8413          | 0.9812   | nan           | 0.6927     | 0.9900          | 0.0           | 0.5224   | 0.9808           |
| 0.2668        | 114.55 | 1260 | 0.2275        | 0.5024             | 0.8395          | 0.9816   | nan           | 0.6883     | 0.9906          | 0.0           | 0.5258   | 0.9813           |
| 0.2269        | 115.45 | 1270 | 0.2212        | 0.5038             | 0.8356          | 0.9821   | nan           | 0.6798     | 0.9913          | 0.0           | 0.5296   | 0.9818           |
| 0.2713        | 116.36 | 1280 | 0.2265        | 0.5041             | 0.8365          | 0.9821   | nan           | 0.6817     | 0.9913          | 0.0           | 0.5305   | 0.9818           |
| 0.2351        | 117.27 | 1290 | 0.2113        | 0.5064             | 0.8255          | 0.9832   | nan           | 0.6580     | 0.9931          | 0.0           | 0.5363   | 0.9828           |
| 0.2306        | 118.18 | 1300 | 0.2258        | 0.5053             | 0.8354          | 0.9824   | nan           | 0.6791     | 0.9917          | 0.0           | 0.5337   | 0.9821           |
| 0.2371        | 119.09 | 1310 | 0.2234        | 0.5057             | 0.8342          | 0.9826   | nan           | 0.6765     | 0.9919          | 0.0           | 0.5348   | 0.9822           |
| 0.277         | 120.0  | 1320 | 0.2263        | 0.5061             | 0.8340          | 0.9827   | nan           | 0.6760     | 0.9920          | 0.0           | 0.5359   | 0.9823           |
| 0.2121        | 120.91 | 1330 | 0.2191        | 0.5065             | 0.8337          | 0.9828   | nan           | 0.6752     | 0.9921          | 0.0           | 0.5370   | 0.9824           |
| 0.2426        | 121.82 | 1340 | 0.2237        | 0.5055             | 0.8400          | 0.9822   | nan           | 0.6889     | 0.9912          | 0.0           | 0.5345   | 0.9819           |
| 0.2429        | 122.73 | 1350 | 0.2106        | 0.5069             | 0.8340          | 0.9829   | nan           | 0.6757     | 0.9922          | 0.0           | 0.5383   | 0.9825           |
| 0.244         | 123.64 | 1360 | 0.2133        | 0.5062             | 0.8395          | 0.9824   | nan           | 0.6876     | 0.9914          | 0.0           | 0.5364   | 0.9821           |
| 0.2287        | 124.55 | 1370 | 0.2126        | 0.5068             | 0.8371          | 0.9827   | nan           | 0.6823     | 0.9918          | 0.0           | 0.5381   | 0.9823           |
| 0.2223        | 125.45 | 1380 | 0.1988        | 0.5083             | 0.8305          | 0.9833   | nan           | 0.6681     | 0.9929          | 0.0           | 0.5420   | 0.9830           |
| 0.2275        | 126.36 | 1390 | 0.2164        | 0.5061             | 0.8409          | 0.9823   | nan           | 0.6906     | 0.9912          | 0.0           | 0.5363   | 0.9820           |
| 0.2378        | 127.27 | 1400 | 0.2201        | 0.5062             | 0.8405          | 0.9824   | nan           | 0.6898     | 0.9913          | 0.0           | 0.5365   | 0.9820           |
| 0.2385        | 128.18 | 1410 | 0.2286        | 0.5046             | 0.8455          | 0.9818   | nan           | 0.7006     | 0.9903          | 0.0           | 0.5324   | 0.9814           |
| 0.2787        | 129.09 | 1420 | 0.2157        | 0.5063             | 0.8405          | 0.9824   | nan           | 0.6896     | 0.9913          | 0.0           | 0.5369   | 0.9820           |
| 0.2377        | 130.0  | 1430 | 0.2236        | 0.5051             | 0.8441          | 0.9820   | nan           | 0.6977     | 0.9906          | 0.0           | 0.5337   | 0.9816           |


### Framework versions

- Transformers 4.30.2
- Pytorch 2.0.1+cu117
- Datasets 2.13.1
- Tokenizers 0.13.3