File size: 96,501 Bytes
2191945
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
---

license: other
base_model: nvidia/mit-b0
tags:
- vision
- image-segmentation
- generated_from_trainer
model-index:
- name: segformer-b0-finetuned-segments-sidewalk-2
  results: []
---


<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# segformer-b0-finetuned-segments-sidewalk-2

This model is a fine-tuned version of [nvidia/mit-b0](https://huggingface.co/nvidia/mit-b0) on the segments/sidewalk-semantic dataset.
It achieves the following results on the evaluation set:
- Loss: 0.7810
- Mean Iou: 0.1982
- Mean Accuracy: 0.2367
- Overall Accuracy: 0.8103
- Accuracy Unlabeled: nan
- Accuracy Flat-road: 0.8571
- Accuracy Flat-sidewalk: 0.9478
- Accuracy Flat-crosswalk: 0.0
- Accuracy Flat-cyclinglane: 0.7893
- Accuracy Flat-parkingdriveway: 0.2689
- Accuracy Flat-railtrack: 0.0
- Accuracy Flat-curb: 0.1857
- Accuracy Human-person: 0.0
- Accuracy Human-rider: 0.0
- Accuracy Vehicle-car: 0.9203
- Accuracy Vehicle-truck: 0.0
- Accuracy Vehicle-bus: 0.0
- Accuracy Vehicle-tramtrain: 0.0
- Accuracy Vehicle-motorcycle: 0.0
- Accuracy Vehicle-bicycle: 0.0
- Accuracy Vehicle-caravan: 0.0
- Accuracy Vehicle-cartrailer: 0.0
- Accuracy Construction-building: 0.9048
- Accuracy Construction-door: 0.0
- Accuracy Construction-wall: 0.2404
- Accuracy Construction-fenceguardrail: 0.0000
- Accuracy Construction-bridge: 0.0
- Accuracy Construction-tunnel: nan
- Accuracy Construction-stairs: 0.0
- Accuracy Object-pole: 0.0102
- Accuracy Object-trafficsign: 0.0
- Accuracy Object-trafficlight: 0.0
- Accuracy Nature-vegetation: 0.9351
- Accuracy Nature-terrain: 0.8000
- Accuracy Sky: 0.9484
- Accuracy Void-ground: 0.0
- Accuracy Void-dynamic: 0.0
- Accuracy Void-static: 0.0017
- Accuracy Void-unclear: 0.0
- Iou Unlabeled: nan
- Iou Flat-road: 0.6411
- Iou Flat-sidewalk: 0.8351
- Iou Flat-crosswalk: 0.0
- Iou Flat-cyclinglane: 0.7179
- Iou Flat-parkingdriveway: 0.2097
- Iou Flat-railtrack: 0.0
- Iou Flat-curb: 0.1654
- Iou Human-person: 0.0
- Iou Human-rider: 0.0
- Iou Vehicle-car: 0.7408
- Iou Vehicle-truck: 0.0
- Iou Vehicle-bus: 0.0
- Iou Vehicle-tramtrain: 0.0
- Iou Vehicle-motorcycle: 0.0
- Iou Vehicle-bicycle: 0.0
- Iou Vehicle-caravan: 0.0
- Iou Vehicle-cartrailer: 0.0
- Iou Construction-building: 0.6400
- Iou Construction-door: 0.0
- Iou Construction-wall: 0.1981
- Iou Construction-fenceguardrail: 0.0000
- Iou Construction-bridge: 0.0
- Iou Construction-tunnel: nan
- Iou Construction-stairs: 0.0
- Iou Object-pole: 0.0101
- Iou Object-trafficsign: 0.0
- Iou Object-trafficlight: 0.0
- Iou Nature-vegetation: 0.7837
- Iou Nature-terrain: 0.7083
- Iou Sky: 0.8890
- Iou Void-ground: 0.0
- Iou Void-dynamic: 0.0
- Iou Void-static: 0.0017
- Iou Void-unclear: 0.0

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 1e-05

- train_batch_size: 8

- eval_batch_size: 8

- seed: 42

- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08

- lr_scheduler_type: linear

- num_epochs: 10
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | Accuracy Unlabeled | Accuracy Flat-road | Accuracy Flat-sidewalk | Accuracy Flat-crosswalk | Accuracy Flat-cyclinglane | Accuracy Flat-parkingdriveway | Accuracy Flat-railtrack | Accuracy Flat-curb | Accuracy Human-person | Accuracy Human-rider | Accuracy Vehicle-car | Accuracy Vehicle-truck | Accuracy Vehicle-bus | Accuracy Vehicle-tramtrain | Accuracy Vehicle-motorcycle | Accuracy Vehicle-bicycle | Accuracy Vehicle-caravan | Accuracy Vehicle-cartrailer | Accuracy Construction-building | Accuracy Construction-door | Accuracy Construction-wall | Accuracy Construction-fenceguardrail | Accuracy Construction-bridge | Accuracy Construction-tunnel | Accuracy Construction-stairs | Accuracy Object-pole | Accuracy Object-trafficsign | Accuracy Object-trafficlight | Accuracy Nature-vegetation | Accuracy Nature-terrain | Accuracy Sky | Accuracy Void-ground | Accuracy Void-dynamic | Accuracy Void-static | Accuracy Void-unclear | Iou Unlabeled | Iou Flat-road | Iou Flat-sidewalk | Iou Flat-crosswalk | Iou Flat-cyclinglane | Iou Flat-parkingdriveway | Iou Flat-railtrack | Iou Flat-curb | Iou Human-person | Iou Human-rider | Iou Vehicle-car | Iou Vehicle-truck | Iou Vehicle-bus | Iou Vehicle-tramtrain | Iou Vehicle-motorcycle | Iou Vehicle-bicycle | Iou Vehicle-caravan | Iou Vehicle-cartrailer | Iou Construction-building | Iou Construction-door | Iou Construction-wall | Iou Construction-fenceguardrail | Iou Construction-bridge | Iou Construction-tunnel | Iou Construction-stairs | Iou Object-pole | Iou Object-trafficsign | Iou Object-trafficlight | Iou Nature-vegetation | Iou Nature-terrain | Iou Sky | Iou Void-ground | Iou Void-dynamic | Iou Void-static | Iou Void-unclear |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:------------------:|:------------------:|:----------------------:|:-----------------------:|:-------------------------:|:-----------------------------:|:-----------------------:|:------------------:|:---------------------:|:--------------------:|:--------------------:|:----------------------:|:--------------------:|:--------------------------:|:---------------------------:|:------------------------:|:------------------------:|:---------------------------:|:------------------------------:|:--------------------------:|:--------------------------:|:------------------------------------:|:----------------------------:|:----------------------------:|:----------------------------:|:--------------------:|:---------------------------:|:----------------------------:|:--------------------------:|:-----------------------:|:------------:|:--------------------:|:---------------------:|:--------------------:|:---------------------:|:-------------:|:-------------:|:-----------------:|:------------------:|:--------------------:|:------------------------:|:------------------:|:-------------:|:----------------:|:---------------:|:---------------:|:-----------------:|:---------------:|:---------------------:|:----------------------:|:-------------------:|:-------------------:|:----------------------:|:-------------------------:|:---------------------:|:---------------------:|:-------------------------------:|:-----------------------:|:-----------------------:|:-----------------------:|:---------------:|:----------------------:|:-----------------------:|:---------------------:|:------------------:|:-------:|:---------------:|:----------------:|:---------------:|:----------------:|
| 0.8994        | 0.2   | 20   | 0.9185          | 0.1824   | 0.2205        | 0.7956           | nan                | 0.8398             | 0.9526                 | 0.0                     | 0.7086                    | 0.0972                        | 0.0                     | 0.0416             | 0.0                   | 0.0                  | 0.9154               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8989                         | 0.0                        | 0.1218                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0018               | 0.0                         | 0.0                          | 0.9318                     | 0.8259                  | 0.9418       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6125        | 0.8115            | 0.0                | 0.6588               | 0.0885                   | 0.0                | 0.0407        | 0.0              | 0.0             | 0.7250          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6258                    | 0.0                   | 0.1174                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0018          | 0.0                    | 0.0                     | 0.7664                | 0.6934             | 0.8782  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.0441        | 0.4   | 40   | 0.9159          | 0.1819   | 0.2192        | 0.7949           | nan                | 0.8533             | 0.9506                 | 0.0                     | 0.6956                    | 0.1025                        | 0.0                     | 0.0413             | 0.0                   | 0.0                  | 0.9078               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9106                         | 0.0                        | 0.1046                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0010               | 0.0                         | 0.0                          | 0.9319                     | 0.7917                  | 0.9440       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6078        | 0.8152            | 0.0                | 0.6591               | 0.0929                   | 0.0                | 0.0403        | 0.0              | 0.0             | 0.7302          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6161                    | 0.0                   | 0.1019                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0010          | 0.0                    | 0.0                     | 0.7682                | 0.6913             | 0.8785  | 0.0             | 0.0              | 0.0             | 0.0              |
| 0.9559        | 0.6   | 60   | 0.9124          | 0.1839   | 0.2229        | 0.7974           | nan                | 0.8477             | 0.9475                 | 0.0                     | 0.7436                    | 0.1287                        | 0.0                     | 0.0388             | 0.0                   | 0.0                  | 0.9180               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9094                         | 0.0                        | 0.1183                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0015               | 0.0                         | 0.0                          | 0.9204                     | 0.8372                  | 0.9434       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6055        | 0.8205            | 0.0                | 0.6711               | 0.1126                   | 0.0                | 0.0380        | 0.0              | 0.0             | 0.7227          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6218                    | 0.0                   | 0.1144                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0015          | 0.0                    | 0.0                     | 0.7749                | 0.7091             | 0.8782  | 0.0             | 0.0              | 0.0             | 0.0              |
| 0.954         | 0.8   | 80   | 0.9023          | 0.1837   | 0.2215        | 0.7967           | nan                | 0.8424             | 0.9498                 | 0.0                     | 0.7398                    | 0.1447                        | 0.0                     | 0.0470             | 0.0                   | 0.0                  | 0.9163               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9046                         | 0.0                        | 0.1169                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0018               | 0.0                         | 0.0                          | 0.9388                     | 0.7670                  | 0.9412       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6102        | 0.8199            | 0.0                | 0.6731               | 0.1254                   | 0.0                | 0.0458        | 0.0              | 0.0             | 0.7243          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6220                    | 0.0                   | 0.1131                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0018          | 0.0                    | 0.0                     | 0.7646                | 0.6817             | 0.8798  | 0.0             | 0.0              | 0.0             | 0.0              |
| 0.852         | 1.0   | 100  | 0.8860          | 0.1839   | 0.2218        | 0.7973           | nan                | 0.8695             | 0.9450                 | 0.0                     | 0.7107                    | 0.1460                        | 0.0                     | 0.0565             | 0.0                   | 0.0                  | 0.9142               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9131                         | 0.0                        | 0.1054                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0013               | 0.0                         | 0.0                          | 0.9311                     | 0.7820                  | 0.9449       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6076        | 0.8255            | 0.0                | 0.6667               | 0.1273                   | 0.0                | 0.0547        | 0.0              | 0.0             | 0.7272          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6160                    | 0.0                   | 0.1026                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0013          | 0.0                    | 0.0                     | 0.7711                | 0.6904             | 0.8794  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.1704        | 1.2   | 120  | 0.8873          | 0.1856   | 0.2241        | 0.7992           | nan                | 0.8439             | 0.9494                 | 0.0                     | 0.7551                    | 0.1495                        | 0.0                     | 0.0572             | 0.0                   | 0.0                  | 0.9188               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8992                         | 0.0                        | 0.1343                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0036               | 0.0                         | 0.0                          | 0.9351                     | 0.8044                  | 0.9459       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6168        | 0.8208            | 0.0                | 0.6752               | 0.1294                   | 0.0                | 0.0555        | 0.0              | 0.0             | 0.7247          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6264                    | 0.0                   | 0.1284                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0036          | 0.0                    | 0.0                     | 0.7701                | 0.6956             | 0.8796  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.2101        | 1.4   | 140  | 0.8773          | 0.1863   | 0.2245        | 0.7992           | nan                | 0.8307             | 0.9524                 | 0.0                     | 0.7453                    | 0.1570                        | 0.0                     | 0.0734             | 0.0                   | 0.0                  | 0.9222               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9014                         | 0.0                        | 0.1408                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0032               | 0.0                         | 0.0                          | 0.9372                     | 0.8047                  | 0.9412       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6218        | 0.8175            | 0.0                | 0.6692               | 0.1355                   | 0.0                | 0.0703        | 0.0              | 0.0             | 0.7188          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6266                    | 0.0                   | 0.1336                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0032          | 0.0                    | 0.0                     | 0.7702                | 0.6987             | 0.8815  | 0.0             | 0.0              | 0.0             | 0.0              |
| 1.1823        | 1.6   | 160  | 0.8691          | 0.1877   | 0.2255        | 0.8010           | nan                | 0.8620             | 0.9476                 | 0.0                     | 0.7408                    | 0.1586                        | 0.0                     | 0.0745             | 0.0                   | 0.0                  | 0.9175               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9066                         | 0.0                        | 0.1510                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0026               | 0.0                         | 0.0                          | 0.9313                     | 0.8042                  | 0.9462       | 0.0                  | 0.0                   | 0.0                  | 0.0                   | nan           | 0.6176        | 0.8242            | 0.0                | 0.6895               | 0.1374                   | 0.0                | 0.0713        | 0.0              | 0.0             | 0.7313          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6242                    | 0.0                   | 0.1415                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0026          | 0.0                    | 0.0                     | 0.7747                | 0.7002             | 0.8802  | 0.0             | 0.0              | 0.0             | 0.0              |
| 0.8903        | 1.8   | 180  | 0.8694          | 0.1877   | 0.2257        | 0.8015           | nan                | 0.8801             | 0.9430                 | 0.0                     | 0.7577                    | 0.1548                        | 0.0                     | 0.0671             | 0.0                   | 0.0                  | 0.9159               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8977                         | 0.0                        | 0.1630                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0037               | 0.0                         | 0.0                          | 0.9389                     | 0.7767                  | 0.9482       | 0.0                  | 0.0                   | 0.0000               | 0.0                   | nan           | 0.6151        | 0.8305            | 0.0                | 0.6952               | 0.1341                   | 0.0                | 0.0646        | 0.0              | 0.0             | 0.7325          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6302                    | 0.0                   | 0.1510                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0037          | 0.0                    | 0.0                     | 0.7682                | 0.6884             | 0.8802  | 0.0             | 0.0              | 0.0000          | 0.0              |
| 1.0182        | 2.0   | 200  | 0.8606          | 0.1889   | 0.2273        | 0.8028           | nan                | 0.8546             | 0.9471                 | 0.0                     | 0.7733                    | 0.1752                        | 0.0                     | 0.0810             | 0.0                   | 0.0                  | 0.9168               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9049                         | 0.0                        | 0.1563                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0032               | 0.0                         | 0.0                          | 0.9343                     | 0.8129                  | 0.9430       | 0.0                  | 0.0                   | 0.0000               | 0.0                   | nan           | 0.6254        | 0.8278            | 0.0                | 0.6939               | 0.1483                   | 0.0                | 0.0775        | 0.0              | 0.0             | 0.7310          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6259                    | 0.0                   | 0.1455                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0031          | 0.0                    | 0.0                     | 0.7723                | 0.7014             | 0.8822  | 0.0             | 0.0              | 0.0000          | 0.0              |
| 0.7128        | 2.2   | 220  | 0.8548          | 0.1892   | 0.2276        | 0.8030           | nan                | 0.8565             | 0.9498                 | 0.0                     | 0.7546                    | 0.1793                        | 0.0                     | 0.0829             | 0.0                   | 0.0                  | 0.9215               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9108                         | 0.0                        | 0.1514                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0032               | 0.0                         | 0.0                          | 0.9203                     | 0.8333                  | 0.9477       | 0.0                  | 0.0                   | 0.0000               | 0.0                   | nan           | 0.6258        | 0.8249            | 0.0                | 0.6952               | 0.1508                   | 0.0                | 0.0793        | 0.0              | 0.0             | 0.7262          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6244                    | 0.0                   | 0.1418                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0032          | 0.0                    | 0.0                     | 0.7801                | 0.7113             | 0.8817  | 0.0             | 0.0              | 0.0000          | 0.0              |
| 0.7744        | 2.4   | 240  | 0.8551          | 0.1899   | 0.2280        | 0.8031           | nan                | 0.8646             | 0.9441                 | 0.0                     | 0.7575                    | 0.1919                        | 0.0                     | 0.0991             | 0.0                   | 0.0                  | 0.9153               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9056                         | 0.0                        | 0.1533                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0039               | 0.0                         | 0.0                          | 0.9358                     | 0.8085                  | 0.9454       | 0.0                  | 0.0                   | 0.0001               | 0.0                   | nan           | 0.6210        | 0.8313            | 0.0                | 0.6983               | 0.1577                   | 0.0                | 0.0936        | 0.0              | 0.0             | 0.7317          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6264                    | 0.0                   | 0.1433                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0039          | 0.0                    | 0.0                     | 0.7730                | 0.7030             | 0.8826  | 0.0             | 0.0              | 0.0001          | 0.0              |
| 0.9597        | 2.6   | 260  | 0.8491          | 0.1915   | 0.2305        | 0.8045           | nan                | 0.8490             | 0.9456                 | 0.0                     | 0.7801                    | 0.2106                        | 0.0                     | 0.1075             | 0.0                   | 0.0                  | 0.9149               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9040                         | 0.0                        | 0.1790                     | 0.0000                               | 0.0                          | nan                          | 0.0                          | 0.0050               | 0.0                         | 0.0                          | 0.9318                     | 0.8332                  | 0.9458       | 0.0                  | 0.0                   | 0.0002               | 0.0                   | nan           | 0.6263        | 0.8307            | 0.0                | 0.6976               | 0.1691                   | 0.0                | 0.1013        | 0.0              | 0.0             | 0.7308          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6302                    | 0.0                   | 0.1622                | 0.0000                          | 0.0                     | nan                     | 0.0                     | 0.0050          | 0.0                    | 0.0                     | 0.7758                | 0.7086             | 0.8823  | 0.0             | 0.0              | 0.0002          | 0.0              |
| 1.0563        | 2.8   | 280  | 0.8415          | 0.1906   | 0.2281        | 0.8039           | nan                | 0.8594             | 0.9509                 | 0.0                     | 0.7548                    | 0.1894                        | 0.0                     | 0.1003             | 0.0                   | 0.0                  | 0.9161               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9158                         | 0.0                        | 0.1669                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0047               | 0.0                         | 0.0                          | 0.9266                     | 0.7989                  | 0.9423       | 0.0                  | 0.0                   | 0.0000               | 0.0                   | nan           | 0.6274        | 0.8266            | 0.0                | 0.7030               | 0.1585                   | 0.0                | 0.0947        | 0.0              | 0.0             | 0.7288          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6259                    | 0.0                   | 0.1536                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0047          | 0.0                    | 0.0                     | 0.7797                | 0.7032             | 0.8831  | 0.0             | 0.0              | 0.0000          | 0.0              |
| 0.873         | 3.0   | 300  | 0.8417          | 0.1910   | 0.2293        | 0.8040           | nan                | 0.8526             | 0.9497                 | 0.0                     | 0.7642                    | 0.2033                        | 0.0                     | 0.1126             | 0.0                   | 0.0                  | 0.9263               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9039                         | 0.0                        | 0.1838                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0051               | 0.0                         | 0.0                          | 0.9333                     | 0.7878                  | 0.9452       | 0.0                  | 0.0                   | 0.0001               | 0.0                   | nan           | 0.6271        | 0.8286            | 0.0                | 0.6954               | 0.1664                   | 0.0                | 0.1053        | 0.0              | 0.0             | 0.7202          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6335                    | 0.0                   | 0.1653                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0050          | 0.0                    | 0.0                     | 0.7757                | 0.6984             | 0.8834  | 0.0             | 0.0              | 0.0001          | 0.0              |
| 0.8197        | 3.2   | 320  | 0.8420          | 0.1910   | 0.2292        | 0.8036           | nan                | 0.8367             | 0.9502                 | 0.0                     | 0.7854                    | 0.2157                        | 0.0                     | 0.1159             | 0.0                   | 0.0                  | 0.9138               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9067                         | 0.0                        | 0.1796                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0053               | 0.0                         | 0.0                          | 0.9409                     | 0.7721                  | 0.9411       | 0.0                  | 0.0                   | 0.0001               | 0.0                   | nan           | 0.6317        | 0.8278            | 0.0                | 0.6904               | 0.1754                   | 0.0                | 0.1085        | 0.0              | 0.0             | 0.7353          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6286                    | 0.0                   | 0.1619                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0053          | 0.0                    | 0.0                     | 0.7700                | 0.6848             | 0.8840  | 0.0             | 0.0              | 0.0001          | 0.0              |
| 1.0667        | 3.4   | 340  | 0.8304          | 0.1921   | 0.2301        | 0.8059           | nan                | 0.8711             | 0.9466                 | 0.0                     | 0.7673                    | 0.1991                        | 0.0                     | 0.1051             | 0.0                   | 0.0                  | 0.9174               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9085                         | 0.0                        | 0.1799                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0055               | 0.0                         | 0.0                          | 0.9293                     | 0.8174                  | 0.9453       | 0.0                  | 0.0                   | 0.0002               | 0.0                   | nan           | 0.6281        | 0.8319            | 0.0                | 0.7087               | 0.1664                   | 0.0                | 0.0989        | 0.0              | 0.0             | 0.7352          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6287                    | 0.0                   | 0.1629                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0055          | 0.0                    | 0.0                     | 0.7794                | 0.7114             | 0.8835  | 0.0             | 0.0              | 0.0002          | 0.0              |
| 0.7125        | 3.6   | 360  | 0.8299          | 0.1924   | 0.2323        | 0.8062           | nan                | 0.8713             | 0.9390                 | 0.0                     | 0.7967                    | 0.2138                        | 0.0                     | 0.1172             | 0.0                   | 0.0                  | 0.9254               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8901                         | 0.0                        | 0.1930                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0071               | 0.0                         | 0.0                          | 0.9379                     | 0.8236                  | 0.9498       | 0.0                  | 0.0                   | 0.0005               | 0.0                   | nan           | 0.6314        | 0.8371            | 0.0                | 0.6978               | 0.1723                   | 0.0                | 0.1094        | 0.0              | 0.0             | 0.7251          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6366                    | 0.0                   | 0.1710                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0071          | 0.0                    | 0.0                     | 0.7725                | 0.7082             | 0.8816  | 0.0             | 0.0              | 0.0005          | 0.0              |
| 0.9464        | 3.8   | 380  | 0.8261          | 0.1931   | 0.2317        | 0.8059           | nan                | 0.8387             | 0.9523                 | 0.0                     | 0.7739                    | 0.2171                        | 0.0                     | 0.1399             | 0.0                   | 0.0                  | 0.9234               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9063                         | 0.0                        | 0.1884                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0065               | 0.0                         | 0.0                          | 0.9274                     | 0.8247                  | 0.9485       | 0.0                  | 0.0                   | 0.0002               | 0.0                   | nan           | 0.6354        | 0.8265            | 0.0                | 0.6937               | 0.1762                   | 0.0                | 0.1288        | 0.0              | 0.0             | 0.7273          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6324                    | 0.0                   | 0.1682                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0065          | 0.0                    | 0.0                     | 0.7809                | 0.7117             | 0.8835  | 0.0             | 0.0              | 0.0002          | 0.0              |
| 0.8507        | 4.0   | 400  | 0.8193          | 0.1932   | 0.2310        | 0.8060           | nan                | 0.8562             | 0.9489                 | 0.0                     | 0.7721                    | 0.2034                        | 0.0                     | 0.1338             | 0.0                   | 0.0                  | 0.9171               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9061                         | 0.0                        | 0.1953                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0061               | 0.0                         | 0.0                          | 0.9353                     | 0.8039                  | 0.9445       | 0.0                  | 0.0                   | 0.0003               | 0.0                   | nan           | 0.6299        | 0.8296            | 0.0                | 0.7067               | 0.1702                   | 0.0                | 0.1234        | 0.0              | 0.0             | 0.7349          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6316                    | 0.0                   | 0.1729                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0061          | 0.0                    | 0.0                     | 0.7778                | 0.7063             | 0.8851  | 0.0             | 0.0              | 0.0003          | 0.0              |
| 1.1977        | 4.2   | 420  | 0.8203          | 0.1933   | 0.2312        | 0.8061           | nan                | 0.8586             | 0.9506                 | 0.0                     | 0.7629                    | 0.1993                        | 0.0                     | 0.1317             | 0.0                   | 0.0                  | 0.9203               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9110                         | 0.0                        | 0.2036                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0054               | 0.0                         | 0.0                          | 0.9264                     | 0.8135                  | 0.9447       | 0.0                  | 0.0                   | 0.0002               | 0.0                   | nan           | 0.6319        | 0.8277            | 0.0                | 0.7057               | 0.1685                   | 0.0                | 0.1217        | 0.0              | 0.0             | 0.7346          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6292                    | 0.0                   | 0.1768                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0054          | 0.0                    | 0.0                     | 0.7831                | 0.7094             | 0.8861  | 0.0             | 0.0              | 0.0002          | 0.0              |
| 0.8554        | 4.4   | 440  | 0.8262          | 0.1933   | 0.2328        | 0.8055           | nan                | 0.8301             | 0.9494                 | 0.0                     | 0.7944                    | 0.2211                        | 0.0                     | 0.1424             | 0.0                   | 0.0                  | 0.9224               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9017                         | 0.0                        | 0.2125                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0069               | 0.0                         | 0.0                          | 0.9333                     | 0.8196                  | 0.9469       | 0.0                  | 0.0                   | 0.0005               | 0.0                   | nan           | 0.6319        | 0.8278            | 0.0                | 0.6795               | 0.1803                   | 0.0                | 0.1315        | 0.0              | 0.0             | 0.7317          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6351                    | 0.0                   | 0.1827                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0069          | 0.0                    | 0.0                     | 0.7794                | 0.7066             | 0.8859  | 0.0             | 0.0              | 0.0005          | 0.0              |
| 1.1725        | 4.6   | 460  | 0.8199          | 0.1943   | 0.2333        | 0.8070           | nan                | 0.8779             | 0.9403                 | 0.0                     | 0.7814                    | 0.2232                        | 0.0                     | 0.1392             | 0.0                   | 0.0                  | 0.9257               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9003                         | 0.0                        | 0.2169                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0069               | 0.0                         | 0.0                          | 0.9329                     | 0.8049                  | 0.9487       | 0.0                  | 0.0                   | 0.0005               | 0.0                   | nan           | 0.6267        | 0.8374            | 0.0                | 0.7119               | 0.1800                   | 0.0                | 0.1276        | 0.0              | 0.0             | 0.7295          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6362                    | 0.0                   | 0.1855                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0069          | 0.0                    | 0.0                     | 0.7801                | 0.7049             | 0.8854  | 0.0             | 0.0              | 0.0005          | 0.0              |
| 0.8091        | 4.8   | 480  | 0.8154          | 0.1946   | 0.2336        | 0.8062           | nan                | 0.8288             | 0.9495                 | 0.0                     | 0.7873                    | 0.2486                        | 0.0                     | 0.1507             | 0.0                   | 0.0                  | 0.9201               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8995                         | 0.0                        | 0.2135                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0079               | 0.0                         | 0.0                          | 0.9366                     | 0.8165                  | 0.9479       | 0.0                  | 0.0                   | 0.0006               | 0.0                   | nan           | 0.6337        | 0.8279            | 0.0                | 0.6956               | 0.1942                   | 0.0                | 0.1374        | 0.0              | 0.0             | 0.7309          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6360                    | 0.0                   | 0.1829                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0079          | 0.0                    | 0.0                     | 0.7785                | 0.7089             | 0.8859  | 0.0             | 0.0              | 0.0006          | 0.0              |
| 0.7131        | 5.0   | 500  | 0.8094          | 0.1948   | 0.2335        | 0.8077           | nan                | 0.8958             | 0.9348                 | 0.0                     | 0.7825                    | 0.2308                        | 0.0                     | 0.1450             | 0.0                   | 0.0                  | 0.9134               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9175                         | 0.0                        | 0.1972                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0064               | 0.0                         | 0.0                          | 0.9286                     | 0.8034                  | 0.9498       | 0.0                  | 0.0                   | 0.0003               | 0.0                   | nan           | 0.6286        | 0.8417            | 0.0                | 0.7195               | 0.1827                   | 0.0                | 0.1318        | 0.0              | 0.0             | 0.7359          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6271                    | 0.0                   | 0.1749                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0063          | 0.0                    | 0.0                     | 0.7840                | 0.7104             | 0.8852  | 0.0             | 0.0              | 0.0003          | 0.0              |
| 0.8448        | 5.2   | 520  | 0.8107          | 0.1939   | 0.2312        | 0.8059           | nan                | 0.8489             | 0.9516                 | 0.0                     | 0.7632                    | 0.2214                        | 0.0                     | 0.1502             | 0.0                   | 0.0                  | 0.9119               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9160                         | 0.0                        | 0.1999                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0069               | 0.0                         | 0.0                          | 0.9334                     | 0.7829                  | 0.9448       | 0.0                  | 0.0                   | 0.0001               | 0.0                   | nan           | 0.6331        | 0.8274            | 0.0                | 0.7018               | 0.1818                   | 0.0                | 0.1376        | 0.0              | 0.0             | 0.7363          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6284                    | 0.0                   | 0.1759                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0069          | 0.0                    | 0.0                     | 0.7808                | 0.7011             | 0.8868  | 0.0             | 0.0              | 0.0001          | 0.0              |
| 0.718         | 5.4   | 540  | 0.8037          | 0.1953   | 0.2340        | 0.8078           | nan                | 0.8531             | 0.9476                 | 0.0                     | 0.7795                    | 0.2424                        | 0.0                     | 0.1572             | 0.0                   | 0.0                  | 0.9203               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8951                         | 0.0                        | 0.2226                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0081               | 0.0                         | 0.0                          | 0.9393                     | 0.8070                  | 0.9504       | 0.0                  | 0.0                   | 0.0008               | 0.0                   | nan           | 0.6365        | 0.8329            | 0.0                | 0.7070               | 0.1935                   | 0.0                | 0.1431        | 0.0              | 0.0             | 0.7320          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6392                    | 0.0                   | 0.1891                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0081          | 0.0                    | 0.0                     | 0.7765                | 0.7018             | 0.8855  | 0.0             | 0.0              | 0.0008          | 0.0              |
| 0.743         | 5.6   | 560  | 0.8045          | 0.1958   | 0.2341        | 0.8080           | nan                | 0.8597             | 0.9498                 | 0.0                     | 0.7553                    | 0.2344                        | 0.0                     | 0.1531             | 0.0                   | 0.0                  | 0.9226               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9025                         | 0.0                        | 0.2335                     | 0.0000                               | 0.0                          | nan                          | 0.0                          | 0.0073               | 0.0                         | 0.0                          | 0.9269                     | 0.8342                  | 0.9444       | 0.0                  | 0.0                   | 0.0004               | 0.0                   | nan           | 0.6364        | 0.8294            | 0.0                | 0.7069               | 0.1897                   | 0.0                | 0.1396        | 0.0              | 0.0             | 0.7324          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6375                    | 0.0                   | 0.1932                | 0.0000                          | 0.0                     | nan                     | 0.0                     | 0.0073          | 0.0                    | 0.0                     | 0.7856                | 0.7150             | 0.8876  | 0.0             | 0.0              | 0.0004          | 0.0              |
| 0.7429        | 5.8   | 580  | 0.8002          | 0.1960   | 0.2347        | 0.8082           | nan                | 0.8410             | 0.9502                 | 0.0                     | 0.7887                    | 0.2528                        | 0.0                     | 0.1588             | 0.0                   | 0.0                  | 0.9209               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8994                         | 0.0                        | 0.2226                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0087               | 0.0                         | 0.0                          | 0.9340                     | 0.8246                  | 0.9442       | 0.0                  | 0.0                   | 0.0008               | 0.0                   | nan           | 0.6388        | 0.8303            | 0.0                | 0.7016               | 0.1994                   | 0.0                | 0.1444        | 0.0              | 0.0             | 0.7341          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6384                    | 0.0                   | 0.1881                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0086          | 0.0                    | 0.0                     | 0.7807                | 0.7149             | 0.8876  | 0.0             | 0.0              | 0.0008          | 0.0              |
| 1.3848        | 6.0   | 600  | 0.7933          | 0.1965   | 0.2351        | 0.8090           | nan                | 0.8591             | 0.9448                 | 0.0                     | 0.7879                    | 0.2488                        | 0.0                     | 0.1709             | 0.0                   | 0.0                  | 0.9177               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9000                         | 0.0                        | 0.2240                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0083               | 0.0                         | 0.0                          | 0.9408                     | 0.8121                  | 0.9434       | 0.0                  | 0.0                   | 0.0009               | 0.0                   | nan           | 0.6362        | 0.8363            | 0.0                | 0.7118               | 0.1980                   | 0.0                | 0.1537        | 0.0              | 0.0             | 0.7369          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6392                    | 0.0                   | 0.1898                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0083          | 0.0                    | 0.0                     | 0.7774                | 0.7079             | 0.8880  | 0.0             | 0.0              | 0.0009          | 0.0              |
| 0.824         | 6.2   | 620  | 0.7967          | 0.1956   | 0.2348        | 0.8076           | nan                | 0.8341             | 0.9495                 | 0.0                     | 0.7963                    | 0.2538                        | 0.0                     | 0.1701             | 0.0                   | 0.0                  | 0.9256               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8985                         | 0.0                        | 0.2224                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0095               | 0.0                         | 0.0                          | 0.9394                     | 0.7987                  | 0.9478       | 0.0                  | 0.0                   | 0.0013               | 0.0                   | nan           | 0.6376        | 0.8312            | 0.0                | 0.6930               | 0.2013                   | 0.0                | 0.1537        | 0.0              | 0.0             | 0.7289          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6403                    | 0.0                   | 0.1888                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0094          | 0.0                    | 0.0                     | 0.7777                | 0.7025             | 0.8876  | 0.0             | 0.0              | 0.0013          | 0.0              |
| 0.991         | 6.4   | 640  | 0.7887          | 0.1963   | 0.2347        | 0.8092           | nan                | 0.8629             | 0.9472                 | 0.0                     | 0.7841                    | 0.2341                        | 0.0                     | 0.1695             | 0.0                   | 0.0                  | 0.9209               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9010                         | 0.0                        | 0.2270                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0096               | 0.0                         | 0.0                          | 0.9377                     | 0.8027                  | 0.9486       | 0.0                  | 0.0                   | 0.0010               | 0.0                   | nan           | 0.6378        | 0.8347            | 0.0                | 0.7145               | 0.1926                   | 0.0                | 0.1523        | 0.0              | 0.0             | 0.7356          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6396                    | 0.0                   | 0.1911                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0096          | 0.0                    | 0.0                     | 0.7796                | 0.7029             | 0.8878  | 0.0             | 0.0              | 0.0010          | 0.0              |
| 0.9375        | 6.6   | 660  | 0.7923          | 0.1966   | 0.2348        | 0.8092           | nan                | 0.8617             | 0.9454                 | 0.0                     | 0.7933                    | 0.2520                        | 0.0                     | 0.1653             | 0.0                   | 0.0                  | 0.9167               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9085                         | 0.0                        | 0.2246                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0092               | 0.0                         | 0.0                          | 0.9392                     | 0.7917                  | 0.9417       | 0.0                  | 0.0                   | 0.0007               | 0.0                   | nan           | 0.6385        | 0.8362            | 0.0                | 0.7182               | 0.2012                   | 0.0                | 0.1496        | 0.0              | 0.0             | 0.7403          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6361                    | 0.0                   | 0.1900                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0091          | 0.0                    | 0.0                     | 0.7792                | 0.6992             | 0.8887  | 0.0             | 0.0              | 0.0007          | 0.0              |
| 0.8419        | 6.8   | 680  | 0.7900          | 0.1965   | 0.2358        | 0.8094           | nan                | 0.8614             | 0.9429                 | 0.0                     | 0.8050                    | 0.2494                        | 0.0                     | 0.1607             | 0.0                   | 0.0                  | 0.9201               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8991                         | 0.0                        | 0.2276                     | 0.0000                               | 0.0                          | nan                          | 0.0                          | 0.0096               | 0.0                         | 0.0                          | 0.9378                     | 0.8169                  | 0.9484       | 0.0                  | 0.0                   | 0.0015               | 0.0                   | nan           | 0.6348        | 0.8376            | 0.0                | 0.7105               | 0.1980                   | 0.0                | 0.1456        | 0.0              | 0.0             | 0.7370          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6407                    | 0.0                   | 0.1923                | 0.0000                          | 0.0                     | nan                     | 0.0                     | 0.0095          | 0.0                    | 0.0                     | 0.7804                | 0.7103             | 0.8875  | 0.0             | 0.0              | 0.0015          | 0.0              |
| 0.8405        | 7.0   | 700  | 0.7905          | 0.1971   | 0.2360        | 0.8099           | nan                | 0.8738             | 0.9420                 | 0.0                     | 0.7945                    | 0.2426                        | 0.0                     | 0.1692             | 0.0                   | 0.0                  | 0.9219               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8987                         | 0.0                        | 0.2370                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0097               | 0.0                         | 0.0                          | 0.9377                     | 0.8111                  | 0.9483       | 0.0                  | 0.0                   | 0.0014               | 0.0                   | nan           | 0.6356        | 0.8390            | 0.0                | 0.7189               | 0.1950                   | 0.0                | 0.1515        | 0.0              | 0.0             | 0.7359          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6410                    | 0.0                   | 0.1969                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0097          | 0.0                    | 0.0                     | 0.7809                | 0.7104             | 0.8876  | 0.0             | 0.0              | 0.0014          | 0.0              |
| 0.9715        | 7.2   | 720  | 0.7874          | 0.1968   | 0.2362        | 0.8095           | nan                | 0.8768             | 0.9383                 | 0.0                     | 0.8023                    | 0.2512                        | 0.0                     | 0.1712             | 0.0                   | 0.0                  | 0.9238               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8951                         | 0.0                        | 0.2382                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0098               | 0.0                         | 0.0                          | 0.9426                     | 0.7956                  | 0.9480       | 0.0                  | 0.0                   | 0.0019               | 0.0                   | nan           | 0.6367        | 0.8421            | 0.0                | 0.7199               | 0.1960                   | 0.0                | 0.1533        | 0.0              | 0.0             | 0.7332          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6417                    | 0.0                   | 0.1975                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0098          | 0.0                    | 0.0                     | 0.7763                | 0.6992             | 0.8876  | 0.0             | 0.0              | 0.0019          | 0.0              |
| 0.7724        | 7.4   | 740  | 0.7915          | 0.1968   | 0.2362        | 0.8091           | nan                | 0.8398             | 0.9487                 | 0.0                     | 0.8018                    | 0.2608                        | 0.0                     | 0.1719             | 0.0                   | 0.0                  | 0.9207               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9087                         | 0.0                        | 0.2315                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0097               | 0.0                         | 0.0                          | 0.9300                     | 0.8208                  | 0.9481       | 0.0                  | 0.0                   | 0.0007               | 0.0                   | nan           | 0.6414        | 0.8324            | 0.0                | 0.6986               | 0.2052                   | 0.0                | 0.1555        | 0.0              | 0.0             | 0.7371          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6364                    | 0.0                   | 0.1927                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0096          | 0.0                    | 0.0                     | 0.7860                | 0.7113             | 0.8875  | 0.0             | 0.0              | 0.0007          | 0.0              |
| 1.383         | 7.6   | 760  | 0.7824          | 0.1970   | 0.2367        | 0.8091           | nan                | 0.8456             | 0.9449                 | 0.0                     | 0.8053                    | 0.2649                        | 0.0                     | 0.1814             | 0.0                   | 0.0                  | 0.9223               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9019                         | 0.0                        | 0.2364                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0100               | 0.0                         | 0.0                          | 0.9366                     | 0.8108                  | 0.9494       | 0.0                  | 0.0                   | 0.0013               | 0.0                   | nan           | 0.6375        | 0.8363            | 0.0                | 0.7020               | 0.2052                   | 0.0                | 0.1627        | 0.0              | 0.0             | 0.7352          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6396                    | 0.0                   | 0.1961                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0099          | 0.0                    | 0.0                     | 0.7818                | 0.7065             | 0.8877  | 0.0             | 0.0              | 0.0013          | 0.0              |
| 0.8534        | 7.8   | 780  | 0.7886          | 0.1964   | 0.2353        | 0.8078           | nan                | 0.8278             | 0.9533                 | 0.0                     | 0.7803                    | 0.2586                        | 0.0                     | 0.1821             | 0.0                   | 0.0                  | 0.9279               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9032                         | 0.0                        | 0.2372                     | 0.0                                  | 0.0                          | nan                          | 0.0                          | 0.0103               | 0.0                         | 0.0                          | 0.9331                     | 0.8001                  | 0.9500       | 0.0                  | 0.0                   | 0.0014               | 0.0                   | nan           | 0.6431        | 0.8262            | 0.0                | 0.6920               | 0.2048                   | 0.0                | 0.1631        | 0.0              | 0.0             | 0.7279          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6389                    | 0.0                   | 0.1955                | 0.0                             | 0.0                     | nan                     | 0.0                     | 0.0102          | 0.0                    | 0.0                     | 0.7831                | 0.7072             | 0.8875  | 0.0             | 0.0              | 0.0014          | 0.0              |
| 0.7281        | 8.0   | 800  | 0.7854          | 0.1977   | 0.2368        | 0.8099           | nan                | 0.8600             | 0.9436                 | 0.0                     | 0.7960                    | 0.2662                        | 0.0                     | 0.1818             | 0.0                   | 0.0                  | 0.9229               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9079                         | 0.0                        | 0.2388                     | 0.0000                               | 0.0                          | nan                          | 0.0                          | 0.0100               | 0.0                         | 0.0                          | 0.9346                     | 0.8066                  | 0.9459       | 0.0                  | 0.0                   | 0.0011               | 0.0                   | nan           | 0.6396        | 0.8385            | 0.0                | 0.7166               | 0.2046                   | 0.0                | 0.1626        | 0.0              | 0.0             | 0.7354          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6371                    | 0.0                   | 0.1970                | 0.0000                          | 0.0                     | nan                     | 0.0                     | 0.0099          | 0.0                    | 0.0                     | 0.7838                | 0.7097             | 0.8888  | 0.0             | 0.0              | 0.0011          | 0.0              |
| 0.9046        | 8.2   | 820  | 0.7823          | 0.1976   | 0.2364        | 0.8097           | nan                | 0.8513             | 0.9486                 | 0.0                     | 0.7782                    | 0.2599                        | 0.0                     | 0.1809             | 0.0                   | 0.0                  | 0.9254               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9013                         | 0.0                        | 0.2411                     | 0.0001                               | 0.0                          | nan                          | 0.0                          | 0.0100               | 0.0                         | 0.0                          | 0.9338                     | 0.8221                  | 0.9455       | 0.0                  | 0.0                   | 0.0019               | 0.0                   | nan           | 0.6406        | 0.8324            | 0.0                | 0.7101               | 0.2041                   | 0.0                | 0.1623        | 0.0              | 0.0             | 0.7338          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6411                    | 0.0                   | 0.1978                | 0.0001                          | 0.0                     | nan                     | 0.0                     | 0.0099          | 0.0                    | 0.0                     | 0.7845                | 0.7146             | 0.8891  | 0.0             | 0.0              | 0.0019          | 0.0              |
| 0.7019        | 8.4   | 840  | 0.7834          | 0.1975   | 0.2364        | 0.8099           | nan                | 0.8499             | 0.9476                 | 0.0                     | 0.7918                    | 0.2640                        | 0.0                     | 0.1803             | 0.0                   | 0.0                  | 0.9235               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9015                         | 0.0                        | 0.2326                     | 0.0000                               | 0.0                          | nan                          | 0.0                          | 0.0106               | 0.0                         | 0.0                          | 0.9368                     | 0.8132                  | 0.9476       | 0.0                  | 0.0                   | 0.0021               | 0.0                   | nan           | 0.6411        | 0.8346            | 0.0                | 0.7084               | 0.2062                   | 0.0                | 0.1619        | 0.0              | 0.0             | 0.7348          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6408                    | 0.0                   | 0.1939                | 0.0000                          | 0.0                     | nan                     | 0.0                     | 0.0105          | 0.0                    | 0.0                     | 0.7820                | 0.7128             | 0.8884  | 0.0             | 0.0              | 0.0021          | 0.0              |
| 0.885         | 8.6   | 860  | 0.7877          | 0.1977   | 0.2373        | 0.8100           | nan                | 0.8622             | 0.9417                 | 0.0                     | 0.8035                    | 0.2708                        | 0.0                     | 0.1772             | 0.0                   | 0.0                  | 0.9241               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9109                         | 0.0                        | 0.2367                     | 0.0000                               | 0.0                          | nan                          | 0.0                          | 0.0104               | 0.0                         | 0.0                          | 0.9287                     | 0.8143                  | 0.9508       | 0.0                  | 0.0                   | 0.0011               | 0.0                   | nan           | 0.6363        | 0.8404            | 0.0                | 0.7137               | 0.2052                   | 0.0                | 0.1592        | 0.0              | 0.0             | 0.7344          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6370                    | 0.0                   | 0.1964                | 0.0000                          | 0.0                     | nan                     | 0.0                     | 0.0103          | 0.0                    | 0.0                     | 0.7872                | 0.7147             | 0.8874  | 0.0             | 0.0              | 0.0011          | 0.0              |
| 0.8822        | 8.8   | 880  | 0.7831          | 0.1978   | 0.2376        | 0.8103           | nan                | 0.8765             | 0.9360                 | 0.0                     | 0.8054                    | 0.2702                        | 0.0                     | 0.1818             | 0.0                   | 0.0                  | 0.9236               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9075                         | 0.0                        | 0.2339                     | 0.0000                               | 0.0                          | nan                          | 0.0                          | 0.0103               | 0.0                         | 0.0                          | 0.9358                     | 0.8084                  | 0.9494       | 0.0                  | 0.0                   | 0.0014               | 0.0                   | nan           | 0.6381        | 0.8443            | 0.0                | 0.7209               | 0.2022                   | 0.0                | 0.1618        | 0.0              | 0.0             | 0.7352          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6382                    | 0.0                   | 0.1958                | 0.0000                          | 0.0                     | nan                     | 0.0                     | 0.0103          | 0.0                    | 0.0                     | 0.7828                | 0.7080             | 0.8883  | 0.0             | 0.0              | 0.0014          | 0.0              |
| 0.5794        | 9.0   | 900  | 0.7825          | 0.1978   | 0.2363        | 0.8100           | nan                | 0.8604             | 0.9462                 | 0.0                     | 0.7940                    | 0.2673                        | 0.0                     | 0.1772             | 0.0                   | 0.0                  | 0.9188               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.8940                         | 0.0                        | 0.2453                     | 0.0000                               | 0.0                          | nan                          | 0.0                          | 0.0105               | 0.0                         | 0.0                          | 0.9435                     | 0.7907                  | 0.9475       | 0.0                  | 0.0                   | 0.0025               | 0.0                   | nan           | 0.6417        | 0.8370            | 0.0                | 0.7175               | 0.2078                   | 0.0                | 0.1590        | 0.0              | 0.0             | 0.7421          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6426                    | 0.0                   | 0.2008                | 0.0000                          | 0.0                     | nan                     | 0.0                     | 0.0104          | 0.0                    | 0.0                     | 0.7766                | 0.7007             | 0.8888  | 0.0             | 0.0              | 0.0025          | 0.0              |
| 0.6408        | 9.2   | 920  | 0.7818          | 0.1976   | 0.2360        | 0.8094           | nan                | 0.8462             | 0.9497                 | 0.0                     | 0.7917                    | 0.2648                        | 0.0                     | 0.1855             | 0.0                   | 0.0                  | 0.9179               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9025                         | 0.0                        | 0.2383                     | 0.0000                               | 0.0                          | nan                          | 0.0                          | 0.0107               | 0.0                         | 0.0                          | 0.9391                     | 0.7889                  | 0.9494       | 0.0                  | 0.0                   | 0.0019               | 0.0                   | nan           | 0.6409        | 0.8327            | 0.0                | 0.7081               | 0.2091                   | 0.0                | 0.1654        | 0.0              | 0.0             | 0.7419          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6404                    | 0.0                   | 0.1971                | 0.0000                          | 0.0                     | nan                     | 0.0                     | 0.0107          | 0.0                    | 0.0                     | 0.7799                | 0.7025             | 0.8886  | 0.0             | 0.0              | 0.0019          | 0.0              |
| 0.7626        | 9.4   | 940  | 0.7804          | 0.1977   | 0.2363        | 0.8099           | nan                | 0.8546             | 0.9474                 | 0.0                     | 0.7927                    | 0.2683                        | 0.0                     | 0.1778             | 0.0                   | 0.0                  | 0.9225               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9002                         | 0.0                        | 0.2359                     | 0.0001                               | 0.0                          | nan                          | 0.0                          | 0.0105               | 0.0                         | 0.0                          | 0.9386                     | 0.7972                  | 0.9495       | 0.0                  | 0.0                   | 0.0023               | 0.0                   | nan           | 0.6407        | 0.8352            | 0.0                | 0.7153               | 0.2090                   | 0.0                | 0.1597        | 0.0              | 0.0             | 0.7379          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6415                    | 0.0                   | 0.1961                | 0.0001                          | 0.0                     | nan                     | 0.0                     | 0.0104          | 0.0                    | 0.0                     | 0.7806                | 0.7051             | 0.8887  | 0.0             | 0.0              | 0.0023          | 0.0              |
| 1.0868        | 9.6   | 960  | 0.7791          | 0.1979   | 0.2366        | 0.8103           | nan                | 0.8627             | 0.9439                 | 0.0                     | 0.7967                    | 0.2643                        | 0.0                     | 0.1783             | 0.0                   | 0.0                  | 0.9197               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9026                         | 0.0                        | 0.2389                     | 0.0000                               | 0.0                          | nan                          | 0.0                          | 0.0105               | 0.0                         | 0.0                          | 0.9402                     | 0.8018                  | 0.9475       | 0.0                  | 0.0                   | 0.0018               | 0.0                   | nan           | 0.6402        | 0.8386            | 0.0                | 0.7204               | 0.2061                   | 0.0                | 0.1601        | 0.0              | 0.0             | 0.7399          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6401                    | 0.0                   | 0.1976                | 0.0000                          | 0.0                     | nan                     | 0.0                     | 0.0105          | 0.0                    | 0.0                     | 0.7799                | 0.7048             | 0.8891  | 0.0             | 0.0              | 0.0018          | 0.0              |
| 0.7829        | 9.8   | 980  | 0.7843          | 0.1979   | 0.2365        | 0.8102           | nan                | 0.8641             | 0.9430                 | 0.0                     | 0.8002                    | 0.2667                        | 0.0                     | 0.1808             | 0.0                   | 0.0                  | 0.9165               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9020                         | 0.0                        | 0.2365                     | 0.0000                               | 0.0                          | nan                          | 0.0                          | 0.0105               | 0.0                         | 0.0                          | 0.9427                     | 0.7922                  | 0.9484       | 0.0                  | 0.0                   | 0.0019               | 0.0                   | nan           | 0.6390        | 0.8396            | 0.0                | 0.7200               | 0.2071                   | 0.0                | 0.1619        | 0.0              | 0.0             | 0.7431          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6402                    | 0.0                   | 0.1968                | 0.0000                          | 0.0                     | nan                     | 0.0                     | 0.0104          | 0.0                    | 0.0                     | 0.7777                | 0.7026             | 0.8888  | 0.0             | 0.0              | 0.0019          | 0.0              |
| 0.8179        | 10.0  | 1000 | 0.7810          | 0.1982   | 0.2367        | 0.8103           | nan                | 0.8571             | 0.9478                 | 0.0                     | 0.7893                    | 0.2689                        | 0.0                     | 0.1857             | 0.0                   | 0.0                  | 0.9203               | 0.0                    | 0.0                  | 0.0                        | 0.0                         | 0.0                      | 0.0                      | 0.0                         | 0.9048                         | 0.0                        | 0.2404                     | 0.0000                               | 0.0                          | nan                          | 0.0                          | 0.0102               | 0.0                         | 0.0                          | 0.9351                     | 0.8000                  | 0.9484       | 0.0                  | 0.0                   | 0.0017               | 0.0                   | nan           | 0.6411        | 0.8351            | 0.0                | 0.7179               | 0.2097                   | 0.0                | 0.1654        | 0.0              | 0.0             | 0.7408          | 0.0               | 0.0             | 0.0                   | 0.0                    | 0.0                 | 0.0                 | 0.0                    | 0.6400                    | 0.0                   | 0.1981                | 0.0000                          | 0.0                     | nan                     | 0.0                     | 0.0101          | 0.0                    | 0.0                     | 0.7837                | 0.7083             | 0.8890  | 0.0             | 0.0              | 0.0017          | 0.0              |


### Framework versions

- Transformers 4.41.1
- Pytorch 2.3.0+cu118
- Datasets 2.18.0
- Tokenizers 0.19.1