File size: 96,944 Bytes
5767d8e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
---
license: apache-2.0
base_model: nasa-impact/nasa-smd-ibm-st
tags:
- generated_from_trainer
metrics:
- accuracy
model-index:
- name: checkpoints
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# checkpoints

This model is a fine-tuned version of [nasa-impact/nasa-smd-ibm-st](https://huggingface.co/nasa-impact/nasa-smd-ibm-st) on the None dataset.
It achieves the following results on the evaluation set:
- Accuracy: 0.7087
- Loss: 1.5329
- Overall/weighted Precision: 0.7311
- Overall/weighted Recall: 0.7087
- Overall/weighted F1: 0.7105
- Class Agriculture/precision: 1.0
- Class Agriculture/recall: 1.0
- Class Agriculture/f1: 1.0
- Class Air quality/precision: 0.7586
- Class Air quality/recall: 0.8462
- Class Air quality/f1: 0.8
- Class Cryospheric climate indicators/precision: 1.0
- Class Cryospheric climate indicators/recall: 0.5
- Class Cryospheric climate indicators/f1: 0.6667
- Class Droughts/precision: 1.0
- Class Droughts/recall: 1.0
- Class Droughts/f1: 1.0
- Class Earthquakes/precision: 1.0
- Class Earthquakes/recall: 1.0
- Class Earthquakes/f1: 1.0
- Class Ecosystem species/precision: 0.8571
- Class Ecosystem species/recall: 0.75
- Class Ecosystem species/f1: 0.8
- Class Ecosystems/precision: 0.0
- Class Ecosystems/recall: 1.0
- Class Ecosystems/f1: 0.0
- Class Energy production/use/precision: 0.0
- Class Energy production/use/recall: 0.0
- Class Energy production/use/f1: 0.0
- Class Extreme weather/precision: 0.3846
- Class Extreme weather/recall: 0.8333
- Class Extreme weather/f1: 0.5263
- Class Floods/precision: 0.0
- Class Floods/recall: 0.0
- Class Floods/f1: 0.0
- Class Greenhouse gases/precision: 0.6667
- Class Greenhouse gases/recall: 0.5
- Class Greenhouse gases/f1: 0.5714
- Class Heat/precision: 0.75
- Class Heat/recall: 0.75
- Class Heat/f1: 0.75
- Class Land use and cover change/precision: 1.0
- Class Land use and cover change/recall: 1.0
- Class Land use and cover change/f1: 1.0
- Class Landslides/precision: 0.8333
- Class Landslides/recall: 0.8333
- Class Landslides/f1: 0.8333
- Class Public health/precision: 1.0
- Class Public health/recall: 0.5
- Class Public health/f1: 0.6667
- Class Severe storms/precision: 0.5
- Class Severe storms/recall: 0.4
- Class Severe storms/f1: 0.4444
- Class Sun-earth interactions/precision: 0.7667
- Class Sun-earth interactions/recall: 0.6970
- Class Sun-earth interactions/f1: 0.7302
- Class Teleconnections/precision: 0.6667
- Class Teleconnections/recall: 0.5455
- Class Teleconnections/f1: 0.6
- Class Temperature indicators/precision: 0.5
- Class Temperature indicators/recall: 0.6667
- Class Temperature indicators/f1: 0.5714

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- gradient_accumulation_steps: 4
- total_train_batch_size: 64
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 500
- num_epochs: 50
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step | Accuracy | Validation Loss | Overall/weighted Precision | Overall/weighted Recall | Overall/weighted F1 | Class Agriculture/precision | Class Agriculture/recall | Class Agriculture/f1 | Class Air quality/precision | Class Air quality/recall | Class Air quality/f1 | Class Cryospheric climate indicators/precision | Class Cryospheric climate indicators/recall | Class Cryospheric climate indicators/f1 | Class Droughts/precision | Class Droughts/recall | Class Droughts/f1 | Class Earthquakes/precision | Class Earthquakes/recall | Class Earthquakes/f1 | Class Ecosystem species/precision | Class Ecosystem species/recall | Class Ecosystem species/f1 | Class Ecosystems/precision | Class Ecosystems/recall | Class Ecosystems/f1 | Class Energy production/use/precision | Class Energy production/use/recall | Class Energy production/use/f1 | Class Extreme weather/precision | Class Extreme weather/recall | Class Extreme weather/f1 | Class Floods/precision | Class Floods/recall | Class Floods/f1 | Class Greenhouse gases/precision | Class Greenhouse gases/recall | Class Greenhouse gases/f1 | Class Heat/precision | Class Heat/recall | Class Heat/f1 | Class Land use and cover change/precision | Class Land use and cover change/recall | Class Land use and cover change/f1 | Class Landslides/precision | Class Landslides/recall | Class Landslides/f1 | Class Public health/precision | Class Public health/recall | Class Public health/f1 | Class Severe storms/precision | Class Severe storms/recall | Class Severe storms/f1 | Class Sun-earth interactions/precision | Class Sun-earth interactions/recall | Class Sun-earth interactions/f1 | Class Teleconnections/precision | Class Teleconnections/recall | Class Teleconnections/f1 | Class Temperature indicators/precision | Class Temperature indicators/recall | Class Temperature indicators/f1 | Class Validation/precision | Class Validation/recall | Class Validation/f1 |
|:-------------:|:-----:|:----:|:--------:|:---------------:|:--------------------------:|:-----------------------:|:-------------------:|:---------------------------:|:------------------------:|:--------------------:|:---------------------------:|:------------------------:|:--------------------:|:----------------------------------------------:|:-------------------------------------------:|:---------------------------------------:|:------------------------:|:---------------------:|:-----------------:|:---------------------------:|:------------------------:|:--------------------:|:---------------------------------:|:------------------------------:|:--------------------------:|:--------------------------:|:-----------------------:|:-------------------:|:-------------------------------------:|:----------------------------------:|:------------------------------:|:-------------------------------:|:----------------------------:|:------------------------:|:----------------------:|:-------------------:|:---------------:|:--------------------------------:|:-----------------------------:|:-------------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------------------------------:|:--------------------------------------:|:----------------------------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------------:|:--------------------------:|:----------------------:|:-----------------------------:|:--------------------------:|:----------------------:|:--------------------------------------:|:-----------------------------------:|:-------------------------------:|:-------------------------------:|:----------------------------:|:------------------------:|:--------------------------------------:|:-----------------------------------:|:-------------------------------:|:--------------------------:|:-----------------------:|:-------------------:|
| No log        | 1.0   | 8    | 0.0      | 3.1300          | 0.4173                     | 0.0                     | 0.0                 | 1.0                         | 0.0                      | 0.0                  | 0.0                         | 0.0                      | 0.0                  | 1.0                                            | 0.0                                         | 0.0                                     | 0.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 1.0                               | 0.0                            | 0.0                        | 0.0                        | 1.0                     | 0.0                 | 0.0                                   | 1.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 0.0                                       | 0.0                                    | 0.0                                | 0.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 1.0                           | 0.0                        | 0.0                    | 0.0                                    | 0.0                                 | 0.0                             | 0.0                             | 0.0                          | 0.0                      | 1.0                                    | 0.0                                 | 0.0                             | 1.0                        | 0.0                     | 0.0                 |
| 3.1343        | 2.0   | 16   | 0.0945   | 3.0987          | 0.4665                     | 0.0945                  | 0.0646              | 1.0                         | 0.0                      | 0.0                  | 0.24                        | 0.4615                   | 0.3158               | 1.0                                            | 0.0                                         | 0.0                                     | 0.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 1.0                               | 0.0                            | 0.0                        | 0.0                        | 1.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 0.0                  | 0.0               | 0.0           | 0.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.0                           | 0.0                        | 0.0                    | 0.0                                    | 0.0                                 | 0.0                             | 1.0                             | 0.0                          | 0.0                      | 1.0                                    | 0.0                                 | 0.0                             |
| 3.1018        | 3.0   | 24   | 0.2126   | 3.0484          | 0.5508                     | 0.2126                  | 0.0978              | 1.0                         | 0.0                      | 0.0                  | 0.2336                      | 0.9615                   | 0.3759               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 1.0                               | 0.0                            | 0.0                        | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 0.0                              | 0.0                           | 0.0                       | 0.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.1176                        | 0.0606                     | 0.08                   | 1.0                                    | 0.0                                 | 0.0                             | 1.0                             | 0.0                          | 0.0                      |
| 3.0499        | 4.0   | 32   | 0.2283   | 2.9848          | 0.6297                     | 0.2283                  | 0.1095              | 1.0                         | 0.0                      | 0.0                  | 0.2364                      | 1.0                      | 0.3824               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 1.0                               | 0.0                            | 0.0                        | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.1765                        | 0.0909                     | 0.12                   | 1.0                                    | 0.0                                 | 0.0                             | 1.0                             | 0.0                          | 0.0                      |
| 2.9715        | 5.0   | 40   | 0.2283   | 2.9113          | 0.6321                     | 0.2283                  | 0.1095              | 1.0                         | 0.0                      | 0.0                  | 0.2342                      | 1.0                      | 0.3796               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 1.0                               | 0.0                            | 0.0                        | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.1875                        | 0.0909                     | 0.1224                 | 1.0                                    | 0.0                                 | 0.0                             | 1.0                             | 0.0                          | 0.0                      |
| 2.9715        | 6.0   | 48   | 0.2520   | 2.8317          | 0.6668                     | 0.2520                  | 0.1394              | 1.0                         | 0.0                      | 0.0                  | 0.2407                      | 1.0                      | 0.3881               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 1.0                               | 0.0                            | 0.0                        | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.3158                        | 0.1818                     | 0.2308                 | 1.0                                    | 0.0                                 | 0.0                             | 1.0                             | 0.0                          | 0.0                      |
| 2.8735        | 7.0   | 56   | 0.4016   | 2.7478          | 0.7263                     | 0.4016                  | 0.2582              | 1.0                         | 0.0                      | 0.0                  | 0.52                        | 1.0                      | 0.6842               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 1.0                               | 0.0                            | 0.0                        | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.3247                        | 0.7576                     | 0.4545                 | 1.0                                    | 0.0                                 | 0.0                             | 1.0                             | 0.0                          | 0.0                      |
| 2.7766        | 8.0   | 64   | 0.3937   | 2.6696          | 0.7255                     | 0.3937                  | 0.2552              | 1.0                         | 0.0                      | 0.0                  | 0.5319                      | 0.9615                   | 0.6849               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 1.0                               | 0.0                            | 0.0                        | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.3125                        | 0.7576                     | 0.4425                 | 1.0                                    | 0.0                                 | 0.0                             | 1.0                             | 0.0                          | 0.0                      |
| 2.6778        | 9.0   | 72   | 0.3307   | 2.6007          | 0.7783                     | 0.3307                  | 0.2201              | 1.0                         | 0.0                      | 0.0                  | 0.8333                      | 0.3846                   | 0.5263               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 1.0                               | 0.0                            | 0.0                        | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.2783                        | 0.9697                     | 0.4324                 | 1.0                                    | 0.0                                 | 0.0                             | 1.0                             | 0.0                          | 0.0                      |
| 2.6132        | 10.0  | 80   | 0.3701   | 2.5347          | 0.7679                     | 0.3701                  | 0.2580              | 1.0                         | 0.0                      | 0.0                  | 0.7727                      | 0.6538                   | 0.7083               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 1.0                               | 0.0                            | 0.0                        | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.2857                        | 0.9091                     | 0.4348                 | 1.0                                    | 0.0                                 | 0.0                             | 1.0                             | 0.0                          | 0.0                      |
| 2.6132        | 11.0  | 88   | 0.3937   | 2.4538          | 0.7650                     | 0.3937                  | 0.2717              | 1.0                         | 0.0                      | 0.0                  | 0.7407                      | 0.7692                   | 0.7547               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 1.0                               | 0.0                            | 0.0                        | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.3                           | 0.9091                     | 0.4511                 | 1.0                                    | 0.0                                 | 0.0                             | 1.0                             | 0.0                          | 0.0                      |
| 2.502         | 12.0  | 96   | 0.4252   | 2.3546          | 0.7537                     | 0.4252                  | 0.3030              | 1.0                         | 0.0                      | 0.0                  | 0.6667                      | 0.9231                   | 0.7742               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 1.0                               | 0.25                           | 0.4                        | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.3146                        | 0.8485                     | 0.4590                 | 1.0                                    | 0.0                                 | 0.0                             | 1.0                             | 0.0                          | 0.0                      |
| 2.4298        | 13.0  | 104  | 0.4646   | 2.2607          | 0.7308                     | 0.4646                  | 0.3283              | 1.0                         | 0.0                      | 0.0                  | 0.6098                      | 0.9615                   | 0.7463               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 0.6                               | 0.75                           | 0.6667                     | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.3684                        | 0.8485                     | 0.5138                 | 1.0                                    | 0.0                                 | 0.0                             | 1.0                             | 0.0                          | 0.0                      |
| 2.263         | 14.0  | 112  | 0.4803   | 2.1656          | 0.6757                     | 0.4803                  | 0.3474              | 1.0                         | 0.0                      | 0.0                  | 0.6098                      | 0.9615                   | 0.7463               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 0.4375                            | 0.875                          | 0.5833                     | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 1.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.4179                        | 0.8485                     | 0.56                   | 0.3333                                 | 0.0909                              | 0.1429                          | 1.0                             | 0.0                          | 0.0                      |
| 2.1649        | 15.0  | 120  | 0.4882   | 2.0712          | 0.6239                     | 0.4882                  | 0.3616              | 1.0                         | 0.0                      | 0.0                  | 0.5814                      | 0.9615                   | 0.7246               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 0.5                               | 0.75                           | 0.6                        | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 0.0                    | 0.0                 | 0.0             | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.4462                        | 0.8788                     | 0.5918                 | 0.4                                    | 0.1818                              | 0.25                            | 1.0                             | 0.0                          | 0.0                      |
| 2.1649        | 16.0  | 128  | 0.5118   | 1.9789          | 0.6575                     | 0.5118                  | 0.3960              | 1.0                         | 0.0                      | 0.0                  | 0.6944                      | 0.9615                   | 0.8065               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 0.4615                            | 0.75                           | 0.5714                     | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 0.1538                 | 0.25                | 0.1905          | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.5082                        | 0.9394                     | 0.6596                 | 0.25                                   | 0.0909                              | 0.1333                          | 1.0                             | 0.0                          | 0.0                      |
| 2.0169        | 17.0  | 136  | 0.5433   | 1.9319          | 0.7150                     | 0.5433                  | 0.4470              | 1.0                         | 0.0                      | 0.0                  | 0.6757                      | 0.9615                   | 0.7937               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 0.4286                            | 0.75                           | 0.5455                     | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 0.1818                 | 0.5                 | 0.2667          | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.6383                        | 0.9091                     | 0.75                   | 0.5714                                 | 0.3636                              | 0.4444                          | 1.0                             | 0.0                          | 0.0                      |
| 1.8937        | 18.0  | 144  | 0.5276   | 1.8886          | 0.7051                     | 0.5276                  | 0.4316              | 1.0                         | 0.0                      | 0.0                  | 0.5814                      | 0.9615                   | 0.7246               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 0.4615                            | 0.75                           | 0.5714                     | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 0.25                   | 0.75                | 0.375           | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.65                          | 0.7879                     | 0.7123                 | 0.5714                                 | 0.3636                              | 0.4444                          | 1.0                             | 0.0                          | 0.0                      |
| 1.8209        | 19.0  | 152  | 0.5512   | 1.7950          | 0.7211                     | 0.5512                  | 0.4524              | 1.0                         | 0.0                      | 0.0                  | 0.6579                      | 0.9615                   | 0.7812               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 0.5                               | 0.75                           | 0.6                        | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 0.24                   | 0.75                | 0.3636          | 1.0                              | 0.0                           | 0.0                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.6444                        | 0.8788                     | 0.7436                 | 0.5714                                 | 0.3636                              | 0.4444                          | 1.0                             | 0.0                          | 0.0                      |
| 1.6452        | 20.0  | 160  | 0.5827   | 1.7998          | 0.7483                     | 0.5827                  | 0.4947              | 1.0                         | 0.0                      | 0.0                  | 0.625                       | 0.9615                   | 0.7576               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 0.6667                            | 0.75                           | 0.7059                     | 1.0                        | 0.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 1.0                             | 0.0                          | 0.0                      | 0.24                   | 0.75                | 0.3636          | 1.0                              | 0.25                          | 0.4                       | 1.0                  | 0.0               | 0.0           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.6829                        | 0.8485                     | 0.7568                 | 0.7273                                 | 0.7273                              | 0.7273                          | 1.0                             | 0.0                          | 0.0                      |
| 1.6452        | 21.0  | 168  | 0.5827   | 1.7016          | 0.7211                     | 0.5827                  | 0.5068              | 1.0                         | 0.0                      | 0.0                  | 0.6757                      | 0.9615                   | 0.7937               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.0                      | 0.0                  | 0.5833                            | 0.875                          | 0.7                        | 1.0                        | 0.0                     | 0.0                 | 0.5                                   | 0.1667                             | 0.25                           | 1.0                             | 0.0                          | 0.0                      | 0.25                   | 0.75                | 0.375           | 1.0                              | 0.25                          | 0.4                       | 1.0                  | 0.25              | 0.4           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.6512                        | 0.8485                     | 0.7368                 | 0.7143                                 | 0.4545                              | 0.5556                          | 1.0                             | 0.0                          | 0.0                      |
| 1.5597        | 22.0  | 176  | 0.6378   | 1.6544          | 0.7338                     | 0.6378                  | 0.5642              | 1.0                         | 0.0                      | 0.0                  | 0.6579                      | 0.9615                   | 0.7812               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.5                      | 0.6667               | 0.75                              | 0.75                           | 0.75                       | 1.0                        | 0.0                     | 0.0                 | 0.6                                   | 0.5                                | 0.5455                         | 1.0                             | 0.0                          | 0.0                      | 0.4118                 | 0.875               | 0.56            | 0.75                             | 0.75                          | 0.75                      | 1.0                  | 0.25              | 0.4           | 1.0                                       | 0.0                                    | 0.0                                | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.6512                        | 0.8485                     | 0.7368                 | 0.7                                    | 0.6364                              | 0.6667                          | 1.0                             | 0.0                          | 0.0                      |
| 1.4316        | 23.0  | 184  | 0.6850   | 1.5807          | 0.7513                     | 0.6850                  | 0.6319              | 1.0                         | 0.0                      | 0.0                  | 0.7742                      | 0.9231                   | 0.8421               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.5                      | 0.6667               | 0.6667                            | 0.75                           | 0.7059                     | 1.0                        | 0.0                     | 0.0                 | 0.5                                   | 0.5                                | 0.5                            | 1.0                             | 0.0                          | 0.0                      | 0.4                    | 0.75                | 0.5217          | 0.6                              | 0.75                          | 0.6667                    | 1.0                  | 0.75              | 0.8571        | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.6977                        | 0.9091                     | 0.7895                 | 0.6667                                 | 0.5455                              | 0.6                             | 1.0                             | 0.0                          | 0.0                      |
| 1.2604        | 24.0  | 192  | 0.6850   | 1.5698          | 0.7486                     | 0.6850                  | 0.6436              | 1.0                         | 0.0                      | 0.0                  | 0.7353                      | 0.9615                   | 0.8333               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.0                   | 0.0               | 1.0                         | 0.5                      | 0.6667               | 0.75                              | 0.75                           | 0.75                       | 1.0                        | 0.0                     | 0.0                 | 0.4286                                | 0.5                                | 0.4615                         | 1.0                             | 0.0                          | 0.0                      | 0.4                    | 0.75                | 0.5217          | 0.75                             | 0.75                          | 0.75                      | 1.0                  | 0.75              | 0.8571        | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.7027                        | 0.7879                     | 0.7429                 | 0.6364                                 | 0.6364                              | 0.6364                          | 1.0                             | 0.6667                       | 0.8                      |
| 1.17          | 25.0  | 200  | 0.6772   | 1.5075          | 0.7379                     | 0.6772                  | 0.6377              | 1.0                         | 0.0                      | 0.0                  | 0.7353                      | 0.9615                   | 0.8333               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.5                   | 0.6667            | 1.0                         | 0.5                      | 0.6667               | 0.6667                            | 0.75                           | 0.7059                     | 1.0                        | 0.0                     | 0.0                 | 0.4444                                | 0.6667                             | 0.5333                         | 1.0                             | 0.0                          | 0.0                      | 0.4615                 | 0.75                | 0.5714          | 0.75                             | 0.75                          | 0.75                      | 1.0                  | 0.75              | 0.8571        | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.6757                        | 0.7576                     | 0.7143                 | 0.6                                    | 0.5455                              | 0.5714                          | 1.0                             | 0.3333                       | 0.5                      |
| 1.17          | 26.0  | 208  | 0.7165   | 1.4437          | 0.7679                     | 0.7165                  | 0.6756              | 1.0                         | 0.0                      | 0.0                  | 0.8065                      | 0.9615                   | 0.8772               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 0.5                   | 0.6667            | 1.0                         | 0.5                      | 0.6667               | 0.75                              | 0.75                           | 0.75                       | 1.0                        | 0.0                     | 0.0                 | 0.4444                                | 0.6667                             | 0.5333                         | 1.0                             | 0.0                          | 0.0                      | 0.5455                 | 0.75                | 0.6316          | 0.6                              | 0.75                          | 0.6667                    | 1.0                  | 0.75              | 0.8571        | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.6905                        | 0.8788                     | 0.7733                 | 0.6667                                 | 0.5455                              | 0.6                             | 1.0                             | 0.6667                       | 0.8                      |
| 1.0515        | 27.0  | 216  | 0.7402   | 1.3992          | 0.7587                     | 0.7402                  | 0.7103              | 1.0                         | 0.0                      | 0.0                  | 0.8214                      | 0.8846                   | 0.8519               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.75                              | 0.75                           | 0.75                       | 1.0                        | 0.0                     | 0.0                 | 0.5                                   | 0.8333                             | 0.625                          | 1.0                             | 0.0                          | 0.0                      | 0.8333                 | 0.625               | 0.7143          | 1.0                              | 0.75                          | 0.8571                    | 1.0                  | 1.0               | 1.0           | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 0.0                           | 0.0                        | 0.0                    | 0.6667                        | 0.9091                     | 0.7692                 | 0.6667                                 | 0.5455                              | 0.6                             | 1.0                             | 0.6667                       | 0.8                      |
| 0.9513        | 28.0  | 224  | 0.7165   | 1.3520          | 0.7659                     | 0.7165                  | 0.6754              | 1.0                         | 0.0                      | 0.0                  | 0.7667                      | 0.8846                   | 0.8214               | 1.0                                            | 0.0                                         | 0.0                                     | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.75                              | 0.75                           | 0.75                       | 1.0                        | 0.0                     | 0.0                 | 0.5                                   | 0.8333                             | 0.625                          | 1.0                             | 0.0                          | 0.0                      | 0.6667                 | 0.75                | 0.7059          | 1.0                              | 0.75                          | 0.8571                    | 1.0                  | 1.0               | 1.0           | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.6667                        | 0.8485                     | 0.7467                 | 0.5455                                 | 0.5455                              | 0.5455                          | 1.0                             | 0.3333                       | 0.5                      |
| 0.7942        | 29.0  | 232  | 0.7244   | 1.3103          | 0.7409                     | 0.7244                  | 0.7038              | 1.0                         | 0.5                      | 0.6667               | 0.8065                      | 0.9615                   | 0.8772               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.6667                            | 0.75                           | 0.7059                     | 1.0                        | 0.0                     | 0.0                 | 0.4167                                | 0.8333                             | 0.5556                         | 1.0                             | 0.0                          | 0.0                      | 0.75                   | 0.75                | 0.75            | 1.0                              | 0.75                          | 0.8571                    | 1.0                  | 1.0               | 1.0           | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 0.0                           | 0.0                        | 0.0                    | 0.7059                        | 0.7273                     | 0.7164                 | 0.5455                                 | 0.5455                              | 0.5455                          | 1.0                             | 0.6667                       | 0.8                      |
| 0.7386        | 30.0  | 240  | 0.7008   | 1.3628          | 0.7289                     | 0.7008                  | 0.6813              | 1.0                         | 0.0                      | 0.0                  | 0.8065                      | 0.9615                   | 0.8772               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.75                              | 0.75                           | 0.75                       | 1.0                        | 0.0                     | 0.0                 | 0.3333                                | 0.6667                             | 0.4444                         | 1.0                             | 0.0                          | 0.0                      | 0.7143                 | 0.625               | 0.6667          | 0.75                             | 0.75                          | 0.75                      | 1.0                  | 1.0               | 1.0           | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 0.0                           | 0.0                        | 0.0                    | 0.7059                        | 0.7273                     | 0.7164                 | 0.6                                    | 0.5455                              | 0.5714                          | 0.6667                          | 0.6667                       | 0.6667                   |
| 0.7386        | 31.0  | 248  | 0.7165   | 1.3002          | 0.7389                     | 0.7165                  | 0.6980              | 1.0                         | 0.5                      | 0.6667               | 0.7353                      | 0.9615                   | 0.8333               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.75                              | 0.75                           | 0.75                       | 1.0                        | 0.0                     | 0.0                 | 0.4                                   | 0.6667                             | 0.5                            | 1.0                             | 0.0                          | 0.0                      | 0.75                   | 0.75                | 0.75            | 0.75                             | 0.75                          | 0.75                      | 1.0                  | 1.0               | 1.0           | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 0.0                           | 0.0                        | 0.0                    | 0.7586                        | 0.6667                     | 0.7097                 | 0.5714                                 | 0.7273                              | 0.64                            | 1.0                             | 0.6667                       | 0.8                      |
| 0.64          | 32.0  | 256  | 0.7244   | 1.3095          | 0.7345                     | 0.7244                  | 0.7027              | 1.0                         | 0.5                      | 0.6667               | 0.8065                      | 0.9615                   | 0.8772               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.75                              | 0.75                           | 0.75                       | 1.0                        | 0.0                     | 0.0                 | 0.4                                   | 0.6667                             | 0.5                            | 1.0                             | 0.0                          | 0.0                      | 0.75                   | 0.75                | 0.75            | 0.75                             | 0.75                          | 0.75                      | 1.0                  | 1.0               | 1.0           | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 0.0                           | 0.0                        | 0.0                    | 0.6944                        | 0.7576                     | 0.7246                 | 0.5455                                 | 0.5455                              | 0.5455                          | 1.0                             | 0.6667                       | 0.8                      |
| 0.5528        | 33.0  | 264  | 0.7087   | 1.2698          | 0.7282                     | 0.7087                  | 0.6903              | 1.0                         | 0.5                      | 0.6667               | 0.7576                      | 0.9615                   | 0.8475               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.75                              | 0.75                           | 0.75                       | 1.0                        | 0.0                     | 0.0                 | 0.3636                                | 0.6667                             | 0.4706                         | 1.0                             | 0.0                          | 0.0                      | 0.75                   | 0.75                | 0.75            | 0.75                             | 0.75                          | 0.75                      | 1.0                  | 1.0               | 1.0           | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 0.0                           | 0.0                        | 0.0                    | 0.6970                        | 0.6970                     | 0.6970                 | 0.6                                    | 0.5455                              | 0.5714                          | 1.0                             | 0.6667                       | 0.8                      |
| 0.4612        | 34.0  | 272  | 0.7402   | 1.2532          | 0.7488                     | 0.7402                  | 0.7174              | 1.0                         | 1.0                      | 1.0                  | 0.7812                      | 0.9615                   | 0.8621               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 1.0                        | 0.0                     | 0.0                 | 0.4                                   | 0.6667                             | 0.5                            | 1.0                             | 0.0                          | 0.0                      | 0.75                   | 0.75                | 0.75            | 0.75                             | 0.75                          | 0.75                      | 1.0                  | 1.0               | 1.0           | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 0.0                           | 0.0                        | 0.0                    | 0.7027                        | 0.7879                     | 0.7429                 | 0.6667                                 | 0.5455                              | 0.6                             | 1.0                             | 0.6667                       | 0.8                      |
| 0.4051        | 35.0  | 280  | 0.7087   | 1.2745          | 0.7369                     | 0.7087                  | 0.6930              | 1.0                         | 1.0                      | 1.0                  | 0.7812                      | 0.9615                   | 0.8621               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 1.0                        | 0.0                     | 0.0                 | 0.3846                                | 0.8333                             | 0.5263                         | 1.0                             | 0.0                          | 0.0                      | 0.0                    | 1.0                 | 0.0             | 0.7143                           | 0.625                         | 0.6667                    | 0.75                 | 0.75              | 0.75          | 1.0                                       | 1.0                                    | 1.0                                | 1.0                        | 0.8333                  | 0.9091              | 1.0                           | 0.0                        | 0.0                    | 0.0                           | 0.0                        | 0.0                    | 0.7241                                 | 0.6364                              | 0.6774                          | 0.5                             | 0.6364                       | 0.56                     | 1.0                                    | 0.6667                              | 0.8                             |
| 0.4051        | 36.0  | 288  | 0.7087   | 1.3092          | 0.7413                     | 0.7087                  | 0.6988              | 1.0                         | 1.0                      | 1.0                  | 0.8276                      | 0.9231                   | 0.8727               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 1.0                        | 0.0                     | 0.0                 | 0.3077                                | 0.6667                             | 0.4211                         | 1.0                             | 0.0                          | 0.0                      | 0.0                    | 1.0                 | 0.0             | 0.75                             | 0.75                          | 0.75                      | 0.75                 | 0.75              | 0.75          | 1.0                                       | 1.0                                    | 1.0                                | 1.0                        | 0.8333                  | 0.9091              | 1.0                           | 0.0                        | 0.0                    | 0.0                           | 0.0                        | 0.0                    | 0.6765                                 | 0.6970                              | 0.6866                          | 0.6                             | 0.5455                       | 0.5714                   | 1.0                                    | 0.6667                              | 0.8                             |
| 0.3354        | 37.0  | 296  | 0.6929   | 1.2752          | 0.7348                     | 0.6929                  | 0.6799              | 1.0                         | 0.5                      | 0.6667               | 0.7143                      | 0.9615                   | 0.8197               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.75                              | 0.75                           | 0.75                       | 1.0                        | 0.0                     | 0.0                 | 0.3333                                | 0.6667                             | 0.4444                         | 1.0                             | 0.0                          | 0.0                      | 0.0                    | 1.0                 | 0.0             | 0.7143                           | 0.625                         | 0.6667                    | 0.75                 | 0.75              | 0.75          | 1.0                                       | 1.0                                    | 1.0                                | 1.0                        | 0.8333                  | 0.9091              | 1.0                           | 0.0                        | 0.0                    | 0.3333                        | 0.2                        | 0.25                   | 0.76                                   | 0.5758                              | 0.6552                          | 0.5714                          | 0.7273                       | 0.64                     | 0.6667                                 | 0.6667                              | 0.6667                          |
| 0.2905        | 38.0  | 304  | 0.7244   | 1.2621          | 0.7442                     | 0.7244                  | 0.7060              | 1.0                         | 1.0                      | 1.0                  | 0.7812                      | 0.9615                   | 0.8621               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 1.0                        | 0.0                     | 0.0                 | 0.3846                                | 0.8333                             | 0.5263                         | 1.0                             | 0.0                          | 0.0                      | 0.6667                 | 0.5                 | 0.5714          | 0.75                             | 0.75                          | 0.75                      | 1.0                  | 1.0               | 1.0           | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 0.0                           | 0.0                        | 0.0                    | 0.7273                        | 0.7273                     | 0.7273                 | 0.7                                    | 0.6364                              | 0.6667                          | 0.6667                          | 0.6667                       | 0.6667                   |
| 0.249         | 39.0  | 312  | 0.7165   | 1.3443          | 0.7636                     | 0.7165                  | 0.7027              | 1.0                         | 1.0                      | 1.0                  | 0.7143                      | 0.9615                   | 0.8197               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 1.0                        | 0.0                     | 0.0                 | 0.3846                                | 0.8333                             | 0.5263                         | 1.0                             | 0.0                          | 0.0                      | 0.0                    | 1.0                 | 0.0             | 0.7143                           | 0.625                         | 0.6667                    | 0.75                 | 0.75              | 0.75          | 1.0                                       | 1.0                                    | 1.0                                | 1.0                        | 0.8333                  | 0.9091              | 1.0                           | 0.0                        | 0.0                    | 0.3333                        | 0.2                        | 0.25                   | 0.8261                                 | 0.5758                              | 0.6786                          | 0.6                             | 0.8182                       | 0.6923                   | 0.6667                                 | 0.6667                              | 0.6667                          |
| 0.201         | 40.0  | 320  | 0.7008   | 1.2940          | 0.7209                     | 0.7008                  | 0.6824              | 1.0                         | 1.0                      | 1.0                  | 0.8276                      | 0.9231                   | 0.8727               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 0.0                        | 1.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 0.3333                          | 0.6667                       | 0.4444                   | 1.0                    | 0.0                 | 0.0             | 0.5                              | 0.25                          | 0.3333                    | 0.75                 | 0.75              | 0.75          | 1.0                                       | 1.0                                    | 1.0                                | 1.0                        | 0.8333                  | 0.9091              | 1.0                           | 0.0                        | 0.0                    | 0.0                           | 0.0                        | 0.0                    | 0.6842                                 | 0.7879                              | 0.7324                          | 0.6                             | 0.5455                       | 0.5714                   | 0.6667                                 | 0.6667                              | 0.6667                          |
| 0.201         | 41.0  | 328  | 0.7638   | 1.3724          | 0.8040                     | 0.7638                  | 0.7341              | 1.0                         | 1.0                      | 1.0                  | 0.8                         | 0.9231                   | 0.8571               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 1.0                        | 0.0                     | 0.0                 | 0.5                                   | 0.8333                             | 0.625                          | 1.0                             | 0.0                          | 0.0                      | 0.8571                 | 0.75                | 0.8             | 1.0                              | 0.75                          | 0.8571                    | 1.0                  | 1.0               | 1.0           | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 1.0                           | 0.0                        | 0.0                    | 0.6744                        | 0.8788                     | 0.7632                 | 0.6667                                 | 0.5455                              | 0.6                             | 1.0                             | 0.6667                       | 0.8                      |
| 0.1855        | 42.0  | 336  | 0.7323   | 1.3904          | 0.7521                     | 0.7323                  | 0.7117              | 1.0                         | 1.0                      | 1.0                  | 0.8846                      | 0.8846                   | 0.8846               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 1.0                        | 0.0                     | 0.0                 | 0.3636                                | 0.6667                             | 0.4706                         | 1.0                             | 0.0                          | 0.0                      | 0.8                    | 0.5                 | 0.6154          | 0.75                             | 0.75                          | 0.75                      | 1.0                  | 1.0               | 1.0           | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.0                     | 0.0                 | 0.0                           | 0.0                        | 0.0                    | 0.6591                        | 0.8788                     | 0.7532                 | 0.6667                                 | 0.5455                              | 0.6                             | 0.6667                          | 0.6667                       | 0.6667                   |
| 0.1636        | 43.0  | 344  | 0.6929   | 1.4009          | 0.7417                     | 0.6929                  | 0.6851              | 1.0                         | 1.0                      | 1.0                  | 0.6970                      | 0.8846                   | 0.7797               | 0.5                                            | 0.5                                         | 0.5                                     | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 1.0                        | 0.0                     | 0.0                 | 0.3571                                | 0.8333                             | 0.5                            | 1.0                             | 0.0                          | 0.0                      | 0.0                    | 1.0                 | 0.0             | 0.8                              | 0.5                           | 0.6154                    | 1.0                  | 0.75              | 0.8571        | 1.0                                       | 1.0                                    | 1.0                                | 0.7143                     | 0.8333                  | 0.7692              | 1.0                           | 0.0                        | 0.0                    | 0.2                           | 0.2                        | 0.2                    | 0.7692                                 | 0.6061                              | 0.6780                          | 0.7273                          | 0.7273                       | 0.7273                   | 0.6667                                 | 0.6667                              | 0.6667                          |
| 0.1472        | 44.0  | 352  | 0.7165   | 1.4073          | 0.7307                     | 0.7165                  | 0.7020              | 1.0                         | 1.0                      | 1.0                  | 0.8462                      | 0.8462                   | 0.8462               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 1.0                        | 0.0                     | 0.0                 | 0.3636                                | 0.6667                             | 0.4706                         | 1.0                             | 0.0                          | 0.0                      | 0.8333                 | 0.625               | 0.7143          | 0.75                             | 0.75                          | 0.75                      | 1.0                  | 1.0               | 1.0           | 0.8333                                    | 0.8333                                 | 0.8333                             | 1.0                        | 0.5                     | 0.6667              | 0.0                           | 0.0                        | 0.0                    | 0.6429                        | 0.8182                     | 0.72                   | 0.625                                  | 0.4545                              | 0.5263                          | 0.6667                          | 0.6667                       | 0.6667                   |
| 0.114         | 45.0  | 360  | 0.7244   | 1.4105          | 0.7553                     | 0.7244                  | 0.7219              | 1.0                         | 1.0                      | 1.0                  | 0.7059                      | 0.9231                   | 0.8                  | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 0.0                        | 0.0                     | 0.0                 | 0.3846                                | 0.8333                             | 0.5263                         | 1.0                             | 0.0                          | 0.0                      | 0.0                    | 1.0                 | 0.0             | 0.7143                           | 0.625                         | 0.6667                    | 0.75                 | 0.75              | 0.75          | 1.0                                       | 1.0                                    | 1.0                                | 0.8333                     | 0.8333                  | 0.8333              | 1.0                           | 0.5                        | 0.6667                 | 0.6667                        | 0.4                        | 0.5                    | 0.8077                                 | 0.6364                              | 0.7119                          | 0.7                             | 0.6364                       | 0.6667                   | 0.6667                                 | 0.6667                              | 0.6667                          |
| 0.114         | 46.0  | 368  | 0.7402   | 1.3171          | 0.7515                     | 0.7402                  | 0.7248              | 1.0                         | 1.0                      | 1.0                  | 0.8065                      | 0.9615                   | 0.8772               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 1.0                        | 0.0                     | 0.0                 | 0.3846                                | 0.8333                             | 0.5263                         | 1.0                             | 0.0                          | 0.0                      | 0.7143                 | 0.625               | 0.6667          | 0.75                             | 0.75                          | 0.75                      | 1.0                  | 1.0               | 1.0           | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.5                     | 0.6667              | 0.0                           | 0.0                        | 0.0                    | 0.7353                        | 0.7576                     | 0.7463                 | 0.6667                                 | 0.5455                              | 0.6                             | 0.6667                          | 0.6667                       | 0.6667                   |
| 0.0875        | 47.0  | 376  | 0.7402   | 1.3592          | 0.7814                     | 0.7402                  | 0.7375              | 1.0                         | 1.0                      | 1.0                  | 0.7742                      | 0.9231                   | 0.8421               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 1.0                        | 0.0                     | 0.0                 | 0.3571                                | 0.8333                             | 0.5                            | 1.0                             | 0.0                          | 0.0                      | 0.7143                 | 0.625               | 0.6667          | 0.75                             | 0.75                          | 0.75                      | 1.0                  | 1.0               | 1.0           | 1.0                                       | 0.8333                                 | 0.9091                             | 1.0                        | 0.5                     | 0.6667              | 0.4                           | 0.4                        | 0.4                    | 0.8148                        | 0.6667                     | 0.7333                 | 0.7273                                 | 0.7273                              | 0.7273                          | 0.5                             | 0.6667                       | 0.5714                   |
| 0.0698        | 48.0  | 384  | 0.7244   | 1.4037          | 0.7611                     | 0.7244                  | 0.7204              | 1.0                         | 1.0                      | 1.0                  | 0.8                         | 0.9231                   | 0.8571               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 0.0                        | 1.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 0.3846                          | 0.8333                       | 0.5263                   | 1.0                    | 0.0                 | 0.0             | 0.0                              | 1.0                           | 0.0                       | 0.6667               | 0.5               | 0.5714        | 0.75                                      | 0.75                                   | 0.75                               | 0.8                        | 1.0                     | 0.8889              | 1.0                           | 0.8333                     | 0.9091                 | 1.0                           | 0.5                        | 0.6667                 | 0.3333                                 | 0.2                                 | 0.25                            | 0.7667                          | 0.6970                       | 0.7302                   | 0.7                                    | 0.6364                              | 0.6667                          | 0.5                        | 0.6667                  | 0.5714              |
| 0.0519        | 49.0  | 392  | 0.7244   | 1.5194          | 0.7606                     | 0.7244                  | 0.7188              | 1.0                         | 1.0                      | 1.0                  | 0.7576                      | 0.9615                   | 0.8475               | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 0.0                        | 1.0                     | 0.0                 | 1.0                                   | 0.0                                | 0.0                            | 0.3846                          | 0.8333                       | 0.5263                   | 1.0                    | 0.0                 | 0.0             | 0.0                              | 1.0                           | 0.0                       | 0.6667               | 0.5               | 0.5714        | 0.75                                      | 0.75                                   | 0.75                               | 1.0                        | 1.0                     | 1.0                 | 1.0                           | 0.8333                     | 0.9091                 | 1.0                           | 0.5                        | 0.6667                 | 0.3333                                 | 0.2                                 | 0.25                            | 0.7586                          | 0.6667                       | 0.7097                   | 0.7                                    | 0.6364                              | 0.6667                          | 0.6667                     | 0.6667                  | 0.6667              |
| 0.0404        | 50.0  | 400  | 0.7087   | 1.5329          | 0.7311                     | 0.7087                  | 0.7105              | 1.0                         | 1.0                      | 1.0                  | 0.7586                      | 0.8462                   | 0.8                  | 1.0                                            | 0.5                                         | 0.6667                                  | 1.0                      | 1.0                   | 1.0               | 1.0                         | 1.0                      | 1.0                  | 0.8571                            | 0.75                           | 0.8                        | 0.0                        | 1.0                     | 0.0                 | 0.0                                   | 0.0                                | 0.0                            | 0.3846                          | 0.8333                       | 0.5263                   | 0.0                    | 0.0                 | 0.0             | 0.6667                           | 0.5                           | 0.5714                    | 0.75                 | 0.75              | 0.75          | 1.0                                       | 1.0                                    | 1.0                                | 0.8333                     | 0.8333                  | 0.8333              | 1.0                           | 0.5                        | 0.6667                 | 0.5                           | 0.4                        | 0.4444                 | 0.7667                                 | 0.6970                              | 0.7302                          | 0.6667                          | 0.5455                       | 0.6                      | 0.5                                    | 0.6667                              | 0.5714                          |


### Framework versions

- Transformers 4.38.2
- Pytorch 2.2.1+cu121
- Datasets 2.18.0
- Tokenizers 0.15.2