---
license: other
base_model: nvidia/mit-b0
tags:
- vision
- image-segmentation
- generated_from_trainer
metrics:
- recall
model-index:
- name: segformer-b0-finetuned-segments-greenhousev3-sep-23
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# segformer-b0-finetuned-segments-greenhousev3-sep-23

This model is a fine-tuned version of [nvidia/mit-b0](https://huggingface.co/nvidia/mit-b0) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1258
- Mean Iou: 0.4605
- Mean Accuracy: 0.5478
- Overall Accuracy: 0.9636
- F1 Score: 0.9623
- Recall: 0.9636
- Accuracy Unlabeled: nan
- Accuracy Object: nan
- Accuracy Road: nan
- Accuracy Plant: 0.9531
- Accuracy Iron: 0.6071
- Accuracy Wood: 0.0
- Accuracy Wall: 0.9724
- Accuracy Raw Road: 0.9911
- Accuracy Bottom Wall: 0.9428
- Accuracy Roof: 0.0
- Accuracy Grass: 0.0
- Accuracy Mulch: 0.9106
- Accuracy Person: 0.0
- Accuracy Tomato: 0.6488
- Iou Unlabeled: nan
- Iou Object: 0.0
- Iou Road: nan
- Iou Plant: 0.9017
- Iou Iron: 0.5169
- Iou Wood: 0.0
- Iou Wall: 0.9039
- Iou Raw Road: 0.9824
- Iou Bottom Wall: 0.8235
- Iou Roof: 0.0
- Iou Grass: 0.0
- Iou Mulch: 0.8489
- Iou Person: 0.0
- Iou Tomato: 0.5487

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 6e-05
- train_batch_size: 2
- eval_batch_size: 2
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 15

### Training results

| Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | F1 Score | Recall | Accuracy Unlabeled | Accuracy Object | Accuracy Road | Accuracy Plant | Accuracy Iron | Accuracy Wood | Accuracy Wall | Accuracy Raw Road | Accuracy Bottom Wall | Accuracy Roof | Accuracy Grass | Accuracy Mulch | Accuracy Person | Accuracy Tomato | Iou Unlabeled | Iou Object | Iou Road | Iou Plant | Iou Iron | Iou Wood | Iou Wall | Iou Raw Road | Iou Bottom Wall | Iou Roof | Iou Grass | Iou Mulch | Iou Person | Iou Tomato |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:--------:|:------:|:------------------:|:---------------:|:-------------:|:--------------:|:-------------:|:-------------:|:-------------:|:-----------------:|:--------------------:|:-------------:|:--------------:|:--------------:|:---------------:|:---------------:|:-------------:|:----------:|:--------:|:---------:|:--------:|:--------:|:--------:|:------------:|:---------------:|:--------:|:---------:|:---------:|:----------:|:----------:|
| 1.9112        | 0.14  | 20   | 1.9741          | 0.1572   | 0.2512        | 0.8228           | 0.8216   | 0.8228 | nan                | nan             | nan           | 0.9490         | 0.0001        | 0.0           | 0.1399        | 0.9057            | 0.0                  | 0.0           | 0.0            | 0.7683         | 0.0             | 0.0             | 0.0           | 0.0        | 0.0      | 0.7392    | 0.0001   | 0.0      | 0.1344   | 0.8972       | 0.0             | 0.0      | 0.0       | 0.4300    | 0.0        | 0.0        |
| 1.2645        | 0.29  | 40   | 1.1237          | 0.2207   | 0.2873        | 0.8661           | 0.8649   | 0.8661 | nan                | nan             | nan           | 0.9454         | 0.0           | 0.0           | 0.4683        | 0.9406            | 0.0000               | 0.0           | 0.0            | 0.8057         | 0.0             | 0.0             | nan           | nan        | 0.0      | 0.7857    | 0.0      | 0.0      | 0.4260   | 0.9336       | 0.0000          | 0.0      | 0.0       | 0.5035    | 0.0        | 0.0        |
| 0.9822        | 0.43  | 60   | 0.9113          | 0.2810   | 0.3322        | 0.9008           | 0.8995   | 0.9008 | nan                | nan             | nan           | 0.9478         | 0.0000        | 0.0           | 0.9479        | 0.9476            | 0.0002               | 0.0           | 0.0            | 0.8105         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8061    | 0.0000   | 0.0      | 0.6992   | 0.9408       | 0.0002          | 0.0      | 0.0       | 0.6450    | 0.0        | 0.0        |
| 0.9145        | 0.57  | 80   | 0.8368          | 0.2810   | 0.3301        | 0.9039           | 0.9026   | 0.9039 | nan                | nan             | nan           | 0.9478         | 0.0           | 0.0           | 0.8947        | 0.9535            | 0.0000               | 0.0           | 0.0            | 0.8354         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8255    | 0.0      | 0.0      | 0.6751   | 0.9468       | 0.0000          | 0.0      | 0.0       | 0.6433    | 0.0        | 0.0        |
| 0.8329        | 0.71  | 100  | 0.7504          | 0.2880   | 0.3390        | 0.9093           | 0.9080   | 0.9093 | nan                | nan             | nan           | 0.9495         | 0.0           | 0.0           | 0.9721        | 0.9485            | 0.0003               | 0.0           | 0.0            | 0.8589         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8353    | 0.0      | 0.0      | 0.7067   | 0.9433       | 0.0003          | 0.0      | 0.0       | 0.6823    | 0.0        | 0.0        |
| 0.6885        | 0.86  | 120  | 0.6347          | 0.2927   | 0.3410        | 0.9138           | 0.9125   | 0.9138 | nan                | nan             | nan           | 0.9545         | 0.0           | 0.0           | 0.9460        | 0.9554            | 0.0308               | 0.0           | 0.0            | 0.8639         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8375    | 0.0      | 0.0      | 0.6959   | 0.9499       | 0.0306          | 0.0      | 0.0       | 0.7059    | 0.0        | 0.0        |
| 0.5029        | 1.0   | 140  | 0.5655          | 0.3029   | 0.3474        | 0.9239           | 0.9226   | 0.9239 | nan                | nan             | nan           | 0.9580         | 0.0           | 0.0           | 0.9636        | 0.9702            | 0.0712               | 0.0           | 0.0            | 0.8579         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8534    | 0.0      | 0.0      | 0.7036   | 0.9611       | 0.0702          | 0.0      | 0.0       | 0.7436    | 0.0        | 0.0        |
| 0.8051        | 1.14  | 160  | 0.4899          | 0.3099   | 0.3541        | 0.9264           | 0.9251   | 0.9264 | nan                | nan             | nan           | 0.9517         | 0.0           | 0.0           | 0.9662        | 0.9698            | 0.1254               | 0.0           | 0.0            | 0.8824         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8608    | 0.0      | 0.0      | 0.7128   | 0.9616       | 0.1227          | 0.0      | 0.0       | 0.7513    | 0.0        | 0.0        |
| 0.6761        | 1.29  | 180  | 0.4900          | 0.3194   | 0.3634        | 0.9298           | 0.9285   | 0.9298 | nan                | nan             | nan           | 0.9553         | 0.0           | 0.0           | 0.9757        | 0.9689            | 0.2073               | 0.0           | 0.0            | 0.8896         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8648    | 0.0      | 0.0      | 0.7204   | 0.9632       | 0.1947          | 0.0      | 0.0       | 0.7706    | 0.0        | 0.0        |
| 0.5982        | 1.43  | 200  | 0.4250          | 0.3234   | 0.3659        | 0.9312           | 0.9299   | 0.9312 | nan                | nan             | nan           | 0.9491         | 0.0           | 0.0           | 0.9651        | 0.9725            | 0.2424               | 0.0           | 0.0            | 0.8964         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8708    | 0.0      | 0.0      | 0.7270   | 0.9640       | 0.2324          | 0.0      | 0.0       | 0.7630    | 0.0        | 0.0        |
| 0.8235        | 1.57  | 220  | 0.3687          | 0.3410   | 0.3857        | 0.9360           | 0.9347   | 0.9360 | nan                | nan             | nan           | 0.9593         | 0.0           | 0.0           | 0.9553        | 0.9751            | 0.4776               | 0.0           | 0.0            | 0.8750         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8701    | 0.0      | 0.0      | 0.7581   | 0.9675       | 0.3710          | 0.0      | 0.0       | 0.7842    | 0.0        | 0.0        |
| 0.4406        | 1.71  | 240  | 0.3593          | 0.3327   | 0.3759        | 0.9363           | 0.9349   | 0.9363 | nan                | nan             | nan           | 0.9531         | 0.0           | 0.0           | 0.9844        | 0.9769            | 0.3335               | 0.0           | 0.0            | 0.8875         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8795    | 0.0      | 0.0      | 0.7271   | 0.9688       | 0.2938          | 0.0      | 0.0       | 0.7911    | 0.0        | 0.0        |
| 0.2359        | 1.86  | 260  | 0.3357          | 0.3587   | 0.4007        | 0.9435           | 0.9422   | 0.9435 | nan                | nan             | nan           | 0.9667         | 0.0           | 0.0           | 0.9348        | 0.9827            | 0.6504               | 0.0           | 0.0            | 0.8728         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8748    | 0.0      | 0.0      | 0.7979   | 0.9746       | 0.4986          | 0.0      | 0.0       | 0.8001    | 0.0        | 0.0        |
| 0.2363        | 2.0   | 280  | 0.2939          | 0.3543   | 0.3987        | 0.9415           | 0.9402   | 0.9415 | nan                | nan             | nan           | 0.9561         | 0.0           | 0.0           | 0.9519        | 0.9772            | 0.6017               | 0.0           | 0.0            | 0.8992         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8772    | 0.0      | 0.0      | 0.7783   | 0.9715       | 0.4691          | 0.0      | 0.0       | 0.8010    | 0.0        | 0.0        |
| 0.2119        | 2.14  | 300  | 0.2770          | 0.3654   | 0.4134        | 0.9454           | 0.9441   | 0.9454 | nan                | nan             | nan           | 0.9654         | 0.0           | 0.0           | 0.8936        | 0.9859            | 0.8318               | 0.0           | 0.0            | 0.8707         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8795    | 0.0      | 0.0      | 0.7971   | 0.9755       | 0.5584          | 0.0      | 0.0       | 0.8086    | 0.0        | 0.0        |
| 0.2184        | 2.29  | 320  | 0.2751          | 0.3506   | 0.3901        | 0.9437           | 0.9423   | 0.9437 | nan                | nan             | nan           | 0.9627         | 0.0           | 0.0           | 0.9732        | 0.9827            | 0.4857               | 0.0           | 0.0            | 0.8864         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8846    | 0.0      | 0.0      | 0.7666   | 0.9749       | 0.4209          | 0.0      | 0.0       | 0.8094    | 0.0        | 0.0        |
| 0.225         | 2.43  | 340  | 0.2479          | 0.3650   | 0.4143        | 0.9464           | 0.9450   | 0.9464 | nan                | nan             | nan           | 0.9571         | 0.0           | 0.0           | 0.9002        | 0.9849            | 0.8195               | 0.0           | 0.0            | 0.8957         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8833    | 0.0      | 0.0      | 0.8045   | 0.9763       | 0.5354          | 0.0      | 0.0       | 0.8159    | 0.0        | 0.0        |
| 0.1887        | 2.57  | 360  | 0.2312          | 0.3620   | 0.4065        | 0.9474           | 0.9461   | 0.9474 | nan                | nan             | nan           | 0.9538         | 0.0001        | 0.0           | 0.9399        | 0.9892            | 0.6989               | 0.0           | 0.0            | 0.8896         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8883    | 0.0001   | 0.0      | 0.7901   | 0.9778       | 0.5032          | 0.0      | 0.0       | 0.8226    | 0.0        | 0.0        |
| 0.2127        | 2.71  | 380  | 0.2341          | 0.3670   | 0.4158        | 0.9473           | 0.9460   | 0.9473 | nan                | nan             | nan           | 0.9455         | 0.0002        | 0.0           | 0.9351        | 0.9856            | 0.8006               | 0.0           | 0.0            | 0.9067         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8880    | 0.0002   | 0.0      | 0.7955   | 0.9759       | 0.5573          | 0.0      | 0.0       | 0.8198    | 0.0        | 0.0        |
| 0.1654        | 2.86  | 400  | 0.2265          | 0.3737   | 0.4223        | 0.9484           | 0.9471   | 0.9484 | nan                | nan             | nan           | 0.9513         | 0.0053        | 0.0           | 0.9251        | 0.9838            | 0.8728               | 0.0           | 0.0            | 0.9070         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8879    | 0.0053   | 0.0      | 0.8146   | 0.9750       | 0.6096          | 0.0      | 0.0       | 0.8182    | 0.0        | 0.0        |
| 0.731         | 3.0   | 420  | 0.2114          | 0.3724   | 0.4229        | 0.9493           | 0.9480   | 0.9493 | nan                | nan             | nan           | 0.9536         | 0.0025        | 0.0           | 0.9450        | 0.9860            | 0.8744               | 0.0           | 0.0            | 0.8907         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8890    | 0.0025   | 0.0      | 0.8194   | 0.9770       | 0.5852          | 0.0      | 0.0       | 0.8236    | 0.0        | 0.0        |
| 0.1501        | 3.14  | 440  | 0.2091          | 0.3786   | 0.4179        | 0.9507           | 0.9494   | 0.9507 | nan                | nan             | nan           | 0.9627         | 0.0156        | 0.0           | 0.9659        | 0.9872            | 0.7839               | 0.0           | 0.0            | 0.8818         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8853    | 0.0155   | 0.0      | 0.8309   | 0.9779       | 0.6345          | 0.0      | 0.0       | 0.8206    | 0.0        | 0.0        |
| 0.1585        | 3.29  | 460  | 0.2390          | 0.3416   | 0.4093        | 0.9361           | 0.9348   | 0.9361 | nan                | nan             | nan           | 0.9590         | 0.0439        | 0.0           | 0.6686        | 0.9864            | 0.9425               | 0.0           | 0.0            | 0.8969         | 0.0             | 0.0051          | nan           | nan        | nan      | 0.8881    | 0.0435   | 0.0      | 0.6189   | 0.9785       | 0.3977          | 0.0      | 0.0       | 0.8261    | 0.0        | 0.0051     |
| 0.2105        | 3.43  | 480  | 0.2061          | 0.3814   | 0.4233        | 0.9509           | 0.9495   | 0.9509 | nan                | nan             | nan           | 0.9367         | 0.0631        | 0.0           | 0.9779        | 0.9873            | 0.7687               | 0.0           | 0.0            | 0.9230         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8857    | 0.0626   | 0.0      | 0.8267   | 0.9784       | 0.6161          | 0.0      | 0.0       | 0.8259    | 0.0        | 0.0        |
| 0.1229        | 3.57  | 500  | 0.1864          | 0.3867   | 0.4318        | 0.9526           | 0.9512   | 0.9526 | nan                | nan             | nan           | 0.9617         | 0.0969        | 0.0           | 0.9250        | 0.9889            | 0.8867               | 0.0           | 0.0            | 0.8905         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8913    | 0.0954   | 0.0      | 0.8283   | 0.9797       | 0.6277          | 0.0      | 0.0       | 0.8307    | 0.0        | 0.0        |
| 0.1553        | 3.71  | 520  | 0.1954          | 0.3703   | 0.4155        | 0.9487           | 0.9474   | 0.9487 | nan                | nan             | nan           | 0.9510         | 0.0632        | 0.0           | 0.9905        | 0.9843            | 0.6810               | 0.0           | 0.0            | 0.9001         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8905    | 0.0623   | 0.0      | 0.7974   | 0.9772       | 0.5145          | 0.0      | 0.0       | 0.8310    | 0.0        | 0.0        |
| 0.578         | 3.86  | 540  | 0.1826          | 0.3876   | 0.4362        | 0.9533           | 0.9519   | 0.9533 | nan                | nan             | nan           | 0.9446         | 0.0772        | 0.0           | 0.9396        | 0.9894            | 0.9350               | 0.0           | 0.0            | 0.9122         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8928    | 0.0763   | 0.0      | 0.8385   | 0.9790       | 0.6404          | 0.0      | 0.0       | 0.8366    | 0.0        | 0.0        |
| 0.5982        | 4.0   | 560  | 0.1771          | 0.4063   | 0.4438        | 0.9543           | 0.9529   | 0.9543 | nan                | nan             | nan           | 0.9626         | 0.2019        | 0.0           | 0.9714        | 0.9835            | 0.8634               | 0.0           | 0.0            | 0.8991         | 0.0             | 0.0             | nan           | nan        | nan      | 0.8923    | 0.1915   | 0.0      | 0.8596   | 0.9764       | 0.7260          | 0.0      | 0.0       | 0.8240    | 0.0        | 0.0        |
| 0.1359        | 4.14  | 580  | 0.1831          | 0.3907   | 0.4422        | 0.9508           | 0.9495   | 0.9508 | nan                | nan             | nan           | 0.9595         | 0.2320        | 0.0           | 0.8736        | 0.9873            | 0.9020               | 0.0           | 0.0            | 0.9007         | 0.0             | 0.0092          | nan           | nan        | nan      | 0.8924    | 0.2194   | 0.0      | 0.7962   | 0.9795       | 0.5664          | 0.0      | 0.0       | 0.8346    | 0.0        | 0.0092     |
| 0.1658        | 4.29  | 600  | 0.1707          | 0.4067   | 0.4408        | 0.9561           | 0.9547   | 0.9561 | nan                | nan             | nan           | 0.9534         | 0.1985        | 0.0           | 0.9843        | 0.9900            | 0.8034               | 0.0           | 0.0            | 0.9041         | 0.0             | 0.0151          | nan           | nan        | nan      | 0.8930    | 0.1902   | 0.0      | 0.8456   | 0.9803       | 0.7104          | 0.0      | 0.0       | 0.8386    | 0.0        | 0.0151     |
| 0.1875        | 4.43  | 620  | 0.1697          | 0.4141   | 0.4478        | 0.9573           | 0.9560   | 0.9573 | nan                | nan             | nan           | 0.9614         | 0.2537        | 0.0           | 0.9822        | 0.9897            | 0.8284               | 0.0           | 0.0            | 0.8945         | 0.0             | 0.0158          | nan           | nan        | nan      | 0.8957    | 0.2344   | 0.0      | 0.8569   | 0.9805       | 0.7332          | 0.0      | 0.0       | 0.8387    | 0.0        | 0.0158     |
| 0.2031        | 4.57  | 640  | 0.1722          | 0.4202   | 0.4635        | 0.9569           | 0.9555   | 0.9569 | nan                | nan             | nan           | 0.9609         | 0.2956        | 0.0           | 0.9354        | 0.9870            | 0.9444               | 0.0           | 0.0            | 0.9065         | 0.0             | 0.0690          | nan           | nan        | nan      | 0.8954    | 0.2740   | 0.0      | 0.8671   | 0.9798       | 0.6973          | 0.0      | 0.0       | 0.8391    | 0.0        | 0.0690     |
| 0.3598        | 4.71  | 660  | 0.1591          | 0.4121   | 0.4476        | 0.9571           | 0.9557   | 0.9571 | nan                | nan             | nan           | 0.9570         | 0.2598        | 0.0           | 0.9834        | 0.9900            | 0.8261               | 0.0           | 0.0            | 0.8988         | 0.0             | 0.0084          | nan           | nan        | nan      | 0.8961    | 0.2428   | 0.0      | 0.8567   | 0.9801       | 0.7091          | 0.0      | 0.0       | 0.8396    | 0.0        | 0.0084     |
| 0.1246        | 4.86  | 680  | 0.1563          | 0.4341   | 0.4739        | 0.9589           | 0.9575   | 0.9589 | nan                | nan             | nan           | 0.9551         | 0.4169        | 0.0           | 0.9483        | 0.9893            | 0.9242               | 0.0           | 0.0            | 0.9107         | 0.0             | 0.0684          | nan           | nan        | nan      | 0.8954    | 0.3565   | 0.0      | 0.8790   | 0.9809       | 0.7531          | 0.0      | 0.0       | 0.8413    | 0.0        | 0.0684     |
| 0.1466        | 5.0   | 700  | 0.1606          | 0.4360   | 0.4780        | 0.9576           | 0.9563   | 0.9576 | nan                | nan             | nan           | 0.9497         | 0.3199        | 0.0           | 0.9667        | 0.9903            | 0.9314               | 0.0           | 0.0            | 0.9019         | 0.0             | 0.1985          | nan           | nan        | nan      | 0.8944    | 0.2928   | 0.0      | 0.8715   | 0.9804       | 0.7204          | 0.0      | 0.0       | 0.8384    | 0.0        | 0.1977     |
| 0.0939        | 5.14  | 720  | 0.1576          | 0.4318   | 0.4676        | 0.9583           | 0.9569   | 0.9583 | nan                | nan             | nan           | 0.9553         | 0.3883        | 0.0           | 0.9774        | 0.9906            | 0.8764               | 0.0           | 0.0            | 0.8950         | 0.0             | 0.0604          | nan           | nan        | nan      | 0.8955    | 0.3484   | 0.0      | 0.8673   | 0.9798       | 0.7602          | 0.0      | 0.0       | 0.8385    | 0.0        | 0.0604     |
| 0.1259        | 5.29  | 740  | 0.1556          | 0.4369   | 0.4734        | 0.9593           | 0.9579   | 0.9593 | nan                | nan             | nan           | 0.9518         | 0.3998        | 0.0           | 0.9763        | 0.9888            | 0.9027               | 0.0           | 0.0            | 0.9131         | 0.0             | 0.0753          | nan           | nan        | nan      | 0.8957    | 0.3566   | 0.0      | 0.8757   | 0.9807       | 0.7793          | 0.0      | 0.0       | 0.8422    | 0.0        | 0.0753     |
| 0.2505        | 5.43  | 760  | 0.1541          | 0.4389   | 0.4717        | 0.9599           | 0.9586   | 0.9599 | nan                | nan             | nan           | 0.9572         | 0.4771        | 0.0           | 0.9725        | 0.9911            | 0.8597               | 0.0           | 0.0            | 0.9015         | 0.0             | 0.0297          | nan           | nan        | nan      | 0.8957    | 0.4047   | 0.0      | 0.8766   | 0.9812       | 0.7984          | 0.0      | 0.0       | 0.8420    | 0.0        | 0.0297     |
| 0.1265        | 5.57  | 780  | 0.1510          | 0.4383   | 0.4795        | 0.9587           | 0.9573   | 0.9587 | nan                | nan             | nan           | 0.9469         | 0.3689        | 0.0           | 0.9623        | 0.9903            | 0.9512               | 0.0           | 0.0            | 0.9116         | 0.0             | 0.1431          | nan           | nan        | nan      | 0.8954    | 0.3283   | 0.0      | 0.8848   | 0.9800       | 0.7498          | 0.0      | 0.0       | 0.8397    | 0.0        | 0.1431     |
| 0.1274        | 5.71  | 800  | 0.1512          | 0.4345   | 0.4731        | 0.9588           | 0.9575   | 0.9588 | nan                | nan             | nan           | 0.9402         | 0.3510        | 0.0           | 0.9791        | 0.9895            | 0.9216               | 0.0           | 0.0            | 0.9260         | 0.0             | 0.0965          | nan           | nan        | nan      | 0.8942    | 0.3207   | 0.0      | 0.8790   | 0.9808       | 0.7671          | 0.0      | 0.0       | 0.8410    | 0.0        | 0.0965     |
| 0.0843        | 5.86  | 820  | 0.1669          | 0.4440   | 0.4974        | 0.9544           | 0.9531   | 0.9544 | nan                | nan             | nan           | 0.9544         | 0.3733        | 0.0           | 0.8850        | 0.9906            | 0.9223               | 0.0           | 0.0            | 0.9018         | 0.0             | 0.4444          | nan           | nan        | nan      | 0.8981    | 0.3346   | 0.0      | 0.8133   | 0.9815       | 0.5881          | 0.0      | 0.0       | 0.8417    | 0.0        | 0.4267     |
| 0.1215        | 6.0   | 840  | 0.1484          | 0.4713   | 0.5077        | 0.9607           | 0.9593   | 0.9607 | nan                | nan             | nan           | 0.9570         | 0.4344        | 0.0           | 0.9714        | 0.9935            | 0.9203               | 0.0           | 0.0            | 0.8881         | 0.0             | 0.4199          | nan           | nan        | nan      | 0.8984    | 0.3872   | 0.0      | 0.8938   | 0.9808       | 0.7756          | 0.0      | 0.0       | 0.8401    | 0.0        | 0.4082     |
| 0.1682        | 6.14  | 860  | 0.1468          | 0.4500   | 0.4834        | 0.9592           | 0.9578   | 0.9592 | nan                | nan             | nan           | 0.9596         | 0.3839        | 0.0           | 0.9824        | 0.9903            | 0.8180               | 0.0           | 0.0            | 0.8994         | 0.0             | 0.2838          | nan           | nan        | nan      | 0.8977    | 0.3488   | 0.0      | 0.8656   | 0.9815       | 0.7313          | 0.0      | 0.0       | 0.8425    | 0.0        | 0.2822     |
| 0.3355        | 6.29  | 880  | 0.1455          | 0.4686   | 0.5039        | 0.9613           | 0.9599   | 0.9613 | nan                | nan             | nan           | 0.9598         | 0.4413        | 0.0           | 0.9632        | 0.9928            | 0.9298               | 0.0           | 0.0            | 0.8934         | 0.0             | 0.3626          | nan           | nan        | nan      | 0.8990    | 0.3934   | 0.0      | 0.8945   | 0.9815       | 0.7858          | 0.0      | 0.0       | 0.8429    | 0.0        | 0.3570     |
| 0.0971        | 6.43  | 900  | 0.1472          | 0.4519   | 0.4959        | 0.9590           | 0.9576   | 0.9590 | nan                | nan             | nan           | 0.9513         | 0.3458        | 0.0           | 0.9477        | 0.9892            | 0.9526               | 0.0           | 0.0            | 0.9174         | 0.0             | 0.3513          | nan           | nan        | nan      | 0.8994    | 0.3112   | 0.0      | 0.8801   | 0.9808       | 0.7064          | 0.0      | 0.0       | 0.8453    | 0.0        | 0.3477     |
| 0.1552        | 6.57  | 920  | 0.1433          | 0.4738   | 0.5141        | 0.9610           | 0.9597   | 0.9610 | nan                | nan             | nan           | 0.9523         | 0.5074        | 0.0           | 0.9679        | 0.9910            | 0.9222               | 0.0           | 0.0            | 0.9065         | 0.0             | 0.4077          | nan           | nan        | nan      | 0.8989    | 0.4297   | 0.0      | 0.8913   | 0.9811       | 0.7693          | 0.0      | 0.0       | 0.8458    | 0.0        | 0.3961     |
| 0.1151        | 6.71  | 940  | 0.1473          | 0.4768   | 0.5158        | 0.9608           | 0.9594   | 0.9608 | nan                | nan             | nan           | 0.9530         | 0.5088        | 0.0           | 0.9800        | 0.9885            | 0.9050               | 0.0           | 0.0            | 0.9106         | 0.0             | 0.4285          | nan           | nan        | nan      | 0.8986    | 0.4313   | 0.0      | 0.8878   | 0.9808       | 0.7872          | 0.0      | 0.0       | 0.8431    | 0.0        | 0.4154     |
| 0.2099        | 6.86  | 960  | 0.1502          | 0.4587   | 0.5028        | 0.9586           | 0.9572   | 0.9586 | nan                | nan             | nan           | 0.9650         | 0.4765        | 0.0           | 0.9276        | 0.9891            | 0.9417               | 0.0           | 0.0            | 0.8921         | 0.0             | 0.3382          | nan           | nan        | nan      | 0.8972    | 0.4107   | 0.0      | 0.8711   | 0.9809       | 0.7131          | 0.0      | 0.0       | 0.8384    | 0.0        | 0.3347     |
| 0.2762        | 7.0   | 980  | 0.1442          | 0.4743   | 0.5142        | 0.9601           | 0.9588   | 0.9601 | nan                | nan             | nan           | 0.9398         | 0.4370        | 0.0           | 0.9814        | 0.9912            | 0.9093               | 0.0           | 0.0            | 0.9209         | 0.0             | 0.4767          | nan           | nan        | nan      | 0.8959    | 0.3900   | 0.0      | 0.8857   | 0.9811       | 0.7671          | 0.0      | 0.0       | 0.8432    | 0.0        | 0.4543     |
| 0.0799        | 7.14  | 1000 | 0.1367          | 0.4826   | 0.5191        | 0.9621           | 0.9608   | 0.9621 | nan                | nan             | nan           | 0.9605         | 0.5247        | 0.0           | 0.9708        | 0.9904            | 0.9177               | 0.0           | 0.0            | 0.9006         | 0.0             | 0.4460          | nan           | nan        | nan      | 0.9000    | 0.4490   | 0.0      | 0.8952   | 0.9819       | 0.8077          | 0.0      | 0.0       | 0.8447    | 0.0        | 0.4302     |
| 0.1172        | 7.29  | 1020 | 0.1406          | 0.4481   | 0.4845        | 0.9613           | 0.9600   | 0.9613 | nan                | nan             | nan           | 0.9592         | 0.4708        | 0.0           | 0.9681        | 0.9919            | 0.9423               | 0.0           | 0.0            | 0.8950         | 0.0             | 0.1024          | nan           | nan        | nan      | 0.8985    | 0.4164   | 0.0      | 0.8987   | 0.9816       | 0.7883          | 0.0      | 0.0       | 0.8432    | 0.0        | 0.1024     |
| 0.138         | 7.43  | 1040 | 0.1432          | 0.4562   | 0.4969        | 0.9600           | 0.9586   | 0.9600 | nan                | nan             | nan           | 0.9597         | 0.4952        | 0.0           | 0.9583        | 0.9908            | 0.9360               | 0.0           | 0.0            | 0.8911         | 0.0             | 0.2353          | nan           | nan        | nan      | 0.8973    | 0.4328   | 0.0      | 0.8856   | 0.9814       | 0.7475          | 0.0      | 0.0       | 0.8401    | 0.0        | 0.2335     |
| 0.1024        | 7.57  | 1060 | 0.1409          | 0.4575   | 0.5003        | 0.9598           | 0.9584   | 0.9598 | nan                | nan             | nan           | 0.9491         | 0.5201        | 0.0           | 0.9463        | 0.9917            | 0.9336               | 0.0           | 0.0            | 0.9089         | 0.0             | 0.2537          | nan           | nan        | nan      | 0.8971    | 0.4481   | 0.0      | 0.8772   | 0.9818       | 0.7320          | 0.0      | 0.0       | 0.8427    | 0.0        | 0.2534     |
| 0.1077        | 7.71  | 1080 | 0.1373          | 0.4746   | 0.5131        | 0.9612           | 0.9598   | 0.9612 | nan                | nan             | nan           | 0.9532         | 0.5782        | 0.0           | 0.9693        | 0.9931            | 0.9034               | 0.0           | 0.0            | 0.8949         | 0.0             | 0.3520          | nan           | nan        | nan      | 0.8979    | 0.4756   | 0.0      | 0.8962   | 0.9811       | 0.7800          | 0.0      | 0.0       | 0.8415    | 0.0        | 0.3482     |
| 0.083         | 7.86  | 1100 | 0.1438          | 0.4643   | 0.5097        | 0.9592           | 0.9579   | 0.9592 | nan                | nan             | nan           | 0.9574         | 0.5304        | 0.0           | 0.9321        | 0.9903            | 0.9214               | 0.0           | 0.0            | 0.9021         | 0.0             | 0.3733          | nan           | nan        | nan      | 0.8989    | 0.4567   | 0.0      | 0.8604   | 0.9820       | 0.6957          | 0.0      | 0.0       | 0.8453    | 0.0        | 0.3679     |
| 0.0995        | 8.0   | 1120 | 0.1415          | 0.4698   | 0.5154        | 0.9600           | 0.9586   | 0.9600 | nan                | nan             | nan           | 0.9566         | 0.5671        | 0.0           | 0.9245        | 0.9917            | 0.9337               | 0.0           | 0.0            | 0.9029         | 0.0             | 0.3926          | nan           | nan        | nan      | 0.9001    | 0.4768   | 0.0      | 0.8652   | 0.9819       | 0.7139          | 0.0      | 0.0       | 0.8462    | 0.0        | 0.3840     |
| 0.2425        | 8.14  | 1140 | 0.1358          | 0.4782   | 0.5160        | 0.9625           | 0.9611   | 0.9625 | nan                | nan             | nan           | 0.9541         | 0.5286        | 0.0           | 0.9699        | 0.9907            | 0.9397               | 0.0           | 0.0            | 0.9117         | 0.0             | 0.3810          | nan           | nan        | nan      | 0.9007    | 0.4587   | 0.0      | 0.9011   | 0.9820       | 0.7968          | 0.0      | 0.0       | 0.8475    | 0.0        | 0.3739     |
| 0.1021        | 8.29  | 1160 | 0.1360          | 0.4856   | 0.5262        | 0.9621           | 0.9608   | 0.9621 | nan                | nan             | nan           | 0.9539         | 0.5049        | 0.0           | 0.9712        | 0.9920            | 0.9307               | 0.0           | 0.0            | 0.9045         | 0.0             | 0.5309          | nan           | nan        | nan      | 0.8999    | 0.4466   | 0.0      | 0.8963   | 0.9818       | 0.8015          | 0.0      | 0.0       | 0.8452    | 0.0        | 0.4703     |
| 0.1072        | 8.43  | 1180 | 0.1375          | 0.4791   | 0.5269        | 0.9612           | 0.9599   | 0.9612 | nan                | nan             | nan           | 0.9508         | 0.4288        | 0.0           | 0.9602        | 0.9924            | 0.9653               | 0.0           | 0.0            | 0.9063         | 0.0             | 0.5926          | nan           | nan        | nan      | 0.9006    | 0.3840   | 0.0      | 0.8957   | 0.9817       | 0.7540          | 0.0      | 0.0       | 0.8459    | 0.0        | 0.5085     |
| 0.0716        | 8.57  | 1200 | 0.1341          | 0.4884   | 0.5286        | 0.9618           | 0.9604   | 0.9618 | nan                | nan             | nan           | 0.9479         | 0.5253        | 0.0           | 0.9777        | 0.9920            | 0.8920               | 0.0           | 0.0            | 0.9134         | 0.0             | 0.5667          | nan           | nan        | nan      | 0.8985    | 0.4596   | 0.0      | 0.8929   | 0.9818       | 0.7940          | 0.0      | 0.0       | 0.8450    | 0.0        | 0.5002     |
| 0.8156        | 8.71  | 1220 | 0.1355          | 0.4860   | 0.5271        | 0.9622           | 0.9609   | 0.9622 | nan                | nan             | nan           | 0.9578         | 0.5614        | 0.0           | 0.9535        | 0.9910            | 0.9468               | 0.0           | 0.0            | 0.9049         | 0.0             | 0.4832          | nan           | nan        | nan      | 0.8999    | 0.4748   | 0.0      | 0.8948   | 0.9823       | 0.7988          | 0.0      | 0.0       | 0.8456    | 0.0        | 0.4497     |
| 0.4388        | 8.86  | 1240 | 0.1330          | 0.4806   | 0.5202        | 0.9623           | 0.9610   | 0.9623 | nan                | nan             | nan           | 0.9536         | 0.5331        | 0.0           | 0.9690        | 0.9907            | 0.9495               | 0.0           | 0.0            | 0.9093         | 0.0             | 0.4176          | nan           | nan        | nan      | 0.9002    | 0.4625   | 0.0      | 0.8978   | 0.9821       | 0.7981          | 0.0      | 0.0       | 0.8465    | 0.0        | 0.3999     |
| 0.1236        | 9.0   | 1260 | 0.1360          | 0.4680   | 0.5032        | 0.9615           | 0.9602   | 0.9615 | nan                | nan             | nan           | 0.9658         | 0.5805        | 0.0           | 0.9650        | 0.9907            | 0.9245               | 0.0           | 0.0            | 0.8853         | 0.0             | 0.2232          | nan           | nan        | nan      | 0.8980    | 0.4929   | 0.0      | 0.8999   | 0.9810       | 0.8165          | 0.0      | 0.0       | 0.8378    | 0.0        | 0.2223     |
| 0.1275        | 9.14  | 1280 | 0.1341          | 0.4771   | 0.5165        | 0.9621           | 0.9607   | 0.9621 | nan                | nan             | nan           | 0.9493         | 0.5477        | 0.0           | 0.9676        | 0.9913            | 0.9542               | 0.0           | 0.0            | 0.9123         | 0.0             | 0.3587          | nan           | nan        | nan      | 0.8995    | 0.4726   | 0.0      | 0.9009   | 0.9813       | 0.7938          | 0.0      | 0.0       | 0.8468    | 0.0        | 0.3534     |
| 0.1358        | 9.29  | 1300 | 0.1325          | 0.4846   | 0.5225        | 0.9625           | 0.9612   | 0.9625 | nan                | nan             | nan           | 0.9572         | 0.5806        | 0.0           | 0.9758        | 0.9911            | 0.9141               | 0.0           | 0.0            | 0.9014         | 0.0             | 0.4272          | nan           | nan        | nan      | 0.9005    | 0.4941   | 0.0      | 0.8978   | 0.9819       | 0.8040          | 0.0      | 0.0       | 0.8462    | 0.0        | 0.4065     |
| 0.2225        | 9.43  | 1320 | 0.1356          | 0.4911   | 0.5317        | 0.9625           | 0.9612   | 0.9625 | nan                | nan             | nan           | 0.9443         | 0.5646        | 0.0           | 0.9688        | 0.9933            | 0.9342               | 0.0           | 0.0            | 0.9157         | 0.0             | 0.5281          | nan           | nan        | nan      | 0.8989    | 0.4818   | 0.0      | 0.9023   | 0.9817       | 0.8111          | 0.0      | 0.0       | 0.8467    | 0.0        | 0.4795     |
| 0.0823        | 9.57  | 1340 | 0.1307          | 0.4910   | 0.5318        | 0.9626           | 0.9613   | 0.9626 | nan                | nan             | nan           | 0.9577         | 0.5417        | 0.0           | 0.9813        | 0.9904            | 0.9050               | 0.0           | 0.0            | 0.9041         | 0.0             | 0.5696          | nan           | nan        | nan      | 0.9013    | 0.4712   | 0.0      | 0.8923   | 0.9821       | 0.8185          | 0.0      | 0.0       | 0.8464    | 0.0        | 0.4895     |
| 0.0876        | 9.71  | 1360 | 0.1309          | 0.4912   | 0.5326        | 0.9631           | 0.9617   | 0.9631 | nan                | nan             | nan           | 0.9535         | 0.5959        | 0.0           | 0.9668        | 0.9912            | 0.9482               | 0.0           | 0.0            | 0.9094         | 0.0             | 0.4939          | nan           | nan        | nan      | 0.9009    | 0.4999   | 0.0      | 0.9004   | 0.9823       | 0.8172          | 0.0      | 0.0       | 0.8482    | 0.0        | 0.4548     |
| 0.0759        | 9.86  | 1380 | 0.1292          | 0.4913   | 0.5318        | 0.9630           | 0.9617   | 0.9630 | nan                | nan             | nan           | 0.9559         | 0.5515        | 0.0           | 0.9692        | 0.9909            | 0.9454               | 0.0           | 0.0            | 0.9083         | 0.0             | 0.5285          | nan           | nan        | nan      | 0.9011    | 0.4756   | 0.0      | 0.9014   | 0.9824       | 0.8167          | 0.0      | 0.0       | 0.8476    | 0.0        | 0.4799     |
| 0.2511        | 10.0  | 1400 | 0.1301          | 0.4906   | 0.5296        | 0.9632           | 0.9618   | 0.9632 | nan                | nan             | nan           | 0.9551         | 0.5325        | 0.0           | 0.9722        | 0.9918            | 0.9395               | 0.0           | 0.0            | 0.9074         | 0.0             | 0.5267          | nan           | nan        | nan      | 0.9015    | 0.4652   | 0.0      | 0.9023   | 0.9822       | 0.8138          | 0.0      | 0.0       | 0.8488    | 0.0        | 0.4827     |
| 0.4786        | 10.14 | 1420 | 0.1287          | 0.4975   | 0.5420        | 0.9629           | 0.9616   | 0.9629 | nan                | nan             | nan           | 0.9559         | 0.5693        | 0.0           | 0.9712        | 0.9918            | 0.9358               | 0.0           | 0.0            | 0.9016         | 0.0             | 0.6368          | nan           | nan        | nan      | 0.9011    | 0.4869   | 0.0      | 0.9010   | 0.9819       | 0.8150          | 0.0      | 0.0       | 0.8467    | 0.0        | 0.5395     |
| 0.1047        | 10.29 | 1440 | 0.1301          | 0.4970   | 0.5473        | 0.9628           | 0.9615   | 0.9628 | nan                | nan             | nan           | 0.9494         | 0.5572        | 0.0           | 0.9682        | 0.9924            | 0.9558               | 0.0           | 0.0            | 0.9087         | 0.0             | 0.6887          | nan           | nan        | nan      | 0.9009    | 0.4814   | 0.0      | 0.9003   | 0.9819       | 0.8111          | 0.0      | 0.0       | 0.8471    | 0.0        | 0.5442     |
| 0.0776        | 10.43 | 1460 | 0.1319          | 0.4871   | 0.5234        | 0.9632           | 0.9618   | 0.9632 | nan                | nan             | nan           | 0.9573         | 0.5652        | 0.0           | 0.9672        | 0.9920            | 0.9221               | 0.0           | 0.0            | 0.9058         | 0.0             | 0.4477          | nan           | nan        | nan      | 0.9011    | 0.4858   | 0.0      | 0.9006   | 0.9826       | 0.8120          | 0.0      | 0.0       | 0.8480    | 0.0        | 0.4282     |
| 0.1874        | 10.57 | 1480 | 0.1328          | 0.4849   | 0.5242        | 0.9622           | 0.9609   | 0.9622 | nan                | nan             | nan           | 0.9453         | 0.5433        | 0.0           | 0.9742        | 0.9918            | 0.9365               | 0.0           | 0.0            | 0.9173         | 0.0             | 0.4577          | nan           | nan        | nan      | 0.8989    | 0.4724   | 0.0      | 0.8973   | 0.9820       | 0.8020          | 0.0      | 0.0       | 0.8466    | 0.0        | 0.4346     |
| 0.1245        | 10.71 | 1500 | 0.1341          | 0.4814   | 0.5321        | 0.9605           | 0.9592   | 0.9605 | nan                | nan             | nan           | 0.9515         | 0.5632        | 0.0           | 0.9381        | 0.9920            | 0.9577               | 0.0           | 0.0            | 0.9038         | 0.0             | 0.5465          | nan           | nan        | nan      | 0.9002    | 0.4759   | 0.0      | 0.8733   | 0.9818       | 0.7319          | 0.0      | 0.0       | 0.8463    | 0.0        | 0.4861     |
| 0.168         | 10.86 | 1520 | 0.1299          | 0.4950   | 0.5386        | 0.9627           | 0.9614   | 0.9627 | nan                | nan             | nan           | 0.9489         | 0.6060        | 0.0           | 0.9779        | 0.9913            | 0.9165               | 0.0           | 0.0            | 0.9121         | 0.0             | 0.5720          | nan           | nan        | nan      | 0.8999    | 0.5068   | 0.0      | 0.8955   | 0.9823       | 0.8136          | 0.0      | 0.0       | 0.8471    | 0.0        | 0.5002     |
| 0.0964        | 11.0  | 1540 | 0.1302          | 0.4905   | 0.5280        | 0.9631           | 0.9617   | 0.9631 | nan                | nan             | nan           | 0.9598         | 0.5714        | 0.0           | 0.9731        | 0.9921            | 0.9275               | 0.0           | 0.0            | 0.8958         | 0.0             | 0.4887          | nan           | nan        | nan      | 0.9010    | 0.4928   | 0.0      | 0.8997   | 0.9823       | 0.8221          | 0.0      | 0.0       | 0.8461    | 0.0        | 0.4515     |
| 0.1577        | 11.14 | 1560 | 0.1287          | 0.4924   | 0.5295        | 0.9633           | 0.9620   | 0.9633 | nan                | nan             | nan           | 0.9590         | 0.5793        | 0.0           | 0.9717        | 0.9921            | 0.9197               | 0.0           | 0.0            | 0.9002         | 0.0             | 0.5025          | nan           | nan        | nan      | 0.9010    | 0.4966   | 0.0      | 0.9014   | 0.9826       | 0.8220          | 0.0      | 0.0       | 0.8472    | 0.0        | 0.4656     |
| 0.0964        | 11.29 | 1580 | 0.1306          | 0.5029   | 0.5453        | 0.9635           | 0.9621   | 0.9635 | nan                | nan             | nan           | 0.9554         | 0.6552        | 0.0           | 0.9646        | 0.9922            | 0.9120               | 0.0           | 0.0            | 0.9061         | 0.0             | 0.6123          | nan           | nan        | nan      | 0.9008    | 0.5347   | 0.0      | 0.9020   | 0.9824       | 0.8341          | 0.0      | 0.0       | 0.8469    | 0.0        | 0.5306     |
| 0.0671        | 11.43 | 1600 | 0.1286          | 0.4580   | 0.5459        | 0.9631           | 0.9617   | 0.9631 | nan                | nan             | nan           | 0.9507         | 0.5853        | 0.0           | 0.9721        | 0.9910            | 0.9521               | 0.0           | 0.0            | 0.9116         | 0.0             | 0.6425          | nan           | 0.0        | nan      | 0.9007    | 0.5006   | 0.0      | 0.9038   | 0.9821       | 0.8122          | 0.0      | 0.0       | 0.8478    | 0.0        | 0.5490     |
| 0.0625        | 11.57 | 1620 | 0.1283          | 0.4568   | 0.5442        | 0.9630           | 0.9616   | 0.9630 | nan                | nan             | nan           | 0.9497         | 0.5601        | 0.0           | 0.9737        | 0.9909            | 0.9549               | 0.0           | 0.0            | 0.9137         | 0.0             | 0.6434          | nan           | 0.0        | nan      | 0.9007    | 0.4864   | 0.0      | 0.9029   | 0.9820       | 0.8080          | 0.0      | 0.0       | 0.8484    | 0.0        | 0.5524     |
| 0.2409        | 11.71 | 1640 | 0.1279          | 0.5020   | 0.5425        | 0.9637           | 0.9624   | 0.9637 | nan                | nan             | nan           | 0.9575         | 0.6471        | 0.0           | 0.9666        | 0.9923            | 0.9181               | 0.0           | 0.0            | 0.9026         | 0.0             | 0.5827          | nan           | nan        | nan      | 0.9015    | 0.5342   | 0.0      | 0.9029   | 0.9824       | 0.8329          | 0.0      | 0.0       | 0.8484    | 0.0        | 0.5197     |
| 0.2031        | 11.86 | 1660 | 0.1285          | 0.4942   | 0.5337        | 0.9633           | 0.9619   | 0.9633 | nan                | nan             | nan           | 0.9598         | 0.5663        | 0.0           | 0.9709        | 0.9921            | 0.9397               | 0.0           | 0.0            | 0.8966         | 0.0             | 0.5451          | nan           | nan        | nan      | 0.9014    | 0.4891   | 0.0      | 0.9035   | 0.9824       | 0.8149          | 0.0      | 0.0       | 0.8467    | 0.0        | 0.4978     |
| 0.2124        | 12.0  | 1680 | 0.1261          | 0.4987   | 0.5406        | 0.9635           | 0.9621   | 0.9635 | nan                | nan             | nan           | 0.9564         | 0.5954        | 0.0           | 0.9707        | 0.9914            | 0.9395               | 0.0           | 0.0            | 0.9050         | 0.0             | 0.5882          | nan           | nan        | nan      | 0.9017    | 0.5067   | 0.0      | 0.9031   | 0.9824       | 0.8218          | 0.0      | 0.0       | 0.8478    | 0.0        | 0.5217     |
| 0.0926        | 12.14 | 1700 | 0.1264          | 0.4975   | 0.5383        | 0.9633           | 0.9619   | 0.9633 | nan                | nan             | nan           | 0.9521         | 0.5875        | 0.0           | 0.9758        | 0.9919            | 0.9230               | 0.0           | 0.0            | 0.9097         | 0.0             | 0.5817          | nan           | nan        | nan      | 0.9015    | 0.5014   | 0.0      | 0.9011   | 0.9823       | 0.8136          | 0.0      | 0.0       | 0.8485    | 0.0        | 0.5236     |
| 0.1363        | 12.29 | 1720 | 0.1282          | 0.4577   | 0.5433        | 0.9633           | 0.9619   | 0.9633 | nan                | nan             | nan           | 0.9532         | 0.5944        | 0.0           | 0.9669        | 0.9922            | 0.9425               | 0.0           | 0.0            | 0.9066         | 0.0             | 0.6203          | nan           | 0.0        | nan      | 0.9014    | 0.5030   | 0.0      | 0.9042   | 0.9820       | 0.8129          | 0.0      | 0.0       | 0.8482    | 0.0        | 0.5403     |
| 0.1563        | 12.43 | 1740 | 0.1274          | 0.4570   | 0.5444        | 0.9632           | 0.9618   | 0.9632 | nan                | nan             | nan           | 0.9524         | 0.5784        | 0.0           | 0.9659        | 0.9918            | 0.9513               | 0.0           | 0.0            | 0.9095         | 0.0             | 0.6391          | nan           | 0.0        | nan      | 0.9015    | 0.4957   | 0.0      | 0.9031   | 0.9821       | 0.8053          | 0.0      | 0.0       | 0.8493    | 0.0        | 0.5468     |
| 0.0727        | 12.57 | 1760 | 0.1274          | 0.4593   | 0.5446        | 0.9635           | 0.9622   | 0.9635 | nan                | nan             | nan           | 0.9565         | 0.6029        | 0.0           | 0.9704        | 0.9919            | 0.9294               | 0.0           | 0.0            | 0.9034         | 0.0             | 0.6365          | nan           | 0.0        | nan      | 0.9019    | 0.5113   | 0.0      | 0.9034   | 0.9823       | 0.8179          | 0.0      | 0.0       | 0.8482    | 0.0        | 0.5469     |
| 0.156         | 12.71 | 1780 | 0.1265          | 0.4569   | 0.5446        | 0.9631           | 0.9617   | 0.9631 | nan                | nan             | nan           | 0.9489         | 0.5649        | 0.0           | 0.9729        | 0.9913            | 0.9491               | 0.0           | 0.0            | 0.9150         | 0.0             | 0.6490          | nan           | 0.0        | nan      | 0.9011    | 0.4881   | 0.0      | 0.9036   | 0.9822       | 0.8066          | 0.0      | 0.0       | 0.8485    | 0.0        | 0.5526     |
| 0.4316        | 12.86 | 1800 | 0.1280          | 0.4971   | 0.5344        | 0.9631           | 0.9618   | 0.9631 | nan                | nan             | nan           | 0.9586         | 0.6084        | 0.0           | 0.9768        | 0.9924            | 0.8684               | 0.0           | 0.0            | 0.9005         | 0.0             | 0.5730          | nan           | nan        | nan      | 0.9013    | 0.5179   | 0.0      | 0.8950   | 0.9825       | 0.8087          | 0.0      | 0.0       | 0.8474    | 0.0        | 0.5150     |
| 0.7124        | 13.0  | 1820 | 0.1263          | 0.4572   | 0.5396        | 0.9635           | 0.9621   | 0.9635 | nan                | nan             | nan           | 0.9546         | 0.5731        | 0.0           | 0.9748        | 0.9918            | 0.9337               | 0.0           | 0.0            | 0.9067         | 0.0             | 0.6010          | nan           | 0.0        | nan      | 0.9014    | 0.4998   | 0.0      | 0.9029   | 0.9824       | 0.8226          | 0.0      | 0.0       | 0.8482    | 0.0        | 0.5287     |
| 0.6906        | 13.14 | 1840 | 0.1271          | 0.4926   | 0.5360        | 0.9628           | 0.9615   | 0.9628 | nan                | nan             | nan           | 0.9543         | 0.5478        | 0.0           | 0.9670        | 0.9916            | 0.9618               | 0.0           | 0.0            | 0.9050         | 0.0             | 0.5684          | nan           | nan        | nan      | 0.9009    | 0.4768   | 0.0      | 0.9042   | 0.9821       | 0.7961          | 0.0      | 0.0       | 0.8475    | 0.0        | 0.5115     |
| 0.1642        | 13.29 | 1860 | 0.1260          | 0.4982   | 0.5394        | 0.9634           | 0.9621   | 0.9634 | nan                | nan             | nan           | 0.9548         | 0.5920        | 0.0           | 0.9749        | 0.9916            | 0.9378               | 0.0           | 0.0            | 0.9051         | 0.0             | 0.5772          | nan           | nan        | nan      | 0.9014    | 0.5103   | 0.0      | 0.9030   | 0.9822       | 0.8230          | 0.0      | 0.0       | 0.8478    | 0.0        | 0.5124     |
| 0.0953        | 13.43 | 1880 | 0.1275          | 0.4550   | 0.5390        | 0.9630           | 0.9616   | 0.9630 | nan                | nan             | nan           | 0.9512         | 0.5543        | 0.0           | 0.9775        | 0.9929            | 0.9439               | 0.0           | 0.0            | 0.9032         | 0.0             | 0.6061          | nan           | 0.0        | nan      | 0.9009    | 0.4869   | 0.0      | 0.9015   | 0.9817       | 0.8183          | 0.0      | 0.0       | 0.8469    | 0.0        | 0.5244     |
| 0.0846        | 13.57 | 1900 | 0.1264          | 0.4974   | 0.5393        | 0.9633           | 0.9619   | 0.9633 | nan                | nan             | nan           | 0.9517         | 0.5741        | 0.0           | 0.9694        | 0.9924            | 0.9469               | 0.0           | 0.0            | 0.9088         | 0.0             | 0.5889          | nan           | nan        | nan      | 0.9011    | 0.4966   | 0.0      | 0.9040   | 0.9821       | 0.8162          | 0.0      | 0.0       | 0.8482    | 0.0        | 0.5237     |
| 0.1048        | 13.71 | 1920 | 0.1270          | 0.4980   | 0.5398        | 0.9633           | 0.9620   | 0.9633 | nan                | nan             | nan           | 0.9535         | 0.5573        | 0.0           | 0.9715        | 0.9923            | 0.9402               | 0.0           | 0.0            | 0.9068         | 0.0             | 0.6166          | nan           | nan        | nan      | 0.9013    | 0.4871   | 0.0      | 0.9035   | 0.9823       | 0.8162          | 0.0      | 0.0       | 0.8480    | 0.0        | 0.5392     |
| 0.1053        | 13.86 | 1940 | 0.1268          | 0.4594   | 0.5470        | 0.9634           | 0.9621   | 0.9634 | nan                | nan             | nan           | 0.9545         | 0.5956        | 0.0           | 0.9697        | 0.9918            | 0.9450               | 0.0           | 0.0            | 0.9051         | 0.0             | 0.6550          | nan           | 0.0        | nan      | 0.9014    | 0.5089   | 0.0      | 0.9046   | 0.9822       | 0.8196          | 0.0      | 0.0       | 0.8476    | 0.0        | 0.5485     |
| 0.0643        | 14.0  | 1960 | 0.1271          | 0.4576   | 0.5447        | 0.9633           | 0.9620   | 0.9633 | nan                | nan             | nan           | 0.9568         | 0.5641        | 0.0           | 0.9705        | 0.9918            | 0.9498               | 0.0           | 0.0            | 0.9014         | 0.0             | 0.6568          | nan           | 0.0        | nan      | 0.9016    | 0.4914   | 0.0      | 0.9042   | 0.9822       | 0.8167          | 0.0      | 0.0       | 0.8472    | 0.0        | 0.5484     |
| 0.1198        | 14.14 | 1980 | 0.1266          | 0.4594   | 0.5478        | 0.9634           | 0.9620   | 0.9634 | nan                | nan             | nan           | 0.9520         | 0.5894        | 0.0           | 0.9706        | 0.9919            | 0.9522               | 0.0           | 0.0            | 0.9082         | 0.0             | 0.6620          | nan           | 0.0        | nan      | 0.9014    | 0.5052   | 0.0      | 0.9044   | 0.9822       | 0.8167          | 0.0      | 0.0       | 0.8482    | 0.0        | 0.5544     |
| 0.17          | 14.29 | 2000 | 0.1270          | 0.4573   | 0.5444        | 0.9632           | 0.9619   | 0.9632 | nan                | nan             | nan           | 0.9502         | 0.5611        | 0.0           | 0.9708        | 0.9914            | 0.9576               | 0.0           | 0.0            | 0.9136         | 0.0             | 0.6440          | nan           | 0.0        | nan      | 0.9011    | 0.4873   | 0.0      | 0.9046   | 0.9824       | 0.8080          | 0.0      | 0.0       | 0.8487    | 0.0        | 0.5557     |
| 0.089         | 14.43 | 2020 | 0.1257          | 0.4614   | 0.5475        | 0.9637           | 0.9623   | 0.9637 | nan                | nan             | nan           | 0.9534         | 0.6223        | 0.0           | 0.9671        | 0.9925            | 0.9395               | 0.0           | 0.0            | 0.9066         | 0.0             | 0.6410          | nan           | 0.0        | nan      | 0.9015    | 0.5247   | 0.0      | 0.9047   | 0.9823       | 0.8295          | 0.0      | 0.0       | 0.8480    | 0.0        | 0.5465     |
| 0.0741        | 14.57 | 2040 | 0.1257          | 0.4604   | 0.5491        | 0.9634           | 0.9621   | 0.9634 | nan                | nan             | nan           | 0.9490         | 0.6041        | 0.0           | 0.9710        | 0.9919            | 0.9503               | 0.0           | 0.0            | 0.9130         | 0.0             | 0.6604          | nan           | 0.0        | nan      | 0.9011    | 0.5136   | 0.0      | 0.9046   | 0.9822       | 0.8210          | 0.0      | 0.0       | 0.8487    | 0.0        | 0.5538     |
| 0.1272        | 14.71 | 2060 | 0.1255          | 0.4611   | 0.5459        | 0.9637           | 0.9624   | 0.9637 | nan                | nan             | nan           | 0.9527         | 0.6077        | 0.0           | 0.9708        | 0.9923            | 0.9338               | 0.0           | 0.0            | 0.9094         | 0.0             | 0.6384          | nan           | 0.0        | nan      | 0.9016    | 0.5194   | 0.0      | 0.9041   | 0.9824       | 0.8313          | 0.0      | 0.0       | 0.8486    | 0.0        | 0.5456     |
| 0.0926        | 14.86 | 2080 | 0.1251          | 0.4612   | 0.5470        | 0.9637           | 0.9623   | 0.9637 | nan                | nan             | nan           | 0.9554         | 0.6172        | 0.0           | 0.9746        | 0.9922            | 0.9277               | 0.0           | 0.0            | 0.9027         | 0.0             | 0.6476          | nan           | 0.0        | nan      | 0.9018    | 0.5235   | 0.0      | 0.9028   | 0.9823       | 0.8303          | 0.0      | 0.0       | 0.8478    | 0.0        | 0.5461     |
| 0.0588        | 15.0  | 2100 | 0.1258          | 0.4605   | 0.5478        | 0.9636           | 0.9623   | 0.9636 | nan                | nan             | nan           | 0.9531         | 0.6071        | 0.0           | 0.9724        | 0.9911            | 0.9428               | 0.0           | 0.0            | 0.9106         | 0.0             | 0.6488          | nan           | 0.0        | nan      | 0.9017    | 0.5169   | 0.0      | 0.9039   | 0.9824       | 0.8235          | 0.0      | 0.0       | 0.8489    | 0.0        | 0.5487     |


### Framework versions

- Transformers 4.33.2
- Pytorch 2.0.1
- Datasets 3.0.0
- Tokenizers 0.13.3