---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-pt-pl30-4
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-pt-pl30-4

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co/indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1850
- Location Precision: 0.8375
- Location Recall: 0.9178
- Location F1: 0.8758
- Location Number: 73
- Organization Precision: 0.6538
- Organization Recall: 0.7846
- Organization F1: 0.7133
- Organization Number: 65
- Person Precision: 0.8688
- Person Recall: 0.9267
- Person F1: 0.8968
- Person Number: 150
- Quantity Precision: 0.7576
- Quantity Recall: 0.8621
- Quantity F1: 0.8065
- Quantity Number: 29
- Time Precision: 0.7895
- Time Recall: 0.8824
- Time F1: 0.8333
- Time Number: 34
- Overall Precision: 0.8021
- Overall Recall: 0.8889
- Overall F1: 0.8432
- Overall Accuracy: 0.9636

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 1.0106        | 1.0   | 106   | 0.5844          | 0.0                | 0.0             | 0.0         | 73              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.1053           | 0.0133        | 0.0237    | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.0            | 0.0         | 0.0     | 34          | 0.0606            | 0.0057         | 0.0104     | 0.8403           |
| 0.4994        | 2.0   | 212   | 0.3692          | 0.4062             | 0.1781          | 0.2476      | 73              | 0.0625                 | 0.0462              | 0.0531          | 65                  | 0.5672           | 0.76          | 0.6496    | 150           | 0.1364             | 0.1034          | 0.1176      | 29              | 0.5625         | 0.5294      | 0.5455  | 34          | 0.4507            | 0.4302         | 0.4402     | 0.8974           |
| 0.3195        | 3.0   | 318   | 0.2105          | 0.5667             | 0.6986          | 0.6258      | 73              | 0.3548                 | 0.3385              | 0.3465          | 65                  | 0.7614           | 0.8933        | 0.8221    | 150           | 0.5                | 0.5862          | 0.5397      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.6357            | 0.7208         | 0.6756     | 0.9308           |
| 0.2206        | 4.0   | 424   | 0.1735          | 0.6591             | 0.7945          | 0.7205      | 73              | 0.4898                 | 0.7385              | 0.5890          | 65                  | 0.8095           | 0.9067        | 0.8553    | 150           | 0.4773             | 0.7241          | 0.5753      | 29              | 0.8649         | 0.9412      | 0.9014  | 34          | 0.6782            | 0.8405         | 0.7506     | 0.9429           |
| 0.1791        | 5.0   | 530   | 0.1584          | 0.6413             | 0.8082          | 0.7152      | 73              | 0.5281                 | 0.7231              | 0.6104          | 65                  | 0.8204           | 0.9133        | 0.8644    | 150           | 0.5                | 0.7241          | 0.5915      | 29              | 0.6889         | 0.9118      | 0.7848  | 34          | 0.6782            | 0.8405         | 0.7506     | 0.9456           |
| 0.1602        | 6.0   | 636   | 0.1800          | 0.6742             | 0.8219          | 0.7407      | 73              | 0.56                   | 0.8615              | 0.6788          | 65                  | 0.8081           | 0.9267        | 0.8634    | 150           | 0.4898             | 0.8276          | 0.6154      | 29              | 0.6591         | 0.8529      | 0.7436  | 34          | 0.6784            | 0.8775         | 0.7652     | 0.9417           |
| 0.1484        | 7.0   | 742   | 0.1419          | 0.7209             | 0.8493          | 0.7799      | 73              | 0.6047                 | 0.8                 | 0.6887          | 65                  | 0.8373           | 0.9267        | 0.8797    | 150           | 0.5854             | 0.8276          | 0.6857      | 29              | 0.75           | 0.8824      | 0.8108  | 34          | 0.7327            | 0.8746         | 0.7974     | 0.9550           |
| 0.1372        | 8.0   | 848   | 0.1439          | 0.6703             | 0.8356          | 0.7439      | 73              | 0.6047                 | 0.8                 | 0.6887          | 65                  | 0.8476           | 0.9267        | 0.8854    | 150           | 0.5854             | 0.8276          | 0.6857      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7275            | 0.8746         | 0.7943     | 0.9527           |
| 0.1271        | 9.0   | 954   | 0.1298          | 0.7683             | 0.8630          | 0.8129      | 73              | 0.5889                 | 0.8154              | 0.6839          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.6944             | 0.8621          | 0.7692      | 29              | 0.8205         | 0.9412      | 0.8767  | 34          | 0.7709            | 0.8917         | 0.8269     | 0.9584           |
| 0.1255        | 10.0  | 1060  | 0.1276          | 0.7875             | 0.8630          | 0.8235      | 73              | 0.6296                 | 0.7846              | 0.6986          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.6410             | 0.8621          | 0.7353      | 29              | 0.8378         | 0.9118      | 0.8732  | 34          | 0.7823            | 0.8803         | 0.8284     | 0.9601           |
| 0.118         | 11.0  | 1166  | 0.1304          | 0.7654             | 0.8493          | 0.8052      | 73              | 0.6190                 | 0.8                 | 0.6980          | 65                  | 0.8616           | 0.9133        | 0.8867    | 150           | 0.6410             | 0.8621          | 0.7353      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.7631            | 0.8718         | 0.8138     | 0.9584           |
| 0.1125        | 12.0  | 1272  | 0.1426          | 0.7294             | 0.8493          | 0.7848      | 73              | 0.6548                 | 0.8462              | 0.7383          | 65                  | 0.8434           | 0.9333        | 0.8861    | 150           | 0.6410             | 0.8621          | 0.7353      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7518            | 0.8889         | 0.8146     | 0.9559           |
| 0.1032        | 13.0  | 1378  | 0.1318          | 0.7821             | 0.8356          | 0.8079      | 73              | 0.6087                 | 0.8615              | 0.7134          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6579             | 0.8621          | 0.7463      | 29              | 0.8824         | 0.8824      | 0.8824  | 34          | 0.775             | 0.8832         | 0.8256     | 0.9594           |
| 0.1046        | 14.0  | 1484  | 0.1450          | 0.7294             | 0.8493          | 0.7848      | 73              | 0.6207                 | 0.8308              | 0.7105          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.65               | 0.8966          | 0.7536      | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.7464            | 0.8803         | 0.8078     | 0.9564           |
| 0.0969        | 15.0  | 1590  | 0.1328          | 0.7683             | 0.8630          | 0.8129      | 73              | 0.6386                 | 0.8154              | 0.7162          | 65                  | 0.8726           | 0.9133        | 0.8925    | 150           | 0.6944             | 0.8621          | 0.7692      | 29              | 0.8378         | 0.9118      | 0.8732  | 34          | 0.7823            | 0.8803         | 0.8284     | 0.9619           |
| 0.0916        | 16.0  | 1696  | 0.1359          | 0.8                | 0.8767          | 0.8366      | 73              | 0.6753                 | 0.8                 | 0.7324          | 65                  | 0.8642           | 0.9333        | 0.8974    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7888            | 0.8832         | 0.8333     | 0.9626           |
| 0.0915        | 17.0  | 1802  | 0.1330          | 0.7590             | 0.8630          | 0.8077      | 73              | 0.6625                 | 0.8154              | 0.7310          | 65                  | 0.875            | 0.9333        | 0.9032    | 150           | 0.7576             | 0.8621          | 0.8065      | 29              | 0.8611         | 0.9118      | 0.8857  | 34          | 0.7959            | 0.8889         | 0.8398     | 0.9623           |
| 0.0917        | 18.0  | 1908  | 0.1425          | 0.7975             | 0.8630          | 0.8289      | 73              | 0.6625                 | 0.8154              | 0.7310          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.8333         | 0.8824      | 0.8571  | 34          | 0.7837            | 0.8775         | 0.8280     | 0.9591           |
| 0.0883        | 19.0  | 2014  | 0.1324          | 0.7975             | 0.8630          | 0.8289      | 73              | 0.6875                 | 0.8462              | 0.7586          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.7429             | 0.8966          | 0.8125      | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.7934            | 0.8860         | 0.8371     | 0.9631           |
| 0.0838        | 20.0  | 2120  | 0.1400          | 0.7901             | 0.8767          | 0.8312      | 73              | 0.6835                 | 0.8308              | 0.75            | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.5854             | 0.8276          | 0.6857      | 29              | 0.8857         | 0.9118      | 0.8986  | 34          | 0.7899            | 0.8889         | 0.8365     | 0.9614           |
| 0.0809        | 21.0  | 2226  | 0.1390          | 0.7975             | 0.8630          | 0.8289      | 73              | 0.6588                 | 0.8615              | 0.7467          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6970             | 0.7931          | 0.7419      | 29              | 0.8857         | 0.9118      | 0.8986  | 34          | 0.7893            | 0.8860         | 0.8349     | 0.9628           |
| 0.0795        | 22.0  | 2332  | 0.1383          | 0.8101             | 0.8767          | 0.8421      | 73              | 0.675                  | 0.8308              | 0.7448          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7969            | 0.8832         | 0.8378     | 0.9614           |
| 0.0778        | 23.0  | 2438  | 0.1378          | 0.8025             | 0.8904          | 0.8442      | 73              | 0.675                  | 0.8308              | 0.7448          | 65                  | 0.875            | 0.9333        | 0.9032    | 150           | 0.7879             | 0.8966          | 0.8387      | 29              | 0.8333         | 0.8824      | 0.8571  | 34          | 0.8077            | 0.8974         | 0.8502     | 0.9646           |
| 0.0731        | 24.0  | 2544  | 0.1416          | 0.7901             | 0.8767          | 0.8312      | 73              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.8696           | 0.9333        | 0.9003    | 150           | 0.7647             | 0.8966          | 0.8254      | 29              | 0.8571         | 0.8824      | 0.8696  | 34          | 0.7960            | 0.9003         | 0.8449     | 0.9626           |
| 0.0729        | 25.0  | 2650  | 0.1511          | 0.7975             | 0.8630          | 0.8289      | 73              | 0.6875                 | 0.8462              | 0.7586          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6                | 0.8276          | 0.6957      | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.7769            | 0.8832         | 0.8267     | 0.9609           |
| 0.0724        | 26.0  | 2756  | 0.1487          | 0.7949             | 0.8493          | 0.8212      | 73              | 0.72                   | 0.8308              | 0.7714          | 65                  | 0.8671           | 0.9133        | 0.8896    | 150           | 0.5714             | 0.8276          | 0.6761      | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7786            | 0.8718         | 0.8226     | 0.9589           |
| 0.0699        | 27.0  | 2862  | 0.1470          | 0.75               | 0.8630          | 0.8025      | 73              | 0.7                    | 0.8615              | 0.7724          | 65                  | 0.875            | 0.9333        | 0.9032    | 150           | 0.5581             | 0.8276          | 0.6667      | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.7704            | 0.8889         | 0.8254     | 0.9601           |
| 0.0669        | 28.0  | 2968  | 0.1365          | 0.8133             | 0.8356          | 0.8243      | 73              | 0.6970                 | 0.7077              | 0.7023          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8043            | 0.8547         | 0.8287     | 0.9633           |
| 0.0671        | 29.0  | 3074  | 0.1308          | 0.8205             | 0.8767          | 0.8477      | 73              | 0.7143                 | 0.8462              | 0.7746          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.7647             | 0.8966          | 0.8254      | 29              | 0.8571         | 0.8824      | 0.8696  | 34          | 0.8156            | 0.8946         | 0.8533     | 0.9668           |
| 0.0645        | 30.0  | 3180  | 0.1310          | 0.8026             | 0.8356          | 0.8188      | 73              | 0.6835                 | 0.8308              | 0.75            | 65                  | 0.875            | 0.9333        | 0.9032    | 150           | 0.7879             | 0.8966          | 0.8387      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.8052            | 0.8832         | 0.8424     | 0.9658           |
| 0.0598        | 31.0  | 3286  | 0.1398          | 0.7529             | 0.8767          | 0.8101      | 73              | 0.6974                 | 0.8154              | 0.7518          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.7949            | 0.8832         | 0.8367     | 0.9636           |
| 0.0598        | 32.0  | 3392  | 0.1498          | 0.75               | 0.8630          | 0.8025      | 73              | 0.6790                 | 0.8462              | 0.7534          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.7731            | 0.8832         | 0.8245     | 0.9609           |
| 0.0607        | 33.0  | 3498  | 0.1473          | 0.7922             | 0.8356          | 0.8133      | 73              | 0.7013                 | 0.8308              | 0.7606          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.7647             | 0.8966          | 0.8254      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.7990            | 0.8832         | 0.8390     | 0.9626           |
| 0.0583        | 34.0  | 3604  | 0.1407          | 0.8182             | 0.8630          | 0.8400      | 73              | 0.7105                 | 0.8308              | 0.7660          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.7647             | 0.8966          | 0.8254      | 29              | 0.8158         | 0.9118      | 0.8611  | 34          | 0.8083            | 0.8889         | 0.8467     | 0.9670           |
| 0.0558        | 35.0  | 3710  | 0.1466          | 0.7654             | 0.8493          | 0.8052      | 73              | 0.7067                 | 0.8154              | 0.7571          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.8611         | 0.9118      | 0.8857  | 34          | 0.7959            | 0.8775         | 0.8347     | 0.9636           |
| 0.0562        | 36.0  | 3816  | 0.1467          | 0.7722             | 0.8356          | 0.8026      | 73              | 0.6707                 | 0.8462              | 0.7483          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.7222             | 0.8966          | 0.8000      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.7803            | 0.8803         | 0.8273     | 0.9626           |
| 0.0548        | 37.0  | 3922  | 0.1504          | 0.7654             | 0.8493          | 0.8052      | 73              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.7837            | 0.8775         | 0.8280     | 0.9614           |
| 0.0528        | 38.0  | 4028  | 0.1421          | 0.8378             | 0.8493          | 0.8435      | 73              | 0.7101                 | 0.7538              | 0.7313          | 65                  | 0.8616           | 0.9133        | 0.8867    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.8333         | 0.8824      | 0.8571  | 34          | 0.8097            | 0.8604         | 0.8343     | 0.9638           |
| 0.0504        | 39.0  | 4134  | 0.1570          | 0.8125             | 0.8904          | 0.8497      | 73              | 0.7013                 | 0.8308              | 0.7606          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.7928            | 0.8832         | 0.8356     | 0.9628           |
| 0.053         | 40.0  | 4240  | 0.1527          | 0.8                | 0.8767          | 0.8366      | 73              | 0.6322                 | 0.8462              | 0.7237          | 65                  | 0.8553           | 0.9067        | 0.8803    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.8378         | 0.9118      | 0.8732  | 34          | 0.7814            | 0.8860         | 0.8304     | 0.9614           |
| 0.0469        | 41.0  | 4346  | 0.1568          | 0.8049             | 0.9041          | 0.8516      | 73              | 0.6835                 | 0.8308              | 0.75            | 65                  | 0.85             | 0.9067        | 0.8774    | 150           | 0.6                | 0.8276          | 0.6957      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.7769            | 0.8832         | 0.8267     | 0.9594           |
| 0.0487        | 42.0  | 4452  | 0.1480          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6974                 | 0.8154              | 0.7518          | 65                  | 0.8671           | 0.9133        | 0.8896    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.8158         | 0.9118      | 0.8611  | 34          | 0.8005            | 0.8803         | 0.8385     | 0.9628           |
| 0.0463        | 43.0  | 4558  | 0.1548          | 0.8182             | 0.8630          | 0.8400      | 73              | 0.6625                 | 0.8154              | 0.7310          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.8108         | 0.8824      | 0.8451  | 34          | 0.7846            | 0.8718         | 0.8259     | 0.9619           |
| 0.0459        | 44.0  | 4664  | 0.1515          | 0.8289             | 0.8630          | 0.8456      | 73              | 0.7051                 | 0.8462              | 0.7692          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.75               | 0.8276          | 0.7869      | 29              | 0.8378         | 0.9118      | 0.8732  | 34          | 0.8168            | 0.8889         | 0.8513     | 0.9663           |
| 0.0454        | 45.0  | 4770  | 0.1515          | 0.8333             | 0.8904          | 0.8609      | 73              | 0.6970                 | 0.7077              | 0.7023          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.8125             | 0.8966          | 0.8525      | 29              | 0.8378         | 0.9118      | 0.8732  | 34          | 0.8275            | 0.8746         | 0.8504     | 0.9658           |
| 0.0455        | 46.0  | 4876  | 0.1483          | 0.825              | 0.9041          | 0.8627      | 73              | 0.7260                 | 0.8154              | 0.7681          | 65                  | 0.8790           | 0.92          | 0.8990    | 150           | 0.8125             | 0.8966          | 0.8525      | 29              | 0.8378         | 0.9118      | 0.8732  | 34          | 0.8285            | 0.8946         | 0.8603     | 0.9673           |
| 0.0424        | 47.0  | 4982  | 0.1514          | 0.8354             | 0.9041          | 0.8684      | 73              | 0.6790                 | 0.8462              | 0.7534          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.8125             | 0.8966          | 0.8525      | 29              | 0.8333         | 0.8824      | 0.8571  | 34          | 0.8123            | 0.9003         | 0.8541     | 0.9655           |
| 0.0444        | 48.0  | 5088  | 0.1553          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.7391                 | 0.7846              | 0.7612          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.8084            | 0.8775         | 0.8415     | 0.9653           |
| 0.0427        | 49.0  | 5194  | 0.1564          | 0.8571             | 0.9041          | 0.88        | 73              | 0.7308                 | 0.8769              | 0.7972          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7576             | 0.8621          | 0.8065      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8212            | 0.9031         | 0.8602     | 0.9653           |
| 0.041         | 50.0  | 5300  | 0.1514          | 0.8228             | 0.8904          | 0.8553      | 73              | 0.7333                 | 0.8462              | 0.7857          | 65                  | 0.875            | 0.9333        | 0.9032    | 150           | 0.7812             | 0.8621          | 0.8197      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8203            | 0.8974         | 0.8571     | 0.9660           |
| 0.0416        | 51.0  | 5406  | 0.1590          | 0.8072             | 0.9178          | 0.8590      | 73              | 0.6849                 | 0.7692              | 0.7246          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.8125             | 0.8966          | 0.8525      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.7995            | 0.8860         | 0.8405     | 0.9651           |
| 0.0398        | 52.0  | 5512  | 0.1614          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.6667                 | 0.8615              | 0.7517          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.7879             | 0.8966          | 0.8387      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8025            | 0.9031         | 0.8499     | 0.9648           |
| 0.0404        | 53.0  | 5618  | 0.1627          | 0.8354             | 0.9041          | 0.8684      | 73              | 0.6923                 | 0.8308              | 0.7552          | 65                  | 0.8758           | 0.94          | 0.9068    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8082            | 0.9003         | 0.8518     | 0.9631           |
| 0.0405        | 54.0  | 5724  | 0.1586          | 0.8354             | 0.9041          | 0.8684      | 73              | 0.6709                 | 0.8154              | 0.7361          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.7879             | 0.8966          | 0.8387      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8093            | 0.8946         | 0.8498     | 0.9660           |
| 0.037         | 55.0  | 5830  | 0.1638          | 0.8025             | 0.8904          | 0.8442      | 73              | 0.6892                 | 0.7846              | 0.7338          | 65                  | 0.8509           | 0.9133        | 0.8810    | 150           | 0.6944             | 0.8621          | 0.7692      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.7897            | 0.8775         | 0.8313     | 0.9619           |
| 0.0367        | 56.0  | 5936  | 0.1585          | 0.84               | 0.8630          | 0.8514      | 73              | 0.6986                 | 0.7846              | 0.7391          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.8158         | 0.9118      | 0.8611  | 34          | 0.8063            | 0.8775         | 0.8404     | 0.9648           |
| 0.0387        | 57.0  | 6042  | 0.1545          | 0.8514             | 0.8630          | 0.8571      | 73              | 0.7027                 | 0.8                 | 0.7482          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.7647             | 0.8966          | 0.8254      | 29              | 0.8611         | 0.9118      | 0.8857  | 34          | 0.8223            | 0.8832         | 0.8516     | 0.9663           |
| 0.0371        | 58.0  | 6148  | 0.1625          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.85             | 0.9067        | 0.8774    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.8108         | 0.8824      | 0.8451  | 34          | 0.7979            | 0.8775         | 0.8358     | 0.9631           |
| 0.0354        | 59.0  | 6254  | 0.1653          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.6986                 | 0.7846              | 0.7391          | 65                  | 0.8509           | 0.9133        | 0.8810    | 150           | 0.7647             | 0.8966          | 0.8254      | 29              | 0.8378         | 0.9118      | 0.8732  | 34          | 0.8120            | 0.8860         | 0.8474     | 0.9653           |
| 0.0363        | 60.0  | 6360  | 0.1616          | 0.8571             | 0.9041          | 0.88        | 73              | 0.6842                 | 0.8                 | 0.7376          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.8125             | 0.8966          | 0.8525      | 29              | 0.8611         | 0.9118      | 0.8857  | 34          | 0.8172            | 0.8917         | 0.8529     | 0.9655           |
| 0.0333        | 61.0  | 6466  | 0.1767          | 0.8205             | 0.8767          | 0.8477      | 73              | 0.6265                 | 0.8                 | 0.7027          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.7647             | 0.8966          | 0.8254      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.7868            | 0.8832         | 0.8322     | 0.9623           |
| 0.0324        | 62.0  | 6572  | 0.1648          | 0.8289             | 0.8630          | 0.8456      | 73              | 0.6883                 | 0.8154              | 0.7465          | 65                  | 0.8861           | 0.9333        | 0.9091    | 150           | 0.7879             | 0.8966          | 0.8387      | 29              | 0.8108         | 0.8824      | 0.8451  | 34          | 0.8189            | 0.8889         | 0.8525     | 0.9653           |
| 0.0364        | 63.0  | 6678  | 0.1629          | 0.8533             | 0.8767          | 0.8649      | 73              | 0.6875                 | 0.8462              | 0.7586          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.8125             | 0.8966          | 0.8525      | 29              | 0.8611         | 0.9118      | 0.8857  | 34          | 0.8198            | 0.8946         | 0.8556     | 0.9651           |
| 0.034         | 64.0  | 6784  | 0.1654          | 0.8148             | 0.9041          | 0.8571      | 73              | 0.6471                 | 0.6769              | 0.6617          | 65                  | 0.8553           | 0.9067        | 0.8803    | 150           | 0.7879             | 0.8966          | 0.8387      | 29              | 0.8611         | 0.9118      | 0.8857  | 34          | 0.8037            | 0.8632         | 0.8324     | 0.9638           |
| 0.0325        | 65.0  | 6890  | 0.1645          | 0.8553             | 0.8904          | 0.8725      | 73              | 0.6933                 | 0.8                 | 0.7429          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.7576             | 0.8621          | 0.8065      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.8073            | 0.8832         | 0.8435     | 0.9665           |
| 0.0322        | 66.0  | 6996  | 0.1727          | 0.8148             | 0.9041          | 0.8571      | 73              | 0.6667                 | 0.8                 | 0.7273          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.8125             | 0.8966          | 0.8525      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8046            | 0.8917         | 0.8459     | 0.9646           |
| 0.0314        | 67.0  | 7102  | 0.1656          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.6812                 | 0.7231              | 0.7015          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.8069            | 0.8689         | 0.8368     | 0.9643           |
| 0.0313        | 68.0  | 7208  | 0.1711          | 0.8553             | 0.8904          | 0.8725      | 73              | 0.6883                 | 0.8154              | 0.7465          | 65                  | 0.8608           | 0.9067        | 0.8831    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.8042            | 0.8775         | 0.8392     | 0.9643           |
| 0.0319        | 69.0  | 7314  | 0.1759          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6914                 | 0.8615              | 0.7671          | 65                  | 0.8553           | 0.9067        | 0.8803    | 150           | 0.7812             | 0.8621          | 0.8197      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8062            | 0.8889         | 0.8455     | 0.9628           |
| 0.0303        | 70.0  | 7420  | 0.1741          | 0.8553             | 0.8904          | 0.8725      | 73              | 0.6933                 | 0.8                 | 0.7429          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.8099            | 0.8860         | 0.8463     | 0.9636           |
| 0.0299        | 71.0  | 7526  | 0.1705          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.6923                 | 0.8308              | 0.7552          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.7812             | 0.8621          | 0.8197      | 29              | 0.8378         | 0.9118      | 0.8732  | 34          | 0.8203            | 0.8974         | 0.8571     | 0.9651           |
| 0.0289        | 72.0  | 7632  | 0.1736          | 0.8228             | 0.8904          | 0.8553      | 73              | 0.6849                 | 0.7692              | 0.7246          | 65                  | 0.8509           | 0.9133        | 0.8810    | 150           | 0.7812             | 0.8621          | 0.8197      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8016            | 0.8746         | 0.8365     | 0.9636           |
| 0.029         | 73.0  | 7738  | 0.1749          | 0.8421             | 0.8767          | 0.8591      | 73              | 0.7013                 | 0.8308              | 0.7606          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.7576             | 0.8621          | 0.8065      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8146            | 0.8889         | 0.8501     | 0.9648           |
| 0.0271        | 74.0  | 7844  | 0.1736          | 0.8553             | 0.8904          | 0.8725      | 73              | 0.7123                 | 0.8                 | 0.7536          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.7812             | 0.8621          | 0.8197      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8228            | 0.8860         | 0.8532     | 0.9668           |
| 0.0283        | 75.0  | 7950  | 0.1777          | 0.8354             | 0.9041          | 0.8684      | 73              | 0.6883                 | 0.8154              | 0.7465          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.7576             | 0.8621          | 0.8065      | 29              | 0.8108         | 0.8824      | 0.8451  | 34          | 0.8156            | 0.8946         | 0.8533     | 0.9643           |
| 0.0292        | 76.0  | 8056  | 0.1849          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.6790                 | 0.8462              | 0.7534          | 65                  | 0.8812           | 0.94          | 0.9097    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8107            | 0.9031         | 0.8544     | 0.9638           |
| 0.0287        | 77.0  | 8162  | 0.1785          | 0.8553             | 0.8904          | 0.8725      | 73              | 0.6923                 | 0.8308              | 0.7552          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8151            | 0.8917         | 0.8517     | 0.9641           |
| 0.0258        | 78.0  | 8268  | 0.1714          | 0.8649             | 0.8767          | 0.8707      | 73              | 0.7324                 | 0.8                 | 0.7647          | 65                  | 0.8726           | 0.9133        | 0.8925    | 150           | 0.7812             | 0.8621          | 0.8197      | 29              | 0.8333         | 0.8824      | 0.8571  | 34          | 0.8324            | 0.8775         | 0.8544     | 0.9663           |
| 0.0275        | 79.0  | 8374  | 0.1759          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8010            | 0.8832         | 0.8401     | 0.9628           |
| 0.0288        | 80.0  | 8480  | 0.1741          | 0.8684             | 0.9041          | 0.8859      | 73              | 0.68                   | 0.7846              | 0.7286          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.8125             | 0.8966          | 0.8525      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8232            | 0.8889         | 0.8548     | 0.9641           |
| 0.0283        | 81.0  | 8586  | 0.1744          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.7123                 | 0.8                 | 0.7536          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8078            | 0.8860         | 0.8451     | 0.9636           |
| 0.027         | 82.0  | 8692  | 0.1758          | 0.8228             | 0.8904          | 0.8553      | 73              | 0.68                   | 0.7846              | 0.7286          | 65                  | 0.8790           | 0.92          | 0.8990    | 150           | 0.7879             | 0.8966          | 0.8387      | 29              | 0.8158         | 0.9118      | 0.8611  | 34          | 0.8141            | 0.8860         | 0.8486     | 0.9643           |
| 0.0254        | 83.0  | 8798  | 0.1825          | 0.8312             | 0.8767          | 0.8533      | 73              | 0.6582                 | 0.8                 | 0.7222          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.7984            | 0.8803         | 0.8374     | 0.9628           |
| 0.0267        | 84.0  | 8904  | 0.1853          | 0.8354             | 0.9041          | 0.8684      | 73              | 0.6795                 | 0.8154              | 0.7413          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.7959            | 0.8889         | 0.8398     | 0.9636           |
| 0.0244        | 85.0  | 9010  | 0.1810          | 0.825              | 0.9041          | 0.8627      | 73              | 0.6667                 | 0.7692              | 0.7143          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.7647             | 0.8966          | 0.8254      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8031            | 0.8832         | 0.8412     | 0.9643           |
| 0.0241        | 86.0  | 9116  | 0.1784          | 0.8481             | 0.9178          | 0.8816      | 73              | 0.7101                 | 0.7538              | 0.7313          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.7647             | 0.8966          | 0.8254      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8179            | 0.8832         | 0.8493     | 0.9653           |
| 0.0257        | 87.0  | 9222  | 0.1824          | 0.8375             | 0.9178          | 0.8758      | 73              | 0.6667                 | 0.8                 | 0.7273          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8026            | 0.8917         | 0.8448     | 0.9636           |
| 0.0253        | 88.0  | 9328  | 0.1803          | 0.8590             | 0.9178          | 0.8874      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8041            | 0.8889         | 0.8444     | 0.9641           |
| 0.026         | 89.0  | 9434  | 0.1838          | 0.8375             | 0.9178          | 0.8758      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.7974            | 0.8860         | 0.8394     | 0.9623           |
| 0.0246        | 90.0  | 9540  | 0.1807          | 0.8701             | 0.9178          | 0.8933      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.7879             | 0.8966          | 0.8387      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8104            | 0.8889         | 0.8478     | 0.9638           |
| 0.023         | 91.0  | 9646  | 0.1841          | 0.8590             | 0.9178          | 0.8874      | 73              | 0.6494                 | 0.7692              | 0.7042          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8083            | 0.8889         | 0.8467     | 0.9641           |
| 0.0235        | 92.0  | 9752  | 0.1831          | 0.8481             | 0.9178          | 0.8816      | 73              | 0.68                   | 0.7846              | 0.7286          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8130            | 0.8917         | 0.8505     | 0.9648           |
| 0.0228        | 93.0  | 9858  | 0.1843          | 0.825              | 0.9041          | 0.8627      | 73              | 0.6709                 | 0.8154              | 0.7361          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.7812             | 0.8621          | 0.8197      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8093            | 0.8946         | 0.8498     | 0.9641           |
| 0.024         | 94.0  | 9964  | 0.1845          | 0.8375             | 0.9178          | 0.8758      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8067            | 0.8917         | 0.8471     | 0.9636           |
| 0.024         | 95.0  | 10070 | 0.1825          | 0.8590             | 0.9178          | 0.8874      | 73              | 0.6538                 | 0.7846              | 0.7133          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.7576             | 0.8621          | 0.8065      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8109            | 0.8917         | 0.8494     | 0.9641           |
| 0.0247        | 96.0  | 10176 | 0.1849          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.6456                 | 0.7846              | 0.7083          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7576             | 0.8621          | 0.8065      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8015            | 0.8860         | 0.8417     | 0.9636           |
| 0.0236        | 97.0  | 10282 | 0.1839          | 0.8481             | 0.9178          | 0.8816      | 73              | 0.6711                 | 0.7846              | 0.7234          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7576             | 0.8621          | 0.8065      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8083            | 0.8889         | 0.8467     | 0.9638           |
| 0.0228        | 98.0  | 10388 | 0.1857          | 0.8375             | 0.9178          | 0.8758      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7576             | 0.8621          | 0.8065      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8041            | 0.8889         | 0.8444     | 0.9636           |
| 0.025         | 99.0  | 10494 | 0.1851          | 0.8481             | 0.9178          | 0.8816      | 73              | 0.6538                 | 0.7846              | 0.7133          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7576             | 0.8621          | 0.8065      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8041            | 0.8889         | 0.8444     | 0.9638           |
| 0.023         | 100.0 | 10600 | 0.1850          | 0.8375             | 0.9178          | 0.8758      | 73              | 0.6538                 | 0.7846              | 0.7133          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7576             | 0.8621          | 0.8065      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8021            | 0.8889         | 0.8432     | 0.9636           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2