---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-lora-r16-4
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-lora-r16-4

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co/indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1423
- Location Precision: 0.7349
- Location Recall: 0.8356
- Location F1: 0.7821
- Location Number: 73
- Organization Precision: 0.6543
- Organization Recall: 0.8154
- Organization F1: 0.7260
- Organization Number: 65
- Person Precision: 0.8571
- Person Recall: 0.92
- Person F1: 0.8875
- Person Number: 150
- Quantity Precision: 0.6389
- Quantity Recall: 0.7931
- Quantity F1: 0.7077
- Quantity Number: 29
- Time Precision: 0.7381
- Time Recall: 0.9118
- Time F1: 0.8158
- Time Number: 34
- Overall Precision: 0.7593
- Overall Recall: 0.8718
- Overall F1: 0.8117
- Overall Accuracy: 0.9582

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 1.1472        | 1.0   | 106   | 0.7123          | 0.0                | 0.0             | 0.0         | 73              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.0              | 0.0           | 0.0       | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.0            | 0.0         | 0.0     | 34          | 0.0               | 0.0            | 0.0        | 0.8366           |
| 0.6802        | 2.0   | 212   | 0.5883          | 0.0                | 0.0             | 0.0         | 73              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.1429           | 0.0067        | 0.0127    | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.0            | 0.0         | 0.0     | 34          | 0.0909            | 0.0028         | 0.0055     | 0.8385           |
| 0.56          | 3.0   | 318   | 0.4647          | 0.4167             | 0.0685          | 0.1176      | 73              | 0.0833                 | 0.0154              | 0.0260          | 65                  | 0.2923           | 0.1267        | 0.1767    | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.35           | 0.2059      | 0.2593  | 34          | 0.2936            | 0.0912         | 0.1391     | 0.8617           |
| 0.4294        | 4.0   | 424   | 0.3324          | 0.5                | 0.3288          | 0.3967      | 73              | 0.2143                 | 0.0923              | 0.1290          | 65                  | 0.6296           | 0.68          | 0.6538    | 150           | 0.1875             | 0.1034          | 0.1333      | 29              | 0.5758         | 0.5588      | 0.5672  | 34          | 0.5366            | 0.4387         | 0.4828     | 0.9077           |
| 0.324         | 5.0   | 530   | 0.2608          | 0.5301             | 0.6027          | 0.5641      | 73              | 0.4306                 | 0.4769              | 0.4526          | 65                  | 0.75             | 0.92          | 0.8263    | 150           | 0.3871             | 0.4138          | 0.4000      | 29              | 0.6410         | 0.7353      | 0.6849  | 34          | 0.6112            | 0.7123         | 0.6579     | 0.9308           |
| 0.2665        | 6.0   | 636   | 0.2330          | 0.6064             | 0.7808          | 0.6826      | 73              | 0.4713                 | 0.6308              | 0.5395          | 65                  | 0.7667           | 0.92          | 0.8364    | 150           | 0.4118             | 0.4828          | 0.4444      | 29              | 0.65           | 0.7647      | 0.7027  | 34          | 0.6345            | 0.7863         | 0.7023     | 0.9345           |
| 0.2275        | 7.0   | 742   | 0.1975          | 0.6559             | 0.8356          | 0.7349      | 73              | 0.4787                 | 0.6923              | 0.5660          | 65                  | 0.7809           | 0.9267        | 0.8476    | 150           | 0.4118             | 0.4828          | 0.4444      | 29              | 0.65           | 0.7647      | 0.7027  | 34          | 0.6492            | 0.8120         | 0.7215     | 0.9392           |
| 0.2049        | 8.0   | 848   | 0.1831          | 0.63               | 0.8630          | 0.7283      | 73              | 0.4505                 | 0.6308              | 0.5256          | 65                  | 0.7931           | 0.92          | 0.8519    | 150           | 0.5                | 0.6207          | 0.5538      | 29              | 0.6585         | 0.7941      | 0.72    | 34          | 0.6493            | 0.8177         | 0.7238     | 0.9419           |
| 0.1888        | 9.0   | 954   | 0.1750          | 0.6421             | 0.8356          | 0.7262      | 73              | 0.4946                 | 0.7077              | 0.5823          | 65                  | 0.7882           | 0.8933        | 0.8375    | 150           | 0.4412             | 0.5172          | 0.4762      | 29              | 0.6429         | 0.7941      | 0.7105  | 34          | 0.6521            | 0.8063         | 0.7210     | 0.9431           |
| 0.1759        | 10.0  | 1060  | 0.1671          | 0.7143             | 0.8219          | 0.7643      | 73              | 0.5104                 | 0.7538              | 0.6087          | 65                  | 0.7836           | 0.8933        | 0.8349    | 150           | 0.5405             | 0.6897          | 0.6061      | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.6767            | 0.8291         | 0.7452     | 0.9459           |
| 0.1691        | 11.0  | 1166  | 0.1639          | 0.6842             | 0.8904          | 0.7738      | 73              | 0.5426                 | 0.7846              | 0.6415          | 65                  | 0.8              | 0.9067        | 0.8500    | 150           | 0.5676             | 0.7241          | 0.6364      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.6918            | 0.8632         | 0.7681     | 0.9463           |
| 0.1569        | 12.0  | 1272  | 0.1666          | 0.7191             | 0.8767          | 0.7901      | 73              | 0.5263                 | 0.7692              | 0.625           | 65                  | 0.7849           | 0.9           | 0.8385    | 150           | 0.525              | 0.7241          | 0.6087      | 29              | 0.6744         | 0.8529      | 0.7532  | 34          | 0.6811            | 0.8519         | 0.7570     | 0.9459           |
| 0.1512        | 13.0  | 1378  | 0.1506          | 0.7126             | 0.8493          | 0.7750      | 73              | 0.5581                 | 0.7385              | 0.6358          | 65                  | 0.7941           | 0.9           | 0.8438    | 150           | 0.5526             | 0.7241          | 0.6269      | 29              | 0.75           | 0.8824      | 0.8108  | 34          | 0.7031            | 0.8433         | 0.7668     | 0.9510           |
| 0.1492        | 14.0  | 1484  | 0.1587          | 0.7191             | 0.8767          | 0.7901      | 73              | 0.5204                 | 0.7846              | 0.6258          | 65                  | 0.7895           | 0.9           | 0.8411    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.6918            | 0.8632         | 0.7681     | 0.9483           |
| 0.1422        | 15.0  | 1590  | 0.1571          | 0.7111             | 0.8767          | 0.7853      | 73              | 0.5102                 | 0.7692              | 0.6135          | 65                  | 0.8              | 0.9067        | 0.8500    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.7209         | 0.9118      | 0.8052  | 34          | 0.6963            | 0.8689         | 0.7731     | 0.9483           |
| 0.1386        | 16.0  | 1696  | 0.1537          | 0.7159             | 0.8630          | 0.7826      | 73              | 0.5393                 | 0.7385              | 0.6234          | 65                  | 0.8225           | 0.9267        | 0.8715    | 150           | 0.6410             | 0.8621          | 0.7353      | 29              | 0.6977         | 0.8824      | 0.7792  | 34          | 0.7126            | 0.8689         | 0.7831     | 0.9503           |
| 0.1351        | 17.0  | 1802  | 0.1520          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.5152                 | 0.7846              | 0.6220          | 65                  | 0.8303           | 0.9133        | 0.8698    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7119            | 0.8661         | 0.7815     | 0.9500           |
| 0.1397        | 18.0  | 1908  | 0.1488          | 0.7294             | 0.8493          | 0.7848      | 73              | 0.5053                 | 0.7385              | 0.6             | 65                  | 0.8303           | 0.9133        | 0.8698    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7146            | 0.8632         | 0.7819     | 0.9500           |
| 0.1332        | 19.0  | 2014  | 0.1468          | 0.75               | 0.8630          | 0.8025      | 73              | 0.5258                 | 0.7846              | 0.6296          | 65                  | 0.8253           | 0.9133        | 0.8671    | 150           | 0.5833             | 0.7241          | 0.6462      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7146            | 0.8632         | 0.7819     | 0.9513           |
| 0.1258        | 20.0  | 2120  | 0.1434          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.5542                 | 0.7077              | 0.6216          | 65                  | 0.8253           | 0.9133        | 0.8671    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7306            | 0.8575         | 0.7890     | 0.9527           |
| 0.1231        | 21.0  | 2226  | 0.1407          | 0.7294             | 0.8493          | 0.7848      | 73              | 0.5696                 | 0.6923              | 0.625           | 65                  | 0.8204           | 0.9133        | 0.8644    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7304            | 0.8490         | 0.7852     | 0.9545           |
| 0.1218        | 22.0  | 2332  | 0.1495          | 0.7059             | 0.8219          | 0.7595      | 73              | 0.5050                 | 0.7846              | 0.6145          | 65                  | 0.8059           | 0.9133        | 0.8562    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.6998            | 0.8632         | 0.7730     | 0.9500           |
| 0.1189        | 23.0  | 2438  | 0.1388          | 0.7590             | 0.8630          | 0.8077      | 73              | 0.5556                 | 0.7692              | 0.6452          | 65                  | 0.8354           | 0.9133        | 0.8726    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.8049         | 0.9706      | 0.8800  | 34          | 0.7373            | 0.8718         | 0.7990     | 0.9562           |
| 0.1176        | 24.0  | 2544  | 0.1480          | 0.7294             | 0.8493          | 0.7848      | 73              | 0.5417                 | 0.8                 | 0.6460          | 65                  | 0.8204           | 0.9133        | 0.8644    | 150           | 0.6154             | 0.8276          | 0.7059      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7110            | 0.8689         | 0.7821     | 0.9523           |
| 0.115         | 25.0  | 2650  | 0.1457          | 0.7079             | 0.8630          | 0.7778      | 73              | 0.5312                 | 0.7846              | 0.6335          | 65                  | 0.8303           | 0.9133        | 0.8698    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7143            | 0.8689         | 0.7841     | 0.9535           |
| 0.1175        | 26.0  | 2756  | 0.1425          | 0.7625             | 0.8356          | 0.7974      | 73              | 0.5595                 | 0.7231              | 0.6309          | 65                  | 0.8373           | 0.9267        | 0.8797    | 150           | 0.6154             | 0.8276          | 0.7059      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7366            | 0.8604         | 0.7937     | 0.9555           |
| 0.1099        | 27.0  | 2862  | 0.1426          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.5955                 | 0.8154              | 0.6883          | 65                  | 0.8424           | 0.9267        | 0.8825    | 150           | 0.575              | 0.7931          | 0.6667      | 29              | 0.7442         | 0.9412      | 0.8312  | 34          | 0.7333            | 0.8775         | 0.7990     | 0.9557           |
| 0.1108        | 28.0  | 2968  | 0.1399          | 0.7561             | 0.8493          | 0.8000      | 73              | 0.5977                 | 0.8                 | 0.6842          | 65                  | 0.8263           | 0.92          | 0.8707    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7367            | 0.8689         | 0.7974     | 0.9555           |
| 0.1071        | 29.0  | 3074  | 0.1470          | 0.7159             | 0.8630          | 0.7826      | 73              | 0.5347                 | 0.8308              | 0.6506          | 65                  | 0.8284           | 0.9333        | 0.8777    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7146            | 0.8917         | 0.7934     | 0.9513           |
| 0.1075        | 30.0  | 3180  | 0.1315          | 0.7561             | 0.8493          | 0.8000      | 73              | 0.6267                 | 0.7231              | 0.6714          | 65                  | 0.8155           | 0.9133        | 0.8616    | 150           | 0.5833             | 0.7241          | 0.6462      | 29              | 0.8462         | 0.9706      | 0.9041  | 34          | 0.75              | 0.8547         | 0.7989     | 0.9569           |
| 0.1053        | 31.0  | 3286  | 0.1396          | 0.7654             | 0.8493          | 0.8052      | 73              | 0.5843                 | 0.8                 | 0.6753          | 65                  | 0.8373           | 0.9267        | 0.8797    | 150           | 0.5897             | 0.7931          | 0.6765      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7380            | 0.8746         | 0.8005     | 0.9555           |
| 0.1027        | 32.0  | 3392  | 0.1429          | 0.7683             | 0.8630          | 0.8129      | 73              | 0.5612                 | 0.8462              | 0.6748          | 65                  | 0.8373           | 0.9267        | 0.8797    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7358            | 0.8889         | 0.8052     | 0.9550           |
| 0.1036        | 33.0  | 3498  | 0.1393          | 0.7654             | 0.8493          | 0.8052      | 73              | 0.5870                 | 0.8308              | 0.6879          | 65                  | 0.8313           | 0.92          | 0.8734    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7410            | 0.8803         | 0.8047     | 0.9559           |
| 0.1           | 34.0  | 3604  | 0.1386          | 0.7561             | 0.8493          | 0.8000      | 73              | 0.5889                 | 0.8154              | 0.6839          | 65                  | 0.8313           | 0.92          | 0.8734    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7386            | 0.8775         | 0.8021     | 0.9562           |
| 0.1013        | 35.0  | 3710  | 0.1437          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.5789                 | 0.8462              | 0.6875          | 65                  | 0.8313           | 0.92          | 0.8734    | 150           | 0.6                | 0.8276          | 0.6957      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7294            | 0.8832         | 0.7990     | 0.9550           |
| 0.0988        | 36.0  | 3816  | 0.1437          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.5824                 | 0.8154              | 0.6795          | 65                  | 0.8364           | 0.92          | 0.8762    | 150           | 0.5897             | 0.7931          | 0.6765      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7321            | 0.8718         | 0.7958     | 0.9547           |
| 0.0971        | 37.0  | 3922  | 0.1551          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.5429                 | 0.8769              | 0.6706          | 65                  | 0.8263           | 0.92          | 0.8707    | 150           | 0.5897             | 0.7931          | 0.6765      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7087            | 0.8803         | 0.7853     | 0.9491           |
| 0.0967        | 38.0  | 4028  | 0.1369          | 0.7625             | 0.8356          | 0.7974      | 73              | 0.6203                 | 0.7538              | 0.6806          | 65                  | 0.8364           | 0.92          | 0.8762    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7512            | 0.8604         | 0.8021     | 0.9569           |
| 0.0949        | 39.0  | 4134  | 0.1398          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.5729                 | 0.8462              | 0.6832          | 65                  | 0.8364           | 0.92          | 0.8762    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7281            | 0.8775         | 0.7959     | 0.9559           |
| 0.0956        | 40.0  | 4240  | 0.1413          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6092                 | 0.8154              | 0.6974          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.5897             | 0.7931          | 0.6765      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7391            | 0.8718         | 0.8000     | 0.9559           |
| 0.0913        | 41.0  | 4346  | 0.1397          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6044                 | 0.8462              | 0.7051          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7392            | 0.8803         | 0.8036     | 0.9567           |
| 0.0949        | 42.0  | 4452  | 0.1463          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.5934                 | 0.8308              | 0.6923          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.5897             | 0.7931          | 0.6765      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7415            | 0.8746         | 0.8026     | 0.9547           |
| 0.0919        | 43.0  | 4558  | 0.1371          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6173                 | 0.7692              | 0.6849          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7438            | 0.8604         | 0.7979     | 0.9567           |
| 0.0895        | 44.0  | 4664  | 0.1338          | 0.7561             | 0.8493          | 0.8000      | 73              | 0.6125                 | 0.7538              | 0.6759          | 65                  | 0.8424           | 0.9267        | 0.8825    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7531            | 0.8689         | 0.8069     | 0.9577           |
| 0.0899        | 45.0  | 4770  | 0.1402          | 0.7407             | 0.8219          | 0.7792      | 73              | 0.5806                 | 0.8308              | 0.6835          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7356            | 0.8718         | 0.7979     | 0.9569           |
| 0.088         | 46.0  | 4876  | 0.1336          | 0.7531             | 0.8356          | 0.7922      | 73              | 0.6163                 | 0.8154              | 0.7020          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.5833             | 0.7241          | 0.6462      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7531            | 0.8689         | 0.8069     | 0.9584           |
| 0.0896        | 47.0  | 4982  | 0.1427          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.5895                 | 0.8615              | 0.7             | 65                  | 0.8476           | 0.9267        | 0.8854    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7387            | 0.8860         | 0.8057     | 0.9562           |
| 0.0897        | 48.0  | 5088  | 0.1461          | 0.7093             | 0.8356          | 0.7673      | 73              | 0.6163                 | 0.8154              | 0.7020          | 65                  | 0.8424           | 0.9267        | 0.8825    | 150           | 0.5897             | 0.7931          | 0.6765      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7344            | 0.8746         | 0.7984     | 0.9550           |
| 0.0836        | 49.0  | 5194  | 0.1437          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.5889                 | 0.8154              | 0.6839          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7367            | 0.8689         | 0.7974     | 0.9552           |
| 0.0845        | 50.0  | 5300  | 0.1428          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6044                 | 0.8462              | 0.7051          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7398            | 0.8746         | 0.8016     | 0.9552           |
| 0.0849        | 51.0  | 5406  | 0.1388          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.6092                 | 0.8154              | 0.6974          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7457            | 0.8689         | 0.8026     | 0.9564           |
| 0.0836        | 52.0  | 5512  | 0.1435          | 0.7093             | 0.8356          | 0.7673      | 73              | 0.6163                 | 0.8154              | 0.7020          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7409            | 0.8718         | 0.8010     | 0.9555           |
| 0.0838        | 53.0  | 5618  | 0.1494          | 0.7011             | 0.8356          | 0.7625      | 73              | 0.5806                 | 0.8308              | 0.6835          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.575              | 0.7931          | 0.6667      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.72              | 0.8718         | 0.7887     | 0.9527           |
| 0.0811        | 54.0  | 5724  | 0.1462          | 0.6966             | 0.8493          | 0.7654      | 73              | 0.5914                 | 0.8462              | 0.6962          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7329            | 0.8832         | 0.8010     | 0.9557           |
| 0.0826        | 55.0  | 5830  | 0.1463          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.5714                 | 0.8                 | 0.6667          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7314            | 0.8689         | 0.7943     | 0.9535           |
| 0.0818        | 56.0  | 5936  | 0.1475          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.5824                 | 0.8154              | 0.6795          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7380            | 0.8746         | 0.8005     | 0.9555           |
| 0.0833        | 57.0  | 6042  | 0.1485          | 0.7229             | 0.8219          | 0.7692      | 73              | 0.5745                 | 0.8308              | 0.6792          | 65                  | 0.8313           | 0.92          | 0.8734    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7251            | 0.8718         | 0.7917     | 0.9530           |
| 0.0798        | 58.0  | 6148  | 0.1409          | 0.7229             | 0.8219          | 0.7692      | 73              | 0.6190                 | 0.8                 | 0.6980          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7543            | 0.8661         | 0.8064     | 0.9564           |
| 0.0802        | 59.0  | 6254  | 0.1450          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.5955                 | 0.8154              | 0.6883          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7445            | 0.8718         | 0.8031     | 0.9557           |
| 0.08          | 60.0  | 6360  | 0.1365          | 0.7561             | 0.8493          | 0.8000      | 73              | 0.6163                 | 0.8154              | 0.7020          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6286             | 0.7586          | 0.6875      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7580            | 0.8746         | 0.8122     | 0.9591           |
| 0.0792        | 61.0  | 6466  | 0.1384          | 0.7229             | 0.8219          | 0.7692      | 73              | 0.6279                 | 0.8308              | 0.7152          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6286             | 0.7586          | 0.6875      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7518            | 0.8718         | 0.8074     | 0.9577           |
| 0.0776        | 62.0  | 6572  | 0.1412          | 0.7229             | 0.8219          | 0.7692      | 73              | 0.6582                 | 0.8                 | 0.7222          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7568            | 0.8689         | 0.8090     | 0.9577           |
| 0.0782        | 63.0  | 6678  | 0.1416          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.5870                 | 0.8308              | 0.6879          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7422            | 0.8775         | 0.8042     | 0.9555           |
| 0.0789        | 64.0  | 6784  | 0.1338          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6420                 | 0.8                 | 0.7123          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6286             | 0.7586          | 0.6875      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7568            | 0.8689         | 0.8090     | 0.9582           |
| 0.0769        | 65.0  | 6890  | 0.1396          | 0.7176             | 0.8356          | 0.7722      | 73              | 0.6420                 | 0.8                 | 0.7123          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7550            | 0.8689         | 0.8079     | 0.9579           |
| 0.0757        | 66.0  | 6996  | 0.1402          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6163                 | 0.8154              | 0.7020          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7463            | 0.8718         | 0.8042     | 0.9577           |
| 0.0753        | 67.0  | 7102  | 0.1390          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6463                 | 0.8154              | 0.7211          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7618            | 0.8746         | 0.8143     | 0.9594           |
| 0.0757        | 68.0  | 7208  | 0.1379          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.65                   | 0.8                 | 0.7172          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.765             | 0.8718         | 0.8149     | 0.9591           |
| 0.0731        | 69.0  | 7314  | 0.1417          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6364                 | 0.8615              | 0.7320          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7579            | 0.8832         | 0.8158     | 0.9582           |
| 0.0751        | 70.0  | 7420  | 0.1352          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.65                   | 0.8                 | 0.7172          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6286             | 0.7586          | 0.6875      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7663            | 0.8689         | 0.8144     | 0.9591           |
| 0.0755        | 71.0  | 7526  | 0.1439          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.625                  | 0.8462              | 0.7190          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.75              | 0.8803         | 0.8100     | 0.9577           |
| 0.0745        | 72.0  | 7632  | 0.1397          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6420                 | 0.8                 | 0.7123          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7531            | 0.8689         | 0.8069     | 0.9579           |
| 0.0746        | 73.0  | 7738  | 0.1361          | 0.7407             | 0.8219          | 0.7792      | 73              | 0.65                   | 0.8                 | 0.7172          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7644            | 0.8689         | 0.8133     | 0.9591           |
| 0.0727        | 74.0  | 7844  | 0.1356          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.65                   | 0.8                 | 0.7172          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6286             | 0.7586          | 0.6875      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7644            | 0.8689         | 0.8133     | 0.9596           |
| 0.0727        | 75.0  | 7950  | 0.1443          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6386                 | 0.8154              | 0.7162          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7562            | 0.8746         | 0.8111     | 0.9574           |
| 0.073         | 76.0  | 8056  | 0.1439          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6067                 | 0.8308              | 0.7013          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6286             | 0.7586          | 0.6875      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7439            | 0.8689         | 0.8016     | 0.9550           |
| 0.0733        | 77.0  | 8162  | 0.1373          | 0.7407             | 0.8219          | 0.7792      | 73              | 0.6625                 | 0.8154              | 0.7310          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6286             | 0.7586          | 0.6875      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7638            | 0.8661         | 0.8117     | 0.9594           |
| 0.072         | 78.0  | 8268  | 0.1415          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7637            | 0.8746         | 0.8154     | 0.9582           |
| 0.0718        | 79.0  | 8374  | 0.1495          | 0.7176             | 0.8356          | 0.7722      | 73              | 0.6154                 | 0.8615              | 0.7179          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7404            | 0.8775         | 0.8031     | 0.9552           |
| 0.0703        | 80.0  | 8480  | 0.1430          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6627                 | 0.8462              | 0.7432          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7562            | 0.8746         | 0.8111     | 0.9572           |
| 0.0702        | 81.0  | 8586  | 0.1415          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6627                 | 0.8462              | 0.7432          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7618            | 0.8746         | 0.8143     | 0.9584           |
| 0.0721        | 82.0  | 8692  | 0.1425          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6627                 | 0.8462              | 0.7432          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7643            | 0.8775         | 0.8170     | 0.9589           |
| 0.0712        | 83.0  | 8798  | 0.1438          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6627                 | 0.8462              | 0.7432          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7630            | 0.8803         | 0.8175     | 0.9587           |
| 0.0719        | 84.0  | 8904  | 0.1437          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6548                 | 0.8462              | 0.7383          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7592            | 0.8803         | 0.8153     | 0.9579           |
| 0.0709        | 85.0  | 9010  | 0.1442          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6506                 | 0.8308              | 0.7297          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7556            | 0.8718         | 0.8095     | 0.9574           |
| 0.0699        | 86.0  | 9116  | 0.1407          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7643            | 0.8775         | 0.8170     | 0.9589           |
| 0.0681        | 87.0  | 9222  | 0.1414          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7643            | 0.8775         | 0.8170     | 0.9589           |
| 0.0685        | 88.0  | 9328  | 0.1427          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7605            | 0.8775         | 0.8148     | 0.9579           |
| 0.0703        | 89.0  | 9434  | 0.1406          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.6625                 | 0.8154              | 0.7310          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7694            | 0.8746         | 0.8187     | 0.9594           |
| 0.0695        | 90.0  | 9540  | 0.1384          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.8205         | 0.9412      | 0.8767  | 34          | 0.7694            | 0.8746         | 0.8187     | 0.9601           |
| 0.0684        | 91.0  | 9646  | 0.1436          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6463                 | 0.8154              | 0.7211          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7543            | 0.8746         | 0.8100     | 0.9569           |
| 0.0681        | 92.0  | 9752  | 0.1414          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7656            | 0.8746         | 0.8165     | 0.9591           |
| 0.0694        | 93.0  | 9858  | 0.1429          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7599            | 0.8746         | 0.8132     | 0.9584           |
| 0.068         | 94.0  | 9964  | 0.1413          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7618            | 0.8746         | 0.8143     | 0.9582           |
| 0.0682        | 95.0  | 10070 | 0.1429          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7599            | 0.8746         | 0.8132     | 0.9582           |
| 0.0697        | 96.0  | 10176 | 0.1423          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7593            | 0.8718         | 0.8117     | 0.9579           |
| 0.0672        | 97.0  | 10282 | 0.1422          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7593            | 0.8718         | 0.8117     | 0.9579           |
| 0.0674        | 98.0  | 10388 | 0.1428          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7599            | 0.8746         | 0.8132     | 0.9584           |
| 0.0666        | 99.0  | 10494 | 0.1419          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7593            | 0.8718         | 0.8117     | 0.9582           |
| 0.0693        | 100.0 | 10600 | 0.1423          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7593            | 0.8718         | 0.8117     | 0.9582           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2