---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-lora-r8-1
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-lora-r8-1

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co/indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1282
- Location Precision: 0.7375
- Location Recall: 0.8551
- Location F1: 0.7919
- Location Number: 69
- Organization Precision: 0.6173
- Organization Recall: 0.8197
- Organization F1: 0.7042
- Organization Number: 61
- Person Precision: 0.8363
- Person Recall: 0.9346
- Person F1: 0.8827
- Person Number: 153
- Quantity Precision: 0.6757
- Quantity Recall: 0.7812
- Quantity F1: 0.7246
- Quantity Number: 32
- Time Precision: 0.7568
- Time Recall: 0.9032
- Time F1: 0.8235
- Time Number: 31
- Overall Precision: 0.7512
- Overall Recall: 0.8815
- Overall F1: 0.8112
- Overall Accuracy: 0.9614

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 1.247         | 1.0   | 106   | 0.7410          | 0.0                | 0.0             | 0.0         | 69              | 0.0                    | 0.0                 | 0.0             | 61                  | 0.0              | 0.0           | 0.0       | 153           | 0.0                | 0.0             | 0.0         | 32              | 0.0            | 0.0         | 0.0     | 31          | 0.0               | 0.0            | 0.0        | 0.8353           |
| 0.7131        | 2.0   | 212   | 0.6369          | 0.0                | 0.0             | 0.0         | 69              | 0.0                    | 0.0                 | 0.0             | 61                  | 0.25             | 0.0065        | 0.0127    | 153           | 0.0                | 0.0             | 0.0         | 32              | 0.0            | 0.0         | 0.0     | 31          | 0.1667            | 0.0029         | 0.0057     | 0.8363           |
| 0.629         | 3.0   | 318   | 0.5407          | 0.0                | 0.0             | 0.0         | 69              | 0.0                    | 0.0                 | 0.0             | 61                  | 0.3043           | 0.0458        | 0.0795    | 153           | 0.0                | 0.0             | 0.0         | 32              | 0.0            | 0.0         | 0.0     | 31          | 0.2               | 0.0202         | 0.0367     | 0.8425           |
| 0.5381        | 4.0   | 424   | 0.4457          | 0.5                | 0.0580          | 0.1039      | 69              | 0.1                    | 0.0164              | 0.0282          | 61                  | 0.3182           | 0.1830        | 0.2324    | 153           | 0.0                | 0.0             | 0.0         | 32              | 0.3889         | 0.2258      | 0.2857  | 31          | 0.3226            | 0.1156         | 0.1702     | 0.8667           |
| 0.4387        | 5.0   | 530   | 0.3568          | 0.5294             | 0.2609          | 0.3495      | 69              | 0.2917                 | 0.1148              | 0.1647          | 61                  | 0.4914           | 0.5621        | 0.5244    | 153           | 0.0                | 0.0             | 0.0         | 32              | 0.5455         | 0.3871      | 0.4528  | 31          | 0.4642            | 0.3555         | 0.4026     | 0.8957           |
| 0.3593        | 6.0   | 636   | 0.2867          | 0.4706             | 0.4638          | 0.4672      | 69              | 0.4314                 | 0.3607              | 0.3929          | 61                  | 0.6471           | 0.7908        | 0.7118    | 153           | 0.3704             | 0.3125          | 0.3390      | 32              | 0.6562         | 0.6774      | 0.6667  | 31          | 0.5644            | 0.5954         | 0.5795     | 0.9227           |
| 0.296         | 7.0   | 742   | 0.2455          | 0.5366             | 0.6377          | 0.5828      | 69              | 0.4189                 | 0.5082              | 0.4593          | 61                  | 0.7433           | 0.9085        | 0.8176    | 153           | 0.4324             | 0.5             | 0.4638      | 32              | 0.6111         | 0.7097      | 0.6567  | 31          | 0.6058            | 0.7283         | 0.6614     | 0.9316           |
| 0.254         | 8.0   | 848   | 0.2186          | 0.625              | 0.7971          | 0.7006      | 69              | 0.4318                 | 0.6230              | 0.5101          | 61                  | 0.7554           | 0.9085        | 0.8249    | 153           | 0.4211             | 0.5             | 0.4571      | 32              | 0.7143         | 0.8065      | 0.7576  | 31          | 0.6305            | 0.7890         | 0.7009     | 0.9376           |
| 0.2277        | 9.0   | 954   | 0.1994          | 0.6404             | 0.8261          | 0.7215      | 69              | 0.4588                 | 0.6393              | 0.5342          | 61                  | 0.7692           | 0.9150        | 0.8358    | 153           | 0.4737             | 0.5625          | 0.5143      | 32              | 0.7576         | 0.8065      | 0.7812  | 31          | 0.6534            | 0.8064         | 0.7219     | 0.9403           |
| 0.2071        | 10.0  | 1060  | 0.1809          | 0.7024             | 0.8551          | 0.7712      | 69              | 0.4556                 | 0.6721              | 0.5430          | 61                  | 0.7809           | 0.9085        | 0.8399    | 153           | 0.5135             | 0.5938          | 0.5507      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.6714            | 0.8208         | 0.7386     | 0.9428           |
| 0.1937        | 11.0  | 1166  | 0.1715          | 0.6897             | 0.8696          | 0.7692      | 69              | 0.5119                 | 0.7049              | 0.5931          | 61                  | 0.7865           | 0.9150        | 0.8459    | 153           | 0.5526             | 0.6562          | 0.6         | 32              | 0.7143         | 0.8065      | 0.7576  | 31          | 0.6848            | 0.8353         | 0.7526     | 0.9455           |
| 0.183         | 12.0  | 1272  | 0.1619          | 0.7059             | 0.8696          | 0.7792      | 69              | 0.525                  | 0.6885              | 0.5957          | 61                  | 0.7910           | 0.9150        | 0.8485    | 153           | 0.5526             | 0.6562          | 0.6         | 32              | 0.6944         | 0.8065      | 0.7463  | 31          | 0.6923            | 0.8324         | 0.7559     | 0.9480           |
| 0.1739        | 13.0  | 1378  | 0.1549          | 0.7143             | 0.8696          | 0.7843      | 69              | 0.5238                 | 0.7213              | 0.6069          | 61                  | 0.8011           | 0.9216        | 0.8571    | 153           | 0.5405             | 0.625           | 0.5797      | 32              | 0.6944         | 0.8065      | 0.7463  | 31          | 0.6954            | 0.8382         | 0.7602     | 0.9512           |
| 0.1665        | 14.0  | 1484  | 0.1525          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.5444                 | 0.8033              | 0.6490          | 61                  | 0.8161           | 0.9281        | 0.8685    | 153           | 0.6                | 0.6562          | 0.6269      | 32              | 0.7353         | 0.8065      | 0.7692  | 31          | 0.7150            | 0.8555         | 0.7789     | 0.9529           |
| 0.1598        | 15.0  | 1590  | 0.1506          | 0.7143             | 0.8696          | 0.7843      | 69              | 0.5357                 | 0.7377              | 0.6207          | 61                  | 0.8161           | 0.9281        | 0.8685    | 153           | 0.6111             | 0.6875          | 0.6471      | 32              | 0.7027         | 0.8387      | 0.7647  | 31          | 0.7108            | 0.8526         | 0.7753     | 0.9524           |
| 0.1549        | 16.0  | 1696  | 0.1479          | 0.7143             | 0.8696          | 0.7843      | 69              | 0.5542                 | 0.7541              | 0.6389          | 61                  | 0.8208           | 0.9281        | 0.8712    | 153           | 0.6                | 0.6562          | 0.6269      | 32              | 0.7105         | 0.8710      | 0.7826  | 31          | 0.7167            | 0.8555         | 0.7800     | 0.9537           |
| 0.1487        | 17.0  | 1802  | 0.1496          | 0.6977             | 0.8696          | 0.7742      | 69              | 0.5393                 | 0.7869              | 0.64            | 61                  | 0.8161           | 0.9281        | 0.8685    | 153           | 0.6316             | 0.75            | 0.6857      | 32              | 0.7105         | 0.8710      | 0.7826  | 31          | 0.7082            | 0.8699         | 0.7808     | 0.9534           |
| 0.1471        | 18.0  | 1908  | 0.1426          | 0.7108             | 0.8551          | 0.7763      | 69              | 0.5465                 | 0.7705              | 0.6395          | 61                  | 0.8208           | 0.9281        | 0.8712    | 153           | 0.5946             | 0.6875          | 0.6377      | 32              | 0.6667         | 0.8387      | 0.7429  | 31          | 0.7081            | 0.8555         | 0.7749     | 0.9557           |
| 0.1415        | 19.0  | 2014  | 0.1388          | 0.7439             | 0.8841          | 0.8079      | 69              | 0.575                  | 0.7541              | 0.6525          | 61                  | 0.8161           | 0.9281        | 0.8685    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.6667         | 0.8387      | 0.7429  | 31          | 0.7282            | 0.8671         | 0.7916     | 0.9569           |
| 0.1385        | 20.0  | 2120  | 0.1452          | 0.7093             | 0.8841          | 0.7871      | 69              | 0.5647                 | 0.7869              | 0.6575          | 61                  | 0.8023           | 0.9281        | 0.8606    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7179         | 0.9032      | 0.8     | 31          | 0.7193            | 0.8815         | 0.7922     | 0.9547           |
| 0.1361        | 21.0  | 2226  | 0.1402          | 0.7024             | 0.8551          | 0.7712      | 69              | 0.5455                 | 0.7869              | 0.6443          | 61                  | 0.8161           | 0.9281        | 0.8685    | 153           | 0.6857             | 0.75            | 0.7164      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7201            | 0.8699         | 0.7880     | 0.9559           |
| 0.1361        | 22.0  | 2332  | 0.1423          | 0.7262             | 0.8841          | 0.7974      | 69              | 0.5393                 | 0.7869              | 0.64            | 61                  | 0.8208           | 0.9281        | 0.8712    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.7368         | 0.9032      | 0.8116  | 31          | 0.7262            | 0.8815         | 0.7963     | 0.9549           |
| 0.1331        | 23.0  | 2438  | 0.1338          | 0.7317             | 0.8696          | 0.7947      | 69              | 0.5769                 | 0.7377              | 0.6475          | 61                  | 0.8256           | 0.9281        | 0.8738    | 153           | 0.7143             | 0.7812          | 0.7463      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7426            | 0.8671         | 0.8000     | 0.9581           |
| 0.1286        | 24.0  | 2544  | 0.1470          | 0.6977             | 0.8696          | 0.7742      | 69              | 0.5632                 | 0.8033              | 0.6622          | 61                  | 0.8256           | 0.9281        | 0.8738    | 153           | 0.65               | 0.8125          | 0.7222      | 32              | 0.7            | 0.9032      | 0.7887  | 31          | 0.7176            | 0.8815         | 0.7912     | 0.9544           |
| 0.1274        | 25.0  | 2650  | 0.1399          | 0.7143             | 0.8696          | 0.7843      | 69              | 0.5714                 | 0.7869              | 0.6621          | 61                  | 0.8198           | 0.9216        | 0.8677    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7368         | 0.9032      | 0.8116  | 31          | 0.7277            | 0.8728         | 0.7937     | 0.9567           |
| 0.1269        | 26.0  | 2756  | 0.1416          | 0.7349             | 0.8841          | 0.8026      | 69              | 0.5444                 | 0.8033              | 0.6490          | 61                  | 0.8161           | 0.9281        | 0.8685    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7286            | 0.8844         | 0.7990     | 0.9557           |
| 0.1242        | 27.0  | 2862  | 0.1372          | 0.7108             | 0.8551          | 0.7763      | 69              | 0.6076                 | 0.7869              | 0.6857          | 61                  | 0.8161           | 0.9281        | 0.8685    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7390            | 0.8757         | 0.8016     | 0.9569           |
| 0.1223        | 28.0  | 2968  | 0.1326          | 0.7625             | 0.8841          | 0.8188      | 69              | 0.5802                 | 0.7705              | 0.6620          | 61                  | 0.8256           | 0.9281        | 0.8738    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7506            | 0.8786         | 0.8096     | 0.9589           |
| 0.1193        | 29.0  | 3074  | 0.1309          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.6026                 | 0.7705              | 0.6763          | 61                  | 0.8402           | 0.9281        | 0.8820    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7556            | 0.8757         | 0.8112     | 0.9596           |
| 0.119         | 30.0  | 3180  | 0.1322          | 0.75               | 0.8696          | 0.8054      | 69              | 0.5875                 | 0.7705              | 0.6667          | 61                  | 0.8353           | 0.9281        | 0.8793    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7519            | 0.8757         | 0.8091     | 0.9601           |
| 0.1208        | 31.0  | 3286  | 0.1354          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.5854                 | 0.7869              | 0.6713          | 61                  | 0.8304           | 0.9281        | 0.8765    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7402            | 0.8728         | 0.8011     | 0.9586           |
| 0.1143        | 32.0  | 3392  | 0.1314          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.5732                 | 0.7705              | 0.6573          | 61                  | 0.8353           | 0.9281        | 0.8793    | 153           | 0.7143             | 0.7812          | 0.7463      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7450            | 0.8699         | 0.8027     | 0.9586           |
| 0.1151        | 33.0  | 3498  | 0.1328          | 0.7317             | 0.8696          | 0.7947      | 69              | 0.5714                 | 0.7869              | 0.6621          | 61                  | 0.8304           | 0.9281        | 0.8765    | 153           | 0.6486             | 0.75            | 0.6957      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7348            | 0.8728         | 0.7979     | 0.9591           |
| 0.1121        | 34.0  | 3604  | 0.1394          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.5506                 | 0.8033              | 0.6533          | 61                  | 0.8314           | 0.9346        | 0.8800    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7356            | 0.8844         | 0.8031     | 0.9571           |
| 0.1149        | 35.0  | 3710  | 0.1341          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5517                 | 0.7869              | 0.6486          | 61                  | 0.8363           | 0.9346        | 0.8827    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7397            | 0.8786         | 0.8032     | 0.9584           |
| 0.1114        | 36.0  | 3816  | 0.1286          | 0.7468             | 0.8551          | 0.7973      | 69              | 0.6076                 | 0.7869              | 0.6857          | 61                  | 0.8412           | 0.9346        | 0.8854    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7556            | 0.8757         | 0.8112     | 0.9606           |
| 0.1092        | 37.0  | 3922  | 0.1328          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.5904                 | 0.8033              | 0.6806          | 61                  | 0.8314           | 0.9346        | 0.8800    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7439            | 0.8815         | 0.8069     | 0.9594           |
| 0.1072        | 38.0  | 4028  | 0.1340          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.5976                 | 0.8033              | 0.6853          | 61                  | 0.8266           | 0.9346        | 0.8773    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7439            | 0.8815         | 0.8069     | 0.9599           |
| 0.1032        | 39.0  | 4134  | 0.1285          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5854                 | 0.7869              | 0.6713          | 61                  | 0.8304           | 0.9281        | 0.8765    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7445            | 0.8757         | 0.8048     | 0.9604           |
| 0.1045        | 40.0  | 4240  | 0.1285          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.5926                 | 0.7869              | 0.6761          | 61                  | 0.8304           | 0.9281        | 0.8765    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7463            | 0.8757         | 0.8059     | 0.9614           |
| 0.1057        | 41.0  | 4346  | 0.1311          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6024                 | 0.8197              | 0.6944          | 61                  | 0.8266           | 0.9346        | 0.8773    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7445            | 0.8844         | 0.8085     | 0.9594           |
| 0.104         | 42.0  | 4452  | 0.1323          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5882                 | 0.8197              | 0.6849          | 61                  | 0.8324           | 0.9412        | 0.8834    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7451            | 0.8873         | 0.8100     | 0.9589           |
| 0.1066        | 43.0  | 4558  | 0.1354          | 0.7342             | 0.8406          | 0.7838      | 69              | 0.6024                 | 0.8197              | 0.6944          | 61                  | 0.8266           | 0.9346        | 0.8773    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7457            | 0.8815         | 0.8079     | 0.9584           |
| 0.1046        | 44.0  | 4664  | 0.1240          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5949                 | 0.7705              | 0.6714          | 61                  | 0.8256           | 0.9281        | 0.8738    | 153           | 0.6486             | 0.75            | 0.6957      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7426            | 0.8671         | 0.8000     | 0.9609           |
| 0.102         | 45.0  | 4770  | 0.1278          | 0.7468             | 0.8551          | 0.7973      | 69              | 0.5976                 | 0.8033              | 0.6853          | 61                  | 0.8304           | 0.9281        | 0.8765    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7506            | 0.8786         | 0.8096     | 0.9599           |
| 0.101         | 46.0  | 4876  | 0.1306          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5952                 | 0.8197              | 0.6897          | 61                  | 0.8218           | 0.9346        | 0.8746    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7427            | 0.8844         | 0.8074     | 0.9596           |
| 0.1002        | 47.0  | 4982  | 0.1306          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5783                 | 0.7869              | 0.6667          | 61                  | 0.8266           | 0.9346        | 0.8773    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7415            | 0.8786         | 0.8042     | 0.9599           |
| 0.0994        | 48.0  | 5088  | 0.1315          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.5595                 | 0.7705              | 0.6483          | 61                  | 0.8266           | 0.9346        | 0.8773    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7390            | 0.8757         | 0.8016     | 0.9586           |
| 0.0995        | 49.0  | 5194  | 0.1285          | 0.7692             | 0.8696          | 0.8163      | 69              | 0.5976                 | 0.8033              | 0.6853          | 61                  | 0.8208           | 0.9281        | 0.8712    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7506            | 0.8786         | 0.8096     | 0.9599           |
| 0.0981        | 50.0  | 5300  | 0.1275          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6                    | 0.7869              | 0.6809          | 61                  | 0.8208           | 0.9281        | 0.8712    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7402            | 0.8728         | 0.8011     | 0.9594           |
| 0.0966        | 51.0  | 5406  | 0.1287          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5952                 | 0.8197              | 0.6897          | 61                  | 0.8372           | 0.9412        | 0.8862    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7445            | 0.8844         | 0.8085     | 0.9599           |
| 0.0963        | 52.0  | 5512  | 0.1288          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6024                 | 0.8197              | 0.6944          | 61                  | 0.8218           | 0.9346        | 0.8746    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7445            | 0.8844         | 0.8085     | 0.9601           |
| 0.098         | 53.0  | 5618  | 0.1283          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5976                 | 0.8033              | 0.6853          | 61                  | 0.8208           | 0.9281        | 0.8712    | 153           | 0.6316             | 0.75            | 0.6857      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7384            | 0.8728         | 0.8000     | 0.9594           |
| 0.095         | 54.0  | 5724  | 0.1266          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6203                 | 0.8033              | 0.7             | 61                  | 0.8314           | 0.9346        | 0.8800    | 153           | 0.6316             | 0.75            | 0.6857      | 32              | 0.8            | 0.9032      | 0.8485  | 31          | 0.75              | 0.8757         | 0.8080     | 0.9621           |
| 0.0963        | 55.0  | 5830  | 0.1305          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8266           | 0.9346        | 0.8773    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7463            | 0.8844         | 0.8095     | 0.9606           |
| 0.0945        | 56.0  | 5936  | 0.1237          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6410                 | 0.8197              | 0.7194          | 61                  | 0.8304           | 0.9281        | 0.8765    | 153           | 0.6316             | 0.75            | 0.6857      | 32              | 0.8            | 0.9032      | 0.8485  | 31          | 0.7537            | 0.8757         | 0.8102     | 0.9626           |
| 0.0944        | 57.0  | 6042  | 0.1275          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8266           | 0.9346        | 0.8773    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7482            | 0.8844         | 0.8106     | 0.9604           |
| 0.094         | 58.0  | 6148  | 0.1249          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6329                 | 0.8197              | 0.7143          | 61                  | 0.8314           | 0.9346        | 0.8800    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7531            | 0.8815         | 0.8123     | 0.9621           |
| 0.0927        | 59.0  | 6254  | 0.1248          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8266           | 0.9346        | 0.8773    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.75              | 0.8844         | 0.8117     | 0.9614           |
| 0.0928        | 60.0  | 6360  | 0.1292          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8266           | 0.9346        | 0.8773    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7463            | 0.8844         | 0.8095     | 0.9601           |
| 0.0931        | 61.0  | 6466  | 0.1280          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6024                 | 0.8197              | 0.6944          | 61                  | 0.8208           | 0.9281        | 0.8712    | 153           | 0.6486             | 0.75            | 0.6957      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7408            | 0.8757         | 0.8026     | 0.9599           |
| 0.0894        | 62.0  | 6572  | 0.1278          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6024                 | 0.8197              | 0.6944          | 61                  | 0.8266           | 0.9346        | 0.8773    | 153           | 0.6486             | 0.75            | 0.6957      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7433            | 0.8786         | 0.8053     | 0.9599           |
| 0.0911        | 63.0  | 6678  | 0.1259          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5783                 | 0.7869              | 0.6667          | 61                  | 0.8363           | 0.9346        | 0.8827    | 153           | 0.6216             | 0.7188          | 0.6667      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7377            | 0.8699         | 0.7984     | 0.9604           |
| 0.0889        | 64.0  | 6784  | 0.1291          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6024                 | 0.8197              | 0.6944          | 61                  | 0.8314           | 0.9346        | 0.8800    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7439            | 0.8815         | 0.8069     | 0.9596           |
| 0.0884        | 65.0  | 6890  | 0.1276          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.625                  | 0.8197              | 0.7092          | 61                  | 0.8218           | 0.9346        | 0.8746    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7463            | 0.8844         | 0.8095     | 0.9604           |
| 0.0905        | 66.0  | 6996  | 0.1283          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6024                 | 0.8197              | 0.6944          | 61                  | 0.8266           | 0.9346        | 0.8773    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7439            | 0.8815         | 0.8069     | 0.9604           |
| 0.0884        | 67.0  | 7102  | 0.1295          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8256           | 0.9281        | 0.8738    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7457            | 0.8815         | 0.8079     | 0.9596           |
| 0.0881        | 68.0  | 7208  | 0.1293          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5952                 | 0.8197              | 0.6897          | 61                  | 0.8353           | 0.9281        | 0.8793    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7433            | 0.8786         | 0.8053     | 0.9596           |
| 0.0903        | 69.0  | 7314  | 0.1259          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8363           | 0.9346        | 0.8827    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7494            | 0.8815         | 0.8101     | 0.9611           |
| 0.089         | 70.0  | 7420  | 0.1226          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6203                 | 0.8033              | 0.7             | 61                  | 0.8304           | 0.9281        | 0.8765    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.8            | 0.9032      | 0.8485  | 31          | 0.7556            | 0.8757         | 0.8112     | 0.9628           |
| 0.0883        | 71.0  | 7526  | 0.1259          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5904                 | 0.8033              | 0.6806          | 61                  | 0.8353           | 0.9281        | 0.8793    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7445            | 0.8757         | 0.8048     | 0.9609           |
| 0.0878        | 72.0  | 7632  | 0.1265          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5976                 | 0.8033              | 0.6853          | 61                  | 0.8353           | 0.9281        | 0.8793    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7463            | 0.8757         | 0.8059     | 0.9609           |
| 0.0866        | 73.0  | 7738  | 0.1245          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6049                 | 0.8033              | 0.6901          | 61                  | 0.8266           | 0.9346        | 0.8773    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7469            | 0.8786         | 0.8074     | 0.9611           |
| 0.0859        | 74.0  | 7844  | 0.1276          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5904                 | 0.8033              | 0.6806          | 61                  | 0.8125           | 0.9346        | 0.8693    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7385            | 0.8815         | 0.8037     | 0.9601           |
| 0.088         | 75.0  | 7950  | 0.1258          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6049                 | 0.8033              | 0.6901          | 61                  | 0.8353           | 0.9281        | 0.8793    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7488            | 0.8786         | 0.8085     | 0.9614           |
| 0.0877        | 76.0  | 8056  | 0.1284          | 0.7195             | 0.8551          | 0.7815      | 69              | 0.6024                 | 0.8197              | 0.6944          | 61                  | 0.8256           | 0.9281        | 0.8738    | 153           | 0.6316             | 0.75            | 0.6857      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7354            | 0.8757         | 0.7995     | 0.9586           |
| 0.0865        | 77.0  | 8162  | 0.1269          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8353           | 0.9281        | 0.8793    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7488            | 0.8786         | 0.8085     | 0.9611           |
| 0.0873        | 78.0  | 8268  | 0.1249          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6049                 | 0.8033              | 0.6901          | 61                  | 0.8256           | 0.9281        | 0.8738    | 153           | 0.6486             | 0.75            | 0.6957      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7420            | 0.8728         | 0.8021     | 0.9604           |
| 0.0837        | 79.0  | 8374  | 0.1265          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8256           | 0.9281        | 0.8738    | 153           | 0.6486             | 0.75            | 0.6957      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7445            | 0.8757         | 0.8048     | 0.9606           |
| 0.0866        | 80.0  | 8480  | 0.1308          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8363           | 0.9346        | 0.8827    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7475            | 0.8815         | 0.8090     | 0.9604           |
| 0.084         | 81.0  | 8586  | 0.1274          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8304           | 0.9281        | 0.8765    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7469            | 0.8786         | 0.8074     | 0.9606           |
| 0.0858        | 82.0  | 8692  | 0.1274          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8304           | 0.9281        | 0.8765    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7488            | 0.8786         | 0.8085     | 0.9614           |
| 0.0837        | 83.0  | 8798  | 0.1258          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8304           | 0.9281        | 0.8765    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7488            | 0.8786         | 0.8085     | 0.9614           |
| 0.0866        | 84.0  | 8904  | 0.1270          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6049                 | 0.8033              | 0.6901          | 61                  | 0.8304           | 0.9281        | 0.8765    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7463            | 0.8757         | 0.8059     | 0.9609           |
| 0.0837        | 85.0  | 9010  | 0.1271          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6049                 | 0.8033              | 0.6901          | 61                  | 0.8304           | 0.9281        | 0.8765    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7463            | 0.8757         | 0.8059     | 0.9606           |
| 0.085         | 86.0  | 9116  | 0.1291          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8363           | 0.9346        | 0.8827    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7475            | 0.8815         | 0.8090     | 0.9606           |
| 0.0818        | 87.0  | 9222  | 0.1290          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8208           | 0.9281        | 0.8712    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7451            | 0.8786         | 0.8064     | 0.9606           |
| 0.0814        | 88.0  | 9328  | 0.1279          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8304           | 0.9281        | 0.8765    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7488            | 0.8786         | 0.8085     | 0.9611           |
| 0.0845        | 89.0  | 9434  | 0.1287          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6220                 | 0.8361              | 0.7133          | 61                  | 0.8363           | 0.9346        | 0.8827    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7518            | 0.8844         | 0.8127     | 0.9616           |
| 0.0838        | 90.0  | 9540  | 0.1289          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6220                 | 0.8361              | 0.7133          | 61                  | 0.8412           | 0.9346        | 0.8854    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7537            | 0.8844         | 0.8138     | 0.9619           |
| 0.0832        | 91.0  | 9646  | 0.1281          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6220                 | 0.8361              | 0.7133          | 61                  | 0.8412           | 0.9346        | 0.8854    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7537            | 0.8844         | 0.8138     | 0.9616           |
| 0.0818        | 92.0  | 9752  | 0.1275          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8412           | 0.9346        | 0.8854    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7531            | 0.8815         | 0.8123     | 0.9616           |
| 0.0843        | 93.0  | 9858  | 0.1291          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6145                 | 0.8361              | 0.7083          | 61                  | 0.8363           | 0.9346        | 0.8827    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7482            | 0.8844         | 0.8106     | 0.9609           |
| 0.0821        | 94.0  | 9964  | 0.1279          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8363           | 0.9346        | 0.8827    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7512            | 0.8815         | 0.8112     | 0.9614           |
| 0.0807        | 95.0  | 10070 | 0.1279          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8363           | 0.9346        | 0.8827    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7512            | 0.8815         | 0.8112     | 0.9616           |
| 0.0833        | 96.0  | 10176 | 0.1291          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6220                 | 0.8361              | 0.7133          | 61                  | 0.8363           | 0.9346        | 0.8827    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7518            | 0.8844         | 0.8127     | 0.9614           |
| 0.0835        | 97.0  | 10282 | 0.1281          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8363           | 0.9346        | 0.8827    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7512            | 0.8815         | 0.8112     | 0.9614           |
| 0.081         | 98.0  | 10388 | 0.1283          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8363           | 0.9346        | 0.8827    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7512            | 0.8815         | 0.8112     | 0.9614           |
| 0.0815        | 99.0  | 10494 | 0.1280          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8412           | 0.9346        | 0.8854    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7531            | 0.8815         | 0.8123     | 0.9616           |
| 0.0848        | 100.0 | 10600 | 0.1282          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8363           | 0.9346        | 0.8827    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7512            | 0.8815         | 0.8112     | 0.9614           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2