File size: 49,487 Bytes
601a22a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
---
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-seq_bn-1
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-seq_bn-1

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co/indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1642
- Location Precision: 0.7195
- Location Recall: 0.8551
- Location F1: 0.7815
- Location Number: 69
- Organization Precision: 0.6098
- Organization Recall: 0.8197
- Organization F1: 0.6993
- Organization Number: 61
- Person Precision: 0.8494
- Person Recall: 0.9216
- Person F1: 0.8840
- Person Number: 153
- Quantity Precision: 0.7105
- Quantity Recall: 0.8438
- Quantity F1: 0.7714
- Quantity Number: 32
- Time Precision: 0.7941
- Time Recall: 0.8710
- Time F1: 0.8308
- Time Number: 31
- Overall Precision: 0.7562
- Overall Recall: 0.8786
- Overall F1: 0.8128
- Overall Accuracy: 0.9604

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.9293        | 1.0   | 106   | 0.6360          | 0.0                | 0.0             | 0.0         | 69              | 0.0                    | 0.0                 | 0.0             | 61                  | 0.25             | 0.0065        | 0.0127    | 153           | 0.0                | 0.0             | 0.0         | 32              | 0.0            | 0.0         | 0.0     | 31          | 0.2               | 0.0029         | 0.0057     | 0.8358           |
| 0.5712        | 2.0   | 212   | 0.4339          | 0.5                | 0.1449          | 0.2247      | 69              | 0.08                   | 0.0328              | 0.0465          | 61                  | 0.4311           | 0.4706        | 0.45      | 153           | 0.0                | 0.0             | 0.0         | 32              | 0.6667         | 0.4516      | 0.5385  | 31          | 0.4206            | 0.2832         | 0.3385     | 0.8806           |
| 0.4084        | 3.0   | 318   | 0.3173          | 0.5063             | 0.5797          | 0.5405      | 69              | 0.3036                 | 0.2787              | 0.2906          | 61                  | 0.5535           | 0.7778        | 0.6467    | 153           | 0.2333             | 0.2188          | 0.2258      | 32              | 0.6667         | 0.7097      | 0.6875  | 31          | 0.4964            | 0.5925         | 0.5402     | 0.9165           |
| 0.306         | 4.0   | 424   | 0.2266          | 0.5595             | 0.6812          | 0.6144      | 69              | 0.4643                 | 0.4262              | 0.4444          | 61                  | 0.6989           | 0.8497        | 0.7670    | 153           | 0.5676             | 0.6562          | 0.6087      | 32              | 0.8065         | 0.8065      | 0.8065  | 31          | 0.6320            | 0.7197         | 0.6730     | 0.9371           |
| 0.2369        | 5.0   | 530   | 0.2118          | 0.5189             | 0.7971          | 0.6286      | 69              | 0.4651                 | 0.6557              | 0.5442          | 61                  | 0.7158           | 0.8889        | 0.7930    | 153           | 0.4583             | 0.6875          | 0.5500      | 32              | 0.7879         | 0.8387      | 0.8125  | 31          | 0.6026            | 0.8064         | 0.6897     | 0.9381           |
| 0.1993        | 6.0   | 636   | 0.1713          | 0.6129             | 0.8261          | 0.7037      | 69              | 0.5366                 | 0.7213              | 0.6154          | 61                  | 0.7701           | 0.8758        | 0.8196    | 153           | 0.5122             | 0.6562          | 0.5753      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.6706            | 0.8179         | 0.7370     | 0.9482           |
| 0.1745        | 7.0   | 742   | 0.1560          | 0.6914             | 0.8116          | 0.7467      | 69              | 0.5233                 | 0.7377              | 0.6122          | 61                  | 0.7988           | 0.8824        | 0.8385    | 153           | 0.5476             | 0.7188          | 0.6216      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.6976            | 0.8266         | 0.7566     | 0.9512           |
| 0.158         | 8.0   | 848   | 0.1504          | 0.7024             | 0.8551          | 0.7712      | 69              | 0.5476                 | 0.7541              | 0.6345          | 61                  | 0.8036           | 0.8824        | 0.8411    | 153           | 0.5610             | 0.7188          | 0.6301      | 32              | 0.6842         | 0.8387      | 0.7536  | 31          | 0.6964            | 0.8353         | 0.7595     | 0.9522           |
| 0.1464        | 9.0   | 954   | 0.1448          | 0.6897             | 0.8696          | 0.7692      | 69              | 0.5366                 | 0.7213              | 0.6154          | 61                  | 0.8182           | 0.8824        | 0.8491    | 153           | 0.6                | 0.75            | 0.6667      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7066            | 0.8353         | 0.7656     | 0.9529           |
| 0.14          | 10.0  | 1060  | 0.1318          | 0.75               | 0.8261          | 0.7862      | 69              | 0.5676                 | 0.6885              | 0.6222          | 61                  | 0.8210           | 0.8693        | 0.8444    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.75           | 0.8710      | 0.8060  | 31          | 0.7377            | 0.8208         | 0.7770     | 0.9584           |
| 0.1336        | 11.0  | 1166  | 0.1326          | 0.6941             | 0.8551          | 0.7662      | 69              | 0.5857                 | 0.6721              | 0.6260          | 61                  | 0.8344           | 0.8889        | 0.8608    | 153           | 0.5854             | 0.75            | 0.6575      | 32              | 0.7297         | 0.8710      | 0.7941  | 31          | 0.7247            | 0.8295         | 0.7736     | 0.9559           |
| 0.126         | 12.0  | 1272  | 0.1323          | 0.7229             | 0.8696          | 0.7895      | 69              | 0.6111                 | 0.7213              | 0.6617          | 61                  | 0.8284           | 0.9150        | 0.8696    | 153           | 0.5714             | 0.75            | 0.6486      | 32              | 0.75           | 0.8710      | 0.8060  | 31          | 0.7338            | 0.8526         | 0.7888     | 0.9569           |
| 0.1209        | 13.0  | 1378  | 0.1298          | 0.7317             | 0.8696          | 0.7947      | 69              | 0.6                    | 0.7869              | 0.6809          | 61                  | 0.8323           | 0.9085        | 0.8688    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7494            | 0.8642         | 0.8027     | 0.9601           |
| 0.1172        | 14.0  | 1484  | 0.1449          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.5699                 | 0.8689              | 0.6883          | 61                  | 0.8150           | 0.9216        | 0.8650    | 153           | 0.5714             | 0.75            | 0.6486      | 32              | 0.6842         | 0.8387      | 0.7536  | 31          | 0.7096            | 0.8757         | 0.7840     | 0.9529           |
| 0.1135        | 15.0  | 1590  | 0.1262          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.6479                 | 0.7541              | 0.6970          | 61                  | 0.8293           | 0.8889        | 0.8580    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7617            | 0.8497         | 0.8033     | 0.9606           |
| 0.1087        | 16.0  | 1696  | 0.1269          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6203                 | 0.8033              | 0.7             | 61                  | 0.8263           | 0.9020        | 0.8625    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7570            | 0.8642         | 0.8070     | 0.9611           |
| 0.1041        | 17.0  | 1802  | 0.1356          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.65                   | 0.8525              | 0.7376          | 61                  | 0.8313           | 0.9020        | 0.8652    | 153           | 0.6190             | 0.8125          | 0.7027      | 32              | 0.7714         | 0.8710      | 0.8182  | 31          | 0.75              | 0.8757         | 0.8080     | 0.9584           |
| 0.102         | 18.0  | 1908  | 0.1280          | 0.75               | 0.8696          | 0.8054      | 69              | 0.6338                 | 0.7377              | 0.6818          | 61                  | 0.8354           | 0.8954        | 0.8644    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7571            | 0.8468         | 0.7995     | 0.9606           |
| 0.0999        | 19.0  | 2014  | 0.1217          | 0.7821             | 0.8841          | 0.8299      | 69              | 0.6053                 | 0.7541              | 0.6715          | 61                  | 0.8415           | 0.9020        | 0.8707    | 153           | 0.6316             | 0.75            | 0.6857      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7590            | 0.8555         | 0.8043     | 0.9623           |
| 0.0942        | 20.0  | 2120  | 0.1324          | 0.7229             | 0.8696          | 0.7895      | 69              | 0.6623                 | 0.8361              | 0.7391          | 61                  | 0.8343           | 0.9216        | 0.8758    | 153           | 0.65               | 0.8125          | 0.7222      | 32              | 0.7105         | 0.8710      | 0.7826  | 31          | 0.7494            | 0.8815         | 0.8101     | 0.9604           |
| 0.0932        | 21.0  | 2226  | 0.1428          | 0.6932             | 0.8841          | 0.7771      | 69              | 0.6386                 | 0.8689              | 0.7361          | 61                  | 0.8294           | 0.9216        | 0.8731    | 153           | 0.625              | 0.7812          | 0.6944      | 32              | 0.7027         | 0.8387      | 0.7647  | 31          | 0.7321            | 0.8844         | 0.8010     | 0.9564           |
| 0.0916        | 22.0  | 2332  | 0.1281          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6711                 | 0.8361              | 0.7445          | 61                  | 0.8393           | 0.9216        | 0.8785    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7710            | 0.8757         | 0.8200     | 0.9628           |
| 0.0892        | 23.0  | 2438  | 0.1260          | 0.7692             | 0.8696          | 0.8163      | 69              | 0.6711                 | 0.8361              | 0.7445          | 61                  | 0.8443           | 0.9216        | 0.8812    | 153           | 0.6667             | 0.8125          | 0.7324      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7716            | 0.8786         | 0.8216     | 0.9628           |
| 0.0865        | 24.0  | 2544  | 0.1433          | 0.6897             | 0.8696          | 0.7692      | 69              | 0.6463                 | 0.8689              | 0.7413          | 61                  | 0.8443           | 0.9216        | 0.8812    | 153           | 0.6667             | 0.8125          | 0.7324      | 32              | 0.7027         | 0.8387      | 0.7647  | 31          | 0.7427            | 0.8844         | 0.8074     | 0.9579           |
| 0.0834        | 25.0  | 2650  | 0.1323          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6790                 | 0.9016              | 0.7746          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.65               | 0.8125          | 0.7222      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7681            | 0.8902         | 0.8246     | 0.9614           |
| 0.0823        | 26.0  | 2756  | 0.1324          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6627                 | 0.9016              | 0.7639          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.6923             | 0.8438          | 0.7606      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7706            | 0.8931         | 0.8273     | 0.9616           |
| 0.0809        | 27.0  | 2862  | 0.1321          | 0.75               | 0.8696          | 0.8054      | 69              | 0.6623                 | 0.8361              | 0.7391          | 61                  | 0.8537           | 0.9150        | 0.8833    | 153           | 0.6923             | 0.8438          | 0.7606      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7716            | 0.8786         | 0.8216     | 0.9616           |
| 0.0793        | 28.0  | 2968  | 0.1276          | 0.75               | 0.8696          | 0.8054      | 69              | 0.625                  | 0.7377              | 0.6767          | 61                  | 0.8545           | 0.9216        | 0.8868    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7641            | 0.8613         | 0.8098     | 0.9619           |
| 0.0759        | 29.0  | 3074  | 0.1305          | 0.75               | 0.8696          | 0.8054      | 69              | 0.6582                 | 0.8525              | 0.7429          | 61                  | 0.8485           | 0.9150        | 0.8805    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7696            | 0.8786         | 0.8205     | 0.9616           |
| 0.0742        | 30.0  | 3180  | 0.1352          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.6235                 | 0.8689              | 0.7260          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.6857             | 0.75            | 0.7164      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7581            | 0.8786         | 0.8139     | 0.9596           |
| 0.0755        | 31.0  | 3286  | 0.1235          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6438                 | 0.7705              | 0.7015          | 61                  | 0.8434           | 0.9150        | 0.8777    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7667            | 0.8642         | 0.8125     | 0.9628           |
| 0.0709        | 32.0  | 3392  | 0.1266          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6506                 | 0.8852              | 0.75            | 61                  | 0.8537           | 0.9150        | 0.8833    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7683            | 0.8815         | 0.8210     | 0.9628           |
| 0.0711        | 33.0  | 3498  | 0.1263          | 0.7692             | 0.8696          | 0.8163      | 69              | 0.6795                 | 0.8689              | 0.7626          | 61                  | 0.8537           | 0.9150        | 0.8833    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7879         | 0.8387      | 0.8125  | 31          | 0.7815            | 0.8786         | 0.8272     | 0.9646           |
| 0.0698        | 34.0  | 3604  | 0.1398          | 0.7317             | 0.8696          | 0.7947      | 69              | 0.6235                 | 0.8689              | 0.7260          | 61                  | 0.8503           | 0.9281        | 0.8875    | 153           | 0.65               | 0.8125          | 0.7222      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7506            | 0.8873         | 0.8132     | 0.9591           |
| 0.0669        | 35.0  | 3710  | 0.1391          | 0.6988             | 0.8406          | 0.7632      | 69              | 0.6136                 | 0.8852              | 0.7248          | 61                  | 0.8598           | 0.9216        | 0.8896    | 153           | 0.6667             | 0.8125          | 0.7324      | 32              | 0.7879         | 0.8387      | 0.8125  | 31          | 0.7494            | 0.8815         | 0.8101     | 0.9586           |
| 0.0659        | 36.0  | 3816  | 0.1316          | 0.7195             | 0.8551          | 0.7815      | 69              | 0.6310                 | 0.8689              | 0.7310          | 61                  | 0.8606           | 0.9281        | 0.8931    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7631            | 0.8844         | 0.8193     | 0.9623           |
| 0.0627        | 37.0  | 3922  | 0.1347          | 0.7108             | 0.8551          | 0.7763      | 69              | 0.6207                 | 0.8852              | 0.7297          | 61                  | 0.8598           | 0.9216        | 0.8896    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7599            | 0.8873         | 0.8187     | 0.9606           |
| 0.0627        | 38.0  | 4028  | 0.1356          | 0.7531             | 0.8841          | 0.8133      | 69              | 0.6463                 | 0.8689              | 0.7413          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7656            | 0.8873         | 0.8220     | 0.9621           |
| 0.0592        | 39.0  | 4134  | 0.1278          | 0.7821             | 0.8841          | 0.8299      | 69              | 0.6494                 | 0.8197              | 0.7246          | 61                  | 0.8485           | 0.9150        | 0.8805    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.7835            | 0.8786         | 0.8283     | 0.9641           |
| 0.06          | 40.0  | 4240  | 0.1365          | 0.6905             | 0.8406          | 0.7582      | 69              | 0.65                   | 0.8525              | 0.7376          | 61                  | 0.8485           | 0.9150        | 0.8805    | 153           | 0.6667             | 0.8125          | 0.7324      | 32              | 0.7879         | 0.8387      | 0.8125  | 31          | 0.7531            | 0.8728         | 0.8086     | 0.9599           |
| 0.0583        | 41.0  | 4346  | 0.1365          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6548                 | 0.9016              | 0.7586          | 61                  | 0.8402           | 0.9281        | 0.8820    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.7879         | 0.8387      | 0.8125  | 31          | 0.7643            | 0.8902         | 0.8224     | 0.9619           |
| 0.0592        | 42.0  | 4452  | 0.1467          | 0.75               | 0.8696          | 0.8054      | 69              | 0.6395                 | 0.9016              | 0.7483          | 61                  | 0.8614           | 0.9346        | 0.8966    | 153           | 0.6667             | 0.8125          | 0.7324      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7635            | 0.8960         | 0.8245     | 0.9594           |
| 0.0584        | 43.0  | 4558  | 0.1409          | 0.7531             | 0.8841          | 0.8133      | 69              | 0.625                  | 0.8197              | 0.7092          | 61                  | 0.8503           | 0.9281        | 0.8875    | 153           | 0.6341             | 0.8125          | 0.7123      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7550            | 0.8815         | 0.8133     | 0.9591           |
| 0.0571        | 44.0  | 4664  | 0.1371          | 0.7195             | 0.8551          | 0.7815      | 69              | 0.6386                 | 0.8689              | 0.7361          | 61                  | 0.8537           | 0.9150        | 0.8833    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7683            | 0.8815         | 0.8210     | 0.9621           |
| 0.0568        | 45.0  | 4770  | 0.1323          | 0.7692             | 0.8696          | 0.8163      | 69              | 0.6625                 | 0.8689              | 0.7518          | 61                  | 0.8528           | 0.9085        | 0.8797    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8710         | 0.8710      | 0.8710  | 31          | 0.7861            | 0.8815         | 0.8311     | 0.9633           |
| 0.0518        | 46.0  | 4876  | 0.1402          | 0.7024             | 0.8551          | 0.7712      | 69              | 0.6386                 | 0.8689              | 0.7361          | 61                  | 0.8650           | 0.9216        | 0.8924    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7606            | 0.8815         | 0.8166     | 0.9606           |
| 0.0529        | 47.0  | 4982  | 0.1366          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6310                 | 0.8689              | 0.7310          | 61                  | 0.8537           | 0.9150        | 0.8833    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7638            | 0.8786         | 0.8172     | 0.9621           |
| 0.0516        | 48.0  | 5088  | 0.1416          | 0.7531             | 0.8841          | 0.8133      | 69              | 0.6447                 | 0.8033              | 0.7153          | 61                  | 0.8485           | 0.9150        | 0.8805    | 153           | 0.65               | 0.8125          | 0.7222      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7652            | 0.8757         | 0.8167     | 0.9599           |
| 0.0524        | 49.0  | 5194  | 0.1416          | 0.7531             | 0.8841          | 0.8133      | 69              | 0.6456                 | 0.8361              | 0.7286          | 61                  | 0.8606           | 0.9281        | 0.8931    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.7772            | 0.8873         | 0.8286     | 0.9616           |
| 0.0494        | 50.0  | 5300  | 0.1381          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6711                 | 0.8361              | 0.7445          | 61                  | 0.8545           | 0.9216        | 0.8868    | 153           | 0.6667             | 0.8125          | 0.7324      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7761            | 0.8815         | 0.8254     | 0.9621           |
| 0.0478        | 51.0  | 5406  | 0.1435          | 0.7722             | 0.8841          | 0.8243      | 69              | 0.6207                 | 0.8852              | 0.7297          | 61                  | 0.8545           | 0.9216        | 0.8868    | 153           | 0.75               | 0.8438          | 0.7941      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.775             | 0.8960         | 0.8311     | 0.9623           |
| 0.0485        | 52.0  | 5512  | 0.1402          | 0.7922             | 0.8841          | 0.8356      | 69              | 0.6322                 | 0.9016              | 0.7432          | 61                  | 0.8545           | 0.9216        | 0.8868    | 153           | 0.7297             | 0.8438          | 0.7826      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.7814            | 0.8988         | 0.8360     | 0.9626           |
| 0.0475        | 53.0  | 5618  | 0.1382          | 0.7922             | 0.8841          | 0.8356      | 69              | 0.6235                 | 0.8689              | 0.7260          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.7797            | 0.8902         | 0.8313     | 0.9631           |
| 0.0481        | 54.0  | 5724  | 0.1421          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6456                 | 0.8361              | 0.7286          | 61                  | 0.8545           | 0.9216        | 0.8868    | 153           | 0.675              | 0.8438          | 0.75        | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7683            | 0.8815         | 0.8210     | 0.9606           |
| 0.0474        | 55.0  | 5830  | 0.1441          | 0.7821             | 0.8841          | 0.8299      | 69              | 0.6322                 | 0.9016              | 0.7432          | 61                  | 0.8512           | 0.9346        | 0.8910    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7748            | 0.9046         | 0.8347     | 0.9619           |
| 0.0456        | 56.0  | 5936  | 0.1413          | 0.7108             | 0.8551          | 0.7763      | 69              | 0.6447                 | 0.8033              | 0.7153          | 61                  | 0.8606           | 0.9281        | 0.8931    | 153           | 0.675              | 0.8438          | 0.75        | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7657            | 0.8786         | 0.8183     | 0.9614           |
| 0.0451        | 57.0  | 6042  | 0.1452          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6582                 | 0.8525              | 0.7429          | 61                  | 0.8563           | 0.9346        | 0.8938    | 153           | 0.6923             | 0.8438          | 0.7606      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7719            | 0.8902         | 0.8268     | 0.9626           |
| 0.0437        | 58.0  | 6148  | 0.1460          | 0.7108             | 0.8551          | 0.7763      | 69              | 0.6265                 | 0.8525              | 0.7222          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.6923             | 0.8438          | 0.7606      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.7656            | 0.8873         | 0.8220     | 0.9616           |
| 0.0424        | 59.0  | 6254  | 0.1501          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6341                 | 0.8525              | 0.7273          | 61                  | 0.8503           | 0.9281        | 0.8875    | 153           | 0.6923             | 0.8438          | 0.7606      | 32              | 0.7714         | 0.8710      | 0.8182  | 31          | 0.7599            | 0.8873         | 0.8187     | 0.9604           |
| 0.0423        | 60.0  | 6360  | 0.1540          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.6163                 | 0.8689              | 0.7211          | 61                  | 0.8452           | 0.9281        | 0.8847    | 153           | 0.6667             | 0.8125          | 0.7324      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7549            | 0.8902         | 0.8170     | 0.9604           |
| 0.041         | 61.0  | 6466  | 0.1479          | 0.75               | 0.8696          | 0.8054      | 69              | 0.6235                 | 0.8689              | 0.7260          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7637            | 0.8873         | 0.8209     | 0.9611           |
| 0.0405        | 62.0  | 6572  | 0.1487          | 0.7108             | 0.8551          | 0.7763      | 69              | 0.6329                 | 0.8197              | 0.7143          | 61                  | 0.8452           | 0.9281        | 0.8847    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.76              | 0.8786         | 0.8150     | 0.9606           |
| 0.0394        | 63.0  | 6678  | 0.1480          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6235                 | 0.8689              | 0.7260          | 61                  | 0.8554           | 0.9281        | 0.8903    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.7694            | 0.8873         | 0.8242     | 0.9626           |
| 0.0384        | 64.0  | 6784  | 0.1568          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6279                 | 0.8852              | 0.7347          | 61                  | 0.8563           | 0.9346        | 0.8938    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7635            | 0.8960         | 0.8245     | 0.9609           |
| 0.0397        | 65.0  | 6890  | 0.1487          | 0.7625             | 0.8841          | 0.8188      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8393           | 0.9216        | 0.8785    | 153           | 0.6923             | 0.8438          | 0.7606      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7593            | 0.8844         | 0.8171     | 0.9604           |
| 0.0388        | 66.0  | 6996  | 0.1625          | 0.7024             | 0.8551          | 0.7712      | 69              | 0.6047                 | 0.8525              | 0.7075          | 61                  | 0.8471           | 0.9412        | 0.8916    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.75              | 0.8931         | 0.8153     | 0.9601           |
| 0.0402        | 67.0  | 7102  | 0.1620          | 0.7349             | 0.8841          | 0.8026      | 69              | 0.6118                 | 0.8525              | 0.7123          | 61                  | 0.8512           | 0.9346        | 0.8910    | 153           | 0.675              | 0.8438          | 0.75        | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7561            | 0.8960         | 0.8201     | 0.9596           |
| 0.0397        | 68.0  | 7208  | 0.1531          | 0.7108             | 0.8551          | 0.7763      | 69              | 0.6296                 | 0.8361              | 0.7183          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7587            | 0.8815         | 0.8155     | 0.9604           |
| 0.0383        | 69.0  | 7314  | 0.1517          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6071                 | 0.8361              | 0.7034          | 61                  | 0.8452           | 0.9281        | 0.8847    | 153           | 0.7297             | 0.8438          | 0.7826      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7656            | 0.8873         | 0.8220     | 0.9619           |
| 0.0375        | 70.0  | 7420  | 0.1548          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6190                 | 0.8525              | 0.7172          | 61                  | 0.8503           | 0.9281        | 0.8875    | 153           | 0.7297             | 0.8438          | 0.7826      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7637            | 0.8873         | 0.8209     | 0.9614           |
| 0.0368        | 71.0  | 7526  | 0.1553          | 0.7108             | 0.8551          | 0.7763      | 69              | 0.5952                 | 0.8197              | 0.6897          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7297             | 0.8438          | 0.7826      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7543            | 0.8786         | 0.8117     | 0.9599           |
| 0.0375        | 72.0  | 7632  | 0.1548          | 0.7108             | 0.8551          | 0.7763      | 69              | 0.6329                 | 0.8197              | 0.7143          | 61                  | 0.8443           | 0.9216        | 0.8812    | 153           | 0.7297             | 0.8438          | 0.7826      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.76              | 0.8786         | 0.8150     | 0.9609           |
| 0.0364        | 73.0  | 7738  | 0.1511          | 0.7160             | 0.8406          | 0.7733      | 69              | 0.6125                 | 0.8033              | 0.6950          | 61                  | 0.8443           | 0.9216        | 0.8812    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.7601            | 0.8699         | 0.8113     | 0.9616           |
| 0.0356        | 74.0  | 7844  | 0.1570          | 0.7108             | 0.8551          | 0.7763      | 69              | 0.6024                 | 0.8197              | 0.6944          | 61                  | 0.8443           | 0.9216        | 0.8812    | 153           | 0.75               | 0.8438          | 0.7941      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7562            | 0.8786         | 0.8128     | 0.9606           |
| 0.0345        | 75.0  | 7950  | 0.1601          | 0.75               | 0.8696          | 0.8054      | 69              | 0.6220                 | 0.8361              | 0.7133          | 61                  | 0.8503           | 0.9281        | 0.8875    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7631            | 0.8844         | 0.8193     | 0.9609           |
| 0.0358        | 76.0  | 8056  | 0.1599          | 0.7024             | 0.8551          | 0.7712      | 69              | 0.6190                 | 0.8525              | 0.7172          | 61                  | 0.8443           | 0.9216        | 0.8812    | 153           | 0.75               | 0.8438          | 0.7941      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7574            | 0.8844         | 0.816      | 0.9614           |
| 0.0359        | 77.0  | 8162  | 0.1563          | 0.7531             | 0.8841          | 0.8133      | 69              | 0.625                  | 0.8197              | 0.7092          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7297             | 0.8438          | 0.7826      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7708            | 0.8844         | 0.8237     | 0.9616           |
| 0.0328        | 78.0  | 8268  | 0.1555          | 0.7625             | 0.8841          | 0.8188      | 69              | 0.6282                 | 0.8033              | 0.7050          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7716            | 0.8786         | 0.8216     | 0.9616           |
| 0.034         | 79.0  | 8374  | 0.1584          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6296                 | 0.8361              | 0.7183          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7644            | 0.8815         | 0.8188     | 0.9614           |
| 0.0344        | 80.0  | 8480  | 0.1564          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6329                 | 0.8197              | 0.7143          | 61                  | 0.8443           | 0.9216        | 0.8812    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7716            | 0.8786         | 0.8216     | 0.9621           |
| 0.0337        | 81.0  | 8586  | 0.1657          | 0.7531             | 0.8841          | 0.8133      | 69              | 0.6125                 | 0.8033              | 0.6950          | 61                  | 0.8443           | 0.9216        | 0.8812    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.76              | 0.8786         | 0.8150     | 0.9601           |
| 0.0331        | 82.0  | 8692  | 0.1668          | 0.7625             | 0.8841          | 0.8188      | 69              | 0.6                    | 0.8361              | 0.6986          | 61                  | 0.8443           | 0.9216        | 0.8812    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7599            | 0.8873         | 0.8187     | 0.9601           |
| 0.0328        | 83.0  | 8798  | 0.1596          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6329                 | 0.8197              | 0.7143          | 61                  | 0.8485           | 0.9150        | 0.8805    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7652            | 0.8757         | 0.8167     | 0.9611           |
| 0.0339        | 84.0  | 8904  | 0.1590          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6375                 | 0.8361              | 0.7234          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7657            | 0.8786         | 0.8183     | 0.9614           |
| 0.0324        | 85.0  | 9010  | 0.1539          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6154                 | 0.7869              | 0.6906          | 61                  | 0.8424           | 0.9085        | 0.8742    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7608            | 0.8642         | 0.8092     | 0.9614           |
| 0.0327        | 86.0  | 9116  | 0.1589          | 0.7108             | 0.8551          | 0.7763      | 69              | 0.6026                 | 0.7705              | 0.6763          | 61                  | 0.8383           | 0.9150        | 0.875     | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7519            | 0.8671         | 0.8054     | 0.9606           |
| 0.0318        | 87.0  | 9222  | 0.1615          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6375                 | 0.8361              | 0.7234          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7663            | 0.8815         | 0.8199     | 0.9611           |
| 0.0311        | 88.0  | 9328  | 0.1607          | 0.7195             | 0.8551          | 0.7815      | 69              | 0.6154                 | 0.7869              | 0.6906          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7607            | 0.8728         | 0.8129     | 0.9609           |
| 0.033         | 89.0  | 9434  | 0.1633          | 0.7108             | 0.8551          | 0.7763      | 69              | 0.6234                 | 0.7869              | 0.6957          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7588            | 0.8728         | 0.8118     | 0.9601           |
| 0.0314        | 90.0  | 9540  | 0.1654          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.6203                 | 0.8033              | 0.7             | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7657            | 0.8786         | 0.8183     | 0.9606           |
| 0.0317        | 91.0  | 9646  | 0.1604          | 0.7195             | 0.8551          | 0.7815      | 69              | 0.6203                 | 0.8033              | 0.7             | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7613            | 0.8757         | 0.8145     | 0.9614           |
| 0.0313        | 92.0  | 9752  | 0.1602          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6329                 | 0.8197              | 0.7143          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7632            | 0.8757         | 0.8156     | 0.9614           |
| 0.0317        | 93.0  | 9858  | 0.1619          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6329                 | 0.8197              | 0.7143          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7657            | 0.8786         | 0.8183     | 0.9611           |
| 0.0322        | 94.0  | 9964  | 0.1659          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6341                 | 0.8525              | 0.7273          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.765             | 0.8844         | 0.8204     | 0.9609           |
| 0.0305        | 95.0  | 10070 | 0.1641          | 0.7195             | 0.8551          | 0.7815      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7562            | 0.8786         | 0.8128     | 0.9604           |
| 0.0302        | 96.0  | 10176 | 0.1619          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6282                 | 0.8033              | 0.7050          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7652            | 0.8757         | 0.8167     | 0.9609           |
| 0.0309        | 97.0  | 10282 | 0.1639          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6296                 | 0.8361              | 0.7183          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7644            | 0.8815         | 0.8188     | 0.9609           |
| 0.0288        | 98.0  | 10388 | 0.1642          | 0.7195             | 0.8551          | 0.7815      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7581            | 0.8786         | 0.8139     | 0.9606           |
| 0.0307        | 99.0  | 10494 | 0.1646          | 0.7195             | 0.8551          | 0.7815      | 69              | 0.6049                 | 0.8033              | 0.6901          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7556            | 0.8757         | 0.8112     | 0.9604           |
| 0.032         | 100.0 | 10600 | 0.1642          | 0.7195             | 0.8551          | 0.7815      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7562            | 0.8786         | 0.8128     | 0.9604           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2