File size: 44,219 Bytes
5b85b22
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
---
license: cc-by-nc-sa-4.0
tags:
- generated_from_trainer
model-index:
- name: lmv2-g-receipts2
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# lmv2-g-receipts2

This model is a fine-tuned version of [microsoft/layoutlmv2-base-uncased](https://huggingface.co/microsoft/layoutlmv2-base-uncased) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.2756
- Purchase Time Precision: 0.9180
- Purchase Time Recall: 0.875
- Purchase Time F1: 0.8960
- Purchase Time Number: 128
- Receipt Date Precision: 0.8941
- Receipt Date Recall: 0.8994
- Receipt Date F1: 0.8968
- Receipt Date Number: 169
- Sub Total Precision: 0.8673
- Sub Total Recall: 0.7727
- Sub Total F1: 0.8173
- Sub Total Number: 110
- Supplier Address Precision: 0.7097
- Supplier Address Recall: 0.7719
- Supplier Address F1: 0.7395
- Supplier Address Number: 114
- Supplier Name Precision: 0.7159
- Supplier Name Recall: 0.7079
- Supplier Name F1: 0.7119
- Supplier Name Number: 267
- Tip Amount Precision: 0.6667
- Tip Amount Recall: 1.0
- Tip Amount F1: 0.8
- Tip Amount Number: 2
- Total Precision: 0.8978
- Total Recall: 0.9126
- Total F1: 0.9051
- Total Number: 183
- Total Tax Amount Precision: 0.8644
- Total Tax Amount Recall: 0.7846
- Total Tax Amount F1: 0.8226
- Total Tax Amount Number: 65
- Overall Precision: 0.8246
- Overall Recall: 0.8150
- Overall F1: 0.8198
- Overall Accuracy: 0.9749

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 3e-05
- train_batch_size: 1
- eval_batch_size: 1
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 50

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Purchase Time Precision | Purchase Time Recall | Purchase Time F1 | Purchase Time Number | Receipt Date Precision | Receipt Date Recall | Receipt Date F1 | Receipt Date Number | Sub Total Precision | Sub Total Recall | Sub Total F1 | Sub Total Number | Supplier Address Precision | Supplier Address Recall | Supplier Address F1 | Supplier Address Number | Supplier Name Precision | Supplier Name Recall | Supplier Name F1 | Supplier Name Number | Tip Amount Precision | Tip Amount Recall | Tip Amount F1 | Tip Amount Number | Total Precision | Total Recall | Total F1 | Total Number | Total Tax Amount Precision | Total Tax Amount Recall | Total Tax Amount F1 | Total Tax Amount Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:-------------------:|:----------------:|:------------:|:----------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:---------------:|:------------:|:--------:|:------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.972         | 1.0   | 793   | 0.4257          | 0.3830                  | 0.1406               | 0.2057           | 128                  | 0.0                    | 0.0                 | 0.0             | 169                 | 0.0                 | 0.0              | 0.0          | 110              | 0.3973                     | 0.5088                  | 0.4462              | 114                     | 0.5263                  | 0.3745               | 0.4376           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.4096          | 0.7923       | 0.5400   | 183          | 0.0                        | 0.0                     | 0.0                 | 65                      | 0.4355            | 0.3092         | 0.3617     | 0.9296           |
| 0.2924        | 2.0   | 1586  | 0.2379          | 0.9259                  | 0.7812               | 0.8475           | 128                  | 0.8182                 | 0.7456              | 0.7802          | 169                 | 0.8966              | 0.2364           | 0.3741       | 110              | 0.5571                     | 0.6842                  | 0.6142              | 114                     | 0.6584                  | 0.5993               | 0.6275           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.7042          | 0.8197       | 0.7576   | 183          | 1.0                        | 0.0462                  | 0.0882              | 65                      | 0.7225            | 0.6195         | 0.6670     | 0.9630           |
| 0.1611        | 3.0   | 2379  | 0.1756          | 0.8138                  | 0.9219               | 0.8645           | 128                  | 0.8020                 | 0.9349              | 0.8634          | 169                 | 0.7064              | 0.7              | 0.7032       | 110              | 0.5733                     | 0.7544                  | 0.6515              | 114                     | 0.7308                  | 0.6404               | 0.6826           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.8057          | 0.7705       | 0.7877   | 183          | 0.7258                     | 0.6923                  | 0.7087              | 65                      | 0.7425            | 0.7669         | 0.7545     | 0.9670           |
| 0.1013        | 4.0   | 3172  | 0.1557          | 0.9099                  | 0.7891               | 0.8452           | 128                  | 0.8659                 | 0.8402              | 0.8529          | 169                 | 0.8493              | 0.5636           | 0.6776       | 110              | 0.5970                     | 0.7018                  | 0.6452              | 114                     | 0.6603                  | 0.6479               | 0.6541           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.8371          | 0.8142       | 0.8255   | 183          | 0.8654                     | 0.6923                  | 0.7692              | 65                      | 0.7721            | 0.7245         | 0.7475     | 0.9692           |
| 0.0684        | 5.0   | 3965  | 0.1623          | 0.7718                  | 0.8984               | 0.8303           | 128                  | 0.7949                 | 0.9172              | 0.8516          | 169                 | 0.7131              | 0.7909           | 0.75         | 110              | 0.5705                     | 0.7807                  | 0.6593              | 114                     | 0.6887                  | 0.6629               | 0.6756           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.8392          | 0.9126       | 0.8743   | 183          | 0.5816                     | 0.8769                  | 0.6994              | 65                      | 0.7202            | 0.8160         | 0.7651     | 0.9661           |
| 0.0491        | 6.0   | 4758  | 0.1828          | 0.9008                  | 0.8516               | 0.8755           | 128                  | 0.8830                 | 0.8935              | 0.8882          | 169                 | 0.6846              | 0.8091           | 0.7417       | 110              | 0.5062                     | 0.7105                  | 0.5912              | 114                     | 0.6729                  | 0.6779               | 0.6754           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.8807          | 0.8470       | 0.8635   | 183          | 0.7361                     | 0.8154                  | 0.7737              | 65                      | 0.7452            | 0.7890         | 0.7665     | 0.9673           |
| 0.043         | 7.0   | 5551  | 0.1825          | 0.9237                  | 0.8516               | 0.8862           | 128                  | 0.8807                 | 0.9172              | 0.8986          | 169                 | 0.7672              | 0.8091           | 0.7876       | 110              | 0.6279                     | 0.7105                  | 0.6667              | 114                     | 0.7788                  | 0.6330               | 0.6983           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.9045          | 0.8798       | 0.8920   | 183          | 0.6867                     | 0.8769                  | 0.7703              | 65                      | 0.8073            | 0.7909         | 0.7990     | 0.9717           |
| 0.0325        | 8.0   | 6344  | 0.1645          | 0.875                   | 0.875                | 0.875            | 128                  | 0.8636                 | 0.8994              | 0.8812          | 169                 | 0.7288              | 0.7818           | 0.7544       | 110              | 0.6241                     | 0.7719                  | 0.6902              | 114                     | 0.7085                  | 0.7191               | 0.7138           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.8367          | 0.8962       | 0.8654   | 183          | 0.6344                     | 0.9077                  | 0.7468              | 65                      | 0.7596            | 0.8218         | 0.7894     | 0.9711           |
| 0.0276        | 9.0   | 7137  | 0.1761          | 0.9160                  | 0.8516               | 0.8826           | 128                  | 0.8706                 | 0.8757              | 0.8732          | 169                 | 0.8861              | 0.6364           | 0.7407       | 110              | 0.6045                     | 0.7105                  | 0.6532              | 114                     | 0.6689                  | 0.7416               | 0.7034           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.8299          | 0.8798       | 0.8541   | 183          | 0.9268                     | 0.5846                  | 0.7170              | 65                      | 0.7793            | 0.7755         | 0.7774     | 0.9705           |
| 0.0237        | 10.0  | 7930  | 0.1842          | 0.8473                  | 0.8672               | 0.8571           | 128                  | 0.8613                 | 0.8817              | 0.8713          | 169                 | 0.7607              | 0.8091           | 0.7841       | 110              | 0.6569                     | 0.7895                  | 0.7171              | 114                     | 0.7189                  | 0.6704               | 0.6938           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.8729          | 0.8634       | 0.8681   | 183          | 0.7794                     | 0.8154                  | 0.7970              | 65                      | 0.7850            | 0.7987         | 0.7918     | 0.9709           |
| 0.0229        | 11.0  | 8723  | 0.1811          | 0.9167                  | 0.8594               | 0.8871           | 128                  | 0.8929                 | 0.8876              | 0.8902          | 169                 | 0.75                | 0.7909           | 0.7699       | 110              | 0.6                        | 0.7368                  | 0.6614              | 114                     | 0.6958                  | 0.6854               | 0.6906           | 267                  | 1.0                  | 0.5               | 0.6667        | 2                 | 0.8639          | 0.9016       | 0.8824   | 183          | 0.8525                     | 0.8                     | 0.8254              | 65                      | 0.7849            | 0.8015         | 0.7931     | 0.9713           |
| 0.017         | 12.0  | 9516  | 0.2075          | 0.8906                  | 0.8906               | 0.8906           | 128                  | 0.7727                 | 0.9053              | 0.8338          | 169                 | 0.8218              | 0.7545           | 0.7867       | 110              | 0.6042                     | 0.7632                  | 0.6744              | 114                     | 0.6830                  | 0.6779               | 0.6805           | 267                  | 1.0                  | 0.5               | 0.6667        | 2                 | 0.8429          | 0.8798       | 0.8610   | 183          | 0.8281                     | 0.8154                  | 0.8217              | 65                      | 0.7628            | 0.8025         | 0.7822     | 0.9696           |
| 0.0149        | 13.0  | 10309 | 0.1781          | 0.8760                  | 0.8828               | 0.8794           | 128                  | 0.8786                 | 0.8994              | 0.8889          | 169                 | 0.8660              | 0.7636           | 0.8116       | 110              | 0.6357                     | 0.7193                  | 0.6749              | 114                     | 0.7154                  | 0.6779               | 0.6962           | 267                  | 0.5                  | 1.0               | 0.6667        | 2                 | 0.9138          | 0.8689       | 0.8908   | 183          | 0.8793                     | 0.7846                  | 0.8293              | 65                      | 0.8102            | 0.7938         | 0.8019     | 0.9738           |
| 0.0124        | 14.0  | 11102 | 0.1957          | 0.9106                  | 0.875                | 0.8924           | 128                  | 0.8629                 | 0.8935              | 0.8779          | 169                 | 0.8586              | 0.7727           | 0.8134       | 110              | 0.5909                     | 0.7982                  | 0.6791              | 114                     | 0.6823                  | 0.7079               | 0.6949           | 267                  | 1.0                  | 0.5               | 0.6667        | 2                 | 0.9191          | 0.8689       | 0.8933   | 183          | 0.8030                     | 0.8154                  | 0.8092              | 65                      | 0.7875            | 0.8102         | 0.7987     | 0.9729           |
| 0.01          | 15.0  | 11895 | 0.2174          | 0.9098                  | 0.8672               | 0.888            | 128                  | 0.8817                 | 0.8817              | 0.8817          | 169                 | 0.8298              | 0.7091           | 0.7647       | 110              | 0.6587                     | 0.7281                  | 0.6917              | 114                     | 0.6842                  | 0.6816               | 0.6829           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.875           | 0.8798       | 0.8774   | 183          | 0.9783                     | 0.6923                  | 0.8108              | 65                      | 0.8038            | 0.7813         | 0.7924     | 0.9726           |
| 0.0102        | 16.0  | 12688 | 0.2073          | 0.9106                  | 0.875                | 0.8924           | 128                  | 0.8276                 | 0.8521              | 0.8397          | 169                 | 0.7679              | 0.7818           | 0.7748       | 110              | 0.6378                     | 0.7105                  | 0.6722              | 114                     | 0.6806                  | 0.6704               | 0.6755           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8717          | 0.8907       | 0.8811   | 183          | 0.6962                     | 0.8462                  | 0.7639              | 65                      | 0.7697            | 0.7919         | 0.7806     | 0.9705           |
| 0.0091        | 17.0  | 13481 | 0.2205          | 0.8358                  | 0.875                | 0.8550           | 128                  | 0.8306                 | 0.8994              | 0.8636          | 169                 | 0.6133              | 0.8364           | 0.7077       | 110              | 0.5944                     | 0.7456                  | 0.6615              | 114                     | 0.6833                  | 0.7191               | 0.7007           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8410          | 0.8962       | 0.8677   | 183          | 0.7297                     | 0.8308                  | 0.7770              | 65                      | 0.7334            | 0.8218         | 0.7751     | 0.9680           |
| 0.0063        | 18.0  | 14274 | 0.2007          | 0.8527                  | 0.8594               | 0.8560           | 128                  | 0.8613                 | 0.8817              | 0.8713          | 169                 | 0.8283              | 0.7455           | 0.7847       | 110              | 0.6535                     | 0.7281                  | 0.6888              | 114                     | 0.7520                  | 0.6929               | 0.7212           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8730          | 0.9016       | 0.8871   | 183          | 0.7432                     | 0.8462                  | 0.7914              | 65                      | 0.7998            | 0.8006         | 0.8002     | 0.9719           |
| 0.0075        | 19.0  | 15067 | 0.2173          | 0.925                   | 0.8672               | 0.8952           | 128                  | 0.8765                 | 0.8817              | 0.8791          | 169                 | 0.8113              | 0.7818           | 0.7963       | 110              | 0.7196                     | 0.6754                  | 0.6968              | 114                     | 0.6982                  | 0.7191               | 0.7085           | 267                  | 1.0                  | 0.5               | 0.6667        | 2                 | 0.9080          | 0.8634       | 0.8852   | 183          | 0.8833                     | 0.8154                  | 0.848               | 65                      | 0.8164            | 0.7967         | 0.8064     | 0.9733           |
| 0.0062        | 20.0  | 15860 | 0.2255          | 0.888                   | 0.8672               | 0.8775           | 128                  | 0.8613                 | 0.8817              | 0.8713          | 169                 | 0.9048              | 0.6909           | 0.7835       | 110              | 0.6718                     | 0.7719                  | 0.7184              | 114                     | 0.7552                  | 0.6816               | 0.7165           | 267                  | 1.0                  | 0.5               | 0.6667        | 2                 | 0.9017          | 0.8525       | 0.8764   | 183          | 0.9074                     | 0.7538                  | 0.8235              | 65                      | 0.8269            | 0.7823         | 0.8040     | 0.9733           |
| 0.0063        | 21.0  | 16653 | 0.2417          | 0.8952                  | 0.8672               | 0.8810           | 128                  | 0.8453                 | 0.9053              | 0.8743          | 169                 | 0.84                | 0.7636           | 0.8000       | 110              | 0.6917                     | 0.7281                  | 0.7094              | 114                     | 0.7194                  | 0.6816               | 0.7              | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8901          | 0.8852       | 0.8877   | 183          | 0.7937                     | 0.7692                  | 0.7813              | 65                      | 0.8060            | 0.7967         | 0.8014     | 0.9721           |
| 0.0045        | 22.0  | 17446 | 0.2069          | 0.8626                  | 0.8828               | 0.8726           | 128                  | 0.8830                 | 0.8935              | 0.8882          | 169                 | 0.7679              | 0.7818           | 0.7748       | 110              | 0.6462                     | 0.7368                  | 0.6885              | 114                     | 0.7045                  | 0.6966               | 0.7006           | 267                  | 0.5                  | 1.0               | 0.6667        | 2                 | 0.8914          | 0.8525       | 0.8715   | 183          | 0.7361                     | 0.8154                  | 0.7737              | 65                      | 0.7847            | 0.8006         | 0.7926     | 0.9721           |
| 0.0044        | 23.0  | 18239 | 0.2675          | 0.8760                  | 0.8828               | 0.8794           | 128                  | 0.8721                 | 0.8876              | 0.8798          | 169                 | 0.8155              | 0.7636           | 0.7887       | 110              | 0.6864                     | 0.7105                  | 0.6983              | 114                     | 0.7588                  | 0.6479               | 0.6990           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8983          | 0.8689       | 0.8833   | 183          | 0.7714                     | 0.8308                  | 0.8                 | 65                      | 0.8168            | 0.7861         | 0.8012     | 0.9711           |
| 0.0037        | 24.0  | 19032 | 0.2294          | 0.9032                  | 0.875                | 0.8889           | 128                  | 0.8848                 | 0.8639              | 0.8743          | 169                 | 0.8283              | 0.7455           | 0.7847       | 110              | 0.7097                     | 0.7719                  | 0.7395              | 114                     | 0.6866                  | 0.6891               | 0.6879           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8950          | 0.8852       | 0.8901   | 183          | 0.7826                     | 0.8308                  | 0.8060              | 65                      | 0.8035            | 0.7996         | 0.8015     | 0.9733           |
| 0.0028        | 25.0  | 19825 | 0.2435          | 0.9310                  | 0.8438               | 0.8852           | 128                  | 0.8398                 | 0.8994              | 0.8686          | 169                 | 0.7870              | 0.7727           | 0.7798       | 110              | 0.5959                     | 0.7632                  | 0.6692              | 114                     | 0.6679                  | 0.6929               | 0.6801           | 267                  | 0.5                  | 1.0               | 0.6667        | 2                 | 0.8601          | 0.9071       | 0.8830   | 183          | 0.7179                     | 0.8615                  | 0.7832              | 65                      | 0.7625            | 0.8102         | 0.7856     | 0.9712           |
| 0.0031        | 26.0  | 20618 | 0.2441          | 0.9160                  | 0.8516               | 0.8826           | 128                  | 0.9036                 | 0.8876              | 0.8955          | 169                 | 0.8925              | 0.7545           | 0.8177       | 110              | 0.6667                     | 0.7368                  | 0.7                 | 114                     | 0.7323                  | 0.6966               | 0.7140           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8817          | 0.8962       | 0.8889   | 183          | 0.8909                     | 0.7538                  | 0.8167              | 65                      | 0.8262            | 0.7967         | 0.8112     | 0.9740           |
| 0.0022        | 27.0  | 21411 | 0.2598          | 0.9160                  | 0.8516               | 0.8826           | 128                  | 0.8728                 | 0.8935              | 0.8830          | 169                 | 0.8646              | 0.7545           | 0.8058       | 110              | 0.7025                     | 0.7456                  | 0.7234              | 114                     | 0.7660                  | 0.6742               | 0.7171           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8639          | 0.9016       | 0.8824   | 183          | 0.8833                     | 0.8154                  | 0.848               | 65                      | 0.8305            | 0.7977         | 0.8138     | 0.9742           |
| 0.0027        | 28.0  | 22204 | 0.2239          | 0.8898                  | 0.8828               | 0.8863           | 128                  | 0.8817                 | 0.8817              | 0.8817          | 169                 | 0.8333              | 0.7727           | 0.8019       | 110              | 0.672                      | 0.7368                  | 0.7029              | 114                     | 0.7216                  | 0.6891               | 0.7050           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8956          | 0.8907       | 0.8932   | 183          | 0.8462                     | 0.8462                  | 0.8462              | 65                      | 0.8130            | 0.8044         | 0.8087     | 0.9743           |
| 0.0028        | 29.0  | 22997 | 0.2268          | 0.8889                  | 0.875                | 0.8819           | 128                  | 0.8772                 | 0.8876              | 0.8824          | 169                 | 0.8119              | 0.7455           | 0.7773       | 110              | 0.6667                     | 0.7368                  | 0.7                 | 114                     | 0.7245                  | 0.7191               | 0.7218           | 267                  | 0.5                  | 1.0               | 0.6667        | 2                 | 0.8865          | 0.8962       | 0.8913   | 183          | 0.7761                     | 0.8                     | 0.7879              | 65                      | 0.8019            | 0.8073         | 0.8046     | 0.9742           |
| 0.0023        | 30.0  | 23790 | 0.2654          | 0.9113                  | 0.8828               | 0.8968           | 128                  | 0.8935                 | 0.8935              | 0.8935          | 169                 | 0.82                | 0.7455           | 0.7810       | 110              | 0.6444                     | 0.7632                  | 0.6988              | 114                     | 0.7570                  | 0.7116               | 0.7336           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8649          | 0.8743       | 0.8696   | 183          | 0.8305                     | 0.7538                  | 0.7903              | 65                      | 0.8137            | 0.8035         | 0.8085     | 0.9737           |
| 0.0018        | 31.0  | 24583 | 0.2678          | 0.9024                  | 0.8672               | 0.8845           | 128                  | 0.8824                 | 0.8876              | 0.8850          | 169                 | 0.8039              | 0.7455           | 0.7736       | 110              | 0.5503                     | 0.7193                  | 0.6236              | 114                     | 0.7015                  | 0.7041               | 0.7028           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8653          | 0.9126       | 0.8883   | 183          | 0.8793                     | 0.7846                  | 0.8293              | 65                      | 0.7822            | 0.8025         | 0.7922     | 0.9717           |
| 0.0018        | 32.0  | 25376 | 0.2460          | 0.9174                  | 0.8672               | 0.8916           | 128                  | 0.8988                 | 0.8935              | 0.8961          | 169                 | 0.8224              | 0.8              | 0.8111       | 110              | 0.6860                     | 0.7281                  | 0.7064              | 114                     | 0.7542                  | 0.6779               | 0.7140           | 267                  | 1.0                  | 0.5               | 0.6667        | 2                 | 0.8994          | 0.8798       | 0.8895   | 183          | 0.8448                     | 0.7538                  | 0.7967              | 65                      | 0.8291            | 0.7948         | 0.8116     | 0.9742           |
| 0.0015        | 33.0  | 26169 | 0.2474          | 0.9098                  | 0.8672               | 0.888            | 128                  | 0.8663                 | 0.8817              | 0.8739          | 169                 | 0.8131              | 0.7909           | 0.8018       | 110              | 0.7                        | 0.7368                  | 0.7179              | 114                     | 0.7214                  | 0.7079               | 0.7146           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8817          | 0.8962       | 0.8889   | 183          | 0.7937                     | 0.7692                  | 0.7813              | 65                      | 0.8085            | 0.8054         | 0.8069     | 0.9739           |
| 0.0006        | 34.0  | 26962 | 0.2690          | 0.9024                  | 0.8672               | 0.8845           | 128                  | 0.8844                 | 0.9053              | 0.8947          | 169                 | 0.8315              | 0.6727           | 0.7437       | 110              | 0.6667                     | 0.7368                  | 0.7                 | 114                     | 0.7391                  | 0.7004               | 0.7192           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8870          | 0.8579       | 0.8722   | 183          | 0.8889                     | 0.7385                  | 0.8067              | 65                      | 0.8185            | 0.7861         | 0.8020     | 0.9735           |
| 0.0038        | 35.0  | 27755 | 0.2565          | 0.912                   | 0.8906               | 0.9012           | 128                  | 0.8786                 | 0.8994              | 0.8889          | 169                 | 0.7757              | 0.7545           | 0.7650       | 110              | 0.6562                     | 0.7368                  | 0.6942              | 114                     | 0.6794                  | 0.7303               | 0.7040           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8962          | 0.8962       | 0.8962   | 183          | 0.8                        | 0.8                     | 0.8000              | 65                      | 0.7907            | 0.8150         | 0.8027     | 0.9730           |
| 0.0008        | 36.0  | 28548 | 0.2583          | 0.8943                  | 0.8594               | 0.8765           | 128                  | 0.8655                 | 0.8757              | 0.8706          | 169                 | 0.7607              | 0.8091           | 0.7841       | 110              | 0.6829                     | 0.7368                  | 0.7089              | 114                     | 0.7266                  | 0.7266               | 0.7266           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8889          | 0.9180       | 0.9032   | 183          | 0.8125                     | 0.8                     | 0.8062              | 65                      | 0.8021            | 0.8160         | 0.8090     | 0.9733           |
| 0.0008        | 37.0  | 29341 | 0.2733          | 0.8862                  | 0.8516               | 0.8685           | 128                  | 0.8663                 | 0.8817              | 0.8739          | 169                 | 0.7611              | 0.7818           | 0.7713       | 110              | 0.6324                     | 0.7544                  | 0.688               | 114                     | 0.7148                  | 0.7041               | 0.7094           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8830          | 0.9071       | 0.8949   | 183          | 0.8333                     | 0.7692                  | 0.8                 | 65                      | 0.7902            | 0.8054         | 0.7977     | 0.9729           |
| 0.0013        | 38.0  | 30134 | 0.2555          | 0.9322                  | 0.8594               | 0.8943           | 128                  | 0.8988                 | 0.8935              | 0.8961          | 169                 | 0.7395              | 0.8              | 0.7686       | 110              | 0.7395                     | 0.7719                  | 0.7554              | 114                     | 0.7308                  | 0.7116               | 0.7211           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8691          | 0.9071       | 0.8877   | 183          | 0.8197                     | 0.7692                  | 0.7937              | 65                      | 0.8133            | 0.8141         | 0.8137     | 0.9744           |
| 0.0003        | 39.0  | 30927 | 0.2683          | 0.9174                  | 0.8672               | 0.8916           | 128                  | 0.8882                 | 0.8935              | 0.8909          | 169                 | 0.8190              | 0.7818           | 0.8000       | 110              | 0.6718                     | 0.7719                  | 0.7184              | 114                     | 0.7154                  | 0.7154               | 0.7154           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.9022          | 0.9071       | 0.9046   | 183          | 0.8772                     | 0.7692                  | 0.8197              | 65                      | 0.8149            | 0.8141         | 0.8145     | 0.9744           |
| 0.0004        | 40.0  | 31720 | 0.2727          | 0.8889                  | 0.875                | 0.8819           | 128                  | 0.8817                 | 0.8817              | 0.8817          | 169                 | 0.8469              | 0.7545           | 0.7981       | 110              | 0.6822                     | 0.7719                  | 0.7243              | 114                     | 0.7041                  | 0.7041               | 0.7041           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8883          | 0.9126       | 0.9003   | 183          | 0.8793                     | 0.7846                  | 0.8293              | 65                      | 0.8100            | 0.8092         | 0.8096     | 0.9745           |
| 0.0005        | 41.0  | 32513 | 0.2607          | 0.9106                  | 0.875                | 0.8924           | 128                  | 0.8629                 | 0.8935              | 0.8779          | 169                 | 0.8737              | 0.7545           | 0.8098       | 110              | 0.6953                     | 0.7807                  | 0.7355              | 114                     | 0.7154                  | 0.6966               | 0.7059           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8743          | 0.9126       | 0.8930   | 183          | 0.8125                     | 0.8                     | 0.8062              | 65                      | 0.8104            | 0.8112         | 0.8108     | 0.9743           |
| 0.0007        | 42.0  | 33306 | 0.2628          | 0.9106                  | 0.875                | 0.8924           | 128                  | 0.8678                 | 0.8935              | 0.8805          | 169                 | 0.8119              | 0.7455           | 0.7773       | 110              | 0.6899                     | 0.7807                  | 0.7325              | 114                     | 0.6985                  | 0.7116               | 0.7050           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8730          | 0.9016       | 0.8871   | 183          | 0.8254                     | 0.8                     | 0.8125              | 65                      | 0.7998            | 0.8121         | 0.8059     | 0.9744           |
| 0.0004        | 43.0  | 34099 | 0.2784          | 0.9098                  | 0.8672               | 0.888            | 128                  | 0.8994                 | 0.8994              | 0.8994          | 169                 | 0.8542              | 0.7455           | 0.7961       | 110              | 0.696                      | 0.7632                  | 0.7280              | 114                     | 0.7127                  | 0.7154               | 0.7140           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8925          | 0.9071       | 0.8997   | 183          | 0.8281                     | 0.8154                  | 0.8217              | 65                      | 0.8170            | 0.8131         | 0.8151     | 0.9743           |
| 0.0004        | 44.0  | 34892 | 0.2771          | 0.9098                  | 0.8672               | 0.888            | 128                  | 0.8941                 | 0.8994              | 0.8968          | 169                 | 0.8586              | 0.7727           | 0.8134       | 110              | 0.7049                     | 0.7544                  | 0.7288              | 114                     | 0.7231                  | 0.7041               | 0.7135           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8919          | 0.9016       | 0.8967   | 183          | 0.8154                     | 0.8154                  | 0.8154              | 65                      | 0.8207            | 0.8112         | 0.8159     | 0.9745           |
| 0.0003        | 45.0  | 35685 | 0.2756          | 0.9180                  | 0.875                | 0.8960           | 128                  | 0.8941                 | 0.8994              | 0.8968          | 169                 | 0.8673              | 0.7727           | 0.8173       | 110              | 0.7097                     | 0.7719                  | 0.7395              | 114                     | 0.7159                  | 0.7079               | 0.7119           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8978          | 0.9126       | 0.9051   | 183          | 0.8644                     | 0.7846                  | 0.8226              | 65                      | 0.8246            | 0.8150         | 0.8198     | 0.9749           |
| 0.0005        | 46.0  | 36478 | 0.2739          | 0.9180                  | 0.875                | 0.8960           | 128                  | 0.8941                 | 0.8994              | 0.8968          | 169                 | 0.8333              | 0.7727           | 0.8019       | 110              | 0.6667                     | 0.7719                  | 0.7154              | 114                     | 0.7011                  | 0.7116               | 0.7063           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8698          | 0.9126       | 0.8907   | 183          | 0.8226                     | 0.7846                  | 0.8031              | 65                      | 0.8036            | 0.8160         | 0.8098     | 0.9747           |
| 0.0001        | 47.0  | 37271 | 0.2774          | 0.9180                  | 0.875                | 0.8960           | 128                  | 0.8941                 | 0.8994              | 0.8968          | 169                 | 0.85                | 0.7727           | 0.8095       | 110              | 0.6667                     | 0.7719                  | 0.7154              | 114                     | 0.7127                  | 0.7154               | 0.7140           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.9061          | 0.8962       | 0.9011   | 183          | 0.8226                     | 0.7846                  | 0.8031              | 65                      | 0.8141            | 0.8141         | 0.8141     | 0.9747           |
| 0.0002        | 48.0  | 38064 | 0.2768          | 0.9180                  | 0.875                | 0.8960           | 128                  | 0.8941                 | 0.8994              | 0.8968          | 169                 | 0.85                | 0.7727           | 0.8095       | 110              | 0.6718                     | 0.7719                  | 0.7184              | 114                     | 0.7159                  | 0.7266               | 0.7212           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8967          | 0.9016       | 0.8992   | 183          | 0.8254                     | 0.8                     | 0.8125              | 65                      | 0.8142            | 0.8189         | 0.8165     | 0.9754           |
| 0.0001        | 49.0  | 38857 | 0.2778          | 0.9180                  | 0.875                | 0.8960           | 128                  | 0.8941                 | 0.8994              | 0.8968          | 169                 | 0.8416              | 0.7727           | 0.8057       | 110              | 0.6718                     | 0.7719                  | 0.7184              | 114                     | 0.7159                  | 0.7266               | 0.7212           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8967          | 0.9016       | 0.8992   | 183          | 0.8254                     | 0.8                     | 0.8125              | 65                      | 0.8134            | 0.8189         | 0.8161     | 0.9753           |
| 0.0003        | 50.0  | 39650 | 0.2778          | 0.9180                  | 0.875                | 0.8960           | 128                  | 0.8941                 | 0.8994              | 0.8968          | 169                 | 0.8431              | 0.7818           | 0.8113       | 110              | 0.6718                     | 0.7719                  | 0.7184              | 114                     | 0.7159                  | 0.7266               | 0.7212           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.8967          | 0.9016       | 0.8992   | 183          | 0.8254                     | 0.8                     | 0.8125              | 65                      | 0.8136            | 0.8198         | 0.8167     | 0.9753           |


### Framework versions

- Transformers 4.25.0.dev0
- Pytorch 1.12.1+cu113
- Datasets 2.2.2
- Tokenizers 0.13.2