|
--- |
|
license: apache-2.0 |
|
base_model: bert-base-multilingual-cased |
|
tags: |
|
- generated_from_trainer |
|
model-index: |
|
- name: run_20240702210535 |
|
results: [] |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You |
|
should probably proofread and complete it, then remove this comment. --> |
|
|
|
# run_20240702210535 |
|
|
|
This model is a fine-tuned version of [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) on an unknown dataset. |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.3214 |
|
- Precision: 0.6028 |
|
- Recall: 0.6325 |
|
- F1: 0.6173 |
|
- Number: 237046 |
|
- Ageno Precision: 0.8230 |
|
- Ageno Recall: 0.8335 |
|
- Ageno F1: 0.8282 |
|
- Ageno Number: 8131 |
|
- Ank Account/bic Precision: 0.9559 |
|
- Ank Account/bic Recall: 0.9753 |
|
- Ank Account/bic F1: 0.9655 |
|
- Ank Account/bic Number: 50290 |
|
- Ank Account/iban Precision: 0.8894 |
|
- Ank Account/iban Recall: 0.9289 |
|
- Ank Account/iban F1: 0.9087 |
|
- Ank Account/iban Number: 84619 |
|
- Ank Account/bankinfo Precision: 0.7777 |
|
- Ank Account/bankinfo Recall: 0.8063 |
|
- Ank Account/bankinfo F1: 0.7917 |
|
- Ank Account/bankinfo Number: 36138 |
|
- Ank Account/currencycode Precision: 0.7507 |
|
- Ank Account/currencycode Recall: 0.3748 |
|
- Ank Account/currencycode F1: 0.5 |
|
- Ank Account/currencycode Number: 1374 |
|
- Ardnumber Precision: 0.3289 |
|
- Ardnumber Recall: 0.3175 |
|
- Ardnumber F1: 0.3231 |
|
- Ardnumber Number: 929 |
|
- Ardtype Precision: 0.5436 |
|
- Ardtype Recall: 0.5444 |
|
- Ardtype F1: 0.5440 |
|
- Ardtype Number: 3821 |
|
- Axamount Precision: 0.7977 |
|
- Axamount Recall: 0.7972 |
|
- Axamount F1: 0.7975 |
|
- Axamount Number: 5302 |
|
- Eservationnumber Precision: 0.4791 |
|
- Eservationnumber Recall: 0.5078 |
|
- Eservationnumber F1: 0.4930 |
|
- Eservationnumber Number: 2568 |
|
- Etamount Precision: 0.7795 |
|
- Etamount Recall: 0.7792 |
|
- Etamount F1: 0.7794 |
|
- Etamount Number: 6299 |
|
- Heckin Precision: 0.9099 |
|
- Heckin Recall: 0.9260 |
|
- Heckin F1: 0.9179 |
|
- Heckin Number: 17115 |
|
- Heckout Precision: 0.9203 |
|
- Heckout Recall: 0.9320 |
|
- Heckout F1: 0.9261 |
|
- Heckout Number: 17016 |
|
- Nvoicedate Precision: 0.9084 |
|
- Nvoicedate Recall: 0.9204 |
|
- Nvoicedate F1: 0.9144 |
|
- Nvoicedate Number: 14899 |
|
- Nvoicenumber Precision: 0.8595 |
|
- Nvoicenumber Recall: 0.8827 |
|
- Nvoicenumber F1: 0.8710 |
|
- Nvoicenumber Number: 14479 |
|
- Ocumenttype Precision: 0.7821 |
|
- Ocumenttype Recall: 0.8193 |
|
- Ocumenttype F1: 0.8003 |
|
- Ocumenttype Number: 13966 |
|
- Ompanyaddress Precision: 0.7657 |
|
- Ompanyaddress Recall: 0.7917 |
|
- Ompanyaddress F1: 0.7785 |
|
- Ompanyaddress Number: 15201 |
|
- Ompanycity Precision: 0.8504 |
|
- Ompanycity Recall: 0.8760 |
|
- Ompanycity F1: 0.8630 |
|
- Ompanycity Number: 14804 |
|
- Ompanycountry Precision: 0.8759 |
|
- Ompanycountry Recall: 0.8851 |
|
- Ompanycountry F1: 0.8805 |
|
- Ompanycountry Number: 9011 |
|
- Ompanyname Precision: 0.6986 |
|
- Ompanyname Recall: 0.7240 |
|
- Ompanyname F1: 0.7111 |
|
- Ompanyname Number: 15233 |
|
- Ompanyvatnumber Precision: 0.6079 |
|
- Ompanyvatnumber Recall: 0.6684 |
|
- Ompanyvatnumber F1: 0.6367 |
|
- Ompanyvatnumber Number: 3474 |
|
- Ompanyzipcode Precision: 0.9190 |
|
- Ompanyzipcode Recall: 0.9434 |
|
- Ompanyzipcode F1: 0.9310 |
|
- Ompanyzipcode Number: 14770 |
|
- Ookingnumber Precision: 0.4084 |
|
- Ookingnumber Recall: 0.3214 |
|
- Ookingnumber F1: 0.3597 |
|
- Ookingnumber Number: 2156 |
|
- Oomno Precision: 0.8351 |
|
- Oomno Recall: 0.8537 |
|
- Oomno F1: 0.8443 |
|
- Oomno Number: 17347 |
|
- Oteladdress Precision: 0.4710 |
|
- Oteladdress Recall: 0.5188 |
|
- Oteladdress F1: 0.4937 |
|
- Oteladdress Number: 14199 |
|
- Otelbankaccount Precision: 0.0 |
|
- Otelbankaccount Recall: 0.0 |
|
- Otelbankaccount F1: 0.0 |
|
- Otelbankaccount Number: 73 |
|
- Otelcity Precision: 0.6779 |
|
- Otelcity Recall: 0.7343 |
|
- Otelcity F1: 0.7050 |
|
- Otelcity Number: 13694 |
|
- Otelcountry Precision: 0.7598 |
|
- Otelcountry Recall: 0.7686 |
|
- Otelcountry F1: 0.7642 |
|
- Otelcountry Number: 3358 |
|
- Otelemail Precision: 0.8933 |
|
- Otelemail Recall: 0.9382 |
|
- Otelemail F1: 0.9152 |
|
- Otelemail Number: 10425 |
|
- Otelfaxnumber Precision: 0.8234 |
|
- Otelfaxnumber Recall: 0.8668 |
|
- Otelfaxnumber F1: 0.8446 |
|
- Otelfaxnumber Number: 7689 |
|
- Otelname Precision: 0.3599 |
|
- Otelname Recall: 0.3987 |
|
- Otelname F1: 0.3783 |
|
- Otelname Number: 14855 |
|
- Otelphonenumber Precision: 0.8023 |
|
- Otelphonenumber Recall: 0.8373 |
|
- Otelphonenumber F1: 0.8194 |
|
- Otelphonenumber Number: 11808 |
|
- Oteltaxcode Precision: 0.4169 |
|
- Oteltaxcode Recall: 0.4602 |
|
- Oteltaxcode F1: 0.4375 |
|
- Oteltaxcode Number: 2338 |
|
- Otelvatnumber Precision: 0.6870 |
|
- Otelvatnumber Recall: 0.7394 |
|
- Otelvatnumber F1: 0.7122 |
|
- Otelvatnumber Number: 9094 |
|
- Otelzipcode Precision: 0.7230 |
|
- Otelzipcode Recall: 0.7776 |
|
- Otelzipcode F1: 0.7493 |
|
- Otelzipcode Number: 13620 |
|
- Rafficdate Precision: 0.0 |
|
- Rafficdate Recall: 0.0 |
|
- Rafficdate F1: 0.0 |
|
- Rafficdate Number: 106 |
|
- Ravellername Precision: 0.5621 |
|
- Ravellername Recall: 0.5663 |
|
- Ravellername F1: 0.5642 |
|
- Ravellername Number: 17893 |
|
- Rewtype Precision: 0.0 |
|
- Rewtype Recall: 0.0 |
|
- Rewtype F1: 0.0 |
|
- Rewtype Number: 56 |
|
- Rossamount Precision: 0.7012 |
|
- Rossamount Recall: 0.7258 |
|
- Rossamount F1: 0.7133 |
|
- Rossamount Number: 12491 |
|
- Rrivaltrainno Precision: 0.1818 |
|
- Rrivaltrainno Recall: 0.0494 |
|
- Rrivaltrainno F1: 0.0777 |
|
- Rrivaltrainno Number: 81 |
|
- Urrencycode Precision: 0.5212 |
|
- Urrencycode Recall: 0.5927 |
|
- Urrencycode F1: 0.5547 |
|
- Urrencycode Number: 8510 |
|
- Xternalreservationnumber Precision: 0.3103 |
|
- Xternalreservationnumber Recall: 0.3205 |
|
- Xternalreservationnumber F1: 0.3153 |
|
- Xternalreservationnumber Number: 546 |
|
- Overall Precision: 0.7298 |
|
- Overall Recall: 0.7596 |
|
- Overall F1: 0.7444 |
|
- Overall Accuracy: 0.9298 |
|
|
|
## Model description |
|
|
|
More information needed |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- learning_rate: 2e-05 |
|
- train_batch_size: 8 |
|
- eval_batch_size: 8 |
|
- seed: 42 |
|
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
|
- lr_scheduler_type: linear |
|
- num_epochs: 8 |
|
|
|
### Training results |
|
|
|
| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Number | Ageno Precision | Ageno Recall | Ageno F1 | Ageno Number | Ank Account/bic Precision | Ank Account/bic Recall | Ank Account/bic F1 | Ank Account/bic Number | Ank Account/iban Precision | Ank Account/iban Recall | Ank Account/iban F1 | Ank Account/iban Number | Ank Account/bankinfo Precision | Ank Account/bankinfo Recall | Ank Account/bankinfo F1 | Ank Account/bankinfo Number | Ank Account/currencycode Precision | Ank Account/currencycode Recall | Ank Account/currencycode F1 | Ank Account/currencycode Number | Ardnumber Precision | Ardnumber Recall | Ardnumber F1 | Ardnumber Number | Ardtype Precision | Ardtype Recall | Ardtype F1 | Ardtype Number | Axamount Precision | Axamount Recall | Axamount F1 | Axamount Number | Eservationnumber Precision | Eservationnumber Recall | Eservationnumber F1 | Eservationnumber Number | Etamount Precision | Etamount Recall | Etamount F1 | Etamount Number | Heckin Precision | Heckin Recall | Heckin F1 | Heckin Number | Heckout Precision | Heckout Recall | Heckout F1 | Heckout Number | Nvoicedate Precision | Nvoicedate Recall | Nvoicedate F1 | Nvoicedate Number | Nvoicenumber Precision | Nvoicenumber Recall | Nvoicenumber F1 | Nvoicenumber Number | Ocumenttype Precision | Ocumenttype Recall | Ocumenttype F1 | Ocumenttype Number | Ompanyaddress Precision | Ompanyaddress Recall | Ompanyaddress F1 | Ompanyaddress Number | Ompanycity Precision | Ompanycity Recall | Ompanycity F1 | Ompanycity Number | Ompanycountry Precision | Ompanycountry Recall | Ompanycountry F1 | Ompanycountry Number | Ompanyname Precision | Ompanyname Recall | Ompanyname F1 | Ompanyname Number | Ompanyvatnumber Precision | Ompanyvatnumber Recall | Ompanyvatnumber F1 | Ompanyvatnumber Number | Ompanyzipcode Precision | Ompanyzipcode Recall | Ompanyzipcode F1 | Ompanyzipcode Number | Ookingnumber Precision | Ookingnumber Recall | Ookingnumber F1 | Ookingnumber Number | Oomno Precision | Oomno Recall | Oomno F1 | Oomno Number | Oteladdress Precision | Oteladdress Recall | Oteladdress F1 | Oteladdress Number | Otelbankaccount Precision | Otelbankaccount Recall | Otelbankaccount F1 | Otelbankaccount Number | Otelcity Precision | Otelcity Recall | Otelcity F1 | Otelcity Number | Otelcountry Precision | Otelcountry Recall | Otelcountry F1 | Otelcountry Number | Otelemail Precision | Otelemail Recall | Otelemail F1 | Otelemail Number | Otelfaxnumber Precision | Otelfaxnumber Recall | Otelfaxnumber F1 | Otelfaxnumber Number | Otelname Precision | Otelname Recall | Otelname F1 | Otelname Number | Otelphonenumber Precision | Otelphonenumber Recall | Otelphonenumber F1 | Otelphonenumber Number | Oteltaxcode Precision | Oteltaxcode Recall | Oteltaxcode F1 | Oteltaxcode Number | Otelvatnumber Precision | Otelvatnumber Recall | Otelvatnumber F1 | Otelvatnumber Number | Otelzipcode Precision | Otelzipcode Recall | Otelzipcode F1 | Otelzipcode Number | Rafficdate Precision | Rafficdate Recall | Rafficdate F1 | Rafficdate Number | Ravellername Precision | Ravellername Recall | Ravellername F1 | Ravellername Number | Rewtype Precision | Rewtype Recall | Rewtype F1 | Rewtype Number | Rossamount Precision | Rossamount Recall | Rossamount F1 | Rossamount Number | Rrivaltrainno Precision | Rrivaltrainno Recall | Rrivaltrainno F1 | Rrivaltrainno Number | Urrencycode Precision | Urrencycode Recall | Urrencycode F1 | Urrencycode Number | Xternalreservationnumber Precision | Xternalreservationnumber Recall | Xternalreservationnumber F1 | Xternalreservationnumber Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy | |
|
|:-------------:|:-----:|:-----:|:---------------:|:-----------:|:--------:|:------:|:--------:|:---------------:|:------------:|:--------:|:------------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------:|:------------------------------:|:---------------------------:|:-----------------------:|:---------------------------:|:----------------------------------:|:-------------------------------:|:---------------------------:|:-------------------------------:|:-------------------:|:----------------:|:------------:|:----------------:|:-----------------:|:--------------:|:----------:|:--------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------:|:-------------:|:---------:|:-------------:|:-----------------:|:--------------:|:----------:|:--------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:---------------:|:------------:|:--------:|:------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:------------------:|:---------------:|:-----------:|:---------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-------------------:|:----------------:|:------------:|:----------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:------------------:|:---------------:|:-----------:|:---------------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:-----------------:|:--------------:|:----------:|:--------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:----------------------------------:|:-------------------------------:|:---------------------------:|:-------------------------------:|:-----------------:|:--------------:|:----------:|:----------------:| |
|
| 0.1284 | 1.0 | 9028 | 0.2249 | 0.6051 | 0.6381 | 0.6212 | 237046 | 0.8298 | 0.8486 | 0.8391 | 8131 | 0.9500 | 0.9829 | 0.9661 | 50290 | 0.8675 | 0.9672 | 0.9147 | 84619 | 0.7426 | 0.8671 | 0.8000 | 36138 | 0.7634 | 0.2278 | 0.3509 | 1374 | 0.4002 | 0.4273 | 0.4133 | 929 | 0.4746 | 0.6053 | 0.5320 | 3821 | 0.7542 | 0.7993 | 0.7761 | 5302 | 0.5823 | 0.5234 | 0.5513 | 2568 | 0.7222 | 0.7484 | 0.7351 | 6299 | 0.8997 | 0.9417 | 0.9202 | 17115 | 0.8939 | 0.9516 | 0.9219 | 17016 | 0.9084 | 0.9411 | 0.9245 | 14899 | 0.8265 | 0.9056 | 0.8643 | 14479 | 0.7735 | 0.8466 | 0.8084 | 13966 | 0.7846 | 0.8053 | 0.7949 | 15201 | 0.8367 | 0.8781 | 0.8569 | 14804 | 0.8513 | 0.8905 | 0.8704 | 9011 | 0.7246 | 0.7488 | 0.7365 | 15233 | 0.5700 | 0.7029 | 0.6295 | 3474 | 0.9078 | 0.9416 | 0.9244 | 14770 | 0.4890 | 0.2880 | 0.3625 | 2156 | 0.8005 | 0.8676 | 0.8327 | 17347 | 0.5074 | 0.5322 | 0.5195 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6766 | 0.7324 | 0.7034 | 13694 | 0.7753 | 0.7335 | 0.7538 | 3358 | 0.8659 | 0.9431 | 0.9028 | 10425 | 0.8095 | 0.8758 | 0.8413 | 7689 | 0.3709 | 0.3988 | 0.3843 | 14855 | 0.8148 | 0.8661 | 0.8397 | 11808 | 0.4123 | 0.4808 | 0.4439 | 2338 | 0.6639 | 0.7497 | 0.7042 | 9094 | 0.7285 | 0.7670 | 0.7473 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5650 | 0.5714 | 0.5682 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.6678 | 0.7477 | 0.7055 | 12491 | 0.0 | 0.0 | 0.0 | 81 | 0.5382 | 0.5533 | 0.5457 | 8510 | 0.2434 | 0.3370 | 0.2826 | 546 | 0.7255 | 0.7735 | 0.7487 | 0.9302 | |
|
| 0.0949 | 2.0 | 18056 | 0.2538 | 0.6162 | 0.6452 | 0.6303 | 237046 | 0.8405 | 0.8458 | 0.8431 | 8131 | 0.9490 | 0.9812 | 0.9649 | 50290 | 0.8735 | 0.9649 | 0.9170 | 84619 | 0.7396 | 0.8769 | 0.8024 | 36138 | 0.6905 | 0.3719 | 0.4834 | 1374 | 0.4151 | 0.3897 | 0.4020 | 929 | 0.5313 | 0.5258 | 0.5285 | 3821 | 0.8081 | 0.7988 | 0.8034 | 5302 | 0.5410 | 0.5191 | 0.5298 | 2568 | 0.7758 | 0.7496 | 0.7625 | 6299 | 0.8919 | 0.9457 | 0.9180 | 17115 | 0.9044 | 0.9463 | 0.9249 | 17016 | 0.9129 | 0.9350 | 0.9238 | 14899 | 0.8430 | 0.8905 | 0.8661 | 14479 | 0.7821 | 0.8443 | 0.8120 | 13966 | 0.7772 | 0.8112 | 0.7938 | 15201 | 0.8387 | 0.8730 | 0.8555 | 14804 | 0.8723 | 0.8940 | 0.8830 | 9011 | 0.7337 | 0.7492 | 0.7414 | 15233 | 0.5927 | 0.7637 | 0.6674 | 3474 | 0.9079 | 0.9436 | 0.9254 | 14770 | 0.4455 | 0.3827 | 0.4117 | 2156 | 0.8238 | 0.8998 | 0.8601 | 17347 | 0.5073 | 0.5811 | 0.5417 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6748 | 0.7625 | 0.7159 | 13694 | 0.7798 | 0.7719 | 0.7758 | 3358 | 0.8900 | 0.9372 | 0.9130 | 10425 | 0.8245 | 0.8796 | 0.8511 | 7689 | 0.3752 | 0.4187 | 0.3958 | 14855 | 0.8101 | 0.8608 | 0.8347 | 11808 | 0.3970 | 0.3867 | 0.3918 | 2338 | 0.6857 | 0.7671 | 0.7241 | 9094 | 0.7172 | 0.8081 | 0.7600 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5803 | 0.6002 | 0.5901 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.6878 | 0.7319 | 0.7091 | 12491 | 0.0 | 0.0 | 0.0 | 81 | 0.5058 | 0.6246 | 0.5589 | 8510 | 0.2834 | 0.2601 | 0.2713 | 546 | 0.7320 | 0.7803 | 0.7554 | 0.9309 | |
|
| 0.0782 | 3.0 | 27084 | 0.2606 | 0.6117 | 0.6390 | 0.6250 | 237046 | 0.8184 | 0.8262 | 0.8223 | 8131 | 0.9502 | 0.9816 | 0.9657 | 50290 | 0.8877 | 0.9201 | 0.9036 | 84619 | 0.7477 | 0.8500 | 0.7955 | 36138 | 0.5903 | 0.3282 | 0.4219 | 1374 | 0.3621 | 0.4241 | 0.3907 | 929 | 0.5362 | 0.5972 | 0.5651 | 3821 | 0.8191 | 0.8059 | 0.8124 | 5302 | 0.4764 | 0.5350 | 0.5040 | 2568 | 0.7917 | 0.7520 | 0.7714 | 6299 | 0.9026 | 0.9322 | 0.9172 | 17115 | 0.9173 | 0.9306 | 0.9239 | 17016 | 0.9072 | 0.9280 | 0.9175 | 14899 | 0.8581 | 0.8802 | 0.8690 | 14479 | 0.7958 | 0.8043 | 0.8000 | 13966 | 0.7862 | 0.8067 | 0.7963 | 15201 | 0.8454 | 0.8715 | 0.8583 | 14804 | 0.8700 | 0.8935 | 0.8816 | 9011 | 0.7315 | 0.7457 | 0.7385 | 15233 | 0.6142 | 0.7260 | 0.6654 | 3474 | 0.9243 | 0.9458 | 0.9349 | 14770 | 0.4591 | 0.3200 | 0.3772 | 2156 | 0.8301 | 0.8991 | 0.8632 | 17347 | 0.5019 | 0.5571 | 0.5281 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6794 | 0.7505 | 0.7132 | 13694 | 0.7549 | 0.7731 | 0.7639 | 3358 | 0.8898 | 0.9406 | 0.9145 | 10425 | 0.8262 | 0.8744 | 0.8496 | 7689 | 0.3755 | 0.4342 | 0.4027 | 14855 | 0.8130 | 0.8565 | 0.8342 | 11808 | 0.4039 | 0.4880 | 0.4420 | 2338 | 0.6806 | 0.7690 | 0.7221 | 9094 | 0.7218 | 0.7937 | 0.7560 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5664 | 0.5833 | 0.5747 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.7069 | 0.7203 | 0.7135 | 12491 | 0.0 | 0.0 | 0.0 | 81 | 0.5185 | 0.6040 | 0.5580 | 8510 | 0.2916 | 0.2985 | 0.2950 | 546 | 0.7324 | 0.7688 | 0.7501 | 0.9298 | |
|
| 0.0694 | 4.0 | 36112 | 0.2742 | 0.6140 | 0.6404 | 0.6269 | 237046 | 0.8279 | 0.8427 | 0.8353 | 8131 | 0.9584 | 0.9779 | 0.9681 | 50290 | 0.8788 | 0.9550 | 0.9153 | 84619 | 0.7570 | 0.8489 | 0.8003 | 36138 | 0.6154 | 0.3726 | 0.4642 | 1374 | 0.3753 | 0.3079 | 0.3383 | 929 | 0.5500 | 0.5472 | 0.5486 | 3821 | 0.8143 | 0.8046 | 0.8094 | 5302 | 0.4958 | 0.5502 | 0.5216 | 2568 | 0.7635 | 0.7820 | 0.7726 | 6299 | 0.8950 | 0.9375 | 0.9158 | 17115 | 0.9195 | 0.9421 | 0.9307 | 17016 | 0.9184 | 0.9130 | 0.9157 | 14899 | 0.8473 | 0.8920 | 0.8691 | 14479 | 0.7910 | 0.8237 | 0.8070 | 13966 | 0.7911 | 0.8068 | 0.7989 | 15201 | 0.8482 | 0.8748 | 0.8613 | 14804 | 0.8821 | 0.8880 | 0.8850 | 9011 | 0.7338 | 0.7524 | 0.7430 | 15233 | 0.6135 | 0.7268 | 0.6653 | 3474 | 0.9229 | 0.9471 | 0.9348 | 14770 | 0.4395 | 0.3353 | 0.3804 | 2156 | 0.8377 | 0.8575 | 0.8475 | 17347 | 0.5023 | 0.5608 | 0.5299 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6818 | 0.7411 | 0.7102 | 13694 | 0.7758 | 0.7624 | 0.7690 | 3358 | 0.8859 | 0.9463 | 0.9151 | 10425 | 0.8254 | 0.8763 | 0.8501 | 7689 | 0.3629 | 0.4012 | 0.3811 | 14855 | 0.8099 | 0.8589 | 0.8337 | 11808 | 0.4079 | 0.4179 | 0.4128 | 2338 | 0.6814 | 0.7562 | 0.7168 | 9094 | 0.7155 | 0.7878 | 0.7499 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5795 | 0.5858 | 0.5826 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.7074 | 0.7414 | 0.7240 | 12491 | 0.1667 | 0.0123 | 0.0230 | 81 | 0.5150 | 0.6221 | 0.5635 | 8510 | 0.3077 | 0.1832 | 0.2296 | 546 | 0.7348 | 0.7723 | 0.7531 | 0.9304 | |
|
| 0.0611 | 5.0 | 45140 | 0.2882 | 0.6023 | 0.6380 | 0.6197 | 237046 | 0.8333 | 0.8466 | 0.8399 | 8131 | 0.9550 | 0.9796 | 0.9671 | 50290 | 0.8793 | 0.9514 | 0.9139 | 84619 | 0.7702 | 0.8053 | 0.7873 | 36138 | 0.6968 | 0.3362 | 0.4536 | 1374 | 0.3502 | 0.3423 | 0.3462 | 929 | 0.5616 | 0.5357 | 0.5484 | 3821 | 0.7968 | 0.8084 | 0.8025 | 5302 | 0.4867 | 0.5257 | 0.5054 | 2568 | 0.7753 | 0.7809 | 0.7781 | 6299 | 0.8936 | 0.9431 | 0.9177 | 17115 | 0.9145 | 0.9476 | 0.9307 | 17016 | 0.9093 | 0.9276 | 0.9184 | 14899 | 0.8563 | 0.8794 | 0.8677 | 14479 | 0.7865 | 0.8224 | 0.8041 | 13966 | 0.7796 | 0.8055 | 0.7924 | 15201 | 0.8437 | 0.8769 | 0.8600 | 14804 | 0.8774 | 0.8936 | 0.8854 | 9011 | 0.7129 | 0.7315 | 0.7221 | 15233 | 0.6146 | 0.6894 | 0.6498 | 3474 | 0.9177 | 0.9469 | 0.9320 | 14770 | 0.4048 | 0.3905 | 0.3975 | 2156 | 0.8147 | 0.8874 | 0.8495 | 17347 | 0.4697 | 0.5330 | 0.4993 | 14199 | 0.0167 | 0.0137 | 0.0150 | 73 | 0.6612 | 0.7259 | 0.6921 | 13694 | 0.7438 | 0.7832 | 0.7630 | 3358 | 0.8861 | 0.9432 | 0.9138 | 10425 | 0.8241 | 0.8813 | 0.8517 | 7689 | 0.3579 | 0.3929 | 0.3746 | 14855 | 0.8134 | 0.8595 | 0.8358 | 11808 | 0.4019 | 0.3888 | 0.3952 | 2338 | 0.6700 | 0.7726 | 0.7176 | 9094 | 0.7078 | 0.7703 | 0.7377 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5627 | 0.5884 | 0.5752 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.6969 | 0.7388 | 0.7172 | 12491 | 0.0833 | 0.0123 | 0.0215 | 81 | 0.5232 | 0.5875 | 0.5535 | 8510 | 0.3384 | 0.2033 | 0.2540 | 546 | 0.7275 | 0.7683 | 0.7473 | 0.9289 | |
|
| 0.0553 | 6.0 | 54168 | 0.3093 | 0.6089 | 0.6331 | 0.6207 | 237046 | 0.8358 | 0.8460 | 0.8409 | 8131 | 0.9535 | 0.9790 | 0.9660 | 50290 | 0.8810 | 0.9473 | 0.9130 | 84619 | 0.7619 | 0.8295 | 0.7942 | 36138 | 0.7952 | 0.3588 | 0.4945 | 1374 | 0.3539 | 0.3574 | 0.3557 | 929 | 0.5173 | 0.5708 | 0.5427 | 3821 | 0.7957 | 0.8005 | 0.7980 | 5302 | 0.4793 | 0.5549 | 0.5143 | 2568 | 0.7789 | 0.7742 | 0.7766 | 6299 | 0.9099 | 0.9173 | 0.9136 | 17115 | 0.9204 | 0.9266 | 0.9235 | 17016 | 0.9095 | 0.9170 | 0.9132 | 14899 | 0.8601 | 0.8832 | 0.8715 | 14479 | 0.7790 | 0.8266 | 0.8021 | 13966 | 0.7831 | 0.8054 | 0.7941 | 15201 | 0.8500 | 0.8801 | 0.8648 | 14804 | 0.8702 | 0.8956 | 0.8827 | 9011 | 0.7089 | 0.7308 | 0.7197 | 15233 | 0.6191 | 0.6635 | 0.6405 | 3474 | 0.9154 | 0.9443 | 0.9296 | 14770 | 0.3951 | 0.3660 | 0.3800 | 2156 | 0.8354 | 0.8543 | 0.8447 | 17347 | 0.4847 | 0.5319 | 0.5072 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6816 | 0.7360 | 0.7078 | 13694 | 0.7452 | 0.7707 | 0.7577 | 3358 | 0.8872 | 0.9373 | 0.9116 | 10425 | 0.8264 | 0.8736 | 0.8493 | 7689 | 0.3592 | 0.3978 | 0.3775 | 14855 | 0.8103 | 0.8536 | 0.8314 | 11808 | 0.4039 | 0.4196 | 0.4116 | 2338 | 0.6838 | 0.7559 | 0.7181 | 9094 | 0.7153 | 0.7747 | 0.7438 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5742 | 0.5826 | 0.5784 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.7049 | 0.7295 | 0.7170 | 12491 | 0.125 | 0.0247 | 0.0412 | 81 | 0.5273 | 0.5794 | 0.5522 | 8510 | 0.3026 | 0.3187 | 0.3104 | 546 | 0.7317 | 0.7651 | 0.7480 | 0.9291 | |
|
| 0.0479 | 7.0 | 63196 | 0.3174 | 0.6063 | 0.6329 | 0.6193 | 237046 | 0.8272 | 0.8409 | 0.8340 | 8131 | 0.9548 | 0.9760 | 0.9652 | 50290 | 0.8877 | 0.9305 | 0.9086 | 84619 | 0.7774 | 0.8091 | 0.7929 | 36138 | 0.7544 | 0.3755 | 0.5015 | 1374 | 0.3398 | 0.3402 | 0.3400 | 929 | 0.5445 | 0.5391 | 0.5418 | 3821 | 0.7955 | 0.7954 | 0.7954 | 5302 | 0.4725 | 0.5315 | 0.5003 | 2568 | 0.7750 | 0.7741 | 0.7745 | 6299 | 0.9077 | 0.9259 | 0.9167 | 17115 | 0.9165 | 0.9339 | 0.9252 | 17016 | 0.9098 | 0.9213 | 0.9155 | 14899 | 0.8606 | 0.8861 | 0.8732 | 14479 | 0.7805 | 0.8167 | 0.7982 | 13966 | 0.7704 | 0.7950 | 0.7825 | 15201 | 0.8509 | 0.8750 | 0.8628 | 14804 | 0.8754 | 0.8853 | 0.8803 | 9011 | 0.7043 | 0.7325 | 0.7181 | 15233 | 0.6016 | 0.6364 | 0.6185 | 3474 | 0.9171 | 0.9425 | 0.9296 | 14770 | 0.4277 | 0.2964 | 0.3501 | 2156 | 0.8348 | 0.8539 | 0.8442 | 17347 | 0.4832 | 0.5269 | 0.5041 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6770 | 0.7370 | 0.7057 | 13694 | 0.7586 | 0.7647 | 0.7617 | 3358 | 0.8926 | 0.9375 | 0.9145 | 10425 | 0.8242 | 0.8684 | 0.8457 | 7689 | 0.3697 | 0.3917 | 0.3803 | 14855 | 0.8084 | 0.8468 | 0.8271 | 11808 | 0.4032 | 0.4927 | 0.4435 | 2338 | 0.6847 | 0.7479 | 0.7149 | 9094 | 0.7230 | 0.7801 | 0.7505 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5682 | 0.5708 | 0.5695 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.6910 | 0.7284 | 0.7092 | 12491 | 0.1667 | 0.0370 | 0.0606 | 81 | 0.5161 | 0.5920 | 0.5514 | 8510 | 0.2874 | 0.2747 | 0.2809 | 546 | 0.7316 | 0.7609 | 0.7460 | 0.9297 | |
|
| 0.0436 | 8.0 | 72224 | 0.3214 | 0.6028 | 0.6325 | 0.6173 | 237046 | 0.8230 | 0.8335 | 0.8282 | 8131 | 0.9559 | 0.9753 | 0.9655 | 50290 | 0.8894 | 0.9289 | 0.9087 | 84619 | 0.7777 | 0.8063 | 0.7917 | 36138 | 0.7507 | 0.3748 | 0.5 | 1374 | 0.3289 | 0.3175 | 0.3231 | 929 | 0.5436 | 0.5444 | 0.5440 | 3821 | 0.7977 | 0.7972 | 0.7975 | 5302 | 0.4791 | 0.5078 | 0.4930 | 2568 | 0.7795 | 0.7792 | 0.7794 | 6299 | 0.9099 | 0.9260 | 0.9179 | 17115 | 0.9203 | 0.9320 | 0.9261 | 17016 | 0.9084 | 0.9204 | 0.9144 | 14899 | 0.8595 | 0.8827 | 0.8710 | 14479 | 0.7821 | 0.8193 | 0.8003 | 13966 | 0.7657 | 0.7917 | 0.7785 | 15201 | 0.8504 | 0.8760 | 0.8630 | 14804 | 0.8759 | 0.8851 | 0.8805 | 9011 | 0.6986 | 0.7240 | 0.7111 | 15233 | 0.6079 | 0.6684 | 0.6367 | 3474 | 0.9190 | 0.9434 | 0.9310 | 14770 | 0.4084 | 0.3214 | 0.3597 | 2156 | 0.8351 | 0.8537 | 0.8443 | 17347 | 0.4710 | 0.5188 | 0.4937 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6779 | 0.7343 | 0.7050 | 13694 | 0.7598 | 0.7686 | 0.7642 | 3358 | 0.8933 | 0.9382 | 0.9152 | 10425 | 0.8234 | 0.8668 | 0.8446 | 7689 | 0.3599 | 0.3987 | 0.3783 | 14855 | 0.8023 | 0.8373 | 0.8194 | 11808 | 0.4169 | 0.4602 | 0.4375 | 2338 | 0.6870 | 0.7394 | 0.7122 | 9094 | 0.7230 | 0.7776 | 0.7493 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5621 | 0.5663 | 0.5642 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.7012 | 0.7258 | 0.7133 | 12491 | 0.1818 | 0.0494 | 0.0777 | 81 | 0.5212 | 0.5927 | 0.5547 | 8510 | 0.3103 | 0.3205 | 0.3153 | 546 | 0.7298 | 0.7596 | 0.7444 | 0.9298 | |
|
|
|
|
|
### Framework versions |
|
|
|
- Transformers 4.40.2 |
|
- Pytorch 2.3.1+cu121 |
|
- Datasets 2.20.0 |
|
- Tokenizers 0.19.1 |
|
|
