--- language: - id license: mit base_model: indolem/indobert-base-uncased tags: - generated_from_trainer model-index: - name: nerugm-pt-pl10-1 results: [] --- # nerugm-pt-pl10-1 This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co/indolem/indobert-base-uncased) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 0.1712 - Location Precision: 0.7595 - Location Recall: 0.8696 - Location F1: 0.8108 - Location Number: 69 - Organization Precision: 0.6712 - Organization Recall: 0.8033 - Organization F1: 0.7313 - Organization Number: 61 - Person Precision: 0.9136 - Person Recall: 0.9673 - Person F1: 0.9397 - Person Number: 153 - Quantity Precision: 0.6842 - Quantity Recall: 0.8125 - Quantity F1: 0.7429 - Quantity Number: 32 - Time Precision: 0.75 - Time Recall: 0.8710 - Time F1: 0.8060 - Time Number: 31 - Overall Precision: 0.7990 - Overall Recall: 0.8960 - Overall F1: 0.8447 - Overall Accuracy: 0.9648 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 5e-05 - train_batch_size: 16 - eval_batch_size: 64 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 100.0 ### Training results | Training Loss | Epoch | Step | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy | |:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:| | 0.9752 | 1.0 | 106 | 0.5789 | 0.0 | 0.0 | 0.0 | 69 | 0.0 | 0.0 | 0.0 | 61 | 0.2667 | 0.0523 | 0.0874 | 153 | 0.0 | 0.0 | 0.0 | 32 | 0.0 | 0.0 | 0.0 | 31 | 0.1905 | 0.0231 | 0.0412 | 0.8397 | | 0.4971 | 2.0 | 212 | 0.3459 | 0.6 | 0.2609 | 0.3636 | 69 | 0.0769 | 0.0328 | 0.0460 | 61 | 0.4962 | 0.8497 | 0.6265 | 153 | 0.0588 | 0.0312 | 0.0408 | 32 | 0.4222 | 0.6129 | 0.5 | 31 | 0.4474 | 0.4913 | 0.4683 | 0.8982 | | 0.3054 | 3.0 | 318 | 0.2187 | 0.4732 | 0.7681 | 0.5856 | 69 | 0.4267 | 0.5246 | 0.4706 | 61 | 0.7556 | 0.8889 | 0.8168 | 153 | 0.5 | 0.6875 | 0.5789 | 32 | 0.7778 | 0.9032 | 0.8358 | 31 | 0.6063 | 0.7832 | 0.6835 | 0.9326 | | 0.2131 | 4.0 | 424 | 0.1845 | 0.6 | 0.8261 | 0.6951 | 69 | 0.5062 | 0.6721 | 0.5775 | 61 | 0.8161 | 0.9281 | 0.8685 | 153 | 0.48 | 0.75 | 0.5854 | 32 | 0.5652 | 0.8387 | 0.6753 | 31 | 0.6502 | 0.8382 | 0.7323 | 0.9393 | | 0.1765 | 5.0 | 530 | 0.1477 | 0.6707 | 0.7971 | 0.7285 | 69 | 0.5714 | 0.7869 | 0.6621 | 61 | 0.8363 | 0.9346 | 0.8827 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.875 | 0.9032 | 0.8889 | 31 | 0.7371 | 0.8671 | 0.7968 | 0.9544 | | 0.1544 | 6.0 | 636 | 0.1522 | 0.6044 | 0.7971 | 0.6875 | 69 | 0.5506 | 0.8033 | 0.6533 | 61 | 0.8462 | 0.9346 | 0.8882 | 153 | 0.5682 | 0.7812 | 0.6579 | 32 | 0.6585 | 0.8710 | 0.75 | 31 | 0.6889 | 0.8642 | 0.7667 | 0.9477 | | 0.1461 | 7.0 | 742 | 0.1431 | 0.6977 | 0.8696 | 0.7742 | 69 | 0.5761 | 0.8689 | 0.6928 | 61 | 0.8462 | 0.9346 | 0.8882 | 153 | 0.6429 | 0.8438 | 0.7297 | 32 | 0.8 | 0.9032 | 0.8485 | 31 | 0.7335 | 0.8988 | 0.8078 | 0.9554 | | 0.1374 | 8.0 | 848 | 0.1363 | 0.7037 | 0.8261 | 0.76 | 69 | 0.6118 | 0.8525 | 0.7123 | 61 | 0.8353 | 0.9281 | 0.8793 | 153 | 0.6667 | 0.8125 | 0.7324 | 32 | 0.6429 | 0.8710 | 0.7397 | 31 | 0.7290 | 0.8786 | 0.7969 | 0.9549 | | 0.1256 | 9.0 | 954 | 0.1395 | 0.6344 | 0.8551 | 0.7284 | 69 | 0.6176 | 0.6885 | 0.6512 | 61 | 0.8452 | 0.9281 | 0.8847 | 153 | 0.7105 | 0.8438 | 0.7714 | 32 | 0.6667 | 0.9032 | 0.7671 | 31 | 0.7286 | 0.8613 | 0.7894 | 0.9537 | | 0.1227 | 10.0 | 1060 | 0.1241 | 0.7317 | 0.8696 | 0.7947 | 69 | 0.6351 | 0.7705 | 0.6963 | 61 | 0.8614 | 0.9346 | 0.8966 | 153 | 0.6667 | 0.8125 | 0.7324 | 32 | 0.7105 | 0.8710 | 0.7826 | 31 | 0.7594 | 0.8757 | 0.8134 | 0.9584 | | 0.1154 | 11.0 | 1166 | 0.1285 | 0.6744 | 0.8406 | 0.7484 | 69 | 0.6377 | 0.7213 | 0.6769 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.5870 | 0.8438 | 0.6923 | 32 | 0.7297 | 0.8710 | 0.7941 | 31 | 0.7438 | 0.8642 | 0.7995 | 0.9547 | | 0.1102 | 12.0 | 1272 | 0.1242 | 0.7692 | 0.8696 | 0.8163 | 69 | 0.6111 | 0.7213 | 0.6617 | 61 | 0.8841 | 0.9477 | 0.9148 | 153 | 0.6 | 0.8438 | 0.7013 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7710 | 0.8757 | 0.8200 | 0.9581 | | 0.1045 | 13.0 | 1378 | 0.1287 | 0.6951 | 0.8261 | 0.7550 | 69 | 0.6163 | 0.8689 | 0.7211 | 61 | 0.8675 | 0.9412 | 0.9028 | 153 | 0.65 | 0.8125 | 0.7222 | 32 | 0.7568 | 0.9032 | 0.8235 | 31 | 0.7494 | 0.8902 | 0.8137 | 0.9611 | | 0.103 | 14.0 | 1484 | 0.1301 | 0.7625 | 0.8841 | 0.8188 | 69 | 0.6049 | 0.8033 | 0.6901 | 61 | 0.8623 | 0.9412 | 0.9 | 153 | 0.6136 | 0.8438 | 0.7105 | 32 | 0.7297 | 0.8710 | 0.7941 | 31 | 0.7531 | 0.8902 | 0.8159 | 0.9584 | | 0.1017 | 15.0 | 1590 | 0.1236 | 0.7632 | 0.8406 | 0.8 | 69 | 0.6143 | 0.7049 | 0.6565 | 61 | 0.8896 | 0.9477 | 0.9177 | 153 | 0.6429 | 0.8438 | 0.7297 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7772 | 0.8671 | 0.8197 | 0.9599 | | 0.0944 | 16.0 | 1696 | 0.1293 | 0.7468 | 0.8551 | 0.7973 | 69 | 0.6118 | 0.8525 | 0.7123 | 61 | 0.8690 | 0.9542 | 0.9097 | 153 | 0.7297 | 0.8438 | 0.7826 | 32 | 0.8235 | 0.9032 | 0.8615 | 31 | 0.7742 | 0.9017 | 0.8331 | 0.9619 | | 0.0911 | 17.0 | 1802 | 0.1347 | 0.6629 | 0.8551 | 0.7468 | 69 | 0.6098 | 0.8197 | 0.6993 | 61 | 0.8743 | 0.9542 | 0.9125 | 153 | 0.675 | 0.8438 | 0.75 | 32 | 0.8 | 0.9032 | 0.8485 | 31 | 0.7506 | 0.8960 | 0.8169 | 0.9599 | | 0.0862 | 18.0 | 1908 | 0.1252 | 0.7436 | 0.8406 | 0.7891 | 69 | 0.6761 | 0.7869 | 0.7273 | 61 | 0.8848 | 0.9542 | 0.9182 | 153 | 0.6585 | 0.8438 | 0.7397 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7866 | 0.8844 | 0.8327 | 0.9611 | | 0.0861 | 19.0 | 2014 | 0.1229 | 0.7467 | 0.8116 | 0.7778 | 69 | 0.6338 | 0.7377 | 0.6818 | 61 | 0.8780 | 0.9412 | 0.9085 | 153 | 0.6923 | 0.8438 | 0.7606 | 32 | 0.8235 | 0.9032 | 0.8615 | 31 | 0.7833 | 0.8671 | 0.8230 | 0.9623 | | 0.0834 | 20.0 | 2120 | 0.1377 | 0.7125 | 0.8261 | 0.7651 | 69 | 0.6118 | 0.8525 | 0.7123 | 61 | 0.8855 | 0.9608 | 0.9216 | 153 | 0.6279 | 0.8438 | 0.72 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7579 | 0.8960 | 0.8212 | 0.9567 | | 0.0812 | 21.0 | 2226 | 0.1547 | 0.7375 | 0.8551 | 0.7919 | 69 | 0.5889 | 0.8689 | 0.7020 | 61 | 0.8698 | 0.9608 | 0.9130 | 153 | 0.6047 | 0.8125 | 0.6933 | 32 | 0.7297 | 0.8710 | 0.7941 | 31 | 0.7446 | 0.9017 | 0.8157 | 0.9529 | | 0.0775 | 22.0 | 2332 | 0.1344 | 0.7024 | 0.8551 | 0.7712 | 69 | 0.6265 | 0.8525 | 0.7222 | 61 | 0.875 | 0.9608 | 0.9159 | 153 | 0.6585 | 0.8438 | 0.7397 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7591 | 0.9017 | 0.8243 | 0.9606 | | 0.0749 | 23.0 | 2438 | 0.1243 | 0.7808 | 0.8261 | 0.8028 | 69 | 0.6420 | 0.8525 | 0.7324 | 61 | 0.8976 | 0.9739 | 0.9342 | 153 | 0.6923 | 0.8438 | 0.7606 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7939 | 0.9017 | 0.8444 | 0.9646 | | 0.0741 | 24.0 | 2544 | 0.1392 | 0.7059 | 0.8696 | 0.7792 | 69 | 0.6125 | 0.8033 | 0.6950 | 61 | 0.8795 | 0.9542 | 0.9154 | 153 | 0.7941 | 0.8438 | 0.8182 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7725 | 0.8931 | 0.8284 | 0.9596 | | 0.0723 | 25.0 | 2650 | 0.1403 | 0.725 | 0.8406 | 0.7785 | 69 | 0.6625 | 0.8689 | 0.7518 | 61 | 0.875 | 0.9608 | 0.9159 | 153 | 0.6923 | 0.8438 | 0.7606 | 32 | 0.8 | 0.9032 | 0.8485 | 31 | 0.7786 | 0.9046 | 0.8369 | 0.9619 | | 0.0711 | 26.0 | 2756 | 0.1464 | 0.75 | 0.8261 | 0.7862 | 69 | 0.6310 | 0.8689 | 0.7310 | 61 | 0.8970 | 0.9673 | 0.9308 | 153 | 0.6667 | 0.8125 | 0.7324 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7775 | 0.8988 | 0.8338 | 0.9614 | | 0.0675 | 27.0 | 2862 | 0.1326 | 0.7407 | 0.8696 | 0.8000 | 69 | 0.6386 | 0.8689 | 0.7361 | 61 | 0.8795 | 0.9542 | 0.9154 | 153 | 0.7297 | 0.8438 | 0.7826 | 32 | 0.7429 | 0.8387 | 0.7879 | 31 | 0.7761 | 0.9017 | 0.8342 | 0.9633 | | 0.0656 | 28.0 | 2968 | 0.1390 | 0.7468 | 0.8551 | 0.7973 | 69 | 0.6712 | 0.8033 | 0.7313 | 61 | 0.9080 | 0.9673 | 0.9367 | 153 | 0.7297 | 0.8438 | 0.7826 | 32 | 0.7105 | 0.8710 | 0.7826 | 31 | 0.7949 | 0.8960 | 0.8424 | 0.9631 | | 0.0666 | 29.0 | 3074 | 0.1383 | 0.7317 | 0.8696 | 0.7947 | 69 | 0.6341 | 0.8525 | 0.7273 | 61 | 0.8855 | 0.9608 | 0.9216 | 153 | 0.6923 | 0.8438 | 0.7606 | 32 | 0.7297 | 0.8710 | 0.7941 | 31 | 0.7709 | 0.9046 | 0.8324 | 0.9621 | | 0.065 | 30.0 | 3180 | 0.1360 | 0.7284 | 0.8551 | 0.7867 | 69 | 0.6235 | 0.8689 | 0.7260 | 61 | 0.9074 | 0.9608 | 0.9333 | 153 | 0.75 | 0.8438 | 0.7941 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7825 | 0.9046 | 0.8391 | 0.9616 | | 0.0641 | 31.0 | 3286 | 0.1314 | 0.7317 | 0.8696 | 0.7947 | 69 | 0.64 | 0.7869 | 0.7059 | 61 | 0.9024 | 0.9673 | 0.9338 | 153 | 0.7714 | 0.8438 | 0.8060 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7908 | 0.8960 | 0.8401 | 0.9626 | | 0.0625 | 32.0 | 3392 | 0.1342 | 0.7108 | 0.8551 | 0.7763 | 69 | 0.6447 | 0.8033 | 0.7153 | 61 | 0.8976 | 0.9739 | 0.9342 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7809 | 0.8960 | 0.8345 | 0.9626 | | 0.0619 | 33.0 | 3498 | 0.1411 | 0.7407 | 0.8696 | 0.8000 | 69 | 0.6154 | 0.7869 | 0.6906 | 61 | 0.8909 | 0.9608 | 0.9245 | 153 | 0.6585 | 0.8438 | 0.7397 | 32 | 0.6842 | 0.8387 | 0.7536 | 31 | 0.7643 | 0.8902 | 0.8224 | 0.9604 | | 0.0602 | 34.0 | 3604 | 0.1591 | 0.7262 | 0.8841 | 0.7974 | 69 | 0.5952 | 0.8197 | 0.6897 | 61 | 0.8976 | 0.9739 | 0.9342 | 153 | 0.6341 | 0.8125 | 0.7123 | 32 | 0.6842 | 0.8387 | 0.7536 | 31 | 0.7554 | 0.9017 | 0.8221 | 0.9557 | | 0.0582 | 35.0 | 3710 | 0.1414 | 0.7349 | 0.8841 | 0.8026 | 69 | 0.6203 | 0.8033 | 0.7 | 61 | 0.8862 | 0.9673 | 0.9250 | 153 | 0.7105 | 0.8438 | 0.7714 | 32 | 0.7222 | 0.8387 | 0.7761 | 31 | 0.7717 | 0.8988 | 0.8304 | 0.9621 | | 0.0574 | 36.0 | 3816 | 0.1452 | 0.6747 | 0.8116 | 0.7368 | 69 | 0.6622 | 0.8033 | 0.7259 | 61 | 0.9030 | 0.9739 | 0.9371 | 153 | 0.7714 | 0.8438 | 0.8060 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7857 | 0.8902 | 0.8347 | 0.9626 | | 0.0551 | 37.0 | 3922 | 0.1465 | 0.6951 | 0.8261 | 0.7550 | 69 | 0.64 | 0.7869 | 0.7059 | 61 | 0.8976 | 0.9739 | 0.9342 | 153 | 0.675 | 0.8438 | 0.75 | 32 | 0.7647 | 0.8387 | 0.8000 | 31 | 0.7733 | 0.8873 | 0.8264 | 0.9609 | | 0.056 | 38.0 | 4028 | 0.1346 | 0.75 | 0.8696 | 0.8054 | 69 | 0.6316 | 0.7869 | 0.7007 | 61 | 0.9018 | 0.9608 | 0.9304 | 153 | 0.7297 | 0.8438 | 0.7826 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7903 | 0.8931 | 0.8385 | 0.9643 | | 0.0571 | 39.0 | 4134 | 0.1376 | 0.7073 | 0.8406 | 0.7682 | 69 | 0.6538 | 0.8361 | 0.7338 | 61 | 0.9024 | 0.9673 | 0.9338 | 153 | 0.6923 | 0.8438 | 0.7606 | 32 | 0.7879 | 0.8387 | 0.8125 | 31 | 0.7828 | 0.8960 | 0.8356 | 0.9628 | | 0.0509 | 40.0 | 4240 | 0.1388 | 0.7125 | 0.8261 | 0.7651 | 69 | 0.6216 | 0.7541 | 0.6815 | 61 | 0.9024 | 0.9673 | 0.9338 | 153 | 0.7105 | 0.8438 | 0.7714 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7821 | 0.8815 | 0.8288 | 0.9623 | | 0.052 | 41.0 | 4346 | 0.1472 | 0.7595 | 0.8696 | 0.8108 | 69 | 0.5862 | 0.8361 | 0.6892 | 61 | 0.8909 | 0.9608 | 0.9245 | 153 | 0.7297 | 0.8438 | 0.7826 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7781 | 0.9017 | 0.8353 | 0.9616 | | 0.0526 | 42.0 | 4452 | 0.1473 | 0.7229 | 0.8696 | 0.7895 | 69 | 0.6364 | 0.8033 | 0.7101 | 61 | 0.9024 | 0.9673 | 0.9338 | 153 | 0.7297 | 0.8438 | 0.7826 | 32 | 0.7647 | 0.8387 | 0.8000 | 31 | 0.7848 | 0.8960 | 0.8367 | 0.9619 | | 0.0503 | 43.0 | 4558 | 0.1404 | 0.7375 | 0.8551 | 0.7919 | 69 | 0.6111 | 0.7213 | 0.6617 | 61 | 0.925 | 0.9673 | 0.9457 | 153 | 0.7297 | 0.8438 | 0.7826 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7963 | 0.8815 | 0.8368 | 0.9628 | | 0.05 | 44.0 | 4664 | 0.1413 | 0.7195 | 0.8551 | 0.7815 | 69 | 0.64 | 0.7869 | 0.7059 | 61 | 0.9024 | 0.9673 | 0.9338 | 153 | 0.7297 | 0.8438 | 0.7826 | 32 | 0.7429 | 0.8387 | 0.7879 | 31 | 0.7837 | 0.8902 | 0.8336 | 0.9628 | | 0.0488 | 45.0 | 4770 | 0.1384 | 0.7625 | 0.8841 | 0.8188 | 69 | 0.6133 | 0.7541 | 0.6765 | 61 | 0.9136 | 0.9673 | 0.9397 | 153 | 0.7105 | 0.8438 | 0.7714 | 32 | 0.8438 | 0.8710 | 0.8571 | 31 | 0.7984 | 0.8931 | 0.8431 | 0.9646 | | 0.0471 | 46.0 | 4876 | 0.1398 | 0.7439 | 0.8841 | 0.8079 | 69 | 0.6234 | 0.7869 | 0.6957 | 61 | 0.8902 | 0.9542 | 0.9211 | 153 | 0.7297 | 0.8438 | 0.7826 | 32 | 0.7879 | 0.8387 | 0.8125 | 31 | 0.7837 | 0.8902 | 0.8336 | 0.9646 | | 0.0483 | 47.0 | 4982 | 0.1436 | 0.7436 | 0.8406 | 0.7891 | 69 | 0.6447 | 0.8033 | 0.7153 | 61 | 0.8855 | 0.9608 | 0.9216 | 153 | 0.6923 | 0.8438 | 0.7606 | 32 | 0.7647 | 0.8387 | 0.8000 | 31 | 0.7812 | 0.8873 | 0.8309 | 0.9628 | | 0.0451 | 48.0 | 5088 | 0.1516 | 0.7262 | 0.8841 | 0.7974 | 69 | 0.6364 | 0.8033 | 0.7101 | 61 | 0.8976 | 0.9739 | 0.9342 | 153 | 0.7297 | 0.8438 | 0.7826 | 32 | 0.7222 | 0.8387 | 0.7761 | 31 | 0.78 | 0.9017 | 0.8365 | 0.9621 | | 0.0471 | 49.0 | 5194 | 0.1461 | 0.75 | 0.8696 | 0.8054 | 69 | 0.6667 | 0.8197 | 0.7353 | 61 | 0.9193 | 0.9673 | 0.9427 | 153 | 0.6923 | 0.8438 | 0.7606 | 32 | 0.7429 | 0.8387 | 0.7879 | 31 | 0.7974 | 0.8988 | 0.8451 | 0.9643 | | 0.0419 | 50.0 | 5300 | 0.1431 | 0.7564 | 0.8551 | 0.8027 | 69 | 0.6575 | 0.7869 | 0.7164 | 61 | 0.9198 | 0.9739 | 0.9460 | 153 | 0.7105 | 0.8438 | 0.7714 | 32 | 0.8125 | 0.8387 | 0.8254 | 31 | 0.8068 | 0.8931 | 0.8477 | 0.9651 | | 0.0406 | 51.0 | 5406 | 0.1600 | 0.7317 | 0.8696 | 0.7947 | 69 | 0.6145 | 0.8361 | 0.7083 | 61 | 0.9085 | 0.9739 | 0.9401 | 153 | 0.65 | 0.8125 | 0.7222 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7748 | 0.9046 | 0.8347 | 0.9604 | | 0.0427 | 52.0 | 5512 | 0.1549 | 0.7564 | 0.8551 | 0.8027 | 69 | 0.6375 | 0.8361 | 0.7234 | 61 | 0.9080 | 0.9673 | 0.9367 | 153 | 0.6667 | 0.8125 | 0.7324 | 32 | 0.7647 | 0.8387 | 0.8000 | 31 | 0.7868 | 0.8960 | 0.8378 | 0.9623 | | 0.0426 | 53.0 | 5618 | 0.1516 | 0.7692 | 0.8696 | 0.8163 | 69 | 0.64 | 0.7869 | 0.7059 | 61 | 0.9024 | 0.9673 | 0.9338 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7943 | 0.8931 | 0.8408 | 0.9633 | | 0.0401 | 54.0 | 5724 | 0.1552 | 0.7532 | 0.8406 | 0.7945 | 69 | 0.6310 | 0.8689 | 0.7310 | 61 | 0.8922 | 0.9739 | 0.9313 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7647 | 0.8387 | 0.8000 | 31 | 0.78 | 0.9017 | 0.8365 | 0.9631 | | 0.0399 | 55.0 | 5830 | 0.1487 | 0.7108 | 0.8551 | 0.7763 | 69 | 0.6351 | 0.7705 | 0.6963 | 61 | 0.9024 | 0.9673 | 0.9338 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7647 | 0.8387 | 0.8000 | 31 | 0.7786 | 0.8844 | 0.8281 | 0.9633 | | 0.0402 | 56.0 | 5936 | 0.1583 | 0.7468 | 0.8551 | 0.7973 | 69 | 0.6234 | 0.7869 | 0.6957 | 61 | 0.9030 | 0.9739 | 0.9371 | 153 | 0.65 | 0.8125 | 0.7222 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7803 | 0.8931 | 0.8329 | 0.9619 | | 0.0406 | 57.0 | 6042 | 0.1540 | 0.7692 | 0.8696 | 0.8163 | 69 | 0.6575 | 0.7869 | 0.7164 | 61 | 0.9085 | 0.9739 | 0.9401 | 153 | 0.7027 | 0.8125 | 0.7536 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.8031 | 0.8960 | 0.8470 | 0.9653 | | 0.0402 | 58.0 | 6148 | 0.1636 | 0.75 | 0.8696 | 0.8054 | 69 | 0.6329 | 0.8197 | 0.7143 | 61 | 0.8976 | 0.9739 | 0.9342 | 153 | 0.6667 | 0.8125 | 0.7324 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.78 | 0.9017 | 0.8365 | 0.9614 | | 0.0387 | 59.0 | 6254 | 0.1612 | 0.7195 | 0.8551 | 0.7815 | 69 | 0.65 | 0.8525 | 0.7376 | 61 | 0.9141 | 0.9739 | 0.9430 | 153 | 0.65 | 0.8125 | 0.7222 | 32 | 0.7429 | 0.8387 | 0.7879 | 31 | 0.78 | 0.9017 | 0.8365 | 0.9628 | | 0.0402 | 60.0 | 6360 | 0.1626 | 0.725 | 0.8406 | 0.7785 | 69 | 0.6 | 0.7869 | 0.6809 | 61 | 0.9024 | 0.9673 | 0.9338 | 153 | 0.6667 | 0.8125 | 0.7324 | 32 | 0.7179 | 0.9032 | 0.8 | 31 | 0.7662 | 0.8902 | 0.8235 | 0.9601 | | 0.0382 | 61.0 | 6466 | 0.1521 | 0.7564 | 0.8551 | 0.8027 | 69 | 0.6282 | 0.8033 | 0.7050 | 61 | 0.9024 | 0.9673 | 0.9338 | 153 | 0.7568 | 0.875 | 0.8116 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7954 | 0.8988 | 0.8440 | 0.9646 | | 0.038 | 62.0 | 6572 | 0.1556 | 0.75 | 0.8696 | 0.8054 | 69 | 0.6494 | 0.8197 | 0.7246 | 61 | 0.9085 | 0.9739 | 0.9401 | 153 | 0.7368 | 0.875 | 0.8000 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7990 | 0.9075 | 0.8498 | 0.9653 | | 0.0391 | 63.0 | 6678 | 0.1530 | 0.7375 | 0.8551 | 0.7919 | 69 | 0.6579 | 0.8197 | 0.7299 | 61 | 0.9085 | 0.9739 | 0.9401 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.7879 | 0.8387 | 0.8125 | 31 | 0.7969 | 0.8960 | 0.8435 | 0.9651 | | 0.0377 | 64.0 | 6784 | 0.1537 | 0.7375 | 0.8551 | 0.7919 | 69 | 0.6533 | 0.8033 | 0.7206 | 61 | 0.9085 | 0.9739 | 0.9401 | 153 | 0.7105 | 0.8438 | 0.7714 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7974 | 0.8988 | 0.8451 | 0.9653 | | 0.0345 | 65.0 | 6890 | 0.1581 | 0.7468 | 0.8551 | 0.7973 | 69 | 0.6375 | 0.8361 | 0.7234 | 61 | 0.9141 | 0.9739 | 0.9430 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7919 | 0.9017 | 0.8432 | 0.9636 | | 0.0367 | 66.0 | 6996 | 0.1538 | 0.7342 | 0.8406 | 0.7838 | 69 | 0.6410 | 0.8197 | 0.7194 | 61 | 0.9146 | 0.9804 | 0.9464 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7893 | 0.8988 | 0.8405 | 0.9648 | | 0.0338 | 67.0 | 7102 | 0.1590 | 0.7317 | 0.8696 | 0.7947 | 69 | 0.6538 | 0.8361 | 0.7338 | 61 | 0.9141 | 0.9739 | 0.9430 | 153 | 0.7027 | 0.8125 | 0.7536 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7964 | 0.9046 | 0.8471 | 0.9661 | | 0.0346 | 68.0 | 7208 | 0.1562 | 0.7792 | 0.8696 | 0.8219 | 69 | 0.6447 | 0.8033 | 0.7153 | 61 | 0.9198 | 0.9739 | 0.9460 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.8015 | 0.8988 | 0.8474 | 0.9651 | | 0.0333 | 69.0 | 7314 | 0.1533 | 0.7692 | 0.8696 | 0.8163 | 69 | 0.6486 | 0.7869 | 0.7111 | 61 | 0.9141 | 0.9739 | 0.9430 | 153 | 0.7027 | 0.8125 | 0.7536 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.8010 | 0.8960 | 0.8458 | 0.9651 | | 0.0339 | 70.0 | 7420 | 0.1583 | 0.7564 | 0.8551 | 0.8027 | 69 | 0.6410 | 0.8197 | 0.7194 | 61 | 0.9255 | 0.9739 | 0.9490 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7974 | 0.8988 | 0.8451 | 0.9643 | | 0.0336 | 71.0 | 7526 | 0.1618 | 0.7439 | 0.8841 | 0.8079 | 69 | 0.6538 | 0.8361 | 0.7338 | 61 | 0.9198 | 0.9739 | 0.9460 | 153 | 0.6667 | 0.8125 | 0.7324 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7929 | 0.9075 | 0.8464 | 0.9646 | | 0.0321 | 72.0 | 7632 | 0.1712 | 0.7108 | 0.8551 | 0.7763 | 69 | 0.6098 | 0.8197 | 0.6993 | 61 | 0.9130 | 0.9608 | 0.9363 | 153 | 0.65 | 0.8125 | 0.7222 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7687 | 0.8931 | 0.8262 | 0.9609 | | 0.033 | 73.0 | 7738 | 0.1599 | 0.7407 | 0.8696 | 0.8000 | 69 | 0.64 | 0.7869 | 0.7059 | 61 | 0.9198 | 0.9739 | 0.9460 | 153 | 0.7297 | 0.8438 | 0.7826 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7995 | 0.8988 | 0.8463 | 0.9646 | | 0.032 | 74.0 | 7844 | 0.1675 | 0.7284 | 0.8551 | 0.7867 | 69 | 0.6267 | 0.7705 | 0.6912 | 61 | 0.9136 | 0.9673 | 0.9397 | 153 | 0.6667 | 0.8125 | 0.7324 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7832 | 0.8873 | 0.8320 | 0.9626 | | 0.0327 | 75.0 | 7950 | 0.1649 | 0.7595 | 0.8696 | 0.8108 | 69 | 0.64 | 0.7869 | 0.7059 | 61 | 0.9080 | 0.9673 | 0.9367 | 153 | 0.7105 | 0.8438 | 0.7714 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7949 | 0.8960 | 0.8424 | 0.9631 | | 0.0316 | 76.0 | 8056 | 0.1638 | 0.7407 | 0.8696 | 0.8000 | 69 | 0.6267 | 0.7705 | 0.6912 | 61 | 0.9136 | 0.9673 | 0.9397 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.8438 | 0.8710 | 0.8571 | 31 | 0.7938 | 0.8902 | 0.8392 | 0.9633 | | 0.0311 | 77.0 | 8162 | 0.1677 | 0.7317 | 0.8696 | 0.7947 | 69 | 0.5974 | 0.7541 | 0.6667 | 61 | 0.9193 | 0.9673 | 0.9427 | 153 | 0.6667 | 0.8125 | 0.7324 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7792 | 0.8873 | 0.8297 | 0.9619 | | 0.0313 | 78.0 | 8268 | 0.1649 | 0.75 | 0.8696 | 0.8054 | 69 | 0.6 | 0.7869 | 0.6809 | 61 | 0.9130 | 0.9608 | 0.9363 | 153 | 0.7027 | 0.8125 | 0.7536 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7857 | 0.8902 | 0.8347 | 0.9636 | | 0.0297 | 79.0 | 8374 | 0.1650 | 0.7407 | 0.8696 | 0.8000 | 69 | 0.6479 | 0.7541 | 0.6970 | 61 | 0.9018 | 0.9608 | 0.9304 | 153 | 0.7027 | 0.8125 | 0.7536 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7907 | 0.8844 | 0.8349 | 0.9646 | | 0.0299 | 80.0 | 8480 | 0.1658 | 0.75 | 0.8696 | 0.8054 | 69 | 0.6351 | 0.7705 | 0.6963 | 61 | 0.9130 | 0.9608 | 0.9363 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.7297 | 0.8710 | 0.7941 | 31 | 0.7912 | 0.8873 | 0.8365 | 0.9641 | | 0.029 | 81.0 | 8586 | 0.1720 | 0.7317 | 0.8696 | 0.7947 | 69 | 0.5974 | 0.7541 | 0.6667 | 61 | 0.9130 | 0.9608 | 0.9363 | 153 | 0.65 | 0.8125 | 0.7222 | 32 | 0.7027 | 0.8387 | 0.7647 | 31 | 0.7683 | 0.8815 | 0.8210 | 0.9614 | | 0.0309 | 82.0 | 8692 | 0.1623 | 0.7595 | 0.8696 | 0.8108 | 69 | 0.6714 | 0.7705 | 0.7176 | 61 | 0.9136 | 0.9673 | 0.9397 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.8042 | 0.8902 | 0.8450 | 0.9658 | | 0.0286 | 83.0 | 8798 | 0.1611 | 0.7407 | 0.8696 | 0.8000 | 69 | 0.6282 | 0.8033 | 0.7050 | 61 | 0.9136 | 0.9673 | 0.9397 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.7297 | 0.8710 | 0.7941 | 31 | 0.7888 | 0.8960 | 0.8390 | 0.9641 | | 0.0286 | 84.0 | 8904 | 0.1694 | 0.75 | 0.8696 | 0.8054 | 69 | 0.6494 | 0.8197 | 0.7246 | 61 | 0.9136 | 0.9673 | 0.9397 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7297 | 0.8710 | 0.7941 | 31 | 0.7893 | 0.8988 | 0.8405 | 0.9631 | | 0.0298 | 85.0 | 9010 | 0.1691 | 0.7407 | 0.8696 | 0.8000 | 69 | 0.6438 | 0.7705 | 0.7015 | 61 | 0.9130 | 0.9608 | 0.9363 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.6842 | 0.8387 | 0.7536 | 31 | 0.7826 | 0.8844 | 0.8304 | 0.9633 | | 0.0293 | 86.0 | 9116 | 0.1705 | 0.7468 | 0.8551 | 0.7973 | 69 | 0.6486 | 0.7869 | 0.7111 | 61 | 0.9130 | 0.9608 | 0.9363 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7912 | 0.8873 | 0.8365 | 0.9638 | | 0.0281 | 87.0 | 9222 | 0.1694 | 0.7564 | 0.8551 | 0.8027 | 69 | 0.64 | 0.7869 | 0.7059 | 61 | 0.9136 | 0.9673 | 0.9397 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7105 | 0.8710 | 0.7826 | 31 | 0.7877 | 0.8902 | 0.8358 | 0.9623 | | 0.0294 | 88.0 | 9328 | 0.1707 | 0.7595 | 0.8696 | 0.8108 | 69 | 0.6494 | 0.8197 | 0.7246 | 61 | 0.9193 | 0.9673 | 0.9427 | 153 | 0.65 | 0.8125 | 0.7222 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7913 | 0.8988 | 0.8417 | 0.9636 | | 0.0279 | 89.0 | 9434 | 0.1687 | 0.7468 | 0.8551 | 0.7973 | 69 | 0.6364 | 0.8033 | 0.7101 | 61 | 0.9080 | 0.9673 | 0.9367 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7903 | 0.8931 | 0.8385 | 0.9633 | | 0.0263 | 90.0 | 9540 | 0.1704 | 0.7692 | 0.8696 | 0.8163 | 69 | 0.6622 | 0.8033 | 0.7259 | 61 | 0.9136 | 0.9673 | 0.9397 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7990 | 0.8960 | 0.8447 | 0.9646 | | 0.0263 | 91.0 | 9646 | 0.1667 | 0.7468 | 0.8551 | 0.7973 | 69 | 0.6533 | 0.8033 | 0.7206 | 61 | 0.9193 | 0.9673 | 0.9427 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7943 | 0.8931 | 0.8408 | 0.9646 | | 0.0253 | 92.0 | 9752 | 0.1699 | 0.75 | 0.8696 | 0.8054 | 69 | 0.6528 | 0.7705 | 0.7068 | 61 | 0.9136 | 0.9673 | 0.9397 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7297 | 0.8710 | 0.7941 | 31 | 0.7918 | 0.8902 | 0.8381 | 0.9641 | | 0.0268 | 93.0 | 9858 | 0.1739 | 0.75 | 0.8696 | 0.8054 | 69 | 0.6438 | 0.7705 | 0.7015 | 61 | 0.9136 | 0.9673 | 0.9397 | 153 | 0.6667 | 0.8125 | 0.7324 | 32 | 0.7105 | 0.8710 | 0.7826 | 31 | 0.7857 | 0.8902 | 0.8347 | 0.9633 | | 0.0258 | 94.0 | 9964 | 0.1727 | 0.7407 | 0.8696 | 0.8000 | 69 | 0.6351 | 0.7705 | 0.6963 | 61 | 0.9141 | 0.9739 | 0.9430 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7883 | 0.8931 | 0.8374 | 0.9638 | | 0.0266 | 95.0 | 10070 | 0.1756 | 0.7317 | 0.8696 | 0.7947 | 69 | 0.6351 | 0.7705 | 0.6963 | 61 | 0.9136 | 0.9673 | 0.9397 | 153 | 0.6667 | 0.8125 | 0.7324 | 32 | 0.7222 | 0.8387 | 0.7761 | 31 | 0.7812 | 0.8873 | 0.8309 | 0.9623 | | 0.0269 | 96.0 | 10176 | 0.1720 | 0.7595 | 0.8696 | 0.8108 | 69 | 0.6579 | 0.8197 | 0.7299 | 61 | 0.9130 | 0.9608 | 0.9363 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7297 | 0.8710 | 0.7941 | 31 | 0.7928 | 0.8960 | 0.8412 | 0.9638 | | 0.0254 | 97.0 | 10282 | 0.1707 | 0.75 | 0.8696 | 0.8054 | 69 | 0.6667 | 0.7869 | 0.7218 | 61 | 0.9130 | 0.9608 | 0.9363 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7297 | 0.8710 | 0.7941 | 31 | 0.7938 | 0.8902 | 0.8392 | 0.9638 | | 0.0259 | 98.0 | 10388 | 0.1709 | 0.7595 | 0.8696 | 0.8108 | 69 | 0.6712 | 0.8033 | 0.7313 | 61 | 0.9130 | 0.9608 | 0.9363 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7984 | 0.8931 | 0.8431 | 0.9643 | | 0.0263 | 99.0 | 10494 | 0.1712 | 0.7595 | 0.8696 | 0.8108 | 69 | 0.6712 | 0.8033 | 0.7313 | 61 | 0.9136 | 0.9673 | 0.9397 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7990 | 0.8960 | 0.8447 | 0.9648 | | 0.0259 | 100.0 | 10600 | 0.1712 | 0.7595 | 0.8696 | 0.8108 | 69 | 0.6712 | 0.8033 | 0.7313 | 61 | 0.9136 | 0.9673 | 0.9397 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7990 | 0.8960 | 0.8447 | 0.9648 | ### Framework versions - Transformers 4.39.3 - Pytorch 2.3.0+cu121 - Datasets 2.19.1 - Tokenizers 0.15.2