Edit model card

output_LiLT_test_01

This model is a fine-tuned version of nielsr/lilt-xlm-roberta-base on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.3152
  • Precision: 0.8023
  • Recall: 0.8270
  • F1: 0.8145
  • Accuracy: 0.9639

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 32
  • eval_batch_size: 32
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 30

Training results

Training Loss Epoch Step Validation Loss Precision Recall F1 Accuracy
No log 0.08 100 0.5536 0.0255 0.0020 0.0037 0.8730
No log 0.16 200 0.3587 0.2042 0.0957 0.1303 0.8865
No log 0.24 300 0.2894 0.4203 0.5526 0.4775 0.9087
No log 0.32 400 0.2185 0.6486 0.6567 0.6526 0.9390
0.3252 0.4 500 0.1703 0.6833 0.6959 0.6895 0.9473
0.3252 0.49 600 0.1698 0.6855 0.7334 0.7086 0.9482
0.3252 0.57 700 0.1748 0.6449 0.7999 0.7141 0.9447
0.3252 0.65 800 0.1693 0.7038 0.7870 0.7431 0.9522
0.3252 0.73 900 0.1639 0.7002 0.7916 0.7431 0.9532
0.0997 0.81 1000 0.1474 0.7408 0.7521 0.7464 0.9573
0.0997 0.89 1100 0.1518 0.7588 0.7489 0.7538 0.9549
0.0997 0.97 1200 0.1459 0.7313 0.7847 0.7571 0.9587
0.0997 1.05 1300 0.1561 0.7347 0.7544 0.7444 0.9552
0.0997 1.13 1400 0.1583 0.7685 0.7875 0.7779 0.9586
0.0805 1.21 1500 0.1658 0.6876 0.7835 0.7324 0.9487
0.0805 1.29 1600 0.1548 0.7470 0.7550 0.7510 0.9556
0.0805 1.37 1700 0.1416 0.7753 0.7976 0.7863 0.9604
0.0805 1.46 1800 0.1802 0.8107 0.7319 0.7693 0.9561
0.0805 1.54 1900 0.1553 0.7476 0.8146 0.7797 0.9587
0.0665 1.62 2000 0.1237 0.7692 0.8002 0.7844 0.9614
0.0665 1.7 2100 0.1504 0.7023 0.7945 0.7456 0.9543
0.0665 1.78 2200 0.1360 0.7920 0.8066 0.7992 0.9629
0.0665 1.86 2300 0.1538 0.7032 0.7881 0.7432 0.9520
0.0665 1.94 2400 0.1374 0.7559 0.8025 0.7785 0.9603
0.0624 2.02 2500 0.1346 0.7738 0.8213 0.7968 0.9610
0.0624 2.1 2600 0.1453 0.7381 0.8247 0.7790 0.9568
0.0624 2.18 2700 0.1525 0.7615 0.8138 0.7868 0.9600
0.0624 2.26 2800 0.1515 0.7387 0.8020 0.7690 0.9558
0.0624 2.34 2900 0.1307 0.7695 0.7968 0.7829 0.9601
0.0548 2.43 3000 0.1371 0.7761 0.7873 0.7816 0.9611
0.0548 2.51 3100 0.1365 0.7246 0.8426 0.7792 0.9567
0.0548 2.59 3200 0.1158 0.8012 0.8144 0.8077 0.9660
0.0548 2.67 3300 0.1259 0.8211 0.8057 0.8133 0.9647
0.0548 2.75 3400 0.1561 0.8310 0.7440 0.7851 0.9611
0.0521 2.83 3500 0.1433 0.7956 0.7956 0.7956 0.9629
0.0521 2.91 3600 0.1508 0.7838 0.7985 0.7911 0.9603
0.0521 2.99 3700 0.1533 0.7949 0.7867 0.7908 0.9622
0.0521 3.07 3800 0.1739 0.7361 0.8129 0.7726 0.9507
0.0521 3.15 3900 0.1421 0.8128 0.8011 0.8069 0.9639
0.0504 3.23 4000 0.1371 0.7739 0.8161 0.7944 0.9626
0.0504 3.31 4100 0.1540 0.7464 0.8155 0.7794 0.9583
0.0504 3.4 4200 0.2071 0.7787 0.7850 0.7818 0.9545
0.0504 3.48 4300 0.1693 0.8328 0.7740 0.8023 0.9635
0.0504 3.56 4400 0.1670 0.7478 0.8170 0.7808 0.9559
0.0408 3.64 4500 0.1507 0.7267 0.8510 0.7840 0.9547
0.0408 3.72 4600 0.1477 0.7625 0.8285 0.7941 0.9612
0.0408 3.8 4700 0.1326 0.8010 0.8204 0.8106 0.9645
0.0408 3.88 4800 0.1280 0.7863 0.8409 0.8126 0.9648
0.0408 3.96 4900 0.1376 0.7673 0.8184 0.7920 0.9617
0.0463 4.04 5000 0.1396 0.7560 0.8415 0.7965 0.9617
0.0463 4.12 5100 0.1232 0.7809 0.8187 0.7993 0.9633
0.0463 4.2 5200 0.1322 0.8039 0.8164 0.8101 0.9651
0.0463 4.28 5300 0.1428 0.7891 0.8426 0.8150 0.9641
0.0463 4.37 5400 0.1669 0.7783 0.8331 0.8048 0.9592
0.0383 4.45 5500 0.1419 0.7843 0.8282 0.8057 0.9645
0.0383 4.53 5600 0.1398 0.7855 0.8118 0.7984 0.9613
0.0383 4.61 5700 0.1392 0.7703 0.7861 0.7781 0.9613
0.0383 4.69 5800 0.1341 0.8025 0.8175 0.8099 0.9646
0.0383 4.77 5900 0.1432 0.7931 0.8123 0.8026 0.9623
0.0434 4.85 6000 0.1434 0.8266 0.7956 0.8108 0.9666
0.0434 4.93 6100 0.1448 0.8051 0.8014 0.8032 0.9634
0.0434 5.01 6200 0.1496 0.7687 0.8342 0.8001 0.9615
0.0434 5.09 6300 0.1437 0.8187 0.8071 0.8129 0.9647
0.0434 5.17 6400 0.1539 0.7499 0.8244 0.7854 0.9595
0.0329 5.25 6500 0.1888 0.7268 0.8458 0.7818 0.9538
0.0329 5.34 6600 0.1573 0.7591 0.8210 0.7888 0.9572
0.0329 5.42 6700 0.1348 0.7916 0.8288 0.8097 0.9656
0.0329 5.5 6800 0.1405 0.7692 0.8244 0.7959 0.9617
0.0329 5.58 6900 0.1410 0.8133 0.8175 0.8154 0.9660
0.036 5.66 7000 0.1574 0.7990 0.8363 0.8172 0.9635
0.036 5.74 7100 0.1446 0.8103 0.8092 0.8098 0.9670
0.036 5.82 7200 0.1465 0.7681 0.7936 0.7807 0.9585
0.036 5.9 7300 0.1339 0.8027 0.8138 0.8082 0.9648
0.036 5.98 7400 0.1329 0.7989 0.8201 0.8094 0.9660
0.0367 6.06 7500 0.1422 0.7892 0.8181 0.8034 0.9652
0.0367 6.14 7600 0.1782 0.7760 0.8178 0.7964 0.9591
0.0367 6.22 7700 0.1418 0.7793 0.8328 0.8052 0.9614
0.0367 6.31 7800 0.1569 0.7720 0.7899 0.7808 0.9602
0.0367 6.39 7900 0.1456 0.8021 0.8328 0.8171 0.9632
0.0329 6.47 8000 0.1513 0.7954 0.8227 0.8088 0.9648
0.0329 6.55 8100 0.1446 0.8010 0.8239 0.8123 0.9647
0.0329 6.63 8200 0.1532 0.7911 0.8132 0.8020 0.9601
0.0329 6.71 8300 0.1524 0.7971 0.8043 0.8007 0.9632
0.0329 6.79 8400 0.1375 0.7869 0.8112 0.7989 0.9638
0.0297 6.87 8500 0.1584 0.8097 0.8155 0.8126 0.9649
0.0297 6.95 8600 0.1406 0.7890 0.8279 0.8080 0.9631
0.0297 7.03 8700 0.1605 0.7687 0.8276 0.7971 0.9615
0.0297 7.11 8800 0.1535 0.7571 0.8400 0.7964 0.9605
0.0297 7.19 8900 0.1527 0.7949 0.8233 0.8088 0.9649
0.0302 7.28 9000 0.1457 0.8183 0.8311 0.8247 0.968
0.0302 7.36 9100 0.1582 0.7588 0.8432 0.7987 0.9600
0.0302 7.44 9200 0.1473 0.8267 0.8322 0.8295 0.9685
0.0302 7.52 9300 0.1351 0.8017 0.8403 0.8205 0.9663
0.0302 7.6 9400 0.1535 0.8116 0.8380 0.8246 0.9684
0.0273 7.68 9500 0.1322 0.8001 0.8201 0.8100 0.9654
0.0273 7.76 9600 0.1563 0.7742 0.8400 0.8058 0.9629
0.0273 7.84 9700 0.1739 0.7492 0.8492 0.7961 0.9560
0.0273 7.92 9800 0.1654 0.8122 0.8279 0.8200 0.9638
0.0273 8.0 9900 0.1663 0.7798 0.8380 0.8078 0.9614
0.0301 8.08 10000 0.1609 0.8256 0.8230 0.8243 0.9663
0.0301 8.16 10100 0.1704 0.7858 0.8449 0.8143 0.9620
0.0301 8.25 10200 0.1551 0.7984 0.8299 0.8139 0.9644
0.0301 8.33 10300 0.1598 0.8017 0.8334 0.8172 0.9630
0.0301 8.41 10400 0.1662 0.8084 0.8164 0.8124 0.9638
0.0252 8.49 10500 0.1876 0.7432 0.8351 0.7865 0.9550
0.0252 8.57 10600 0.1724 0.7866 0.8351 0.8101 0.9614
0.0252 8.65 10700 0.1931 0.7352 0.8458 0.7866 0.9491
0.0252 8.73 10800 0.1727 0.7968 0.8296 0.8129 0.9641
0.0252 8.81 10900 0.1655 0.7640 0.8380 0.7993 0.9588
0.0256 8.89 11000 0.1527 0.8191 0.8351 0.8270 0.9672
0.0256 8.97 11100 0.1542 0.8048 0.8239 0.8142 0.9640
0.0256 9.05 11200 0.1713 0.8139 0.8146 0.8143 0.9636
0.0256 9.14 11300 0.1654 0.8130 0.8221 0.8175 0.9645
0.0256 9.22 11400 0.1712 0.7757 0.8342 0.8039 0.9618
0.0253 9.3 11500 0.1575 0.7724 0.8268 0.7987 0.9615
0.0253 9.38 11600 0.1697 0.8018 0.8233 0.8124 0.9648
0.0253 9.46 11700 0.1506 0.7798 0.8259 0.8022 0.9618
0.0253 9.54 11800 0.1686 0.8034 0.8331 0.8180 0.9649
0.0253 9.62 11900 0.1863 0.7939 0.8227 0.8080 0.9624
0.0215 9.7 12000 0.1794 0.8056 0.8233 0.8144 0.9644
0.0215 9.78 12100 0.1746 0.8083 0.8288 0.8184 0.9644
0.0215 9.86 12200 0.1668 0.8112 0.8247 0.8179 0.9647
0.0215 9.94 12300 0.1792 0.7835 0.8357 0.8088 0.9597
0.0215 10.02 12400 0.2200 0.7550 0.8386 0.7946 0.9575
0.0202 10.11 12500 0.1842 0.7772 0.8317 0.8035 0.9566
0.0202 10.19 12600 0.1930 0.7816 0.8149 0.7979 0.9617
0.0202 10.27 12700 0.1894 0.7615 0.8458 0.8014 0.9571
0.0202 10.35 12800 0.1711 0.8302 0.8103 0.8201 0.9661
0.0202 10.43 12900 0.1981 0.7802 0.8063 0.7930 0.9581
0.021 10.51 13000 0.1586 0.8045 0.8317 0.8179 0.9643
0.021 10.59 13100 0.1589 0.8136 0.8155 0.8146 0.9657
0.021 10.67 13200 0.1758 0.7997 0.8242 0.8118 0.9640
0.021 10.75 13300 0.1862 0.8046 0.8299 0.8171 0.9635
0.021 10.83 13400 0.1854 0.7864 0.8403 0.8124 0.9628
0.0205 10.91 13500 0.1815 0.8168 0.8291 0.8229 0.9655
0.0205 10.99 13600 0.2104 0.8244 0.7838 0.8036 0.9627
0.0205 11.08 13700 0.1783 0.7719 0.8273 0.7987 0.9595
0.0205 11.16 13800 0.1911 0.8176 0.8178 0.8177 0.9656
0.0205 11.24 13900 0.1989 0.8072 0.8317 0.8193 0.9643
0.0194 11.32 14000 0.1959 0.7926 0.8394 0.8153 0.9627
0.0194 11.4 14100 0.1686 0.7977 0.8420 0.8192 0.9642
0.0194 11.48 14200 0.1818 0.8224 0.8074 0.8148 0.9658
0.0194 11.56 14300 0.1841 0.7470 0.8426 0.7919 0.9549
0.0194 11.64 14400 0.1736 0.7826 0.8458 0.8130 0.9624
0.0187 11.72 14500 0.1937 0.8026 0.8204 0.8114 0.9614
0.0187 11.8 14600 0.1893 0.8113 0.8366 0.8237 0.9643
0.0187 11.88 14700 0.1721 0.8173 0.8345 0.8258 0.9663
0.0187 11.96 14800 0.1881 0.8018 0.8325 0.8169 0.9642
0.0187 12.05 14900 0.2184 0.7770 0.8417 0.8081 0.9589
0.0168 12.13 15000 0.1992 0.7864 0.8288 0.8070 0.9602
0.0168 12.21 15100 0.2041 0.8273 0.7829 0.8045 0.9641
0.0168 12.29 15200 0.2166 0.7893 0.8250 0.8068 0.9584
0.0168 12.37 15300 0.1868 0.7712 0.8423 0.8052 0.9577
0.0168 12.45 15400 0.1777 0.8016 0.8351 0.8180 0.9640
0.019 12.53 15500 0.1847 0.7896 0.8158 0.8025 0.9620
0.019 12.61 15600 0.2094 0.8033 0.8100 0.8067 0.9632
0.019 12.69 15700 0.1953 0.7992 0.8351 0.8167 0.9630
0.019 12.77 15800 0.1735 0.7944 0.8106 0.8024 0.9605
0.019 12.85 15900 0.2150 0.7750 0.8501 0.8108 0.9621
0.0163 12.93 16000 0.1975 0.7828 0.8374 0.8092 0.9624
0.0163 13.02 16100 0.1829 0.8207 0.8363 0.8284 0.9668
0.0163 13.1 16200 0.1872 0.8293 0.8037 0.8163 0.9660
0.0163 13.18 16300 0.1876 0.8022 0.8244 0.8132 0.9642
0.0163 13.26 16400 0.1890 0.7981 0.8374 0.8173 0.9646
0.0142 13.34 16500 0.2230 0.7739 0.8357 0.8036 0.9605
0.0142 13.42 16600 0.1933 0.8082 0.8103 0.8093 0.9629
0.0142 13.5 16700 0.1963 0.7937 0.8305 0.8117 0.9610
0.0142 13.58 16800 0.2178 0.7847 0.8299 0.8067 0.9593
0.0142 13.66 16900 0.2074 0.7814 0.8449 0.8119 0.9615
0.0167 13.74 17000 0.2265 0.7561 0.8489 0.7998 0.9582
0.0167 13.82 17100 0.2205 0.7982 0.8242 0.8109 0.9627
0.0167 13.9 17200 0.1883 0.7718 0.8305 0.8001 0.9608
0.0167 13.99 17300 0.2138 0.7837 0.8282 0.8053 0.9613
0.0167 14.07 17400 0.2117 0.7815 0.8322 0.8061 0.9635
0.0154 14.15 17500 0.2053 0.8065 0.8170 0.8117 0.9639
0.0154 14.23 17600 0.2164 0.7921 0.8115 0.8017 0.9609
0.0154 14.31 17700 0.2117 0.7618 0.8351 0.7968 0.9568
0.0154 14.39 17800 0.2287 0.7709 0.8351 0.8017 0.9585
0.0154 14.47 17900 0.2074 0.7969 0.8383 0.8171 0.9639
0.0152 14.55 18000 0.2111 0.7571 0.8455 0.7989 0.9598
0.0152 14.63 18100 0.2091 0.7995 0.8288 0.8139 0.9639
0.0152 14.71 18200 0.2146 0.7787 0.8389 0.8077 0.9602
0.0152 14.79 18300 0.1898 0.7884 0.8129 0.8005 0.9604
0.0152 14.87 18400 0.1974 0.7912 0.8106 0.8008 0.9602
0.0133 14.96 18500 0.1950 0.8191 0.8273 0.8232 0.9644
0.0133 15.04 18600 0.2113 0.8119 0.8311 0.8214 0.9640
0.0133 15.12 18700 0.2172 0.7726 0.8435 0.8065 0.9592
0.0133 15.2 18800 0.2290 0.7450 0.8464 0.7924 0.9542
0.0133 15.28 18900 0.2200 0.7924 0.8363 0.8137 0.9630
0.0135 15.36 19000 0.2064 0.8168 0.8279 0.8223 0.9657
0.0135 15.44 19100 0.2244 0.8249 0.8296 0.8272 0.9655
0.0135 15.52 19200 0.2271 0.8134 0.8141 0.8137 0.9649
0.0135 15.6 19300 0.2167 0.8099 0.8242 0.8170 0.9644
0.0135 15.68 19400 0.2142 0.8020 0.8265 0.8140 0.9632
0.0125 15.76 19500 0.2040 0.8106 0.8253 0.8179 0.9648
0.0125 15.84 19600 0.2035 0.8216 0.8207 0.8212 0.9660
0.0125 15.93 19700 0.2160 0.7937 0.8317 0.8122 0.9640
0.0125 16.01 19800 0.2110 0.7947 0.8314 0.8126 0.9622
0.0125 16.09 19900 0.2296 0.8034 0.8233 0.8132 0.9641
0.0115 16.17 20000 0.2127 0.8007 0.8291 0.8146 0.9645
0.0115 16.25 20100 0.2268 0.8 0.8198 0.8098 0.9636
0.0115 16.33 20200 0.2427 0.7904 0.8314 0.8103 0.9617
0.0115 16.41 20300 0.2247 0.7629 0.8412 0.8001 0.9578
0.0115 16.49 20400 0.2320 0.8106 0.8227 0.8166 0.9639
0.0106 16.57 20500 0.2021 0.8103 0.8187 0.8145 0.9643
0.0106 16.65 20600 0.2328 0.7668 0.8426 0.8029 0.9592
0.0106 16.73 20700 0.2084 0.8073 0.8380 0.8223 0.9645
0.0106 16.81 20800 0.1896 0.7807 0.8314 0.8052 0.9622
0.0106 16.9 20900 0.2005 0.8008 0.8308 0.8155 0.9652
0.0124 16.98 21000 0.2114 0.8084 0.8210 0.8146 0.9656
0.0124 17.06 21100 0.2327 0.7932 0.8357 0.8139 0.9628
0.0124 17.14 21200 0.2311 0.8190 0.8071 0.8130 0.9648
0.0124 17.22 21300 0.2222 0.7904 0.8394 0.8142 0.9626
0.0124 17.3 21400 0.2147 0.8003 0.8236 0.8118 0.9624
0.0093 17.38 21500 0.2409 0.8167 0.8285 0.8226 0.9655
0.0093 17.46 21600 0.2183 0.7792 0.8250 0.8015 0.9609
0.0093 17.54 21700 0.2159 0.7962 0.8242 0.8099 0.9628
0.0093 17.62 21800 0.2046 0.8061 0.8279 0.8168 0.9661
0.0093 17.7 21900 0.2116 0.8003 0.8377 0.8186 0.9652
0.0106 17.78 22000 0.2069 0.8102 0.8354 0.8226 0.9651
0.0106 17.87 22100 0.2276 0.8134 0.8181 0.8158 0.9652
0.0106 17.95 22200 0.2091 0.8239 0.8172 0.8205 0.9661
0.0106 18.03 22300 0.2295 0.7801 0.8354 0.8068 0.9629
0.0106 18.11 22400 0.2248 0.7851 0.8224 0.8033 0.9629
0.0104 18.19 22500 0.2403 0.7866 0.8244 0.8051 0.9630
0.0104 18.27 22600 0.2352 0.8004 0.8161 0.8082 0.9637
0.0104 18.35 22700 0.2164 0.8002 0.8279 0.8138 0.9644
0.0104 18.43 22800 0.2123 0.7934 0.8256 0.8092 0.9644
0.0104 18.51 22900 0.2195 0.7788 0.8394 0.8080 0.9623
0.0086 18.59 23000 0.2060 0.8130 0.8273 0.8201 0.9651
0.0086 18.67 23100 0.2147 0.8034 0.8282 0.8156 0.9648
0.0086 18.76 23200 0.2261 0.8036 0.8337 0.8183 0.9639
0.0086 18.84 23300 0.2202 0.8004 0.8380 0.8188 0.9638
0.0086 18.92 23400 0.2267 0.8110 0.8299 0.8203 0.9641
0.0093 19.0 23500 0.2191 0.8045 0.8256 0.8149 0.9632
0.0093 19.08 23600 0.2492 0.8098 0.8247 0.8172 0.9641
0.0093 19.16 23700 0.2427 0.8176 0.8207 0.8192 0.9648
0.0093 19.24 23800 0.2353 0.8009 0.8314 0.8158 0.9640
0.0093 19.32 23900 0.2431 0.8343 0.8071 0.8205 0.9665
0.0092 19.4 24000 0.2178 0.8098 0.8123 0.8111 0.9646
0.0092 19.48 24100 0.2238 0.8097 0.8020 0.8058 0.9634
0.0092 19.56 24200 0.2322 0.8044 0.8334 0.8186 0.9644
0.0092 19.64 24300 0.2368 0.8009 0.8374 0.8188 0.9643
0.0092 19.73 24400 0.2306 0.8165 0.8299 0.8232 0.9652
0.0076 19.81 24500 0.2257 0.8040 0.8299 0.8167 0.9641
0.0076 19.89 24600 0.2365 0.8117 0.8291 0.8203 0.9649
0.0076 19.97 24700 0.2439 0.8088 0.8230 0.8158 0.9647
0.0076 20.05 24800 0.2487 0.7994 0.8354 0.8170 0.9636
0.0076 20.13 24900 0.2468 0.8033 0.8276 0.8153 0.9646
0.0072 20.21 25000 0.2571 0.7922 0.8299 0.8106 0.9631
0.0072 20.29 25100 0.2498 0.7881 0.8429 0.8146 0.9636
0.0072 20.37 25200 0.2499 0.7897 0.8305 0.8096 0.9625
0.0072 20.45 25300 0.2623 0.7978 0.8282 0.8127 0.9624
0.0072 20.53 25400 0.2633 0.8036 0.8219 0.8126 0.9635
0.0068 20.61 25500 0.2695 0.7960 0.8279 0.8116 0.9626
0.0068 20.7 25600 0.2541 0.7757 0.8314 0.8026 0.9601
0.0068 20.78 25700 0.2706 0.7863 0.8233 0.8044 0.9616
0.0068 20.86 25800 0.2725 0.7990 0.8149 0.8069 0.9621
0.0068 20.94 25900 0.2758 0.7820 0.8325 0.8065 0.9611
0.0073 21.02 26000 0.2450 0.8081 0.8216 0.8148 0.9639
0.0073 21.1 26100 0.2640 0.7904 0.8253 0.8075 0.9622
0.0073 21.18 26200 0.2513 0.7874 0.8400 0.8128 0.9628
0.0073 21.26 26300 0.2661 0.8136 0.8141 0.8138 0.9641
0.0073 21.34 26400 0.2481 0.7880 0.8273 0.8072 0.9627
0.0061 21.42 26500 0.2662 0.7932 0.8293 0.8109 0.9627
0.0061 21.5 26600 0.2651 0.8095 0.8233 0.8163 0.9642
0.0061 21.58 26700 0.2569 0.7904 0.8270 0.8083 0.9618
0.0061 21.67 26800 0.2672 0.8006 0.8092 0.8049 0.9625
0.0061 21.75 26900 0.2721 0.7976 0.8167 0.8070 0.9619
0.0066 21.83 27000 0.2456 0.7904 0.8066 0.7984 0.9616
0.0066 21.91 27100 0.2709 0.8015 0.8195 0.8104 0.9631
0.0066 21.99 27200 0.2607 0.8072 0.8291 0.8180 0.9640
0.0066 22.07 27300 0.2841 0.8024 0.8227 0.8124 0.9627
0.0066 22.15 27400 0.2941 0.7906 0.8285 0.8091 0.9621
0.0056 22.23 27500 0.2856 0.8032 0.8213 0.8121 0.9633
0.0056 22.31 27600 0.2753 0.7933 0.8276 0.8101 0.9629
0.0056 22.39 27700 0.2739 0.8050 0.8022 0.8036 0.9636
0.0056 22.47 27800 0.3057 0.7689 0.8250 0.7960 0.9589
0.0056 22.55 27900 0.2722 0.7760 0.8279 0.8011 0.9607
0.0061 22.64 28000 0.2811 0.7880 0.8377 0.8121 0.9622
0.0061 22.72 28100 0.2819 0.7873 0.8345 0.8102 0.9606
0.0061 22.8 28200 0.2836 0.7939 0.8282 0.8107 0.9613
0.0061 22.88 28300 0.2911 0.7886 0.8279 0.8078 0.9603
0.0061 22.96 28400 0.2930 0.7844 0.8380 0.8103 0.9608
0.0046 23.04 28500 0.3019 0.7928 0.8360 0.8138 0.9620
0.0046 23.12 28600 0.2857 0.8027 0.8314 0.8168 0.9627
0.0046 23.2 28700 0.2794 0.8026 0.8276 0.8149 0.9634
0.0046 23.28 28800 0.2971 0.7950 0.8340 0.8140 0.9623
0.0046 23.36 28900 0.2689 0.8045 0.8219 0.8131 0.9632
0.0051 23.44 29000 0.2727 0.7957 0.8340 0.8144 0.9630
0.0051 23.52 29100 0.2707 0.7967 0.8291 0.8125 0.9626
0.0051 23.61 29200 0.2733 0.7978 0.8305 0.8138 0.9630
0.0051 23.69 29300 0.2744 0.7840 0.8371 0.8097 0.9620
0.0051 23.77 29400 0.2788 0.7905 0.8363 0.8127 0.9620
0.0046 23.85 29500 0.2913 0.7829 0.8391 0.8101 0.9611
0.0046 23.93 29600 0.2761 0.7919 0.8282 0.8096 0.9625
0.0046 24.01 29700 0.2858 0.7924 0.8342 0.8128 0.9629
0.0046 24.09 29800 0.2821 0.8062 0.8285 0.8172 0.9642
0.0046 24.17 29900 0.2802 0.8148 0.8129 0.8139 0.9638
0.0038 24.25 30000 0.2977 0.7952 0.8262 0.8104 0.9622
0.0038 24.33 30100 0.2848 0.8016 0.8337 0.8173 0.9639
0.0038 24.41 30200 0.2741 0.8096 0.8178 0.8137 0.9642
0.0038 24.49 30300 0.2896 0.7928 0.8308 0.8114 0.9636
0.0038 24.58 30400 0.2841 0.7884 0.8377 0.8123 0.9634
0.005 24.66 30500 0.2822 0.7924 0.8308 0.8111 0.9627
0.005 24.74 30600 0.2875 0.7940 0.8334 0.8132 0.9628
0.005 24.82 30700 0.2830 0.8012 0.8216 0.8113 0.9635
0.005 24.9 30800 0.2912 0.7978 0.8279 0.8126 0.9628
0.005 24.98 30900 0.2791 0.8066 0.8187 0.8126 0.9640
0.0039 25.06 31000 0.2774 0.7948 0.8296 0.8118 0.9627
0.0039 25.14 31100 0.2839 0.7945 0.8293 0.8116 0.9631
0.0039 25.22 31200 0.2948 0.7897 0.8322 0.8104 0.9628
0.0039 25.3 31300 0.2881 0.7925 0.8325 0.8120 0.9626
0.0039 25.38 31400 0.2917 0.7875 0.8331 0.8096 0.9626
0.0036 25.46 31500 0.2842 0.7942 0.8308 0.8121 0.9632
0.0036 25.55 31600 0.2776 0.7963 0.8305 0.8130 0.9635
0.0036 25.63 31700 0.2943 0.8009 0.8314 0.8158 0.9638
0.0036 25.71 31800 0.2888 0.8016 0.8268 0.8140 0.9643
0.0036 25.79 31900 0.2926 0.7957 0.8288 0.8119 0.9635
0.0034 25.87 32000 0.2916 0.7993 0.8302 0.8145 0.9637
0.0034 25.95 32100 0.2924 0.7973 0.8288 0.8127 0.9631
0.0034 26.03 32200 0.2918 0.8083 0.8204 0.8143 0.9640
0.0034 26.11 32300 0.3024 0.7931 0.8319 0.8120 0.9633
0.0034 26.19 32400 0.2996 0.7964 0.8268 0.8113 0.9636
0.0032 26.27 32500 0.3000 0.7972 0.8239 0.8103 0.9627
0.0032 26.35 32600 0.2856 0.8071 0.8201 0.8136 0.9636
0.0032 26.43 32700 0.2938 0.7968 0.8276 0.8119 0.9628
0.0032 26.52 32800 0.2897 0.8052 0.8259 0.8154 0.9641
0.0032 26.6 32900 0.2931 0.8074 0.8227 0.8150 0.9643
0.0035 26.68 33000 0.2879 0.8137 0.8244 0.8190 0.9651
0.0035 26.76 33100 0.2985 0.8026 0.8308 0.8164 0.9641
0.0035 26.84 33200 0.2864 0.8054 0.8242 0.8146 0.9639
0.0035 26.92 33300 0.2830 0.8094 0.8253 0.8173 0.9645
0.0035 27.0 33400 0.2951 0.7879 0.8363 0.8114 0.9629
0.0031 27.08 33500 0.2873 0.7969 0.8279 0.8121 0.9639
0.0031 27.16 33600 0.2927 0.8113 0.8204 0.8158 0.9648
0.0031 27.24 33700 0.2987 0.8015 0.8273 0.8142 0.9641
0.0031 27.32 33800 0.2990 0.8017 0.8250 0.8132 0.9641
0.0031 27.41 33900 0.2978 0.8033 0.8276 0.8153 0.9640
0.0025 27.49 34000 0.2960 0.8026 0.8273 0.8148 0.9644
0.0025 27.57 34100 0.2980 0.8051 0.8239 0.8144 0.9644
0.0025 27.65 34200 0.2978 0.8070 0.8233 0.8151 0.9646
0.0025 27.73 34300 0.3003 0.8070 0.8230 0.8149 0.9640
0.0025 27.81 34400 0.3026 0.8025 0.8221 0.8122 0.9640
0.0028 27.89 34500 0.3072 0.8010 0.8250 0.8128 0.9637
0.0028 27.97 34600 0.3137 0.7931 0.8319 0.8120 0.9631
0.0028 28.05 34700 0.3062 0.7932 0.8259 0.8092 0.9628
0.0028 28.13 34800 0.3053 0.7968 0.8250 0.8107 0.9634
0.0028 28.21 34900 0.3034 0.7979 0.8207 0.8092 0.9632
0.0025 28.29 35000 0.3094 0.7994 0.8213 0.8102 0.9635
0.0025 28.38 35100 0.3115 0.7970 0.8239 0.8102 0.9633
0.0025 28.46 35200 0.3116 0.7979 0.8230 0.8103 0.9633
0.0025 28.54 35300 0.3148 0.7959 0.8305 0.8128 0.9633
0.0025 28.62 35400 0.3127 0.7970 0.8273 0.8119 0.9633
0.0021 28.7 35500 0.3104 0.8015 0.8207 0.8110 0.9638
0.0021 28.78 35600 0.3127 0.8052 0.8221 0.8136 0.9640
0.0021 28.86 35700 0.3137 0.8001 0.8247 0.8122 0.9638
0.0021 28.94 35800 0.3172 0.7953 0.8311 0.8128 0.9632
0.0021 29.02 35900 0.3176 0.7987 0.8302 0.8141 0.9636
0.0021 29.1 36000 0.3207 0.7956 0.8317 0.8132 0.9635
0.0021 29.18 36100 0.3208 0.7956 0.8305 0.8127 0.9633
0.0021 29.26 36200 0.3192 0.7976 0.8293 0.8132 0.9635
0.0021 29.35 36300 0.3167 0.8006 0.8273 0.8137 0.9638
0.0021 29.43 36400 0.3167 0.7998 0.8279 0.8136 0.9637
0.0024 29.51 36500 0.3160 0.8014 0.8282 0.8146 0.9638
0.0024 29.59 36600 0.3156 0.8002 0.8268 0.8133 0.9637
0.0024 29.67 36700 0.3156 0.8027 0.8268 0.8145 0.9637
0.0024 29.75 36800 0.3154 0.8026 0.8262 0.8142 0.9638
0.0024 29.83 36900 0.3153 0.8020 0.8265 0.8140 0.9638
0.0017 29.91 37000 0.3152 0.8020 0.8268 0.8142 0.9638
0.0017 29.99 37100 0.3152 0.8023 0.8270 0.8145 0.9639

Framework versions

  • Transformers 4.38.2
  • Pytorch 2.2.1+cu121
  • Datasets 2.18.0
  • Tokenizers 0.15.2
Downloads last month
41
Safetensors
Model size
284M params
Tensor type
F32
·

Finetuned from