--- license: cc-by-nc-sa-4.0 tags: - generated_from_trainer model-index: - name: lmv2-g-receipts2 results: [] --- # lmv2-g-receipts2 This model is a fine-tuned version of [microsoft/layoutlmv2-base-uncased](https://huggingface.co/microsoft/layoutlmv2-base-uncased) on the None dataset. It achieves the following results on the evaluation set: - Loss: 0.2756 - Purchase Time Precision: 0.9180 - Purchase Time Recall: 0.875 - Purchase Time F1: 0.8960 - Purchase Time Number: 128 - Receipt Date Precision: 0.8941 - Receipt Date Recall: 0.8994 - Receipt Date F1: 0.8968 - Receipt Date Number: 169 - Sub Total Precision: 0.8673 - Sub Total Recall: 0.7727 - Sub Total F1: 0.8173 - Sub Total Number: 110 - Supplier Address Precision: 0.7097 - Supplier Address Recall: 0.7719 - Supplier Address F1: 0.7395 - Supplier Address Number: 114 - Supplier Name Precision: 0.7159 - Supplier Name Recall: 0.7079 - Supplier Name F1: 0.7119 - Supplier Name Number: 267 - Tip Amount Precision: 0.6667 - Tip Amount Recall: 1.0 - Tip Amount F1: 0.8 - Tip Amount Number: 2 - Total Precision: 0.8978 - Total Recall: 0.9126 - Total F1: 0.9051 - Total Number: 183 - Total Tax Amount Precision: 0.8644 - Total Tax Amount Recall: 0.7846 - Total Tax Amount F1: 0.8226 - Total Tax Amount Number: 65 - Overall Precision: 0.8246 - Overall Recall: 0.8150 - Overall F1: 0.8198 - Overall Accuracy: 0.9749 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 3e-05 - train_batch_size: 1 - eval_batch_size: 1 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 50 ### Training results | Training Loss | Epoch | Step | Validation Loss | Purchase Time Precision | Purchase Time Recall | Purchase Time F1 | Purchase Time Number | Receipt Date Precision | Receipt Date Recall | Receipt Date F1 | Receipt Date Number | Sub Total Precision | Sub Total Recall | Sub Total F1 | Sub Total Number | Supplier Address Precision | Supplier Address Recall | Supplier Address F1 | Supplier Address Number | Supplier Name Precision | Supplier Name Recall | Supplier Name F1 | Supplier Name Number | Tip Amount Precision | Tip Amount Recall | Tip Amount F1 | Tip Amount Number | Total Precision | Total Recall | Total F1 | Total Number | Total Tax Amount Precision | Total Tax Amount Recall | Total Tax Amount F1 | Total Tax Amount Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy | |:-------------:|:-----:|:-----:|:---------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:-------------------:|:----------------:|:------------:|:----------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:---------------:|:------------:|:--------:|:------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------:|:-----------------:|:--------------:|:----------:|:----------------:| | 0.972 | 1.0 | 793 | 0.4257 | 0.3830 | 0.1406 | 0.2057 | 128 | 0.0 | 0.0 | 0.0 | 169 | 0.0 | 0.0 | 0.0 | 110 | 0.3973 | 0.5088 | 0.4462 | 114 | 0.5263 | 0.3745 | 0.4376 | 267 | 0.0 | 0.0 | 0.0 | 2 | 0.4096 | 0.7923 | 0.5400 | 183 | 0.0 | 0.0 | 0.0 | 65 | 0.4355 | 0.3092 | 0.3617 | 0.9296 | | 0.2924 | 2.0 | 1586 | 0.2379 | 0.9259 | 0.7812 | 0.8475 | 128 | 0.8182 | 0.7456 | 0.7802 | 169 | 0.8966 | 0.2364 | 0.3741 | 110 | 0.5571 | 0.6842 | 0.6142 | 114 | 0.6584 | 0.5993 | 0.6275 | 267 | 0.0 | 0.0 | 0.0 | 2 | 0.7042 | 0.8197 | 0.7576 | 183 | 1.0 | 0.0462 | 0.0882 | 65 | 0.7225 | 0.6195 | 0.6670 | 0.9630 | | 0.1611 | 3.0 | 2379 | 0.1756 | 0.8138 | 0.9219 | 0.8645 | 128 | 0.8020 | 0.9349 | 0.8634 | 169 | 0.7064 | 0.7 | 0.7032 | 110 | 0.5733 | 0.7544 | 0.6515 | 114 | 0.7308 | 0.6404 | 0.6826 | 267 | 0.0 | 0.0 | 0.0 | 2 | 0.8057 | 0.7705 | 0.7877 | 183 | 0.7258 | 0.6923 | 0.7087 | 65 | 0.7425 | 0.7669 | 0.7545 | 0.9670 | | 0.1013 | 4.0 | 3172 | 0.1557 | 0.9099 | 0.7891 | 0.8452 | 128 | 0.8659 | 0.8402 | 0.8529 | 169 | 0.8493 | 0.5636 | 0.6776 | 110 | 0.5970 | 0.7018 | 0.6452 | 114 | 0.6603 | 0.6479 | 0.6541 | 267 | 0.0 | 0.0 | 0.0 | 2 | 0.8371 | 0.8142 | 0.8255 | 183 | 0.8654 | 0.6923 | 0.7692 | 65 | 0.7721 | 0.7245 | 0.7475 | 0.9692 | | 0.0684 | 5.0 | 3965 | 0.1623 | 0.7718 | 0.8984 | 0.8303 | 128 | 0.7949 | 0.9172 | 0.8516 | 169 | 0.7131 | 0.7909 | 0.75 | 110 | 0.5705 | 0.7807 | 0.6593 | 114 | 0.6887 | 0.6629 | 0.6756 | 267 | 0.0 | 0.0 | 0.0 | 2 | 0.8392 | 0.9126 | 0.8743 | 183 | 0.5816 | 0.8769 | 0.6994 | 65 | 0.7202 | 0.8160 | 0.7651 | 0.9661 | | 0.0491 | 6.0 | 4758 | 0.1828 | 0.9008 | 0.8516 | 0.8755 | 128 | 0.8830 | 0.8935 | 0.8882 | 169 | 0.6846 | 0.8091 | 0.7417 | 110 | 0.5062 | 0.7105 | 0.5912 | 114 | 0.6729 | 0.6779 | 0.6754 | 267 | 0.0 | 0.0 | 0.0 | 2 | 0.8807 | 0.8470 | 0.8635 | 183 | 0.7361 | 0.8154 | 0.7737 | 65 | 0.7452 | 0.7890 | 0.7665 | 0.9673 | | 0.043 | 7.0 | 5551 | 0.1825 | 0.9237 | 0.8516 | 0.8862 | 128 | 0.8807 | 0.9172 | 0.8986 | 169 | 0.7672 | 0.8091 | 0.7876 | 110 | 0.6279 | 0.7105 | 0.6667 | 114 | 0.7788 | 0.6330 | 0.6983 | 267 | 0.0 | 0.0 | 0.0 | 2 | 0.9045 | 0.8798 | 0.8920 | 183 | 0.6867 | 0.8769 | 0.7703 | 65 | 0.8073 | 0.7909 | 0.7990 | 0.9717 | | 0.0325 | 8.0 | 6344 | 0.1645 | 0.875 | 0.875 | 0.875 | 128 | 0.8636 | 0.8994 | 0.8812 | 169 | 0.7288 | 0.7818 | 0.7544 | 110 | 0.6241 | 0.7719 | 0.6902 | 114 | 0.7085 | 0.7191 | 0.7138 | 267 | 0.0 | 0.0 | 0.0 | 2 | 0.8367 | 0.8962 | 0.8654 | 183 | 0.6344 | 0.9077 | 0.7468 | 65 | 0.7596 | 0.8218 | 0.7894 | 0.9711 | | 0.0276 | 9.0 | 7137 | 0.1761 | 0.9160 | 0.8516 | 0.8826 | 128 | 0.8706 | 0.8757 | 0.8732 | 169 | 0.8861 | 0.6364 | 0.7407 | 110 | 0.6045 | 0.7105 | 0.6532 | 114 | 0.6689 | 0.7416 | 0.7034 | 267 | 0.0 | 0.0 | 0.0 | 2 | 0.8299 | 0.8798 | 0.8541 | 183 | 0.9268 | 0.5846 | 0.7170 | 65 | 0.7793 | 0.7755 | 0.7774 | 0.9705 | | 0.0237 | 10.0 | 7930 | 0.1842 | 0.8473 | 0.8672 | 0.8571 | 128 | 0.8613 | 0.8817 | 0.8713 | 169 | 0.7607 | 0.8091 | 0.7841 | 110 | 0.6569 | 0.7895 | 0.7171 | 114 | 0.7189 | 0.6704 | 0.6938 | 267 | 0.0 | 0.0 | 0.0 | 2 | 0.8729 | 0.8634 | 0.8681 | 183 | 0.7794 | 0.8154 | 0.7970 | 65 | 0.7850 | 0.7987 | 0.7918 | 0.9709 | | 0.0229 | 11.0 | 8723 | 0.1811 | 0.9167 | 0.8594 | 0.8871 | 128 | 0.8929 | 0.8876 | 0.8902 | 169 | 0.75 | 0.7909 | 0.7699 | 110 | 0.6 | 0.7368 | 0.6614 | 114 | 0.6958 | 0.6854 | 0.6906 | 267 | 1.0 | 0.5 | 0.6667 | 2 | 0.8639 | 0.9016 | 0.8824 | 183 | 0.8525 | 0.8 | 0.8254 | 65 | 0.7849 | 0.8015 | 0.7931 | 0.9713 | | 0.017 | 12.0 | 9516 | 0.2075 | 0.8906 | 0.8906 | 0.8906 | 128 | 0.7727 | 0.9053 | 0.8338 | 169 | 0.8218 | 0.7545 | 0.7867 | 110 | 0.6042 | 0.7632 | 0.6744 | 114 | 0.6830 | 0.6779 | 0.6805 | 267 | 1.0 | 0.5 | 0.6667 | 2 | 0.8429 | 0.8798 | 0.8610 | 183 | 0.8281 | 0.8154 | 0.8217 | 65 | 0.7628 | 0.8025 | 0.7822 | 0.9696 | | 0.0149 | 13.0 | 10309 | 0.1781 | 0.8760 | 0.8828 | 0.8794 | 128 | 0.8786 | 0.8994 | 0.8889 | 169 | 0.8660 | 0.7636 | 0.8116 | 110 | 0.6357 | 0.7193 | 0.6749 | 114 | 0.7154 | 0.6779 | 0.6962 | 267 | 0.5 | 1.0 | 0.6667 | 2 | 0.9138 | 0.8689 | 0.8908 | 183 | 0.8793 | 0.7846 | 0.8293 | 65 | 0.8102 | 0.7938 | 0.8019 | 0.9738 | | 0.0124 | 14.0 | 11102 | 0.1957 | 0.9106 | 0.875 | 0.8924 | 128 | 0.8629 | 0.8935 | 0.8779 | 169 | 0.8586 | 0.7727 | 0.8134 | 110 | 0.5909 | 0.7982 | 0.6791 | 114 | 0.6823 | 0.7079 | 0.6949 | 267 | 1.0 | 0.5 | 0.6667 | 2 | 0.9191 | 0.8689 | 0.8933 | 183 | 0.8030 | 0.8154 | 0.8092 | 65 | 0.7875 | 0.8102 | 0.7987 | 0.9729 | | 0.01 | 15.0 | 11895 | 0.2174 | 0.9098 | 0.8672 | 0.888 | 128 | 0.8817 | 0.8817 | 0.8817 | 169 | 0.8298 | 0.7091 | 0.7647 | 110 | 0.6587 | 0.7281 | 0.6917 | 114 | 0.6842 | 0.6816 | 0.6829 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.875 | 0.8798 | 0.8774 | 183 | 0.9783 | 0.6923 | 0.8108 | 65 | 0.8038 | 0.7813 | 0.7924 | 0.9726 | | 0.0102 | 16.0 | 12688 | 0.2073 | 0.9106 | 0.875 | 0.8924 | 128 | 0.8276 | 0.8521 | 0.8397 | 169 | 0.7679 | 0.7818 | 0.7748 | 110 | 0.6378 | 0.7105 | 0.6722 | 114 | 0.6806 | 0.6704 | 0.6755 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8717 | 0.8907 | 0.8811 | 183 | 0.6962 | 0.8462 | 0.7639 | 65 | 0.7697 | 0.7919 | 0.7806 | 0.9705 | | 0.0091 | 17.0 | 13481 | 0.2205 | 0.8358 | 0.875 | 0.8550 | 128 | 0.8306 | 0.8994 | 0.8636 | 169 | 0.6133 | 0.8364 | 0.7077 | 110 | 0.5944 | 0.7456 | 0.6615 | 114 | 0.6833 | 0.7191 | 0.7007 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8410 | 0.8962 | 0.8677 | 183 | 0.7297 | 0.8308 | 0.7770 | 65 | 0.7334 | 0.8218 | 0.7751 | 0.9680 | | 0.0063 | 18.0 | 14274 | 0.2007 | 0.8527 | 0.8594 | 0.8560 | 128 | 0.8613 | 0.8817 | 0.8713 | 169 | 0.8283 | 0.7455 | 0.7847 | 110 | 0.6535 | 0.7281 | 0.6888 | 114 | 0.7520 | 0.6929 | 0.7212 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.8730 | 0.9016 | 0.8871 | 183 | 0.7432 | 0.8462 | 0.7914 | 65 | 0.7998 | 0.8006 | 0.8002 | 0.9719 | | 0.0075 | 19.0 | 15067 | 0.2173 | 0.925 | 0.8672 | 0.8952 | 128 | 0.8765 | 0.8817 | 0.8791 | 169 | 0.8113 | 0.7818 | 0.7963 | 110 | 0.7196 | 0.6754 | 0.6968 | 114 | 0.6982 | 0.7191 | 0.7085 | 267 | 1.0 | 0.5 | 0.6667 | 2 | 0.9080 | 0.8634 | 0.8852 | 183 | 0.8833 | 0.8154 | 0.848 | 65 | 0.8164 | 0.7967 | 0.8064 | 0.9733 | | 0.0062 | 20.0 | 15860 | 0.2255 | 0.888 | 0.8672 | 0.8775 | 128 | 0.8613 | 0.8817 | 0.8713 | 169 | 0.9048 | 0.6909 | 0.7835 | 110 | 0.6718 | 0.7719 | 0.7184 | 114 | 0.7552 | 0.6816 | 0.7165 | 267 | 1.0 | 0.5 | 0.6667 | 2 | 0.9017 | 0.8525 | 0.8764 | 183 | 0.9074 | 0.7538 | 0.8235 | 65 | 0.8269 | 0.7823 | 0.8040 | 0.9733 | | 0.0063 | 21.0 | 16653 | 0.2417 | 0.8952 | 0.8672 | 0.8810 | 128 | 0.8453 | 0.9053 | 0.8743 | 169 | 0.84 | 0.7636 | 0.8000 | 110 | 0.6917 | 0.7281 | 0.7094 | 114 | 0.7194 | 0.6816 | 0.7 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8901 | 0.8852 | 0.8877 | 183 | 0.7937 | 0.7692 | 0.7813 | 65 | 0.8060 | 0.7967 | 0.8014 | 0.9721 | | 0.0045 | 22.0 | 17446 | 0.2069 | 0.8626 | 0.8828 | 0.8726 | 128 | 0.8830 | 0.8935 | 0.8882 | 169 | 0.7679 | 0.7818 | 0.7748 | 110 | 0.6462 | 0.7368 | 0.6885 | 114 | 0.7045 | 0.6966 | 0.7006 | 267 | 0.5 | 1.0 | 0.6667 | 2 | 0.8914 | 0.8525 | 0.8715 | 183 | 0.7361 | 0.8154 | 0.7737 | 65 | 0.7847 | 0.8006 | 0.7926 | 0.9721 | | 0.0044 | 23.0 | 18239 | 0.2675 | 0.8760 | 0.8828 | 0.8794 | 128 | 0.8721 | 0.8876 | 0.8798 | 169 | 0.8155 | 0.7636 | 0.7887 | 110 | 0.6864 | 0.7105 | 0.6983 | 114 | 0.7588 | 0.6479 | 0.6990 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.8983 | 0.8689 | 0.8833 | 183 | 0.7714 | 0.8308 | 0.8 | 65 | 0.8168 | 0.7861 | 0.8012 | 0.9711 | | 0.0037 | 24.0 | 19032 | 0.2294 | 0.9032 | 0.875 | 0.8889 | 128 | 0.8848 | 0.8639 | 0.8743 | 169 | 0.8283 | 0.7455 | 0.7847 | 110 | 0.7097 | 0.7719 | 0.7395 | 114 | 0.6866 | 0.6891 | 0.6879 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8950 | 0.8852 | 0.8901 | 183 | 0.7826 | 0.8308 | 0.8060 | 65 | 0.8035 | 0.7996 | 0.8015 | 0.9733 | | 0.0028 | 25.0 | 19825 | 0.2435 | 0.9310 | 0.8438 | 0.8852 | 128 | 0.8398 | 0.8994 | 0.8686 | 169 | 0.7870 | 0.7727 | 0.7798 | 110 | 0.5959 | 0.7632 | 0.6692 | 114 | 0.6679 | 0.6929 | 0.6801 | 267 | 0.5 | 1.0 | 0.6667 | 2 | 0.8601 | 0.9071 | 0.8830 | 183 | 0.7179 | 0.8615 | 0.7832 | 65 | 0.7625 | 0.8102 | 0.7856 | 0.9712 | | 0.0031 | 26.0 | 20618 | 0.2441 | 0.9160 | 0.8516 | 0.8826 | 128 | 0.9036 | 0.8876 | 0.8955 | 169 | 0.8925 | 0.7545 | 0.8177 | 110 | 0.6667 | 0.7368 | 0.7 | 114 | 0.7323 | 0.6966 | 0.7140 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.8817 | 0.8962 | 0.8889 | 183 | 0.8909 | 0.7538 | 0.8167 | 65 | 0.8262 | 0.7967 | 0.8112 | 0.9740 | | 0.0022 | 27.0 | 21411 | 0.2598 | 0.9160 | 0.8516 | 0.8826 | 128 | 0.8728 | 0.8935 | 0.8830 | 169 | 0.8646 | 0.7545 | 0.8058 | 110 | 0.7025 | 0.7456 | 0.7234 | 114 | 0.7660 | 0.6742 | 0.7171 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.8639 | 0.9016 | 0.8824 | 183 | 0.8833 | 0.8154 | 0.848 | 65 | 0.8305 | 0.7977 | 0.8138 | 0.9742 | | 0.0027 | 28.0 | 22204 | 0.2239 | 0.8898 | 0.8828 | 0.8863 | 128 | 0.8817 | 0.8817 | 0.8817 | 169 | 0.8333 | 0.7727 | 0.8019 | 110 | 0.672 | 0.7368 | 0.7029 | 114 | 0.7216 | 0.6891 | 0.7050 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.8956 | 0.8907 | 0.8932 | 183 | 0.8462 | 0.8462 | 0.8462 | 65 | 0.8130 | 0.8044 | 0.8087 | 0.9743 | | 0.0028 | 29.0 | 22997 | 0.2268 | 0.8889 | 0.875 | 0.8819 | 128 | 0.8772 | 0.8876 | 0.8824 | 169 | 0.8119 | 0.7455 | 0.7773 | 110 | 0.6667 | 0.7368 | 0.7 | 114 | 0.7245 | 0.7191 | 0.7218 | 267 | 0.5 | 1.0 | 0.6667 | 2 | 0.8865 | 0.8962 | 0.8913 | 183 | 0.7761 | 0.8 | 0.7879 | 65 | 0.8019 | 0.8073 | 0.8046 | 0.9742 | | 0.0023 | 30.0 | 23790 | 0.2654 | 0.9113 | 0.8828 | 0.8968 | 128 | 0.8935 | 0.8935 | 0.8935 | 169 | 0.82 | 0.7455 | 0.7810 | 110 | 0.6444 | 0.7632 | 0.6988 | 114 | 0.7570 | 0.7116 | 0.7336 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.8649 | 0.8743 | 0.8696 | 183 | 0.8305 | 0.7538 | 0.7903 | 65 | 0.8137 | 0.8035 | 0.8085 | 0.9737 | | 0.0018 | 31.0 | 24583 | 0.2678 | 0.9024 | 0.8672 | 0.8845 | 128 | 0.8824 | 0.8876 | 0.8850 | 169 | 0.8039 | 0.7455 | 0.7736 | 110 | 0.5503 | 0.7193 | 0.6236 | 114 | 0.7015 | 0.7041 | 0.7028 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.8653 | 0.9126 | 0.8883 | 183 | 0.8793 | 0.7846 | 0.8293 | 65 | 0.7822 | 0.8025 | 0.7922 | 0.9717 | | 0.0018 | 32.0 | 25376 | 0.2460 | 0.9174 | 0.8672 | 0.8916 | 128 | 0.8988 | 0.8935 | 0.8961 | 169 | 0.8224 | 0.8 | 0.8111 | 110 | 0.6860 | 0.7281 | 0.7064 | 114 | 0.7542 | 0.6779 | 0.7140 | 267 | 1.0 | 0.5 | 0.6667 | 2 | 0.8994 | 0.8798 | 0.8895 | 183 | 0.8448 | 0.7538 | 0.7967 | 65 | 0.8291 | 0.7948 | 0.8116 | 0.9742 | | 0.0015 | 33.0 | 26169 | 0.2474 | 0.9098 | 0.8672 | 0.888 | 128 | 0.8663 | 0.8817 | 0.8739 | 169 | 0.8131 | 0.7909 | 0.8018 | 110 | 0.7 | 0.7368 | 0.7179 | 114 | 0.7214 | 0.7079 | 0.7146 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.8817 | 0.8962 | 0.8889 | 183 | 0.7937 | 0.7692 | 0.7813 | 65 | 0.8085 | 0.8054 | 0.8069 | 0.9739 | | 0.0006 | 34.0 | 26962 | 0.2690 | 0.9024 | 0.8672 | 0.8845 | 128 | 0.8844 | 0.9053 | 0.8947 | 169 | 0.8315 | 0.6727 | 0.7437 | 110 | 0.6667 | 0.7368 | 0.7 | 114 | 0.7391 | 0.7004 | 0.7192 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.8870 | 0.8579 | 0.8722 | 183 | 0.8889 | 0.7385 | 0.8067 | 65 | 0.8185 | 0.7861 | 0.8020 | 0.9735 | | 0.0038 | 35.0 | 27755 | 0.2565 | 0.912 | 0.8906 | 0.9012 | 128 | 0.8786 | 0.8994 | 0.8889 | 169 | 0.7757 | 0.7545 | 0.7650 | 110 | 0.6562 | 0.7368 | 0.6942 | 114 | 0.6794 | 0.7303 | 0.7040 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.8962 | 0.8962 | 0.8962 | 183 | 0.8 | 0.8 | 0.8000 | 65 | 0.7907 | 0.8150 | 0.8027 | 0.9730 | | 0.0008 | 36.0 | 28548 | 0.2583 | 0.8943 | 0.8594 | 0.8765 | 128 | 0.8655 | 0.8757 | 0.8706 | 169 | 0.7607 | 0.8091 | 0.7841 | 110 | 0.6829 | 0.7368 | 0.7089 | 114 | 0.7266 | 0.7266 | 0.7266 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.8889 | 0.9180 | 0.9032 | 183 | 0.8125 | 0.8 | 0.8062 | 65 | 0.8021 | 0.8160 | 0.8090 | 0.9733 | | 0.0008 | 37.0 | 29341 | 0.2733 | 0.8862 | 0.8516 | 0.8685 | 128 | 0.8663 | 0.8817 | 0.8739 | 169 | 0.7611 | 0.7818 | 0.7713 | 110 | 0.6324 | 0.7544 | 0.688 | 114 | 0.7148 | 0.7041 | 0.7094 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8830 | 0.9071 | 0.8949 | 183 | 0.8333 | 0.7692 | 0.8 | 65 | 0.7902 | 0.8054 | 0.7977 | 0.9729 | | 0.0013 | 38.0 | 30134 | 0.2555 | 0.9322 | 0.8594 | 0.8943 | 128 | 0.8988 | 0.8935 | 0.8961 | 169 | 0.7395 | 0.8 | 0.7686 | 110 | 0.7395 | 0.7719 | 0.7554 | 114 | 0.7308 | 0.7116 | 0.7211 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8691 | 0.9071 | 0.8877 | 183 | 0.8197 | 0.7692 | 0.7937 | 65 | 0.8133 | 0.8141 | 0.8137 | 0.9744 | | 0.0003 | 39.0 | 30927 | 0.2683 | 0.9174 | 0.8672 | 0.8916 | 128 | 0.8882 | 0.8935 | 0.8909 | 169 | 0.8190 | 0.7818 | 0.8000 | 110 | 0.6718 | 0.7719 | 0.7184 | 114 | 0.7154 | 0.7154 | 0.7154 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.9022 | 0.9071 | 0.9046 | 183 | 0.8772 | 0.7692 | 0.8197 | 65 | 0.8149 | 0.8141 | 0.8145 | 0.9744 | | 0.0004 | 40.0 | 31720 | 0.2727 | 0.8889 | 0.875 | 0.8819 | 128 | 0.8817 | 0.8817 | 0.8817 | 169 | 0.8469 | 0.7545 | 0.7981 | 110 | 0.6822 | 0.7719 | 0.7243 | 114 | 0.7041 | 0.7041 | 0.7041 | 267 | 1.0 | 1.0 | 1.0 | 2 | 0.8883 | 0.9126 | 0.9003 | 183 | 0.8793 | 0.7846 | 0.8293 | 65 | 0.8100 | 0.8092 | 0.8096 | 0.9745 | | 0.0005 | 41.0 | 32513 | 0.2607 | 0.9106 | 0.875 | 0.8924 | 128 | 0.8629 | 0.8935 | 0.8779 | 169 | 0.8737 | 0.7545 | 0.8098 | 110 | 0.6953 | 0.7807 | 0.7355 | 114 | 0.7154 | 0.6966 | 0.7059 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8743 | 0.9126 | 0.8930 | 183 | 0.8125 | 0.8 | 0.8062 | 65 | 0.8104 | 0.8112 | 0.8108 | 0.9743 | | 0.0007 | 42.0 | 33306 | 0.2628 | 0.9106 | 0.875 | 0.8924 | 128 | 0.8678 | 0.8935 | 0.8805 | 169 | 0.8119 | 0.7455 | 0.7773 | 110 | 0.6899 | 0.7807 | 0.7325 | 114 | 0.6985 | 0.7116 | 0.7050 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8730 | 0.9016 | 0.8871 | 183 | 0.8254 | 0.8 | 0.8125 | 65 | 0.7998 | 0.8121 | 0.8059 | 0.9744 | | 0.0004 | 43.0 | 34099 | 0.2784 | 0.9098 | 0.8672 | 0.888 | 128 | 0.8994 | 0.8994 | 0.8994 | 169 | 0.8542 | 0.7455 | 0.7961 | 110 | 0.696 | 0.7632 | 0.7280 | 114 | 0.7127 | 0.7154 | 0.7140 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8925 | 0.9071 | 0.8997 | 183 | 0.8281 | 0.8154 | 0.8217 | 65 | 0.8170 | 0.8131 | 0.8151 | 0.9743 | | 0.0004 | 44.0 | 34892 | 0.2771 | 0.9098 | 0.8672 | 0.888 | 128 | 0.8941 | 0.8994 | 0.8968 | 169 | 0.8586 | 0.7727 | 0.8134 | 110 | 0.7049 | 0.7544 | 0.7288 | 114 | 0.7231 | 0.7041 | 0.7135 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8919 | 0.9016 | 0.8967 | 183 | 0.8154 | 0.8154 | 0.8154 | 65 | 0.8207 | 0.8112 | 0.8159 | 0.9745 | | 0.0003 | 45.0 | 35685 | 0.2756 | 0.9180 | 0.875 | 0.8960 | 128 | 0.8941 | 0.8994 | 0.8968 | 169 | 0.8673 | 0.7727 | 0.8173 | 110 | 0.7097 | 0.7719 | 0.7395 | 114 | 0.7159 | 0.7079 | 0.7119 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8978 | 0.9126 | 0.9051 | 183 | 0.8644 | 0.7846 | 0.8226 | 65 | 0.8246 | 0.8150 | 0.8198 | 0.9749 | | 0.0005 | 46.0 | 36478 | 0.2739 | 0.9180 | 0.875 | 0.8960 | 128 | 0.8941 | 0.8994 | 0.8968 | 169 | 0.8333 | 0.7727 | 0.8019 | 110 | 0.6667 | 0.7719 | 0.7154 | 114 | 0.7011 | 0.7116 | 0.7063 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8698 | 0.9126 | 0.8907 | 183 | 0.8226 | 0.7846 | 0.8031 | 65 | 0.8036 | 0.8160 | 0.8098 | 0.9747 | | 0.0001 | 47.0 | 37271 | 0.2774 | 0.9180 | 0.875 | 0.8960 | 128 | 0.8941 | 0.8994 | 0.8968 | 169 | 0.85 | 0.7727 | 0.8095 | 110 | 0.6667 | 0.7719 | 0.7154 | 114 | 0.7127 | 0.7154 | 0.7140 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.9061 | 0.8962 | 0.9011 | 183 | 0.8226 | 0.7846 | 0.8031 | 65 | 0.8141 | 0.8141 | 0.8141 | 0.9747 | | 0.0002 | 48.0 | 38064 | 0.2768 | 0.9180 | 0.875 | 0.8960 | 128 | 0.8941 | 0.8994 | 0.8968 | 169 | 0.85 | 0.7727 | 0.8095 | 110 | 0.6718 | 0.7719 | 0.7184 | 114 | 0.7159 | 0.7266 | 0.7212 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8967 | 0.9016 | 0.8992 | 183 | 0.8254 | 0.8 | 0.8125 | 65 | 0.8142 | 0.8189 | 0.8165 | 0.9754 | | 0.0001 | 49.0 | 38857 | 0.2778 | 0.9180 | 0.875 | 0.8960 | 128 | 0.8941 | 0.8994 | 0.8968 | 169 | 0.8416 | 0.7727 | 0.8057 | 110 | 0.6718 | 0.7719 | 0.7184 | 114 | 0.7159 | 0.7266 | 0.7212 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8967 | 0.9016 | 0.8992 | 183 | 0.8254 | 0.8 | 0.8125 | 65 | 0.8134 | 0.8189 | 0.8161 | 0.9753 | | 0.0003 | 50.0 | 39650 | 0.2778 | 0.9180 | 0.875 | 0.8960 | 128 | 0.8941 | 0.8994 | 0.8968 | 169 | 0.8431 | 0.7818 | 0.8113 | 110 | 0.6718 | 0.7719 | 0.7184 | 114 | 0.7159 | 0.7266 | 0.7212 | 267 | 0.6667 | 1.0 | 0.8 | 2 | 0.8967 | 0.9016 | 0.8992 | 183 | 0.8254 | 0.8 | 0.8125 | 65 | 0.8136 | 0.8198 | 0.8167 | 0.9753 | ### Framework versions - Transformers 4.25.0.dev0 - Pytorch 1.12.1+cu113 - Datasets 2.2.2 - Tokenizers 0.13.2