Edit model card

lmv2-g-receipts2

This model is a fine-tuned version of microsoft/layoutlmv2-base-uncased on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.2756
  • Purchase Time Precision: 0.9180
  • Purchase Time Recall: 0.875
  • Purchase Time F1: 0.8960
  • Purchase Time Number: 128
  • Receipt Date Precision: 0.8941
  • Receipt Date Recall: 0.8994
  • Receipt Date F1: 0.8968
  • Receipt Date Number: 169
  • Sub Total Precision: 0.8673
  • Sub Total Recall: 0.7727
  • Sub Total F1: 0.8173
  • Sub Total Number: 110
  • Supplier Address Precision: 0.7097
  • Supplier Address Recall: 0.7719
  • Supplier Address F1: 0.7395
  • Supplier Address Number: 114
  • Supplier Name Precision: 0.7159
  • Supplier Name Recall: 0.7079
  • Supplier Name F1: 0.7119
  • Supplier Name Number: 267
  • Tip Amount Precision: 0.6667
  • Tip Amount Recall: 1.0
  • Tip Amount F1: 0.8
  • Tip Amount Number: 2
  • Total Precision: 0.8978
  • Total Recall: 0.9126
  • Total F1: 0.9051
  • Total Number: 183
  • Total Tax Amount Precision: 0.8644
  • Total Tax Amount Recall: 0.7846
  • Total Tax Amount F1: 0.8226
  • Total Tax Amount Number: 65
  • Overall Precision: 0.8246
  • Overall Recall: 0.8150
  • Overall F1: 0.8198
  • Overall Accuracy: 0.9749

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 3e-05
  • train_batch_size: 1
  • eval_batch_size: 1
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 50

Training results

Training Loss Epoch Step Validation Loss Purchase Time Precision Purchase Time Recall Purchase Time F1 Purchase Time Number Receipt Date Precision Receipt Date Recall Receipt Date F1 Receipt Date Number Sub Total Precision Sub Total Recall Sub Total F1 Sub Total Number Supplier Address Precision Supplier Address Recall Supplier Address F1 Supplier Address Number Supplier Name Precision Supplier Name Recall Supplier Name F1 Supplier Name Number Tip Amount Precision Tip Amount Recall Tip Amount F1 Tip Amount Number Total Precision Total Recall Total F1 Total Number Total Tax Amount Precision Total Tax Amount Recall Total Tax Amount F1 Total Tax Amount Number Overall Precision Overall Recall Overall F1 Overall Accuracy
0.972 1.0 793 0.4257 0.3830 0.1406 0.2057 128 0.0 0.0 0.0 169 0.0 0.0 0.0 110 0.3973 0.5088 0.4462 114 0.5263 0.3745 0.4376 267 0.0 0.0 0.0 2 0.4096 0.7923 0.5400 183 0.0 0.0 0.0 65 0.4355 0.3092 0.3617 0.9296
0.2924 2.0 1586 0.2379 0.9259 0.7812 0.8475 128 0.8182 0.7456 0.7802 169 0.8966 0.2364 0.3741 110 0.5571 0.6842 0.6142 114 0.6584 0.5993 0.6275 267 0.0 0.0 0.0 2 0.7042 0.8197 0.7576 183 1.0 0.0462 0.0882 65 0.7225 0.6195 0.6670 0.9630
0.1611 3.0 2379 0.1756 0.8138 0.9219 0.8645 128 0.8020 0.9349 0.8634 169 0.7064 0.7 0.7032 110 0.5733 0.7544 0.6515 114 0.7308 0.6404 0.6826 267 0.0 0.0 0.0 2 0.8057 0.7705 0.7877 183 0.7258 0.6923 0.7087 65 0.7425 0.7669 0.7545 0.9670
0.1013 4.0 3172 0.1557 0.9099 0.7891 0.8452 128 0.8659 0.8402 0.8529 169 0.8493 0.5636 0.6776 110 0.5970 0.7018 0.6452 114 0.6603 0.6479 0.6541 267 0.0 0.0 0.0 2 0.8371 0.8142 0.8255 183 0.8654 0.6923 0.7692 65 0.7721 0.7245 0.7475 0.9692
0.0684 5.0 3965 0.1623 0.7718 0.8984 0.8303 128 0.7949 0.9172 0.8516 169 0.7131 0.7909 0.75 110 0.5705 0.7807 0.6593 114 0.6887 0.6629 0.6756 267 0.0 0.0 0.0 2 0.8392 0.9126 0.8743 183 0.5816 0.8769 0.6994 65 0.7202 0.8160 0.7651 0.9661
0.0491 6.0 4758 0.1828 0.9008 0.8516 0.8755 128 0.8830 0.8935 0.8882 169 0.6846 0.8091 0.7417 110 0.5062 0.7105 0.5912 114 0.6729 0.6779 0.6754 267 0.0 0.0 0.0 2 0.8807 0.8470 0.8635 183 0.7361 0.8154 0.7737 65 0.7452 0.7890 0.7665 0.9673
0.043 7.0 5551 0.1825 0.9237 0.8516 0.8862 128 0.8807 0.9172 0.8986 169 0.7672 0.8091 0.7876 110 0.6279 0.7105 0.6667 114 0.7788 0.6330 0.6983 267 0.0 0.0 0.0 2 0.9045 0.8798 0.8920 183 0.6867 0.8769 0.7703 65 0.8073 0.7909 0.7990 0.9717
0.0325 8.0 6344 0.1645 0.875 0.875 0.875 128 0.8636 0.8994 0.8812 169 0.7288 0.7818 0.7544 110 0.6241 0.7719 0.6902 114 0.7085 0.7191 0.7138 267 0.0 0.0 0.0 2 0.8367 0.8962 0.8654 183 0.6344 0.9077 0.7468 65 0.7596 0.8218 0.7894 0.9711
0.0276 9.0 7137 0.1761 0.9160 0.8516 0.8826 128 0.8706 0.8757 0.8732 169 0.8861 0.6364 0.7407 110 0.6045 0.7105 0.6532 114 0.6689 0.7416 0.7034 267 0.0 0.0 0.0 2 0.8299 0.8798 0.8541 183 0.9268 0.5846 0.7170 65 0.7793 0.7755 0.7774 0.9705
0.0237 10.0 7930 0.1842 0.8473 0.8672 0.8571 128 0.8613 0.8817 0.8713 169 0.7607 0.8091 0.7841 110 0.6569 0.7895 0.7171 114 0.7189 0.6704 0.6938 267 0.0 0.0 0.0 2 0.8729 0.8634 0.8681 183 0.7794 0.8154 0.7970 65 0.7850 0.7987 0.7918 0.9709
0.0229 11.0 8723 0.1811 0.9167 0.8594 0.8871 128 0.8929 0.8876 0.8902 169 0.75 0.7909 0.7699 110 0.6 0.7368 0.6614 114 0.6958 0.6854 0.6906 267 1.0 0.5 0.6667 2 0.8639 0.9016 0.8824 183 0.8525 0.8 0.8254 65 0.7849 0.8015 0.7931 0.9713
0.017 12.0 9516 0.2075 0.8906 0.8906 0.8906 128 0.7727 0.9053 0.8338 169 0.8218 0.7545 0.7867 110 0.6042 0.7632 0.6744 114 0.6830 0.6779 0.6805 267 1.0 0.5 0.6667 2 0.8429 0.8798 0.8610 183 0.8281 0.8154 0.8217 65 0.7628 0.8025 0.7822 0.9696
0.0149 13.0 10309 0.1781 0.8760 0.8828 0.8794 128 0.8786 0.8994 0.8889 169 0.8660 0.7636 0.8116 110 0.6357 0.7193 0.6749 114 0.7154 0.6779 0.6962 267 0.5 1.0 0.6667 2 0.9138 0.8689 0.8908 183 0.8793 0.7846 0.8293 65 0.8102 0.7938 0.8019 0.9738
0.0124 14.0 11102 0.1957 0.9106 0.875 0.8924 128 0.8629 0.8935 0.8779 169 0.8586 0.7727 0.8134 110 0.5909 0.7982 0.6791 114 0.6823 0.7079 0.6949 267 1.0 0.5 0.6667 2 0.9191 0.8689 0.8933 183 0.8030 0.8154 0.8092 65 0.7875 0.8102 0.7987 0.9729
0.01 15.0 11895 0.2174 0.9098 0.8672 0.888 128 0.8817 0.8817 0.8817 169 0.8298 0.7091 0.7647 110 0.6587 0.7281 0.6917 114 0.6842 0.6816 0.6829 267 1.0 1.0 1.0 2 0.875 0.8798 0.8774 183 0.9783 0.6923 0.8108 65 0.8038 0.7813 0.7924 0.9726
0.0102 16.0 12688 0.2073 0.9106 0.875 0.8924 128 0.8276 0.8521 0.8397 169 0.7679 0.7818 0.7748 110 0.6378 0.7105 0.6722 114 0.6806 0.6704 0.6755 267 0.6667 1.0 0.8 2 0.8717 0.8907 0.8811 183 0.6962 0.8462 0.7639 65 0.7697 0.7919 0.7806 0.9705
0.0091 17.0 13481 0.2205 0.8358 0.875 0.8550 128 0.8306 0.8994 0.8636 169 0.6133 0.8364 0.7077 110 0.5944 0.7456 0.6615 114 0.6833 0.7191 0.7007 267 0.6667 1.0 0.8 2 0.8410 0.8962 0.8677 183 0.7297 0.8308 0.7770 65 0.7334 0.8218 0.7751 0.9680
0.0063 18.0 14274 0.2007 0.8527 0.8594 0.8560 128 0.8613 0.8817 0.8713 169 0.8283 0.7455 0.7847 110 0.6535 0.7281 0.6888 114 0.7520 0.6929 0.7212 267 1.0 1.0 1.0 2 0.8730 0.9016 0.8871 183 0.7432 0.8462 0.7914 65 0.7998 0.8006 0.8002 0.9719
0.0075 19.0 15067 0.2173 0.925 0.8672 0.8952 128 0.8765 0.8817 0.8791 169 0.8113 0.7818 0.7963 110 0.7196 0.6754 0.6968 114 0.6982 0.7191 0.7085 267 1.0 0.5 0.6667 2 0.9080 0.8634 0.8852 183 0.8833 0.8154 0.848 65 0.8164 0.7967 0.8064 0.9733
0.0062 20.0 15860 0.2255 0.888 0.8672 0.8775 128 0.8613 0.8817 0.8713 169 0.9048 0.6909 0.7835 110 0.6718 0.7719 0.7184 114 0.7552 0.6816 0.7165 267 1.0 0.5 0.6667 2 0.9017 0.8525 0.8764 183 0.9074 0.7538 0.8235 65 0.8269 0.7823 0.8040 0.9733
0.0063 21.0 16653 0.2417 0.8952 0.8672 0.8810 128 0.8453 0.9053 0.8743 169 0.84 0.7636 0.8000 110 0.6917 0.7281 0.7094 114 0.7194 0.6816 0.7 267 0.6667 1.0 0.8 2 0.8901 0.8852 0.8877 183 0.7937 0.7692 0.7813 65 0.8060 0.7967 0.8014 0.9721
0.0045 22.0 17446 0.2069 0.8626 0.8828 0.8726 128 0.8830 0.8935 0.8882 169 0.7679 0.7818 0.7748 110 0.6462 0.7368 0.6885 114 0.7045 0.6966 0.7006 267 0.5 1.0 0.6667 2 0.8914 0.8525 0.8715 183 0.7361 0.8154 0.7737 65 0.7847 0.8006 0.7926 0.9721
0.0044 23.0 18239 0.2675 0.8760 0.8828 0.8794 128 0.8721 0.8876 0.8798 169 0.8155 0.7636 0.7887 110 0.6864 0.7105 0.6983 114 0.7588 0.6479 0.6990 267 1.0 1.0 1.0 2 0.8983 0.8689 0.8833 183 0.7714 0.8308 0.8 65 0.8168 0.7861 0.8012 0.9711
0.0037 24.0 19032 0.2294 0.9032 0.875 0.8889 128 0.8848 0.8639 0.8743 169 0.8283 0.7455 0.7847 110 0.7097 0.7719 0.7395 114 0.6866 0.6891 0.6879 267 0.6667 1.0 0.8 2 0.8950 0.8852 0.8901 183 0.7826 0.8308 0.8060 65 0.8035 0.7996 0.8015 0.9733
0.0028 25.0 19825 0.2435 0.9310 0.8438 0.8852 128 0.8398 0.8994 0.8686 169 0.7870 0.7727 0.7798 110 0.5959 0.7632 0.6692 114 0.6679 0.6929 0.6801 267 0.5 1.0 0.6667 2 0.8601 0.9071 0.8830 183 0.7179 0.8615 0.7832 65 0.7625 0.8102 0.7856 0.9712
0.0031 26.0 20618 0.2441 0.9160 0.8516 0.8826 128 0.9036 0.8876 0.8955 169 0.8925 0.7545 0.8177 110 0.6667 0.7368 0.7 114 0.7323 0.6966 0.7140 267 1.0 1.0 1.0 2 0.8817 0.8962 0.8889 183 0.8909 0.7538 0.8167 65 0.8262 0.7967 0.8112 0.9740
0.0022 27.0 21411 0.2598 0.9160 0.8516 0.8826 128 0.8728 0.8935 0.8830 169 0.8646 0.7545 0.8058 110 0.7025 0.7456 0.7234 114 0.7660 0.6742 0.7171 267 1.0 1.0 1.0 2 0.8639 0.9016 0.8824 183 0.8833 0.8154 0.848 65 0.8305 0.7977 0.8138 0.9742
0.0027 28.0 22204 0.2239 0.8898 0.8828 0.8863 128 0.8817 0.8817 0.8817 169 0.8333 0.7727 0.8019 110 0.672 0.7368 0.7029 114 0.7216 0.6891 0.7050 267 1.0 1.0 1.0 2 0.8956 0.8907 0.8932 183 0.8462 0.8462 0.8462 65 0.8130 0.8044 0.8087 0.9743
0.0028 29.0 22997 0.2268 0.8889 0.875 0.8819 128 0.8772 0.8876 0.8824 169 0.8119 0.7455 0.7773 110 0.6667 0.7368 0.7 114 0.7245 0.7191 0.7218 267 0.5 1.0 0.6667 2 0.8865 0.8962 0.8913 183 0.7761 0.8 0.7879 65 0.8019 0.8073 0.8046 0.9742
0.0023 30.0 23790 0.2654 0.9113 0.8828 0.8968 128 0.8935 0.8935 0.8935 169 0.82 0.7455 0.7810 110 0.6444 0.7632 0.6988 114 0.7570 0.7116 0.7336 267 1.0 1.0 1.0 2 0.8649 0.8743 0.8696 183 0.8305 0.7538 0.7903 65 0.8137 0.8035 0.8085 0.9737
0.0018 31.0 24583 0.2678 0.9024 0.8672 0.8845 128 0.8824 0.8876 0.8850 169 0.8039 0.7455 0.7736 110 0.5503 0.7193 0.6236 114 0.7015 0.7041 0.7028 267 1.0 1.0 1.0 2 0.8653 0.9126 0.8883 183 0.8793 0.7846 0.8293 65 0.7822 0.8025 0.7922 0.9717
0.0018 32.0 25376 0.2460 0.9174 0.8672 0.8916 128 0.8988 0.8935 0.8961 169 0.8224 0.8 0.8111 110 0.6860 0.7281 0.7064 114 0.7542 0.6779 0.7140 267 1.0 0.5 0.6667 2 0.8994 0.8798 0.8895 183 0.8448 0.7538 0.7967 65 0.8291 0.7948 0.8116 0.9742
0.0015 33.0 26169 0.2474 0.9098 0.8672 0.888 128 0.8663 0.8817 0.8739 169 0.8131 0.7909 0.8018 110 0.7 0.7368 0.7179 114 0.7214 0.7079 0.7146 267 1.0 1.0 1.0 2 0.8817 0.8962 0.8889 183 0.7937 0.7692 0.7813 65 0.8085 0.8054 0.8069 0.9739
0.0006 34.0 26962 0.2690 0.9024 0.8672 0.8845 128 0.8844 0.9053 0.8947 169 0.8315 0.6727 0.7437 110 0.6667 0.7368 0.7 114 0.7391 0.7004 0.7192 267 1.0 1.0 1.0 2 0.8870 0.8579 0.8722 183 0.8889 0.7385 0.8067 65 0.8185 0.7861 0.8020 0.9735
0.0038 35.0 27755 0.2565 0.912 0.8906 0.9012 128 0.8786 0.8994 0.8889 169 0.7757 0.7545 0.7650 110 0.6562 0.7368 0.6942 114 0.6794 0.7303 0.7040 267 1.0 1.0 1.0 2 0.8962 0.8962 0.8962 183 0.8 0.8 0.8000 65 0.7907 0.8150 0.8027 0.9730
0.0008 36.0 28548 0.2583 0.8943 0.8594 0.8765 128 0.8655 0.8757 0.8706 169 0.7607 0.8091 0.7841 110 0.6829 0.7368 0.7089 114 0.7266 0.7266 0.7266 267 1.0 1.0 1.0 2 0.8889 0.9180 0.9032 183 0.8125 0.8 0.8062 65 0.8021 0.8160 0.8090 0.9733
0.0008 37.0 29341 0.2733 0.8862 0.8516 0.8685 128 0.8663 0.8817 0.8739 169 0.7611 0.7818 0.7713 110 0.6324 0.7544 0.688 114 0.7148 0.7041 0.7094 267 0.6667 1.0 0.8 2 0.8830 0.9071 0.8949 183 0.8333 0.7692 0.8 65 0.7902 0.8054 0.7977 0.9729
0.0013 38.0 30134 0.2555 0.9322 0.8594 0.8943 128 0.8988 0.8935 0.8961 169 0.7395 0.8 0.7686 110 0.7395 0.7719 0.7554 114 0.7308 0.7116 0.7211 267 0.6667 1.0 0.8 2 0.8691 0.9071 0.8877 183 0.8197 0.7692 0.7937 65 0.8133 0.8141 0.8137 0.9744
0.0003 39.0 30927 0.2683 0.9174 0.8672 0.8916 128 0.8882 0.8935 0.8909 169 0.8190 0.7818 0.8000 110 0.6718 0.7719 0.7184 114 0.7154 0.7154 0.7154 267 1.0 1.0 1.0 2 0.9022 0.9071 0.9046 183 0.8772 0.7692 0.8197 65 0.8149 0.8141 0.8145 0.9744
0.0004 40.0 31720 0.2727 0.8889 0.875 0.8819 128 0.8817 0.8817 0.8817 169 0.8469 0.7545 0.7981 110 0.6822 0.7719 0.7243 114 0.7041 0.7041 0.7041 267 1.0 1.0 1.0 2 0.8883 0.9126 0.9003 183 0.8793 0.7846 0.8293 65 0.8100 0.8092 0.8096 0.9745
0.0005 41.0 32513 0.2607 0.9106 0.875 0.8924 128 0.8629 0.8935 0.8779 169 0.8737 0.7545 0.8098 110 0.6953 0.7807 0.7355 114 0.7154 0.6966 0.7059 267 0.6667 1.0 0.8 2 0.8743 0.9126 0.8930 183 0.8125 0.8 0.8062 65 0.8104 0.8112 0.8108 0.9743
0.0007 42.0 33306 0.2628 0.9106 0.875 0.8924 128 0.8678 0.8935 0.8805 169 0.8119 0.7455 0.7773 110 0.6899 0.7807 0.7325 114 0.6985 0.7116 0.7050 267 0.6667 1.0 0.8 2 0.8730 0.9016 0.8871 183 0.8254 0.8 0.8125 65 0.7998 0.8121 0.8059 0.9744
0.0004 43.0 34099 0.2784 0.9098 0.8672 0.888 128 0.8994 0.8994 0.8994 169 0.8542 0.7455 0.7961 110 0.696 0.7632 0.7280 114 0.7127 0.7154 0.7140 267 0.6667 1.0 0.8 2 0.8925 0.9071 0.8997 183 0.8281 0.8154 0.8217 65 0.8170 0.8131 0.8151 0.9743
0.0004 44.0 34892 0.2771 0.9098 0.8672 0.888 128 0.8941 0.8994 0.8968 169 0.8586 0.7727 0.8134 110 0.7049 0.7544 0.7288 114 0.7231 0.7041 0.7135 267 0.6667 1.0 0.8 2 0.8919 0.9016 0.8967 183 0.8154 0.8154 0.8154 65 0.8207 0.8112 0.8159 0.9745
0.0003 45.0 35685 0.2756 0.9180 0.875 0.8960 128 0.8941 0.8994 0.8968 169 0.8673 0.7727 0.8173 110 0.7097 0.7719 0.7395 114 0.7159 0.7079 0.7119 267 0.6667 1.0 0.8 2 0.8978 0.9126 0.9051 183 0.8644 0.7846 0.8226 65 0.8246 0.8150 0.8198 0.9749
0.0005 46.0 36478 0.2739 0.9180 0.875 0.8960 128 0.8941 0.8994 0.8968 169 0.8333 0.7727 0.8019 110 0.6667 0.7719 0.7154 114 0.7011 0.7116 0.7063 267 0.6667 1.0 0.8 2 0.8698 0.9126 0.8907 183 0.8226 0.7846 0.8031 65 0.8036 0.8160 0.8098 0.9747
0.0001 47.0 37271 0.2774 0.9180 0.875 0.8960 128 0.8941 0.8994 0.8968 169 0.85 0.7727 0.8095 110 0.6667 0.7719 0.7154 114 0.7127 0.7154 0.7140 267 0.6667 1.0 0.8 2 0.9061 0.8962 0.9011 183 0.8226 0.7846 0.8031 65 0.8141 0.8141 0.8141 0.9747
0.0002 48.0 38064 0.2768 0.9180 0.875 0.8960 128 0.8941 0.8994 0.8968 169 0.85 0.7727 0.8095 110 0.6718 0.7719 0.7184 114 0.7159 0.7266 0.7212 267 0.6667 1.0 0.8 2 0.8967 0.9016 0.8992 183 0.8254 0.8 0.8125 65 0.8142 0.8189 0.8165 0.9754
0.0001 49.0 38857 0.2778 0.9180 0.875 0.8960 128 0.8941 0.8994 0.8968 169 0.8416 0.7727 0.8057 110 0.6718 0.7719 0.7184 114 0.7159 0.7266 0.7212 267 0.6667 1.0 0.8 2 0.8967 0.9016 0.8992 183 0.8254 0.8 0.8125 65 0.8134 0.8189 0.8161 0.9753
0.0003 50.0 39650 0.2778 0.9180 0.875 0.8960 128 0.8941 0.8994 0.8968 169 0.8431 0.7818 0.8113 110 0.6718 0.7719 0.7184 114 0.7159 0.7266 0.7212 267 0.6667 1.0 0.8 2 0.8967 0.9016 0.8992 183 0.8254 0.8 0.8125 65 0.8136 0.8198 0.8167 0.9753

Framework versions

  • Transformers 4.25.0.dev0
  • Pytorch 1.12.1+cu113
  • Datasets 2.2.2
  • Tokenizers 0.13.2
Downloads last month
17