Edit model card

lmv2-g-receipts3

This model is a fine-tuned version of microsoft/layoutlmv2-large-uncased on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.2709
  • Purchase Time Precision: 0.8976
  • Purchase Time Recall: 0.8906
  • Purchase Time F1: 0.8941
  • Purchase Time Number: 128
  • Receipt Date Precision: 0.9064
  • Receipt Date Recall: 0.9172
  • Receipt Date F1: 0.9118
  • Receipt Date Number: 169
  • Sub Total Precision: 0.8167
  • Sub Total Recall: 0.8909
  • Sub Total F1: 0.8522
  • Sub Total Number: 110
  • Supplier Address Precision: 0.7227
  • Supplier Address Recall: 0.7544
  • Supplier Address F1: 0.7382
  • Supplier Address Number: 114
  • Supplier Name Precision: 0.7556
  • Supplier Name Recall: 0.7640
  • Supplier Name F1: 0.7598
  • Supplier Name Number: 267
  • Tip Amount Precision: 1.0
  • Tip Amount Recall: 1.0
  • Tip Amount F1: 1.0
  • Tip Amount Number: 2
  • Total Precision: 0.9405
  • Total Recall: 0.8634
  • Total F1: 0.9003
  • Total Number: 183
  • Total Tax Amount Precision: 0.9138
  • Total Tax Amount Recall: 0.8154
  • Total Tax Amount F1: 0.8618
  • Total Tax Amount Number: 65
  • Overall Precision: 0.8406
  • Overall Recall: 0.8382
  • Overall F1: 0.8394
  • Overall Accuracy: 0.9771

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 1e-05
  • train_batch_size: 1
  • eval_batch_size: 1
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 50

Training results

Training Loss Epoch Step Validation Loss Purchase Time Precision Purchase Time Recall Purchase Time F1 Purchase Time Number Receipt Date Precision Receipt Date Recall Receipt Date F1 Receipt Date Number Sub Total Precision Sub Total Recall Sub Total F1 Sub Total Number Supplier Address Precision Supplier Address Recall Supplier Address F1 Supplier Address Number Supplier Name Precision Supplier Name Recall Supplier Name F1 Supplier Name Number Tip Amount Precision Tip Amount Recall Tip Amount F1 Tip Amount Number Total Precision Total Recall Total F1 Total Number Total Tax Amount Precision Total Tax Amount Recall Total Tax Amount F1 Total Tax Amount Number Overall Precision Overall Recall Overall F1 Overall Accuracy
0.2395 1.0 793 0.1693 0.8712 0.8984 0.8846 128 0.8398 0.8994 0.8686 169 0.8247 0.7273 0.7729 110 0.5621 0.7544 0.6442 114 0.6822 0.6592 0.6705 267 0.0 0.0 0.0 2 0.8242 0.8197 0.8219 183 0.5185 0.8615 0.6474 65 0.7336 0.7852 0.7585 0.9653
0.0927 2.0 1586 0.1365 0.8406 0.9062 0.8722 128 0.8827 0.9349 0.9080 169 0.8866 0.7818 0.8309 110 0.5968 0.6491 0.6218 114 0.7027 0.6816 0.6920 267 0.0 0.0 0.0 2 0.7788 0.8852 0.8286 183 0.7237 0.8462 0.7801 65 0.7706 0.8025 0.7862 0.9733
0.0596 3.0 2379 0.1552 0.9048 0.8906 0.8976 128 0.8548 0.9408 0.8958 169 0.776 0.8818 0.8255 110 0.6443 0.8421 0.7300 114 0.6945 0.7154 0.7048 267 0.0 0.0 0.0 2 0.7814 0.9180 0.8442 183 0.8571 0.8308 0.8438 65 0.7717 0.8468 0.8075 0.9728
0.0476 4.0 3172 0.1411 0.888 0.8672 0.8775 128 0.8941 0.8994 0.8968 169 0.8017 0.8818 0.8398 110 0.6479 0.8070 0.7188 114 0.7287 0.7041 0.7162 267 0.0 0.0 0.0 2 0.8564 0.8798 0.8679 183 0.7778 0.8615 0.8175 65 0.7965 0.8256 0.8108 0.9765
0.0324 5.0 3965 0.1766 0.8992 0.9062 0.9027 128 0.8933 0.9408 0.9164 169 0.8319 0.8545 0.8430 110 0.6769 0.7719 0.7213 114 0.7530 0.6966 0.7237 267 1.0 1.0 1.0 2 0.8049 0.9016 0.8505 183 0.7778 0.8615 0.8175 65 0.8048 0.8343 0.8193 0.9765
0.0273 6.0 4758 0.2100 0.9062 0.9062 0.9062 128 0.8920 0.9290 0.9101 169 0.8455 0.8455 0.8455 110 0.6567 0.7719 0.7097 114 0.744 0.6966 0.7195 267 1.0 1.0 1.0 2 0.8842 0.9180 0.9008 183 0.7639 0.8462 0.8029 65 0.8145 0.8333 0.8238 0.9752
0.0207 7.0 5551 0.1994 0.925 0.8672 0.8952 128 0.8533 0.9290 0.8895 169 0.8679 0.8364 0.8519 110 0.5696 0.7895 0.6618 114 0.8050 0.7266 0.7638 267 1.0 1.0 1.0 2 0.8730 0.9016 0.8871 183 0.8594 0.8462 0.8527 65 0.8139 0.8343 0.8240 0.9748
0.0172 8.0 6344 0.1989 0.8846 0.8984 0.8915 128 0.8674 0.9290 0.8971 169 0.8158 0.8455 0.8304 110 0.6940 0.8158 0.75 114 0.7366 0.7228 0.7297 267 1.0 1.0 1.0 2 0.8737 0.9071 0.8901 183 0.7733 0.8923 0.8286 65 0.8061 0.8449 0.8250 0.9776
0.0153 9.0 7137 0.2238 0.8636 0.8906 0.8769 128 0.8674 0.9290 0.8971 169 0.8679 0.8364 0.8519 110 0.6438 0.8246 0.7231 114 0.7153 0.7341 0.7246 267 1.0 1.0 1.0 2 0.8490 0.8907 0.8693 183 0.8358 0.8615 0.8485 65 0.7945 0.8420 0.8176 0.9744
0.0099 10.0 7930 0.2257 0.912 0.8906 0.9012 128 0.9080 0.9349 0.9213 169 0.8304 0.8455 0.8378 110 0.6667 0.7544 0.7078 114 0.7444 0.7416 0.7430 267 1.0 1.0 1.0 2 0.8865 0.8962 0.8913 183 0.8438 0.8308 0.8372 65 0.8221 0.8372 0.8296 0.9779
0.0093 11.0 8723 0.2294 0.8760 0.8828 0.8794 128 0.8722 0.9290 0.8997 169 0.8462 0.8 0.8224 110 0.7287 0.8246 0.7737 114 0.7481 0.7453 0.7467 267 1.0 1.0 1.0 2 0.8703 0.8798 0.875 183 0.8056 0.8923 0.8467 65 0.8172 0.8401 0.8285 0.9767
0.0086 12.0 9516 0.2368 0.9 0.9141 0.9070 128 0.8864 0.9231 0.9043 169 0.8378 0.8455 0.8416 110 0.7876 0.7807 0.7841 114 0.764 0.7154 0.7389 267 1.0 1.0 1.0 2 0.8610 0.8798 0.8703 183 0.8667 0.8 0.832 65 0.8367 0.8295 0.8331 0.9771
0.0082 13.0 10309 0.2524 0.8915 0.8984 0.8949 128 0.8807 0.9172 0.8986 169 0.8835 0.8273 0.8545 110 0.736 0.8070 0.7699 114 0.7138 0.7191 0.7164 267 1.0 1.0 1.0 2 0.8594 0.9016 0.88 183 0.6988 0.8923 0.7838 65 0.8063 0.8382 0.8219 0.9757
0.0067 14.0 11102 0.2444 0.9062 0.9062 0.9062 128 0.8870 0.9290 0.9075 169 0.8407 0.8636 0.8520 110 0.7023 0.8070 0.7510 114 0.7196 0.7303 0.7249 267 1.0 1.0 1.0 2 0.8804 0.8852 0.8828 183 0.8028 0.8769 0.8382 65 0.8134 0.8439 0.8284 0.9762
0.0065 15.0 11895 0.2598 0.9048 0.8906 0.8976 128 0.8626 0.9290 0.8946 169 0.8624 0.8545 0.8584 110 0.6454 0.7982 0.7137 114 0.6814 0.7528 0.7153 267 1.0 1.0 1.0 2 0.8763 0.8907 0.8835 183 0.8730 0.8462 0.8594 65 0.7944 0.8449 0.8189 0.9746
0.0067 16.0 12688 0.2483 0.8992 0.9062 0.9027 128 0.8857 0.9172 0.9012 169 0.8585 0.8273 0.8426 110 0.7381 0.8158 0.775 114 0.7348 0.7266 0.7307 267 1.0 1.0 1.0 2 0.8870 0.8579 0.8722 183 0.8889 0.8615 0.8750 65 0.8292 0.8324 0.8308 0.9774
0.0053 17.0 13481 0.2762 0.9106 0.875 0.8924 128 0.8851 0.9112 0.8980 169 0.8641 0.8091 0.8357 110 0.6403 0.7807 0.7036 114 0.7469 0.6854 0.7148 267 1.0 0.5 0.6667 2 0.875 0.8798 0.8774 183 0.9167 0.8462 0.8800 65 0.8202 0.8131 0.8166 0.9755
0.0052 18.0 14274 0.2549 0.9062 0.9062 0.9062 128 0.8814 0.9231 0.9017 169 0.8774 0.8455 0.8611 110 0.6812 0.8246 0.7460 114 0.7481 0.7341 0.7410 267 1.0 1.0 1.0 2 0.8677 0.8962 0.8817 183 0.7867 0.9077 0.8429 65 0.8171 0.8478 0.8322 0.9763
0.0049 19.0 15067 0.2724 0.8760 0.8828 0.8794 128 0.8708 0.9172 0.8934 169 0.8390 0.9 0.8684 110 0.6458 0.8158 0.7209 114 0.7117 0.7303 0.7209 267 1.0 1.0 1.0 2 0.8973 0.9071 0.9022 183 0.8209 0.8462 0.8333 65 0.8004 0.8459 0.8225 0.9759
0.0039 20.0 15860 0.2929 0.9167 0.8594 0.8871 128 0.8929 0.8876 0.8902 169 0.8679 0.8364 0.8519 110 0.7333 0.7719 0.7521 114 0.8106 0.6891 0.7449 267 1.0 1.0 1.0 2 0.8967 0.9016 0.8992 183 0.7917 0.8769 0.8321 65 0.8488 0.8170 0.8326 0.9755
0.0033 21.0 16653 0.2467 0.9055 0.8984 0.9020 128 0.8902 0.9112 0.9006 169 0.8692 0.8455 0.8571 110 0.7154 0.7719 0.7426 114 0.7378 0.7378 0.7378 267 1.0 1.0 1.0 2 0.8889 0.9180 0.9032 183 0.8485 0.8615 0.8550 65 0.8283 0.8410 0.8346 0.9781
0.0021 22.0 17446 0.2560 0.912 0.8906 0.9012 128 0.8960 0.9172 0.9064 169 0.8230 0.8455 0.8341 110 0.6875 0.7719 0.7273 114 0.7462 0.7378 0.7420 267 1.0 1.0 1.0 2 0.9213 0.8962 0.9086 183 0.8382 0.8769 0.8571 65 0.8278 0.8382 0.8329 0.9776
0.0017 23.0 18239 0.2891 0.9048 0.8906 0.8976 128 0.8920 0.9290 0.9101 169 0.8932 0.8364 0.8638 110 0.6905 0.7632 0.725 114 0.75 0.7079 0.7283 267 1.0 1.0 1.0 2 0.9066 0.9016 0.9041 183 0.7308 0.8769 0.7972 65 0.8258 0.8314 0.8286 0.9764
0.0055 24.0 19032 0.2853 0.8837 0.8906 0.8872 128 0.8708 0.9172 0.8934 169 0.8462 0.8 0.8224 110 0.6692 0.7807 0.7206 114 0.7153 0.7341 0.7246 267 1.0 1.0 1.0 2 0.8907 0.8907 0.8907 183 0.8710 0.8308 0.8504 65 0.8085 0.8295 0.8188 0.9760
0.0018 25.0 19825 0.3104 0.912 0.8906 0.9012 128 0.8902 0.9112 0.9006 169 0.8364 0.8364 0.8364 110 0.6984 0.7719 0.7333 114 0.7668 0.7266 0.7462 267 1.0 1.0 1.0 2 0.8865 0.8962 0.8913 183 0.9455 0.8 0.8667 65 0.8358 0.8285 0.8321 0.9758
0.0014 26.0 20618 0.3030 0.8828 0.8828 0.8828 128 0.8908 0.9172 0.9038 169 0.9231 0.7636 0.8358 110 0.7008 0.7807 0.7386 114 0.7683 0.7079 0.7368 267 1.0 1.0 1.0 2 0.8871 0.9016 0.8943 183 0.8889 0.8615 0.8750 65 0.8387 0.8218 0.8302 0.9761
0.0018 27.0 21411 0.2970 0.8692 0.8828 0.8760 128 0.8864 0.9231 0.9043 169 0.8476 0.8091 0.8279 110 0.6947 0.7982 0.7429 114 0.7660 0.7603 0.7632 267 1.0 1.0 1.0 2 0.9011 0.8962 0.8986 183 0.8710 0.8308 0.8504 65 0.8281 0.8401 0.8341 0.9766
0.0013 28.0 22204 0.2850 0.8779 0.8984 0.8880 128 0.8851 0.9112 0.8980 169 0.8158 0.8455 0.8304 110 0.7031 0.7895 0.7438 114 0.7595 0.7453 0.7524 267 1.0 1.0 1.0 2 0.9148 0.8798 0.8969 183 0.8889 0.8615 0.8750 65 0.8286 0.8382 0.8333 0.9776
0.0019 29.0 22997 0.2709 0.8976 0.8906 0.8941 128 0.9064 0.9172 0.9118 169 0.8167 0.8909 0.8522 110 0.7227 0.7544 0.7382 114 0.7556 0.7640 0.7598 267 1.0 1.0 1.0 2 0.9405 0.8634 0.9003 183 0.9138 0.8154 0.8618 65 0.8406 0.8382 0.8394 0.9771
0.0014 30.0 23790 0.2976 0.8906 0.8906 0.8906 128 0.8947 0.9053 0.9000 169 0.8276 0.8727 0.8496 110 0.6742 0.7807 0.7236 114 0.7303 0.7303 0.7303 267 0.6667 1.0 0.8 2 0.9106 0.8907 0.9006 183 0.8871 0.8462 0.8661 65 0.8195 0.8353 0.8273 0.9765
0.0014 31.0 24583 0.2994 0.9062 0.9062 0.9062 128 0.9023 0.9290 0.9155 169 0.8246 0.8545 0.8393 110 0.6471 0.7719 0.704 114 0.7586 0.7416 0.75 267 1.0 1.0 1.0 2 0.8783 0.9071 0.8925 183 0.8529 0.8923 0.8722 65 0.8200 0.8468 0.8332 0.9770
0.0011 32.0 25376 0.2895 0.912 0.8906 0.9012 128 0.9070 0.9231 0.9150 169 0.8559 0.8636 0.8597 110 0.6641 0.7632 0.7102 114 0.7263 0.7453 0.7357 267 1.0 1.0 1.0 2 0.8919 0.9016 0.8967 183 0.8594 0.8462 0.8527 65 0.8205 0.8410 0.8306 0.9770
0.0015 33.0 26169 0.2966 0.8915 0.8984 0.8949 128 0.9023 0.9290 0.9155 169 0.7965 0.8182 0.8072 110 0.6917 0.8070 0.7449 114 0.7071 0.7416 0.7239 267 1.0 1.0 1.0 2 0.8859 0.8907 0.8883 183 0.8529 0.8923 0.8722 65 0.8079 0.8430 0.8251 0.9762
0.0007 34.0 26962 0.3250 0.8915 0.8984 0.8949 128 0.8820 0.9290 0.9049 169 0.8411 0.8182 0.8295 110 0.6403 0.7807 0.7036 114 0.7425 0.7453 0.7439 267 1.0 1.0 1.0 2 0.8956 0.8907 0.8932 183 0.9322 0.8462 0.8871 65 0.8177 0.8382 0.8278 0.9751
0.0011 35.0 27755 0.3033 0.8898 0.8828 0.8863 128 0.8764 0.9231 0.8991 169 0.8532 0.8455 0.8493 110 0.7109 0.7982 0.7521 114 0.7634 0.7491 0.7561 267 1.0 1.0 1.0 2 0.8871 0.9016 0.8943 183 0.9167 0.8462 0.8800 65 0.8317 0.8430 0.8373 0.9767
0.0013 36.0 28548 0.3173 0.8898 0.8828 0.8863 128 0.8864 0.9231 0.9043 169 0.8158 0.8455 0.8304 110 0.7165 0.7982 0.7552 114 0.7826 0.7416 0.7615 267 1.0 1.0 1.0 2 0.8817 0.8962 0.8889 183 0.7887 0.8615 0.8235 65 0.8267 0.8410 0.8338 0.9766
0.0032 37.0 29341 0.3098 0.8837 0.8906 0.8872 128 0.8902 0.9112 0.9006 169 0.8532 0.8455 0.8493 110 0.7143 0.7895 0.7500 114 0.7634 0.7491 0.7561 267 1.0 1.0 1.0 2 0.8859 0.8907 0.8883 183 0.9032 0.8615 0.8819 65 0.8329 0.8401 0.8365 0.9769
0.0005 38.0 30134 0.3061 0.8837 0.8906 0.8872 128 0.9012 0.9172 0.9091 169 0.8824 0.8182 0.8491 110 0.728 0.7982 0.7615 114 0.7654 0.7453 0.7552 267 1.0 1.0 1.0 2 0.8950 0.8852 0.8901 183 0.9167 0.8462 0.8800 65 0.8419 0.8362 0.8391 0.9774
0.0003 39.0 30927 0.3165 0.8898 0.8828 0.8863 128 0.8857 0.9172 0.9012 169 0.8667 0.8273 0.8465 110 0.6917 0.8070 0.7449 114 0.7567 0.7453 0.7509 267 1.0 1.0 1.0 2 0.8836 0.9126 0.8978 183 0.8235 0.8615 0.8421 65 0.8239 0.8430 0.8333 0.9768
0.0006 40.0 31720 0.3112 0.875 0.875 0.875 128 0.8960 0.9172 0.9064 169 0.8571 0.8182 0.8372 110 0.7132 0.8070 0.7572 114 0.7614 0.7528 0.7571 267 1.0 1.0 1.0 2 0.8743 0.9126 0.8930 183 0.8871 0.8462 0.8661 65 0.8292 0.8420 0.8356 0.9769
0.0003 41.0 32513 0.3157 0.8819 0.875 0.8784 128 0.8814 0.9231 0.9017 169 0.8396 0.8091 0.8241 110 0.6866 0.8070 0.7419 114 0.7218 0.7678 0.7441 267 1.0 1.0 1.0 2 0.8691 0.9071 0.8877 183 0.9310 0.8308 0.8780 65 0.8119 0.8439 0.8276 0.9761
0.0004 42.0 33306 0.3131 0.8898 0.8828 0.8863 128 0.8757 0.9172 0.8960 169 0.8725 0.8091 0.8396 110 0.7244 0.8070 0.7635 114 0.7752 0.7491 0.7619 267 1.0 1.0 1.0 2 0.8677 0.8962 0.8817 183 0.8594 0.8462 0.8527 65 0.8317 0.8382 0.8349 0.9778
0.0003 43.0 34099 0.3147 0.8906 0.8906 0.8906 128 0.8757 0.9172 0.8960 169 0.8378 0.8455 0.8416 110 0.7109 0.7982 0.7521 114 0.7704 0.7416 0.7557 267 1.0 1.0 1.0 2 0.8624 0.8907 0.8763 183 0.8730 0.8462 0.8594 65 0.8256 0.8391 0.8323 0.9774
0.0003 44.0 34892 0.3390 0.8828 0.8828 0.8828 128 0.8757 0.9172 0.8960 169 0.8378 0.8455 0.8416 110 0.6691 0.7982 0.7280 114 0.7577 0.7378 0.7476 267 1.0 1.0 1.0 2 0.8670 0.8907 0.8787 183 0.8730 0.8462 0.8594 65 0.8160 0.8372 0.8264 0.9756
0.0004 45.0 35685 0.3224 0.8810 0.8672 0.8740 128 0.8960 0.9172 0.9064 169 0.8364 0.8364 0.8364 110 0.7023 0.8070 0.7510 114 0.7689 0.7228 0.7452 267 1.0 1.0 1.0 2 0.8624 0.8907 0.8763 183 0.875 0.8615 0.8682 65 0.8260 0.8324 0.8292 0.9767
0.0002 46.0 36478 0.3259 0.8810 0.8672 0.8740 128 0.8908 0.9172 0.9038 169 0.8440 0.8364 0.8402 110 0.6947 0.7982 0.7429 114 0.7617 0.7303 0.7457 267 1.0 1.0 1.0 2 0.8670 0.8907 0.8787 183 0.8594 0.8462 0.8527 65 0.8229 0.8324 0.8276 0.9767
0.0003 47.0 37271 0.3282 0.8810 0.8672 0.8740 128 0.8908 0.9172 0.9038 169 0.8440 0.8364 0.8402 110 0.7054 0.7982 0.7490 114 0.7787 0.7378 0.7577 267 1.0 1.0 1.0 2 0.8763 0.8907 0.8835 183 0.8594 0.8462 0.8527 65 0.8303 0.8343 0.8323 0.9772
0.0001 48.0 38064 0.3284 0.8810 0.8672 0.8740 128 0.8953 0.9112 0.9032 169 0.8440 0.8364 0.8402 110 0.7398 0.7982 0.7679 114 0.788 0.7378 0.7621 267 1.0 1.0 1.0 2 0.8757 0.8852 0.8804 183 0.8594 0.8462 0.8527 65 0.8380 0.8324 0.8352 0.9775
0.0002 49.0 38857 0.3272 0.8810 0.8672 0.8740 128 0.8953 0.9112 0.9032 169 0.8455 0.8455 0.8455 110 0.7339 0.7982 0.7647 114 0.7857 0.7416 0.7630 267 1.0 1.0 1.0 2 0.8717 0.8907 0.8811 183 0.8594 0.8462 0.8527 65 0.8361 0.8353 0.8357 0.9777
0.0001 50.0 39650 0.3278 0.8810 0.8672 0.8740 128 0.8960 0.9172 0.9064 169 0.8455 0.8455 0.8455 110 0.7339 0.7982 0.7647 114 0.7857 0.7416 0.7630 267 1.0 1.0 1.0 2 0.8717 0.8907 0.8811 183 0.8594 0.8462 0.8527 65 0.8362 0.8362 0.8362 0.9777

Framework versions

  • Transformers 4.25.0.dev0
  • Pytorch 1.12.1+cu113
  • Datasets 2.2.2
  • Tokenizers 0.13.2
Downloads last month
2