--- license: cc-by-nc-sa-4.0 tags: - generated_from_trainer model-index: - name: layoutlmv3-base-ner results: [] --- # layoutlmv3-base-ner This model is a fine-tuned version of [microsoft/layoutlmv3-base](https://huggingface.co/microsoft/layoutlmv3-base) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 1.5413 - Footer: {'precision': 0.9381835473133618, 'recall': 0.8653508771929824, 'f1': 0.9002966005019393, 'number': 2280} - Header: {'precision': 0.6690058479532164, 'recall': 0.601472134595163, 'f1': 0.6334440753045404, 'number': 951} - Able: {'precision': 0.19949254678084363, 'recall': 0.5143090760425184, 'f1': 0.2874771480804387, 'number': 1223} - Aption: {'precision': 0.32124352331606215, 'recall': 0.07515151515151515, 'f1': 0.12180746561886051, 'number': 825} - Ext: {'precision': 0.34080531340805315, 'recall': 0.4647608264930654, 'f1': 0.39324631780625074, 'number': 3533} - Icture: {'precision': 0.0546448087431694, 'recall': 0.13157894736842105, 'f1': 0.0772200772200772, 'number': 608} - Itle: {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 119} - Ootnote: {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 145} - Ormula: {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 360} - Overall Precision: 0.3939 - Overall Recall: 0.4936 - Overall F1: 0.4382 - Overall Accuracy: 0.7180 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 3e-05 - train_batch_size: 2 - eval_batch_size: 2 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 5 ### Training results | Training Loss | Epoch | Step | Validation Loss | Footer | Header | Able | Aption | Ext | Icture | Itle | Ootnote | Ormula | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy | |:-------------:|:-----:|:----:|:---------------:|:---------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------:|:-----------------------------------------------------------:|:-----------------------------------------------------------:|:-----------------:|:--------------:|:----------:|:----------------:| | 0.4772 | 1.0 | 500 | 1.3891 | {'precision': 0.8112648221343873, 'recall': 0.7201754385964912, 'f1': 0.763011152416357, 'number': 2280} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 951} | {'precision': 0.13366666666666666, 'recall': 0.32788225674570726, 'f1': 0.1899123845607388, 'number': 1223} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 825} | {'precision': 0.2245841035120148, 'recall': 0.27512029436739316, 'f1': 0.24729678157995166, 'number': 3533} | {'precision': 0.022222222222222223, 'recall': 0.008223684210526315, 'f1': 0.012004801920768306, 'number': 608} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 119} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 145} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 360} | 0.3131 | 0.3007 | 0.3068 | 0.7042 | | 0.2598 | 2.0 | 1000 | 1.3046 | {'precision': 0.672650475184794, 'recall': 0.8381578947368421, 'f1': 0.7463386057410663, 'number': 2280} | {'precision': 0.28655597214783074, 'recall': 0.562565720294427, 'f1': 0.3797019162526614, 'number': 951} | {'precision': 0.12042429284525791, 'recall': 0.473426001635323, 'f1': 0.19200795887912453, 'number': 1223} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 825} | {'precision': 0.22616279069767442, 'recall': 0.4404189074440985, 'f1': 0.29885719773360225, 'number': 3533} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 608} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 119} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 145} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 360} | 0.2682 | 0.4561 | 0.3378 | 0.6730 | | 0.1936 | 3.0 | 1500 | 1.4208 | {'precision': 0.9038104089219331, 'recall': 0.8530701754385965, 'f1': 0.8777075812274369, 'number': 2280} | {'precision': 0.6213468869123253, 'recall': 0.5141955835962145, 'f1': 0.5627157652474108, 'number': 951} | {'precision': 0.16486261448792672, 'recall': 0.4856909239574816, 'f1': 0.2461665975963531, 'number': 1223} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 825} | {'precision': 0.2463847702727439, 'recall': 0.3809793376733654, 'f1': 0.2992441084926634, 'number': 3533} | {'precision': 0.02721774193548387, 'recall': 0.044407894736842105, 'f1': 0.03375, 'number': 608} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 119} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 145} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 360} | 0.3385 | 0.4382 | 0.3819 | 0.7043 | | 0.1392 | 4.0 | 2000 | 1.7208 | {'precision': 0.9363636363636364, 'recall': 0.8583333333333333, 'f1': 0.8956521739130435, 'number': 2280} | {'precision': 0.6706521739130434, 'recall': 0.6487907465825447, 'f1': 0.6595403527525386, 'number': 951} | {'precision': 0.15699904122722916, 'recall': 0.53556827473426, 'f1': 0.24281742354031513, 'number': 1223} | {'precision': 0.18992248062015504, 'recall': 0.059393939393939395, 'f1': 0.0904893813481071, 'number': 825} | {'precision': 0.2668534407284188, 'recall': 0.43136144919332015, 'f1': 0.3297273907399394, 'number': 3533} | {'precision': 0.046700507614213196, 'recall': 0.0756578947368421, 'f1': 0.05775266792215945, 'number': 608} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 119} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 145} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 360} | 0.3430 | 0.4827 | 0.4010 | 0.6703 | | 0.0899 | 5.0 | 2500 | 1.5413 | {'precision': 0.9381835473133618, 'recall': 0.8653508771929824, 'f1': 0.9002966005019393, 'number': 2280} | {'precision': 0.6690058479532164, 'recall': 0.601472134595163, 'f1': 0.6334440753045404, 'number': 951} | {'precision': 0.19949254678084363, 'recall': 0.5143090760425184, 'f1': 0.2874771480804387, 'number': 1223} | {'precision': 0.32124352331606215, 'recall': 0.07515151515151515, 'f1': 0.12180746561886051, 'number': 825} | {'precision': 0.34080531340805315, 'recall': 0.4647608264930654, 'f1': 0.39324631780625074, 'number': 3533} | {'precision': 0.0546448087431694, 'recall': 0.13157894736842105, 'f1': 0.0772200772200772, 'number': 608} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 119} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 145} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 360} | 0.3939 | 0.4936 | 0.4382 | 0.7180 | ### Framework versions - Transformers 4.26.0 - Pytorch 1.12.1 - Datasets 2.9.0 - Tokenizers 0.13.2