End of training

README.md

@@ -0,0 +1,70 @@
+---
+license: cc-by-nc-sa-4.0
+tags:
+- generated_from_trainer
+model-index:
+- name: layoutlmv3-base-ner
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# layoutlmv3-base-ner
+
+This model is a fine-tuned version of [microsoft/layoutlmv3-base](https://huggingface.co/microsoft/layoutlmv3-base) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: nan
+- Footer: {'precision': 0.9749447310243183, 'recall': 0.9792746113989638, 'f1': 0.9771048744460857, 'number': 1351}
+- Header: {'precision': 0.927519818799547, 'recall': 0.9578947368421052, 'f1': 0.9424626006904488, 'number': 855}
+- Able: {'precision': 0.7589285714285714, 'recall': 0.8531994981179423, 'f1': 0.8033077377436504, 'number': 797}
+- Aption: {'precision': 0.6352785145888594, 'recall': 0.7496087636932708, 'f1': 0.687724335965542, 'number': 639}
+- Ext: {'precision': 0.6819444444444445, 'recall': 0.7897064736630478, 'f1': 0.7318800074529532, 'number': 2487}
+- Icture: {'precision': 0.772196261682243, 'recall': 0.8283208020050126, 'f1': 0.7992744860943168, 'number': 798}
+- Itle: {'precision': 0.4519230769230769, 'recall': 0.415929203539823, 'f1': 0.43317972350230416, 'number': 113}
+- Ootnote: {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 55}
+- Ormula: {'precision': 0.38578680203045684, 'recall': 0.7307692307692307, 'f1': 0.5049833887043189, 'number': 104}
+- Overall Precision: 0.7631
+- Overall Recall: 0.8403
+- Overall F1: 0.7998
+- Overall Accuracy: 0.9572
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 3e-05
+- train_batch_size: 1
+- eval_batch_size: 1
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 2
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Footer                                                                                                    | Header                                                                                                  | Able                                                                                                     | Aption                                                                                                   | Ext                                                                                                       | Icture                                                                                                   | Itle                                                                                                        | Ootnote                                                    | Ormula                                                                                                     | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
+|:-------------:|:-----:|:----:|:---------------:|:---------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------:|:-----------------:|:--------------:|:----------:|:----------------:|
+| 0.6151        | 1.0   | 4900 | nan             | {'precision': 0.9154334038054969, 'recall': 0.9615099925980755, 'f1': 0.9379061371841154, 'number': 1351} | {'precision': 0.8517316017316018, 'recall': 0.92046783625731, 'f1': 0.8847667228780213, 'number': 855}  | {'precision': 0.5285592497868713, 'recall': 0.7779171894604768, 'f1': 0.6294416243654822, 'number': 797} | {'precision': 0.3216326530612245, 'recall': 0.6165884194053208, 'f1': 0.4227467811158798, 'number': 639} | {'precision': 0.4335355763927192, 'recall': 0.632086851628468, 'f1': 0.5143137575658433, 'number': 2487}  | {'precision': 0.5630585898709036, 'recall': 0.7105263157894737, 'f1': 0.6282548476454293, 'number': 798} | {'precision': 0.06504065040650407, 'recall': 0.21238938053097345, 'f1': 0.09958506224066391, 'number': 113} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 55} | {'precision': 0.07069408740359898, 'recall': 0.5288461538461539, 'f1': 0.12471655328798187, 'number': 104} | 0.5055            | 0.7387         | 0.6002     | 0.9093           |
+| 0.2733        | 2.0   | 9800 | nan             | {'precision': 0.9749447310243183, 'recall': 0.9792746113989638, 'f1': 0.9771048744460857, 'number': 1351} | {'precision': 0.927519818799547, 'recall': 0.9578947368421052, 'f1': 0.9424626006904488, 'number': 855} | {'precision': 0.7589285714285714, 'recall': 0.8531994981179423, 'f1': 0.8033077377436504, 'number': 797} | {'precision': 0.6352785145888594, 'recall': 0.7496087636932708, 'f1': 0.687724335965542, 'number': 639}  | {'precision': 0.6819444444444445, 'recall': 0.7897064736630478, 'f1': 0.7318800074529532, 'number': 2487} | {'precision': 0.772196261682243, 'recall': 0.8283208020050126, 'f1': 0.7992744860943168, 'number': 798}  | {'precision': 0.4519230769230769, 'recall': 0.415929203539823, 'f1': 0.43317972350230416, 'number': 113}    | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 55} | {'precision': 0.38578680203045684, 'recall': 0.7307692307692307, 'f1': 0.5049833887043189, 'number': 104}  | 0.7631            | 0.8403         | 0.7998     | 0.9572           |
+
+
+### Framework versions
+
+- Transformers 4.26.0
+- Pytorch 1.12.1
+- Datasets 2.9.0
+- Tokenizers 0.13.2

logs/events.out.tfevents.1678893268.138-2-233-57.233500.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:68c136722783a0f2198a81fa2360399f7936175a5bb4cc9dc33693cec13a4451
-size 5936
+oid sha256:31fb49d247d99608e9aacb4558100b298cc9a232fa09345c8d656f2fe82dc1c4
+size 6290

preprocessor_config.json

@@ -0,0 +1,27 @@
+{
+  "apply_ocr": false,
+  "do_normalize": true,
+  "do_rescale": true,
+  "do_resize": true,
+  "feature_extractor_type": "LayoutLMv3FeatureExtractor",
+  "image_mean": [
+    0.5,
+    0.5,
+    0.5
+  ],
+  "image_processor_type": "LayoutLMv3ImageProcessor",
+  "image_std": [
+    0.5,
+    0.5,
+    0.5
+  ],
+  "ocr_lang": null,
+  "processor_class": "LayoutLMv3Processor",
+  "resample": 2,
+  "rescale_factor": 0.00392156862745098,
+  "size": {
+    "height": 224,
+    "width": 224
+  },
+  "tesseract_config": ""
+}

special_tokens_map.json

@@ -0,0 +1,51 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "cls_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "<mask>",
+    "lstrip": true,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,87 @@
+{
+  "add_prefix_space": true,
+  "apply_ocr": false,
+  "bos_token": {
+    "__type": "AddedToken",
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "cls_token": {
+    "__type": "AddedToken",
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "cls_token_box": [
+    0,
+    0,
+    0,
+    0
+  ],
+  "eos_token": {
+    "__type": "AddedToken",
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "errors": "replace",
+  "mask_token": {
+    "__type": "AddedToken",
+    "content": "<mask>",
+    "lstrip": true,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "model_max_length": 512,
+  "name_or_path": "microsoft/layoutlmv3-base",
+  "only_label_first_subword": true,
+  "pad_token": {
+    "__type": "AddedToken",
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token_box": [
+    0,
+    0,
+    0,
+    0
+  ],
+  "pad_token_label": -100,
+  "processor_class": "LayoutLMv3Processor",
+  "sep_token": {
+    "__type": "AddedToken",
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token_box": [
+    0,
+    0,
+    0,
+    0
+  ],
+  "special_tokens_map_file": null,
+  "tokenizer_class": "LayoutLMv3Tokenizer",
+  "trim_offsets": true,
+  "unk_token": {
+    "__type": "AddedToken",
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}