Upload TFLayoutLMForTokenClassification

README.md

@@ -1,8 +1,8 @@
 ---
 license: mit
+base_model: microsoft/layoutlm-base-uncased
 tags:
 - generated_from_keras_callback
-base_model: microsoft/layoutlm-base-uncased
 model-index:
 - name: layoutlm-funsd-tf
   results: []
@@ -15,13 +15,13 @@ probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [microsoft/layoutlm-base-uncased](https://huggingface.co/microsoft/layoutlm-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: 1.7272
-- Validation Loss: 1.4405
-- Train Overall Precision: 0.2276
-- Train Overall Recall: 0.2985
-- Train Overall F1: 0.2583
-- Train Overall Accuracy: 0.5034
-- Epoch: 0
+- Train Loss: 0.2406
+- Validation Loss: 0.7155
+- Train Overall Precision: 0.7459
+- Train Overall Recall: 0.7893
+- Train Overall F1: 0.7669
+- Train Overall Accuracy: 0.8064
+- Epoch: 7
 
 ## Model description
 
@@ -40,14 +40,21 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 3e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
+- optimizer: {'inner_optimizer': {'module': 'transformers.optimization_tf', 'class_name': 'AdamWeightDecay', 'config': {'name': 'AdamWeightDecay', 'learning_rate': 2.9999999242136255e-05, 'decay': 0.0, 'beta_1': 0.8999999761581421, 'beta_2': 0.9990000128746033, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}, 'registered_name': 'AdamWeightDecay'}, 'dynamic': True, 'initial_scale': 32768.0, 'dynamic_growth_steps': 2000}
 - training_precision: mixed_float16
 
 ### Training results
 
 | Train Loss | Validation Loss | Train Overall Precision | Train Overall Recall | Train Overall F1 | Train Overall Accuracy | Epoch |
 |:----------:|:---------------:|:-----------------------:|:--------------------:|:----------------:|:----------------------:|:-----:|
-| 1.7272     | 1.4405          | 0.2276                  | 0.2985               | 0.2583           | 0.5034                 | 0     |
+| 1.7115     | 1.4279          | 0.2575                  | 0.2965               | 0.2757           | 0.4884                 | 0     |
+| 1.1520     | 0.8490          | 0.5994                  | 0.6854               | 0.6395           | 0.7372                 | 1     |
+| 0.7816     | 0.7069          | 0.6391                  | 0.7471               | 0.6889           | 0.7808                 | 2     |
+| 0.5815     | 0.6601          | 0.7089                  | 0.7672               | 0.7369           | 0.7992                 | 3     |
+| 0.4460     | 0.6306          | 0.7093                  | 0.7787               | 0.7424           | 0.8060                 | 4     |
+| 0.3658     | 0.6575          | 0.7372                  | 0.7812               | 0.7586           | 0.8111                 | 5     |
+| 0.2926     | 0.6658          | 0.7240                  | 0.7832               | 0.7525           | 0.8096                 | 6     |
+| 0.2406     | 0.7155          | 0.7459                  | 0.7893               | 0.7669           | 0.8064                 | 7     |
 
 
 ### Framework versions

tf_model.h5

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:747eb94808ba3d0b369b248539d00c3da39937ba63363aa4f3c4930baafca138
+oid sha256:256e2c8dca24bfe0d096efbbf919b28b972daa6a01c8026d297ff72ecc30b58f
 size 450829256