Hugging Face's logo

codymd
/
bert-base-uncased-grammar-ner-generic

Token Classification
Transformers
TensorBoard
Safetensors
bert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
codymd commited on
Commit
413a2f2
·
verified ·
1 Parent(s): beabdd2

End of training

Browse files
Files changed (4) hide show
  1. README.md +21 -12
  2. model.safetensors +1 -1
  3. runs/Dec12_22-30-51_a365e7b9463b/events.out.tfevents.1734042651.a365e7b9463b.6288.5 +3 -0
  4. training_args.bin +1 -1
README.md CHANGED
@@ -18,14 +18,14 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.0939
22
- - Accuracy: 0.9856
23
- - F1 Macro: 0.8809
24
- - F1 Micro: 0.8809
25
- - Precision Macro: 0.8970
26
- - Precision Micro: 0.8970
27
- - Recall Macro: 0.8654
28
- - Recall Micro: 0.8654
29
 
30
  ## Model description
31
 
@@ -50,15 +50,24 @@ The following hyperparameters were used during training:
50
  - seed: 42
51
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
52
  - lr_scheduler_type: linear
53
- - num_epochs: 3
54
 
55
  ### Training results
56
 
57
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Macro | F1 Micro | Precision Macro | Precision Micro | Recall Macro | Recall Micro |
58
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|:--------:|:---------------:|:---------------:|:------------:|:------------:|
59
- | 0.0117 | 1.0 | 93 | 0.1278 | 0.9781 | 0.8046 | 0.8046 | 0.8322 | 0.8322 | 0.7788 | 0.7788 |
60
- | 0.008 | 2.0 | 186 | 0.0995 | 0.9860 | 0.8832 | 0.8832 | 0.9355 | 0.9355 | 0.8365 | 0.8365 |
61
- | 0.0054 | 3.0 | 279 | 0.0939 | 0.9856 | 0.8809 | 0.8809 | 0.8970 | 0.8970 | 0.8654 | 0.8654 |
 
 
 
 
 
 
 
 
 
62
 
63
 
64
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.1085
22
+ - Accuracy: 0.9887
23
+ - F1 Macro: 0.9103
24
+ - F1 Micro: 0.9103
25
+ - Precision Macro: 0.9448
26
+ - Precision Micro: 0.9448
27
+ - Recall Macro: 0.8782
28
+ - Recall Micro: 0.8782
29
 
30
  ## Model description
31
 
 
50
  - seed: 42
51
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
52
  - lr_scheduler_type: linear
53
+ - num_epochs: 12
54
 
55
  ### Training results
56
 
57
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Macro | F1 Micro | Precision Macro | Precision Micro | Recall Macro | Recall Micro |
58
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|:--------:|:---------------:|:---------------:|:------------:|:------------:|
59
+ | 0.0121 | 1.0 | 93 | 0.1199 | 0.9821 | 0.8430 | 0.8430 | 0.9373 | 0.9373 | 0.7660 | 0.7660 |
60
+ | 0.0124 | 2.0 | 186 | 0.0898 | 0.9832 | 0.8448 | 0.8448 | 0.8435 | 0.8435 | 0.8462 | 0.8462 |
61
+ | 0.0176 | 3.0 | 279 | 0.0690 | 0.9871 | 0.8797 | 0.8797 | 0.9051 | 0.9051 | 0.8558 | 0.8558 |
62
+ | 0.0182 | 4.0 | 372 | 0.0805 | 0.9858 | 0.8793 | 0.8793 | 0.9078 | 0.9078 | 0.8526 | 0.8526 |
63
+ | 0.01 | 5.0 | 465 | 0.0816 | 0.9824 | 0.8465 | 0.8465 | 0.8198 | 0.8198 | 0.875 | 0.875 |
64
+ | 0.0075 | 6.0 | 558 | 0.0887 | 0.9866 | 0.8867 | 0.8867 | 0.8954 | 0.8954 | 0.8782 | 0.8782 |
65
+ | 0.0038 | 7.0 | 651 | 0.1157 | 0.9839 | 0.8701 | 0.8701 | 0.8502 | 0.8502 | 0.8910 | 0.8910 |
66
+ | 0.0031 | 8.0 | 744 | 0.1000 | 0.9877 | 0.9034 | 0.9034 | 0.9231 | 0.9231 | 0.8846 | 0.8846 |
67
+ | 0.0017 | 9.0 | 837 | 0.1097 | 0.9877 | 0.9010 | 0.9010 | 0.9286 | 0.9286 | 0.875 | 0.875 |
68
+ | 0.0013 | 10.0 | 930 | 0.1044 | 0.9894 | 0.9161 | 0.9161 | 0.9613 | 0.9613 | 0.875 | 0.875 |
69
+ | 0.001 | 11.0 | 1023 | 0.1069 | 0.9889 | 0.9118 | 0.9118 | 0.9481 | 0.9481 | 0.8782 | 0.8782 |
70
+ | 0.0003 | 12.0 | 1116 | 0.1085 | 0.9887 | 0.9103 | 0.9103 | 0.9448 | 0.9448 | 0.8782 | 0.8782 |
71
 
72
 
73
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:81178ab9cd855cd136340b2fce7785d5bf5c022abd2179a41c7d940f38986d02
3
  size 435599164
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93595ec83e7b98ba3248a9d9e6dfd3e80e8251e498a65e607f235c76e566c603
3
  size 435599164
runs/Dec12_22-30-51_a365e7b9463b/events.out.tfevents.1734042651.a365e7b9463b.6288.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3bb02b0d344a2738a8952a3f321fe0c288a2822d999a8fa379beb23d6001e35d
3
+ size 16011
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:430b7d7547fece0d5290dcb315bce4c3e13a76dfeada4b00dc071da5458658b2
3
  size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4dd083d55b426f0f25dc8e23191334bd20bcd885d949ac2ff59f560708449ce7
3
  size 5304