Hugging Face's logo

MHGanainy
/
roberta-base-downstream-build_rr

Token Classification
Transformers
Safetensors
roberta
Generated from Trainer
Inference Endpoints
Model card Files Community
MHGanainy commited on
Commit
544222d
·
verified ·
1 Parent(s): a586177

Model save

Browse files
Files changed (2) hide show
  1. README.md +21 -24
  2. model.safetensors +1 -1
README.md CHANGED
@@ -18,14 +18,14 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.8272
22
- - Precision-macro: 0.6089
23
- - Recall-macro: 0.5868
24
- - Macro-f1: 0.5926
25
- - Precision-micro: 0.7798
26
- - Recall-micro: 0.7798
27
- - Micro-f1: 0.7798
28
- - Accuracy: 0.7798
29
 
30
  ## Model description
31
 
@@ -45,8 +45,8 @@ More information needed
45
 
46
  The following hyperparameters were used during training:
47
  - learning_rate: 3e-05
48
- - train_batch_size: 4
49
- - eval_batch_size: 4
50
  - seed: 1
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
@@ -57,20 +57,17 @@ The following hyperparameters were used during training:
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Precision-macro | Recall-macro | Macro-f1 | Precision-micro | Recall-micro | Micro-f1 | Accuracy |
59
  |:-------------:|:-----:|:----:|:---------------:|:---------------:|:------------:|:--------:|:---------------:|:------------:|:--------:|:--------:|
60
- | No log | 1.0 | 62 | 1.1797 | 0.3651 | 0.2425 | 0.2406 | 0.6509 | 0.6509 | 0.6509 | 0.6509 |
61
- | No log | 2.0 | 124 | 0.8354 | 0.5350 | 0.5291 | 0.5255 | 0.7350 | 0.7350 | 0.7350 | 0.7350 |
62
- | No log | 3.0 | 186 | 0.8058 | 0.5559 | 0.5382 | 0.5366 | 0.7343 | 0.7343 | 0.7343 | 0.7343 |
63
- | No log | 4.0 | 248 | 0.7718 | 0.6246 | 0.5201 | 0.5300 | 0.7503 | 0.7503 | 0.7503 | 0.7503 |
64
- | No log | 5.0 | 310 | 0.7307 | 0.5890 | 0.5463 | 0.5579 | 0.7642 | 0.7642 | 0.7642 | 0.7642 |
65
- | No log | 6.0 | 372 | 0.7099 | 0.6076 | 0.5431 | 0.5481 | 0.7746 | 0.7746 | 0.7746 | 0.7746 |
66
- | No log | 7.0 | 434 | 0.7072 | 0.6090 | 0.5126 | 0.5261 | 0.7812 | 0.7812 | 0.7812 | 0.7812 |
67
- | No log | 8.0 | 496 | 0.6919 | 0.6321 | 0.5471 | 0.5676 | 0.7826 | 0.7826 | 0.7826 | 0.7826 |
68
- | 0.8758 | 9.0 | 558 | 0.7503 | 0.5666 | 0.5818 | 0.5696 | 0.7735 | 0.7735 | 0.7735 | 0.7735 |
69
- | 0.8758 | 10.0 | 620 | 0.7512 | 0.6054 | 0.5656 | 0.5755 | 0.7784 | 0.7784 | 0.7784 | 0.7784 |
70
- | 0.8758 | 11.0 | 682 | 0.7656 | 0.6086 | 0.5835 | 0.5913 | 0.7829 | 0.7829 | 0.7829 | 0.7829 |
71
- | 0.8758 | 12.0 | 744 | 0.7861 | 0.5972 | 0.5885 | 0.5843 | 0.7739 | 0.7739 | 0.7739 | 0.7739 |
72
- | 0.8758 | 13.0 | 806 | 0.8239 | 0.5975 | 0.5749 | 0.5701 | 0.7780 | 0.7780 | 0.7780 | 0.7780 |
73
- | 0.8758 | 14.0 | 868 | 0.8272 | 0.6089 | 0.5868 | 0.5926 | 0.7798 | 0.7798 | 0.7798 | 0.7798 |
74
 
75
 
76
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.8610
22
+ - Precision-macro: 0.6015
23
+ - Recall-macro: 0.5642
24
+ - Macro-f1: 0.5742
25
+ - Precision-micro: 0.7871
26
+ - Recall-micro: 0.7871
27
+ - Micro-f1: 0.7871
28
+ - Accuracy: 0.7871
29
 
30
  ## Model description
31
 
 
45
 
46
  The following hyperparameters were used during training:
47
  - learning_rate: 3e-05
48
+ - train_batch_size: 2
49
+ - eval_batch_size: 2
50
  - seed: 1
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
 
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Precision-macro | Recall-macro | Macro-f1 | Precision-micro | Recall-micro | Micro-f1 | Accuracy |
59
  |:-------------:|:-----:|:----:|:---------------:|:---------------:|:------------:|:--------:|:---------------:|:------------:|:--------:|:--------:|
60
+ | No log | 1.0 | 124 | 0.9703 | 0.5485 | 0.3447 | 0.3566 | 0.7155 | 0.7155 | 0.7155 | 0.7155 |
61
+ | No log | 2.0 | 248 | 0.8005 | 0.5181 | 0.5222 | 0.5080 | 0.7353 | 0.7353 | 0.7353 | 0.7353 |
62
+ | No log | 3.0 | 372 | 0.8156 | 0.5626 | 0.5322 | 0.5288 | 0.7454 | 0.7454 | 0.7454 | 0.7454 |
63
+ | No log | 4.0 | 496 | 0.7056 | 0.5881 | 0.5197 | 0.5180 | 0.7704 | 0.7704 | 0.7704 | 0.7704 |
64
+ | 1.0549 | 5.0 | 620 | 0.7526 | 0.5878 | 0.5906 | 0.5775 | 0.7642 | 0.7642 | 0.7642 | 0.7642 |
65
+ | 1.0549 | 6.0 | 744 | 0.7094 | 0.6336 | 0.5395 | 0.5649 | 0.7812 | 0.7812 | 0.7812 | 0.7812 |
66
+ | 1.0549 | 7.0 | 868 | 0.7391 | 0.6475 | 0.5339 | 0.5535 | 0.7808 | 0.7808 | 0.7808 | 0.7808 |
67
+ | 1.0549 | 8.0 | 992 | 0.7354 | 0.6169 | 0.5756 | 0.5881 | 0.7930 | 0.7930 | 0.7930 | 0.7930 |
68
+ | 0.545 | 9.0 | 1116 | 0.8143 | 0.5951 | 0.5963 | 0.5928 | 0.7805 | 0.7805 | 0.7805 | 0.7805 |
69
+ | 0.545 | 10.0 | 1240 | 0.8352 | 0.6029 | 0.5915 | 0.5918 | 0.7794 | 0.7794 | 0.7794 | 0.7794 |
70
+ | 0.545 | 11.0 | 1364 | 0.8610 | 0.6015 | 0.5642 | 0.5742 | 0.7871 | 0.7871 | 0.7871 | 0.7871 |
 
 
 
71
 
72
 
73
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:74567905d0b408ffde3140fbfea0beb0338d9b523298b02976ea06ccc22ff3ff
3
  size 553787380
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba94ff6e2eb22fbec95b7e9dc63e103947259100824d37f17d647319be213e0d
3
  size 553787380