ytonthat commited on
Commit
0302dd1
1 Parent(s): 1a9e07d

Training complete

Browse files
README.md CHANGED
@@ -25,16 +25,16 @@ model-index:
25
  metrics:
26
  - name: Precision
27
  type: precision
28
- value: 0.5218963439132182
29
  - name: Recall
30
  type: recall
31
- value: 0.5781041388518025
32
  - name: F1
33
  type: f1
34
- value: 0.5485641891891893
35
  - name: Accuracy
36
  type: accuracy
37
- value: 0.8009761388286334
38
  ---
39
 
40
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -44,11 +44,11 @@ should probably proofread and complete it, then remove this comment. -->
44
 
45
  This model is a fine-tuned version of [Dr-BERT/DrBERT-7GB](https://huggingface.co/Dr-BERT/DrBERT-7GB) on the quaero dataset.
46
  It achieves the following results on the evaluation set:
47
- - Loss: 1.4328
48
- - Precision: 0.5219
49
- - Recall: 0.5781
50
- - F1: 0.5486
51
- - Accuracy: 0.8010
52
 
53
  ## Model description
54
 
@@ -73,32 +73,22 @@ The following hyperparameters were used during training:
73
  - seed: 42
74
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
75
  - lr_scheduler_type: linear
76
- - num_epochs: 20
77
 
78
  ### Training results
79
 
80
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
81
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
82
- | No log | 1.0 | 105 | 0.7200 | 0.4493 | 0.4833 | 0.4657 | 0.7785 |
83
- | No log | 2.0 | 210 | 0.7287 | 0.4381 | 0.5056 | 0.4694 | 0.7791 |
84
- | No log | 3.0 | 315 | 0.8443 | 0.4635 | 0.5207 | 0.4905 | 0.7823 |
85
- | No log | 4.0 | 420 | 1.0059 | 0.4780 | 0.5269 | 0.5013 | 0.7835 |
86
- | 0.4225 | 5.0 | 525 | 0.9944 | 0.4688 | 0.5545 | 0.5081 | 0.7806 |
87
- | 0.4225 | 6.0 | 630 | 1.0721 | 0.5104 | 0.5367 | 0.5232 | 0.7944 |
88
- | 0.4225 | 7.0 | 735 | 1.1099 | 0.4829 | 0.5639 | 0.5202 | 0.7933 |
89
- | 0.4225 | 8.0 | 840 | 1.2544 | 0.4814 | 0.5527 | 0.5146 | 0.7779 |
90
- | 0.4225 | 9.0 | 945 | 1.2083 | 0.4823 | 0.5639 | 0.5199 | 0.7905 |
91
- | 0.0481 | 10.0 | 1050 | 1.3132 | 0.4892 | 0.5621 | 0.5231 | 0.7924 |
92
- | 0.0481 | 11.0 | 1155 | 1.3484 | 0.5040 | 0.5665 | 0.5334 | 0.7942 |
93
- | 0.0481 | 12.0 | 1260 | 1.3297 | 0.5042 | 0.5585 | 0.5300 | 0.7989 |
94
- | 0.0481 | 13.0 | 1365 | 1.3890 | 0.5023 | 0.5741 | 0.5358 | 0.7955 |
95
- | 0.0481 | 14.0 | 1470 | 1.4140 | 0.5111 | 0.5639 | 0.5362 | 0.7985 |
96
- | 0.009 | 15.0 | 1575 | 1.4130 | 0.5226 | 0.5550 | 0.5383 | 0.7996 |
97
- | 0.009 | 16.0 | 1680 | 1.4197 | 0.5127 | 0.5639 | 0.5371 | 0.7964 |
98
- | 0.009 | 17.0 | 1785 | 1.4166 | 0.5262 | 0.5723 | 0.5483 | 0.8015 |
99
- | 0.009 | 18.0 | 1890 | 1.4257 | 0.5173 | 0.5781 | 0.5460 | 0.8004 |
100
- | 0.009 | 19.0 | 1995 | 1.4318 | 0.5203 | 0.5817 | 0.5493 | 0.8011 |
101
- | 0.0018 | 20.0 | 2100 | 1.4328 | 0.5219 | 0.5781 | 0.5486 | 0.8010 |
102
 
103
 
104
  ### Framework versions
 
25
  metrics:
26
  - name: Precision
27
  type: precision
28
+ value: 0.5105965463108321
29
  - name: Recall
30
  type: recall
31
+ value: 0.5789942145082332
32
  - name: F1
33
  type: f1
34
+ value: 0.5426485922836287
35
  - name: Accuracy
36
  type: accuracy
37
+ value: 0.8011795010845987
38
  ---
39
 
40
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
44
 
45
  This model is a fine-tuned version of [Dr-BERT/DrBERT-7GB](https://huggingface.co/Dr-BERT/DrBERT-7GB) on the quaero dataset.
46
  It achieves the following results on the evaluation set:
47
+ - Loss: 1.2226
48
+ - Precision: 0.5106
49
+ - Recall: 0.5790
50
+ - F1: 0.5426
51
+ - Accuracy: 0.8012
52
 
53
  ## Model description
54
 
 
73
  - seed: 42
74
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
75
  - lr_scheduler_type: linear
76
+ - num_epochs: 10
77
 
78
  ### Training results
79
 
80
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
81
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
82
+ | No log | 1.0 | 105 | 0.7160 | 0.4596 | 0.4713 | 0.4654 | 0.7764 |
83
+ | No log | 2.0 | 210 | 0.6985 | 0.4484 | 0.5220 | 0.4824 | 0.7831 |
84
+ | No log | 3.0 | 315 | 0.8448 | 0.4872 | 0.5234 | 0.5046 | 0.7881 |
85
+ | No log | 4.0 | 420 | 0.9029 | 0.5231 | 0.5403 | 0.5315 | 0.8017 |
86
+ | 0.4116 | 5.0 | 525 | 1.0169 | 0.4813 | 0.5656 | 0.5200 | 0.7892 |
87
+ | 0.4116 | 6.0 | 630 | 1.0596 | 0.5150 | 0.5665 | 0.5395 | 0.7986 |
88
+ | 0.4116 | 7.0 | 735 | 1.1298 | 0.4954 | 0.5705 | 0.5303 | 0.8000 |
89
+ | 0.4116 | 8.0 | 840 | 1.1665 | 0.4949 | 0.5803 | 0.5342 | 0.7984 |
90
+ | 0.4116 | 9.0 | 945 | 1.2045 | 0.5135 | 0.5754 | 0.5427 | 0.8025 |
91
+ | 0.0254 | 10.0 | 1050 | 1.2226 | 0.5106 | 0.5790 | 0.5426 | 0.8012 |
 
 
 
 
 
 
 
 
 
 
92
 
93
 
94
  ### Framework versions
runs/Mar01_15-00-34_6d7974edcc8d/events.out.tfevents.1709305236.6d7974edcc8d.14493.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:39987248ba00c199ffa5f621ac736f4d45f7f43fcd9bd7ef442a522b0fbd67c3
3
- size 9890
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ef2f6af9d578754bf9600361524296ae0d8180193acadb9fd39b1ca478d7da8
3
+ size 10927