ytonthat commited on
Commit
15572e6
1 Parent(s): 8074009

Training complete

Browse files
README.md CHANGED
@@ -25,16 +25,16 @@ model-index:
25
  metrics:
26
  - name: Precision
27
  type: precision
28
- value: 0.7103274559193955
29
  - name: Recall
30
  type: recall
31
- value: 0.7359081419624217
32
  - name: F1
33
  type: f1
34
- value: 0.7228915662650602
35
  - name: Accuracy
36
  type: accuracy
37
- value: 0.9223586595037094
38
  ---
39
 
40
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -44,11 +44,11 @@ should probably proofread and complete it, then remove this comment. -->
44
 
45
  This model is a fine-tuned version of [Dr-BERT/DrBERT-7GB](https://huggingface.co/Dr-BERT/DrBERT-7GB) on the quaero dataset.
46
  It achieves the following results on the evaluation set:
47
- - Loss: 0.3775
48
- - Precision: 0.7103
49
- - Recall: 0.7359
50
- - F1: 0.7229
51
- - Accuracy: 0.9224
52
 
53
  ## Model description
54
 
@@ -67,21 +67,26 @@ More information needed
67
  ### Training hyperparameters
68
 
69
  The following hyperparameters were used during training:
70
- - learning_rate: 2e-05
71
  - train_batch_size: 8
72
  - eval_batch_size: 8
73
  - seed: 42
74
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
75
  - lr_scheduler_type: linear
76
- - num_epochs: 3
77
 
78
  ### Training results
79
 
80
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
81
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
82
- | No log | 1.0 | 61 | 0.3947 | 0.7117 | 0.6905 | 0.7009 | 0.9198 |
83
- | No log | 2.0 | 122 | 0.3738 | 0.7210 | 0.7244 | 0.7227 | 0.9224 |
84
- | No log | 3.0 | 183 | 0.3775 | 0.7103 | 0.7359 | 0.7229 | 0.9224 |
 
 
 
 
 
85
 
86
 
87
  ### Framework versions
 
25
  metrics:
26
  - name: Precision
27
  type: precision
28
+ value: 0.7244534824605999
29
  - name: Recall
30
  type: recall
31
+ value: 0.7437369519832986
32
  - name: F1
33
  type: f1
34
+ value: 0.7339685809940767
35
  - name: Accuracy
36
  type: accuracy
37
+ value: 0.9228702993092862
38
  ---
39
 
40
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
44
 
45
  This model is a fine-tuned version of [Dr-BERT/DrBERT-7GB](https://huggingface.co/Dr-BERT/DrBERT-7GB) on the quaero dataset.
46
  It achieves the following results on the evaluation set:
47
+ - Loss: 0.4365
48
+ - Precision: 0.7245
49
+ - Recall: 0.7437
50
+ - F1: 0.7340
51
+ - Accuracy: 0.9229
52
 
53
  ## Model description
54
 
 
67
  ### Training hyperparameters
68
 
69
  The following hyperparameters were used during training:
70
+ - learning_rate: 5e-05
71
  - train_batch_size: 8
72
  - eval_batch_size: 8
73
  - seed: 42
74
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
75
  - lr_scheduler_type: linear
76
+ - num_epochs: 8
77
 
78
  ### Training results
79
 
80
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
81
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
82
+ | No log | 1.0 | 61 | 0.4138 | 0.7069 | 0.7035 | 0.7052 | 0.9185 |
83
+ | No log | 2.0 | 122 | 0.3855 | 0.6853 | 0.7307 | 0.7072 | 0.9153 |
84
+ | No log | 3.0 | 183 | 0.4027 | 0.6563 | 0.7526 | 0.7012 | 0.9141 |
85
+ | No log | 4.0 | 244 | 0.4251 | 0.6692 | 0.7390 | 0.7024 | 0.9165 |
86
+ | No log | 5.0 | 305 | 0.4165 | 0.7099 | 0.7432 | 0.7262 | 0.9211 |
87
+ | No log | 6.0 | 366 | 0.4493 | 0.7339 | 0.7213 | 0.7276 | 0.9211 |
88
+ | No log | 7.0 | 427 | 0.4324 | 0.7169 | 0.7443 | 0.7303 | 0.9228 |
89
+ | No log | 8.0 | 488 | 0.4365 | 0.7245 | 0.7437 | 0.7340 | 0.9229 |
90
 
91
 
92
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fe39767271d76a6b6a7c5b5ff56e0d80428acee082f7036e3bb0a6cfcbca8c4a
3
  size 440213956
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:721e0bfa87a8fbc15a55501d220da01e415ac2c0fcd05d60f7a9743c2f2e8909
3
  size 440213956
runs/Mar01_02-45-03_1cc23fee8ba3/events.out.tfevents.1709261108.1cc23fee8ba3.4565.3 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:21423a4c583a12feafa16ed0ac254803ebf344858c91e823a4245e2a0748a20d
3
- size 8258
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b35c0b332a81fab83425aa4df1b6852bbde330f1de05b7745c04e7c8b27b36e7
3
+ size 9556