Brizape commited on
Commit
4a46abb
1 Parent(s): 9ce0594

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +37 -1
README.md CHANGED
@@ -2,6 +2,11 @@
2
  license: mit
3
  tags:
4
  - generated_from_trainer
 
 
 
 
 
5
  model-index:
6
  - name: tmvar_2e-05
7
  results: []
@@ -12,7 +17,13 @@ should probably proofread and complete it, then remove this comment. -->
12
 
13
  # tmvar_2e-05
14
 
15
- This model is a fine-tuned version of [microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext](https://huggingface.co/microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext) on an unknown dataset.
 
 
 
 
 
 
16
 
17
  ## Model description
18
 
@@ -39,6 +50,31 @@ The following hyperparameters were used during training:
39
  - lr_scheduler_type: linear
40
  - training_steps: 500
41
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
42
  ### Framework versions
43
 
44
  - Transformers 4.27.4
 
2
  license: mit
3
  tags:
4
  - generated_from_trainer
5
+ metrics:
6
+ - precision
7
+ - recall
8
+ - f1
9
+ - accuracy
10
  model-index:
11
  - name: tmvar_2e-05
12
  results: []
 
17
 
18
  # tmvar_2e-05
19
 
20
+ This model is a fine-tuned version of [microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext](https://huggingface.co/microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext) on the None dataset.
21
+ It achieves the following results on the evaluation set:
22
+ - Loss: 0.0136
23
+ - Precision: 0.8308
24
+ - Recall: 0.8757
25
+ - F1: 0.8526
26
+ - Accuracy: 0.9968
27
 
28
  ## Model description
29
 
 
50
  - lr_scheduler_type: linear
51
  - training_steps: 500
52
 
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
56
+ |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
57
+ | 0.5077 | 1.47 | 25 | 0.1015 | 0.0 | 0.0 | 0.0 | 0.9843 |
58
+ | 0.0834 | 2.94 | 50 | 0.0463 | 0.3581 | 0.4162 | 0.3850 | 0.9877 |
59
+ | 0.0348 | 4.41 | 75 | 0.0315 | 0.3846 | 0.4324 | 0.4071 | 0.9896 |
60
+ | 0.0285 | 5.88 | 100 | 0.0234 | 0.5157 | 0.6216 | 0.5637 | 0.9927 |
61
+ | 0.0149 | 7.35 | 125 | 0.0174 | 0.7801 | 0.8054 | 0.7926 | 0.9957 |
62
+ | 0.0104 | 8.82 | 150 | 0.0156 | 0.78 | 0.8432 | 0.8104 | 0.9959 |
63
+ | 0.0059 | 10.29 | 175 | 0.0160 | 0.8360 | 0.8541 | 0.8449 | 0.9960 |
64
+ | 0.005 | 11.76 | 200 | 0.0139 | 0.8333 | 0.8649 | 0.8488 | 0.9964 |
65
+ | 0.003 | 13.24 | 225 | 0.0164 | 0.8263 | 0.8486 | 0.8373 | 0.9961 |
66
+ | 0.0024 | 14.71 | 250 | 0.0146 | 0.7980 | 0.8541 | 0.8251 | 0.9964 |
67
+ | 0.0023 | 16.18 | 275 | 0.0132 | 0.8267 | 0.9027 | 0.8630 | 0.9969 |
68
+ | 0.0016 | 17.65 | 300 | 0.0133 | 0.8274 | 0.8811 | 0.8534 | 0.9971 |
69
+ | 0.0015 | 19.12 | 325 | 0.0129 | 0.8235 | 0.9081 | 0.8638 | 0.9971 |
70
+ | 0.0014 | 20.59 | 350 | 0.0163 | 0.8703 | 0.8703 | 0.8703 | 0.9968 |
71
+ | 0.0013 | 22.06 | 375 | 0.0141 | 0.8402 | 0.8811 | 0.8602 | 0.9969 |
72
+ | 0.0013 | 23.53 | 400 | 0.0145 | 0.8438 | 0.8757 | 0.8594 | 0.9968 |
73
+ | 0.0011 | 25.0 | 425 | 0.0149 | 0.8482 | 0.8757 | 0.8617 | 0.9969 |
74
+ | 0.0011 | 26.47 | 450 | 0.0138 | 0.8351 | 0.8757 | 0.8549 | 0.9968 |
75
+ | 0.0011 | 27.94 | 475 | 0.0136 | 0.8308 | 0.8757 | 0.8526 | 0.9968 |
76
+
77
+
78
  ### Framework versions
79
 
80
  - Transformers 4.27.4