blizrys commited on
Commit
ee9d60f
1 Parent(s): a5cd2b3

BATCH_SIZE=8

Browse files

LEARNING_RATE=0.003
MAX_LENGTH=512
FOLD=0

README.md CHANGED
@@ -25,7 +25,7 @@ should probably proofread and complete it, then remove this comment. -->
25
 
26
  This model is a fine-tuned version of [microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext](https://huggingface.co/microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext) on the None dataset.
27
  It achieves the following results on the evaluation set:
28
- - Loss: 0.9957
29
  - Accuracy: 0.54
30
 
31
  ## Model description
@@ -57,11 +57,11 @@ The following hyperparameters were used during training:
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
59
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
60
- | No log | 1.0 | 57 | 1.3151 | 0.54 |
61
- | No log | 2.0 | 114 | 0.9564 | 0.54 |
62
- | No log | 3.0 | 171 | 0.9836 | 0.54 |
63
- | No log | 4.0 | 228 | 1.0456 | 0.54 |
64
- | No log | 5.0 | 285 | 0.9957 | 0.54 |
65
 
66
 
67
  ### Framework versions
 
25
 
26
  This model is a fine-tuned version of [microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext](https://huggingface.co/microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext) on the None dataset.
27
  It achieves the following results on the evaluation set:
28
+ - Loss: 1.0007
29
  - Accuracy: 0.54
30
 
31
  ## Model description
 
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
59
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
60
+ | No log | 1.0 | 57 | 1.1447 | 0.54 |
61
+ | No log | 2.0 | 114 | 1.0048 | 0.34 |
62
+ | No log | 3.0 | 171 | 0.9655 | 0.54 |
63
+ | No log | 4.0 | 228 | 1.0414 | 0.54 |
64
+ | No log | 5.0 | 285 | 1.0007 | 0.54 |
65
 
66
 
67
  ### Framework versions
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:852fe8afb6db13a7cf8327cf30285b95cd65b2b01a7e5518c84d77d62dd402cb
3
  size 438022317
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ec8fa92be3abd21adc8994291449d7f3977b05fecd0ec51526b3f693ce86574
3
  size 438022317
runs/Sep17_08-59-45_a2cdb2b6c766/events.out.tfevents.1631869756.a2cdb2b6c766.92.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0410c7fba4911f585d1c7b32c11033ff9a177997c6d607111d5625fc452fd074
3
+ size 363
runs/Sep17_09-56-05_a2cdb2b6c766/1631872569.5602882/events.out.tfevents.1631872569.a2cdb2b6c766.92.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fee9f68c2378c2f66996bc53403c002d926391be953b9b35fb1ca5d988787f91
3
+ size 4429
runs/Sep17_09-56-05_a2cdb2b6c766/events.out.tfevents.1631872569.a2cdb2b6c766.92.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21f5ce65eb58180e6572ba9fc08ce370cceea8a30f0ce9143a8f84bf86a7fa8d
3
+ size 5287
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:38371338fe9d7618e8ff31602ba3cd8edbc302d701e907ef9dc1db4a8b05cb9c
3
  size 2863
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1cf27e0794bb8d1319445788762930b173bebcc477298cbd86b4f9ec1dc0d3b
3
  size 2863