blizrys commited on
Commit
ed3779c
1 Parent(s): ee9d60f

BATCH_SIZE=8

Browse files

LEARNING_RATE=0.003
MAX_LENGTH=512
FOLD=1

README.md CHANGED
@@ -25,7 +25,7 @@ should probably proofread and complete it, then remove this comment. -->
25
 
26
  This model is a fine-tuned version of [microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext](https://huggingface.co/microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext) on the None dataset.
27
  It achieves the following results on the evaluation set:
28
- - Loss: 1.0007
29
  - Accuracy: 0.54
30
 
31
  ## Model description
@@ -57,11 +57,11 @@ The following hyperparameters were used during training:
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
59
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
60
- | No log | 1.0 | 57 | 1.1447 | 0.54 |
61
- | No log | 2.0 | 114 | 1.0048 | 0.34 |
62
- | No log | 3.0 | 171 | 0.9655 | 0.54 |
63
- | No log | 4.0 | 228 | 1.0414 | 0.54 |
64
- | No log | 5.0 | 285 | 1.0007 | 0.54 |
65
 
66
 
67
  ### Framework versions
25
 
26
  This model is a fine-tuned version of [microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext](https://huggingface.co/microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext) on the None dataset.
27
  It achieves the following results on the evaluation set:
28
+ - Loss: 1.0005
29
  - Accuracy: 0.54
30
 
31
  ## Model description
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
59
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
60
+ | No log | 1.0 | 57 | 1.3510 | 0.54 |
61
+ | No log | 2.0 | 114 | 0.9606 | 0.54 |
62
+ | No log | 3.0 | 171 | 0.9693 | 0.54 |
63
+ | No log | 4.0 | 228 | 1.0445 | 0.54 |
64
+ | No log | 5.0 | 285 | 1.0005 | 0.54 |
65
 
66
 
67
  ### Framework versions
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5ec8fa92be3abd21adc8994291449d7f3977b05fecd0ec51526b3f693ce86574
3
  size 438022317
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab397f14c137a4e4a8f771cface946d4b2fa6a43ecbf800f952ca7e7a8bc5c71
3
  size 438022317
runs/Sep17_09-56-05_a2cdb2b6c766/events.out.tfevents.1631873132.a2cdb2b6c766.92.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22a29c6814cdcfcf2d00a5fb09fd92f05c5ff888204a0065f796b9ecb3ded723
3
+ size 363
runs/Sep17_10-05-36_a2cdb2b6c766/1631873140.2417028/events.out.tfevents.1631873140.a2cdb2b6c766.92.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4779c7ceaede71af0454e429a829b9bbf8e12b02bbb127af92771d050c77809e
3
+ size 4429
runs/Sep17_10-05-36_a2cdb2b6c766/events.out.tfevents.1631873140.a2cdb2b6c766.92.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d04e90796a15b923b556938a332b390334afa6dffb7c592317f47001b7400dd
3
+ size 5287
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e1cf27e0794bb8d1319445788762930b173bebcc477298cbd86b4f9ec1dc0d3b
3
  size 2863
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d0e95116405aa6aa3a63f29d6019d935e1b5ef4ab304c19f4477fe482358d24
3
  size 2863