BATCH_SIZE=8

LEARNING_RATE=5e-05
MAX_LENGTH=512
FOLD=2

README.md

@@ -15,7 +15,7 @@ model-index:
     metrics:
     - name: Accuracy
       type: accuracy
-      value: 0.62
+      value: 0.58
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -25,8 +25,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext](https://huggingface.co/microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.9743
-- Accuracy: 0.62
+- Loss: 2.2266
+- Accuracy: 0.58
 
 ## Model description
 
@@ -57,16 +57,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 57   | 0.9619          | 0.54     |
-| No log        | 2.0   | 114  | 0.9733          | 0.54     |
-| No log        | 3.0   | 171  | 0.9905          | 0.54     |
-| No log        | 4.0   | 228  | 0.9821          | 0.54     |
-| No log        | 5.0   | 285  | 0.9751          | 0.54     |
-| No log        | 6.0   | 342  | 0.9539          | 0.5      |
-| No log        | 7.0   | 399  | 0.8997          | 0.6      |
-| No log        | 8.0   | 456  | 0.9743          | 0.58     |
-| 0.8725        | 9.0   | 513  | 0.9948          | 0.6      |
-| 0.8725        | 10.0  | 570  | 0.9743          | 0.62     |
+| No log        | 1.0   | 57   | 0.8640          | 0.62     |
+| No log        | 2.0   | 114  | 0.9607          | 0.6      |
+| No log        | 3.0   | 171  | 0.7265          | 0.66     |
+| No log        | 4.0   | 228  | 1.0422          | 0.66     |
+| No log        | 5.0   | 285  | 1.4504          | 0.72     |
+| No log        | 6.0   | 342  | 1.8535          | 0.62     |
+| No log        | 7.0   | 399  | 2.0748          | 0.56     |
+| No log        | 8.0   | 456  | 2.2474          | 0.56     |
+| 0.3567        | 9.0   | 513  | 2.1608          | 0.62     |
+| 0.3567        | 10.0  | 570  | 2.2266          | 0.58     |
 
 
 ### Framework versions

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:82f181353fec0551244589a38d7e12de6dc7064e93472a0a1f48041cf50fdce1
+oid sha256:e19796f0852f31d7482cab20bc1ca3669ecd67beca748c0df3343c5e757ea86f
 size 438022317

runs/Sep12_10-11-38_f75bc58113e9/events.out.tfevents.1631442376.f75bc58113e9.87.8

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3349cb86792acd1dcbd19ad8acfb9e1e119cdd4436eefc35328ca4c6ffb09c48
+size 363

runs/Sep12_10-26-19_f75bc58113e9/1631442384.2107968/events.out.tfevents.1631442384.f75bc58113e9.87.10

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0bc9fdfc2b3dbb483281a861d1fcbf123720d0a5bde8fd2f193fba4db4431cf6
+size 4247

runs/Sep12_10-26-19_f75bc58113e9/events.out.tfevents.1631442384.f75bc58113e9.87.9

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:39c187786a3fe6a63d3333aed5a5069d1548d4b0c14c9cd1d247eee8293e9636
+size 6878

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3a7bca9fb952f01eeba995f7ccfaca471be1c10b77f8ec6a2173ed8db3bf8ae7
+oid sha256:c9f440d4b88e47f1d85cb71db8682c6017251adb715627c82ac906ae88b0374f
 size 2735