dfoc99 commited on
Commit
bda1376
1 Parent(s): 09c78ce

Model save

Browse files
README.md CHANGED
@@ -14,6 +14,8 @@ should probably proofread and complete it, then remove this comment. -->
14
  # scibert_scivocab_uncased-finetuned-Astronomy_Thesaurus
15
 
16
  This model is a fine-tuned version of [allenai/scibert_scivocab_uncased](https://huggingface.co/allenai/scibert_scivocab_uncased) on the None dataset.
 
 
17
 
18
  ## Model description
19
 
@@ -38,7 +40,23 @@ The following hyperparameters were used during training:
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
- - num_epochs: 6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
42
 
43
  ### Framework versions
44
 
 
14
  # scibert_scivocab_uncased-finetuned-Astronomy_Thesaurus
15
 
16
  This model is a fine-tuned version of [allenai/scibert_scivocab_uncased](https://huggingface.co/allenai/scibert_scivocab_uncased) on the None dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 1.3614
19
 
20
  ## Model description
21
 
 
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
+ - num_epochs: 10
44
+
45
+ ### Training results
46
+
47
+ | Training Loss | Epoch | Step | Validation Loss |
48
+ |:-------------:|:-----:|:----:|:---------------:|
49
+ | 1.5312 | 1.0 | 879 | 1.3809 |
50
+ | 1.4987 | 2.0 | 1758 | 1.4107 |
51
+ | 1.495 | 3.0 | 2637 | 1.3687 |
52
+ | 1.4667 | 4.0 | 3516 | 1.3820 |
53
+ | 1.4754 | 5.0 | 4395 | 1.3756 |
54
+ | 1.4635 | 6.0 | 5274 | 1.3619 |
55
+ | 1.4763 | 7.0 | 6153 | 1.3646 |
56
+ | 1.4534 | 8.0 | 7032 | 1.3713 |
57
+ | 1.4606 | 9.0 | 7911 | 1.3868 |
58
+ | 1.4703 | 10.0 | 8790 | 1.3614 |
59
+
60
 
61
  ### Framework versions
62
 
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0bd8c3a606f7b062bfc4415a8e347cff6287858746f496e44651d36332e254b5
3
  size 154056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:beb23ea3d93bffc8909bc9e33f4c94ef249b2540ca1a550b81463733c6741dcc
3
  size 154056
runs/May12_21-04-37_6f8063d06c3b/events.out.tfevents.1715547878.6f8063d06c3b.157.14 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0a43132862fbdf374a347653d28250e92470d731b4f989ef2e7f49bcc435fe96
3
- size 10735
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab94f7ce405ef865941fae862f4197a6d421099d93bce8b8dee3efa3d056c1fb
3
+ size 11360