Hugging Face's logo

dfoc99
/
scibert_scivocab_uncased-finetuned-Astronomy_Thesaurus

PEFT
PyTorch
TensorBoard
Safetensors
Generated from Trainer
Model card Files Metrics Community
dfoc99 commited on
Commit
29316c7
•
1 Parent(s): b84c218

Model save

Browse files
Files changed (5) hide show
  1. README.md +1 -19
  2. adapter_config.json +2 -2
  3. adapter_model.safetensors +1 -1
  4. runs/May12_16-49-35_50a639f2ff59/events.out.tfevents.1715532576.50a639f2ff59.2166.1 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -14,8 +14,6 @@ should probably proofread and complete it, then remove this comment. -->
14
  # scibert_scivocab_uncased-finetuned-Astronomy_Thesaurus
15
 
16
  This model is a fine-tuned version of [allenai/scibert_scivocab_uncased](https://huggingface.co/allenai/scibert_scivocab_uncased) on the None dataset.
17
- It achieves the following results on the evaluation set:
18
- - Loss: 2.5494
19
 
20
  ## Model description
21
 
@@ -40,23 +38,7 @@ The following hyperparameters were used during training:
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 10
44
-
45
- ### Training results
46
-
47
- | Training Loss | Epoch | Step | Validation Loss |
48
- |:-------------:|:-----:|:----:|:---------------:|
49
- | 7.8513 | 1.0 | 879 | 3.3446 |
50
- | 3.4222 | 2.0 | 1758 | 2.9664 |
51
- | 3.147 | 3.0 | 2637 | 2.8005 |
52
- | 3.0225 | 4.0 | 3516 | 2.7150 |
53
- | 2.9826 | 5.0 | 4395 | 2.6758 |
54
- | 2.9196 | 6.0 | 5274 | 2.6177 |
55
- | 2.8821 | 7.0 | 6153 | 2.5606 |
56
- | 2.8403 | 8.0 | 7032 | 2.5730 |
57
- | 2.8357 | 9.0 | 7911 | 2.5714 |
58
- | 2.8381 | 10.0 | 8790 | 2.5494 |
59
-
60
 
61
  ### Framework versions
62
 
 
14
  # scibert_scivocab_uncased-finetuned-Astronomy_Thesaurus
15
 
16
  This model is a fine-tuned version of [allenai/scibert_scivocab_uncased](https://huggingface.co/allenai/scibert_scivocab_uncased) on the None dataset.
 
 
17
 
18
  ## Model description
19
 
 
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
+ - num_epochs: 6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
42
 
43
  ### Framework versions
44
 
adapter_config.json CHANGED
@@ -20,8 +20,8 @@
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
23
- "value",
24
- "query"
25
  ],
26
  "task_type": "CAUSAL_LM",
27
  "use_dora": false,
 
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
23
+ "query",
24
+ "value"
25
  ],
26
  "task_type": "CAUSAL_LM",
27
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b584993e3f0f7a87477c5ad2547348417f9ee4ed16f5b7d4c889a20bbb3407bd
3
  size 154056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5e12d7807867348755b78f6fecc292a962e950bb377c19ebafc247c94119902
3
  size 154056
runs/May12_16-49-35_50a639f2ff59/events.out.tfevents.1715532576.50a639f2ff59.2166.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a30c5d7713230904f28091b0f2b9c76f7d83c57b53cc01e65a023a35e27df7d
3
+ size 4708
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d22d8155613ac2adea3f38bcce5ca5e70e6c1d4a581f112d7b17f5083247b550
3
  size 5048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80b54fbb684d3da633b81375944962507a739e410a7000bac4ff6dca668c59d0
3
  size 5048