matr1xx commited on
Commit
06123e8
1 Parent(s): 8d0a3a8

End of training

Browse files
Files changed (2) hide show
  1. README.md +11 -11
  2. generation_config.json +1 -1
README.md CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [allenai/scibert_scivocab_uncased](https://huggingface.co/allenai/scibert_scivocab_uncased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.6660
18
 
19
  ## Model description
20
 
@@ -44,18 +44,18 @@ The following hyperparameters were used during training:
44
 
45
  ### Training results
46
 
47
- | Training Loss | Epoch | Step | Validation Loss |
48
- |:-------------:|:-----:|:----:|:---------------:|
49
- | 1.0053 | 1.0 | 512 | 0.8043 |
50
- | 0.8263 | 2.0 | 1024 | 0.7319 |
51
- | 0.7641 | 3.0 | 1536 | 0.6908 |
52
- | 0.7303 | 4.0 | 2048 | 0.6738 |
53
- | 0.7174 | 5.0 | 2560 | 0.6644 |
54
 
55
 
56
  ### Framework versions
57
 
58
- - Transformers 4.37.2
59
  - Pytorch 2.0.1
60
- - Datasets 2.16.1
61
- - Tokenizers 0.15.1
 
14
 
15
  This model is a fine-tuned version of [allenai/scibert_scivocab_uncased](https://huggingface.co/allenai/scibert_scivocab_uncased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.0501
18
 
19
  ## Model description
20
 
 
44
 
45
  ### Training results
46
 
47
+ | Training Loss | Epoch | Step | Validation Loss |
48
+ |:-------------:|:-----:|:-----:|:---------------:|
49
+ | 0.1075 | 1.0 | 3301 | 0.0635 |
50
+ | 0.0658 | 2.0 | 6602 | 0.0561 |
51
+ | 0.0589 | 3.0 | 9903 | 0.0534 |
52
+ | 0.0555 | 4.0 | 13204 | 0.0513 |
53
+ | 0.0534 | 5.0 | 16505 | 0.0498 |
54
 
55
 
56
  ### Framework versions
57
 
58
+ - Transformers 4.38.2
59
  - Pytorch 2.0.1
60
+ - Datasets 2.18.0
61
+ - Tokenizers 0.15.2
generation_config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
  "_from_model_config": true,
3
  "pad_token_id": 0,
4
- "transformers_version": "4.37.2"
5
  }
 
1
  {
2
  "_from_model_config": true,
3
  "pad_token_id": 0,
4
+ "transformers_version": "4.38.2"
5
  }