Hugging Face's logo

Hemg
/
mask-langauge-modeling

Fill-Mask
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
Hemg commited on
Commit
f1ab2e7
•
1 Parent(s): 4b223ba

End of training

Browse files
Files changed (4) hide show
  1. README.md +14 -4
  2. model.safetensors +1 -1
  3. runs/May21_10-39-40_d6267c37c073/events.out.tfevents.1716287981.d6267c37c073.34.5 +2 -2
  4. runs/May21_10-39-40_d6267c37c073/events.out.tfevents.1716290161.d6267c37c073.34.6 +3 -0
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.6692
19
 
20
  ## Model description
21
 
@@ -40,14 +40,24 @@ The following hyperparameters were used during training:
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 2
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 0.8888 | 1.0 | 598 | 0.8278 |
50
- | 0.7817 | 2.0 | 1196 | 0.6901 |
 
 
 
 
 
 
 
 
 
 
51
 
52
 
53
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.4731
19
 
20
  ## Model description
21
 
 
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
+ - num_epochs: 12
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | 0.8107 | 1.0 | 598 | 0.8552 |
50
+ | 0.8572 | 2.0 | 1196 | 0.8273 |
51
+ | 0.8655 | 3.0 | 1794 | 0.7705 |
52
+ | 0.8348 | 4.0 | 2392 | 0.7156 |
53
+ | 0.792 | 5.0 | 2990 | 0.6761 |
54
+ | 0.701 | 6.0 | 3588 | 0.6323 |
55
+ | 0.665 | 7.0 | 4186 | 0.6005 |
56
+ | 0.6257 | 8.0 | 4784 | 0.5602 |
57
+ | 0.5966 | 9.0 | 5382 | 0.5298 |
58
+ | 0.5674 | 10.0 | 5980 | 0.5153 |
59
+ | 0.5102 | 11.0 | 6578 | 0.4995 |
60
+ | 0.4888 | 12.0 | 7176 | 0.4816 |
61
 
62
 
63
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8191ac174185e87d059397ed556ee84c434c2604ab21f48094e9054ef3bf568a
3
  size 328693404
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66ac8022d033421c8056b66f7a9951ac52860a91d15b5fe5ca238b812c544d68
3
  size 328693404
runs/May21_10-39-40_d6267c37c073/events.out.tfevents.1716287981.d6267c37c073.34.5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:74e815165872fa9e1db7d1e0d72aa28ffe7366323213eda13288c07612c5c4cd
3
- size 10594
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6bfd87f97599f955e70bc5cf687764fcb39987a16ccb58467f33e5e05993b0d6
3
+ size 11219
runs/May21_10-39-40_d6267c37c073/events.out.tfevents.1716290161.d6267c37c073.34.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8c4578323984fc99210694037135825528e4929ef423de7787edb3dd1b4f41d
3
+ size 359