Doniaa commited on
Commit
8b6fb85
1 Parent(s): fd4325f

End of training

Browse files
README.md CHANGED
@@ -14,6 +14,8 @@ should probably proofread and complete it, then remove this comment. -->
14
  # distilroberta-base-finetuned-wikitext2
15
 
16
  This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on an unknown dataset.
 
 
17
 
18
  ## Model description
19
 
@@ -40,6 +42,17 @@ The following hyperparameters were used during training:
40
  - lr_scheduler_type: linear
41
  - num_epochs: 5
42
 
 
 
 
 
 
 
 
 
 
 
 
43
  ### Framework versions
44
 
45
  - Transformers 4.35.2
 
14
  # distilroberta-base-finetuned-wikitext2
15
 
16
  This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 3.2548
19
 
20
  ## Model description
21
 
 
42
  - lr_scheduler_type: linear
43
  - num_epochs: 5
44
 
45
+ ### Training results
46
+
47
+ | Training Loss | Epoch | Step | Validation Loss |
48
+ |:-------------:|:-----:|:----:|:---------------:|
49
+ | No log | 1.0 | 425 | 3.6676 |
50
+ | 4.0717 | 2.0 | 850 | 3.4692 |
51
+ | 3.5577 | 3.0 | 1275 | 3.3515 |
52
+ | 3.4352 | 4.0 | 1700 | 3.2840 |
53
+ | 3.3733 | 5.0 | 2125 | 3.2548 |
54
+
55
+
56
  ### Framework versions
57
 
58
  - Transformers 4.35.2
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0f3f0b07d453196154c9ecfe9e75d0e469346dc0651281154e15264a5022f4e7
3
  size 333405852
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a88ad148b0dcfd535188387902f59a69a8aaa320d26d0f14d4701c5823433e16
3
  size 333405852
runs/Feb13_10-10-26_6565e45b9066/events.out.tfevents.1707819033.6565e45b9066.2013.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2afffeb1dde9d67f0b1b2710667b3e8f209800457010ccfb384d8ce25d999450
3
- size 6021
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e003c3925939c3c43929ccd5309a7c80a2f748e2380b59b41d7dc14b1d370da9
3
+ size 6646
runs/Feb13_10-10-26_6565e45b9066/events.out.tfevents.1707819505.6565e45b9066.2013.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fccadf2f953ccfff3de73084d0a873f45547f6b7cfc71458840b33cbba28314
3
+ size 630