Hugging Face's logo

BoghdadyJR
/
my_awesome_eli5_mlm_model

Fill-Mask
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
BoghdadyJR commited on
Commit
dc7a3c3
•
1 Parent(s): 66edc45

End of training

Browse files
Files changed (4) hide show
  1. README.md +21 -20
  2. model.safetensors +1 -1
  3. runs/Jul23_09-18-35_c9a0361e418e/events.out.tfevents.1721726317.c9a0361e418e.34.4 +2 -2
  4. runs/Jul23_09-18-35_c9a0361e418e/events.out.tfevents.1721726429.c9a0361e418e.34.5 +3 -0
README.md CHANGED
@@ -1,10 +1,10 @@
1
  ---
2
- base_model: distilbert/distilroberta-base
3
- datasets:
4
- - eli5_category
5
  license: apache-2.0
 
6
  tags:
7
  - generated_from_trainer
 
 
8
  model-index:
9
  - name: my_awesome_eli5_mlm_model
10
  results: []
@@ -13,13 +13,14 @@ model-index:
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
  should probably proofread and complete it, then remove this comment. -->
15
 
 
16
  [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/boghdady95/huggingface/runs/q49i6qgl)
17
  [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/boghdady95/huggingface/runs/q49i6qgl)
18
  # my_awesome_eli5_mlm_model
19
 
20
- This model is a fine-tuned version of [distilbert/distilroberta-base](https://huggingface.co/distilbert/distilroberta-base) on the eli5_category dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.0000
23
 
24
  ## Model description
25
 
@@ -50,21 +51,21 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss |
52
  |:-------------:|:-----:|:----:|:---------------:|
53
- | No log | 1.0 | 43 | 0.0408 |
54
- | No log | 2.0 | 86 | 0.0216 |
55
- | No log | 3.0 | 129 | 0.0176 |
56
- | No log | 4.0 | 172 | 0.0263 |
57
- | No log | 5.0 | 215 | 0.0103 |
58
- | No log | 6.0 | 258 | 0.0195 |
59
- | No log | 7.0 | 301 | 0.0138 |
60
- | No log | 8.0 | 344 | 0.0082 |
61
- | No log | 9.0 | 387 | 0.0127 |
62
- | No log | 10.0 | 430 | 0.0067 |
63
- | No log | 11.0 | 473 | 0.0035 |
64
- | 0.02 | 12.0 | 516 | 0.0000 |
65
- | 0.02 | 13.0 | 559 | 0.0000 |
66
- | 0.02 | 14.0 | 602 | 0.0001 |
67
- | 0.02 | 15.0 | 645 | 0.0000 |
68
 
69
 
70
  ### Framework versions
 
1
  ---
 
 
 
2
  license: apache-2.0
3
+ base_model: BoghdadyJR/my_awesome_eli5_mlm_model
4
  tags:
5
  - generated_from_trainer
6
+ datasets:
7
+ - eli5_category
8
  model-index:
9
  - name: my_awesome_eli5_mlm_model
10
  results: []
 
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
  should probably proofread and complete it, then remove this comment. -->
15
 
16
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/boghdady95/huggingface/runs/q49i6qgl)
17
  [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/boghdady95/huggingface/runs/q49i6qgl)
18
  [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/boghdady95/huggingface/runs/q49i6qgl)
19
  # my_awesome_eli5_mlm_model
20
 
21
+ This model is a fine-tuned version of [BoghdadyJR/my_awesome_eli5_mlm_model](https://huggingface.co/BoghdadyJR/my_awesome_eli5_mlm_model) on the eli5_category dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 0.0005
24
 
25
  ## Model description
26
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:-----:|:----:|:---------------:|
54
+ | No log | 1.0 | 43 | 0.0000 |
55
+ | No log | 2.0 | 86 | 0.0015 |
56
+ | No log | 3.0 | 129 | 0.0002 |
57
+ | No log | 4.0 | 172 | 0.0000 |
58
+ | No log | 5.0 | 215 | 0.0000 |
59
+ | No log | 6.0 | 258 | 0.0103 |
60
+ | No log | 7.0 | 301 | 0.0002 |
61
+ | No log | 8.0 | 344 | 0.0000 |
62
+ | No log | 9.0 | 387 | 0.0000 |
63
+ | No log | 10.0 | 430 | 0.0000 |
64
+ | No log | 11.0 | 473 | 0.0000 |
65
+ | 0.0031 | 12.0 | 516 | 0.0000 |
66
+ | 0.0031 | 13.0 | 559 | 0.0000 |
67
+ | 0.0031 | 14.0 | 602 | 0.0000 |
68
+ | 0.0031 | 15.0 | 645 | 0.0000 |
69
 
70
 
71
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:53eb5f7ca1802580e7dce28b24dabe0152645c9c7b928afc549788ada2263c8c
3
  size 328693404
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2d3c408461a9c86a54412657471d4759c1a0e5ae56f67596a21455a0ab88bc1
3
  size 328693404
runs/Jul23_09-18-35_c9a0361e418e/events.out.tfevents.1721726317.c9a0361e418e.34.4 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d7ae080fb3f476a61af9a4338d81dc1dbc1b3d7a643fa4234fdc18ebd98796fe
3
- size 8104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcee4d6d5210f5e944945852f98cd5b9f39dc3c72ae0fe3e40bfdffa3b32c905
3
+ size 9542
runs/Jul23_09-18-35_c9a0361e418e/events.out.tfevents.1721726429.c9a0361e418e.34.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73f90f5debfe44b166a3347e27ba2c689deafd8d0486d05224d83f16638b678b
3
+ size 359