Hugging Face's logo

leobitz
/
bert-tiny-finetuned-wikitext2

TensorBoard
Safetensors
bert
Generated from Trainer
Model card Files Metrics Community
leobitz commited on
Commit
48d8bc3
•
1 Parent(s): 487ba1e

Model save

Browse files
Files changed (4) hide show
  1. README.md +14 -7
  2. model.safetensors +1 -1
  3. runs/Aug18_11-50-54_DESKTOP-NCHPR0T/events.out.tfevents.1723996256.DESKTOP-NCHPR0T.354067.0 +2 -2
  4. runs/Aug18_11-50-54_DESKTOP-NCHPR0T/events.out.tfevents.1724001419.DESKTOP-NCHPR0T.354067.1 +3 -0
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [prajjwal1/bert-tiny](https://huggingface.co/prajjwal1/bert-tiny) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.0001
19
 
20
  ## Model description
21
 
@@ -40,15 +40,22 @@ The following hyperparameters were used during training:
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 3.0
44
 
45
  ### Training results
46
 
47
- | Training Loss | Epoch | Step | Validation Loss |
48
- |:-------------:|:-----:|:-----:|:---------------:|
49
- | 0.1118 | 1.0 | 20864 | 0.0003 |
50
- | 0.0169 | 2.0 | 41728 | 0.0001 |
51
- | 0.0139 | 3.0 | 62592 | 0.0001 |
 
 
 
 
 
 
 
52
 
53
 
54
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [prajjwal1/bert-tiny](https://huggingface.co/prajjwal1/bert-tiny) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 2.7805
19
 
20
  ## Model description
21
 
 
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
+ - num_epochs: 10
44
 
45
  ### Training results
46
 
47
+ | Training Loss | Epoch | Step | Validation Loss |
48
+ |:-------------:|:-----:|:------:|:---------------:|
49
+ | 3.5579 | 1.0 | 16295 | 3.1073 |
50
+ | 3.3944 | 2.0 | 32590 | 2.9692 |
51
+ | 3.2968 | 3.0 | 48885 | 2.8999 |
52
+ | 3.2654 | 4.0 | 65180 | 2.8584 |
53
+ | 3.2519 | 5.0 | 81475 | 2.8261 |
54
+ | 3.2435 | 6.0 | 97770 | 2.8016 |
55
+ | 3.2276 | 7.0 | 114065 | 2.7961 |
56
+ | 3.1999 | 8.0 | 130360 | 2.7843 |
57
+ | 3.1726 | 9.0 | 146655 | 2.7742 |
58
+ | 3.1774 | 10.0 | 162950 | 2.7833 |
59
 
60
 
61
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b603369f57e008a1380198b8f521b78f47054fd018ab27e8715c3300874e84aa
3
  size 17671560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b799d23fc0d9d4febdbf221215d95c19de8c05c5346e8fdbfba8f9c1506a445f
3
  size 17671560
runs/Aug18_11-50-54_DESKTOP-NCHPR0T/events.out.tfevents.1723996256.DESKTOP-NCHPR0T.354067.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:274619fe8cbd22ea7b7cd58e74b54866e44e1ad4d5881d92b99762f81f34c6ff
3
- size 76783
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:344baecf0e8589ef5b8e74c28fa8b7322064bde8f5513340b167942ed187a4d2
3
+ size 77419
runs/Aug18_11-50-54_DESKTOP-NCHPR0T/events.out.tfevents.1724001419.DESKTOP-NCHPR0T.354067.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8773552bdb8853cf13d113b49d11d0885db102ef2b9c780befd9e32d9d82480d
3
+ size 364