Hugging Face's logo

Shruthi-S
/
wikibert-ten

Transformers
TensorFlow
bert
pretraining
generated_from_keras_callback
Inference Endpoints
Model card Files Community
Shruthi-S commited on
Commit
732e848
•
1 Parent(s): 11d70ae

Upload TFBertForPreTraining

Browse files
Files changed (2) hide show
  1. README.md +14 -7
  2. tf_model.h5 +1 -1
README.md CHANGED
@@ -13,9 +13,9 @@ probably proofread and complete it, then remove this comment. -->
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
- - Train Loss: 8.0391
17
- - Validation Loss: 8.0776
18
- - Epoch: 2
19
 
20
  ## Model description
21
 
@@ -41,14 +41,21 @@ The following hyperparameters were used during training:
41
 
42
  | Train Loss | Validation Loss | Epoch |
43
  |:----------:|:---------------:|:-----:|
44
- | 8.1633 | 8.0818 | 0 |
45
- | 8.0523 | 8.0999 | 1 |
46
- | 8.0391 | 8.0776 | 2 |
 
 
 
 
 
 
 
47
 
48
 
49
  ### Framework versions
50
 
51
  - Transformers 4.37.0
52
  - TensorFlow 2.15.0
53
- - Datasets 2.17.0
54
  - Tokenizers 0.15.1
 
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
+ - Train Loss: 8.0044
17
+ - Validation Loss: 8.0857
18
+ - Epoch: 9
19
 
20
  ## Model description
21
 
 
41
 
42
  | Train Loss | Validation Loss | Epoch |
43
  |:----------:|:---------------:|:-----:|
44
+ | 8.1459 | 8.0861 | 0 |
45
+ | 8.0552 | 8.0951 | 1 |
46
+ | 8.0471 | 8.0924 | 2 |
47
+ | 8.0371 | 8.0916 | 3 |
48
+ | 8.0238 | 8.1087 | 4 |
49
+ | 8.0357 | 8.0828 | 5 |
50
+ | 8.0138 | 8.1030 | 6 |
51
+ | 8.0081 | 8.1145 | 7 |
52
+ | 8.0061 | 8.1055 | 8 |
53
+ | 8.0044 | 8.0857 | 9 |
54
 
55
 
56
  ### Framework versions
57
 
58
  - Transformers 4.37.0
59
  - TensorFlow 2.15.0
60
+ - Datasets 2.17.1
61
  - Tokenizers 0.15.1
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5237c770b7250e755e1a859febe8193dd363d4b4df71ed5a0bfffb3acaab4785
3
  size 479322152
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69c6f99817390a57caea8d545511bffb9168f6615eed87ed65bb359b10703098
3
  size 479322152