indiejoseph commited on
Commit
8876b51
1 Parent(s): 99a14fc

Model save

Browse files
Files changed (3) hide show
  1. README.md +13 -10
  2. generation_config.json +1 -1
  3. pytorch_model.bin +1 -1
README.md CHANGED
@@ -1,5 +1,4 @@
1
  ---
2
- base_model: bert-base-cantonese/
3
  tags:
4
  - generated_from_trainer
5
  model-index:
@@ -12,7 +11,7 @@ should probably proofread and complete it, then remove this comment. -->
12
 
13
  # bert-base-cantonese
14
 
15
- This model is a fine-tuned version of [bert-base-cantonese/](https://huggingface.co/bert-base-cantonese/) on an unknown dataset.
16
 
17
  ## Model description
18
 
@@ -31,19 +30,23 @@ More information needed
31
  ### Training hyperparameters
32
 
33
  The following hyperparameters were used during training:
34
- - learning_rate: 0.0001
35
- - train_batch_size: 16
36
  - eval_batch_size: 8
37
  - seed: 42
38
- - gradient_accumulation_steps: 4
39
- - total_train_batch_size: 64
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
42
- - num_epochs: 3.0
 
 
 
 
43
 
44
  ### Framework versions
45
 
46
- - Transformers 4.33.1
47
- - Pytorch 2.0.1+cu117
48
  - Datasets 2.14.5
49
- - Tokenizers 0.13.3
 
1
  ---
 
2
  tags:
3
  - generated_from_trainer
4
  model-index:
 
11
 
12
  # bert-base-cantonese
13
 
14
+ This model was trained from scratch on an unknown dataset.
15
 
16
  ## Model description
17
 
 
30
  ### Training hyperparameters
31
 
32
  The following hyperparameters were used during training:
33
+ - learning_rate: 5e-05
34
+ - train_batch_size: 24
35
  - eval_batch_size: 8
36
  - seed: 42
37
+ - gradient_accumulation_steps: 8
38
+ - total_train_batch_size: 192
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
+ - num_epochs: 7.0
42
+
43
+ ### Training results
44
+
45
+
46
 
47
  ### Framework versions
48
 
49
+ - Transformers 4.34.0.dev0
50
+ - Pytorch 2.0.1+cu118
51
  - Datasets 2.14.5
52
+ - Tokenizers 0.14.0
generation_config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
  "_from_model_config": true,
3
  "pad_token_id": 0,
4
- "transformers_version": "4.33.1"
5
  }
 
1
  {
2
  "_from_model_config": true,
3
  "pad_token_id": 0,
4
+ "transformers_version": "4.34.0.dev0"
5
  }
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f156828927234eddfeb2c3454af80e276c9507051b7fac9af3d800522d40f2b2
3
  size 410768181
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b855ecef316f5c2d8ff1333c9950d277252996423e95c50c31e770e37289e97
3
  size 410768181