andyqin18 commited on
Commit
ceb65db
1 Parent(s): cf13f54

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -9
README.md CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: -1.0673
18
 
19
  ## Model description
20
 
@@ -34,8 +34,8 @@ More information needed
34
 
35
  The following hyperparameters were used during training:
36
  - learning_rate: 2e-05
37
- - train_batch_size: 128
38
- - eval_batch_size: 256
39
  - seed: 42
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
@@ -45,16 +45,15 @@ The following hyperparameters were used during training:
45
 
46
  | Training Loss | Epoch | Step | Validation Loss |
47
  |:-------------:|:-----:|:----:|:---------------:|
48
- | No log | 1.0 | 16 | -0.3245 |
49
- | No log | 2.0 | 32 | -0.8025 |
50
- | No log | 3.0 | 48 | -1.0064 |
51
- | No log | 4.0 | 64 | -1.0578 |
52
- | No log | 5.0 | 80 | -1.0673 |
53
 
54
 
55
  ### Framework versions
56
 
57
  - Transformers 4.28.1
58
  - Pytorch 2.0.0+cu118
59
- - Datasets 2.11.0
60
  - Tokenizers 0.13.3
 
14
 
15
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.0507
18
 
19
  ## Model description
20
 
 
34
 
35
  The following hyperparameters were used during training:
36
  - learning_rate: 2e-05
37
+ - train_batch_size: 16
38
+ - eval_batch_size: 16
39
  - seed: 42
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
 
45
 
46
  | Training Loss | Epoch | Step | Validation Loss |
47
  |:-------------:|:-----:|:----:|:---------------:|
48
+ | 0.0525 | 1.0 | 1250 | 0.0482 |
49
+ | 0.037 | 2.0 | 2500 | 0.0445 |
50
+ | 0.0275 | 3.0 | 3750 | 0.0489 |
51
+ | 0.0188 | 4.0 | 5000 | 0.0491 |
52
+ | 0.0146 | 5.0 | 6250 | 0.0507 |
53
 
54
 
55
  ### Framework versions
56
 
57
  - Transformers 4.28.1
58
  - Pytorch 2.0.0+cu118
 
59
  - Tokenizers 0.13.3