haji2438 commited on
Commit
4a908f4
1 Parent(s): f1f7c1f

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -6
README.md CHANGED
@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  This model is a fine-tuned version of [vinai/bertweet-base](https://huggingface.co/vinai/bertweet-base) on the None dataset.
15
  It achieves the following results on the evaluation set:
16
- - Loss: 0.0590
17
 
18
  ## Model description
19
 
@@ -38,20 +38,22 @@ The following hyperparameters were used during training:
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
- - num_epochs: 3.0
 
42
 
43
  ### Training results
44
 
45
  | Training Loss | Epoch | Step | Validation Loss |
46
  |:-------------:|:-----:|:----:|:---------------:|
47
- | 0.1308 | 1.0 | 1465 | 0.1093 |
48
- | 0.0665 | 2.0 | 2930 | 0.0638 |
49
- | 0.0579 | 3.0 | 4395 | 0.0590 |
 
50
 
51
 
52
  ### Framework versions
53
 
54
  - Transformers 4.15.0
55
  - Pytorch 1.10.0+cu111
56
- - Datasets 1.17.0
57
  - Tokenizers 0.10.3
 
13
 
14
  This model is a fine-tuned version of [vinai/bertweet-base](https://huggingface.co/vinai/bertweet-base) on the None dataset.
15
  It achieves the following results on the evaluation set:
16
+ - Loss: 0.0490
17
 
18
  ## Model description
19
 
 
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
+ - lr_scheduler_warmup_steps: 500
42
+ - num_epochs: 4
43
 
44
  ### Training results
45
 
46
  | Training Loss | Epoch | Step | Validation Loss |
47
  |:-------------:|:-----:|:----:|:---------------:|
48
+ | 0.0787 | 1.0 | 1465 | 0.0751 |
49
+ | 0.0662 | 2.0 | 2930 | 0.0628 |
50
+ | 0.053 | 3.0 | 4395 | 0.0531 |
51
+ | 0.0452 | 4.0 | 5860 | 0.0490 |
52
 
53
 
54
  ### Framework versions
55
 
56
  - Transformers 4.15.0
57
  - Pytorch 1.10.0+cu111
58
+ - Datasets 1.18.0
59
  - Tokenizers 0.10.3