thusken commited on
Commit
d1b5066
1 Parent(s): 04f0b35

End of training

Browse files
Files changed (2) hide show
  1. README.md +15 -8
  2. pytorch_model.bin +1 -1
README.md CHANGED
@@ -14,8 +14,8 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [NbAiLab/nb-bert-base](https://huggingface.co/NbAiLab/nb-bert-base) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.0065
18
- - Mse: 0.0065
19
 
20
  ## Model description
21
 
@@ -41,16 +41,23 @@ The following hyperparameters were used during training:
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
  - lr_scheduler_warmup_steps: 500
44
- - num_epochs: 3
45
  - mixed_precision_training: Native AMP
46
 
47
  ### Training results
48
 
49
- | Training Loss | Epoch | Step | Validation Loss | Mse |
50
- |:-------------:|:-----:|:----:|:---------------:|:------:|
51
- | 0.0095 | 1.0 | 1103 | 0.0061 | 0.0061 |
52
- | 0.0068 | 2.0 | 2206 | 0.0065 | 0.0065 |
53
- | 0.0047 | 3.0 | 3309 | 0.0059 | 0.0059 |
 
 
 
 
 
 
 
54
 
55
 
56
  ### Framework versions
14
 
15
  This model is a fine-tuned version of [NbAiLab/nb-bert-base](https://huggingface.co/NbAiLab/nb-bert-base) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.0073
18
+ - Mse: 0.0073
19
 
20
  ## Model description
21
 
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
  - lr_scheduler_warmup_steps: 500
44
+ - num_epochs: 10
45
  - mixed_precision_training: Native AMP
46
 
47
  ### Training results
48
 
49
+ | Training Loss | Epoch | Step | Validation Loss | Mse |
50
+ |:-------------:|:-----:|:-----:|:---------------:|:------:|
51
+ | 0.0106 | 1.0 | 1103 | 0.0069 | 0.0069 |
52
+ | 0.0073 | 2.0 | 2206 | 0.0072 | 0.0072 |
53
+ | 0.0058 | 3.0 | 3309 | 0.0063 | 0.0063 |
54
+ | 0.0038 | 4.0 | 4412 | 0.0073 | 0.0073 |
55
+ | 0.0025 | 5.0 | 5515 | 0.0064 | 0.0064 |
56
+ | 0.0019 | 6.0 | 6618 | 0.0065 | 0.0065 |
57
+ | 0.0014 | 7.0 | 7721 | 0.0066 | 0.0066 |
58
+ | 0.0011 | 8.0 | 8824 | 0.0067 | 0.0067 |
59
+ | 0.0008 | 9.0 | 9927 | 0.0066 | 0.0066 |
60
+ | 0.0007 | 10.0 | 11030 | 0.0066 | 0.0066 |
61
 
62
 
63
  ### Framework versions
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f38a930f0a76dd741b266752a8729433ff5f742eca4462ffc31c5b5f9e71777f
3
  size 711501869
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b98892882008ee513d4ccb5ba42dba3f33f5803bcef6f8e740d25bdddffb94fe
3
  size 711501869