MaVier19 commited on
Commit
42ebe3c
1 Parent(s): e83323e

End of training

Browse files
Files changed (1) hide show
  1. README.md +11 -10
README.md CHANGED
@@ -18,9 +18,9 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [MoritzLaurer/DeBERTa-v3-base-mnli-fever-anli](https://huggingface.co/MoritzLaurer/DeBERTa-v3-base-mnli-fever-anli) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.6389
22
- - Accuracy: 0.8145
23
- - F1: 0.8152
24
 
25
  ## Model description
26
 
@@ -40,22 +40,23 @@ More information needed
40
 
41
  The following hyperparameters were used during training:
42
  - learning_rate: 5e-05
43
- - train_batch_size: 16
44
- - eval_batch_size: 32
45
  - seed: 42
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
  - lr_scheduler_warmup_steps: 500
49
- - num_epochs: 4
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
54
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
55
- | No log | 1.0 | 375 | 1.1511 | 0.5755 | 0.5607 |
56
- | 1.4974 | 2.0 | 750 | 0.7869 | 0.7535 | 0.7525 |
57
- | 0.7908 | 3.0 | 1125 | 0.6635 | 0.8 | 0.8024 |
58
- | 0.5067 | 4.0 | 1500 | 0.6389 | 0.8145 | 0.8152 |
 
59
 
60
 
61
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [MoritzLaurer/DeBERTa-v3-base-mnli-fever-anli](https://huggingface.co/MoritzLaurer/DeBERTa-v3-base-mnli-fever-anli) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.7573
22
+ - Accuracy: 0.82
23
+ - F1: 0.8207
24
 
25
  ## Model description
26
 
 
40
 
41
  The following hyperparameters were used during training:
42
  - learning_rate: 5e-05
43
+ - train_batch_size: 8
44
+ - eval_batch_size: 16
45
  - seed: 42
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
  - lr_scheduler_warmup_steps: 500
49
+ - num_epochs: 5
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
54
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
55
+ | 1.6738 | 1.0 | 750 | 0.8938 | 0.712 | 0.7142 |
56
+ | 0.7626 | 2.0 | 1500 | 0.8021 | 0.7645 | 0.7633 |
57
+ | 0.6333 | 3.0 | 2250 | 0.7307 | 0.7965 | 0.7997 |
58
+ | 0.5001 | 4.0 | 3000 | 0.6905 | 0.817 | 0.8181 |
59
+ | 0.3686 | 5.0 | 3750 | 0.7573 | 0.82 | 0.8207 |
60
 
61
 
62
  ### Framework versions