WideMan commited on
Commit
97088e9
1 Parent(s): a95ac0d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -18
README.md CHANGED
@@ -15,8 +15,7 @@ base-model: GroNLP/gpt2-small-dutch
15
  This model is a fine-tuned version of [GroNLP/gpt2-small-dutch](https://huggingface.co/GroNLP/gpt2-small-dutch) on [GroNLP/dutch-cola](https://huggingface.co/datasets/GroNLP/dutch-cola).
16
  It achieves the following results on the evaluation set:
17
 
18
- - Loss: 0.5926
19
- - Accuracy: 0.7008
20
 
21
 
22
  ## Training Details
@@ -26,23 +25,9 @@ It achieves the following results on the evaluation set:
26
 
27
  The following hyperparameters were used during training:
28
 
29
- - learning rate: 4e-05
30
  - train_batch_size: 16
31
  - eval_batch_size: 16
32
  - seed: 42
33
- - optimizer: AdamW with lr=4e-05, weight_decay=0.01, betas=(o.9, 0.999) and epsilon=1e-08
34
  - num_epochs=3
35
- - fp16=True
36
- - gradient_acc_step=1
37
-
38
-
39
-
40
- ## Evaluation
41
-
42
- ### Training results
43
-
44
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
45
- |:-------------:|:-----:|:----:|:---------------:|:--------:|
46
- | 0.6750 | 1.0 | 1244 | 0.8253 | 0.5688 |
47
- | 0.5174 | 2.0 | 2488 | 0.5926 | 0.7008 |
48
- | 0.4073 | 3.0 | 3732 | 0.6904 | 0.7004 |
 
15
  This model is a fine-tuned version of [GroNLP/gpt2-small-dutch](https://huggingface.co/GroNLP/gpt2-small-dutch) on [GroNLP/dutch-cola](https://huggingface.co/datasets/GroNLP/dutch-cola).
16
  It achieves the following results on the evaluation set:
17
 
18
+ - Accuracy: 0.7113
 
19
 
20
 
21
  ## Training Details
 
25
 
26
  The following hyperparameters were used during training:
27
 
28
+ - learning rate: 5e-05
29
  - train_batch_size: 16
30
  - eval_batch_size: 16
31
  - seed: 42
 
32
  - num_epochs=3
33
+ - FP16=True