File size: 1,019 Bytes
1d3789c b5ad28c 1d3789c 2ea06d0 1d3789c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 |
---
datasets:
- GroNLP/dutch-cola
language:
- nl
pipeline_tag: text-classification
---
This model is a fine-tuned version of [pdelobelle/robbert-v2-dutch-base](https://huggingface.co/pdelobelle/robbert-v2-dutch-base) on [GroNLP/dutch-cola](https://huggingface.co/datasets/GroNLP/dutch-cola), from where only the acceptable and unacceptable examples were used to fine-tune. The data used for fine-tuning therefore only contains sentences with original mark 'None' and '*'.
Accuracy: 0.8055
The following hyperparameters were used during training:
learning rate: 4e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
num_epochs: 4
| Epoch | Training Loss | Step | Validation Loss | Accuracy |
|:-----:|:-------------:|:----:|:---------------:|:--------:|
| 1.0 | 0.5078 | 1169 | 0.5111 | 0.7732 |
| 2.0 | 0.3076 | 2338 | 0.6988 | 0.7700 |
| 3.0 | 0.1901 | 3507 | 0.8459 | 0.8027 |
| 4.0 | 0.1198 | 4676 | 1.0620 | 0.8055 | |