bertje_dutch-cola / README.md
WideMan's picture
Update README.md
8fe57fb verified
|
raw
history blame
No virus
1.04 kB
metadata
datasets:
  - GroNLP/dutch-cola
language:
  - nl
tags:
  - generated from trainer
metrics:
  - accuracy
bass-model: GroNLP/bert-base-dutch-cased

Model Card for Model ID

This model is a fine-tuned version of GroNLP/bert-base-dutch-cased on GroNLP/dutch-cola. It achieves the following results on the evaluation set:

  • Loss: 0.5693
  • Accuracy: 0.7838

Training Hyperparameters

The following hyperparameters were used during training:

  • learning rate: 2e-05
  • train_batch_size: 16
  • eval_batch_size: 16
  • seed: 42
  • num_epochs=3

Training results

Training Loss Epoch Step Validation Loss Accuracy
0.5233 1.0 1244 0.5762 0.7396
0.2903 2.0 2488 0.5693 0.7838
0.1699 3.0 3732 0.8232 0.7846