distilroberta-base fined-tuned on SQuAD (https://huggingface.co/datasets/squad)
Hyperparameters:
- epochs: 1
- lr: 1e-5
- train batch sie: 16
- optimizer: adamW
- lr_scheduler: linear
- num warming steps: 0
- max_length: 512
Results on the dev set:
- 'exact_match': 76.37653736991486
- 'f1': 84.5528918750732
It took 1h 20 min to train on Colab.
- Downloads last month
- 2
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Dataset used to train UKP-SQuARE/distilroberta-squad
Evaluation results
- SQuAD EM on SQuADvalidation set self-reported76.377
- SQuAD F1 on SQuADvalidation set self-reported84.553