haritzpuerto
/

xtremedistil-l6-h256-uncased-squad_1.1

Question Answering Transformers PyTorch

English bert QA Question Answering SQuAD Eval Results Inference Endpoints

Model card Files Files and versions Community

Edit model card

microsoft/xtremedistil-l6-h256-uncased fined-tuned on SQuAD (https://huggingface.co/datasets/squad)

Hyperparameters:

epochs: 1
lr: 1e-5
train batch sie: 16
optimizer: adamW
lr_scheduler: linear
num warming steps: 0
max_length: 512

Results on the dev set:

'exact_match': 62.66792809839168
'f1': 74.99490608582015

Downloads last month: 17

Dataset used to train haritzpuerto/xtremedistil-l6-h256-uncased-squad_1.1

Evaluation results

SQuAD EM on SQuAD
validation set self-reported

62.668
SQuAD F1 on SQuAD
validation set self-reported

74.995

View on Papers With Code