Model: pminha/roberta-base-squad-i8-f32-p50
Author: pminha
Pipeline: question-answering
Library: transformers
Tags: transformers, safetensors, roberta, question-answering, arxiv:1910.09700, model-index, endpoints_compatible, 8-bit, bitsandbytes, region:us
Card metadata: model-index: name: pminha/roberta-base-squad-i8-f32-p50
results: task: type: question-answering
dataset: name: squad_v2
type: squad_v2
metrics: type: squad_v2
value: exact: 79.21334119430641
f1: 82.18690598735579
total: 11873
HasAns_exact: 75.7085020242915
HasAns_f1: 81.66415903979015
HasAns_total: 5928
NoAns_exact: 82.70815811606391
NoAns_f1: 82.70815811606391
NoAns_total: 5945
best_exact: 79.21334119430641
best_exact_thresh: 0.10000000149011612
best_f1: 82.18690598735564
best_f1_thresh: 0.10000000149011612
name: squad_v2
verified: no
Likes: 0 | All-time downloads: 5
Created: 2023-12-14 14:24:31