Question Answering
Transformers
PyTorch
English
roberta
Eval Results
Inference Endpoints
lewtun HF staff commited on
Commit
4841136
1 Parent(s): 075b66c

Add evaluation results on the adversarialQA config of adversarial_qa

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the adversarialQA config of the [adversarial_qa](https://huggingface.co/datasets/adversarial_qa) dataset by

@mbartolo

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-adversarial_qa-8ac5f360-11845581).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=adversarial_qa).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=adversarial_qa).

Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -31,6 +31,23 @@ model-index:
31
  type: f1
32
  value: 94.8172
33
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  ---
35
 
36
  # Model Overview
 
31
  type: f1
32
  value: 94.8172
33
  verified: true
34
+ - task:
35
+ type: question-answering
36
+ name: Question Answering
37
+ dataset:
38
+ name: adversarial_qa
39
+ type: adversarial_qa
40
+ config: adversarialQA
41
+ split: validation
42
+ metrics:
43
+ - name: Exact Match
44
+ type: exact_match
45
+ value: 55.3333
46
+ verified: true
47
+ - name: F1
48
+ type: f1
49
+ value: 66.7464
50
+ verified: true
51
  ---
52
 
53
  # Model Overview