autoevaluator HF staff commited on
Commit
695f21d
1 Parent(s): 65f7840

Add evaluation results on the amazon config and test split of squadshifts

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the amazon config and test split of the [squadshifts](https://huggingface.co/datasets/squadshifts) dataset by

@viralshanker

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-squadshifts-amazon-74b272-2017966729).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=squadshifts).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=squadshifts).

Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -27,6 +27,23 @@ model-index:
27
  type: total
28
  value: 11869
29
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  ---
31
 
32
  # roberta-base for QA
27
  type: total
28
  value: 11869
29
  verified: true
30
+ - task:
31
+ type: question-answering
32
+ name: Question Answering
33
+ dataset:
34
+ name: squadshifts
35
+ type: squadshifts
36
+ config: amazon
37
+ split: test
38
+ metrics:
39
+ - name: Exact Match
40
+ type: exact_match
41
+ value: 70.14
42
+ verified: true
43
+ - name: F1
44
+ type: f1
45
+ value: 83.3389
46
+ verified: true
47
  ---
48
 
49
  # roberta-base for QA