autoevaluator HF staff commited on
Commit
e224b59
1 Parent(s): 6f774f7

Add evaluation results on the amazon config and test split of squadshifts

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 馃憢!\
Your model has been evaluated on the amazon config and test split of the [squadshifts](https://huggingface.co/datasets/squadshifts) dataset by

@viralshanker

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-squadshifts-amazon-74b272-2017966728).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=squadshifts).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=squadshifts).

Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -23,6 +23,23 @@ model-index:
23
  type: f1
24
  value: 81.7181
25
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
26
  ---
27
 
28
  # electra-base for QA
 
23
  type: f1
24
  value: 81.7181
25
  verified: true
26
+ - task:
27
+ type: question-answering
28
+ name: Question Answering
29
+ dataset:
30
+ name: squadshifts
31
+ type: squadshifts
32
+ config: amazon
33
+ split: test
34
+ metrics:
35
+ - name: Exact Match
36
+ type: exact_match
37
+ value: 64.6108
38
+ verified: true
39
+ - name: F1
40
+ type: f1
41
+ value: 80.0934
42
+ verified: true
43
  ---
44
 
45
  # electra-base for QA