lewtun HF staff commited on
Commit
9618ae2
1 Parent(s): 54d10aa

Add evaluation results on the plain_text config of squad

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the plain_text config of the [squad](https://huggingface.co/datasets/squad) dataset by @sjrlee, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-squad-6abc415f-12465657).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=squad).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=squad).

Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -27,6 +27,23 @@ model-index:
27
  type: f1
28
  value: 91.1623
29
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  ---
31
  # deberta-v3-large for QA
32
 
 
27
  type: f1
28
  value: 91.1623
29
  verified: true
30
+ - task:
31
+ type: question-answering
32
+ name: Question Answering
33
+ dataset:
34
+ name: squad
35
+ type: squad
36
+ config: plain_text
37
+ split: validation
38
+ metrics:
39
+ - name: Exact Match
40
+ type: exact_match
41
+ value: 89.2366
42
+ verified: true
43
+ - name: F1
44
+ type: f1
45
+ value: 95.0569
46
+ verified: true
47
  ---
48
  # deberta-v3-large for QA
49