lewtun HF staff commited on
Commit
8f6a1df
1 Parent(s): fd38a65

Add evaluation results on the mrpc config of glue

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the mrpc config of the [glue](https://huggingface.co/datasets/glue) dataset by

@lewtun

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-glue-e9a4b61a-13985914).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=glue).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=glue).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -24,6 +24,39 @@ model-index:
24
  - name: F1
25
  type: f1
26
  value: 0.8998302207130731
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
27
  ---
28
 
29
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
24
  - name: F1
25
  type: f1
26
  value: 0.8998302207130731
27
+ - task:
28
+ type: natural-language-inference
29
+ name: Natural Language Inference
30
+ dataset:
31
+ name: glue
32
+ type: glue
33
+ config: mrpc
34
+ split: validation
35
+ metrics:
36
+ - name: Accuracy
37
+ type: accuracy
38
+ value: 0.8553921568627451
39
+ verified: true
40
+ - name: Precision
41
+ type: precision
42
+ value: 0.8548387096774194
43
+ verified: true
44
+ - name: Recall
45
+ type: recall
46
+ value: 0.9498207885304659
47
+ verified: true
48
+ - name: AUC
49
+ type: auc
50
+ value: 0.91568725514712
51
+ verified: true
52
+ - name: F1
53
+ type: f1
54
+ value: 0.8998302207130731
55
+ verified: true
56
+ - name: loss
57
+ type: loss
58
+ value: 0.36538368463516235
59
+ verified: true
60
  ---
61
 
62
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You