lewtun HF staff commited on
Commit
e6dacf0
1 Parent(s): fd38a65

Add evaluation results on the mrpc config of glue

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the mrpc config of the [glue](https://huggingface.co/datasets/glue) dataset by

@lewtun

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-glue-fa8727be-13825907).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=glue).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=glue).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -24,6 +24,39 @@ model-index:
24
  - name: F1
25
  type: f1
26
  value: 0.8998302207130731
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
27
  ---
28
 
29
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
24
  - name: F1
25
  type: f1
26
  value: 0.8998302207130731
27
+ - task:
28
+ type: natural-language-inference
29
+ name: Natural Language Inference
30
+ dataset:
31
+ name: glue
32
+ type: glue
33
+ config: mrpc
34
+ split: test
35
+ metrics:
36
+ - name: Accuracy
37
+ type: accuracy
38
+ value: 0.8226086956521739
39
+ verified: true
40
+ - name: Precision
41
+ type: precision
42
+ value: 0.8372093023255814
43
+ verified: true
44
+ - name: Recall
45
+ type: recall
46
+ value: 0.9102005231037489
47
+ verified: true
48
+ - name: AUC
49
+ type: auc
50
+ value: 0.8902771786185113
51
+ verified: true
52
+ - name: F1
53
+ type: f1
54
+ value: 0.8721804511278195
55
+ verified: true
56
+ - name: loss
57
+ type: loss
58
+ value: 0.4117553234100342
59
+ verified: true
60
  ---
61
 
62
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You