lewtun HF staff commited on
Commit
fed3d1c
1 Parent(s): bfed2d8

Add evaluation results on banking77 dataset

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the [banking77](https://huggingface.co/datasets/banking77) dataset by

@lewtun

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-f87a1758-7384797).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=banking77).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=banking77).

Files changed (1) hide show
  1. README.md +62 -8
README.md CHANGED
@@ -8,14 +8,15 @@ metrics:
8
  - accuracy
9
  - f1
10
  widget:
11
- - text: "Could you assist me in finding my lost card?"
12
- example_title: "Example 1"
13
- - text: "I found my lost card. Am I still able to use it?"
14
- example_title: "Example 2"
15
- - text: "Hey, I thought my topup was all done but now the money is gone again – what’s up with that?"
16
- example_title: "Example 3"
17
- - text: "Tell me why my topup wouldn’t go through?"
18
- example_title: "Example 4"
 
19
  model-index:
20
  - name: distilbert-base-uncased-finetuned-banking77
21
  results:
@@ -33,6 +34,59 @@ model-index:
33
  - name: F1
34
  type: f1
35
  value: 0.925018570680639
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
36
  ---
37
 
38
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
8
  - accuracy
9
  - f1
10
  widget:
11
+ - text: Could you assist me in finding my lost card?
12
+ example_title: Example 1
13
+ - text: I found my lost card. Am I still able to use it?
14
+ example_title: Example 2
15
+ - text: "Hey, I thought my topup was all done but now the money is gone again \u2013\
16
+ \ what\u2019s up with that?"
17
+ example_title: Example 3
18
+ - text: "Tell me why my topup wouldn\u2019t go through?"
19
+ example_title: Example 4
20
  model-index:
21
  - name: distilbert-base-uncased-finetuned-banking77
22
  results:
34
  - name: F1
35
  type: f1
36
  value: 0.925018570680639
37
+ - task:
38
+ type: text-classification
39
+ name: Text Classification
40
+ dataset:
41
+ name: banking77
42
+ type: banking77
43
+ config: default
44
+ split: test
45
+ metrics:
46
+ - name: Accuracy
47
+ type: accuracy
48
+ value: 0.925
49
+ verified: true
50
+ - name: Precision Macro
51
+ type: precision
52
+ value: 0.9282769473964405
53
+ verified: true
54
+ - name: Precision Micro
55
+ type: precision
56
+ value: 0.925
57
+ verified: true
58
+ - name: Precision Weighted
59
+ type: precision
60
+ value: 0.9282769473964405
61
+ verified: true
62
+ - name: Recall Macro
63
+ type: recall
64
+ value: 0.9250000000000002
65
+ verified: true
66
+ - name: Recall Micro
67
+ type: recall
68
+ value: 0.925
69
+ verified: true
70
+ - name: Recall Weighted
71
+ type: recall
72
+ value: 0.925
73
+ verified: true
74
+ - name: F1 Macro
75
+ type: f1
76
+ value: 0.9250185706806391
77
+ verified: true
78
+ - name: F1 Micro
79
+ type: f1
80
+ value: 0.925
81
+ verified: true
82
+ - name: F1 Weighted
83
+ type: f1
84
+ value: 0.925018570680639
85
+ verified: true
86
+ - name: loss
87
+ type: loss
88
+ value: 0.2934279143810272
89
+ verified: true
90
  ---
91
 
92
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You