Commit
•
c7f5967
1
Parent(s):
b62eae0
Add evaluation results on the default config and test split of banking77
Browse filesBeep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the default config and test split of the [banking77](https://huggingface.co/datasets/banking77) dataset by @edcody726ai@gmail.com, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-banking77-default-2a251d-51750145317).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=banking77).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=banking77).
README.md
CHANGED
@@ -10,8 +10,8 @@ model-index:
|
|
10 |
- name: bert-base-banking77-pt2
|
11 |
results:
|
12 |
- task:
|
13 |
-
name: Text Classification
|
14 |
type: text-classification
|
|
|
15 |
dataset:
|
16 |
name: banking77
|
17 |
type: banking77
|
@@ -19,9 +19,64 @@ model-index:
|
|
19 |
split: test
|
20 |
args: default
|
21 |
metrics:
|
22 |
-
-
|
23 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
24 |
value: 0.9317233921464609
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
25 |
---
|
26 |
|
27 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
|
10 |
- name: bert-base-banking77-pt2
|
11 |
results:
|
12 |
- task:
|
|
|
13 |
type: text-classification
|
14 |
+
name: Text Classification
|
15 |
dataset:
|
16 |
name: banking77
|
17 |
type: banking77
|
|
|
19 |
split: test
|
20 |
args: default
|
21 |
metrics:
|
22 |
+
- type: f1
|
23 |
+
value: 0.9317233921464609
|
24 |
+
name: F1
|
25 |
+
- type: accuracy
|
26 |
+
value: 0.9314935064935065
|
27 |
+
name: Accuracy
|
28 |
+
verified: true
|
29 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMjY1YjNmMmU2NjA1MWQzZDFjZGFjNGMyMTI5NDEyZDUxYzVhZGU0ODg2YTVkNjRlMjBiYjMxODhhYTZlNWM0MCIsInZlcnNpb24iOjF9.IUNAxfr2I6Hzlw4lfL2hpRr6l7FjlEw_RRvZ22QWaLZz9UDMjb4AH5TOgdOJC8perX_bNx8FIOmauoAKPxq7BQ
|
30 |
+
- type: f1
|
31 |
+
value: 0.9317233921464607
|
32 |
+
name: F1 Macro
|
33 |
+
verified: true
|
34 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZThkMzFhMjkxZDQ4ZmUxYWJjMjNjNmI1ZDViMWIwNTBlZDhiY2ZkOTBhYmNmNzY2NDU4N2VkYzJjNWU5NTg4YiIsInZlcnNpb24iOjF9.CAhnot8MNpJs6EXdKRfIkuPsM-xxCF1tiQgsIPyWSKa-oxYUyOAwp2xLVplhs46ieAYae0Oc40wp1G6wbXbtAQ
|
35 |
+
- type: f1
|
36 |
+
value: 0.9314935064935065
|
37 |
+
name: F1 Micro
|
38 |
+
verified: true
|
39 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNDBiYzZjMDQ4Nzc3NTA0NjVjOTg5NDAwNzRkNzgzY2ZlNTQ4MjhiNDJjMDZiZjg1MDg1MWZkYTE2ODFhYmMzZSIsInZlcnNpb24iOjF9.ppMuNFW1HLajj9ekBL1ETTMyIx6juF3_5cDBOFsJc2sXnEBFV8m2eN9nWYdWAikDZndRuW2075qHe7uNmq4OAw
|
40 |
+
- type: f1
|
41 |
value: 0.9317233921464609
|
42 |
+
name: F1 Weighted
|
43 |
+
verified: true
|
44 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjM2NWJkZmQ4MDQ4NmY5YjcxNDgyMjlkYzczNDNjZTkxZjQ0NWZlMjM2YzUzY2NlOGI0MjYyNWRlZTJkM2RiMCIsInZlcnNpb24iOjF9.e723X-Eg0Rpov7F7nmWp70_GnFpNkLRjo-_sHe0HG_RxABKkun1EBIQWNJANWialb8-OuB3JQxV65lAeEySYAA
|
45 |
+
- type: precision
|
46 |
+
value: 0.935331493948515
|
47 |
+
name: Precision Macro
|
48 |
+
verified: true
|
49 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZTdhYWM0NWM5ZDMwODg1ZjlhZWNjMmIxZjI0ZTk2NjVmYzFkMWVjMzg1NGEyYzAwN2UzZWY4MmYxYmVhNjk0NyIsInZlcnNpb24iOjF9.uEUA0UVZOV5FwpRQSp2Qq3DzHwdbGxJFxicStScMlSkjuHMacnk7ef2IND1jfHSfQuSDe99tUxptXiVkxsnPBw
|
50 |
+
- type: precision
|
51 |
+
value: 0.9314935064935065
|
52 |
+
name: Precision Micro
|
53 |
+
verified: true
|
54 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNGMwMWFhZmFhYmI4NGY2NTBjYTdmMGY1NTQyZTg1YTlhYjdjMjdiNzJiNGJlNjYwZmM1NDVmMTZlMzhkMTViYSIsInZlcnNpb24iOjF9.F6A9SyuZU1-2iQhjDphl6FH7Y82VLf6El80xhkKHF5R4yIt5CuxSys7JGJxG9Czk0cKoKa1jNO4Sa2DsOi-RDw
|
55 |
+
- type: precision
|
56 |
+
value: 0.935331493948515
|
57 |
+
name: Precision Weighted
|
58 |
+
verified: true
|
59 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNzcxMDg1MjBmNWViYTdlOGVhZDk0YjI4NzY3ZjUyN2VmNzQ4ZWU0NThjNmQyOTMwZDY4MjJkMDZhZTBiNjQ0ZSIsInZlcnNpb24iOjF9.HtZVD_SLgeGpodpk-47YC7PTq9nm5mqzITdYlTV7qb45vj8ho56uCbTZnckLpqNaVi6v_JOakWLu8w1R9x84AA
|
60 |
+
- type: recall
|
61 |
+
value: 0.9314935064935064
|
62 |
+
name: Recall Macro
|
63 |
+
verified: true
|
64 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMTkwN2Q0Y2IyMDhkMmQ4OWU5NWQwODZhYzIzMjJhZjZhNTA2MGNkZDZjOWYxNGU3MDA1ZWQ0ZTk4YTY0NzdmMSIsInZlcnNpb24iOjF9.yqP7d_wKUZwpEAJMUydtaio3lcKrpmNyW55ff3Vgoyo9St_6u8etZ-0TF6ZRBATGToIFRHMuE5guYpL6m3FCCQ
|
65 |
+
- type: recall
|
66 |
+
value: 0.9314935064935065
|
67 |
+
name: Recall Micro
|
68 |
+
verified: true
|
69 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiODIwZTEyZjNlZGJmOGY1ZjMxNTIwOTFkOWUwMmFkMzc3NWIzNDhkY2VmNjg4NDY4NmNkMzVlYzhkNGM3ZjVkZiIsInZlcnNpb24iOjF9.OTkmGT6RE35MSrJbBoOQ7PWZ1hwmdDaFxFRx8LA5EJ16vrIQwZk0x5BV5HiYHDiPLbWCcNl0h7ZvMQHltKv1Aw
|
70 |
+
- type: recall
|
71 |
+
value: 0.9314935064935065
|
72 |
+
name: Recall Weighted
|
73 |
+
verified: true
|
74 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMzgwODVlOGRkMmU4ZmQwMWI2ZmNmMmM5Y2YzMDYwYmZkZjRhZDcwZWZhZGUwMjgxY2Y5OTY5NDk1NmJmMmNlMyIsInZlcnNpb24iOjF9.Sbzw-QrX-iAHjSGUhkD8Nktdm9oDpAxAlSDk5QjRup5Opgw6GV_WkY-b_Bd7ael09Iuz3fRzMW_HmXJNONYRCA
|
75 |
+
- type: loss
|
76 |
+
value: 0.29947027564048767
|
77 |
+
name: loss
|
78 |
+
verified: true
|
79 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZWViNjEwNTk0NmFiNDZhMTFmM2U0NTFhNzQ0ZWI4YTY2ZGQ4Njk1ZDNmZWY1YjNiODBkMGZkY2ZiMjA2ZDRkYiIsInZlcnNpb24iOjF9.MRAAGw6uHaZmkWVo8AjGxGbOdl1I2NyOfN9ABf_MWMMiOhWKjstczMgiKHAPmA5rYgC3E5DtI44zU-YybO25BA
|
80 |
---
|
81 |
|
82 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|