Hugging Face's logo

Spaces:
gorkaartola
/
Zero_Shot_Classifier_Tester_for_TP_FP
Runtime error

App Files Community
Zero_Shot_Classifier_Tester_for_TP_FP
File size: 14,169 Bytes 
3b2c042
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
 
argmax_max,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,7,2,0.23333333333333334,0.7777777777777778,0.35897435897435903,0.5833333333333334
2,2,288,288,161,132,0.5590277777777778,0.5494880546075085,0.5542168674698795,0.5503472222222222
3,3,87,87,25,15,0.28735632183908044,0.625,0.39370078740157477,0.5574712643678161
4,4,94,94,4,7,0.0425531914893617,0.36363636363636365,0.07619047619047618,0.48404255319148937
5,5,62,62,3,6,0.04838709677419355,0.3333333333333333,0.08450704225352113,0.47580645161290325
6,6,63,63,23,0,0.36507936507936506,1.0,0.5348837209302325,0.6825396825396826
7,7,17,17,4,2,0.23529411764705882,0.6666666666666666,0.3478260869565218,0.5588235294117647
8,8,65,65,8,8,0.12307692307692308,0.5,0.19753086419753088,0.5
9,9,31,31,1,0,0.03225806451612903,1.0,0.0625,0.5161290322580645
10,10,57,57,0,0,0.0,0.0,0.0,0.5
11,11,48,48,1,0,0.020833333333333332,1.0,0.04081632653061225,0.5104166666666666
12,12,36,36,0,1,0.0,0.0,0.0,0.4861111111111111
13,13,17,17,2,0,0.11764705882352941,1.0,0.21052631578947367,0.5588235294117647
14,14,77,77,34,18,0.44155844155844154,0.6538461538461539,0.5271317829457364,0.6038961038961039
15,15,40,40,20,24,0.5,0.45454545454545453,0.47619047619047616,0.45
16,16,29,29,3,8,0.10344827586206896,0.2727272727272727,0.15,0.41379310344827586
17,total,1043,1043,296,223,,,,
18,,,,,Micro avg.,0.2837967401725791,0.5703275529865125,0.37900128040973113,0.5349952061361457
19,,,,,Macro avg.,0.1829325471241527,0.5410012398317959,0.2361761826959056,0.5253843284394821
threshold-0.05,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,2,1,1.0,0.6666666666666666,0.8,0.75
1,1,30,30,25,14,0.8333333333333334,0.6410256410256411,0.7246376811594204,0.6833333333333333
2,2,288,288,276,275,0.9583333333333334,0.5009074410163339,0.6579261025029797,0.5017361111111112
3,3,87,87,84,75,0.9655172413793104,0.5283018867924528,0.6829268292682926,0.5517241379310345
4,4,94,94,78,75,0.8297872340425532,0.5098039215686274,0.631578947368421,0.5159574468085106
5,5,62,62,41,53,0.6612903225806451,0.43617021276595747,0.5256410256410258,0.4032258064516129
6,6,63,63,54,21,0.8571428571428571,0.72,0.782608695652174,0.7619047619047619
7,7,17,17,15,13,0.8823529411764706,0.5357142857142857,0.6666666666666667,0.5588235294117647
8,8,65,65,59,57,0.9076923076923077,0.5086206896551724,0.6519337016574585,0.5153846153846153
9,9,31,31,21,17,0.6774193548387096,0.5526315789473685,0.6086956521739131,0.5645161290322581
10,10,57,57,47,33,0.8245614035087719,0.5875,0.6861313868613139,0.6228070175438597
11,11,48,48,42,43,0.875,0.49411764705882355,0.631578947368421,0.4895833333333333
12,12,36,36,15,15,0.4166666666666667,0.5,0.45454545454545453,0.5
13,13,17,17,15,15,0.8823529411764706,0.5,0.6382978723404256,0.5
14,14,77,77,73,62,0.948051948051948,0.5407407407407407,0.6886792452830189,0.5714285714285714
15,15,40,40,34,33,0.85,0.5074626865671642,0.6355140186915889,0.5125
16,16,29,29,29,29,1.0,0.5,0.6666666666666666,0.5
17,total,1043,1043,910,831,,,,
18,,,,,Micro avg.,0.87248322147651,0.5226881102814475,0.653735632183908,0.5378715244487057
19,,,,,Macro avg.,0.8452648167601986,0.5429213763834844,0.6549428761086612,0.5589955760985156
threshold-0.25,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,1,1,0.5,0.5,0.5,0.5
1,1,30,30,16,7,0.5333333333333333,0.6956521739130435,0.6037735849056605,0.65
2,2,288,288,235,219,0.8159722222222222,0.5176211453744494,0.633423180592992,0.5277777777777778
3,3,87,87,45,41,0.5172413793103449,0.5232558139534884,0.5202312138728324,0.5229885057471264
4,4,94,94,12,22,0.1276595744680851,0.35294117647058826,0.18749999999999997,0.44680851063829785
5,5,62,62,21,27,0.3387096774193548,0.4375,0.3818181818181818,0.45161290322580644
6,6,63,63,44,8,0.6984126984126984,0.8461538461538461,0.765217391304348,0.7857142857142857
7,7,17,17,7,1,0.4117647058823529,0.875,0.56,0.6764705882352942
8,8,65,65,30,33,0.46153846153846156,0.47619047619047616,0.46875,0.47692307692307695
9,9,31,31,5,2,0.16129032258064516,0.7142857142857143,0.2631578947368421,0.5483870967741935
10,10,57,57,17,8,0.2982456140350877,0.68,0.41463414634146345,0.5789473684210527
11,11,48,48,23,18,0.4791666666666667,0.5609756097560976,0.5168539325842697,0.5520833333333334
12,12,36,36,1,0,0.027777777777777776,1.0,0.05405405405405406,0.5138888888888888
13,13,17,17,9,5,0.5294117647058824,0.6428571428571429,0.5806451612903226,0.6176470588235294
14,14,77,77,64,39,0.8311688311688312,0.6213592233009708,0.7111111111111111,0.6623376623376623
15,15,40,40,12,20,0.3,0.375,0.33333333333333326,0.4
16,16,29,29,27,22,0.9310344827586207,0.5510204081632653,0.6923076923076924,0.5862068965517241
17,total,1043,1043,569,473,,,,
18,,,,,Micro avg.,0.5455417066155321,0.5460652591170825,0.5458033573141488,0.5460210930009588
19,,,,,Macro avg.,0.468395736016492,0.6099889841422989,0.4815771104854768,0.5586937619642383
threshold-0.5,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,7,2,0.23333333333333334,0.7777777777777778,0.35897435897435903,0.5833333333333334
2,2,288,288,51,37,0.17708333333333334,0.5795454545454546,0.2712765957446809,0.5243055555555556
3,3,87,87,5,4,0.05747126436781609,0.5555555555555556,0.10416666666666666,0.5057471264367817
4,4,94,94,1,2,0.010638297872340425,0.3333333333333333,0.020618556701030927,0.4946808510638298
5,5,62,62,6,7,0.0967741935483871,0.46153846153846156,0.15999999999999998,0.49193548387096775
6,6,63,63,28,1,0.4444444444444444,0.9655172413793104,0.6086956521739131,0.7142857142857143
7,7,17,17,2,1,0.11764705882352941,0.6666666666666666,0.2,0.5294117647058824
8,8,65,65,2,2,0.03076923076923077,0.5,0.057971014492753624,0.5
9,9,31,31,1,0,0.03225806451612903,1.0,0.0625,0.5161290322580645
10,10,57,57,1,0,0.017543859649122806,1.0,0.034482758620689655,0.5087719298245614
11,11,48,48,3,0,0.0625,1.0,0.11764705882352941,0.53125
12,12,36,36,0,0,0.0,0.0,0.0,0.5
13,13,17,17,0,0,0.0,0.0,0.0,0.5
14,14,77,77,26,13,0.33766233766233766,0.6666666666666666,0.4482758620689655,0.5844155844155844
15,15,40,40,2,4,0.05,0.3333333333333333,0.08695652173913045,0.475
16,16,29,29,12,7,0.41379310344827586,0.631578947368421,0.5,0.5862068965517241
17,total,1043,1043,147,80,,,,
18,,,,,Micro avg.,0.14093959731543623,0.6475770925110133,0.23149606299212597,0.5321188878235859
19,,,,,Macro avg.,0.12246579539813415,0.5571478493038224,0.17832735564739524,0.5320866630765881
threshold-0.75,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,0,0,0.0,0.0,0.0,0.5
2,2,288,288,2,0,0.006944444444444444,1.0,0.013793103448275862,0.5034722222222222
3,3,87,87,0,0,0.0,0.0,0.0,0.5
4,4,94,94,0,0,0.0,0.0,0.0,0.5
5,5,62,62,0,1,0.0,0.0,0.0,0.49193548387096775
6,6,63,63,0,1,0.0,0.0,0.0,0.49206349206349204
7,7,17,17,0,0,0.0,0.0,0.0,0.5
8,8,65,65,0,0,0.0,0.0,0.0,0.5
9,9,31,31,0,0,0.0,0.0,0.0,0.5
10,10,57,57,0,0,0.0,0.0,0.0,0.5
11,11,48,48,0,0,0.0,0.0,0.0,0.5
12,12,36,36,0,0,0.0,0.0,0.0,0.5
13,13,17,17,0,0,0.0,0.0,0.0,0.5
14,14,77,77,3,0,0.03896103896103896,1.0,0.07500000000000001,0.5194805194805194
15,15,40,40,0,0,0.0,0.0,0.0,0.5
16,16,29,29,2,0,0.06896551724137931,1.0,0.12903225806451613,0.5344827586206896
17,total,1043,1043,7,2,,,,
18,,,,,Micro avg.,0.006711409395973154,0.7777777777777778,0.013307984790874526,0.5023969319271333
19,,,,,Macro avg.,0.0067571176851095715,0.17647058823529413,0.012813256559576,0.5024373221328172
topk-9,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,2,0,1.0,1.0,1.0,1.0
1,1,30,30,24,11,0.8,0.6857142857142857,0.7384615384615385,0.7166666666666667
2,2,288,288,282,273,0.9791666666666666,0.5081081081081081,0.6690391459074734,0.515625
3,3,87,87,85,78,0.9770114942528736,0.5214723926380368,0.6800000000000002,0.5402298850574713
4,4,94,94,84,82,0.8936170212765957,0.5060240963855421,0.6461538461538462,0.5106382978723404
5,5,62,62,30,41,0.4838709677419355,0.4225352112676056,0.45112781954887216,0.4112903225806452
6,6,63,63,53,17,0.8412698412698413,0.7571428571428571,0.7969924812030075,0.7857142857142857
7,7,17,17,16,15,0.9411764705882353,0.5161290322580645,0.6666666666666666,0.5294117647058824
8,8,65,65,53,56,0.8153846153846154,0.48623853211009177,0.6091954022988506,0.47692307692307695
9,9,31,31,28,22,0.9032258064516129,0.56,0.691358024691358,0.5967741935483871
10,10,57,57,45,25,0.7894736842105263,0.6428571428571429,0.7086614173228346,0.6754385964912281
11,11,48,48,40,34,0.8333333333333334,0.5405405405405406,0.6557377049180328,0.5625
12,12,36,36,13,5,0.3611111111111111,0.7222222222222222,0.4814814814814815,0.6111111111111112
13,13,17,17,17,11,1.0,0.6071428571428571,0.7555555555555554,0.6764705882352942
14,14,77,77,72,58,0.935064935064935,0.5538461538461539,0.6956521739130435,0.5909090909090909
15,15,40,40,40,40,1.0,0.5,0.6666666666666666,0.5
16,16,29,29,29,29,1.0,0.5,0.6666666666666666,0.5
17,total,1043,1043,913,797,,,,
18,,,,,Micro avg.,0.87535953978907,0.5339181286549708,0.6632764257173992,0.5556088207094918
19,,,,,Macro avg.,0.8561003498442518,0.5899984371902064,0.6811421524385818,0.599982522342087
topk-7,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,2,0,1.0,1.0,1.0,1.0
1,1,30,30,21,10,0.7,0.6774193548387096,0.6885245901639343,0.6833333333333333
2,2,288,288,281,266,0.9756944444444444,0.5137111517367459,0.6730538922155689,0.5260416666666666
3,3,87,87,82,68,0.9425287356321839,0.5466666666666666,0.6919831223628692,0.5804597701149425
4,4,94,94,72,76,0.7659574468085106,0.4864864864864865,0.5950413223140495,0.4787234042553192
5,5,62,62,24,36,0.3870967741935484,0.4,0.39344262295081966,0.4032258064516129
6,6,63,63,52,11,0.8253968253968254,0.8253968253968254,0.8253968253968254,0.8253968253968254
7,7,17,17,14,11,0.8235294117647058,0.56,0.6666666666666666,0.5882352941176471
8,8,65,65,49,48,0.7538461538461538,0.5051546391752577,0.6049382716049383,0.5076923076923077
9,9,31,31,19,14,0.6129032258064516,0.5757575757575758,0.59375,0.5806451612903226
10,10,57,57,35,20,0.6140350877192983,0.6363636363636364,0.625,0.631578947368421
11,11,48,48,29,24,0.6041666666666666,0.5471698113207547,0.5742574257425742,0.5520833333333334
12,12,36,36,8,3,0.2222222222222222,0.7272727272727273,0.3404255319148936,0.5694444444444444
13,13,17,17,15,8,0.8823529411764706,0.6521739130434783,0.75,0.7058823529411765
14,14,77,77,71,48,0.922077922077922,0.5966386554621849,0.7244897959183674,0.6493506493506493
15,15,40,40,40,40,1.0,0.5,0.6666666666666666,0.5
16,16,29,29,29,29,1.0,0.5,0.6666666666666666,0.5
17,total,1043,1043,843,712,,,,
18,,,,,Micro avg.,0.8082454458293384,0.5421221864951768,0.6489607390300232,0.5627996164908916
19,,,,,Macro avg.,0.7665769328091413,0.6029536143247676,0.6517825529755787,0.6048290174562942
topk-5,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,1,0,0.5,1.0,0.6666666666666666,0.75
1,1,30,30,16,7,0.5333333333333333,0.6956521739130435,0.6037735849056605,0.65
2,2,288,288,276,248,0.9583333333333334,0.5267175572519084,0.6798029556650246,0.5486111111111112
3,3,87,87,80,62,0.9195402298850575,0.5633802816901409,0.6986899563318778,0.603448275862069
4,4,94,94,51,60,0.5425531914893617,0.4594594594594595,0.4975609756097561,0.4521276595744681
5,5,62,62,19,28,0.3064516129032258,0.40425531914893614,0.34862385321100914,0.4274193548387097
6,6,63,63,49,7,0.7777777777777778,0.875,0.823529411764706,0.8333333333333334
7,7,17,17,13,8,0.7647058823529411,0.6190476190476191,0.6842105263157895,0.6470588235294118
8,8,65,65,38,35,0.5846153846153846,0.5205479452054794,0.5507246376811594,0.5230769230769231
9,9,31,31,12,8,0.3870967741935484,0.6,0.47058823529411764,0.5645161290322581
10,10,57,57,26,10,0.45614035087719296,0.7222222222222222,0.5591397849462365,0.6403508771929824
11,11,48,48,18,9,0.375,0.6666666666666666,0.4800000000000001,0.59375
12,12,36,36,6,1,0.16666666666666666,0.8571428571428571,0.27906976744186046,0.5694444444444444
13,13,17,17,11,5,0.6470588235294118,0.6875,0.6666666666666667,0.6764705882352942
14,14,77,77,70,43,0.9090909090909091,0.6194690265486725,0.736842105263158,0.6753246753246753
15,15,40,40,40,39,1.0,0.5063291139240507,0.6722689075630253,0.5125
16,16,29,29,29,27,1.0,0.5178571428571429,0.6823529411764707,0.5344827586206896
17,total,1043,1043,755,597,,,,
18,,,,,Micro avg.,0.7238734419942474,0.5584319526627219,0.6304801670146138,0.5757430488974113
19,,,,,Macro avg.,0.6369626041204791,0.6377204344163646,0.5941477045001873,0.6001126443633159
topk-3,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,1,0,0.5,1.0,0.6666666666666666,0.75
1,1,30,30,9,3,0.3,0.75,0.4285714285714285,0.6
2,2,288,288,250,206,0.8680555555555556,0.5482456140350878,0.6720430107526882,0.5763888888888888
3,3,87,87,57,42,0.6551724137931034,0.5757575757575758,0.6129032258064515,0.5862068965517241
4,4,94,94,26,37,0.2765957446808511,0.4126984126984127,0.3312101910828026,0.44148936170212766
5,5,62,62,13,13,0.20967741935483872,0.5,0.29545454545454547,0.5
6,6,63,63,40,1,0.6349206349206349,0.975609756097561,0.7692307692307692,0.8095238095238095
7,7,17,17,10,5,0.5882352941176471,0.6666666666666666,0.625,0.6470588235294118
8,8,65,65,17,17,0.26153846153846155,0.5,0.3434343434343435,0.5
9,9,31,31,3,3,0.0967741935483871,0.5,0.16216216216216214,0.5
10,10,57,57,6,5,0.10526315789473684,0.5454545454545454,0.1764705882352941,0.5087719298245614
11,11,48,48,6,2,0.125,0.75,0.21428571428571427,0.5416666666666666
12,12,36,36,1,1,0.027777777777777776,0.5,0.05263157894736842,0.5
13,13,17,17,5,2,0.29411764705882354,0.7142857142857143,0.4166666666666667,0.5882352941176471
14,14,77,77,62,34,0.8051948051948052,0.6458333333333334,0.7167630057803468,0.6818181818181818
15,15,40,40,40,35,1.0,0.5333333333333333,0.6956521739130436,0.5625
16,16,29,29,29,24,1.0,0.5471698113207547,0.7073170731707317,0.5862068965517241
17,total,1043,1043,575,430,,,,
18,,,,,Micro avg.,0.551294343240652,0.572139303482587,0.5615234375,0.5695110258868649
19,,,,,Macro avg.,0.4557837120844484,0.6273561625284109,0.4639095967153543,0.5811686323043966