Hugging Face's logo

Spaces:
gorkaartola
/
Zero_Shot_Classifier_Tester_for_TP_FP
Runtime error

App Files Community
Zero_Shot_Classifier_Tester_for_TP_FP
File size: 13,238 Bytes 
1f825b8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
 
argmax_max,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,1,0,0.03333333333333333,1.0,0.06451612903225806,0.5166666666666667
2,2,288,288,135,173,0.46875,0.4383116883116883,0.45302013422818793,0.4340277777777778
3,3,87,87,4,3,0.04597701149425287,0.5714285714285714,0.08510638297872342,0.5057471264367817
4,4,94,94,1,0,0.010638297872340425,1.0,0.021052631578947368,0.5053191489361702
5,5,62,62,0,0,0.0,0.0,0.0,0.5
6,6,63,63,0,0,0.0,0.0,0.0,0.5
7,7,17,17,0,0,0.0,0.0,0.0,0.5
8,8,65,65,0,0,0.0,0.0,0.0,0.5
9,9,31,31,0,0,0.0,0.0,0.0,0.5
10,10,57,57,0,0,0.0,0.0,0.0,0.5
11,11,48,48,0,0,0.0,0.0,0.0,0.5
12,12,36,36,13,14,0.3611111111111111,0.48148148148148145,0.4126984126984127,0.4861111111111111
13,13,17,17,0,0,0.0,0.0,0.0,0.5
14,14,77,77,2,2,0.025974025974025976,0.5,0.04938271604938272,0.5
15,15,40,40,0,0,0.0,0.0,0.0,0.5
16,16,29,29,0,0,0.0,0.0,0.0,0.5
17,total,1043,1043,156,192,,,,
18,,,,,Micro avg.,0.14956855225311602,0.4482758620689655,0.22429906542056077,0.4827420901246405
19,,,,,Macro avg.,0.05563433998735669,0.2347777494836318,0.06386920038623012,0.49693363711344163
threshold-0.05,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,2,2,1.0,0.5,0.6666666666666666,0.5
1,1,30,30,30,29,1.0,0.5084745762711864,0.6741573033707865,0.5166666666666667
2,2,288,288,277,285,0.9618055555555556,0.4928825622775801,0.651764705882353,0.4861111111111111
3,3,87,87,81,81,0.9310344827586207,0.5,0.6506024096385543,0.5
4,4,94,94,88,89,0.9361702127659575,0.4971751412429379,0.6494464944649446,0.4946808510638298
5,5,62,62,62,62,1.0,0.5,0.6666666666666666,0.5
6,6,63,63,61,62,0.9682539682539683,0.4959349593495935,0.6559139784946236,0.49206349206349204
7,7,17,17,16,16,0.9411764705882353,0.5,0.6530612244897959,0.5
8,8,65,65,63,62,0.9692307692307692,0.504,0.6631578947368421,0.5076923076923077
9,9,31,31,28,25,0.9032258064516129,0.5283018867924528,0.6666666666666666,0.5483870967741935
10,10,57,57,57,54,1.0,0.5135135135135135,0.6785714285714285,0.5263157894736842
11,11,48,48,46,48,0.9583333333333334,0.48936170212765956,0.6478873239436619,0.4791666666666667
12,12,36,36,36,36,1.0,0.5,0.6666666666666666,0.5
13,13,17,17,16,17,0.9411764705882353,0.48484848484848486,0.64,0.47058823529411764
14,14,77,77,77,76,1.0,0.5032679738562091,0.6695652173913044,0.5064935064935064
15,15,40,40,34,36,0.85,0.4857142857142857,0.6181818181818183,0.475
16,16,29,29,28,28,0.9655172413793104,0.5,0.6588235294117647,0.5
17,total,1043,1043,1002,1008,,,,
18,,,,,Micro avg.,0.9606903163950143,0.49850746268656715,0.6564035375040943,0.4971236816874401
19,,,,,Macro avg.,0.9603484888767999,0.5002044168231707,0.6575176467790909,0.5001862190176222
threshold-0.25,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,2,0.0,0.0,0.0,0.0
1,1,30,30,27,25,0.9,0.5192307692307693,0.6585365853658537,0.5333333333333333
2,2,288,288,214,237,0.7430555555555556,0.4745011086474501,0.5791610284167795,0.4600694444444444
3,3,87,87,47,53,0.5402298850574713,0.47,0.502673796791444,0.46551724137931033
4,4,94,94,43,56,0.4574468085106383,0.43434343434343436,0.44559585492227977,0.4308510638297872
5,5,62,62,54,60,0.8709677419354839,0.47368421052631576,0.6136363636363635,0.45161290322580644
6,6,63,63,53,43,0.8412698412698413,0.5520833333333334,0.6666666666666667,0.5793650793650794
7,7,17,17,11,8,0.6470588235294118,0.5789473684210527,0.6111111111111113,0.5882352941176471
8,8,65,65,51,43,0.7846153846153846,0.5425531914893617,0.6415094339622641,0.5615384615384615
9,9,31,31,11,14,0.3548387096774194,0.44,0.3928571428571428,0.45161290322580644
10,10,57,57,47,40,0.8245614035087719,0.5402298850574713,0.6527777777777778,0.5614035087719298
11,11,48,48,39,45,0.8125,0.4642857142857143,0.5909090909090908,0.4375
12,12,36,36,34,30,0.9444444444444444,0.53125,0.6799999999999999,0.5555555555555556
13,13,17,17,13,10,0.7647058823529411,0.5652173913043478,0.65,0.5882352941176471
14,14,77,77,72,66,0.935064935064935,0.5217391304347826,0.6697674418604651,0.538961038961039
15,15,40,40,9,10,0.225,0.47368421052631576,0.30508474576271183,0.4875
16,16,29,29,20,21,0.6896551724137931,0.4878048780487805,0.5714285714285714,0.4827586206896552
17,total,1043,1043,745,763,,,,
18,,,,,Micro avg.,0.7142857142857143,0.49403183023872677,0.5840846726773814,0.4913710450623202
19,,,,,Macro avg.,0.6667890934080054,0.4746796838617135,0.543042094792266,0.48082645544444125
threshold-0.5,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,1,0.0,0.0,0.0,0.25
1,1,30,30,12,7,0.4,0.631578947368421,0.4897959183673469,0.5833333333333334
2,2,288,288,107,110,0.3715277777777778,0.4930875576036866,0.42376237623762375,0.4947916666666667
3,3,87,87,17,22,0.19540229885057472,0.4358974358974359,0.2698412698412699,0.47126436781609193
4,4,94,94,16,21,0.1702127659574468,0.43243243243243246,0.24427480916030533,0.4734042553191489
5,5,62,62,21,26,0.3387096774193548,0.44680851063829785,0.3853211009174311,0.4596774193548387
6,6,63,63,26,18,0.4126984126984127,0.5909090909090909,0.48598130841121495,0.5634920634920635
7,7,17,17,6,2,0.35294117647058826,0.75,0.48,0.6176470588235294
8,8,65,65,28,18,0.4307692307692308,0.6086956521739131,0.5045045045045046,0.5769230769230769
9,9,31,31,5,10,0.16129032258064516,0.3333333333333333,0.21739130434782605,0.41935483870967744
10,10,57,57,28,16,0.49122807017543857,0.6363636363636364,0.5544554455445544,0.6052631578947368
11,11,48,48,27,20,0.5625,0.574468085106383,0.5684210526315789,0.5729166666666666
12,12,36,36,28,17,0.7777777777777778,0.6222222222222222,0.6913580246913581,0.6527777777777778
13,13,17,17,2,3,0.11764705882352941,0.4,0.1818181818181818,0.47058823529411764
14,14,77,77,42,41,0.5454545454545454,0.5060240963855421,0.5249999999999999,0.5064935064935064
15,15,40,40,5,3,0.125,0.625,0.20833333333333334,0.525
16,16,29,29,9,12,0.3103448275862069,0.42857142857142855,0.36000000000000004,0.4482758620689655
17,total,1043,1043,379,347,,,,
18,,,,,Micro avg.,0.36337488015340363,0.522038567493113,0.4284906726964387,0.5153403643336529
19,,,,,Macro avg.,0.3390296436671487,0.5009054370003425,0.38766227234156053,0.5112472521549529
threshold-0.75,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,3,0,0.1,1.0,0.18181818181818182,0.55
2,2,288,288,21,12,0.07291666666666667,0.6363636363636364,0.13084112149532712,0.515625
3,3,87,87,5,4,0.05747126436781609,0.5555555555555556,0.10416666666666666,0.5057471264367817
4,4,94,94,3,1,0.031914893617021274,0.75,0.061224489795918366,0.5106382978723404
5,5,62,62,2,0,0.03225806451612903,1.0,0.0625,0.5161290322580645
6,6,63,63,0,1,0.0,0.0,0.0,0.49206349206349204
7,7,17,17,1,1,0.058823529411764705,0.5,0.10526315789473684,0.5
8,8,65,65,2,2,0.03076923076923077,0.5,0.057971014492753624,0.5
9,9,31,31,0,2,0.0,0.0,0.0,0.46774193548387094
10,10,57,57,5,0,0.08771929824561403,1.0,0.16129032258064516,0.543859649122807
11,11,48,48,4,1,0.08333333333333333,0.8,0.1509433962264151,0.53125
12,12,36,36,3,2,0.08333333333333333,0.6,0.14634146341463414,0.5138888888888888
13,13,17,17,0,0,0.0,0.0,0.0,0.5
14,14,77,77,6,4,0.07792207792207792,0.6,0.1379310344827586,0.512987012987013
15,15,40,40,0,0,0.0,0.0,0.0,0.5
16,16,29,29,3,2,0.10344827586206896,0.6,0.17647058823529413,0.5172413793103449
17,total,1043,1043,58,32,,,,
18,,,,,Micro avg.,0.05560882070949185,0.6444444444444445,0.10238305383936452,0.512464046021093
19,,,,,Macro avg.,0.04822999812029742,0.5024658348187759,0.08686831982960774,0.5104218714366826
topk-9,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,25,24,0.8333333333333334,0.5102040816326531,0.6329113924050633,0.5166666666666667
2,2,288,288,279,284,0.96875,0.4955595026642984,0.655699177438308,0.4913194444444444
3,3,87,87,82,83,0.9425287356321839,0.49696969696969695,0.6507936507936507,0.4942528735632184
4,4,94,94,91,86,0.9680851063829787,0.5141242937853108,0.6715867158671587,0.526595744680851
5,5,62,62,45,44,0.7258064516129032,0.5056179775280899,0.5960264900662252,0.5080645161290323
6,6,63,63,0,1,0.0,0.0,0.0,0.49206349206349204
7,7,17,17,2,2,0.11764705882352941,0.5,0.19047619047619047,0.5
8,8,65,65,18,19,0.27692307692307694,0.4864864864864865,0.35294117647058826,0.49230769230769234
9,9,31,31,1,7,0.03225806451612903,0.125,0.05128205128205128,0.4032258064516129
10,10,57,57,50,48,0.8771929824561403,0.5102040816326531,0.6451612903225806,0.5175438596491229
11,11,48,48,7,4,0.14583333333333334,0.6363636363636364,0.23728813559322035,0.53125
12,12,36,36,36,36,1.0,0.5,0.6666666666666666,0.5
13,13,17,17,12,12,0.7058823529411765,0.5,0.5853658536585366,0.5
14,14,77,77,74,75,0.961038961038961,0.4966442953020134,0.654867256637168,0.4935064935064935
15,15,40,40,14,14,0.35,0.5,0.4117647058823529,0.5
16,16,29,29,6,4,0.20689655172413793,0.6,0.3076923076923077,0.5344827586206896
17,total,1043,1043,742,743,,,,
18,,,,,Micro avg.,0.7114093959731543,0.49966329966329964,0.5870253164556962,0.49952061361457334
19,,,,,Macro avg.,0.5360103534539932,0.4339514148449905,0.43003076830894527,0.5000752557696068
topk-7,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,24,18,0.8,0.5714285714285714,0.6666666666666666,0.6
2,2,288,288,276,280,0.9583333333333334,0.49640287769784175,0.6540284360189573,0.4930555555555556
3,3,87,87,74,74,0.8505747126436781,0.5,0.6297872340425531,0.5
4,4,94,94,79,72,0.8404255319148937,0.5231788079470199,0.6448979591836734,0.5372340425531915
5,5,62,62,24,12,0.3870967741935484,0.6666666666666666,0.4897959183673469,0.5967741935483871
6,6,63,63,0,0,0.0,0.0,0.0,0.5
7,7,17,17,0,0,0.0,0.0,0.0,0.5
8,8,65,65,2,3,0.03076923076923077,0.4,0.05714285714285715,0.49230769230769234
9,9,31,31,0,0,0.0,0.0,0.0,0.5
10,10,57,57,45,35,0.7894736842105263,0.5625,0.656934306569343,0.5877192982456141
11,11,48,48,1,0,0.020833333333333332,1.0,0.04081632653061225,0.5104166666666666
12,12,36,36,36,36,1.0,0.5,0.6666666666666666,0.5
13,13,17,17,6,8,0.35294117647058826,0.42857142857142855,0.3870967741935484,0.4411764705882353
14,14,77,77,67,68,0.8701298701298701,0.4962962962962963,0.6320754716981132,0.4935064935064935
15,15,40,40,9,5,0.225,0.6428571428571429,0.33333333333333337,0.55
16,16,29,29,2,2,0.06896551724137931,0.5,0.1212121212121212,0.5
17,total,1043,1043,645,613,,,,
18,,,,,Micro avg.,0.6184084372003835,0.5127186009538951,0.560625814863103,0.5153403643336529
19,,,,,Macro avg.,0.4232084214259047,0.42870010538029224,0.35179141597798774,0.5177759066454021
topk-5,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,12,8,0.4,0.6,0.48,0.5666666666666667
2,2,288,288,267,273,0.9270833333333334,0.49444444444444446,0.644927536231884,0.4895833333333333
3,3,87,87,46,46,0.5287356321839081,0.5,0.5139664804469274,0.5
4,4,94,94,54,51,0.574468085106383,0.5142857142857142,0.5427135678391959,0.5159574468085106
5,5,62,62,6,3,0.0967741935483871,0.6666666666666666,0.16901408450704225,0.5241935483870968
6,6,63,63,0,0,0.0,0.0,0.0,0.5
7,7,17,17,0,0,0.0,0.0,0.0,0.5
8,8,65,65,0,2,0.0,0.0,0.0,0.4846153846153846
9,9,31,31,0,0,0.0,0.0,0.0,0.5
10,10,57,57,26,19,0.45614035087719296,0.5777777777777777,0.5098039215686275,0.5614035087719298
11,11,48,48,0,0,0.0,0.0,0.0,0.5
12,12,36,36,36,36,1.0,0.5,0.6666666666666666,0.5
13,13,17,17,1,2,0.058823529411764705,0.3333333333333333,0.1,0.47058823529411764
14,14,77,77,43,40,0.5584415584415584,0.5180722891566265,0.5375000000000001,0.5194805194805194
15,15,40,40,4,4,0.1,0.5,0.16666666666666669,0.5
16,16,29,29,1,0,0.034482758620689655,1.0,0.06666666666666667,0.5172413793103449
17,total,1043,1043,496,484,,,,
18,,,,,Micro avg.,0.47555129434324067,0.5061224489795918,0.4903608502224419,0.5057526366251198
19,,,,,Macro avg.,0.2785264377366598,0.3649753073920331,0.2587015053290398,0.5088076483922297
topk-3,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,5,3,0.16666666666666666,0.625,0.2631578947368421,0.5333333333333333
2,2,288,288,244,258,0.8472222222222222,0.4860557768924303,0.6177215189873417,0.4756944444444444
3,3,87,87,20,18,0.22988505747126436,0.5263157894736842,0.32,0.5114942528735632
4,4,94,94,13,20,0.13829787234042554,0.3939393939393939,0.2047244094488189,0.4627659574468085
5,5,62,62,2,0,0.03225806451612903,1.0,0.0625,0.5161290322580645
6,6,63,63,0,0,0.0,0.0,0.0,0.5
7,7,17,17,0,0,0.0,0.0,0.0,0.5
8,8,65,65,0,1,0.0,0.0,0.0,0.49230769230769234
9,9,31,31,0,0,0.0,0.0,0.0,0.5
10,10,57,57,12,6,0.21052631578947367,0.6666666666666666,0.32,0.5526315789473685
11,11,48,48,0,0,0.0,0.0,0.0,0.5
12,12,36,36,35,33,0.9722222222222222,0.5147058823529411,0.6730769230769229,0.5277777777777778
13,13,17,17,0,0,0.0,0.0,0.0,0.5
14,14,77,77,17,20,0.22077922077922077,0.4594594594594595,0.2982456140350877,0.4805194805194805
15,15,40,40,0,2,0.0,0.0,0.0,0.475
16,16,29,29,0,0,0.0,0.0,0.0,0.5
17,total,1043,1043,348,361,,,,
18,,,,,Micro avg.,0.3336529242569511,0.4908321579689704,0.3972602739726027,0.4937679769894535
19,,,,,Macro avg.,0.16575633188280145,0.2748319393402691,0.1623191976638243,0.5016266794063843