File size: 15,364 Bytes
001d6e0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
argmax_max,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,1,0,0.03333333333333333,1.0,0.06451612903225806,0.5166666666666667
2,2,288,288,40,33,0.1388888888888889,0.547945205479452,0.221606648199446,0.5121527777777778
3,3,87,87,38,9,0.4367816091954023,0.8085106382978723,0.5671641791044776,0.6666666666666666
4,4,94,94,0,0,0.0,0.0,0.0,0.5
5,5,62,62,2,0,0.03225806451612903,1.0,0.0625,0.5161290322580645
6,6,63,63,2,0,0.031746031746031744,1.0,0.06153846153846154,0.5158730158730159
7,7,17,17,1,1,0.058823529411764705,0.5,0.10526315789473684,0.5
8,8,65,65,30,23,0.46153846153846156,0.5660377358490566,0.5084745762711864,0.5538461538461539
9,9,31,31,2,1,0.06451612903225806,0.6666666666666666,0.1176470588235294,0.5161290322580645
10,10,57,57,3,2,0.05263157894736842,0.6,0.09677419354838708,0.5087719298245614
11,11,48,48,11,5,0.22916666666666666,0.6875,0.34375,0.5625
12,12,36,36,4,2,0.1111111111111111,0.6666666666666666,0.1904761904761905,0.5277777777777778
13,13,17,17,11,2,0.6470588235294118,0.8461538461538461,0.7333333333333334,0.7647058823529411
14,14,77,77,36,26,0.4675324675324675,0.5806451612903226,0.5179856115107914,0.564935064935065
15,15,40,40,2,2,0.05,0.5,0.09090909090909091,0.5
16,16,29,29,3,2,0.10344827586206896,0.6,0.17647058823529413,0.5172413793103449
17,total,1043,1043,186,108,,,,
18,,,,,Micro avg.,0.17833173537871524,0.6326530612244898,0.2782348541510845,0.537392138063279
19,,,,,Macro avg.,0.17169617478302143,0.6217721129649343,0.22696524816924607,0.5437291399733589
threshold-0.05,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,18,10,0.6,0.6428571428571429,0.6206896551724138,0.6333333333333333
2,2,288,288,242,240,0.8402777777777778,0.5020746887966805,0.6285714285714287,0.5034722222222222
3,3,87,87,83,70,0.9540229885057471,0.5424836601307189,0.6916666666666667,0.5747126436781609
4,4,94,94,55,59,0.5851063829787234,0.4824561403508772,0.5288461538461537,0.4787234042553192
5,5,62,62,53,54,0.8548387096774194,0.4953271028037383,0.6272189349112426,0.49193548387096775
6,6,63,63,59,36,0.9365079365079365,0.6210526315789474,0.7468354430379748,0.6825396825396826
7,7,17,17,14,10,0.8235294117647058,0.5833333333333334,0.6829268292682927,0.6176470588235294
8,8,65,65,64,61,0.9846153846153847,0.512,0.6736842105263159,0.5230769230769231
9,9,31,31,29,26,0.9354838709677419,0.5272727272727272,0.6744186046511628,0.5483870967741935
10,10,57,57,53,53,0.9298245614035088,0.5,0.6503067484662577,0.5
11,11,48,48,48,48,1.0,0.5,0.6666666666666666,0.5
12,12,36,36,32,35,0.8888888888888888,0.47761194029850745,0.6213592233009708,0.4583333333333333
13,13,17,17,16,12,0.9411764705882353,0.5714285714285714,0.7111111111111111,0.6176470588235294
14,14,77,77,75,73,0.974025974025974,0.5067567567567568,0.6666666666666667,0.512987012987013
15,15,40,40,27,32,0.675,0.4576271186440678,0.5454545454545455,0.4375
16,16,29,29,27,29,0.9310344827586207,0.48214285714285715,0.6352941176470589,0.46551724137931033
17,total,1043,1043,895,848,,,,
18,,,,,Micro avg.,0.8581016299137104,0.5134825014343086,0.6424982053122756,0.5225311601150527
19,,,,,Macro avg.,0.8149607553212156,0.4943779218467603,0.610101000350878,0.5321066173586776
threshold-0.25,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,11,5,0.36666666666666664,0.6875,0.47826086956521735,0.6
2,2,288,288,193,204,0.6701388888888888,0.48614609571788414,0.5635036496350365,0.4809027777777778
3,3,87,87,73,48,0.8390804597701149,0.6033057851239669,0.7019230769230769,0.6436781609195402
4,4,94,94,24,29,0.2553191489361702,0.4528301886792453,0.32653061224489793,0.4734042553191489
5,5,62,62,46,45,0.7419354838709677,0.5054945054945055,0.6013071895424836,0.5080645161290323
6,6,63,63,49,22,0.7777777777777778,0.6901408450704225,0.7313432835820896,0.7142857142857143
7,7,17,17,13,9,0.7647058823529411,0.5909090909090909,0.6666666666666667,0.6176470588235294
8,8,65,65,61,52,0.9384615384615385,0.5398230088495575,0.6853932584269662,0.5692307692307692
9,9,31,31,20,16,0.6451612903225806,0.5555555555555556,0.5970149253731343,0.5645161290322581
10,10,57,57,50,46,0.8771929824561403,0.5208333333333334,0.6535947712418301,0.5350877192982456
11,11,48,48,47,45,0.9791666666666666,0.5108695652173914,0.6714285714285714,0.5208333333333334
12,12,36,36,30,28,0.8333333333333334,0.5172413793103449,0.6382978723404256,0.5277777777777778
13,13,17,17,15,10,0.8823529411764706,0.6,0.7142857142857143,0.6470588235294118
14,14,77,77,71,66,0.922077922077922,0.5182481751824818,0.6635514018691588,0.5324675324675324
15,15,40,40,20,29,0.5,0.40816326530612246,0.449438202247191,0.3875
16,16,29,29,21,26,0.7241379310344828,0.44680851063829785,0.5526315789473684,0.41379310344827586
17,total,1043,1043,744,680,,,,
18,,,,,Micro avg.,0.713326941514861,0.5224719101123596,0.6031617349006891,0.5306807286673059
19,,,,,Macro avg.,0.6892652302230977,0.5078746649640118,0.5703042143717546,0.5433086865513144
threshold-0.5,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,7,2,0.23333333333333334,0.7777777777777778,0.35897435897435903,0.5833333333333334
2,2,288,288,152,155,0.5277777777777778,0.495114006514658,0.5109243697478991,0.4947916666666667
3,3,87,87,62,31,0.7126436781609196,0.6666666666666666,0.6888888888888889,0.6781609195402298
4,4,94,94,12,10,0.1276595744680851,0.5454545454545454,0.2068965517241379,0.5106382978723404
5,5,62,62,38,40,0.6129032258064516,0.48717948717948717,0.5428571428571428,0.4838709677419355
6,6,63,63,43,7,0.6825396825396826,0.86,0.7610619469026547,0.7857142857142857
7,7,17,17,9,6,0.5294117647058824,0.6,0.5625,0.5882352941176471
8,8,65,65,57,47,0.8769230769230769,0.5480769230769231,0.6745562130177515,0.5769230769230769
9,9,31,31,14,11,0.45161290322580644,0.56,0.5,0.5483870967741935
10,10,57,57,42,29,0.7368421052631579,0.5915492957746479,0.65625,0.6140350877192983
11,11,48,48,41,35,0.8541666666666666,0.5394736842105263,0.6612903225806451,0.5625
12,12,36,36,16,13,0.4444444444444444,0.5517241379310345,0.4923076923076923,0.5416666666666666
13,13,17,17,13,8,0.7647058823529411,0.6190476190476191,0.6842105263157895,0.6470588235294118
14,14,77,77,65,54,0.8441558441558441,0.5462184873949579,0.6632653061224489,0.5714285714285714
15,15,40,40,16,19,0.4,0.45714285714285713,0.42666666666666664,0.4625
16,16,29,29,18,21,0.6206896551724138,0.46153846153846156,0.5294117647058824,0.4482758620689655
17,total,1043,1043,605,488,,,,
18,,,,,Micro avg.,0.5800575263662512,0.5535224153705398,0.5664794007490638,0.5560882070949185
19,,,,,Macro avg.,0.5541064479409696,0.5474684676300096,0.5247095147536447,0.5645599970645073
threshold-0.75,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,4,1,0.13333333333333333,0.8,0.2285714285714286,0.55
2,2,288,288,58,44,0.2013888888888889,0.5686274509803921,0.2974358974358975,0.5243055555555556
3,3,87,87,41,14,0.47126436781609193,0.7454545454545455,0.5774647887323943,0.6551724137931034
4,4,94,94,4,3,0.0425531914893617,0.5714285714285714,0.07920792079207921,0.5053191489361702
5,5,62,62,19,21,0.3064516129032258,0.475,0.37254901960784315,0.4838709677419355
6,6,63,63,20,1,0.31746031746031744,0.9523809523809523,0.47619047619047616,0.6507936507936508
7,7,17,17,2,3,0.11764705882352941,0.4,0.1818181818181818,0.47058823529411764
8,8,65,65,50,38,0.7692307692307693,0.5681818181818182,0.6535947712418302,0.5923076923076923
9,9,31,31,5,2,0.16129032258064516,0.7142857142857143,0.2631578947368421,0.5483870967741935
10,10,57,57,22,11,0.38596491228070173,0.6666666666666666,0.4888888888888889,0.5964912280701754
11,11,48,48,31,21,0.6458333333333334,0.5961538461538461,0.62,0.6041666666666666
12,12,36,36,6,1,0.16666666666666666,0.8571428571428571,0.27906976744186046,0.5694444444444444
13,13,17,17,11,4,0.6470588235294118,0.7333333333333333,0.6875,0.7058823529411765
14,14,77,77,47,41,0.6103896103896104,0.5340909090909091,0.5696969696969697,0.538961038961039
15,15,40,40,5,10,0.125,0.3333333333333333,0.18181818181818182,0.4375
16,16,29,29,8,11,0.27586206896551724,0.42105263157894735,0.3333333333333333,0.4482758620689655
17,total,1043,1043,333,226,,,,
18,,,,,Micro avg.,0.3192713326941515,0.5957066189624329,0.4157303370786517,0.551294343240652
19,,,,,Macro avg.,0.31631736927596493,0.584537213530111,0.3700175011944827,0.5518509620205228
topk-9,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,13,6,0.43333333333333335,0.6842105263157895,0.5306122448979592,0.6166666666666667
2,2,288,288,233,224,0.8090277777777778,0.5098468271334792,0.625503355704698,0.515625
3,3,87,87,80,58,0.9195402298850575,0.5797101449275363,0.7111111111111111,0.6264367816091954
4,4,94,94,35,39,0.3723404255319149,0.47297297297297297,0.4166666666666667,0.4787234042553192
5,5,62,62,41,43,0.6612903225806451,0.4880952380952381,0.5616438356164384,0.4838709677419355
6,6,63,63,50,16,0.7936507936507936,0.7575757575757576,0.7751937984496123,0.7698412698412699
7,7,17,17,14,10,0.8235294117647058,0.5833333333333334,0.6829268292682927,0.6176470588235294
8,8,65,65,64,61,0.9846153846153847,0.512,0.6736842105263159,0.5230769230769231
9,9,31,31,26,22,0.8387096774193549,0.5416666666666666,0.6582278481012658,0.5645161290322581
10,10,57,57,54,47,0.9473684210526315,0.5346534653465347,0.6835443037974683,0.5614035087719298
11,11,48,48,47,44,0.9791666666666666,0.5164835164835165,0.6762589928057554,0.53125
12,12,36,36,26,19,0.7222222222222222,0.5777777777777777,0.6419753086419753,0.5972222222222222
13,13,17,17,17,7,1.0,0.7083333333333334,0.8292682926829268,0.7941176470588235
14,14,77,77,72,69,0.935064935064935,0.5106382978723404,0.6605504587155963,0.5194805194805194
15,15,40,40,35,40,0.875,0.4666666666666667,0.608695652173913,0.4375
16,16,29,29,23,28,0.7931034482758621,0.45098039215686275,0.5750000000000001,0.41379310344827586
17,total,1043,1043,830,733,,,,
18,,,,,Micro avg.,0.7957813998082455,0.5310300703774792,0.6369915579432079,0.5465004793863855
19,,,,,Macro avg.,0.7581154735200755,0.5232320539210473,0.6065213475976466,0.5618336001193451
topk-7,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,9,4,0.3,0.6923076923076923,0.41860465116279066,0.5833333333333334
2,2,288,288,209,203,0.7256944444444444,0.5072815533980582,0.5971428571428572,0.5104166666666666
3,3,87,87,76,52,0.8735632183908046,0.59375,0.7069767441860465,0.6379310344827587
4,4,94,94,21,30,0.22340425531914893,0.4117647058823529,0.28965517241379307,0.4521276595744681
5,5,62,62,33,37,0.532258064516129,0.4714285714285714,0.4999999999999999,0.46774193548387094
6,6,63,63,43,10,0.6825396825396826,0.8113207547169812,0.7413793103448275,0.7619047619047619
7,7,17,17,12,8,0.7058823529411765,0.6,0.6486486486486486,0.6176470588235294
8,8,65,65,63,58,0.9692307692307692,0.5206611570247934,0.6774193548387097,0.5384615384615384
9,9,31,31,19,18,0.6129032258064516,0.5135135135135135,0.5588235294117647,0.5161290322580645
10,10,57,57,49,36,0.8596491228070176,0.5764705882352941,0.6901408450704225,0.6140350877192983
11,11,48,48,43,39,0.8958333333333334,0.524390243902439,0.6615384615384615,0.5416666666666666
12,12,36,36,22,17,0.6111111111111112,0.5641025641025641,0.5866666666666667,0.5694444444444444
13,13,17,17,17,7,1.0,0.7083333333333334,0.8292682926829268,0.7941176470588235
14,14,77,77,70,65,0.9090909090909091,0.5185185185185185,0.660377358490566,0.5324675324675324
15,15,40,40,35,38,0.875,0.4794520547945205,0.6194690265486725,0.4625
16,16,29,29,23,25,0.7931034482758621,0.4791666666666667,0.5974025974025974,0.46551724137931033
17,total,1043,1043,744,647,,,,
18,,,,,Micro avg.,0.713326941514861,0.5348670021567218,0.6113393590797042,0.5465004793863855
19,,,,,Macro avg.,0.6805449375180495,0.5277918775191351,0.5755007950911619,0.5626730376897098
topk-5,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,7,2,0.23333333333333334,0.7777777777777778,0.35897435897435903,0.5833333333333334
2,2,288,288,170,161,0.5902777777777778,0.513595166163142,0.5492730210016155,0.515625
3,3,87,87,71,38,0.8160919540229885,0.6513761467889908,0.7244897959183673,0.6896551724137931
4,4,94,94,13,17,0.13829787234042554,0.43333333333333335,0.2096774193548387,0.4787234042553192
5,5,62,62,25,26,0.4032258064516129,0.49019607843137253,0.44247787610619466,0.49193548387096775
6,6,63,63,32,3,0.5079365079365079,0.9142857142857143,0.653061224489796,0.7301587301587301
7,7,17,17,10,6,0.5882352941176471,0.625,0.6060606060606061,0.6176470588235294
8,8,65,65,59,50,0.9076923076923077,0.5412844036697247,0.6781609195402298,0.5692307692307692
9,9,31,31,16,13,0.5161290322580645,0.5517241379310345,0.5333333333333333,0.5483870967741935
10,10,57,57,34,25,0.5964912280701754,0.576271186440678,0.5862068965517242,0.5789473684210527
11,11,48,48,36,33,0.75,0.5217391304347826,0.6153846153846153,0.53125
12,12,36,36,18,14,0.5,0.5625,0.5294117647058824,0.5555555555555556
13,13,17,17,13,6,0.7647058823529411,0.6842105263157895,0.7222222222222222,0.7058823529411765
14,14,77,77,68,57,0.8831168831168831,0.544,0.6732673267326733,0.5714285714285714
15,15,40,40,31,35,0.775,0.4696969696969697,0.5849056603773586,0.45
16,16,29,29,16,22,0.5517241379310345,0.42105263157894735,0.47761194029850745,0.39655172413793105
17,total,1043,1043,619,508,,,,
18,,,,,Micro avg.,0.5934803451581975,0.54924578527063,0.5705069124423963,0.5532118887823586
19,,,,,Macro avg.,0.5601328245530413,0.545767247226368,0.526148175356019,0.5596653894908777
topk-3,class,N# of True samples,N# of False samples,True Positives,False Positives,r,p,f1,acc
0,0,2,2,0,0,0.0,0.0,0.0,0.5
1,1,30,30,6,1,0.2,0.8571428571428571,0.32432432432432434,0.5833333333333334
2,2,288,288,119,95,0.4131944444444444,0.5560747663551402,0.47410358565737054,0.5416666666666666
3,3,87,87,57,23,0.6551724137931034,0.7125,0.6826347305389221,0.6954022988505747
4,4,94,94,6,6,0.06382978723404255,0.5,0.11320754716981131,0.5
5,5,62,62,16,17,0.25806451612903225,0.48484848484848486,0.3368421052631579,0.49193548387096775
6,6,63,63,20,1,0.31746031746031744,0.9523809523809523,0.47619047619047616,0.6507936507936508
7,7,17,17,4,4,0.23529411764705882,0.5,0.31999999999999995,0.5
8,8,65,65,53,42,0.8153846153846154,0.5578947368421052,0.6625,0.5846153846153846
9,9,31,31,13,7,0.41935483870967744,0.65,0.5098039215686274,0.5967741935483871
10,10,57,57,19,13,0.3333333333333333,0.59375,0.42696629213483145,0.5526315789473685
11,11,48,48,27,24,0.5625,0.5294117647058824,0.5454545454545455,0.53125
12,12,36,36,10,7,0.2777777777777778,0.5882352941176471,0.3773584905660377,0.5416666666666666
13,13,17,17,13,5,0.7647058823529411,0.7222222222222222,0.7428571428571428,0.7352941176470589
14,14,77,77,55,47,0.7142857142857143,0.5392156862745098,0.6145251396648044,0.551948051948052
15,15,40,40,18,15,0.45,0.5454545454545454,0.4931506849315069,0.5375
16,16,29,29,9,15,0.3103448275862069,0.375,0.339622641509434,0.39655172413793105
17,total,1043,1043,445,322,,,,
18,,,,,Micro avg.,0.42665388302972196,0.5801825293350718,0.49171270718232046,0.5589645254074784
19,,,,,Macro avg.,0.39945309330225093,0.5684783123731968,0.43762009575476435,0.55831547947212