# A Similarity Classifier with Bonferroni Mean Operators

Authors: Onesfole Kurama; Pasi Luukka; Mikael Collan
Journal: Advances in Fuzzy Systems
 (2016)

---

## Abstract

A similarity classifier based on Bonferroni mean based operators is introduced. The new Bonferroni mean based variant of the similarity classifier is also extended to cover a new Bonferroni-OWA variant. The new Bonferroni-OWA based similarity classifier raises the question of how to accomplish the weighting needed and for this reason we also examine a number of linguistic quantifiers for weight generation. The new proposed similarity classifier variants are tested on four real world medical research related data sets. The results are compared with results from two previously presented similarity classifiers, one based on the generalized mean and another based on an arithmetic mean operator. The results show that comparatively better classification accuracy can be reached with the proposed new similarity classifier variants.


---

## Body

## 1. Introduction

In this paper we introduce a new generalization to the similarity classifier that is based on using Bonferroni mean operators in the aggregation of similarities. The Bonferroni mean aggregation operator was introduced in [1] and extended in [2–6]. Currently, research with respect to Bonferroni mean is increasingly active (see, e.g., [7–10]). The Bonferroni mean operator is constructed in a way such that it consists of two parts; each argument of the outer arithmetic mean is the product of one argument and the average of all the other remaining inner arguments; this “feature” makes it a unique operator in terms of aggregation [2]. Arithmetic mean and “generalized mean” are special cases (subcases) of the Bonferroni mean (see, e.g., [2]), an issue that makes it a flexible and a “versatile” operator—previously, both the generalized and the arithmetic mean have been used in similarity classifiers [11].In this paper we also apply an ordered weighted averaging (OWA) based variant of the Bonferroni mean, the so-called “Bonferroni-OWA operator,” proposed by Yager [5]. The basic OWA operator has previously been studied in connection with similarity classifiers in [12], but the Bonferroni-OWA operator is applied in this context for the first time. In order to effectively use the OWA operator a set of associated weights (vector of weights) is required; here we have selected using linguistic quantifiers in order to generate these weights. Linguistic quantifiers give a parametrized way of producing weights for the Bonferroni-OWA operator, which adds flexibility but also introduces a need to find a proper parameter value. Parameter values can be examined and good parameter values found by, for example, sensitivity analysis. For the interested reader, more on linguistic quantifiers and their applications can be found, for example, in [13–18]. By using different linguistic quantifiers, we show how several new and different variants of the Bonferroni-OWA based similarity classifiers can be created and examine the newly created variants. The algorithms examined here have been implemented with the MATLAB™ software, and the new classifiers with different variants are tested by using four different medical research data sets.In the field of medical research, classification is a key concept and the use of classifiers is warranted in many practical problems, such as patient diagnosis and inevitably also the prognosis of various human conditions and pathologies [19]. Medical diagnosis of common diseases like breast cancer, lung cancer, hepatitis, thyroid, and many others requires high accuracy. However, in real world (medical) problems, it is most often not possible to achieve a 100
% classification accuracy due to the complexity of the analyzed conditions and the complications caused by the available data [20]. The complications connected to the data can be the result of several different causes, for example, small (limited) amount of data samples that make accurate generalizations impossible, very large number of attributes and/or variables that creates complexity, and the difficulty in determining the relevance of the considered attribute. Often even small improvements in classification accuracy connected to medical diagnoses can be valuable, since even small improvements can help save human lives. Similarity based classifiers (see [21]) have been shown to have the ability to work well on medical diagnosis problems (see, e.g., [11, 22]) and have advantages such as fast speed and high classification accuracy and have already been shown to work rather well with small sets of samples (see, e.g., [20]). For more information about fuzzy classification and clustering methods, see [23–29].The rest of the paper is organized as follows: in the second section we briefly go through the aggregation operators, the weight generation schemes for the new OWA based classifier variants, and the similarity measures applied in the paper, in the third section we introduce the new similarity classifiers and the new variants, and in the fourth section we first shortly introduce the used medical research data sets and then examine the achieved results. The paper is closed with discussion and conclusions.


## 2. Preliminaries

### 2.1. Aggregation Operators

The choice of an aggregation operator that is used in a similarity classifier is a fundamental issue, as it affects the final classification accuracy of the classifier. Several aggregation operators that can be used are available in the existing literature; in this paper we concentrate on averaging type aggregation operators [30]. In what follows, we briefly go through the aggregation operators that we use in our new classifier; the interested reader may find more information on aggregation operators, for example, from [2, 4, 18, 30–38].One of the most common aggregation operators is the arithmetic mean, from which several different generalizations exist, for example, the generalized mean and the ordered weighted average (OWA). The aggregation operator is an important component that is used in similarity classifiers and in this paper, we specifically propose and examine the use of the Bonferroni mean and the Bonferroni-OWA as aggregation operators to be used in a similarity classifier, to create new similarity classifiers. The presented new variants of the similarity classifier are compared with previously presented methods that use the generalized mean and the arithmetic mean. Both the generalized mean and the arithmetic mean are special cases of the Bonferroni mean [2]. The generalized mean is defined as follows.Definition 1.
Letf
:
[
0,1
]
n
→
[
0,1
] be an averaging operator; a generalized mean of an n-tuple (
x
1
,
x
2
,
…
,
x
n
) is defined by [30](1)
f
x
1
,
x
2
,
…
,
x
n
=
x
1
α
+
x
2
α
+
⋯
+
x
n
α
n
1
/
α
,where α
∈
R
,
α
≠
0, and x
i
≠
0
∀
i
∈
N.By varying the value of the parameterα several other means can be derived from the generalized mean (e.g., the arithmetic mean, when α
=
1, the harmonic mean, when α
=
-
1, and the geometric mean, when α
→
0).One other type of generalization of the arithmetic mean is the ordered weighted averaging operator. The ordered weighted averaging operator was introduced by Yager in [16]. Later on several researchers have developed new aggregation operators based on the OWA; for example, see [4, 39, 40]. The OWA operator is also an averaging operator that is characterized by a “reordering step” that allows emphasizing the importance of selected data values. The OWA operator is defined as follows.Definition 2.
Letw
=
w
1
,
w
2
,
…
,
w
n
,
w
i
∈
[
0,1
]
,
∀
i
∈
N, be a weighting vector such that ∑
i
=
1
n
‍
w
i
=
1, and let x
1
,
x
2
,
…
,
x
n be an n-tuple. An OWA operator f
w associated with w is defined as(2)
f
w
x
1
,
x
2
,
…
,
x
n
=
∑
i
=
1
n
w
i
b
i
,where b
i for any i
∈
N is the ith largest element of the collection (
x
1
,
x
2
,
…
,
x
n
) arranged in a descending order.As it is our intention to apply the OWA together with the Bonferroni mean, we next present the Bonferroni mean operator and its OWA extension, the so-called Bonferroni-OWA operator, following the work by Yager in [5]. The Bonferroni mean operator was formally introduced in [1] and discussed extensively by other researchers in, for example, [2–5]. Recently, several researchers have successfully utilized the generalized Bonferroni mean in practical problems [41–45]. The Bonferroni mean is defined as follows.Definition 3.
Letx
=
(
x
1
,
x
2
,
…
,
x
n
)
,
x
i
∈
[
0,1
]
,
∀
i
∈
N, be a vector with at least one x
i
≠
0
∀
i
=
1,2
,
…
,
n and let α
,
q
≥
0 be parameters. The general Bonferroni mean of x
i is defined by [1](3)
B
α
,
q
x
1
,
x
2
,
…
,
x
n
=
1
n
∑
i
=
1
n
x
i
α
1
n
-
1
∑
i
,
j
=
1
,
j
≠
i
n
x
j
q
1
/
α
+
q
.It has been shown that the Bonferroni mean is an averaging operator and that it satisfies the necessary axioms (see [5]). Following (3) the Bonferroni mean operator can be viewed as the α
+
q
t
h root of the arithmetic mean, where each argument is the product of each x
i
α with the arithmetic mean of the remaining x
j
q; see [2]. Equation (3) was further modified to include several other means, by replacing either the inner or the outer means. One of the results involves using the OWA operator in place of the inner mean and is called the Bonferroni-OWA; for more details see [2, 5]. The Bonferroni-OWA is defined as follows.Definition 4.
Letw
=
(
w
1
,
w
2
,
…
,
w
n
)
,
w
i
∈
[
0,1
]
,
∀
i
∈
N, be a weighting vector such that ∑
i
=
1
n
‍
w
i
=
1 and let x
=
(
x
1
,
x
2
,
…
,
x
n
)
,
x
i
∈
[
0,1
]
∀
i
∈
N, be a vector with at least one x
i
≠
0
∀
i
=
1,2
,
…
,
n. A Bonferroni-OWA operator is defined by [5](4)
B
O
W
A
w
1,1
x
1
,
x
2
,
…
,
x
n
=
1
n
∑
i
=
1
n
x
i
O
W
A
w
x
j
≠
i
1
/
2
.When the OWA operator is used, the need to generate the weights that the OWA uses arises; we propose to do this by applying linguistic quantifiers introduced by Zadeh [46] and Yager in [14, 15].


### 2.2. Linguistic Quantifiers and OWA Weight Generation

Linguistic quantifiers are quantifiers that use a scale of linguistic expressions to summarize the properties of a class of objects without enumerating them; this way they offer an imprecise and a flexible methodology for the quantification of objects; Ying [47] offers a compact review of the literature focused on linguistic quantifiers for the interested reader. Yager [15] classified linguistic quantifiers into three main categories: Regular Increasing Monotone (RIM), Regular Decreasing Monotone (RDM), and Regular Unimodal (RUM) quantifiers. These categories are options for when weight generation systems are envisioned; here we concentrate on RIM quantifiers and apply them. RIM quantifiers were defined by Yager [14] as follows.Definition 5.
A fuzzy subsetQ of a real line is called a Regular Increasing Monotone (RIM) quantifier if it satisfies the following conditions: (1) Q
(
0
)
=
0, (2) Q
(
1
)
=
1, and (3) Q
(
x
)
≥
Q
(
y
)
,
∀
x
≥
y.During the ordered weighted aggregation process, terms likemost,at least,many, andall are captured by an appropriate linguistic quantifier with parameter α
∈
R. Following [14, 16], for any RIM quantifier Q, weights for the OWA operator are calculated from(5)
w
i
=
Q
i
n
-
Q
i
-
1
n
,
i
=
1,2
,
…
,
n
,where w
i
≥
0 and ∑
i
=
1
n
‍
w
i
=
1.In this paper we consider five different RIM quantifiers; these are the “basic,” “polynomial,” “quadratic,” “exponential,” and “trigonometric” RIM quantifiers. In what follows, we have denoted these with subscript enumerations 1–5 in the order given above. Next we briefly present each of the five selected RIM quantifiers and show how they can be applied in creating weight generating schemes for OWA.(1)
The basic linguistic quantifier,Q
1, is defined by the equation(6)
Q
α
r
=
r
α
α
≥
0
,
which is associated with the weightsw
i; by application of (5) and (6) we obtain(7)
w
i
=
i
n
α
-
i
-
1
n
α
,
i
=
1,2
,
…
,
n
.
(2)
The linguistic quantifier,Q
2, proposed by Schweizer and Sklar [48], which we for the purposes of this research call a polynomial quantifier, is defined by the equation(8)
Q
α
r
=
1
-
1
-
r
α
α
≥
0
;
whenα
=
1, the polynomial and the basic RIM quantifiers will coincide; otherwise they behave differently. Applying the polynomial RIM quantifier to the weight generation we get(9)
w
i
=
n
+
1
-
i
n
α
-
n
-
i
n
α
,
i
=
1,2
,
…
,
n
.
(3)
The quadratic linguistic quantifier,Q
3, was suggested by Ribeiro and Marques Pereira in [49]. Q
3 has two parameters: α, which controls the maximum value of weight generation, and β, which controls the ratio between the maximum and the minimum values of the generating function; see [49]. The basic form of Q
3 is given by(10)
Q
α
,
β
r
=
1
1
-
α
r
β
,
α
,
β
≥
0
.
By
applying it to weight generation we get(11)
w
i
=
1
1
-
α
i
/
n
β
-
1
1
-
α
i
-
1
/
n
β
,
i
=
1,2
,
…
,
n
.
For the purposes of practical implementation, we have chosenβ
=
0.5, but we acknowledge that the parameter value can be tuned for optimal performance.
(4)
The exponential linguistic quantifier,Q
4, is defined as(12)
Q
α
r
=
e
-
α
r
;
when it is applied to weight generation we get(13)
w
i
=
e
-
α
i
/
n
-
e
-
α
i
-
1
/
n
,
i
=
1,2
,
…
,
n
.
(5)
The trigonometric linguistic quantifier,Q
5, is defined by the equation(14)
Q
α
r
=
arcsin
⁡
α
r
,
and application to weight calculation gives(15)
w
i
=
arcsin
⁡
α
i
n
-
arcsin
⁡
α
i
-
1
n
,
i
=
1,2
,
…
,
n
.
These operators, with the generated weighting vectors, are applied in the aggregation of similarities.


### 2.3. Similarity Measures

In this paper we use similarity measures in a generalized Łukasiewicz-structure (see [50]) to compare objects. The motivation for this choice is that it has been shown that, in Łukasiewicz-structure, the mean of many similarities is a similarity [51]. Also this approach has been previously used in determining similarities implemented in similarity classifiers; see details in [21, 22]. By choosing the Łukasiewicz-structure, two objects can be compared for all participating features. Let x
1 and x
2 be two objects in a set X with entries across all features 1,2
,
…
,
n. We can get n similarities, when the two objects are compared, that is, x
1
(
i
)
↔
x
2
(
i
)
,
i
=
1,2
,
…
,
n. Thus, we have the similarity, S
x
1
,
x
2 between x
1 and x
2 defined as follows [50]:(16)
S
x
1
,
x
2
=
1
n
∑
i
=
1
n
x
1
i
⟷
x
2
i
.An equivalence relation, x
1
↔
x
2, between two objects in Łukasiewicz-structure was defined in [52] as x
1
↔
x
2
=
1
-
x
1
-
x
2. It was shown in [50] that this relation can be generalized as(17)
x
1
⟷
x
2
=
1
-
x
1
p
-
x
2
p
1
/
p
.Combining (16) and (17) leads one to a similarity measure, which can be used to calculate the similarity between two vectors with n objects. This has been earlier discussed in [50] and further applied in [11, 12, 21]. Thus, with the arithmetic mean, we can write the similarity between two objects x
1 and x
2 as(18)
S
x
1
,
x
2
=
1
n
∑
i
=
1
n
1
-
x
1
i
p
-
x
2
i
p
p
,where p is the parameter for the similarity measure in the generalized Łukasiewicz-structure.Several other means can be used instead of the arithmetic mean in (18). With the generalized mean, a modification can be made to include the parameter m in the generalized mean to obtain(19)
S
x
1
,
x
2
=
1
n
∑
i
=
1
n
1
-
x
1
i
p
-
x
2
i
p
p
m
1
/
m
.If one replaces the generalized mean with the Bonferroni mean one arrives at a similarity with the following form:(20)
S
x
1
,
x
2
=
1
n
∑
i
=
1
n
1
-
x
1
i
p
-
x
2
i
p
α
/
p
1
n
-
1
∑
j
=
1
,
j
≠
i
n
1
-
x
1
j
p
-
x
2
j
p
q
/
p
1
/
α
+
q
.Now, to apply the Bonferroni-OWA to the similarity, the inner mean in (20) is replaced with the OWA operator and α
=
q
=
1 and the similarity can be rewritten as(21)
S
x
1
,
x
2
=
1
n
∑
i
=
1
n
1
-
x
1
i
p
-
x
2
i
p
1
/
p
∑
j
=
1
,
j
≠
i
n
w
j
b
j
1
/
2
,where w
j is a weighting vector such that ∑
j
=
1
n
‍
w
j
=
1 and b
j
=
1
-
x
1
j
p
-
x
2
j
p
1
/
p is the jth largest element of the reordered similarity. In the next section, we explain how classification based on the presented similarity measures is done.


## 2.1. Aggregation Operators

The choice of an aggregation operator that is used in a similarity classifier is a fundamental issue, as it affects the final classification accuracy of the classifier. Several aggregation operators that can be used are available in the existing literature; in this paper we concentrate on averaging type aggregation operators [30]. In what follows, we briefly go through the aggregation operators that we use in our new classifier; the interested reader may find more information on aggregation operators, for example, from [2, 4, 18, 30–38].One of the most common aggregation operators is the arithmetic mean, from which several different generalizations exist, for example, the generalized mean and the ordered weighted average (OWA). The aggregation operator is an important component that is used in similarity classifiers and in this paper, we specifically propose and examine the use of the Bonferroni mean and the Bonferroni-OWA as aggregation operators to be used in a similarity classifier, to create new similarity classifiers. The presented new variants of the similarity classifier are compared with previously presented methods that use the generalized mean and the arithmetic mean. Both the generalized mean and the arithmetic mean are special cases of the Bonferroni mean [2]. The generalized mean is defined as follows.Definition 1.
Letf
:
[
0,1
]
n
→
[
0,1
] be an averaging operator; a generalized mean of an n-tuple (
x
1
,
x
2
,
…
,
x
n
) is defined by [30](1)
f
x
1
,
x
2
,
…
,
x
n
=
x
1
α
+
x
2
α
+
⋯
+
x
n
α
n
1
/
α
,where α
∈
R
,
α
≠
0, and x
i
≠
0
∀
i
∈
N.By varying the value of the parameterα several other means can be derived from the generalized mean (e.g., the arithmetic mean, when α
=
1, the harmonic mean, when α
=
-
1, and the geometric mean, when α
→
0).One other type of generalization of the arithmetic mean is the ordered weighted averaging operator. The ordered weighted averaging operator was introduced by Yager in [16]. Later on several researchers have developed new aggregation operators based on the OWA; for example, see [4, 39, 40]. The OWA operator is also an averaging operator that is characterized by a “reordering step” that allows emphasizing the importance of selected data values. The OWA operator is defined as follows.Definition 2.
Letw
=
w
1
,
w
2
,
…
,
w
n
,
w
i
∈
[
0,1
]
,
∀
i
∈
N, be a weighting vector such that ∑
i
=
1
n
‍
w
i
=
1, and let x
1
,
x
2
,
…
,
x
n be an n-tuple. An OWA operator f
w associated with w is defined as(2)
f
w
x
1
,
x
2
,
…
,
x
n
=
∑
i
=
1
n
w
i
b
i
,where b
i for any i
∈
N is the ith largest element of the collection (
x
1
,
x
2
,
…
,
x
n
) arranged in a descending order.As it is our intention to apply the OWA together with the Bonferroni mean, we next present the Bonferroni mean operator and its OWA extension, the so-called Bonferroni-OWA operator, following the work by Yager in [5]. The Bonferroni mean operator was formally introduced in [1] and discussed extensively by other researchers in, for example, [2–5]. Recently, several researchers have successfully utilized the generalized Bonferroni mean in practical problems [41–45]. The Bonferroni mean is defined as follows.Definition 3.
Letx
=
(
x
1
,
x
2
,
…
,
x
n
)
,
x
i
∈
[
0,1
]
,
∀
i
∈
N, be a vector with at least one x
i
≠
0
∀
i
=
1,2
,
…
,
n and let α
,
q
≥
0 be parameters. The general Bonferroni mean of x
i is defined by [1](3)
B
α
,
q
x
1
,
x
2
,
…
,
x
n
=
1
n
∑
i
=
1
n
x
i
α
1
n
-
1
∑
i
,
j
=
1
,
j
≠
i
n
x
j
q
1
/
α
+
q
.It has been shown that the Bonferroni mean is an averaging operator and that it satisfies the necessary axioms (see [5]). Following (3) the Bonferroni mean operator can be viewed as the α
+
q
t
h root of the arithmetic mean, where each argument is the product of each x
i
α with the arithmetic mean of the remaining x
j
q; see [2]. Equation (3) was further modified to include several other means, by replacing either the inner or the outer means. One of the results involves using the OWA operator in place of the inner mean and is called the Bonferroni-OWA; for more details see [2, 5]. The Bonferroni-OWA is defined as follows.Definition 4.
Letw
=
(
w
1
,
w
2
,
…
,
w
n
)
,
w
i
∈
[
0,1
]
,
∀
i
∈
N, be a weighting vector such that ∑
i
=
1
n
‍
w
i
=
1 and let x
=
(
x
1
,
x
2
,
…
,
x
n
)
,
x
i
∈
[
0,1
]
∀
i
∈
N, be a vector with at least one x
i
≠
0
∀
i
=
1,2
,
…
,
n. A Bonferroni-OWA operator is defined by [5](4)
B
O
W
A
w
1,1
x
1
,
x
2
,
…
,
x
n
=
1
n
∑
i
=
1
n
x
i
O
W
A
w
x
j
≠
i
1
/
2
.When the OWA operator is used, the need to generate the weights that the OWA uses arises; we propose to do this by applying linguistic quantifiers introduced by Zadeh [46] and Yager in [14, 15].


## 2.2. Linguistic Quantifiers and OWA Weight Generation

Linguistic quantifiers are quantifiers that use a scale of linguistic expressions to summarize the properties of a class of objects without enumerating them; this way they offer an imprecise and a flexible methodology for the quantification of objects; Ying [47] offers a compact review of the literature focused on linguistic quantifiers for the interested reader. Yager [15] classified linguistic quantifiers into three main categories: Regular Increasing Monotone (RIM), Regular Decreasing Monotone (RDM), and Regular Unimodal (RUM) quantifiers. These categories are options for when weight generation systems are envisioned; here we concentrate on RIM quantifiers and apply them. RIM quantifiers were defined by Yager [14] as follows.Definition 5.
A fuzzy subsetQ of a real line is called a Regular Increasing Monotone (RIM) quantifier if it satisfies the following conditions: (1) Q
(
0
)
=
0, (2) Q
(
1
)
=
1, and (3) Q
(
x
)
≥
Q
(
y
)
,
∀
x
≥
y.During the ordered weighted aggregation process, terms likemost,at least,many, andall are captured by an appropriate linguistic quantifier with parameter α
∈
R. Following [14, 16], for any RIM quantifier Q, weights for the OWA operator are calculated from(5)
w
i
=
Q
i
n
-
Q
i
-
1
n
,
i
=
1,2
,
…
,
n
,where w
i
≥
0 and ∑
i
=
1
n
‍
w
i
=
1.In this paper we consider five different RIM quantifiers; these are the “basic,” “polynomial,” “quadratic,” “exponential,” and “trigonometric” RIM quantifiers. In what follows, we have denoted these with subscript enumerations 1–5 in the order given above. Next we briefly present each of the five selected RIM quantifiers and show how they can be applied in creating weight generating schemes for OWA.(1)
The basic linguistic quantifier,Q
1, is defined by the equation(6)
Q
α
r
=
r
α
α
≥
0
,
which is associated with the weightsw
i; by application of (5) and (6) we obtain(7)
w
i
=
i
n
α
-
i
-
1
n
α
,
i
=
1,2
,
…
,
n
.
(2)
The linguistic quantifier,Q
2, proposed by Schweizer and Sklar [48], which we for the purposes of this research call a polynomial quantifier, is defined by the equation(8)
Q
α
r
=
1
-
1
-
r
α
α
≥
0
;
whenα
=
1, the polynomial and the basic RIM quantifiers will coincide; otherwise they behave differently. Applying the polynomial RIM quantifier to the weight generation we get(9)
w
i
=
n
+
1
-
i
n
α
-
n
-
i
n
α
,
i
=
1,2
,
…
,
n
.
(3)
The quadratic linguistic quantifier,Q
3, was suggested by Ribeiro and Marques Pereira in [49]. Q
3 has two parameters: α, which controls the maximum value of weight generation, and β, which controls the ratio between the maximum and the minimum values of the generating function; see [49]. The basic form of Q
3 is given by(10)
Q
α
,
β
r
=
1
1
-
α
r
β
,
α
,
β
≥
0
.
By
applying it to weight generation we get(11)
w
i
=
1
1
-
α
i
/
n
β
-
1
1
-
α
i
-
1
/
n
β
,
i
=
1,2
,
…
,
n
.
For the purposes of practical implementation, we have chosenβ
=
0.5, but we acknowledge that the parameter value can be tuned for optimal performance.
(4)
The exponential linguistic quantifier,Q
4, is defined as(12)
Q
α
r
=
e
-
α
r
;
when it is applied to weight generation we get(13)
w
i
=
e
-
α
i
/
n
-
e
-
α
i
-
1
/
n
,
i
=
1,2
,
…
,
n
.
(5)
The trigonometric linguistic quantifier,Q
5, is defined by the equation(14)
Q
α
r
=
arcsin
⁡
α
r
,
and application to weight calculation gives(15)
w
i
=
arcsin
⁡
α
i
n
-
arcsin
⁡
α
i
-
1
n
,
i
=
1,2
,
…
,
n
.
These operators, with the generated weighting vectors, are applied in the aggregation of similarities.


## 2.3. Similarity Measures

In this paper we use similarity measures in a generalized Łukasiewicz-structure (see [50]) to compare objects. The motivation for this choice is that it has been shown that, in Łukasiewicz-structure, the mean of many similarities is a similarity [51]. Also this approach has been previously used in determining similarities implemented in similarity classifiers; see details in [21, 22]. By choosing the Łukasiewicz-structure, two objects can be compared for all participating features. Let x
1 and x
2 be two objects in a set X with entries across all features 1,2
,
…
,
n. We can get n similarities, when the two objects are compared, that is, x
1
(
i
)
↔
x
2
(
i
)
,
i
=
1,2
,
…
,
n. Thus, we have the similarity, S
x
1
,
x
2 between x
1 and x
2 defined as follows [50]:(16)
S
x
1
,
x
2
=
1
n
∑
i
=
1
n
x
1
i
⟷
x
2
i
.An equivalence relation, x
1
↔
x
2, between two objects in Łukasiewicz-structure was defined in [52] as x
1
↔
x
2
=
1
-
x
1
-
x
2. It was shown in [50] that this relation can be generalized as(17)
x
1
⟷
x
2
=
1
-
x
1
p
-
x
2
p
1
/
p
.Combining (16) and (17) leads one to a similarity measure, which can be used to calculate the similarity between two vectors with n objects. This has been earlier discussed in [50] and further applied in [11, 12, 21]. Thus, with the arithmetic mean, we can write the similarity between two objects x
1 and x
2 as(18)
S
x
1
,
x
2
=
1
n
∑
i
=
1
n
1
-
x
1
i
p
-
x
2
i
p
p
,where p is the parameter for the similarity measure in the generalized Łukasiewicz-structure.Several other means can be used instead of the arithmetic mean in (18). With the generalized mean, a modification can be made to include the parameter m in the generalized mean to obtain(19)
S
x
1
,
x
2
=
1
n
∑
i
=
1
n
1
-
x
1
i
p
-
x
2
i
p
p
m
1
/
m
.If one replaces the generalized mean with the Bonferroni mean one arrives at a similarity with the following form:(20)
S
x
1
,
x
2
=
1
n
∑
i
=
1
n
1
-
x
1
i
p
-
x
2
i
p
α
/
p
1
n
-
1
∑
j
=
1
,
j
≠
i
n
1
-
x
1
j
p
-
x
2
j
p
q
/
p
1
/
α
+
q
.Now, to apply the Bonferroni-OWA to the similarity, the inner mean in (20) is replaced with the OWA operator and α
=
q
=
1 and the similarity can be rewritten as(21)
S
x
1
,
x
2
=
1
n
∑
i
=
1
n
1
-
x
1
i
p
-
x
2
i
p
1
/
p
∑
j
=
1
,
j
≠
i
n
w
j
b
j
1
/
2
,where w
j is a weighting vector such that ∑
j
=
1
n
‍
w
j
=
1 and b
j
=
1
-
x
1
j
p
-
x
2
j
p
1
/
p is the jth largest element of the reordered similarity. In the next section, we explain how classification based on the presented similarity measures is done.


## 3. Similarity Classifier with Bonferroni Mean Operators

A new Bonferroni mean based similarity classifier and its OWA variant are introduced in this section. Before going into details of these new classifiers, we briefly describe the main components typically found in similarity classifiers.It is possible to determine the similarity between two or more samples in a given data set; the main idea is based on comparing samples and as a result of the comparison providing a numerical value that represents their similarity. Typically for similarity classifiers, resulting values closer to 1 indicate high similarity between objects and values closer to0 indicate low similarity. For classification tasks, the challenge is typically the partitioning of the attribute space in a way such that samples with the same characteristics are allocated into the same classes; for example, see [53]. Once the assignment of samples into individual classes is done properly the classification procedure can proceed.Suppose a data matrixX
∈
0,1
N
×
n is to be classified into N different classes C
1
,
C
2
,
…
,
C
N across n attributes, 1,2
,
…
,
n. The initial step is to find mean vectors for each class; these are often called ideal vectors; for example, for class C
i, such a vector is denoted as v
i
=
v
i
1
,
v
i
2
,
…
,
v
i
N, where the entry v
i
1 is the mean value of the elements in the class C
i. We observe that there are several ways of determining these ideal vectors, v
i; for example, one can use the generalized mean; see also [31] for other methods of computing means that can be applied as ideal vectors in this context. The generalized mean, as it is usable in this context, is defined as(22)
v
i
t
=
1
♯
X
i
∑
x
∈
X
i
x
t
m
1
/
m
,
∀
t
=
1
,
…
,
n
,where the parameter m (that comes from the generalized mean) is fixed ∀
i
,
t and ♯
X
i denotes the number of samples in class C
i. To determine to which class any arbitrary sample x
∈
X belongs, it is compared to the ideal vectors of different classes. The comparison can be done by computing the similarity for attributes in the earlier described generalized Łukasiewicz-structure [50]. The similarity between a sample x and an ideal vector of a given class v with the Bonferroni mean based similarity measure is given by(23)
S
x
,
v
=
1
n
∑
t
=
1
n
1
-
x
t
p
-
v
t
p
α
/
p
1
n
-
1
∑
j
=
1
,
j
≠
t
n
1
-
x
j
p
-
v
j
p
q
/
p
1
/
α
+
qfor x
,
v
∈
[
0,1
]
n, where p is a parameter from the similarity measure and α and q are parameters from the Bonferroni mean operator; see [1]. In the same manner, we write the similarity measure with the Bonferroni-OWA as(24)
S
x
,
v
=
1
n
∑
t
=
1
n
1
-
x
t
p
-
v
t
p
1
/
p
∑
j
=
1
,
j
≠
t
n
w
j
b
j
1
/
2
,where w
j is a weighting vector such that ∑
j
=
1
n
‍
w
j
=
1 and b
j
=
1
-
x
j
p
-
v
j
p
1
/
p is the jth largest element of the reordered similarities.The samplex
∈
X is assigned to a class with which it has the highest similarity value, for example, in accordance with(25)
S
x
,
v
=
max
i
=
1
,
…
,
n
⁡
S
x
,
v
.A pseudocode algorithm from the main part of the process is given in Algorithm 1.Algorithm 1:Pseudocode for the similarity classifier with the Bonferroni mean operator.
Require: d
a
t
a
[
1
,
…
,
n
]
,
i
d
e
a
l
s
,
p
,
α
,
q
for
k
=
1 to n
do
for
i
=
1 to N
do
for
t
=
1 to n
do
S
(
k
,
j
,
t
)
=
1
-
d
a
t
a
k
,
t
p
-
i
d
e
a
l
i
,
t
p
1
/
p
end for
end for
end for
for
k
=
1 to n
do
for
i
=
1 to N
do
for
t
=
1 to n
do
S
s
u
m
1
(
t
)
=
s
u
m
S
k
,
1
∶
t
-
1
,
t
+
1
∶
n
q
(
n
-
1
)
end for
S
(
k
,
i
)
=
1
n
s
u
m
S
k
,
i
,
∶
α
.
∗
S
s
u
m
1
∶
1
/
(
α
+
q
)
end for
end for
for
k
=
1 to n
do
c
l
a
s
s
(
k
)
=
f
i
n
d
S
k
,
∶
=
=
max
⁡
S
k
,
∶
end forIn order to use similarity with the Bonferroni-OWA in Algorithm1 we need to replace S
(
k
,
i
) with the Bonferroni-OWA based similarity. In this case, all the other steps are the same, but S
s
u
m
1
(
t
) and S
(
k
,
i
) become(26)
S
s
u
m
1
t
=
s
u
m
w
j
k
,
1
:
t
-
1
,
t
+
1
:
n
b
j
k
,
1
:
t
-
1
,
t
+
1
:
n
,
S
k
,
i
=
1
n
s
u
m
S
k
,
i
:
.
∗
S
s
u
m
1
:
1
/
2
,where w
j and b
j are defined in accordance with (24). For purposes of finding w
j, different weight generating linguistic quantifiers were used.


## 4. Data Sets and Obtained Results

### 4.1. Experimental Setting for Examination of Results

The experiments were carried out by splitting each studied data set into two parts, one part for training and the other for testing. The data set divisions were repeated randomly30 times in each experiment and the resulting classification accuracies with corresponding means and variances (from the thirty runs) were recorded. Individual surface plots for each new similarity classifier variant were also plotted; these help to identify proper parameter values. Statistical comparison of classification accuracies from new classifiers with accuracies from the two benchmarks was made by using typical sample statistics (t-test).


### 4.2. Data Sets

Data sets used in testing our new classifier were retrieved from the UCI Machine Learning Repository [54]. Properties of each set used, including the number of classes and attributes and number of instances, are summarized in Table 1.Table 1
Data sets used and their main properties.
Data set
Number of classes
Number of attributes
Number of instances
Fertility
2
10
100
Blood transfusion service center
2
5
748
Echocardiogram
2
12
132
Lung cancer
3
56
32Further detailed attribute information for the fertility, blood transfusion service center, and echocardiogram data sets is presented in Tables2, 3, and 4.Table 2
Fertility data set attribute information.
Attribute number
Attribute name
1
Season
2
Age
3
Childish diseases
4
Accident or serious trauma
5
Surgical intervention
6
High fevers in the last year
7
Frequency of alcohol consumption
8
Smoking habit
9
Number of hours
10
Output (class attribute)Table 3
Blood transfusion service center data set attribute information.
Attribute number
Attribute name
1
Recency: months since last donation
2
Frequency: total number of donations
3
Monetary: total blood donated in c.c.
4
Time: months since first donation
5
Donated blood or not (class attribute)Table 4
Echocardiogram data set attribute information.
Attribute number
Attribute name
1
Survival
2
Still alive
3
Age at heart attack
4
Pericardial effusion
5
Fractional shortening
6
EPSS
7
LVDD
8
Wall motion score
9
Wall motion index
10
Mult
11
Name
12
Alive at one year or not (class)


### 4.3. Experimental Results

In this section we present the obtained results from the experiments. Mean accuracies from 30 separate runs were computed for each data set and for each classifier combination. The resulting classification accuracies and the variances obtained are reported in Tables5, 6, 7, and 8 separately for each data set. For the purposes of benchmarking the new similarity classifiers and their variants, we also report results obtained with arithmetic mean and generalized mean based similarity classifiers.Table 5
Classification results with the fertility data set.
Method
Mean accuracy (%)
Variance
Similarity classifier with Bonferroni-OWA using
Basic RIM quantifier
70.60
0.0073
Polynomial quantifier
70.63
⋆
0.0068
Quadratic quantifier
69.13
0.0094
Exponential quantifier
70.40
0.0084
Trigonometric quantifier
69.40
0.0076
Similarity classifier with
(1) Bonferroni mean
74.20
⋆
∘
0.0105
(2) Arithmetic mean
66.87
0.0031
(3) Generalized mean
69.07
0.0073Table 6
Classification results with blood transfusion service center data set.
Method
Mean accuracy (%)
Variance
Similarity classifier with Bonferroni-OWA using
Basic RIM quantifier
76.91
⋆
∘
3.7217
∗
1
0
-
5
Polynomial quantifier
76.68
⋆
∘
2.0059
∗
1
0
-
5
Quadratic quantifier
76.69
⋆
4.4908
∗
1
0
-
5
Exponential quantifier
76.87
⋆
4.6223
∗
1
0
-
5
Trigonometric quantifier
76.78
⋆
∘
3.5047
∗
1
0
-
5
Similarity classifier with
(1) Bonferroni mean
76.86
⋆
1.3792
∗
1
0
-
4
(2) Arithmetic mean
67.87
5.3303
∗
1
0
-
4
(3) Generalized mean
76.43
1.8604
∗
1
0
-
5Table 7
Classification results with the echocardiogram data set.
Method
Mean accuracy (%)
Variance
Similarity classifier with Bonferroni-OWA using
Basic RIM quantifier
90.73
⋆
2.9190
∗
1
0
-
4
Polynomial quantifier
90.56
⋆
5.4846
∗
1
0
-
4
Quadratic quantifier
90.62
⋆
9.8532
∗
1
0
-
4
Exponential quantifier
90.73
⋆
3.3152
∗
1
0
-
4
Trigonometric quantifier
91.13
⋆
9.4470
∗
1
0
-
4
Similarity classifier with
(1) Bonferroni mean
90.96
⋆
6.0096
∗
1
0
-
4
(2) Arithmetic mean
86.89
8.9022
∗
1
0
-
4
(3) Generalized mean
90.11
6.1582
∗
1
0
-
4Table 8
Classification results with the lung cancer data set.
Method
Mean accuracy (%)
Variance
Similarity classifier with Bonferroni-OWA using
Basic RIM quantifier
81.96
0.0052
Polynomial quantifier
81.37
0.0038
Quadratic quantifier
82.75
0.0036
Exponential quantifier
82.16
0.0027
Trigonometric quantifier
81.57
0.0033
Similarity classifier with
(1) Bonferroni mean
82.94
0.0032
(2) Arithmetic mean
82.16
0.0032
(3) Generalized mean
82.16
0.0032For the fertility data set, the highest classification accuracy of74.20
% was obtained using the Bonferroni mean based similarity classifier. The Bonferroni-OWA based classifier produced a classification accuracy of 70.63
% with the polynomial quantifier variant, the generalized mean based classifier gave the accuracy of 69.07
%, and the arithmetic mean based classifier gave the accuracy of 66.87
%. Complete results and their corresponding variances are presented in Table 5. In the same table, computed accuracies with a star (
⋆
) are statistically significantly different from the result with the arithmetic mean based similarity classifier and those with a circle (
∘
) are significantly different from the results obtained with the generalized mean based similarity classifier with a 95
% confidence level. The results with the new Bonferroni mean based similarity classifier exhibit a statistically significant difference (improved classification performance) to both benchmark cases. The Bonferroni-OWA based similarity classifier that uses the polynomial quantifier for weight generation was found to be statistically significantly better compared to the arithmetic mean based similarity classifier. For the rest of the Bonferroni-OWA variants a statistically significant difference to the benchmark cases could not be established.Figure1 shows the surface corresponding to the classification results received from a set of runs with different combinations of parameter values of the parameters p
=
[
0,8
] for the similarity measure and α
=
0,8 for the Bonferroni mean, obtained with the Bonferroni mean based similarity classifier and the corresponding variances. The q-value (for Bonferroni mean) was fixed at the value 6—this value was not randomly set, but the choice was a result of optimization performed. The best performance was reached with p set to approximately 6 and α set to approximately 6.Figure 1
Mean classification accuracies (a) and the variances (b) obtained from the fertility data set with the Bonferroni mean based classifier, whenq
=
6.
(a)
(b)When the new similarity classifiers were used to classify the blood transfusion service center data set, the highest achieved mean accuracy was76.91
% and was obtained with the basic linguistic quantifier variant of the Bonferroni-OWA based similarity classifier. The classification accuracy of 76.86
% was achieved with the Bonferroni mean based similarity classifier. With this data set, all results with the new proposed similarity based classifiers were found to have statistically significant difference with results from the arithmetic mean based similarity classifier method (indicated with ⋆). There was also statistically significant difference between the results from the generalized mean based method with three variants of the Bonferroni-OWA based similarity classifier (denoted with a circle in Table 6). Figure 2 shows how different combinations of the values for parameters p and α affect the resulting classification accuracy and the corresponding variance of the classification accuracy.Figure 2
Mean classification accuracies (a) and the variances of the accuracies (b) obtained from the blood transfusion service center data set with the Bonferroni-OWA based similarity classifier with the basic linguistic quantifier variant.
(a)
(b)With echocardiogram data set, the highest achieved mean classification accuracy was91.13
%, obtained by using the trigonometric linguistic quantifier variant of the Bonferroni-OWA based similarity classifier. The Bonferroni mean based similarity classifier gave a mean accuracy of 90.90
%. All results received with the new proposed similarity classifiers and their variants were statistically significantly different from the results obtained by using the arithmetic mean based similarity classifier, at a 95
% confidence level. Statistically significant difference could not be verified between the new methods and the generalized mean based approach. In Table 7 mean accuracies and variances are reported for all new similarity classifiers and their variants and for the benchmark cases (⋆ indicates that achieved accuracies are statistically significantly different from accuracies obtained with the arithmetic mean based classifier (this is explained in the text)).Figure3 shows how different parameter value combinations affect the mean classification accuracy and the variance of the accuracy, when the trigonometric linguistic quantifier variant of the Bonferroni-OWA based similarity classifier is used.Figure 3
Mean classification accuracies (a) and the variances (b) obtained from the echocardiogram data set with the trigonometric linguistic quantifier variant of the Bonferroni-OWA based similarity classifier.
(a)
(b)When the lung cancer data set was examined, the highest achieved mean accuracy was82.94
% and was obtained with the Bonferroni mean based similarity classifier. We obtained classification accuracy of 82.75
% with the best functioning quadratic linguistic quantifier variant of the Bonferroni-OWA based similarity classifier. Detailed results are presented in Table 8. Statistically significant difference could not be verified between the new methods and the benchmark cases. Figure 4 shows how different parameter value combinations affect the mean classification accuracy and the variance of the accuracy, when the Bonferroni mean based similarity classifier is used. To produce the figure the parameter q (in the Bonferroni mean) was fixed at q
=
3 after a set of experimental runs to optimize performance. The highest accuracy reported was achieved with p
=
4 and α
=
4.Figure 4
Mean classification accuracies (a) and the variances (b) obtained from the lung cancer data set with the Bonferroni mean based similarity classifier, whenq
=
3.
(a)
(b)In Table9 we summarize the best achieved mean classification accuracies with the new similarity classifiers (and variants) and both the benchmark cases. As can be seen from the table there is no clear “winner,” but for all cases the new proposed similarity classifiers outperformed the benchmark cases; specifically the Bonferroni mean based similarity classifier was the best in two out of four cases and also for the remaining two cases beat both benchmark cases. In a way the overperformance with regard to the selected benchmarks might have been expected, as both the benchmarks are subcases of the Bonferroni mean.Table 9
A summary of classification accuracies for each of the similarity classifiers.
Data set
Bonferroni mean based classifier
Bonferroni-OWA based classifier
Generalized mean based classifier
Arithmetic mean based classifier
Fertility
74.20
%
70.63%
69.07%
66.87%
Blood transfusion
76.86%
76.91
%
76.43%
67.87%
Echocardiogram
90.96%
91.13
%
90.11%
86.89%
Lung cancer
82.94
%
82.75%
81.57%
82.16%


## 4.1. Experimental Setting for Examination of Results

The experiments were carried out by splitting each studied data set into two parts, one part for training and the other for testing. The data set divisions were repeated randomly30 times in each experiment and the resulting classification accuracies with corresponding means and variances (from the thirty runs) were recorded. Individual surface plots for each new similarity classifier variant were also plotted; these help to identify proper parameter values. Statistical comparison of classification accuracies from new classifiers with accuracies from the two benchmarks was made by using typical sample statistics (t-test).


## 4.2. Data Sets

Data sets used in testing our new classifier were retrieved from the UCI Machine Learning Repository [54]. Properties of each set used, including the number of classes and attributes and number of instances, are summarized in Table 1.Table 1
Data sets used and their main properties.
Data set
Number of classes
Number of attributes
Number of instances
Fertility
2
10
100
Blood transfusion service center
2
5
748
Echocardiogram
2
12
132
Lung cancer
3
56
32Further detailed attribute information for the fertility, blood transfusion service center, and echocardiogram data sets is presented in Tables2, 3, and 4.Table 2
Fertility data set attribute information.
Attribute number
Attribute name
1
Season
2
Age
3
Childish diseases
4
Accident or serious trauma
5
Surgical intervention
6
High fevers in the last year
7
Frequency of alcohol consumption
8
Smoking habit
9
Number of hours
10
Output (class attribute)Table 3
Blood transfusion service center data set attribute information.
Attribute number
Attribute name
1
Recency: months since last donation
2
Frequency: total number of donations
3
Monetary: total blood donated in c.c.
4
Time: months since first donation
5
Donated blood or not (class attribute)Table 4
Echocardiogram data set attribute information.
Attribute number
Attribute name
1
Survival
2
Still alive
3
Age at heart attack
4
Pericardial effusion
5
Fractional shortening
6
EPSS
7
LVDD
8
Wall motion score
9
Wall motion index
10
Mult
11
Name
12
Alive at one year or not (class)


## 4.3. Experimental Results

In this section we present the obtained results from the experiments. Mean accuracies from 30 separate runs were computed for each data set and for each classifier combination. The resulting classification accuracies and the variances obtained are reported in Tables5, 6, 7, and 8 separately for each data set. For the purposes of benchmarking the new similarity classifiers and their variants, we also report results obtained with arithmetic mean and generalized mean based similarity classifiers.Table 5
Classification results with the fertility data set.
Method
Mean accuracy (%)
Variance
Similarity classifier with Bonferroni-OWA using
Basic RIM quantifier
70.60
0.0073
Polynomial quantifier
70.63
⋆
0.0068
Quadratic quantifier
69.13
0.0094
Exponential quantifier
70.40
0.0084
Trigonometric quantifier
69.40
0.0076
Similarity classifier with
(1) Bonferroni mean
74.20
⋆
∘
0.0105
(2) Arithmetic mean
66.87
0.0031
(3) Generalized mean
69.07
0.0073Table 6
Classification results with blood transfusion service center data set.
Method
Mean accuracy (%)
Variance
Similarity classifier with Bonferroni-OWA using
Basic RIM quantifier
76.91
⋆
∘
3.7217
∗
1
0
-
5
Polynomial quantifier
76.68
⋆
∘
2.0059
∗
1
0
-
5
Quadratic quantifier
76.69
⋆
4.4908
∗
1
0
-
5
Exponential quantifier
76.87
⋆
4.6223
∗
1
0
-
5
Trigonometric quantifier
76.78
⋆
∘
3.5047
∗
1
0
-
5
Similarity classifier with
(1) Bonferroni mean
76.86
⋆
1.3792
∗
1
0
-
4
(2) Arithmetic mean
67.87
5.3303
∗
1
0
-
4
(3) Generalized mean
76.43
1.8604
∗
1
0
-
5Table 7
Classification results with the echocardiogram data set.
Method
Mean accuracy (%)
Variance
Similarity classifier with Bonferroni-OWA using
Basic RIM quantifier
90.73
⋆
2.9190
∗
1
0
-
4
Polynomial quantifier
90.56
⋆
5.4846
∗
1
0
-
4
Quadratic quantifier
90.62
⋆
9.8532
∗
1
0
-
4
Exponential quantifier
90.73
⋆
3.3152
∗
1
0
-
4
Trigonometric quantifier
91.13
⋆
9.4470
∗
1
0
-
4
Similarity classifier with
(1) Bonferroni mean
90.96
⋆
6.0096
∗
1
0
-
4
(2) Arithmetic mean
86.89
8.9022
∗
1
0
-
4
(3) Generalized mean
90.11
6.1582
∗
1
0
-
4Table 8
Classification results with the lung cancer data set.
Method
Mean accuracy (%)
Variance
Similarity classifier with Bonferroni-OWA using
Basic RIM quantifier
81.96
0.0052
Polynomial quantifier
81.37
0.0038
Quadratic quantifier
82.75
0.0036
Exponential quantifier
82.16
0.0027
Trigonometric quantifier
81.57
0.0033
Similarity classifier with
(1) Bonferroni mean
82.94
0.0032
(2) Arithmetic mean
82.16
0.0032
(3) Generalized mean
82.16
0.0032For the fertility data set, the highest classification accuracy of74.20
% was obtained using the Bonferroni mean based similarity classifier. The Bonferroni-OWA based classifier produced a classification accuracy of 70.63
% with the polynomial quantifier variant, the generalized mean based classifier gave the accuracy of 69.07
%, and the arithmetic mean based classifier gave the accuracy of 66.87
%. Complete results and their corresponding variances are presented in Table 5. In the same table, computed accuracies with a star (
⋆
) are statistically significantly different from the result with the arithmetic mean based similarity classifier and those with a circle (
∘
) are significantly different from the results obtained with the generalized mean based similarity classifier with a 95
% confidence level. The results with the new Bonferroni mean based similarity classifier exhibit a statistically significant difference (improved classification performance) to both benchmark cases. The Bonferroni-OWA based similarity classifier that uses the polynomial quantifier for weight generation was found to be statistically significantly better compared to the arithmetic mean based similarity classifier. For the rest of the Bonferroni-OWA variants a statistically significant difference to the benchmark cases could not be established.Figure1 shows the surface corresponding to the classification results received from a set of runs with different combinations of parameter values of the parameters p
=
[
0,8
] for the similarity measure and α
=
0,8 for the Bonferroni mean, obtained with the Bonferroni mean based similarity classifier and the corresponding variances. The q-value (for Bonferroni mean) was fixed at the value 6—this value was not randomly set, but the choice was a result of optimization performed. The best performance was reached with p set to approximately 6 and α set to approximately 6.Figure 1
Mean classification accuracies (a) and the variances (b) obtained from the fertility data set with the Bonferroni mean based classifier, whenq
=
6.
(a)
(b)When the new similarity classifiers were used to classify the blood transfusion service center data set, the highest achieved mean accuracy was76.91
% and was obtained with the basic linguistic quantifier variant of the Bonferroni-OWA based similarity classifier. The classification accuracy of 76.86
% was achieved with the Bonferroni mean based similarity classifier. With this data set, all results with the new proposed similarity based classifiers were found to have statistically significant difference with results from the arithmetic mean based similarity classifier method (indicated with ⋆). There was also statistically significant difference between the results from the generalized mean based method with three variants of the Bonferroni-OWA based similarity classifier (denoted with a circle in Table 6). Figure 2 shows how different combinations of the values for parameters p and α affect the resulting classification accuracy and the corresponding variance of the classification accuracy.Figure 2
Mean classification accuracies (a) and the variances of the accuracies (b) obtained from the blood transfusion service center data set with the Bonferroni-OWA based similarity classifier with the basic linguistic quantifier variant.
(a)
(b)With echocardiogram data set, the highest achieved mean classification accuracy was91.13
%, obtained by using the trigonometric linguistic quantifier variant of the Bonferroni-OWA based similarity classifier. The Bonferroni mean based similarity classifier gave a mean accuracy of 90.90
%. All results received with the new proposed similarity classifiers and their variants were statistically significantly different from the results obtained by using the arithmetic mean based similarity classifier, at a 95
% confidence level. Statistically significant difference could not be verified between the new methods and the generalized mean based approach. In Table 7 mean accuracies and variances are reported for all new similarity classifiers and their variants and for the benchmark cases (⋆ indicates that achieved accuracies are statistically significantly different from accuracies obtained with the arithmetic mean based classifier (this is explained in the text)).Figure3 shows how different parameter value combinations affect the mean classification accuracy and the variance of the accuracy, when the trigonometric linguistic quantifier variant of the Bonferroni-OWA based similarity classifier is used.Figure 3
Mean classification accuracies (a) and the variances (b) obtained from the echocardiogram data set with the trigonometric linguistic quantifier variant of the Bonferroni-OWA based similarity classifier.
(a)
(b)When the lung cancer data set was examined, the highest achieved mean accuracy was82.94
% and was obtained with the Bonferroni mean based similarity classifier. We obtained classification accuracy of 82.75
% with the best functioning quadratic linguistic quantifier variant of the Bonferroni-OWA based similarity classifier. Detailed results are presented in Table 8. Statistically significant difference could not be verified between the new methods and the benchmark cases. Figure 4 shows how different parameter value combinations affect the mean classification accuracy and the variance of the accuracy, when the Bonferroni mean based similarity classifier is used. To produce the figure the parameter q (in the Bonferroni mean) was fixed at q
=
3 after a set of experimental runs to optimize performance. The highest accuracy reported was achieved with p
=
4 and α
=
4.Figure 4
Mean classification accuracies (a) and the variances (b) obtained from the lung cancer data set with the Bonferroni mean based similarity classifier, whenq
=
3.
(a)
(b)In Table9 we summarize the best achieved mean classification accuracies with the new similarity classifiers (and variants) and both the benchmark cases. As can be seen from the table there is no clear “winner,” but for all cases the new proposed similarity classifiers outperformed the benchmark cases; specifically the Bonferroni mean based similarity classifier was the best in two out of four cases and also for the remaining two cases beat both benchmark cases. In a way the overperformance with regard to the selected benchmarks might have been expected, as both the benchmarks are subcases of the Bonferroni mean.Table 9
A summary of classification accuracies for each of the similarity classifiers.
Data set
Bonferroni mean based classifier
Bonferroni-OWA based classifier
Generalized mean based classifier
Arithmetic mean based classifier
Fertility
74.20
%
70.63%
69.07%
66.87%
Blood transfusion
76.86%
76.91
%
76.43%
67.87%
Echocardiogram
90.96%
91.13
%
90.11%
86.89%
Lung cancer
82.94
%
82.75%
81.57%
82.16%


## 5. Discussion

In this paper we have proposed a new Bonferroni mean based similarity classifier and a new Bonferroni-OWA based similarity classifier with five variants that are based on different linguistic quantifier based weight generation schemes for the OWA used in the classifier. The classification performance of the proposed new similarity classifiers was tested on four real world medical data sets, for each of which thirty sets of runs were made and the mean average classification performance was recorded. As a benchmark, we have compared the results from the proposed new similarity classifiers with two previously presented similarity classifiers, based on the generalized mean and on the arithmetic mean. The mean classification performance of the proposed new similarity classifiers was better than the performance of the benchmarks; however, not on all data sets was the difference in performance statistically significant. Nevertheless, there is evidence that suggests that the proposed new similarity classifiers perform at least as well as and often better than the benchmark similarity classifiers. We note that the performance of these classifiers is data dependent.Future research on the subject of similarity classifiers, multiclassifier approach, could be considered where each classifier would have one vote on samples class and the final class of the sample is decided by the consensus of the classifiers.



---

*Source: 7173054-2016-07-26.xml*