# An Improved Belief Entropy and Its Application in Decision-Making

Authors: Deyun Zhou; Yongchuan Tang; Wen Jiang
Journal: Complexity
 (2017)

---

## Abstract

Uncertainty measure in data fusion applications is a hot topic; quite a few methods have been proposed to measure the degree of uncertainty in Dempster-Shafer framework. However, the existing methods pay little attention to the scale of the frame of discernment (FOD), which means a loss of information. Due to this reason, the existing methods cannot measure the difference of uncertain degree among different FODs. In this paper, an improved belief entropy is proposed in Dempster-Shafer framework. The proposed belief entropy takes into consideration more available information in the body of evidence (BOE), including the uncertain information modeled by the mass function, the cardinality of the proposition, and the scale of the FOD. The improved belief entropy is a new method for uncertainty measure in Dempster-Shafer framework. Based on the new belief entropy, a decision-making approach is designed. The validity of the new belief entropy is verified according to some numerical examples and the proposed decision-making approach.


---

## Body

## 1. Introduction

Decision-making in the uncertain environment is common in real world applications, such as civil engineering [1–3], supply chain management [4, 5], risk analysis [6, 7], medical service [8, 9], and so on [10–12]. In order to reach the goal of maximum comprehensive benefits, many methods have been developed for decision-making based on probability theory [13, 14], fuzzy set theory [15–18], Dempster-Shafer evidence theory [19–22], rough set theory [23–25], and so on [26–29].Dempster-Shafer evidence theory [19, 20] is effective in uncertain information processing. It provides the frame of discernment (FOD) and the basic probability assignment (BPA) for information modeling, as well as the Dempster’s rule of combination for data fusion. Dempster-Shafer evidence theory has been extensively studied in many fields such as pattern recognition [30–34], fault diagnosis [35–38], multiple attribute decision-making [39–41], risk analysis [22, 35, 42, 43], controller design [44, 45], and so on [46–48]. Some open issues in Dempster-Shafer evidence theory are still needed for further study, including the conflicting management [49–52], the independence of different evidences [53–55], the methods to generate BPAs [56–58], and the incompleteness of the FOD [59–61]. One way to address these open issues is to quantify the uncertain degree of uncertain information before further information processing.In the probabilistic framework, Shannon entropy [62] is a well-known theory for uncertainty measure; it has attracted much attention in real applications [63–65]. But Shannon entropy cannot be used directly in the framework of Dempster-Shafer evidence theory, because a mass function in evidence theory is a generalized probability assigned on the power set of the FOD. In order to overcome this limitation, in Dempster-Shafer framework, many methods have been proposed to measure the uncertain degree of the evidence, such as Hohle’s confusion measure [66], Yager’s dissonance measure [67], Dubois & Prade’s weighted Hartley entropy [68], Klir & Ramer’s discord measure [69], Klir & Parviz’s strife measure [70], George & Pal’s total conflict measure [71], and so on [72–74]. Some of these methods are derived from Shannon entropy [66–70]. But the aforementioned methods are somehow not that effective in some cases [71, 75].Lately, another uncertainty measure named Deng entropy [75] is proposed in Dempster-Shafer framework. Although Deng entropy has been successfully applied in some real applications [36–38, 80, 81], it does not take into consideration the scale of the FOD, which means a loss of available information while doing information processing. To make matters worse, the information loss will lead to failure for uncertainty measure in some cases [71]. The same shortage also exists in the confusion measure [66], the dissonance measure [67], the weighted Hartley entropy [68], the discord measure [69], and the strife measure [70]. To address this issue, an improved belief entropy based on Deng entropy is proposed in this paper. The proposed belief entropy can improve the performance of Deng entropy by considering the scale of the FOD and the relative scale of a focal element with respect to FOD. What is more, the proposed method keeps all the merits of Deng entropy; thus it can degenerate to Shannon entropy in the sense of the probability consistency.In order to verify the validity of the improved belief entropy, a decision-making approach in target identification is designed based on the new belief entropy. In the proposed method, the uncertain degree of the sensor data is measured by the new belief entropy; then the uncertain degree will be used as the relative weight of each sensor report modeled as the body of evidence (BOE); after that, the BPAs of the BOE will be modified by the weight value; finally, the decision-making is based on the fusion results of applying Dempster’s rule of combination to the modified BPAs.The rest of this paper is organized as follows. In Section2, the preliminaries on Dempster-Shafer evidence theory, Shannon entropy, and some uncertainty measures in Dempster-Shafer framework are briefly introduced. In Section 3, the improved belief entropy is proposed; some behaviors of the proposed belief entropy are discussed with the numerical examples. In Section 4, an uncertainty measure-based decision-making approach is proposed to show the efficiency of the new belief entropy. The conclusions are given in Section 5.


## 2. Preliminaries

In this section, some preliminaries are briefly introduced, including Dempster-Shafer evidence theory, Shannon entropy, and some typical uncertainty measures in Dempster-Shafer framework.


### 2.1. Dempster-Shafer Evidence Theory

LetΩ=θ1,θ2,…,θi,…,θN be a finite nonempty set of mutually exclusive and exhaustive events, and Ω is called theframe of discernment (FOD). The power set of Ω, denoted as 2Ω, is composed of 2N elements denoted as follows:(1)2Ω=∅,θ1,θ2,…,θN,θ1,θ2,…,θ1,θ2,…,θi,…,Ω.Amass functionm is defined as a mapping from the power set 2Ω to the interval [0,1], which satisfies the following conditions [19, 20]:(2)m∅=0,∑A∈ΩmA=1.IfmA>0, then A is called afocal element, and the mass function mA represents how strongly the evidence supports proposition A.Abody of evidence (BOE), also known as abasic probability assignment (BPA) orbasic belief assignment (BBA), is represented by the focal sets and their associated mass value:(3)R,m=A,mA:A∈2Ω,mA>0,where R is a subset of the power set 2Ω and each A∈R has an associated nonzero mass value mA.A BPAm can also be represented by its associate belief function Bel and plausibility function Pl, respectively, defined as follows:(4)BelA=∑ϕ≠B⊆AmB,PlA=∑B∩A≠ϕmB.In Dempster-Shafer evidence theory, two independent mass functions, denoted asm1 and m2, can be combined with Dempster’s rule of combination defined as follows [19, 20]:(5)mA=m1⊕m2A=11-k∑B∩C=Am1Bm2C,where k is a normalization constant representing thedegree of conflict between m1 and m2 and k is defined as follows [19, 20]:(6)k=∑B∩C=∅m1Bm2C.


### 2.2. Shannon Entropy

As an uncertainty measure of information volume in a system or process, Shannon entropy plays a central role in information theory. Shannon entropy indicates that the information volume of each piece of information is directly connected to its uncertainty degree.Shannon entropy, as the information entropy, is defined as follows [62]:(7)H=-∑i=1Npilogbpi,where N is the number of basic states, pi is the probability of state i and pi satisfies ∑i=1Npi=1, and b is the basis of the logarithm which accounts for the scaling of H. Although b is arbitrary, b is usually chosen to be 2, and the unit of information entropy is bit. If b is the natural base, then the unit of information entropy will be Nat. Mathematically, as a scaling factor, different basis of the logarithm is convertible.


### 2.3. Uncertainty Measures in Dempster-Shafer Framework

In Dempster-Shafer framework, some uncertainty measures for the BOE are presented, as is shown in Table1, where X is the FOD, A and B are focal elements of a mass function, and A denotes the cardinality of A.Table 1
Uncertainty measures in Dempster-Shafer framework.
Uncertainty measure
Definition
Hohle’s confusion measure [66]
C
H
m
=
-
∑
A
⊆
X
‍
m
A
l
o
g
2
B
e
l
A
Yager’s dissonance measure [67]
E
Y
m
=
-
∑
A
⊆
X
‍
m
A
l
o
g
2
P
l
A
Dubois & Prade’s weighted Hartley entropy [68]
E
D
P
m
=
∑
A
⊆
X
‍
m
A
l
o
g
2
A
Klir & Ramer’s discord measure [69]
D
K
R
m
=
-
∑
A
⊆
X
‍
m
A
l
o
g
2
∑
B
⊆
X
‍
m
B
A
∩
B
B
Klir & Parviz’s strife measure [70]
S
K
P
m
=
-
∑
A
⊆
X
‍
m
A
l
o
g
2
∑
B
⊆
X
‍
m
B
A
∩
B
A
George & Pal’s total conflict measure [71]
T
C
G
P
m
=
∑
A
⊆
X
m
A
∑
B
⊆
X
‍
m
B
1
-
A
∩
B
A
∪
BLately, another belief entropy, named Deng entropy, is presented to measure the uncertainty in the BOE. Deng entropy, denoted asEd, is defined as follows [75]:(8)Edm=-∑A⊆XmAlog2⁡mA2A-1.


## 2.1. Dempster-Shafer Evidence Theory

LetΩ=θ1,θ2,…,θi,…,θN be a finite nonempty set of mutually exclusive and exhaustive events, and Ω is called theframe of discernment (FOD). The power set of Ω, denoted as 2Ω, is composed of 2N elements denoted as follows:(1)2Ω=∅,θ1,θ2,…,θN,θ1,θ2,…,θ1,θ2,…,θi,…,Ω.Amass functionm is defined as a mapping from the power set 2Ω to the interval [0,1], which satisfies the following conditions [19, 20]:(2)m∅=0,∑A∈ΩmA=1.IfmA>0, then A is called afocal element, and the mass function mA represents how strongly the evidence supports proposition A.Abody of evidence (BOE), also known as abasic probability assignment (BPA) orbasic belief assignment (BBA), is represented by the focal sets and their associated mass value:(3)R,m=A,mA:A∈2Ω,mA>0,where R is a subset of the power set 2Ω and each A∈R has an associated nonzero mass value mA.A BPAm can also be represented by its associate belief function Bel and plausibility function Pl, respectively, defined as follows:(4)BelA=∑ϕ≠B⊆AmB,PlA=∑B∩A≠ϕmB.In Dempster-Shafer evidence theory, two independent mass functions, denoted asm1 and m2, can be combined with Dempster’s rule of combination defined as follows [19, 20]:(5)mA=m1⊕m2A=11-k∑B∩C=Am1Bm2C,where k is a normalization constant representing thedegree of conflict between m1 and m2 and k is defined as follows [19, 20]:(6)k=∑B∩C=∅m1Bm2C.


## 2.2. Shannon Entropy

As an uncertainty measure of information volume in a system or process, Shannon entropy plays a central role in information theory. Shannon entropy indicates that the information volume of each piece of information is directly connected to its uncertainty degree.Shannon entropy, as the information entropy, is defined as follows [62]:(7)H=-∑i=1Npilogbpi,where N is the number of basic states, pi is the probability of state i and pi satisfies ∑i=1Npi=1, and b is the basis of the logarithm which accounts for the scaling of H. Although b is arbitrary, b is usually chosen to be 2, and the unit of information entropy is bit. If b is the natural base, then the unit of information entropy will be Nat. Mathematically, as a scaling factor, different basis of the logarithm is convertible.


## 2.3. Uncertainty Measures in Dempster-Shafer Framework

In Dempster-Shafer framework, some uncertainty measures for the BOE are presented, as is shown in Table1, where X is the FOD, A and B are focal elements of a mass function, and A denotes the cardinality of A.Table 1
Uncertainty measures in Dempster-Shafer framework.
Uncertainty measure
Definition
Hohle’s confusion measure [66]
C
H
m
=
-
∑
A
⊆
X
‍
m
A
l
o
g
2
B
e
l
A
Yager’s dissonance measure [67]
E
Y
m
=
-
∑
A
⊆
X
‍
m
A
l
o
g
2
P
l
A
Dubois & Prade’s weighted Hartley entropy [68]
E
D
P
m
=
∑
A
⊆
X
‍
m
A
l
o
g
2
A
Klir & Ramer’s discord measure [69]
D
K
R
m
=
-
∑
A
⊆
X
‍
m
A
l
o
g
2
∑
B
⊆
X
‍
m
B
A
∩
B
B
Klir & Parviz’s strife measure [70]
S
K
P
m
=
-
∑
A
⊆
X
‍
m
A
l
o
g
2
∑
B
⊆
X
‍
m
B
A
∩
B
A
George & Pal’s total conflict measure [71]
T
C
G
P
m
=
∑
A
⊆
X
m
A
∑
B
⊆
X
‍
m
B
1
-
A
∩
B
A
∪
BLately, another belief entropy, named Deng entropy, is presented to measure the uncertainty in the BOE. Deng entropy, denoted asEd, is defined as follows [75]:(8)Edm=-∑A⊆XmAlog2⁡mA2A-1.


## 3. The Improved Belief Entropy

### 3.1. Problem Description

In Dempster-Shafer framework, the uncertain information modeled in the BOE includes the mass function and the FOD. However, the existing uncertainty measures only focus on the mass function [66, 67] or at most take into consideration the cardinality of each proposition [68–71, 75]. In other words, the scale of the FOD is totally ignored. Without taking full advantage of available information in the BOE, the existing uncertainty measures cannot effectively quantify the difference among different BOEs if the same mass value is assigned on different FOD. A simple example of the limitation of Deng entropy is shown in Example 1.Example 1.
Consider a target identification problem; assume that two reliable sensors report the detection results independently. The results are represented by BOEs shown as follows:(9)m1:m1a,b=0.4,m1c,d=0.6,m2:m2a,c=0.4,m2b,c=0.6.
Recalling (8), the uncertainty measure with Deng entropy is shown as follows:(10)Edm1=-∑A⊆Xm1Alog2⁡m1A2A-1=-0.4log2⁡0.422-1-0.6log2⁡0.622-1=2.5559,Edm2=-∑A⊆Xm2Alog2⁡m2A2A-1=-0.4log2⁡0.422-1-0.6log2⁡0.622-1=2.5559.
The limitation of Deng entropy also exists in Dubois & Prade’s weighted Hartley entropy [68], and the uncertainty measure with the weighted Hartley entropy is shown as follows:(11)EDPm1=∑A⊆Xm1Alog2⁡A=0.4log2⁡2+0.6log2⁡2=1,EDPm2=∑A⊆Xm2Alog2⁡A=0.4log2⁡2+0.6log2⁡2=1.
The results calculated by Deng entropy and the weighted Hartley entropy are counterintuitive. Although the two BOEs have the same mass value, the FOD of the first BOEm1 consists of four targets, denoted as a, b, c, and d, while the second BOE m2 has only three possible targets, denoted as a, b, and c. Intuitively, it is expected that m2 has a less uncertainty than m1. In other words, the belief entropy of m1 should be bigger than that of m2. Both Deng entropy and weighted Hartley entropy fail to quantify this difference.
To address this issue, an improved belief entropy is proposed.


### 3.2. The Proposed Belief Entropy

In Dempster-Shafer framework, the improved belief entropy is proposed as follows:(12)EIdm=-∑A⊆XmAlog2⁡mA2A-1eA-1/X,where X is the FOD, A denotes the cardinality of the focal element A, and X is the number of element in the FOD. Compared with some other uncertainty measures in [66–71, 75], the improved belief entropy addresses more information in a BOE. The uncertain information addressed by the new belief entropy includes the information represented by the mass function, the cardinality of each proposition, the scale of FOD (denoted as X), and the relative scale of a focal element with respect to the FOD (denoted as A-1/X).In detail, compared with the confusion measure [66] and the dissonance measure [67], the uncertain information modeled by the cardinality of each proposition and the scale of FOD now can be handled properly. Compared with the weighted Hartley entropy [68], the discord measure [69], the strife measure [70], the total conflict measure [71] and Deng entropy [75], the scale of FOD, and the relative scale of a focal element with respect to the FOD now can be processed effectively. Above all, by involving the cardinality of each proposition and the scale of FOD in the proposed belief entropy, the new uncertainty measure can now effectively quantify the difference among different BOEs even if the same mass value is assigned on different FODs. What is more, more information of the BOE is addressed in information processing which means less information loss.With the new belief entropy, recall the issue in Example1; the improved belief entropy for these two BOEs is calculated as follows:(13)EIdm1=-∑A⊆Xm1Alog2⁡m1A2A-1eA-1/X=-0.4log2⁡0.422-1e2-1/4-0.6log2⁡0.622-1e2-1/4=2.1952,EIdm2=-∑A⊆Xm2Alog2⁡m2A2A-1eA-1/X=-0.4log2⁡0.422-1e2-1/3-0.6log2⁡0.622-1e2-1/3=2.0750.It can be concluded that both the weighted Hartley entropy and Deng entropy cannot measure the different uncertain degree between these two BOEs, while the new belief entropy can effectively measure the difference by taking into consideration more available information of the BOE. According to Table2, it is also safe to say that the first BOE m1 has a higher uncertain degree with the new belief entropy; this is reasonable because the FOD of m1 includes four possible targets which means a larger information volume than the second BOE m2. The efficiency of the new belief entropy is not available in the weighted Hartley entropy and Deng entropy.Table 2
Calculation results in Example1.
BOEs
Weight Hartley entropy [68]
Deng entropy [75]
Improved belief entropy
m
1
1
2.5559
2.1952
m
2
1
2.5559
2.0750


### 3.3. Behaviors of the Proposed Belief Entropy

In order to show the rationality and merit of the proposed belief entropy, some numerical examples are presented in this section. In Section3.3.1, the compatibility of the new belief entropy with Shannon entropy is verified with some simple numerical examples. In Section 3.3.2, the superiority of the new belief entropy compared with some other uncertainty measures is presented.


#### 3.3.1. Compatibility with Shannon Entropy

Example 2.
Consider a target identification problem; if the target reported by the sensor isa with one hundred percent belief, then the mass function can be denoted as ma=1 in the frame of discernment X=a.
Shannon entropyH, Deng entropy Ed, and the improved belief entropy EId are calculated, respectively, as follows:(14)Hm=-1×log2⁡1=0,Edm=-1×log2⁡121-1=0,EIdm=-1×log2⁡121-1e1-1/1=0.
It is obvious that the uncertainty degree for a certain event is zero. So the values of Shannon entropy, Deng entropy, and the improved belief entropy are all zero.Example 3.
Consider the mass functionsma=mb=mc=md=0.25 in the frame of discernment X=a,b,c,d.
Shannon entropyH, Deng entropy Ed, and the improved belief entropy EId are calculated, respectively, as follows:(15)Hm=-0.25×log2⁡0.25×4=2.0000,Edm=-0.25×log2⁡0.2521-1×4=2.0000,EIdm=-0.25×log2⁡0.2521-1e1-1/4×4=2.0000.
According to Examples2 and 3, if the mass value is only assigned on the single element, the result of the improved belief entropy is consistent with Shannon entropy and Deng entropy. The new belief entropy is compatible with Shannon entropy in the sense of the probability consistency, which indicates the effectiveness of the proposed belief entropy.


#### 3.3.2. Efficiency in Uncertainty Measure

In order to test the efficiency and merit of the new belief entropy, recall the numerical example in [75] as follows.Example 4.
Consider the mass functionsm6=0.05, m3,4,5=0.05, mT=0.8, and mX=0.1. The FOD X=1,2,…,14,15 is with fifteen elements denoted as Element1,…,andElement15. The proposition T consists of a variable subset with the number of element changing from one to fourteen, as is shown in Table 3.
Deng entropyEd and the improved belief entropy EId are calculated, respectively, with the variable element number in the proposition T; the results are shown in Table 3. Table 3 shows that the improved belief entropy is smaller than Deng entropy. This is reasonable, because more information in the BOE is taken into consideration within the improved belief entropy. By taking into consideration more available information, the uncertain degree measured by the new belief entropy decreases significantly compared to Deng entropy, which can be really helpful in information processing.
The uncertain degree in Example4, measured by the other uncertainty measures in Table 1, is shown in Figure 1. The uncertain degree measured by Hohle’s confusion measure never changes with the variation of the element number in proposition T; thus it cannot measure the variance of uncertain degree in this case. Similar to Hohle’s confusion measure, Yager’s dissonance measure has a limited capacity of uncertainty measure in this case. Both the confusion measure and the dissonance measure cannot measure the change in the proposition T. The uncertain degree measured by Klir & Ramer’s discord measure, Klir & Parviz’s strife measure, and George & Pal’s conflict measure is decreasing with the increasing of the element number in the proposition T; this is counterintuitive. Thus, the confusion measure, the dissonance measure, the discord measure, the strife measure, and the conflict measure cannot effectively measure the rising of the uncertain degree along with the increasing of the element number in the proposition T.
It seems that the uncertain degree measured by Dubois & Prade’s weighted Hartley entropy, Deng entropy, and the modified belief entropy is rising significantly with the increasing of the element number in propositionT. However, the weighted Hartley entropy and Deng entropy cannot distinguish the different uncertain degree among the BOEs with similar BPAs on different FODs, as is shown in Example 1. Thus, the improved belief entropy is the only available method for uncertainty measure in this case. More importantly, the proposed belief entropy takes advantage of more valuable information in the BOE, which ensures it to be more reasonable and effective for uncertainty measure in Dempster-Shafer framework.Table 3
Improved belief entropy with a variable element number inT.
Cases
Deng entropy
Improved belief entropy
T
=
1
2.6623
2.5180
T
=
1,2
3.9303
3.7090
T
=
1,2
,
3
4.9082
4.6100
T
=
1
,
…
,
4
5.7878
5.4127
T
=
1
,
…
,
5
6.6256
6.1736
T
=
1
,
…
,
6
7.4441
6.9151
T
=
1
,
…
,
7
8.2532
7.6473
T
=
1
,
…
,
8
9.0578
8.3749
T
=
1
,
…
,
9
9.8600
9.1002
T
=
1
,
…
,
10
10.6612
9.8244
T
=
1
,
…
,
11
11.4617
10.5480
T
=
1
,
…
,
12
12.2620
11.2714
T
=
1
,
…
,
13
13.0622
11.9946
T
=
1
,
…
,
14
13.8622
12.7177Figure 1
Comparison among different uncertainty measures.


## 3.1. Problem Description

In Dempster-Shafer framework, the uncertain information modeled in the BOE includes the mass function and the FOD. However, the existing uncertainty measures only focus on the mass function [66, 67] or at most take into consideration the cardinality of each proposition [68–71, 75]. In other words, the scale of the FOD is totally ignored. Without taking full advantage of available information in the BOE, the existing uncertainty measures cannot effectively quantify the difference among different BOEs if the same mass value is assigned on different FOD. A simple example of the limitation of Deng entropy is shown in Example 1.Example 1.
Consider a target identification problem; assume that two reliable sensors report the detection results independently. The results are represented by BOEs shown as follows:(9)m1:m1a,b=0.4,m1c,d=0.6,m2:m2a,c=0.4,m2b,c=0.6.
Recalling (8), the uncertainty measure with Deng entropy is shown as follows:(10)Edm1=-∑A⊆Xm1Alog2⁡m1A2A-1=-0.4log2⁡0.422-1-0.6log2⁡0.622-1=2.5559,Edm2=-∑A⊆Xm2Alog2⁡m2A2A-1=-0.4log2⁡0.422-1-0.6log2⁡0.622-1=2.5559.
The limitation of Deng entropy also exists in Dubois & Prade’s weighted Hartley entropy [68], and the uncertainty measure with the weighted Hartley entropy is shown as follows:(11)EDPm1=∑A⊆Xm1Alog2⁡A=0.4log2⁡2+0.6log2⁡2=1,EDPm2=∑A⊆Xm2Alog2⁡A=0.4log2⁡2+0.6log2⁡2=1.
The results calculated by Deng entropy and the weighted Hartley entropy are counterintuitive. Although the two BOEs have the same mass value, the FOD of the first BOEm1 consists of four targets, denoted as a, b, c, and d, while the second BOE m2 has only three possible targets, denoted as a, b, and c. Intuitively, it is expected that m2 has a less uncertainty than m1. In other words, the belief entropy of m1 should be bigger than that of m2. Both Deng entropy and weighted Hartley entropy fail to quantify this difference.
To address this issue, an improved belief entropy is proposed.


## 3.2. The Proposed Belief Entropy

In Dempster-Shafer framework, the improved belief entropy is proposed as follows:(12)EIdm=-∑A⊆XmAlog2⁡mA2A-1eA-1/X,where X is the FOD, A denotes the cardinality of the focal element A, and X is the number of element in the FOD. Compared with some other uncertainty measures in [66–71, 75], the improved belief entropy addresses more information in a BOE. The uncertain information addressed by the new belief entropy includes the information represented by the mass function, the cardinality of each proposition, the scale of FOD (denoted as X), and the relative scale of a focal element with respect to the FOD (denoted as A-1/X).In detail, compared with the confusion measure [66] and the dissonance measure [67], the uncertain information modeled by the cardinality of each proposition and the scale of FOD now can be handled properly. Compared with the weighted Hartley entropy [68], the discord measure [69], the strife measure [70], the total conflict measure [71] and Deng entropy [75], the scale of FOD, and the relative scale of a focal element with respect to the FOD now can be processed effectively. Above all, by involving the cardinality of each proposition and the scale of FOD in the proposed belief entropy, the new uncertainty measure can now effectively quantify the difference among different BOEs even if the same mass value is assigned on different FODs. What is more, more information of the BOE is addressed in information processing which means less information loss.With the new belief entropy, recall the issue in Example1; the improved belief entropy for these two BOEs is calculated as follows:(13)EIdm1=-∑A⊆Xm1Alog2⁡m1A2A-1eA-1/X=-0.4log2⁡0.422-1e2-1/4-0.6log2⁡0.622-1e2-1/4=2.1952,EIdm2=-∑A⊆Xm2Alog2⁡m2A2A-1eA-1/X=-0.4log2⁡0.422-1e2-1/3-0.6log2⁡0.622-1e2-1/3=2.0750.It can be concluded that both the weighted Hartley entropy and Deng entropy cannot measure the different uncertain degree between these two BOEs, while the new belief entropy can effectively measure the difference by taking into consideration more available information of the BOE. According to Table2, it is also safe to say that the first BOE m1 has a higher uncertain degree with the new belief entropy; this is reasonable because the FOD of m1 includes four possible targets which means a larger information volume than the second BOE m2. The efficiency of the new belief entropy is not available in the weighted Hartley entropy and Deng entropy.Table 2
Calculation results in Example1.
BOEs
Weight Hartley entropy [68]
Deng entropy [75]
Improved belief entropy
m
1
1
2.5559
2.1952
m
2
1
2.5559
2.0750


## 3.3. Behaviors of the Proposed Belief Entropy

In order to show the rationality and merit of the proposed belief entropy, some numerical examples are presented in this section. In Section3.3.1, the compatibility of the new belief entropy with Shannon entropy is verified with some simple numerical examples. In Section 3.3.2, the superiority of the new belief entropy compared with some other uncertainty measures is presented.


### 3.3.1. Compatibility with Shannon Entropy

Example 2.
Consider a target identification problem; if the target reported by the sensor isa with one hundred percent belief, then the mass function can be denoted as ma=1 in the frame of discernment X=a.
Shannon entropyH, Deng entropy Ed, and the improved belief entropy EId are calculated, respectively, as follows:(14)Hm=-1×log2⁡1=0,Edm=-1×log2⁡121-1=0,EIdm=-1×log2⁡121-1e1-1/1=0.
It is obvious that the uncertainty degree for a certain event is zero. So the values of Shannon entropy, Deng entropy, and the improved belief entropy are all zero.Example 3.
Consider the mass functionsma=mb=mc=md=0.25 in the frame of discernment X=a,b,c,d.
Shannon entropyH, Deng entropy Ed, and the improved belief entropy EId are calculated, respectively, as follows:(15)Hm=-0.25×log2⁡0.25×4=2.0000,Edm=-0.25×log2⁡0.2521-1×4=2.0000,EIdm=-0.25×log2⁡0.2521-1e1-1/4×4=2.0000.
According to Examples2 and 3, if the mass value is only assigned on the single element, the result of the improved belief entropy is consistent with Shannon entropy and Deng entropy. The new belief entropy is compatible with Shannon entropy in the sense of the probability consistency, which indicates the effectiveness of the proposed belief entropy.


### 3.3.2. Efficiency in Uncertainty Measure

In order to test the efficiency and merit of the new belief entropy, recall the numerical example in [75] as follows.Example 4.
Consider the mass functionsm6=0.05, m3,4,5=0.05, mT=0.8, and mX=0.1. The FOD X=1,2,…,14,15 is with fifteen elements denoted as Element1,…,andElement15. The proposition T consists of a variable subset with the number of element changing from one to fourteen, as is shown in Table 3.
Deng entropyEd and the improved belief entropy EId are calculated, respectively, with the variable element number in the proposition T; the results are shown in Table 3. Table 3 shows that the improved belief entropy is smaller than Deng entropy. This is reasonable, because more information in the BOE is taken into consideration within the improved belief entropy. By taking into consideration more available information, the uncertain degree measured by the new belief entropy decreases significantly compared to Deng entropy, which can be really helpful in information processing.
The uncertain degree in Example4, measured by the other uncertainty measures in Table 1, is shown in Figure 1. The uncertain degree measured by Hohle’s confusion measure never changes with the variation of the element number in proposition T; thus it cannot measure the variance of uncertain degree in this case. Similar to Hohle’s confusion measure, Yager’s dissonance measure has a limited capacity of uncertainty measure in this case. Both the confusion measure and the dissonance measure cannot measure the change in the proposition T. The uncertain degree measured by Klir & Ramer’s discord measure, Klir & Parviz’s strife measure, and George & Pal’s conflict measure is decreasing with the increasing of the element number in the proposition T; this is counterintuitive. Thus, the confusion measure, the dissonance measure, the discord measure, the strife measure, and the conflict measure cannot effectively measure the rising of the uncertain degree along with the increasing of the element number in the proposition T.
It seems that the uncertain degree measured by Dubois & Prade’s weighted Hartley entropy, Deng entropy, and the modified belief entropy is rising significantly with the increasing of the element number in propositionT. However, the weighted Hartley entropy and Deng entropy cannot distinguish the different uncertain degree among the BOEs with similar BPAs on different FODs, as is shown in Example 1. Thus, the improved belief entropy is the only available method for uncertainty measure in this case. More importantly, the proposed belief entropy takes advantage of more valuable information in the BOE, which ensures it to be more reasonable and effective for uncertainty measure in Dempster-Shafer framework.Table 3
Improved belief entropy with a variable element number inT.
Cases
Deng entropy
Improved belief entropy
T
=
1
2.6623
2.5180
T
=
1,2
3.9303
3.7090
T
=
1,2
,
3
4.9082
4.6100
T
=
1
,
…
,
4
5.7878
5.4127
T
=
1
,
…
,
5
6.6256
6.1736
T
=
1
,
…
,
6
7.4441
6.9151
T
=
1
,
…
,
7
8.2532
7.6473
T
=
1
,
…
,
8
9.0578
8.3749
T
=
1
,
…
,
9
9.8600
9.1002
T
=
1
,
…
,
10
10.6612
9.8244
T
=
1
,
…
,
11
11.4617
10.5480
T
=
1
,
…
,
12
12.2620
11.2714
T
=
1
,
…
,
13
13.0622
11.9946
T
=
1
,
…
,
14
13.8622
12.7177Figure 1
Comparison among different uncertainty measures.


## 3.3.1. Compatibility with Shannon Entropy

Example 2.
Consider a target identification problem; if the target reported by the sensor isa with one hundred percent belief, then the mass function can be denoted as ma=1 in the frame of discernment X=a.
Shannon entropyH, Deng entropy Ed, and the improved belief entropy EId are calculated, respectively, as follows:(14)Hm=-1×log2⁡1=0,Edm=-1×log2⁡121-1=0,EIdm=-1×log2⁡121-1e1-1/1=0.
It is obvious that the uncertainty degree for a certain event is zero. So the values of Shannon entropy, Deng entropy, and the improved belief entropy are all zero.Example 3.
Consider the mass functionsma=mb=mc=md=0.25 in the frame of discernment X=a,b,c,d.
Shannon entropyH, Deng entropy Ed, and the improved belief entropy EId are calculated, respectively, as follows:(15)Hm=-0.25×log2⁡0.25×4=2.0000,Edm=-0.25×log2⁡0.2521-1×4=2.0000,EIdm=-0.25×log2⁡0.2521-1e1-1/4×4=2.0000.
According to Examples2 and 3, if the mass value is only assigned on the single element, the result of the improved belief entropy is consistent with Shannon entropy and Deng entropy. The new belief entropy is compatible with Shannon entropy in the sense of the probability consistency, which indicates the effectiveness of the proposed belief entropy.


## 3.3.2. Efficiency in Uncertainty Measure

In order to test the efficiency and merit of the new belief entropy, recall the numerical example in [75] as follows.Example 4.
Consider the mass functionsm6=0.05, m3,4,5=0.05, mT=0.8, and mX=0.1. The FOD X=1,2,…,14,15 is with fifteen elements denoted as Element1,…,andElement15. The proposition T consists of a variable subset with the number of element changing from one to fourteen, as is shown in Table 3.
Deng entropyEd and the improved belief entropy EId are calculated, respectively, with the variable element number in the proposition T; the results are shown in Table 3. Table 3 shows that the improved belief entropy is smaller than Deng entropy. This is reasonable, because more information in the BOE is taken into consideration within the improved belief entropy. By taking into consideration more available information, the uncertain degree measured by the new belief entropy decreases significantly compared to Deng entropy, which can be really helpful in information processing.
The uncertain degree in Example4, measured by the other uncertainty measures in Table 1, is shown in Figure 1. The uncertain degree measured by Hohle’s confusion measure never changes with the variation of the element number in proposition T; thus it cannot measure the variance of uncertain degree in this case. Similar to Hohle’s confusion measure, Yager’s dissonance measure has a limited capacity of uncertainty measure in this case. Both the confusion measure and the dissonance measure cannot measure the change in the proposition T. The uncertain degree measured by Klir & Ramer’s discord measure, Klir & Parviz’s strife measure, and George & Pal’s conflict measure is decreasing with the increasing of the element number in the proposition T; this is counterintuitive. Thus, the confusion measure, the dissonance measure, the discord measure, the strife measure, and the conflict measure cannot effectively measure the rising of the uncertain degree along with the increasing of the element number in the proposition T.
It seems that the uncertain degree measured by Dubois & Prade’s weighted Hartley entropy, Deng entropy, and the modified belief entropy is rising significantly with the increasing of the element number in propositionT. However, the weighted Hartley entropy and Deng entropy cannot distinguish the different uncertain degree among the BOEs with similar BPAs on different FODs, as is shown in Example 1. Thus, the improved belief entropy is the only available method for uncertainty measure in this case. More importantly, the proposed belief entropy takes advantage of more valuable information in the BOE, which ensures it to be more reasonable and effective for uncertainty measure in Dempster-Shafer framework.Table 3
Improved belief entropy with a variable element number inT.
Cases
Deng entropy
Improved belief entropy
T
=
1
2.6623
2.5180
T
=
1,2
3.9303
3.7090
T
=
1,2
,
3
4.9082
4.6100
T
=
1
,
…
,
4
5.7878
5.4127
T
=
1
,
…
,
5
6.6256
6.1736
T
=
1
,
…
,
6
7.4441
6.9151
T
=
1
,
…
,
7
8.2532
7.6473
T
=
1
,
…
,
8
9.0578
8.3749
T
=
1
,
…
,
9
9.8600
9.1002
T
=
1
,
…
,
10
10.6612
9.8244
T
=
1
,
…
,
11
11.4617
10.5480
T
=
1
,
…
,
12
12.2620
11.2714
T
=
1
,
…
,
13
13.0622
11.9946
T
=
1
,
…
,
14
13.8622
12.7177Figure 1
Comparison among different uncertainty measures.


## 4. An Uncertainty Measure-Based Decision-Making Approach

In this section, a decision-making approach in sensor data fusion is presented. After uncertainty measure with the improved belief entropy, the modified BOEs are fused with Dempster’s rule of combination. Finally, decision-making is based on the fused results.


### 4.1. Problem Description

In target recognition, sometimes, decision-making is based on reports from sensors. Consider the problem in [78]; the potential objects in the target recognition system are denoted as a, b, and c in the FOD, denoted as X=a,b,c. Five sensors report on the possible object independently and successively; each report is represented as a BOE; these BOEs are denoted as m1, m2, m3, m4, and m5, respectively.(16)m1:m1a=0.41,m1b=0.29,m1c=0.30,m1a,c=0.00,m2:m2a=0.00,m2b=0.90,m2c=0.10,m2a,c=0.00,m3:m3a=0.58,m3b=0.07,m3c=0.00,m3a,c=0.35,m4:m4a=0.55,m4b=0.10,m4c=0.00,m4a,c=0.35,m5:m5a=0.60,m5b=0.10,m5c=0.00,m5a,c=0.30.With the incoming data of sensors, which is the target? The target recognition system needs to make a decision based on the fusion results of the sensor data. Intuitively,a will be the right target. In the second BOE, the mass value assigned on target a is zero and the mass value of target b is 0.9; this is in high conflict with the other BOEs. According to [78, 79], the second BOE m2 may come from a bad sensor and its report on the target is abnormal. m2 will infer the correct fusion result, which may lead to a failure in decision-making. This case can be really a challenge for some data fusion methods that cannot handle conflicting evidences effectively [49, 50, 52].


### 4.2. Uncertainty Measure with the New Belief Entropy

Before further addressing the BOEs reported by sensors, the quality of this information is quantified with the proposed belief entropy. Recalling (12), the improved belief entropy of each BOE is calculated as follows:(17)EIdm1=-∑A⊆Xm1Alog2⁡m1A2A-1eA-1/X=-0.41log2⁡0.4121-1e1-1/3-0.29log2⁡0.2921-1e1-1/3-0.3log2⁡0.321-1e1-1/3=0.5274+0.5179+0.5211=1.5664EIdm2=-∑A⊆Xm2Alog2⁡m2A2A-1eA-1/X=-0.9log2⁡0.921-1e1-1/3-0.1log2⁡0.121-1e1-1/3=0.1368+0.3322=0.4690EIdm3=-∑A⊆Xm3Alog2⁡m3A2A-1eA-1/X=-0.58log2⁡0.5821-1e1-1/3-0.07log2⁡0.0721-1e1-1/3-0.35log2⁡0.3522-1e2-1/3=0.4558+0.2686+0.9165=1.6409EIdm4=-∑A⊆Xm4Alog2⁡m4A2A-1eA-1/X=-0.55log2⁡0.5521-1e1-1/3-0.1log2⁡0.121-1e1-1/3-0.35log2⁡0.3522-1e2-1/3=0.4744+0.3322+0.9165=1.7231EIdm5=-∑A⊆Xm5Alog2⁡m5A2A-1eA-1/X=-0.6log2⁡0.621-1e1-1/3-0.1log2⁡0.121-1e1-1/3-0.3log2⁡0.322-1e2-1/3=0.4422+0.3322+0.8523=1.6267.Intuitively, the second BOEm2 is conflicting with the other BOEs; this is also successfully indicated by the abnormal value of the improved belief entropy. In other words, the improved belief entropy value of m2, which is 0.4690, is abnormal in comparison with that of the other four BOEs.


### 4.3. Decision-Making Procedures

In real applications, for example, air battle, the real-time requirement is highly concerned, so decision-making in target recognition needs to be finished in real time. If decision-making needs to be finished in real time, then data fusion needs to be processed instantly with the upcoming sensor report. The procedures for decision-making based on the improved belief entropy are designed in Figure2; six steps are needed as follows.Figure 2
The flowchart of the proposed approach for decision-making.Step 1.
Evidence from sensor report is modeled as the BOE.
An example of this step is given in Section4.1; each piece of evidence is modeled as a BOE.Step 2.
Uncertainty measure of each BOE with the improved belief entropy.
Generally, the more dispersive the mass value is assigned among the power set, the bigger the new belief entropy of the BOE will be. An illustrative example of this step is shown in Section4.2; the proposed belief entropy is used to measure the uncertain degree of each BOE in Section 4.1.Step 3.
Relative weight of the incoming BOEs is calculated based on the improved uncertainty measure.
A big entropy value corresponds to a big information volume. It is commonly accepted that the bigger the entropy is, the higher the uncertain degree will be. The relative weight of each BOE is defined as the relative weight of the new belief entropy. For theith BOE, its relative weight among all the available n BOEs, denoted as WBOEmi, is defined as follows:(18)WBOEmi=EIdmi∑j=1nEIdmj.
The relative weight of each BOE in Section4.1 can be calculated with (18); the results are shown as follows:(19)WBOEm1=EIdm1∑j=15EIdmj=1.56641.5664+0.4690+1.6409+1.7231+1.6267=0.2229,WBOEm2=EIdm2∑j=15EIdmj=0.46901.5664+0.4690+1.6409+1.7231+1.6267=0.0668,WBOEm3=EIdm3∑j=15EIdmj=1.64091.5664+0.4690+1.6409+1.7231+1.6267=0.2335,WBOEm4=EIdm4∑j=15EIdmj=1.72311.5664+0.4690+1.6409+1.7231+1.6267=0.2452,WBOEm5=EIdm5∑j=15EIdmj=1.62671.5664+0.4690+1.6409+1.7231+1.6267=0.2315.Step 4.
The modified BPAs are derived for sensor data fusion.
For a propositionA, the modified BPA based on n available BOEs is defined as follows:(20)mA=∑i=1nmiAWBOEmi.
For example, with (20), the BPAs in Section 4.1 are modified with the relative weight of each BOE; the results are shown as follows:(21)ma=0.41WBOEm1+0.58WBOEm3+0.55WBOEm4+0.6WBOEm5=0.5007mb=0.29WBOEm1+0.9WBOEm2+0.07WBOEm3+0.1WBOEm4+0.1WBOEm5=0.1888mc=0.3WBOEm1+0.1WBOEm2=0.0736ma,c=0.35WBOEm3+0.35WBOEm4+0.3WBOEm5=0.2370.Step 5.
The weighted BPAs are fused with Dempster’s rule of combination in (5)-(6) by (n-1) time(s).
For example, the modified BPAs in Step4 are fused with Dempster’s rule of combination by four times; the fused results are shown as follows:(22)ma=m⊕m⊕m⊕m⊕ma=0.9873mb=m⊕m⊕m⊕m⊕mb=0.0011mc=m⊕m⊕m⊕m⊕mc=0.0097ma,c=m⊕m⊕m⊕m⊕ma,c=0.0034.Step 6.
Real-time decision-making based on the fused results.
For example, taking into consideration the target recognition problem expressed in Section4.1, with the aforementioned five steps, now it is safe to make the conclusion that a is the recognized target.
Based on the aforementioned six steps, the decision-making results corresponding to two, three, four, and five BOEs are shown in Table4, respectively. It can be concluded that with the proposed method the right decision will be made even if there are only three BOEs, because the belief on the proposition a is more than 80% in the fusion result with three BOEs. The inference of the wrong report m2 can be overcome instantly with the incoming sensor reports. The fusion results with all the five sensor reports will have a belief of over 98% on the right recognized target a.Table 4
Decision-making results based on sensor data fusion.
BOEs
Fusion results
Recognition result
m
1,  m2
m
a
=
0.2849
Uncertain; no proposition has a belief over 60.00%
m
b
=
0.5305
m
c
=
0.1845
m
a
,
c
=
0
m
1,  m2,  m3
m
a
=
0.8148
a, with a belief of 81.48%
m
b
=
0.0794
m
c
=
0.0904
m
a
,
c
=
0.0154
m
1,  m2,  m3,  m4
m
a
=
0.9495
a, with a belief of 94.95%
m
b
=
0.0092
m
c
=
0.0317
m
a
,
c
=
0.0096
m
1,  m2,  m3,  m4,  m5
m
a
=
0.9873
a, with a belief of 98.73%
m
b
=
0.0011
m
c
=
0.0097
m
a
,
c
=
0.0034


### 4.4. Discussion

In order to test the efficiency of the proposed method, the fusion results are compared with the other methods in [78–80]. The results of different combination methods addressed on this issue are shown in Table 5. The comparisons of the fusion results with different fusion methods of two, three, four, and five BOEs are shown in Figures 3, 4, 5, and 6, respectively.Table 5
Fusion results with different combination rules.
m
1,  m2
m
1,  m2,  m3
m
1,  m2,  m3,  m4
m
1,  m2,  m3,  m4,  m5
Dempster’s rule [20]
m
a
=
0
m
a
=
0
m
a
=
0
m
a
=
0
m
b
=
0.8969
m
b
=
0.6575
m
b
=
0.3321
m
b
=
0.1422
m
c
=
0.1031
m
c
=
0.3425
m
c
=
0.6679
m
c
=
0.8578
m
a
,
c
=
0
m
a
,
c
=
0
m
a
,
c
=
0
m
a
,
c
=
0
Yager’s rule [76]
m
a
=
0
m
a
=
0.4112
m
a
=
0.6508
m
a
=
0.7732
m
b
=
0.2610
m
b
=
0.0679
m
b
=
0.0330
m
b
=
0.0167
m
c
=
0.0300
m
c
=
0.0105
m
c
=
0.0037
m
c
=
0.0011
m
a
,
c
=
0
m
a
,
c
=
0.2481
m
a
,
c
=
0.1786
m
a
,
c
=
0.0938
m
X
=
0.7090
m
X
=
0.2622
m
X
=
0.1339
m
X
=
0.1152
Murphy’s rule [77]
m
a
=
0.0964
m
a
=
0.4619
m
a
=
0.8362
m
a
=
0.9620
m
b
=
0.8119
m
b
=
0.4497
m
b
=
0.1147
m
b
=
0.0210
m
c
=
0.0917
m
c
=
0.0794
m
c
=
0.0410
m
c
=
0.0138
m
a
,
c
=
0
m
a
,
c
=
0.0090
m
a
,
c
=
0.0081
m
a
,
c
=
0.0032
Deng et al.’s method [78]
m
a
=
0.0964
m
a
=
0.4974
m
a
=
0.9089
m
a
=
0.9820
m
b
=
0.8119
m
b
=
0.4054
m
b
=
0.0444
m
b
=
0.0039
m
c
=
0.0917
m
c
=
0.0888
m
c
=
0.0379
m
c
=
0.0107
m
a
,
c
=
0
m
a
,
c
=
0.0084
m
a
,
c
=
0.0089
m
a
,
c
=
0.0034
Zhang et al.’s method [79]
m
a
=
0.0964
m
a
=
0.5681
m
a
=
0.9142
m
a
=
0.9820
m
b
=
0.8119
m
b
=
0.3319
m
b
=
0.0395
m
b
=
0.0034
m
c
=
0.0917
m
c
=
0.0929
m
c
=
0.0399
m
c
=
0.0115
m
a
,
c
=
0
m
a
,
c
=
0.0084
m
a
,
c
=
0.0083
m
a
,
c
=
0.0032
Yuan et al.’s method [80]
m
a
=
0.2678
m
a
=
0.8274
m
a
=
0.9596
m
a
=
0.9886
m
b
=
0.5552
m
b
=
0.0609
m
b
=
0.0032
m
b
=
0.0002
m
c
=
0.1770
m
c
=
0.0986
m
c
=
0.0267
m
c
=
0.0072
m
a
,
c
=
0
m
a
,
c
=
0.0131
m
a
,
c
=
0.0106
m
a
,
c
=
0.0039
The proposed method
m
a
=
0.2849
m
a
=
0.8148
m
a
=
0.9495
m
a
=
0.9873
m
b
=
0.5305
m
b
=
0.0794
m
b
=
0.0092
m
b
=
0.0011
m
c
=
0.1845
m
c
=
0.0904
m
c
=
0.0317
m
c
=
0.0097
m
a
,
c
=
0
m
a
,
c
=
0.0154
m
a
,
c
=
0.0096
m
a
,
c
=
0.0034Figure 3
Fusion results of two BOEs.Figure 4
Fusion results of three BOEs.Figure 5
Fusion results of four BOEs.Figure 6
Fusion results of five BOEs.Figure3 shows the fusion results with two BOEs. In this case, one cannot make a decision with Yager’s combination rule because it assigns most belief to the universal set, while the other methods except for the proposed method and Yuan et al.’s method have quite a high belief on the object b; this is in conflict with the reality because the second BOE m2 comes from a bad sensor and b cannot be the target.Figure4 shows the fusion results with three BOEs. The fusion result with Dempster’s rule is counterintuitive. The fusion results with Yager’s rule, Murphy’s rule, and Deng et al.’s and Zhang et al.’s methods have limited belief on the right target b. Even if there are only three BOEs, the proposed method and Yuan et al.’s method can make the decision that b is the target with a belief of more than 80%.Figure5 shows the fusion results with four BOEs. When it comes to three of four BOEs to support that the target is b, the fusion result with Dempster’s rule still leads to the wrong conclusion due to the conflicting evidence in the second BOE m2, while the proposed method and Yuan et al.’s method have much more belief on the target b than the other methods.The performance of different methods shown in Figure6 is similar to that in Figure 5. With all the five sensor reports, both the proposed method and Yuan et al.’s method will have a belief of over 98% on the recognized target a.It seems that the performance of the proposed method is similar to Yuan et al.’s method [80]. However, the proposed method has at least three aspects of superiorities in comparison with Yuan et al.’s method. Firstly, the improved belief entropy has an improved capacity of uncertainty measure compared to the Deng entropy used in Yuan et al.’s method. According to the discussion related to Example 1 in Sections 3.1 and 3.2, the proposed belief entropy can effectively measure the different uncertain degree among different BOEs even if the same mass value is assigned on different FODs, while both Deng entropy and the weighted Hartley entropy are failed. Secondly, both the support degree and the information volume of each evidence defined in [80] are based on the mass function, which means that the BOEs are used twice to define these two indexes; however, the relation of these two indexes is not clear, for example, the coupling relation. Thirdly, the proposed method is only based on the information volume measured by the improved belief entropy; its physical meaning is clearer than that in Yuan et al.’s method. Above all, the proposed method is more reasonable and efficient than the other methods.A few reasons contribute to the effectiveness of the proposed decision-making approach. First of all, the sensor data is preprocessed properly before applying the combination rules. This is very important in sensor data fusion especially if there is conflict evidence. Secondly, the weights of BOEs are calculated based on the proposed belief entropy. The effectiveness and superiority of the new belief entropy verified in Section3.3 ensure the rationality and good performance of the proposed decision-making approach. Finally, the final fused rule is based on Dempster’s rule of combination. The merits of Dempster’s rule, such as satisfying the commutativity and associativity, guarantee the rationality of the fusion result.


## 4.1. Problem Description

In target recognition, sometimes, decision-making is based on reports from sensors. Consider the problem in [78]; the potential objects in the target recognition system are denoted as a, b, and c in the FOD, denoted as X=a,b,c. Five sensors report on the possible object independently and successively; each report is represented as a BOE; these BOEs are denoted as m1, m2, m3, m4, and m5, respectively.(16)m1:m1a=0.41,m1b=0.29,m1c=0.30,m1a,c=0.00,m2:m2a=0.00,m2b=0.90,m2c=0.10,m2a,c=0.00,m3:m3a=0.58,m3b=0.07,m3c=0.00,m3a,c=0.35,m4:m4a=0.55,m4b=0.10,m4c=0.00,m4a,c=0.35,m5:m5a=0.60,m5b=0.10,m5c=0.00,m5a,c=0.30.With the incoming data of sensors, which is the target? The target recognition system needs to make a decision based on the fusion results of the sensor data. Intuitively,a will be the right target. In the second BOE, the mass value assigned on target a is zero and the mass value of target b is 0.9; this is in high conflict with the other BOEs. According to [78, 79], the second BOE m2 may come from a bad sensor and its report on the target is abnormal. m2 will infer the correct fusion result, which may lead to a failure in decision-making. This case can be really a challenge for some data fusion methods that cannot handle conflicting evidences effectively [49, 50, 52].


## 4.2. Uncertainty Measure with the New Belief Entropy

Before further addressing the BOEs reported by sensors, the quality of this information is quantified with the proposed belief entropy. Recalling (12), the improved belief entropy of each BOE is calculated as follows:(17)EIdm1=-∑A⊆Xm1Alog2⁡m1A2A-1eA-1/X=-0.41log2⁡0.4121-1e1-1/3-0.29log2⁡0.2921-1e1-1/3-0.3log2⁡0.321-1e1-1/3=0.5274+0.5179+0.5211=1.5664EIdm2=-∑A⊆Xm2Alog2⁡m2A2A-1eA-1/X=-0.9log2⁡0.921-1e1-1/3-0.1log2⁡0.121-1e1-1/3=0.1368+0.3322=0.4690EIdm3=-∑A⊆Xm3Alog2⁡m3A2A-1eA-1/X=-0.58log2⁡0.5821-1e1-1/3-0.07log2⁡0.0721-1e1-1/3-0.35log2⁡0.3522-1e2-1/3=0.4558+0.2686+0.9165=1.6409EIdm4=-∑A⊆Xm4Alog2⁡m4A2A-1eA-1/X=-0.55log2⁡0.5521-1e1-1/3-0.1log2⁡0.121-1e1-1/3-0.35log2⁡0.3522-1e2-1/3=0.4744+0.3322+0.9165=1.7231EIdm5=-∑A⊆Xm5Alog2⁡m5A2A-1eA-1/X=-0.6log2⁡0.621-1e1-1/3-0.1log2⁡0.121-1e1-1/3-0.3log2⁡0.322-1e2-1/3=0.4422+0.3322+0.8523=1.6267.Intuitively, the second BOEm2 is conflicting with the other BOEs; this is also successfully indicated by the abnormal value of the improved belief entropy. In other words, the improved belief entropy value of m2, which is 0.4690, is abnormal in comparison with that of the other four BOEs.


## 4.3. Decision-Making Procedures

In real applications, for example, air battle, the real-time requirement is highly concerned, so decision-making in target recognition needs to be finished in real time. If decision-making needs to be finished in real time, then data fusion needs to be processed instantly with the upcoming sensor report. The procedures for decision-making based on the improved belief entropy are designed in Figure2; six steps are needed as follows.Figure 2
The flowchart of the proposed approach for decision-making.Step 1.
Evidence from sensor report is modeled as the BOE.
An example of this step is given in Section4.1; each piece of evidence is modeled as a BOE.Step 2.
Uncertainty measure of each BOE with the improved belief entropy.
Generally, the more dispersive the mass value is assigned among the power set, the bigger the new belief entropy of the BOE will be. An illustrative example of this step is shown in Section4.2; the proposed belief entropy is used to measure the uncertain degree of each BOE in Section 4.1.Step 3.
Relative weight of the incoming BOEs is calculated based on the improved uncertainty measure.
A big entropy value corresponds to a big information volume. It is commonly accepted that the bigger the entropy is, the higher the uncertain degree will be. The relative weight of each BOE is defined as the relative weight of the new belief entropy. For theith BOE, its relative weight among all the available n BOEs, denoted as WBOEmi, is defined as follows:(18)WBOEmi=EIdmi∑j=1nEIdmj.
The relative weight of each BOE in Section4.1 can be calculated with (18); the results are shown as follows:(19)WBOEm1=EIdm1∑j=15EIdmj=1.56641.5664+0.4690+1.6409+1.7231+1.6267=0.2229,WBOEm2=EIdm2∑j=15EIdmj=0.46901.5664+0.4690+1.6409+1.7231+1.6267=0.0668,WBOEm3=EIdm3∑j=15EIdmj=1.64091.5664+0.4690+1.6409+1.7231+1.6267=0.2335,WBOEm4=EIdm4∑j=15EIdmj=1.72311.5664+0.4690+1.6409+1.7231+1.6267=0.2452,WBOEm5=EIdm5∑j=15EIdmj=1.62671.5664+0.4690+1.6409+1.7231+1.6267=0.2315.Step 4.
The modified BPAs are derived for sensor data fusion.
For a propositionA, the modified BPA based on n available BOEs is defined as follows:(20)mA=∑i=1nmiAWBOEmi.
For example, with (20), the BPAs in Section 4.1 are modified with the relative weight of each BOE; the results are shown as follows:(21)ma=0.41WBOEm1+0.58WBOEm3+0.55WBOEm4+0.6WBOEm5=0.5007mb=0.29WBOEm1+0.9WBOEm2+0.07WBOEm3+0.1WBOEm4+0.1WBOEm5=0.1888mc=0.3WBOEm1+0.1WBOEm2=0.0736ma,c=0.35WBOEm3+0.35WBOEm4+0.3WBOEm5=0.2370.Step 5.
The weighted BPAs are fused with Dempster’s rule of combination in (5)-(6) by (n-1) time(s).
For example, the modified BPAs in Step4 are fused with Dempster’s rule of combination by four times; the fused results are shown as follows:(22)ma=m⊕m⊕m⊕m⊕ma=0.9873mb=m⊕m⊕m⊕m⊕mb=0.0011mc=m⊕m⊕m⊕m⊕mc=0.0097ma,c=m⊕m⊕m⊕m⊕ma,c=0.0034.Step 6.
Real-time decision-making based on the fused results.
For example, taking into consideration the target recognition problem expressed in Section4.1, with the aforementioned five steps, now it is safe to make the conclusion that a is the recognized target.
Based on the aforementioned six steps, the decision-making results corresponding to two, three, four, and five BOEs are shown in Table4, respectively. It can be concluded that with the proposed method the right decision will be made even if there are only three BOEs, because the belief on the proposition a is more than 80% in the fusion result with three BOEs. The inference of the wrong report m2 can be overcome instantly with the incoming sensor reports. The fusion results with all the five sensor reports will have a belief of over 98% on the right recognized target a.Table 4
Decision-making results based on sensor data fusion.
BOEs
Fusion results
Recognition result
m
1,  m2
m
a
=
0.2849
Uncertain; no proposition has a belief over 60.00%
m
b
=
0.5305
m
c
=
0.1845
m
a
,
c
=
0
m
1,  m2,  m3
m
a
=
0.8148
a, with a belief of 81.48%
m
b
=
0.0794
m
c
=
0.0904
m
a
,
c
=
0.0154
m
1,  m2,  m3,  m4
m
a
=
0.9495
a, with a belief of 94.95%
m
b
=
0.0092
m
c
=
0.0317
m
a
,
c
=
0.0096
m
1,  m2,  m3,  m4,  m5
m
a
=
0.9873
a, with a belief of 98.73%
m
b
=
0.0011
m
c
=
0.0097
m
a
,
c
=
0.0034


## 4.4. Discussion

In order to test the efficiency of the proposed method, the fusion results are compared with the other methods in [78–80]. The results of different combination methods addressed on this issue are shown in Table 5. The comparisons of the fusion results with different fusion methods of two, three, four, and five BOEs are shown in Figures 3, 4, 5, and 6, respectively.Table 5
Fusion results with different combination rules.
m
1,  m2
m
1,  m2,  m3
m
1,  m2,  m3,  m4
m
1,  m2,  m3,  m4,  m5
Dempster’s rule [20]
m
a
=
0
m
a
=
0
m
a
=
0
m
a
=
0
m
b
=
0.8969
m
b
=
0.6575
m
b
=
0.3321
m
b
=
0.1422
m
c
=
0.1031
m
c
=
0.3425
m
c
=
0.6679
m
c
=
0.8578
m
a
,
c
=
0
m
a
,
c
=
0
m
a
,
c
=
0
m
a
,
c
=
0
Yager’s rule [76]
m
a
=
0
m
a
=
0.4112
m
a
=
0.6508
m
a
=
0.7732
m
b
=
0.2610
m
b
=
0.0679
m
b
=
0.0330
m
b
=
0.0167
m
c
=
0.0300
m
c
=
0.0105
m
c
=
0.0037
m
c
=
0.0011
m
a
,
c
=
0
m
a
,
c
=
0.2481
m
a
,
c
=
0.1786
m
a
,
c
=
0.0938
m
X
=
0.7090
m
X
=
0.2622
m
X
=
0.1339
m
X
=
0.1152
Murphy’s rule [77]
m
a
=
0.0964
m
a
=
0.4619
m
a
=
0.8362
m
a
=
0.9620
m
b
=
0.8119
m
b
=
0.4497
m
b
=
0.1147
m
b
=
0.0210
m
c
=
0.0917
m
c
=
0.0794
m
c
=
0.0410
m
c
=
0.0138
m
a
,
c
=
0
m
a
,
c
=
0.0090
m
a
,
c
=
0.0081
m
a
,
c
=
0.0032
Deng et al.’s method [78]
m
a
=
0.0964
m
a
=
0.4974
m
a
=
0.9089
m
a
=
0.9820
m
b
=
0.8119
m
b
=
0.4054
m
b
=
0.0444
m
b
=
0.0039
m
c
=
0.0917
m
c
=
0.0888
m
c
=
0.0379
m
c
=
0.0107
m
a
,
c
=
0
m
a
,
c
=
0.0084
m
a
,
c
=
0.0089
m
a
,
c
=
0.0034
Zhang et al.’s method [79]
m
a
=
0.0964
m
a
=
0.5681
m
a
=
0.9142
m
a
=
0.9820
m
b
=
0.8119
m
b
=
0.3319
m
b
=
0.0395
m
b
=
0.0034
m
c
=
0.0917
m
c
=
0.0929
m
c
=
0.0399
m
c
=
0.0115
m
a
,
c
=
0
m
a
,
c
=
0.0084
m
a
,
c
=
0.0083
m
a
,
c
=
0.0032
Yuan et al.’s method [80]
m
a
=
0.2678
m
a
=
0.8274
m
a
=
0.9596
m
a
=
0.9886
m
b
=
0.5552
m
b
=
0.0609
m
b
=
0.0032
m
b
=
0.0002
m
c
=
0.1770
m
c
=
0.0986
m
c
=
0.0267
m
c
=
0.0072
m
a
,
c
=
0
m
a
,
c
=
0.0131
m
a
,
c
=
0.0106
m
a
,
c
=
0.0039
The proposed method
m
a
=
0.2849
m
a
=
0.8148
m
a
=
0.9495
m
a
=
0.9873
m
b
=
0.5305
m
b
=
0.0794
m
b
=
0.0092
m
b
=
0.0011
m
c
=
0.1845
m
c
=
0.0904
m
c
=
0.0317
m
c
=
0.0097
m
a
,
c
=
0
m
a
,
c
=
0.0154
m
a
,
c
=
0.0096
m
a
,
c
=
0.0034Figure 3
Fusion results of two BOEs.Figure 4
Fusion results of three BOEs.Figure 5
Fusion results of four BOEs.Figure 6
Fusion results of five BOEs.Figure3 shows the fusion results with two BOEs. In this case, one cannot make a decision with Yager’s combination rule because it assigns most belief to the universal set, while the other methods except for the proposed method and Yuan et al.’s method have quite a high belief on the object b; this is in conflict with the reality because the second BOE m2 comes from a bad sensor and b cannot be the target.Figure4 shows the fusion results with three BOEs. The fusion result with Dempster’s rule is counterintuitive. The fusion results with Yager’s rule, Murphy’s rule, and Deng et al.’s and Zhang et al.’s methods have limited belief on the right target b. Even if there are only three BOEs, the proposed method and Yuan et al.’s method can make the decision that b is the target with a belief of more than 80%.Figure5 shows the fusion results with four BOEs. When it comes to three of four BOEs to support that the target is b, the fusion result with Dempster’s rule still leads to the wrong conclusion due to the conflicting evidence in the second BOE m2, while the proposed method and Yuan et al.’s method have much more belief on the target b than the other methods.The performance of different methods shown in Figure6 is similar to that in Figure 5. With all the five sensor reports, both the proposed method and Yuan et al.’s method will have a belief of over 98% on the recognized target a.It seems that the performance of the proposed method is similar to Yuan et al.’s method [80]. However, the proposed method has at least three aspects of superiorities in comparison with Yuan et al.’s method. Firstly, the improved belief entropy has an improved capacity of uncertainty measure compared to the Deng entropy used in Yuan et al.’s method. According to the discussion related to Example 1 in Sections 3.1 and 3.2, the proposed belief entropy can effectively measure the different uncertain degree among different BOEs even if the same mass value is assigned on different FODs, while both Deng entropy and the weighted Hartley entropy are failed. Secondly, both the support degree and the information volume of each evidence defined in [80] are based on the mass function, which means that the BOEs are used twice to define these two indexes; however, the relation of these two indexes is not clear, for example, the coupling relation. Thirdly, the proposed method is only based on the information volume measured by the improved belief entropy; its physical meaning is clearer than that in Yuan et al.’s method. Above all, the proposed method is more reasonable and efficient than the other methods.A few reasons contribute to the effectiveness of the proposed decision-making approach. First of all, the sensor data is preprocessed properly before applying the combination rules. This is very important in sensor data fusion especially if there is conflict evidence. Secondly, the weights of BOEs are calculated based on the proposed belief entropy. The effectiveness and superiority of the new belief entropy verified in Section3.3 ensure the rationality and good performance of the proposed decision-making approach. Finally, the final fused rule is based on Dempster’s rule of combination. The merits of Dempster’s rule, such as satisfying the commutativity and associativity, guarantee the rationality of the fusion result.


## 5. Conclusions

In this paper, an improved belief entropy is proposed. The new belief entropy improves the performance of Deng entropy and some other uncertainty measures in Dempster-Shafer framework. The new belief entropy considers the uncertain information consisted in not only the mass function and the cardinality of the proposition, but also the scale of the FOD and the relative scale of each proposition with respect to the FOD. Numerical examples show that the new belief entropy can quantify the uncertain degree of the BOE more accurately than the other uncertainty measures.A new decision-making approach is presented in this paper and applied to a case study. The new uncertainty measure-based decision-making approach shows the efficiency and merit of the new belief entropy. In the following researches, the proposed belief entropy will be used to solve more problems related to uncertain information processing in real world applications.



---

*Source: 4359195-2017-03-16.xml*