Evidence-Aware Entropy Decomposition For  Active Deep Learning
Authors: Weishi Shi
Xujiang Zhao
Feng Chen
Qi Yu
Venue:  (2020)
Keywords: active learning
entropy decomposition
uncertainty

Abstract: We present a novel multi-source uncertainty prediction approach that enables deep learning (DL) models to be actively trained with much less labeled data. By leveraging the second-order uncertainty representation provided by subjective logic (SL), we conduct evidence-based theoretical analysis and formally decompose the predicted entropy over multiple classes into two distinct sources of uncertainty: vacuity and dissonance, caused by lack of evidence and conflict of strong evidence, respectively. The evidence based entropy decomposition provides deeper insights on the nature of uncertainty, which can help effectively explore a large and high-dimensional unlabeled data space. We develop a novel loss function that augments DL based evidence prediction with uncertainty anchor sample identification through kernel density estimation (KDE). The accurately estimated multiple sources of uncertainty are systematically integrated and dynamically balanced using a data sampling function for label-efficient active deep learning (ADL). Experiments conducted over both synthetic and real data and comparison with competitive AL methods demonstrate the effectiveness of the proposed ADL model.   

Under review as a conference paper at ICLR 2020
EVIDENCE-AWARE ENTROPY DECOMPOSITION FOR ACTIVE DEEP LEARNING
Anonymous authors Paper under double-blind review
ABSTRACT
We present a novel multi-source uncertainty prediction approach that enables deep learning (DL) models to be actively trained with much less labeled data. By lever- aging the second-orde (SL), we conduct evidence-based theoretical analysis and formally decompose the predicted entropy over multiple classes into two distinct sources of uncertainty: vacuity and dissonance, caused by lack of evidence and conflict of strong evi- dence, respectively. The evidence based entropy decomposition provides deeper insights on the nature of uncertainty, which can help effectively explore a large and nigh-dimensional unlabeled data space. We develop novel loss function that augments DL based evidence prediction with uncertainty anchor sample identifi- cation through kernel density estimation (KDE). The accurately estimated multi- ple sources of uncertainty are systematically integrated and dynamically balanced using data sampling function for label-efficient active deep learning (ADL). Ex- periments conducted over both synthetic and real data and comparison with com- petitive AL methods demonstrate the effectiveness of the proposed ADL model.
uncertainty representation provided by subjective logic
INTRODUCTION
Deep learning (DL) models establish dominating status among other types of supervised learning models by achieving the state-of-the-art performance in various application domains. However, such an advantage only emerges when a huge amount of labeled training data is available. This limitation slows down the pace of DL. especially when being applied to knowledge-rich domains, such as medicine, biology, and military operations, where large-scale labeled samples are too expensive to obtain from well-trained experts. Meanwhile, active learning (AL.) has demonstrated great success by showing that for many supervised models, training samples are not equally important in terms of improving the model performance (Settles) 2009p. As a result, a carefully selected smaller training set can achieve model equally well or even better than randomly selected large training set.
An interesting question arises, which is whether DL models can be actively trained using much less labeled data. Recent efforts show promising results in this direction through Bayesian modeling GGal ct al., 2017) and batch model sampling (Sener & Savarese 2018). However, as DL models are commonly applied to high dimensional data such images and videos, fundamental challenge still remains, which is how to most effectively explore the exponentially growing sample space to select the most useful data samples for active model training. Existing AL models usually leverage the model provided information, such as estimated decision boundaries or predicted entropy for data sampling. However, the deep structure and the large number of parameters of DL models make model overfitting almost inevitable especially in the early stage of AL when only very limited training data is available. As a result, the model may provide misleading information that makes data sampling from a high-dimensional search space even more difficult. Besides high dimensionality, complex data may contain a large number of classes and data samples from certain classes may be completely missing. Such situations are quite common for domains, such scientific discovery (e.g., gene function prediction) and anomaly detection. AL models should be able to effectively discover these out of distribution (OOD) samples for labeling in order to achieve overall good prediction performance.
Uncertainty sampling has been one of the most commonly used bool-based AL models. In particular, a model chooses the data sample that it is least certain about. Thus, once the sample is labeled, model uncertainty can be significantly reduced. As information-theoreet measure, entropy provides

---

Under review as a conference paper at ICLR 2020
(r
14
11
(a)
(d)
Figure 1: A dataset consists of three mixtures of Gaussian's (shown in red, blue, and yellow, respectively), each of which has a large and small clusters of data samples. (a) Softmax predicted entropy; (b) ADL predicted entropy; (c) ADL predicted vacuity; (d) ADL predicted dissonance.
general criterion for uncertainty sampling. Some commonly used sampling methods, including least confident and margin based strategies, are equivalent entropy- based sampling in binary classifi- cation (Settles 2009). It is also natural and straightforward to generalize to multi-class problems.
A key challenge of entropy-based sampling for AL is that the predicted entropy may be highly inac- curate, especially in the early state of the AL. Such an issue may become more severe when training neural network (NNyDL active learner due model overfitting described above. Figure Ta) shows the predicted entropy by an NN active learner trained using nine labeled data samples, which in black color and evenly distributed in three classes. The standard softmax layer is used in the output layer to generate class probabilities over three classes, each of which is a mixture of two Gaussian's s. It turns out that all the data samples in the three small clusters located in the top left, top right, and bottom center, are wrongly predicted with high confidence, as indicated by the low entropy. As a result, data samples from these three clusters are less likely to be selected for labeling- In contrast, the data samples that are close to the center of the three major clusters are more likely to be selected. However, labeling these samples will have the effect of fine-tuning wrongly predicted decision boundary, leading to a much higher (but less effective) labeling cost.
Figure Tb) shows the the result from the proposed active deep learning (ADL) model. While the samples from the small clusters are still wrongly predicted due to lack of training data, they are pre- dicted with a much lower low confidence as indicated by the high entropy. However, even with more accurately predicted entropy, the active learner may still sample from the center of the three major clusters as it is still assigned a high entropy along with the areas that cover the three smaller clusters. By performing a fine-graines grained analysis of uncertainty under the subjective logic (SL) framework (Jøsang, 2016), we formally decompose entropy into two distinct sources of uncer- tainty: vacuity and dissonance, which respectively. By putting the vacuity and dissonance as shown in Figures [[c) and (d) together, it is interesting to see that we recover the entropy as shown in Figure [c), which empirically verifies our theoretical results. Entropy decomposition provides further insights on the sources on uncertainty, which is instrumental guide the data sampling process. Intuitively, given the dataset Figure [ an effective sampling strategy will first choose samples from the three small clusters according to vacuity in the early stage of AL to properly establish the shape of the decision boundary. It can then fine-tune the decision boundary by sampling according to dissonance. Such uncertainty-awar sampling strategy will be critical for a nigh-dimensional space with multiple competing classes where data samples are scarcely distributed and the decision boundary becomes more complicated.
caused by lack of evidence and conflict of strong evidence,
Our major contribution is threefold: (I) decomposition of entropy through evidence-based theoret- ical analysis of belief vacuity and belief dissonance under the SL framework; (2) multi-source uncertainty prediction model that accurately quantifies different sources of uncertainty through ker- nel density regularized evidence prediction; (3) an active deep learning model that systematically integrates different types of uncertainty for effective data sampling in a high-dimensional space. Extensive experiments are conducted over both synthetic and real-world data to demonstrate the effectiveness of the proposed ADL model.
2 RELATED WORK
In the belief/evidence theory domain, un- certainty reasoning has been substantially explored such as Fuzzy Logic (De Silva 2018), Dempster- Shafer Theory (DST) (Sentz et al. 2002), or Subjective Logic (SL) (Josang 2016). Unlike the efforts made in MI.DI above, belief theorists focused on reasoning of inherent uncertainty in information
Uncertainty Quantification Belief/Evidence Theory:
2

---

Under review as a conference paper at ICLR 2020
resulting from unreliable, incomplete, deceptive, and/or conflicting evidence. SL considered uncer- tainty in subjective opinions in terms of vacuity (i.e., lack of evidence) and vagueness (i.e., failure of discriminating belief state) (Josang] 2016). Vacuity has been used an effective vehicle to detect out-of-distributton queries through evidence learning, achieved under the typical DI. setting with ample training samples (Sensoy et al., 2018). Recently, other dimensions of uncertainty have been studied, such as dissonance (due to conflicting evidence) and consonance (due to evidence about composite subsets of state values) (Jøsang al. 2018
Epistemic Uncertainty in Deep Learning: In DL, aleatoric uncertainty (AU) and epistemic uncer- tainty (EU) have been studies using Bayesian Neural Networks (BNNs) for computer vision. AU consists of bomoscedastic uncertainty (i.e.. constant errors for different inputs) and heteroscedastic uncertainty (i.e., different errors for different inputs) (Gal 2016). A Bayesian DI. (BDL. framework was presented to estimate both AU and DU simultaneously in regression (e.g., depth regression) and classification settings (e.g.. semantic segmentation) (Kendall & Gal 2017 new type of uncer- tainty, called distributional uncertainty, is defined based on distributional mismatch between the test and training data distributions (Malinin & Gales 2018
Active Learning in Deep Learning: The common AL methods other than DL-based ones are surveyed in (Settles] 2009). There are limited efforts on actively training DL models for high- dimensional data with a few exceptions. In (Wang & Shang 2014). an AL model was developed for DL using three metrics for data sampling: least confidence, margin sampling, and entropy. A new approach combines recent advances in BDL into the AL framework to achieve label-efficient DL training (Gal et al. 2017). Another approach advances the AL development by introducing cost-effective strategy to automatically select and annotate the high-confidence samples, which improves the traditional samples selection strategies (Wang et al.) (016)). Data sampling in DL has also been approached as a core-set selection problem (Sener & Savarese 2018), which requires a large batch to work well. Different from all existing works, the proposed ADL model decomposes the accurately estimated uncertainty into vacuity and dissonance and dynamically balances multi- source uncertainty to achieve active training of DI. models with much less labeled data.
3 EVIDENCE-AWAR ENTROPY DECOMPOSITION
As discussed earlier, a high entropy may be contributed by difference sources of uncertainty with distinct characteristics. In this section, we conduct a fine-grained theoretical analysis of different types of uncertainty that arise in the context of multi-class problems. The decomposition is con- ducted under the SI. framework, which provides key building blocks for our theoretical analysis.
3.1 THEORY OF SUBJECTIVE LOGIC
SL is an uncertain probabilistic logic that is built upon probabilistic logic (PL) Nilsson 1986) and belief theory (BT) (Shafer 1976) while making two unique extensions. First, SL explicitly represents uncertainty by introducing vacuity of evidence (or uncertainty mass) in its opinion repre- sentation, which addresses the limitation of using PL to model lack of confidence in probabilities. Second, SI. extends the traditional belief function of the BT by incorporating base rates, which serve as the prior probability in Bayesian theory. The Bayesian nature of SL allows use second-order uncertainty to express and reason the uncertainty mass, where second-order uncertainty is repre- sented in terms of a probability density function (PDF) over first-order probabilities (Jøsang 2016). In particular, for multi-class problems, we use multinomial distribution (first-order uncertainty) to model class probabilities and use a Dirichlet PDF (second-order uncertainty) to model the dis- tribution of class probabilities. Second-order uncertainty enriches uncertainty representation with evidence information, which plays central role entropy decomposition as detailed later.
Subjective opinions (or opinions) are the arguments in SL. In the multi-class setting, the subjective opinion of a multinomial random variable y in domain = {I....,K] is given by a triplet
K by + +
w = (b, u, a), with
(1)
k=1
where (bI,..., bk)"" u. and a (a). RK) denote the belief mass distribution over Y. uncertainty mass representing vacuity of evidence, and base rate distribution over Y, respectively, and Vk. a 2 0, by 2 0, 2u2 O. The probability that y is assigned to the k-class is given by
P(y k) by aku, Wk: Y
(2)
3

---

Under review as a conference paper at ICLR 2020
which combines the belief mass with the uncertain mass using the base rates. In the multi-class setting, ag can be regarded as the prior preference over the l--th class. When no specific preference is given, we assign all the base rates as 1/K.
In existing SL literature, there lacks a clear transition between the first order uncertainty given in equation[[and the second-order uncertainty expressed as Dirichlet PDF. Here, we make this transi- tion more explicit by introducing a set of random variables = (Pi,-... ....,x)), where p is distributed on simplex of dimensionality K We introduce conditional distribution P(y klpp) = Pk which allows us to represent the marginal distribution in equation by P(y) P(y)p))(p)dp-
We define p(p) as Dirichlet PDF over p. Dir(p) where a = (ai..... agk )" is K-ddienniionll strength vector, with ag 0 denoting the effective number of observations of the k-th class. SL explicitly introduces the uncertainty evidence through a non-informative weight W and redefine the strength parameter as
Og 7% + ag W with r% 2 O, Y
(3)
where r4 is the amount of evidence (or the number of observations) to support the k-thh class and W is usually set to K, i.e., the number of classes. Given the new definition of the strength parameter, the expectation of the class probabilities p (PI, px) is given by
Blpa]
ak
Tk + a W
Σj=1 Ojj
Σ b
where Og = 1/K. By marginalizing out p. we can derive an evidence-based expression of belief mass and uncertainty mass:
by = Ph S
W S
K
VhE Y.
u
with S
=
(5)
SL. categorizes uncertainty into two primary sources (Josang 2016): (1) basic belief uncertainty that results from specific aspects belief mass in isolation and (2) intra-belief uncertainty that results from the relationships between belief masses and uncertainty mass. Since we focus on the multi- class setting, no composite values (i.c., simultaneously assigned to multiple classes) are allowed. As result, these two sources of uncertainty boil down to vacuity and dissonance, respectively, that correspond to vacuous belief and contradicting beliefs. In particular, vacuity of an opinion vac(w) is captured by uncertainty mass u, which is defined in equation and dissonance of an opinion (Jøsang let al. 2018 is defined as
K by Ejth B,Bal(b,, bu), ), Bal(b;, bx) (1
|63 -bel bye
if b,b, + 0 if min(b, b,) =0
diss(w)
(6)
Ejfeb
where Bal(by, by) is the relative mass balance function between two belief masses. The belief disso- nance of an opinion is measured based on how much belief supports individual classes. Consider binary classification example with binomial opinion given by (b,, b2, u. a) (0.49, 0.49, 0.02, a.) Based on equation 6 it has dissonance value of 0.98. In this case, although the vacuity is close to zero, a high dissonance indicates that one cannot make a clear decision because both two classes have the same amount of supporting evidence and hence strongly conflict with each other.
3.2 SUDENNCE-BASEI ENTROPY DECOMPOSITION
By leveraging the second-order uncertainty representation, we formally show that the entropy of a predicted class distribution P(y) can be decomposed into vacuity and dissonance. Our major theoretical results indicate that the uncertainty of high-entropy data sample may be caused by either lack of evidence (i.e., high vacuity) or conflict of strong evidence (i.e., high dissonance) but not both. By clearly identifying the sources of uncertainty instead of using them in combined form as in entropy, the evidence based decomposition of entropy provides deeper insights on the nature of uncertainty, which provides important guidance for an AL model to more effectively explore large and high-dimensional search space for efficient data sampling.
Lemma 1. Dissonance maximization. Given a total Dirichlet strength S C.K where C 2 and K is the number of classes, for any opinion w on multinomial random variable y. we have
max diss(w) = C
(7)
4

---

Under review as a conference paper at ICLR 2020
Corollary 1. The dissonance diss(w) is approaching (but not reaching) I when all the evidence Th 's are set to equal and S + oo; it reaches 0 when S = K:
lims- diss(w) = diss(w)= 0
1 if ri = ...T.... TK
(8)
if S = K
Lemma 2. Vacuity maximization. For any opinion w on a multinomial random variable we have 0 S vac(w) S 1 and the maximum vacuity is achieved when Σ Th 0.
Theorem 1. Let y denote a multinomial random variable, wy denote its opinion, S denote its to- tal Dirichlet strength, and Hyy be the entropy of y. H[y] can be maximized under two differ- ent and non-overlapping conditions: (1) for S K and assuming non-informative base rates, y" arg max [y) <>> y = arg max vuc(usy); (2) for S - -0,y" arg max Hy] <> y" arg max (iss(
A more intuitive interpretation of the main results in Theorem I is as following. A high-entropy data sample supported by a strong evidence (i.e., S > K) is caused by a high dissonance (i.e., conflict of evidence); high-entropy data sample supported by little evidence (i.e., S = K) is caused by a high vacuity (i.e., lack of evidence). Through the second-order uncertainty representation, we offer an evidence based interpretation of entropy that allows us to identify two different sources of uncertainty that both cause a high entropy. The multi-source uncertainty will provide important information design a fine-grained sampling function for AL, which will be detailed in next section.
4 MULTI-SOURCE UNCERTAINTY AWARE ACTIVE DEEP LEARNING
In order to best use the uncertainty information, the ADL model should first be able to provide an accurate uncertainty estimation based on very limited training data. This, coupled with the large number of parameters of the DL model, poses fundamental challenge due a higher risk of model overfitting, As shown earlier, inaccurate uncertainty estimation will cause the model to miss labeling important data samples that can help accurately detect the decision boundary if labeled.
In addition, since both vacuity and dissonance are derived from second-order uncertainty, solely predicting the class label or its distribution does not provide sufficient information for molti-source uncertainty prediction. Instead of predicting the class label distribution, the proposed ADL model directly estimates the supporting evidence (i.e., F3 's) for each class, which central element that can be used to quantify belief mass and uncertainty mass according to equation 5 To better ad- dress overfitting, we develop a novel loss function that augments DL based evidence prediction with uncertainty anchor sample identification through kernel density estimation (KDE). These anchor samples are unlabeled data that inform the ADL which areas of the data space are less explored. Optimizing this loss function will ensure that ADL predicts high vacuity over these areas. Further- more, through KDE, these less explored areas are automatically ranked based on their data density. This nice property allows the ADL to effectively prioritize the sampling order over these areas and iterative visit them based on their data density. Finally, we introduce our novel sampling function that systematically integrates accurately estimated multi-source uncertainty for active deep learning.
4.1 UNCERTAINTY ANCHOR SAMPLE IDENTIFICATION
Let X and X, denote the sets of unlabeled candidate and training samples, respectively. The prob- ability density of the two populations with a kernel function k(.,) can be estimated as follows:
Pa (x
k(o,
Pc(x)=
k(2, EX
X
Since aim to identify unlabeled anchor samples to inform the model areas in the space that are less explored by the training data, these samples should be from areas having a high density mass with respect to (xx) but low density mass with respect pxr).. The problem is formalized as:
max X Pp(( - -E<(w>) AC%.
(10)
PEA
DEA
The first term ensures that the selected area has abundant candidate data points to sample so that it has lower risk of containing isolated noise. The second term makes sure the selected region located OOD with respect to the current training data. The optimal set for equation i0 given by:
A = {a()pu(x)) - pr (xx) > 0}
(11)
where À E [0, 1] is used to control the size of A for given the candidate and training datasets.
5

---

Under review as a conference paper at ICLR 2020
4.2 MULTI-SOURCE UNCERTAINTY PREDICTION
The set of uncertainty anchor samples A' represents areas in the data space that are cohesively distributed far away from the current training data. As these data are essentially OOD with respect to the current training data, their predicted vacuity should be high, which implies low predicted We leverage this information by constructing an evidence strength loss,
evidence due to Lemma 2
E which forces the model to predict low evidence for Iu E A.:
Eui (A",)) +) = 11 (x.
[(x; |
(12)
where 1 (c) 1 if C' is true and O otherwise; senting the predicted supporting evidence of æu. and θ is the set of DL model parameters. Since we require r'k 2 0, an activation layer (i.e., ReLu) is used to replace the softmax layer commonly used in other NN classifiers. The evidence strength loss is the key component to our proposed over- all loss function. Samples in A act as anchors to provide the model preview of certain areas that out of its current knowledge. The model is guided to put less belief mass on those areas, leading to more accurate uncertainty estimation and eventually benefit the multi-source uncertainty based data sampling. Furthermore, since the activation layer is used for model output, equation [2 essentially performs 1 regularization to last hidden layer's weight matrix and bias vector. We want to empha- size that our approach demands no additional labeling cost. The anchor samples are dynamically detected according to the current training and put into use without their actual label being known.
f( ()) is the output of the DL model, repre-
We proceed to define our overall loss function. For training sample æ; let yr encode the ground-true class label & by setting Vik = 1 and Bty = 0, Vj * k. Let Cat(y; k (e)) be the likelihoood, where (O) Dir(P: (e))) and a ( = [(ar, ()) + Wa;, We set the non-informative weight W = K and base rates dzk = 1/ K, vk. The expected sum of squares loss is defined as
K
(0) = Dip ly: - -P21 = > (1 - 2y, (0) + Elp,, (0)?)) (13)
Minimizing C( has the effect of jointly minimizing the prediction error and the variance of p. (Sensoy et al. 2018), hence reducing the uncertainty. This can be seen using identity Elp,, (0) Elp, [² (ar(p,,())) and rearranging the terms on the r.h.s. of equation 13
Our overall loss function is defined as:
(O)
Σ
(a) Bes cen (+)
(14)
2.
where C2(O) is the standard L2 regularizer of the network parameters.
4.3 DATA SAMPLING FOR ACTIVE DEEP LEARNING
According to Lemma 2. data sample's vacuity is maximized when the model assigns zero evidence to all K classes. This indicates the model has never seen a similar data sample from training. Annotating samples with a large vacuity can help the ADL gain most new knowledge of the data space. It has the effect of guiding the model to explore the most important areas, which is especially critical for tigh-diimnnional data space. In AL, the true decision boundary can be easily skewed due to limited initial training. The vacuity-aware search helps the model fast converge to the true decision boundary without excessively sampling around the wrong one. Moreover, it is also effective to discover new types of classes whose instances have never exposed to the model, as shown in our experiments. According to Lemma [ data sample's ' dissonance maximized when the model assigns equally high (close to infinity) evidence to all K classes. These strong conflicting evidence received from different classes indicate the data sample is located near the decision boundary where multiple classes are heavily overlapped. Annotating samples with high dissonance helps the model further fine-tune the decision boundary, leading to better discriminative power.
We design sample function that best leverages these two important and complementary sources of uncertainty to most effectively guide ADL. Intuitively, we would like ADL to rely more on vacuity in the early phase of AL, which most effectively shape the decision boundary and avoid fine- tuning the wrong decision areas. As AL goes, dissonance should gradually gain a higher weight, which allows ADL to further fine-tune the decision boundary that has the right shape but is less accurate, aiming to maximize the discriminate power of the model. The sample function is given:
at arg max (diss( (a)()) + (x))(
(15)

---

Under review as a conference paper at ICLR 2020
Vic Po
12
Figure Uncertainty prediction result from EDL and AL performance comparison;
VarulyyAAL 6ih berst en)
Dhuonance/AAn 5ch liereiio)
Vacu ihhieaatte onl
Disooenne/AAL 15th keration)
11
44
57
22
13
(b)
(c)
(d)
Figure 3: (a) Vacuity and (b) Dissonance of iteration 6 when ADL first discovers all hidden OOD
areas; (c) Vacuity of iteration 13 when ADL starts penalizing vacuity in the sampling function; (d)
Dissonance after two iterations of penalizing vacuity.
where is an annealing coefficient gradually balance between vacuity and dissonance based on the rationale given above. More specifically, the importance of vacuity reduces there are less "vacuoos" areas the data space w.r.t. the current training data. This implies that the training data can well approximate the entire data space. Thus, one natural way to quantify 3 is to use the inverse of mutual information K LPPu,<11p4 (|pr), where the joint density distribution Pa,r can be estimated as (x)) X. +|x.] Ex,ex.,xx, k( s.)). In practice, calculating the mutual information for each AL iteration is expensive. We use heuristic surrogate: min max=min,,, EX, max,,eX, k(x,, æu) and set 3 df min max does not change within the past few AL iterations, where T denotes the current iteration of AI. and d is fixed decay rate (set to 1/100K K in our experiments).
EXPERIMENTS
In this section, report experimental results both synthetic and real-world data. The syn- thetic experiment aims to verify the key theoretical properties of ADL, including entropy decom- position and multi-source uncertainty prediction, and how these properties contribute to AL. The real-data experiment aims to compare ADL and its competitors. We focus on testing in classical AL environment, where the initial training set only includes limited samples from some classes with samples from other classes completely missing. In each AL iteration. we sample one or small batch of data instances. This is fundamentally different than some recent DL based AL methods, such as (Sener & Savarese (018). which perform batch-mode sampling with a large batch size (larger than our entire labeled samples). All models uses the same DL architecture, For synthetic data, we adopt a 3-layer MLP with tanh for activation. For real data, use LeNet with Relu for activation.
5.1 SYNTHETIC DATA
The synthetic experiment is designed to show: (1) whether ADL accurately captures different sources of uncertainty, and (2) whether accurately estimated uncertainty leads better AL behavior. To mimic the existence of OOD, we generate three mixtures of Gaussian's. Each mixture consists of major and a smaller (i.e., OOD) clusters with 750 and 50 samples, respectively. We center the major Gaussian components from each class in the middle the feature space and put their corre- sponding OOD components away from them. In Figure I we show that classical DL model with softmax layer provides very inaccurate uncertainty estimation. In contrast, the proposed ADL model not only provides accurate entropy prediction but also successfully decomposes into vacuity and dissonance. Figure [ shows the uncertain prediction result from EDL (Sentz et al.) (002), which can also provide evidence prediction but requires ample training data. Suffering from insufficient training. EDL is inaccurate in its entropy prediction, especially for the OOD clusters. While EDL does not provide entropy decomposition, we use its predicted evidence to compute vacuity and dis- sonance as shown in Figure 2] However, neither of them is accurately predicted as low vacuity is predicted for the three OOD clusters where there is no training data and high dissonance predicted in areas with nearby training data show conflicting evidence.
7

---

Under review as a conference paper at ICLR 2020
stat damee
dtrt wtt dtere
WM.TT that wth deetee
WMIST statt Cannee
-:
181
AEL
Figure 4: AL performance on MNIST (start with 5-8 classes)
AL ALbartter
T0
Derattrs
102
200
2000
225
280
Figure 5: AL. perforaaeee on notMNIST and CIFAR- 10 (start with 5 and 6 classes; 7,8 in Appendix)
Figure 3l shows the first time when ADL selects at least one data sample from each OOD area, high vacuity is assigned to an area with no training data but many unlabeled data. Meanwhile, high dissonance indicates that refining the decision boundary may be more instrumental to improve the model performance. A few iterations later, ADL starts to penalize vacuity. While vacuity is still accurately estimated (high in vacuous regions), it becomes less useful for sampling (since very few unlabeled data is located nearby). Two iterations later, penalizing on vacuity helps to choose data samples that significantly refine the decision boundary. The superior AL performance of ADL as shown in Figure further confirms the effectiveness of ADL's key properties as demonstrated above.
5.2 REAL DATA
The real-world experiment is conducted on three datasets, MNIST, noLMNIST, and CIFAR-10, 10, all of which have ten classes. To mimic the real-world AL scenario, we leave 2-5 classes out for initial training and there are 5 labeled samples for each available class. A good AL model is expected to discover samples of unknown classes in an early stage to effectively improve model accuracy. We compare the proposed model with EDL (Sensoy al.] 2018) (entropy, vacuity+ BALD Gal et al. 2017) (epistemic), and softmax (entropy, random), where in the parenthesis are the uncertainty measurements used for sampling. Figures 4 and 5) that ADL consistently out- performs other models on all three datasets. The ad advattges of ADL are twofold. First, entropy decomposition gives ADL flexibility meet distinct sampling need at different AL phases. In an early stage, the fast accuracy improvement is achieved by the vacuity guided sampling where the most representative samples are labeled with high priority. Gradually, ADL switches to dissonance guided sampling to refine the decision boundary by labeling the most informative samples to im- prove its discriminative power. In contrast, sampling methods utilizing a unified uncertainty (e.g.. epistemic uncertainty and entropy) lack such flexibility to adjust the sampling behavior, leading to either slow convergence or lower model accuracy. Second, compared with EDL, which can also perform evidence prediction, ADL is superior due to accurate uncertainty estimation using the ef- fective loss function. For both synthetic and real data, we observe that ADL identifies samples from missing classes at least around 20% faster than using EDL and other models.
CONCLUSION
We present a novel active deep learning model that systematically leverages two distinct sources of uncertainty, vacuity and dissonance, effectively explore a large and high-dimensional data space for label-efficient training of DL models. The proposed ADL model benefits from the evidence- based entropy decomposition that follows from our theoretical analysis of belief vacuity and belief dissonance under the SL framework. The multi-source uncertainty can be accurately estimated through a novel loss function that augments DL based evidence prediction with vacuity-awar reg- ularization of the model parameters. Through dynamically balancing the importance of vacuity and dissonance, a sampling function is designed to first explore the critical areas of the data space and then fine-tune the decision boundary to maximize its discriminate power. Extensive experiments conducted over both synthetic and real data help verify the theoretical properties and empirical per- formance of the proposed ADL model.
8

---

Under review as a conference paper at ICLR 2020
REFERENCES
Clarence W De Silva. Intelligent control: fuzzy logic applications. CRC press, 2018.
Yarin Gal. Uncertainty in deep learning. University of Cambridge, 2016.
Yarin Gal, Riashat Islam, and Zoubin Ghahramani. Deep bayesian active learning with image data. In Proceedings of the 34th International Conference on Machine Learning-Voir Volume 70, pp. 1183- 1192. JMLR. org, 2017.
Audun Jøsang. Subjective logic. Springer, 2016.
Audun Jøsang, Jin-Hee Cho, and Feng Chen. Uncertainty characteristics of subjective opinions. In Fusion, pp. 1998-2005. IEEE, 2018.
Alex Kendall and Yarin Gal. What uncertainties do we need in bayesian deep learning for computer vision? NIPS, pp. 5574-5584, 2017.
Andrey Malinin and Mark Gales. Predictive uncertainty estimation via prior networks. arXiv preprint arXiv:1802.1050/1 2018.
Nils J Nilsson. Probabilistic logic. Artificial intelligence, 28(1):71-87, 1986.
Ozan Sener and Silvio Savarese. Active learning for convolutional neural networks: A core-set approach. In International Conference on Learning Representations, 2018. URL https://
openreview. net. forum? d=H1a Tuk-RMi
Murat Sensoy, Lance Kaplan, and Melih Kandemir. Evidential deep learning to quantify classifica- tion uncertainty. In Advances in Neural Information Processing Systems, pp. 3179-3180 3189, 2018.
Kari Sentz, Scott Ferson, et al. Combination of evidence in Dempster-Shafer theory, volume 4015. Citeseer, 2002.
Burr Settles. Active learning literature survey. Technical report, University of Wisconsin-Madison Department of Computer Sciences, 2009.
Glenn Shafer. A mathematical theory of evidence, volume 42. Princeton university press, 1976.
Oriol Vinyals, Charles Blundell, Timothy Lillicrap, Daan Wierstra, et al. Matching networks for one shot learning. In Advances in neural information processing systems, pp. 3630-3638, 2016.
Dan Wang and Yi Shang. new active labeling method for deep learning. 2014 International joint conference on neural networks (LJCNN) pp. 112-119. IEEE, 2014.
Keze Wang, Dongyu Zhang, Ya Li, Ruimao Zhang, and Liang Lin. Cost-effective active learning for deep image classification. IEEE Transactions on Circuits and Systems for Video Technology, 27(12):2591 16000, 2016.

---

Under review as a conference paper at ICLR 2020
A APPENDIX
PROOF OF LEMMA
Proof. Let Bi denote Bal(b,, b2). Since 0 S by (as S = E. by K), we have 0 - Bsk 1 1. In addition, Bys = 1, if by = by # 0; By 0, if bybn. = 0. Thus, we have Ejzu Bik S Ejtt bj, where the equality holds when Byx+ = 1, Vj. Therefore, we have
Ej
b, bj
L 1 =1 1 C
diss(w) Σ bk
bk
(16)
S
S
where (a) is due to the definition of by in equation 5 and (b) is due to the summation constraint in equation | and W- K.
PROOF OF LEMMA
Proof. Using the definition of uncertainty mass in equation and substituting W by K, we have
K
0 S vac(w)
S
(17)
S
Ek=1 Th
K
where equality is achieved when Σk 1'k = 0.
PROOF OF THEOREM
Proof. For (1), (+) is easy to show as S = K implies Σ
1 Fh = and vacluy-) 1; for (+),
using equation 2 and non-informative base rates, we have Ply k) L/K, Vk, which achieves maximum Hyy as log K.
For (2), we first prove (=). For y arg max H[y], we have P(y* k)) 1/K, vk. Thus, (rk + agK)/s K, Vk. For S + oc, denote S = CK and we have - Let C oc, we have r S + 1/K, Vk. Thus, we have y" = arg max diss (wzy) due to Corollary implies that ...k..... YKK and S - cc. Hence, lims ply
vk.
To prove (E), diss(wyy) as K)Ks 1/K, which implies that y* arg max H() for 5 - Co.
k)
BAT RUNET CETEE Teinass
KOT KAEST CHEEM CEVOOR
OFAB 13 VENT BAOSS
Tees
ABL
020
ALhisttione
Prinatoon
Parasone
Figure 6: AL performance on notMNIST and CIFAR-10 (start with 7 and 8 classes)
ABST claass
Tee Socuppt
A. Fol 3 485
AL Taa Kno
Ai Berobars
Figure 7: AL performance with no missing classes
ADDITIONAL EXPERIMENTAL RESULTS
We obtain similar AL curves for notMNIST and CIFAR- 10 when starting AL with 7 and classes as with 5 and 6 classes, which shown in Figure 6 In Figure we also report the AL performance on the three datasets when there is no missing class. ADL still achieves the best performance in all cases with slightly less advantage than other models.
10

---

Under review as a conference paper at ICLR 2020
EXPERIMENTAL SETTINGS
We choose the Adam optimizer train ADI. for 600 epochs and setting the learning rate to 0.001. The coefficient of evidence strength loss, X1, is set to 0.005 (cross validated from {0.001, 0.005, 0.03, 0.05)). The coefficient of the L2 regularizer. Xg, is set 0.05 (cross validated from {0.001, 0.005, 0.01, 0.03, 0.05, 0.08)). The X for anchor sample identification in equation I0 set to 0.005 (cross validated {0.001, 0.005, 0.03, 0.05)). We choose RBF as our kernel function with length scale set to (cross validated from f0.01, ()).
EFFECTIVENESS OF KDE BASED UNCERTAINTY ANCHOR SAMPLE IDENTIFICATION
In this section, we conduct additional experiment to evaluate the effectiveness of the KDE based uncertainty anchor sample identification method. Uncertainty anchor sample identification is an integral component of the ADL model, which aims to guide the model to be uncertain the OOD areas with respect to the current training data (instead of providing the final prediction). Therefore, other more advanced kernel functions/simillarty measures that are specifically designed for high- dimensional data can be used for the same purpose without affecting the overall model. However, when choosing a specific technique, is also important to consider both the quality of the data samples and efficiency fast identification of these data samples is critical for AL which is usually performed in real time. Since the model is constantly changing as it continues to explore the data space, new uncertainty data samples need to be discovered in each AL iteration. We have conducted three additional experiments to demonstrate which technique can achieve such a good balance.
Tene PEC Iaay
Uuade
130
301
302
Exitions
(a)
(b)
(c)
Figure 8: Effectiveness of KDE based anchor sample identification. (a) Comparison with ran- dom selection, no anchor samples, and attention kernel; (b) Comparison of min-max similarity of different techniques; (c) Impact of the characteristic length scale
We have compared KDE with the randomly selected anchor samples from unlabeled data and not using any anchor samples in Figure S (). KDE clearly outperforms random selee- tion, which in turn performs better than not using any anchor samples. We further confirm the positive result by evaluating the min-max similarity between the unlabeled and train- ing data. If KDE is able to identify anchor samples from the desired OOD regions of the feature space (although the estimated density in that region may not be very accurate), the sampling process would be guided correctly and the min-max similarity would increase in the next AL iteration as the result. Figure (b) compares the min-max similarity of KDE with random selection. The result shows that with KDE, the model covers the unlabeled feature space much more efficiently as AL moves forward.
We have adopted the attention kernel as a more advanced distance metric to replace the RBF kernel in the proposed anchor sample identification component. The attention kernel is the major component in the matching network (Vinyals et al. 2016), where the spatial invariance is ensured by CNN and the dimensionality of the inputs is reduced through two correlated LSTM projections. However, the attention kernel (our current implementation) is much slower to compute as compared with KDE especially when facing a very large unlabeled pool as the entire candidate data samples need to be embedded every iteration when the training/testing data are changed along with AL. Thus, if the improvement is not significant (see Figure g a)) and when the efficiency becomes a bottleneck for large unlabeled pool, the proposed KDE approach appears to be a good choice as can provide good balance between quality and efficiency, which is critical for AL.
11

---

Under review as a conference paper at ICLR 2020
We have investigated the impact of the characteristic length scale used in RBF kernl on AL performance. Figure [(c) shows that the ADL model performance is fairly robust to the length scale and only shows minor change with different choices.
ABLATION STUDY
We have conducted a detailed ablation study to clearly demonstrate the effectiveness of each major technical components:
MNEET strtt wtth Chnteee
cart wtth Chhoee
Tel Hepe
THE
hindons
(a)
(b)
(c)
Figure 9: Ablation study and batch-model AL. (a) Comparison of different sampling criteria; (b)
Comparison with different fixed vacuity/dissonance weighting; (c) Batch-model AL performance.
Figure D ()) compares proposed sampling method with other different sampling criteria: entropy, vacuity only, and dissonance only. The result confirms the effectiveness of the dynamically balanced sampling method. It is interesting to see that using vacuity alone performs quite well in the initial phase but only converges to lower accuracy in the end. In contrast, using dissonance is slow to start but able to converge to a higher accuracy. The entropy curve roughly stays in the middle of the above two curves.
The effectiveness of using the anchor samples has already been demonstrated in Figure g aaa) by comparing ADL with using any anchor samples and randomly selected anchor sam- ples from unlabeled data.
Figure bb) shows the results using different vacuity/dissonance ratios but keeping fixed throughout the AL process. The dynamically balanced sampling method clearly outper- forms the fixed weighting. This also demonstrates the usefulness of the proposed entropy decomposition theory. Since the sampling goal of AL changes with the accumulation of the labeled data, the optimal AL behavior can only be achieved by adaptively adjust the importance of vacuity and dissonance the sampling function.
Finally, we have conducted batch-mode AL and reported the results in Figure gc). As can be seen, as the batch size increases, the performance decreases. This is expected as there is no special strategy to diversify the samples chosen in the same batch. We will leave this to our future work as the current model is not designed specifically for batch mode AL.
SAMPLE IMAGES CHOSEN BY ADL
In this section, we have visualized the image samples selected by ADL in the early and later stages of active learning to help better understand the role of vacuity and dissonance in data sampling. In order better demonstrate the effectiveness of the vacuity measurement, we start active learning with 5 classes omitted from the initial training. Later we will see how does high vacuity at the early stage of active learning helps fast identify missing classes. TTssows the samples with highest vacuity selected by ADL in the first 30 AL iterations. The first four of them are from missing classes. This clearly demonstrates the effectiveness of using vacuity to explore the data space. As a result, data samples from the missing classes are quickly identified and being labeled. The last sample is from class '3', whose examples have already been exposed to ADL. However, the writing style of this sample is very different than other instances from the same class, which result in high vacuity.
Figure II shows the samples with highest dissonance selected by ADL in the last 100 AL iterations. By observing their predicted belief mass, find that the high dissonance result is due to the flicting belief over multiple classes. For example, the first sample is confusing between classes '4' and '6': the second sample is confusing among classes '5' 55,'6', and '8"; the third sample is confusing
12

---

Under review as a conference paper at ICLR 2020
5
6
3
7
3
Figure 10: Samples with a high vacuity in early AL iterations
4e
S
4
Q
Figure 11: Samples with high dissonance in late AL iterations
among classes '4''7', and '9"; the fourth sample is confusing between classes '4" and '6'; and the Fifth sample confusing between classes 'O' and '9'.
SOURCE CODE
The code for this work can be found in httess//aaiiie..ooooooo//o////er LimwnOahh8Ht HK_ TTT.:///AABBB........SSSTTTCTCAT 388
13


Reviews:
[{"review_id": "r1ldvyygcB", "reviewer": "AnonReviewer3", "summary": "", "questions": "", "limitations": "", "rating": 3, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "The authors consider active deep learning. They propose decomposing predictive entropy into a) vacuity (lack of evidence) and b) dissonance (contradictory evidence). They frame this in terms of \"subjective logic\". In practice this is achieved by having the NN output the parameters of a Dirichlet, which allows an additional degree of freedom describing variance/vacuity. Dissonance is defined in terms of the support of contradictory classes. To get improved estimates of vacuity they augment the loss with a term regularizing the Dirichlet parameters to be small (low precision) at unlabelled points with higher KDE(unlablled points) than KDE(labelled points). They propose initially weighting vacuity and later dissonance as AL proceeds. Encouraging results are presented on simulated 2D data, MNIST and CIFAR10. \n\nI think the basic idea of separating vacuity and dissonance is interesting, and the demonstration of the failings of existing ADL approaches is valuable. It wasn't clear to me how this \"subjective logic\" theory gets you to the specific definitions of vacuity/dissonance, or whether these were just proposed by the authors. Equation 6 seems to come out of nowhere (whereas the rest of the derivations using the Dirichlet are very intuitive). \n\nThe idea of encouraging the network to be uncertain far from data is also reasonable. While some Bayesian models such as Gaussian process regression with a RBF kernel give you this for free, it is certainly true that DL methods do not have this characteristic in general. Regularizing the r to be small seems like a reasonable way to do this, but I'm not convinced by the kernel density estimate part. DNNs can operate on very high-dimensional, structured inputs. Even the simplest of these, images, requires some degree of spatial invariance (achieved using convolutions) to obtain meaningful predictions. I find it very hard to believe a KDE can do anything meaningful in such spaces, even if you could find a sensible bandwidth (which isn't discussed at all). It is possible of course that random selection of unlabelled points to regularize in this way would work just as well. Unfortunately no ablation study is performed, so we don't know what the individual contribution of the three proposals (moving from vacuity to dissonance, augmented loss and Dirichlet likelihood) is. \n\nHow sensitive is the method to the vacuity/dissonance weighting? \n\nThe improvement over competing methods for MNIST and CIFAR10 appears to mostly manifest after the initial 20 or so acquistions.\n\nDo these results extend to batch AL? For many applications that's more important. \n\nOverall I thought this paper had some promising ideas but they need to be more thoroughly tested empirically to give some sense of how robust and generalizable the approach is. ", "extra_scores": {"experience_assessment": "I have read many papers in this area.", "review_assessment:_thoroughness_in_paper_reading": "I read the paper thoroughly.", "review_assessment:_checking_correctness_of_experiments": "I assessed the sensibility of the experiments.", "review_assessment:_checking_correctness_of_derivations_and_theory": "I assessed the sensibility of the derivations and theory."}, "extra_text": {}}, {"review_id": "SylVvHLkcH", "reviewer": "AnonReviewer1", "summary": "", "questions": "", "limitations": "", "rating": 6, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "This paper propose an active deep learning model. By leveraging subjective Logic, they propose to decompose the entropy of a predicted class distribution into vacuity (lack of evidence) and dissonance (conflict of strong evidence). Instead of using the predicted class distribution, they estimate the supporting evidence for each class. In the actual data sampling stage, they first sample from those high-vacuity dense region, to shape the true decision boundary, and then gradually sample from those high-dissonance region to fine-tune the decision boundary. They show better performance than the baselines on both synthetic and real datasets. \n\nFirst of all, for the readers who are not familiar with Subjective Logic or probabilistic logic in general, it is a bit hard to follow the reasoning behind the  equations in Sec 3 and  4. Specifically, what is the intuition behind the dissonance of an opinion in Eq (6)? What is the advantage of using Subjective logic framework. \n\nIn the experiments on MNIST, it would be best to visualize the image samples selected by the active learning model in the early and later stages, so that we can have a more intuitive understanding of vacuity vs. dissonance. ", "extra_scores": {"experience_assessment": "I do not know much about this area.", "review_assessment:_thoroughness_in_paper_reading": "I made a quick assessment of this paper.", "review_assessment:_checking_correctness_of_experiments": "I assessed the sensibility of the experiments.", "review_assessment:_checking_correctness_of_derivations_and_theory": "I assessed the sensibility of the derivations and theory."}, "extra_text": {}}]

Author rebuttal:

Meta-review: The authors propose a new perspective on active learning by borrowing concepts from subjective logic. In particular, they model uncertainty as a combination of dissonance and vacuity; two orthogonal forms of uncertainty that may invite additional labels for different reasons. The concepts introduced are not specific to deep learning but are generally applicable. Experiments on 2d data and a couple standard datasets are provided.

The derivation of the model is intuitive but it's not clear that it is "better" than any other intuitively derived model for active learning. With the field of active learning having such a long history, the field has moved towards a standard of expecting theoretical guarantees to distinguish a new method from the rest; this paper provides none. Instead anecdotal examples and small experiments are performed. Like other reviews, I am extremely skeptical about the use of KDE which is known to have essentially no inferential ability in high dimensions (such as in deep learning situations where presumably images are involved). It is hard not to feel as though deep learning is somewhat of a red herring in this paper. 

I recommend the authors lean into understanding the method from a perspective beyond anecdotes and experiments if they wish for this method to gain traction. 
Decision: Reject