# A Wavelet Based Multiscale Weighted Permutation Entropy Method for Sensor Fault Feature Extraction and Identification

Authors: Qiaoning Yang; Jianlin Wang
Journal: Journal of Sensors
 (2016)

---

## Abstract

Sensor is the core module in signal perception and measurement applications. Due to the harsh external environment, aging, and so forth, sensor easily causes failure and unreliability. In this paper, three kinds of common faults of single sensor, bias, drift, and stuck-at, are investigated. And a fault diagnosis method based on wavelet permutation entropy is proposed. It takes advantage of the multiresolution ability of wavelet and the internal structure complexity measure of permutation entropy to extract fault feature. Multicluster feature selection (MCFS) is used to reduce the dimension of feature vector, and a three-layer back-propagation neural network classifier is designed for fault recognition. The experimental results show that the proposed method can effectively identify the different sensor faults and has good classification and recognition performance.


---

## Body

## 1.Introduction

At present, the sensor is widely used in various processes to obtain a variety of physical quantity of data. In practical applications, due to the harsh external environments, battery depletion, aging, and other reasons, the sensor is prone to failure or even damage [1, 2]. The data obtained from the fault sensor has low reliability, and the subsequent judgment, recognition, decision, and control based on these low quality data will lose the meaning. The reliability of sensor data and the identification of sensor fault are important research subjects. Sensor fault identification mainly consists of two aspects: fault feature extraction and fault pattern classification [3, 4].Wavelet transform is a widely used time-frequency analysis technology. Using wavelet transform, signals are decomposed into multilevel time-frequency components. Suitable wavelet basis for wavelet decomposition is important for fault information representation [5]. The selection method of wavelet base includes many kinds, such as the minimum joint entropy standard, the minimum conditional entropy standard, the maximum mutual information criterion, the minimum relative entropy standard, and maximum energy-Shannon entropy criterion [6, 7]. Maximum energy-Shannon entropy criterion takes energy intensity and energy distribution into consideration and is capable of extracting the sensor fault variations effectively. The wavelet basis with maximum entropy Shannon energy ratio is the most appropriate wavelet basis.After wavelet decomposition, the main problem is how to extract fault information from the coefficients in decomposed subbands. The traditional Shannon entropy only considers the probability distribution of the signal value and does not consider the order structure of the signal value. Paper [8] combines the concept of Shannon entropy with the theory of symbol to propose a new complexity measure, which is the permutation entropy (PE). Permutation entropy is a time series complexity measure based on comparison of neighborhood values and the numerical mapping into symbol sequence pattern. It can describe the local structure features of time series signal and enlarge the subtle changes in the signal with low complexity and antinoise ability. PE is a kind of effective method for classification of different signal state, identification of the breakpoint in time sequence, prediction of the future trend of the time series, determination of causal relationship [9], and so forth. In order to overcome the shortcomings of PE’s single scale, Aziz and Arif [10] proposed a multiscale permutation entropy (MPE) to estimate the complexity in different scales of time series. MPE can describe the structural characteristics and complexity of time series in multiple scales and is widely used in heart sound signal analysis [10] and bearing fault diagnosis [11].On the other hand, the disadvantage of PE is the lack of amplitude information about the signal except sequential pattern [12]. Paper [13] puts forward the weighted permutation entropy (WPE). It extracts the sequential pattern of time series and retains the amplitude information of time series. Although the amplitude information of time series is used by WPE, it can only reflect the complexity of time series in one single scale. Multiscale analysis and weighted permutation entropy are combined, and multiscale weighted permutation entropy (MWPE) emerges. MWPE represents the complexity measure of the signal on multiscale and reflects the microlocal structure complexity and the amplitude information of the signal. It is widely used in a variety of signal analysis, such as analysis for bubbly oil-in-water [14], flow bearing fault diagnosis [15–17], biomedical signal analysis [18–21], and stock information analysis [22].From the viewpoint of structure feature presentation, PE can extract the local microstructure feature and wavelet transform can extract the global macrostructure feature. So the combination of wavelet transform with MWPE can comprehensively represent the feature of the sensor fault. A wavelet based multiscale weighted permutation entropy (WMWPE) is proposed in this paper. WMWPEs of different subbands are used to extract signal features. Because the dimensions of WMWPE features are relatively high, it may cause low identification accuracy and time consuming. So the selection of the most important features in WMWPEs is needed [23, 24]. In this paper, the multicluster feature selection (MCFS) [23] is used as feature selection method, which takes into account both the importance of each feature itself and the correlation between all features. By sorting the score of MCFS, the first K features with larger MCFS score are selected as the K important feature. Through the MCFS feature selection algorithm, the recognition accuracy is guaranteed, the feature vector dimension is reduced, and the computational efficiency is improved.Naturally, after feature selecting using MCFS, the multifault classifier is needed to conduct the fault diagnosis. A three-layer BP neural network is adopted as classifier to identify fault. TheK features selected by MCFS are fed into the classifier to identify sensor fault.The remainder of this paper is organized as follows. Section2 introduces permutation entropy and multiscale permutation entropy. In Section 3, the wavelet based multiscale weighted permutation entropy and corresponding fault identification method are presented in detail. Using practical data, the performance of the proposed method is investigated in Section 4. Section 5 makes some concluding remarks.


## 2.Permutation Entropy and Multiscale Permutation Entropy

### 2.1. Permutation Entropy

The permutation entropy (PE) is defined as follows [8]. Given a time series x(n) with the length N, then the m dimensional embedding vector at i time is defined as(1)Xim=xi,xi+τ,…,xi+m-1τ,i=1,2,…,N-m-1τ,where m is the embedding dimension and τ is time delay. Xim has a permutation πr0r1⋯rm-1, if it satisfies that(2)xi+r0τ≤xi+r1τ≤⋯≤xi+rm-1τ,where 0≤ri≤m-1 and ri≠rj. There are m! possible permutations for an m-tuple vector. For each permutation, we determine the relative frequency by(3)pπk=#i∣1≤i≤N-m-1τ,Ximhas typeπkN-m-1τ,where ∑k=1Kpπk=1,1≤K≤m!, and #{} represents the number of one set.The definition of PE withm dimension is defined as(4)HPEm=-∑k=1Kpπkln⁡pπk.The maximum value ofHPEm is ln⁡m!, when all possible permutations appear with the same probability. Therefore, the normalized permutation entropy (NPE) can be obtained as(5)HNPEm=HPEmln⁡m!.For any time series,0≤HNPEm≤1 is satisfied. The value of HPEm depends on the selection of the embedding dimension m and delay τ. If m is too small, the scheme will not work well since there are too few distinct states. However, it is often inappropriate to choose m as a large value for detecting the dynamic change of a time series.


### 2.2. Weighted Permutation Entropy

Weighted permutation entropy (WPE) incorporates significant amplitude information from the time series when retrieving the sequential patterns. The main motivation aims at saving useful amplitude information carried by the signal. WPE is defined as follows [13].Given a time seriesx(n) and m dimensional embedding vector Xim as (1) shows, the relative frequency of each motif in (3) is modified to include the weighted information wi for each Xim. Weight values wi are calculated in (6) based on the variance or energy of each subsequence Xim:(6)wi=1m∑l=1mxi+l-1τ-Xim-2,where Xim- is the mean of Xim:(7)Xim-=1m∑l=1mxi+l-1τ.Thus, each pair of weight valuewi and motif type πk can represent full feature for each vector Xim. By using weight value, WPE extends the concept of PE with the addition of amplitude information prior to the computing of probability occurrence of each motif defined in (6). Weighted relative frequency is defined as(8)pwπk=∑wi∣1≤i≤N-m-1τ,Ximhas typeπk∑wi.Then WPE of time series x(n) is(9)HWPEm=-∑k=1Kpwπkln⁡pwπk.


### 2.3. Multiscale Weighted Permutation Entropy

Multiscale analysis [22] is to obtain new time series of the original time series by a coarse-grained size process, which can estimate the complexity of time signals at different scales. Multiscale weighted permutation entropy (MWPE) is the combination of weighted permutation entropy and multiscale analysis. MWPE can totally describe the microstructure complexity and amplitude information of the time series on multiscale.The MWPE procedure is summarized in the following steps. Firstly, the original time seriesxn=x1,x2,…,xN is divided into nonoverlapping windows of length s. Secondly, the data points inside each window are averaged by (10), and the coarse-grained time series yjs is got. The schematic illustration of the coarse-grained procedure is shown in Figure 1. Consider the following:(10)yjs=1s∑i=j-1s+1jsxi,1≤j≤Ns.Weighted permutation entropy of yjs is MWPE, as shown in(11)MWPEx,s,m,τ=WPEyjs,m,τ.Figure 1
Coarse-grained procedure.MWPE is a function of scale factors and represents the complexity of time series on each scale. When s=1, MWPE is the same as WPE; that is to say, WPE is a special form of MWPE. For most of signals, the MWPE on one single scale is not enough to describe complexity of the signal, and the multiscale weighted permutation entropy is more suitable for the analysis of all kinds of actual signals.


### 2.4. Parameters Selection

Before computing multiscale weighted permutation entropy, four important parameters including the lengthN of time series data, embedding dimension m, time delay τ, and scale factor s are needed to set.The value of PE mainly depends on the embedding dimensionm and time delay τ. Embedding dimension m determines the number of sequential pattern, and the maximum sequential pattern number is m!, so m plays an important role in calculating the probability of the sequential pattern. If embedding dimension is too small (such as less than 3), it is hard to differentiate the sequential patterns. If the embedding dimension m is too large (such as more than 8), calculation of PE is time consuming, and it is not easy to observe the small changes in the signal [16].The time delayτ is related to the sampling rate of the signal. As [8] suggests, the time delay τ is set to 1 in this paper.The length of time seriesN has a great influence on the calculation of PE, a larger N will cause low computational efficiency, and a smaller N cannot completely describe the complexity of the time series. N≥5m! is recommended by [9].To illustrate the rationality of parameters selection, some experiments are conducted. The experiment data used in this paper is 1-minute gas sensor data. Sampling rate is 100 Hz and the data has 6000 sampling points. Given that the scale factors is a fixed value, Figure 2 shows the weighted permutation entropy (WPE) of four kinds of sensor data under different embedding dimensions,m = 2–8, and the time delay τ=1. As shown in Figure 2, when m=5, WPE can separate the four kinds of signals. So m=5 is feasible and is used in this paper.Figure 2
The relationship ofm and WPE.In Figure3, it is easy to find that different τ almost has no effect on WPE, so it is reasonable for the fact that τ is set to 1.Figure 3
The relationship ofτ and WPE.In this paper, the scale factors is set to 20. MWPEs on 20 scales are used as the features to identify and classify faults.


## 2.1. Permutation Entropy

The permutation entropy (PE) is defined as follows [8]. Given a time series x(n) with the length N, then the m dimensional embedding vector at i time is defined as(1)Xim=xi,xi+τ,…,xi+m-1τ,i=1,2,…,N-m-1τ,where m is the embedding dimension and τ is time delay. Xim has a permutation πr0r1⋯rm-1, if it satisfies that(2)xi+r0τ≤xi+r1τ≤⋯≤xi+rm-1τ,where 0≤ri≤m-1 and ri≠rj. There are m! possible permutations for an m-tuple vector. For each permutation, we determine the relative frequency by(3)pπk=#i∣1≤i≤N-m-1τ,Ximhas typeπkN-m-1τ,where ∑k=1Kpπk=1,1≤K≤m!, and #{} represents the number of one set.The definition of PE withm dimension is defined as(4)HPEm=-∑k=1Kpπkln⁡pπk.The maximum value ofHPEm is ln⁡m!, when all possible permutations appear with the same probability. Therefore, the normalized permutation entropy (NPE) can be obtained as(5)HNPEm=HPEmln⁡m!.For any time series,0≤HNPEm≤1 is satisfied. The value of HPEm depends on the selection of the embedding dimension m and delay τ. If m is too small, the scheme will not work well since there are too few distinct states. However, it is often inappropriate to choose m as a large value for detecting the dynamic change of a time series.


## 2.2. Weighted Permutation Entropy

Weighted permutation entropy (WPE) incorporates significant amplitude information from the time series when retrieving the sequential patterns. The main motivation aims at saving useful amplitude information carried by the signal. WPE is defined as follows [13].Given a time seriesx(n) and m dimensional embedding vector Xim as (1) shows, the relative frequency of each motif in (3) is modified to include the weighted information wi for each Xim. Weight values wi are calculated in (6) based on the variance or energy of each subsequence Xim:(6)wi=1m∑l=1mxi+l-1τ-Xim-2,where Xim- is the mean of Xim:(7)Xim-=1m∑l=1mxi+l-1τ.Thus, each pair of weight valuewi and motif type πk can represent full feature for each vector Xim. By using weight value, WPE extends the concept of PE with the addition of amplitude information prior to the computing of probability occurrence of each motif defined in (6). Weighted relative frequency is defined as(8)pwπk=∑wi∣1≤i≤N-m-1τ,Ximhas typeπk∑wi.Then WPE of time series x(n) is(9)HWPEm=-∑k=1Kpwπkln⁡pwπk.


## 2.3. Multiscale Weighted Permutation Entropy

Multiscale analysis [22] is to obtain new time series of the original time series by a coarse-grained size process, which can estimate the complexity of time signals at different scales. Multiscale weighted permutation entropy (MWPE) is the combination of weighted permutation entropy and multiscale analysis. MWPE can totally describe the microstructure complexity and amplitude information of the time series on multiscale.The MWPE procedure is summarized in the following steps. Firstly, the original time seriesxn=x1,x2,…,xN is divided into nonoverlapping windows of length s. Secondly, the data points inside each window are averaged by (10), and the coarse-grained time series yjs is got. The schematic illustration of the coarse-grained procedure is shown in Figure 1. Consider the following:(10)yjs=1s∑i=j-1s+1jsxi,1≤j≤Ns.Weighted permutation entropy of yjs is MWPE, as shown in(11)MWPEx,s,m,τ=WPEyjs,m,τ.Figure 1
Coarse-grained procedure.MWPE is a function of scale factors and represents the complexity of time series on each scale. When s=1, MWPE is the same as WPE; that is to say, WPE is a special form of MWPE. For most of signals, the MWPE on one single scale is not enough to describe complexity of the signal, and the multiscale weighted permutation entropy is more suitable for the analysis of all kinds of actual signals.


## 2.4. Parameters Selection

Before computing multiscale weighted permutation entropy, four important parameters including the lengthN of time series data, embedding dimension m, time delay τ, and scale factor s are needed to set.The value of PE mainly depends on the embedding dimensionm and time delay τ. Embedding dimension m determines the number of sequential pattern, and the maximum sequential pattern number is m!, so m plays an important role in calculating the probability of the sequential pattern. If embedding dimension is too small (such as less than 3), it is hard to differentiate the sequential patterns. If the embedding dimension m is too large (such as more than 8), calculation of PE is time consuming, and it is not easy to observe the small changes in the signal [16].The time delayτ is related to the sampling rate of the signal. As [8] suggests, the time delay τ is set to 1 in this paper.The length of time seriesN has a great influence on the calculation of PE, a larger N will cause low computational efficiency, and a smaller N cannot completely describe the complexity of the time series. N≥5m! is recommended by [9].To illustrate the rationality of parameters selection, some experiments are conducted. The experiment data used in this paper is 1-minute gas sensor data. Sampling rate is 100 Hz and the data has 6000 sampling points. Given that the scale factors is a fixed value, Figure 2 shows the weighted permutation entropy (WPE) of four kinds of sensor data under different embedding dimensions,m = 2–8, and the time delay τ=1. As shown in Figure 2, when m=5, WPE can separate the four kinds of signals. So m=5 is feasible and is used in this paper.Figure 2
The relationship ofm and WPE.In Figure3, it is easy to find that different τ almost has no effect on WPE, so it is reasonable for the fact that τ is set to 1.Figure 3
The relationship ofτ and WPE.In this paper, the scale factors is set to 20. MWPEs on 20 scales are used as the features to identify and classify faults.


## 3.Wavelet Based Multiscale Weighted Permutation Entropy (WMWPE) and Fault Identification Method

Although the MWPE takes advantage of the local microstructure information and amplitude information of signal, the macrostructure information is not explored. Wavelet transform is a powerful method to explore it and can be used to extract the global macrostructure information of the signal. So the combination of wavelet transform with MWPE can comprehensively describe the multiple features of the signal.


### 3.1. WMWPE

Given the analyzed signalx(n) and wavelet decomposed level J, wavelet decomposed coefficients are expressed as D1n,D2n,…,DJn,AJ(n), corresponding to the coefficients D1n of the first high frequency subband (HF1), the coefficients D2n of the second high frequency subband (HF2),…, the coefficients DJn of the J high frequency subband (HFJ), and the coefficients AJ(n) of the J low frequency subband (LFJ). AJ(n) belongs to the low frequency subband, which represents the macrostructure of the analyzed signal. So AJ(n) is the preferable subband to calculate WMWPE:(12)WMWPEAJn,s,m,τ=WPEyjs,m,τ,where yjs=1/s∑i=j-1s+1jsAJ(n),1≤j≤NJ/s, NJ is the number of coefficients in LFJ, and s is the scale factor.


### 3.2. WMWPE Based Fault Identification Method

The WMWPE based fault identification method takes advantage of wavelet transform, WMWPE, MCFS, and BP-NN. It provides a full working flow of feature selection and fault identification as shown in Figure4. Detailed procedures are described as follows.Figure 4
Flowchart of sensor fault feature extraction and recognition method.Step 1.
Use maximum energy-to-Shannon entropy ratio criterion to choose a proper wavelet base.Step 2.
The sensor signals are decomposed by the selected wavelet base. A series of wavelet subband signals are obtained, and the appropriate subband signal is selected to extract feature.Step 3.
Calculate multiscale weighted permutation entropy of the selected wavelet subbands, and WMWPEs are got.Step 4.
After feature extraction, calculate MCFS score of the WMWPE features. According to the MCFS score ranked from high to low, select the features corresponding to the topK MCFS score as the best subset of features.Step 5.
The selectedK features by MCFS are fed into BP-NN classifier for sensor fault recognition.


## 3.1. WMWPE

Given the analyzed signalx(n) and wavelet decomposed level J, wavelet decomposed coefficients are expressed as D1n,D2n,…,DJn,AJ(n), corresponding to the coefficients D1n of the first high frequency subband (HF1), the coefficients D2n of the second high frequency subband (HF2),…, the coefficients DJn of the J high frequency subband (HFJ), and the coefficients AJ(n) of the J low frequency subband (LFJ). AJ(n) belongs to the low frequency subband, which represents the macrostructure of the analyzed signal. So AJ(n) is the preferable subband to calculate WMWPE:(12)WMWPEAJn,s,m,τ=WPEyjs,m,τ,where yjs=1/s∑i=j-1s+1jsAJ(n),1≤j≤NJ/s, NJ is the number of coefficients in LFJ, and s is the scale factor.


## 3.2. WMWPE Based Fault Identification Method

The WMWPE based fault identification method takes advantage of wavelet transform, WMWPE, MCFS, and BP-NN. It provides a full working flow of feature selection and fault identification as shown in Figure4. Detailed procedures are described as follows.Figure 4
Flowchart of sensor fault feature extraction and recognition method.Step 1.
Use maximum energy-to-Shannon entropy ratio criterion to choose a proper wavelet base.Step 2.
The sensor signals are decomposed by the selected wavelet base. A series of wavelet subband signals are obtained, and the appropriate subband signal is selected to extract feature.Step 3.
Calculate multiscale weighted permutation entropy of the selected wavelet subbands, and WMWPEs are got.Step 4.
After feature extraction, calculate MCFS score of the WMWPE features. According to the MCFS score ranked from high to low, select the features corresponding to the topK MCFS score as the best subset of features.Step 5.
The selectedK features by MCFS are fed into BP-NN classifier for sensor fault recognition.


## 4. Experiments and Result Analysis

In this paper, the experimental data set is the measurement recordings collected from an array of 72 metal-oxide gas sensor array-based chemical detection platform [25]. The sampling rate of data is 100 Hz. One-minute sampling data (6000 sampling points) of each sensor is used as original data. Three kinds of fault (bias, stuck-at, and drift) are injected into original data. Each kind has 120 groups of data. For bias fault, the bias constant is 2% of the average value of original data. In each stuck-at fault, there are two segments of data with constant value (98% of the average value of the original). In drift fault groups, drift rate is 0.1% of the average value of original data. Normal sensor data and fault sensor data are shown in Figure 5, respectively.Figure 5
Normal sensor data and fault sensor data. (a) Normal data, (b) bias, (c) stuck-at, and (d) drift.
(a) (b) (c) (d)(1) Selection of Wavelet Subband.Before selection of wavelet subband, the maximum energy-to-Shannon entropy ratio criterion is used for wavelet base selection. More detailed information can be found in [26]. Figure 6 is the average WMWPE of 120 sensor signals after 3-level wavelet decomposition. It is easy to find that WMWPE of the low frequency subband can easily differentiate the four kinds of sensor signals (normal, bias, stuck-at, and drift) on different scale factor s, and WMWPE of three high frequency subbands cannot distinguish the four kinds of sensor signals. The experiment results show that selecting the low frequency subband for feature extraction is feasible.Figure 6
The average WMWPE of 120 sensor signals after wavelet decomposition. (a) Low frequency-level 3. (b) High frequency-level 1. (c) High frequency-level 2. (d) High frequency-level 3.
(a) (b) (c) (d)(2) Feature Extraction and Fault Identification.After 3-level wavelet decomposition, feature extraction on the third-level low frequency subband is the further job. The WMWPEs of the selected low frequency subband signal on 20 scales are calculated. These WMWPEs will be fed into BP-NN classifier to identify fault.A three-layer BP-NN neural network is used as classifier in the experiments. The hidden layer of the network has 10 neural nodes for learning. The network is trained by scaled conjugate gradient back-propagation method. Mean squared error is used as performance function. To obtain the generalized identification performance, 10-fold cross-validation [27, 28] is used in this paper. In 10-fold cross-validation, the proposed feature vectors are randomly partitioned into 10 equal sized subsets. Of the 10 subsets, a single subset is retained as the validation data for testing, and the remaining 9 subsets are used as training data. The cross-validation process is then repeated 10 times, with each of the 10 subsets used exactly once as the validation data. The 10 results from the folds can then be averaged to produce a single estimation.To illustrate the identification performance of WMWPE on different subbands(HF1,HF2,HF3, and LF3), all WMWPEs of 20 scales are used to recognize faults. Table 1 shows the average identification accuracy of different subband. WMWPE of LF3 has much better identification performance than that of other subbands. The average identification accuracy of LF3 is 99.5% and about 20% higher than others. At the same time, LF3 has the smallest identification standard deviation than others. It explains the rationality of selecting WMWPE of LF3 subband as features.Table 1
Average identification accuracy and standard deviation of 20 WMWPEs of different subband.
Subband Average identification accuracy ± standard deviation LF3 99.50 % ± 0.08 HF1 60.94 % ± 1.42 HF2 72.99 % ± 0.64 HF3 76.11 % ± 0.65Table2 is the detailed identification results of WMWPE from LF3 subband. For bias and stuck-at, the identification accuracy is 100%. There is false judgment in the identification of normal and drift signal. The reason is that the local structure pattern and the amplitude of bias and stuck-at are significantly different from those of normal signal. So it is easy to use WMWPE to identify them. Although the drift causes the change of signal amplitude, small change of the amplitude may bring little change to the sequential pattern. And some false negative results exists.Table 2
Identification results of WMWPE feature of LF3 subband.
Actual type Identification results Normal Bias Stuck-at Drift Normal 99 . 43 % ± 0 . 24 0% 0% 0 . 57 % ± 0 . 24 Bias 0% 100% 0% 0% Stuck-at 0% 0% 100% 0% Drift 1 . 18 % ± 0 . 17 0 . 28 % ± 0 . 02 0% 9 8.54 % ± 0 . 16(3) Feature Selection.There exists large consuming time and information redundancy, if selecting all 20 scales of WMWPE as features and implementing classification. In order to improve the efficiency of the proposed method, MCFS is used to reduce the dimension of feature vector.After calculating MCFS of 20 WMWPE features, the topK features with larger MCFS score are selected as the inputs of BP-NN. The feature selection result and the corresponding identification accuracy are shown in Table 3.Table 3
Average identification accuracy of the selected feature vectors.
Feature dimensionK The scale index of selected features Average identification accuracy ± standard deviation 1 [ 1 ] 83.46 % ± 0.53 2 [ 19,20 ] 87.19 % ± 0.72 3 [ 18,13,17 ] 97.42 % ± 0.27 4 [ 18,17,3 , 4 ] 98.74 % ± 0.23 5 [ 18,4 , 6,5 , 7 ] 99.46 % ± 0.09 6 [ 18,4 , 5,2 , 1,6 ] 99.37 % ± 0.15 7 [ 4,18,5 , 2,1 , 6,17 ] 99.30 % ± 0.08 8 [ 4,18,5 , 2,1 , 6,3 , 7 ] 99.4 2 % ± 0.13 9 [ 4,5 , 18,2 , 1,6 , 3,7 , 8 ] 99.33 % ± 0 . 07 10 [ 4,5 , 18,2 , 1,3 , 6,7 , 8,12 ] 99.4 3 % ± 0.10 All 20 features [ 1 , … , 20 ] 99.50 % ± 0.08Table3 shows that the average identification accuracy and standard deviation obtained by 5 new selected features are almost the same as those of all 20 features. The experiment results show that, using feature selection algorithm MCFS, the dimension of the feature vector is reduced from 20 to 5, but the recognition accuracy is maintained at about 99.5% with standard deviation of 0.08. That is because MCFS not only considers the classification ability of single feature, but also considers the relationship between the features.(4) Performance Comparison of Different Features.In order to further illustrate the superiority of the proposed method, the identification performance of the proposed method WMWPE is compared with that of MWPE, WWPE, WPE, MPE, and PE, wherein WWPE is WPE of the low frequency subband signal under wavelet decomposition. Table 4 shows the average recognition accuracy and standard deviation for the four kinds of signals using different features over 10 times of 10-fold cross-validation. The more detailed recognition results are shown in Table 5.Table 4
Average identification accuracy of using different features.
Features Average identification accuracy ± standard deviation WMWPE 99.50 % ± 0.08 MWPE 98.0 6 % ± 0.20 WWPE 83.34 % ± 0.62 WPE 4 5.15 % ± 0.49 MPE 73 . 42 % ± 0.40 PE 35.27 % ± 0.20Table 5
Identification results of different features.
Actual type Identification results Normal Bias Stuck-at Drift MWPE Normal 9 7.93 % ± 0 . 56 0% 0% 2.07 % ± 0 . 51 Bias 0% 9 8.13 % ± 0 . 48 1.87 % ± 0 . 46 0% Stuck-at 0% 1.43 % ± 0 . 23 98.57 % ± 0 . 22 0% Drift 1.43 % ± 0 . 2 0 . 8 % ± 0 . 3 0% 9 7.77 % ± 0 . 19  WWPE Normal 90 . 87 % ± 0 . 52 0% 0% 9.13 % ± 0 . 46 Bias 0% 7 4.5 % ± 1.62 2 5.50 % ± 1.51 0% Stuck-at 0% 3.67 % ± 0 . 21 9 6.33 % ± 0 . 26 0% Drift 2 6.83 % ± 0 . 96 0% 1.47 % ± 0 . 41 7 1.7 % ± 1.34  WPE Normal 40.8 7 % ± 6.97 13 . 0 3 % ± 1.43 6 . 9 7 % ± 0 . 82 39.1 3 % ± 7.42 Bias 15.70 % ± 2.05 35 . 30 % ± 4.52 27 % ± 3.63 22 % ± 2.85 Stuck-at 6.2 % ± 1.31 20.47 % ± 2.95 6 4 . 1 3 % ± 2.71 9.20 % ± 1.47 Drift 4 2 . 8 0 % ± 6.35 1 0.70 % ± 1.60 6.20 % ± 0 . 84 40.30 % ± 6.76  MPE Normal 5 7.76 % ± 1.40 3 7.91 % ± 1.38 4.33 % ± 0 . 17 0% Bias 4 2.06 % ± 0 . 82 53.74 % ± 0 . 71 4.20 % ± 0 . 32 0% Stuck-at 3 . 2 0 % ± 0 . 44 1 0 . 1 3 % ± 1.42 86.67 % ± 1.42 0% Drift 4 . 50 % ± 0 . 08 0% 0% 9 5 . 50 % ± 0 . 24As shown in Tables2, 4, and 5, the identification accuracy of WMWPE is higher than that of MWPE. The same conclusion can be got from the performance comparison of WWPE with WPE. That is because wavelet transform brings macrostructure information into the feature. Combined with macro- and microstructure information, WMWPE and WWPE can get better performance.Comparing the results of WMWPE to WWPE, MWPE to WPE, and MPE to PE, the multiscales analysis can improve the identification precision over 16%. The main reason is that the multiscale feature can explore more local structure information of the signals than the single scale feature.Comparing the results of MWPE to MPE and WPE to PE, the amplitude information can bring about 25% and 9% increase of average identification accuracy, respectively.So the macro- and microstructure information and amplitude information are all explored by WMWPE. The experiment results validate that the proposed method based on WMWPE can achieve high identification accuracy for sensor fault.


## 5. Conclusion

How to find an effective feature extraction method for sensor fault analysis and identification is always an important issue. Taking full advantage of macrostructure information, microstructure information, and amplitude information of the typical sensor faults, this paper proposed a new sensor fault feature extraction and identification method based on wavelet transform and multiscale weighted permutation entropy. The appropriate based wavelet selection, feature extraction, multicluster feature selection, and BP classifier are investigated. Actual chemical gas concentration data is used to evaluate the performance of the proposed method. Experiment results show that the proposed WMWPE extracts more comprehensive feature information and can achieve higher fault recognition accuracy than other kinds of features.



---

*Source: 9693651-2016-05-30.xml*