# Nonlinear Neural System for Active Noise Controller to Reduce Narrowband Noise

Authors: Minh-Canh Huynh; Cheng-Yuan Chang
Journal: Mathematical Problems in Engineering
 (2021)

---

## Abstract

Noise in a dynamic system is practically unavoidable. Today, such noise is commonly reduced using an active noise control (ANC) system with the filtered-x least mean square (FXLMS) algorithm. However, the performance of the ANC system with FXLMS algorithm is significantly impaired in nonlinear systems. Therefore, this paper develops an efficient nonlinear adaptive feedback neural controller (NAFNC) to eliminate narrowband noise for both linear and nonlinear ANC systems. The proposed controller is implemented to update its coefficients without prior offline training by neural network. Hence, the proposed method has rapid convergence rate as confirmed by simulation results. The proposed work also analyzes the stability and convergence of the proposed algorithm. Simulation results verify the effectiveness of the proposed method.


---

## Body

## 1. Introduction

Noise is everywhere and affects us constantly. The usual approach to reduce noise uses sound-proof or sound-absorbing materials, called passive noise reduction, having the disadvantage of requiring bulky materials and being ineffective in cancelling low-frequency noise. The active noise control (ANC) method, introduced by Lueg in 1936 [1], is built by adding a secondary source to eliminate the undesired noise by the superposition principle. An ANC system emits antinoise that has an equal amplitude but with opposite phase to the primary noise source. Two sound waves from both primary and secondary sources interfere with each other, resulting in both noise cancellation and very efficient low-frequency operation [2].In recent years, several ANC approaches have been applied to vibration and noise reduction for vehicles. Gäbel et al. proposed a multichannel active control system to reduce vehicle interior noise on the road. The proposed algorithm reduced the level of structural vibration and vehicle interior noise under the operating conditions [3]. Wang et al. proposed active control using the discrete wavelet transform (DWT) based FXLMS algorithm with a piezoelectric feedback system to cope with the stationary and nonstationary noises in a simplified vehicle cavity model [4]. Guo et al. improved fuzzy control algorithm based on piezoelectric ceramic materials and proposed the variable step-size median-LMS algorithm for the vehicle interior noise [5, 6]. Thereby, it can be seen that the ANC system has made positive contributions to life.Usually, the ANC systems can be divided into two categories, the broadband and the narrowband ANC systems. The narrowband ANC (NANC) system includes two methods: feedforward and feedback ways [7, 8]. The feedback ANC method applies error signal and then synthesizes the reference signal, which reduces estimated noise [9, 10]. On the other hand, a feedforward system measures the noise using a reference sensor and thus is capable of cancelling broadband noise [11]. The FXLMS algorithm is widely used in the ANC systems to tune the coefficients to achieve the best noise reduction. The variable step-size method for FXLMS algorithm was proposed in [12] for a typical NANC system which supports rapid convergence. Chang et al. presented a filter-bank in a parallel-structure NANC for secondary path modelling to enhance ANC performance [13–15]. Shin et al. proposed a sequential selection-normalized subband adaptive filter with variable step size, which involved low computational complexity and had an efficient convergence speed [16]. However, the ANC system is usually influenced by acoustic environment such as the varying time, temperature, and other factors. In addition, the ANC system is also affected by the stability of sensors, actuators, and amplifiers, which may degrade the performance of the linear ANC with the FXLMS algorithm [17].Consequently, many studies proposed nonlinear ANC designs. The adaptive recursive Volterra controller and adaptive bilinear controller have been used with nonlinear systems [18–20]. With respect to fuzzy controllers, the fuzzy ANC system was proposed in [21]. Aluclu et al. also built a fuzzy logic model to restrain noise in workplace [22]. Chang et al. developed the fuzzy filtered-U algorithm to avoid unstable poles, which may occur in the conventional filtered-U based ANC system [23]. Besides, combining fuzzy and neural network schemes, several nonlinear ANC systems have also been presented [24–28]. The multilayer neural networks have been proposed for nonlinear ANC systems [29–32]. Halimeh et al. also introduced a neural network-based approach to the problem of nonlinear acoustic echo cancellation (NLAEC) [33]. Zhang mentioned a nonlinear neural adaptive controller integrated with evaluation algorithm to attenuate noises in nonlinear systems [34]. Thai et al. used an adaptive variable step-size neural controller in nonlinear feedback ANC systems, resulting in the reduction of noise that was transmitted over nonlinear paths and thereby improving the performance [35]. Notably, Thai et al. proposed a fast learning algorithm for neural networks that was based on the FXLMS algorithm without offline training.Based on the above analysis, the FXLMS algorithm-based adaptive neural controller can update parameters online without offline training in advance. However, the feedforward neural controller approach is less effective than the feedback system [36, 37] because the feedback path allows the neural network to learn, recognize, and generate the time-varying patterns. The delay in the feedback connection stores values from the previous time step. These values can be used in the current time step [37, 38]. This research develops a nonlinear adaptive feedback neural controller (NAFNC) that can be adapted in nonlinear conditions to enhance the performance of the NANC system. The advantages of this paper can be recapitulated as follows:(1)
The parameters of the NAFNC are updated online using the FXLMS algorithm(2)
The convergence and stability of the proposed method are ensured by analyzing the Lyapunov function(3)
The obtained results of the simulations were compared with the works in [35], revealing improved performance of the proposed method(4)
Simulation results verify the effectiveness of the proposed method in both linear and nonlinear ANC systemsThis paper is organized as follows. Section2 analyzes conventional ANC methods. Section 3 provides the proposed method. Section 4 presents simulation results. Section 5 draws conclusions.


## 2. Conventional Methods Analysis

This section analyzes the algorithm of the conventional methods in ANC systems.


### 2.1. Offline Modelling to the Secondary Path

The ANC system with the FXLMS algorithm must estimate the secondary path to update the coefficients of the adaptive filter. Accordingly, the secondary pathSz, comprising the digital-to-analog converter (DAC), reconstruction filter, power amplifier, loudspeaker, acoustic path, error microphone, preamplifier, antialiasing filter, and analog-to-digital converter (ADC) in practice, is assumed to be time-invariant but unknown [2]. The white noise xwhn is considered to be a common source of stimulation signals in the estimation of Sz. Figure 1 presents the offline model, in which the error signal ewhn is picked up by the error sensor and is determined as(1)ewhn=xwh′n−x^wh′n,where x^wh′n is the output of the adaptive filter and is represented as(2)x^wh′n=∑l=0L−1s^lnxwhn−l=s^Tnxwhn,where xwhn is determined by vector xwhn≡xwhn,xwhn−1,…,xwhn−L+1T and emitted by the secondary loudspeaker at time n and s^ln is the lth adaptive coefficient of the finite impulse response (FIR) filter S^z, with s^n≡s^0n,s^1n,…,s^L−1nT. The LMS algorithm updates the coefficients for the adaptive filter as(3)s^n+1=s^n+μxwhnewhn.Figure 1
The offline model.Applying the convergence conditions of the mean square error (MSE) [39] yields step size μ that satisfies the boundary condition(4)0<μ<23LPxn,where Pxn denotes the power of input signal xwhn.


### 2.2. Conventional Methods for Reducing Narrowband Noise

#### 2.2.1. Narrowband Feedforward ANC Method

Figure2 displays the parallel form NANC model. This is the typical model for the conventional narrowband feedforward ANC (CNFANC) method. Pz is the primary path, and dn is the primary noise comprising k harmonics and is assumed to be(5)dn=∑i=1kdin,where din is the undesired narrowband noise with frequency ωi. The reference input at the ith channel of the NANC system is a sinusoidal signal(6)xin=cosωin,with the angular frequency ωi. The reference input signal is usually produced from the information provided by the synchronization signal from a nonacoustic sensor to the noise source. The output signal of adaptive filter at the ith channel is(7)yin=∑l=0L−1winxin−l=wiTnxiwn,where xiwn=xin,xin−1,…,xin−L+1T, win=wi,0n,wi,1n,…,wi,L−1nT, and L is the filter length of Wiz. The antinoise signal yn is the sum of each channel, and we have(8)yn=∑i=1kyin,and the error signal(9)en=dn−y′n.Figure 2
Conventional parallel form NANC model.The filtered signal is(10)xi′n=∑m=0M−1s^nxi′n−m=s^Tnxi′sn,where s^n=s^0n,s^1n,…,s^M−1nT is the vector coefficient of the estimated secondary path S^z and xi′sn=xin,xin−1,…,xin−M+1T. By setting the cost function as(11)ξn=Ee2n,we can obtain the estimated gradient(12)∇ξn=∂ξn∂win=−2enxi′n.The FXLMS algorithm for updating the weights is(13)win+1=win−μconv∇ξn2,=win+μconvenxi′n,where μconv is the step size and xi′n=xi′n,xi′n−1,…,xi′n−L+1 is the filtered signal vector.


#### 2.2.2. Feedback ANC Method

The feedback-based ANC model is shown in Figure3. By only using the error sensor to measure the residual noise signal en, the adaptive feedback ANC algorithm synthesizes the reference signal xn as(14)xn≡d^n=en+∑m=0M−1s^myn−m,where s^mm=0,1,…,M−1 is the coefficients of the filter S^z. Thus, we have(15)vn=∑m=0M−1s^myn−m.Figure 3
Narrowband feedback ANC model.The antinoise signalyn is generated as(16)yn=∑l=0l−1wlnxn−l,where wlnl=0,1,…,L−1 is the coefficients of Wz at time n and L is the filter length of Wz. The FXLMS algorithm updates the weights of adaptive FIR filter and is given by(17)wln+1=wln+μd^′n−len,where μ is the step size. The filtered reference signal is defined as(18)d^′n≡∑m=0M−1s^md^n−m.


#### 2.2.3. Adaptive Neural Controller

Based on the feedback ANC system, the adaptive neural network approach including input layer, hidden layer, and output layer was presented in [35]. Two adaptive algorithms determine the weights for the hidden and the output layers. Figure 4 shows the structure suggested in [35].Figure 4
Structure of previous controller in [35].fn is the output signal of the hidden layer with the activation function Tanh (), and yn represents the output of the output layer, indicating the antinoise signal. The signal en denotes the error signal.


## 2.1. Offline Modelling to the Secondary Path

The ANC system with the FXLMS algorithm must estimate the secondary path to update the coefficients of the adaptive filter. Accordingly, the secondary pathSz, comprising the digital-to-analog converter (DAC), reconstruction filter, power amplifier, loudspeaker, acoustic path, error microphone, preamplifier, antialiasing filter, and analog-to-digital converter (ADC) in practice, is assumed to be time-invariant but unknown [2]. The white noise xwhn is considered to be a common source of stimulation signals in the estimation of Sz. Figure 1 presents the offline model, in which the error signal ewhn is picked up by the error sensor and is determined as(1)ewhn=xwh′n−x^wh′n,where x^wh′n is the output of the adaptive filter and is represented as(2)x^wh′n=∑l=0L−1s^lnxwhn−l=s^Tnxwhn,where xwhn is determined by vector xwhn≡xwhn,xwhn−1,…,xwhn−L+1T and emitted by the secondary loudspeaker at time n and s^ln is the lth adaptive coefficient of the finite impulse response (FIR) filter S^z, with s^n≡s^0n,s^1n,…,s^L−1nT. The LMS algorithm updates the coefficients for the adaptive filter as(3)s^n+1=s^n+μxwhnewhn.Figure 1
The offline model.Applying the convergence conditions of the mean square error (MSE) [39] yields step size μ that satisfies the boundary condition(4)0<μ<23LPxn,where Pxn denotes the power of input signal xwhn.


## 2.2. Conventional Methods for Reducing Narrowband Noise

### 2.2.1. Narrowband Feedforward ANC Method

Figure2 displays the parallel form NANC model. This is the typical model for the conventional narrowband feedforward ANC (CNFANC) method. Pz is the primary path, and dn is the primary noise comprising k harmonics and is assumed to be(5)dn=∑i=1kdin,where din is the undesired narrowband noise with frequency ωi. The reference input at the ith channel of the NANC system is a sinusoidal signal(6)xin=cosωin,with the angular frequency ωi. The reference input signal is usually produced from the information provided by the synchronization signal from a nonacoustic sensor to the noise source. The output signal of adaptive filter at the ith channel is(7)yin=∑l=0L−1winxin−l=wiTnxiwn,where xiwn=xin,xin−1,…,xin−L+1T, win=wi,0n,wi,1n,…,wi,L−1nT, and L is the filter length of Wiz. The antinoise signal yn is the sum of each channel, and we have(8)yn=∑i=1kyin,and the error signal(9)en=dn−y′n.Figure 2
Conventional parallel form NANC model.The filtered signal is(10)xi′n=∑m=0M−1s^nxi′n−m=s^Tnxi′sn,where s^n=s^0n,s^1n,…,s^M−1nT is the vector coefficient of the estimated secondary path S^z and xi′sn=xin,xin−1,…,xin−M+1T. By setting the cost function as(11)ξn=Ee2n,we can obtain the estimated gradient(12)∇ξn=∂ξn∂win=−2enxi′n.The FXLMS algorithm for updating the weights is(13)win+1=win−μconv∇ξn2,=win+μconvenxi′n,where μconv is the step size and xi′n=xi′n,xi′n−1,…,xi′n−L+1 is the filtered signal vector.


### 2.2.2. Feedback ANC Method

The feedback-based ANC model is shown in Figure3. By only using the error sensor to measure the residual noise signal en, the adaptive feedback ANC algorithm synthesizes the reference signal xn as(14)xn≡d^n=en+∑m=0M−1s^myn−m,where s^mm=0,1,…,M−1 is the coefficients of the filter S^z. Thus, we have(15)vn=∑m=0M−1s^myn−m.Figure 3
Narrowband feedback ANC model.The antinoise signalyn is generated as(16)yn=∑l=0l−1wlnxn−l,where wlnl=0,1,…,L−1 is the coefficients of Wz at time n and L is the filter length of Wz. The FXLMS algorithm updates the weights of adaptive FIR filter and is given by(17)wln+1=wln+μd^′n−len,where μ is the step size. The filtered reference signal is defined as(18)d^′n≡∑m=0M−1s^md^n−m.


### 2.2.3. Adaptive Neural Controller

Based on the feedback ANC system, the adaptive neural network approach including input layer, hidden layer, and output layer was presented in [35]. Two adaptive algorithms determine the weights for the hidden and the output layers. Figure 4 shows the structure suggested in [35].Figure 4
Structure of previous controller in [35].fn is the output signal of the hidden layer with the activation function Tanh (), and yn represents the output of the output layer, indicating the antinoise signal. The signal en denotes the error signal.


## 2.2.1. Narrowband Feedforward ANC Method

Figure2 displays the parallel form NANC model. This is the typical model for the conventional narrowband feedforward ANC (CNFANC) method. Pz is the primary path, and dn is the primary noise comprising k harmonics and is assumed to be(5)dn=∑i=1kdin,where din is the undesired narrowband noise with frequency ωi. The reference input at the ith channel of the NANC system is a sinusoidal signal(6)xin=cosωin,with the angular frequency ωi. The reference input signal is usually produced from the information provided by the synchronization signal from a nonacoustic sensor to the noise source. The output signal of adaptive filter at the ith channel is(7)yin=∑l=0L−1winxin−l=wiTnxiwn,where xiwn=xin,xin−1,…,xin−L+1T, win=wi,0n,wi,1n,…,wi,L−1nT, and L is the filter length of Wiz. The antinoise signal yn is the sum of each channel, and we have(8)yn=∑i=1kyin,and the error signal(9)en=dn−y′n.Figure 2
Conventional parallel form NANC model.The filtered signal is(10)xi′n=∑m=0M−1s^nxi′n−m=s^Tnxi′sn,where s^n=s^0n,s^1n,…,s^M−1nT is the vector coefficient of the estimated secondary path S^z and xi′sn=xin,xin−1,…,xin−M+1T. By setting the cost function as(11)ξn=Ee2n,we can obtain the estimated gradient(12)∇ξn=∂ξn∂win=−2enxi′n.The FXLMS algorithm for updating the weights is(13)win+1=win−μconv∇ξn2,=win+μconvenxi′n,where μconv is the step size and xi′n=xi′n,xi′n−1,…,xi′n−L+1 is the filtered signal vector.


## 2.2.2. Feedback ANC Method

The feedback-based ANC model is shown in Figure3. By only using the error sensor to measure the residual noise signal en, the adaptive feedback ANC algorithm synthesizes the reference signal xn as(14)xn≡d^n=en+∑m=0M−1s^myn−m,where s^mm=0,1,…,M−1 is the coefficients of the filter S^z. Thus, we have(15)vn=∑m=0M−1s^myn−m.Figure 3
Narrowband feedback ANC model.The antinoise signalyn is generated as(16)yn=∑l=0l−1wlnxn−l,where wlnl=0,1,…,L−1 is the coefficients of Wz at time n and L is the filter length of Wz. The FXLMS algorithm updates the weights of adaptive FIR filter and is given by(17)wln+1=wln+μd^′n−len,where μ is the step size. The filtered reference signal is defined as(18)d^′n≡∑m=0M−1s^md^n−m.


## 2.2.3. Adaptive Neural Controller

Based on the feedback ANC system, the adaptive neural network approach including input layer, hidden layer, and output layer was presented in [35]. Two adaptive algorithms determine the weights for the hidden and the output layers. Figure 4 shows the structure suggested in [35].Figure 4
Structure of previous controller in [35].fn is the output signal of the hidden layer with the activation function Tanh (), and yn represents the output of the output layer, indicating the antinoise signal. The signal en denotes the error signal.


## 3. The Proposed Method and Mathematical Analysis

This section analyzes the NAFNC algorithm and considers its convergence and stability properties.


### 3.1. Algorithm of the Proposed Method

Firstly, using the parallel NANC structure, the proposed method is presented in Figure5. The primary noise dn comprises k harmonics, and xin is the ith reference sinusoidal signal.Figure 5
The proposed method.The error signal is given by the equation:(19)en=dn−y′n,where y′n=sn∗yn, with “ ∗ ” denoting linear convolution operation and sn being the impulse response of Sz. yn is the sum of the antinoise signal of the NAFNC:(20)yn=∑i=1kyin.Figure6 displays the structure of the proposed NAFNC. Here, a three-layer perceptron feedback neural network is constructed, and the FXLMS algorithm is used to update the adaptive weights w1in and w2in. Layer 1 is the input layer that directly receives the input signal and transmits the signal to the hidden layer. Layer 2 is the hidden layer whose output signal has the sigmoid activation function. The feedback component is connected from the output of layer 2 to its input through weights w1in and the adjustment parameter α. Layer 3 is the output layer. The algorithm of the NAFNC is as follows:Figure 6
Structure of the presented NAFNC.Layer 1:(21)layeri1n=xin,i=1,2,3,…,k.Layer 2:(22)layeri2n=giqin,(23)withqin=∑l=0L−1w1inxin−l+αw1ingin−l−1+B.And the activation function at theith channel is defined as(24)gin=sigmoidqin=11+e−qin,where B is the bias parameter and α is the adjustment parameter that adjusts the feedback signal of the hidden layer so that the system achieves a balanced output signal. The cost function is determined as ξn=Ee2n. The gradient estimation of layer 2 at time n is(25)∇ξ1in=∂ξ1i∂w1i=−2en∑m=0M−1smxin−mw2ingin−m1−gin−m,where w2in is the weight of layer 3 and w1in is the weight of layer 2 updated by the FXLMS algorithm:(26)w1in+1=w1in−μ1_prop2∇ξ1in,(27)withxi′n=∑m=0M−1s^mnxin−m,where s^mn,m=0,…,M−1, are the coefficients of S^z.Substituting equation (25) and equation (27) into equation (26) yields(28)w1in+1=w1in+μ1_propxi′nenw2ingin1−gin,where xi′n=xin,xin−1,…,xin−L+1T is the filtered signal vector; w1in≡w1i,0nw1i,1nw1i,2n,…,w1i,L−1nT is the weight vector of layer 2; en is the error signal; μ1_prop is the learning rate parameter or the step size of layer 2.The output of layer 3 is(29)layeri3n=yin=∑l=0L−1w2ingin−l=w2iTngiwn,where w2in≡w2i,0n,w2i,1n,w2i,2n,…,w2i,L−1nT is the weight vector of W2iz and the filtered signal vector giwn=gin,gin−1,…,gin−L+1T.Withg^in=∑m=0M−1s^mngin−m=s^Tngisn, s^n=s^0n,s^1n,…,s^M−1nT is the filtered vector and gisn=gin,gin−1,…,gin−M+1T. Similarly, the estimated gradient to tune the weight vector of layer 3 at time n is(30)∇ξ2in=∂ξ2i∂w2i=−2eng^in.Therefore, we have(31)w2in+1=w2in−μ2_prop2∇ξ2in=w2in+μ2_propeng^in,where μ2_prop is the step size, g^in=gin,gin−1,…,gin−L+1T is the filtered signal vector i=1,2,3,…,k, and en is the error signal at time n.Comparing Figures6 and 4 indicates that the proposed method uses a feedback component that is combined with adaptive weights w1in through the adjustment parameter α and the bias parameter B. Based on the FXLMS algorithm, two adaptive algorithms tune the weight vectors of the hidden and the output layers, which helps the presented system achieve rapid convergence without any prior training of neural networks. Both the adjustment parameter α and bias parameter B are determined experimentally to achieve convergence and stability of the system.


### 3.2. Convergence and Stability of the Proposed Method

The NAFNC is designed with two FXLMS algorithms for rapid and stable convergence. The weight vectorsw1in and w2in are updated online to minimize the error signal. In order to verify the convergence and stability of the proposed work, the Lyapunov function is chosen as(32)Cn=12e2n=12dn−y′n2.Therefore,ΔCn can be calculated as follows:(33)ΔCn=Cn+1−Cn=e2n+1−e2n2=en+en+1en+1−en2=ΔenΔen+2en2,where Δen is used to update the weights w2in of the output layer computed as(34)Δen=en+1−en=∂e∂w2iΔw2in=∂en∂y′n∑m=0M−1∂y′n∂yin−m∂yin−m∂w2inΔw2in=−∑m=0M−1smngin−mμ2_propen∑m=0M−1smngin−m=−μ2_propen∑m=0M−1smngin−m2.Substituting equation (34) into equation (33) yields(35)ΔCn=−12μ2_propen∑m=0M−1smngin−m2×2en−μ2_propen∑m=0M−1smngin−m2=−12μ2_prope2n∑m=0M−1smngin−m2×2−μ2_prop∑m=0M−1smngin−m2.From equation (35), it is obvious that if the learning rate μ2_prop is chosen to satisfy(36)0<μ2_prop<2∑m=0M−1smngin−m2,then the stability of the system is ensured. The proof to derive the boundary of μ1_prop is the same as equations (35) and (36); therefore, the weight w1in converges by setting μ1_prop as(37)0<μ1_prop<2∑m=0M−1smxin−mw2ingin−m1−gin−m2.Equations (36) and (37) specify convergence and stability conditions of NAFNC, depending on step sizes μ1_prop and μ2_prop. If the step sizes μ1_prop and μ2_prop are large, then the convergence speed will be large accordingly. But if the step size μprop violates the boundary condition, then the system will become unstable. Therefore, the appropriate value of the step sizes μ1_prop and μ2_prop must be chosen experimentally to ensure good performance.


## 3.1. Algorithm of the Proposed Method

Firstly, using the parallel NANC structure, the proposed method is presented in Figure5. The primary noise dn comprises k harmonics, and xin is the ith reference sinusoidal signal.Figure 5
The proposed method.The error signal is given by the equation:(19)en=dn−y′n,where y′n=sn∗yn, with “ ∗ ” denoting linear convolution operation and sn being the impulse response of Sz. yn is the sum of the antinoise signal of the NAFNC:(20)yn=∑i=1kyin.Figure6 displays the structure of the proposed NAFNC. Here, a three-layer perceptron feedback neural network is constructed, and the FXLMS algorithm is used to update the adaptive weights w1in and w2in. Layer 1 is the input layer that directly receives the input signal and transmits the signal to the hidden layer. Layer 2 is the hidden layer whose output signal has the sigmoid activation function. The feedback component is connected from the output of layer 2 to its input through weights w1in and the adjustment parameter α. Layer 3 is the output layer. The algorithm of the NAFNC is as follows:Figure 6
Structure of the presented NAFNC.Layer 1:(21)layeri1n=xin,i=1,2,3,…,k.Layer 2:(22)layeri2n=giqin,(23)withqin=∑l=0L−1w1inxin−l+αw1ingin−l−1+B.And the activation function at theith channel is defined as(24)gin=sigmoidqin=11+e−qin,where B is the bias parameter and α is the adjustment parameter that adjusts the feedback signal of the hidden layer so that the system achieves a balanced output signal. The cost function is determined as ξn=Ee2n. The gradient estimation of layer 2 at time n is(25)∇ξ1in=∂ξ1i∂w1i=−2en∑m=0M−1smxin−mw2ingin−m1−gin−m,where w2in is the weight of layer 3 and w1in is the weight of layer 2 updated by the FXLMS algorithm:(26)w1in+1=w1in−μ1_prop2∇ξ1in,(27)withxi′n=∑m=0M−1s^mnxin−m,where s^mn,m=0,…,M−1, are the coefficients of S^z.Substituting equation (25) and equation (27) into equation (26) yields(28)w1in+1=w1in+μ1_propxi′nenw2ingin1−gin,where xi′n=xin,xin−1,…,xin−L+1T is the filtered signal vector; w1in≡w1i,0nw1i,1nw1i,2n,…,w1i,L−1nT is the weight vector of layer 2; en is the error signal; μ1_prop is the learning rate parameter or the step size of layer 2.The output of layer 3 is(29)layeri3n=yin=∑l=0L−1w2ingin−l=w2iTngiwn,where w2in≡w2i,0n,w2i,1n,w2i,2n,…,w2i,L−1nT is the weight vector of W2iz and the filtered signal vector giwn=gin,gin−1,…,gin−L+1T.Withg^in=∑m=0M−1s^mngin−m=s^Tngisn, s^n=s^0n,s^1n,…,s^M−1nT is the filtered vector and gisn=gin,gin−1,…,gin−M+1T. Similarly, the estimated gradient to tune the weight vector of layer 3 at time n is(30)∇ξ2in=∂ξ2i∂w2i=−2eng^in.Therefore, we have(31)w2in+1=w2in−μ2_prop2∇ξ2in=w2in+μ2_propeng^in,where μ2_prop is the step size, g^in=gin,gin−1,…,gin−L+1T is the filtered signal vector i=1,2,3,…,k, and en is the error signal at time n.Comparing Figures6 and 4 indicates that the proposed method uses a feedback component that is combined with adaptive weights w1in through the adjustment parameter α and the bias parameter B. Based on the FXLMS algorithm, two adaptive algorithms tune the weight vectors of the hidden and the output layers, which helps the presented system achieve rapid convergence without any prior training of neural networks. Both the adjustment parameter α and bias parameter B are determined experimentally to achieve convergence and stability of the system.


## 3.2. Convergence and Stability of the Proposed Method

The NAFNC is designed with two FXLMS algorithms for rapid and stable convergence. The weight vectorsw1in and w2in are updated online to minimize the error signal. In order to verify the convergence and stability of the proposed work, the Lyapunov function is chosen as(32)Cn=12e2n=12dn−y′n2.Therefore,ΔCn can be calculated as follows:(33)ΔCn=Cn+1−Cn=e2n+1−e2n2=en+en+1en+1−en2=ΔenΔen+2en2,where Δen is used to update the weights w2in of the output layer computed as(34)Δen=en+1−en=∂e∂w2iΔw2in=∂en∂y′n∑m=0M−1∂y′n∂yin−m∂yin−m∂w2inΔw2in=−∑m=0M−1smngin−mμ2_propen∑m=0M−1smngin−m=−μ2_propen∑m=0M−1smngin−m2.Substituting equation (34) into equation (33) yields(35)ΔCn=−12μ2_propen∑m=0M−1smngin−m2×2en−μ2_propen∑m=0M−1smngin−m2=−12μ2_prope2n∑m=0M−1smngin−m2×2−μ2_prop∑m=0M−1smngin−m2.From equation (35), it is obvious that if the learning rate μ2_prop is chosen to satisfy(36)0<μ2_prop<2∑m=0M−1smngin−m2,then the stability of the system is ensured. The proof to derive the boundary of μ1_prop is the same as equations (35) and (36); therefore, the weight w1in converges by setting μ1_prop as(37)0<μ1_prop<2∑m=0M−1smxin−mw2ingin−m1−gin−m2.Equations (36) and (37) specify convergence and stability conditions of NAFNC, depending on step sizes μ1_prop and μ2_prop. If the step sizes μ1_prop and μ2_prop are large, then the convergence speed will be large accordingly. But if the step size μprop violates the boundary condition, then the system will become unstable. Therefore, the appropriate value of the step sizes μ1_prop and μ2_prop must be chosen experimentally to ensure good performance.


## 4. Simulation Results

Simulations are used to compare the performance of the proposed work with the previously presented method in [35]. Thereby, the superiority of the proposed method will be discussed. The sampling frequency is 4kHz for the initial setting of the general system parameter.


### 4.1. Case 1

The primary pathPz and the secondary path Sz of the ANC system in case 1 are estimated from [2] with the length 256, and S^z is set the same as Sz. The noise source is the synthesis of the narrowband noise, considering only the three components (i=1,2,3) with amplitude 1 at 100Hz, 200Hz, and 300Hz and being combined with a white noise signal with amplitude of 0.0049. The length of the adaptive FIR filter of the CNFANC method is 150. The order of the adaptive filter of the hidden layer and the output layer of the previous method in [35] and of the proposed method is 150. Regarding these parameters for case 1, the step size of the CNFANC method is μconv=0.8x10−4 and of the proposed method is μ1_prop=0.2 and μ2_prop=2.1x10−3. The bias parameter is B=0.01 and the adjustment parameter is α=0.041. The experiment of case 1 is performed to adjust the parameters by trial and error method to assure the system convergence and stability. The parameters for [35] include the step size of the hidden layer μ1_prev being 0.2 and the step size of the output layer μ2_prev being 1.1×10−4. Figure 7 plots the error signals in the frequency domain, including the CNFANC method (blue), the previous method in [35] (green), the proposed method (red), and the noise signal dn(gold). The CNFANC method and the proposed method thoroughly eliminate the noise with all frequencies, whereas the previous method in [35] eliminates the noise at only 200Hz and 300Hz. Figure 8 plots the learning curve. Obviously, all three methods perform equally in terms of the noise reduction performance. However, the convergence speed of the proposed method and the CNFANC method is better than the existing method in [35].Figure 7
Error and noise signals in frequency domain, showing the error signals in the CNFANC method (blue), the previous method in [35] (green), and the proposed method (red), as well as the noise signal dn (gold).Figure 8
Learning curve of MSE for the CNFANC method (blue), the previous method in [35] (green), and the proposed method (red).


### 4.2. Case 2

In case 2, the secondary path remains as in case 1, but the nonlinear primary path is considered [35].(38)dn=xn−3−0.3xn−4+0.2xn−5+0.8x2n−5,where xn contained sinusoidal signal components at 100Hz, 200Hz, and 300Hz with amplitude 1 and was combined with the white noise signal with amplitude of 0.0049. The order of adaptive filter in the CNFANC method, the previously presented method in [35], and the proposed method is selected the same as case 1. The step size for the CNFANC method is μconv=0.06×10−5. The parameters μ1_prop=0.5 and μ2_prop=3.4×10−4, the bias parameter B=0.021, and the adjustment parameter α=0.2 were used for the proposed work. The step sizes for [35] are μ1_prev=0.21 and μ2_prev=6.4×10−5. Figure 9 shows the noise and error signals in time domain. The proposed method is most efficient in reducing the noise. Figure 10 plots the learning curve. The proposed method is effective in reducing narrowband noise but the other methods failed to reduce the noise efficiently.Figure 9
Noise and error signals in time domain, error signals in the CNFANC method (blue), the previous method in [35] (green), and the proposed method (red), as well as the noise signal dn (gold).Figure 10
Learning curve of MSE for the CNFANC method (blue), the previous method in [35] (green), and the proposed method (red).


### 4.3. Case 3

Case 3 considers the ANC system involving both nonlinear primary and secondary paths. The frequencies of the undesired narrowband noises are changed abruptly to see the responsiveness of the proposed method too. The nonlinear primary path has been modelled as a cascade of a linear filter and a nonlinear one. The former is defined astn=xn−2−0.9xn−3+0.01xn−5, and the latter is selected based on a third-order polynomial model [40–42]: dn=tn−2+0.08tn−22+0.04tn−23, and the nonlinear secondary path is given by a Volterra series [43] y′n=yn+0.35yn−1+0.09yn−2−0.5ynyn−1+0.4ynyn−2, according to Figure 5. The frequencies of the three narrowband components i=1,2,3 are 100Hz, 200Hz, and 400Hz at first and suddenly changed to 150Hz, 250Hz, and 300Hz at the 5th second. Each narrowband noise is with amplitude 1, combining with the white noise with amplitude 0.1. The order of adaptive filter in the CNFANC method, the previous method in [35], and the proposed method is increased to 200. The step size for the CNFANC method is μconv=0.02×10−4 and the parameters are μ1_prop=0.8, μ2_prop=4×10−4, B=0.1×10−2, and α=0.1×10−3 for the proposed method. The step sizes for [35] are μ1_prev=0.8 and μ2_prev=0.1×10−2. Figure 11 presents the error signals in time domain. The convergence rate of the proposed method obviously outperforms those of the other schemes. Although frequencies change abruptly at the 5th second, the proposed method is still stable and converges quickly. Figure 12 plots the learning curves. The results show that the proposed method is still good at reducing the noise in nonlinear system.Figure 11
Noise and error signals in time domain, error signals obtained using the CNFANC method (blue), the previous method in [35] (green), and the proposed method (red), as well as the noise signal dn (gold).Figure 12
Learning curves of the MSE for the CNFANC method (blue), the previous method in [35] (green), and the proposed method (red).These experiments confirm the noise reduction efficiency of the proposed method. The proposed method is effective not only for linear ANC systems but also for nonlinear ANC systems. In contrast, the CNFANC method is effective only for linear ANC systems, as in case 1, but not for nonlinear ANC systems as in cases 2 and 3. Moreover, the proposed method offers improved convergence speed and performance owing to the use of the adjustment parameterα and bias parameter B in various ANC systems. The adjustment parameter α is effectively combined with the bias parameters B according to equation (23) so that the step sizes μ1_prop and μ2_prop can reach high values matching the boundary conditions from equations (36) and (37), making the proposed method converge quickly, as proven by the experimental results. However, adding a feedback component to the hidden layer increases the cost of calculation and could make the system unstable. Hence, the parameter α must be adjusted carefully to enable the ANC system achieving stable and quick convergence.


## 4.1. Case 1

The primary pathPz and the secondary path Sz of the ANC system in case 1 are estimated from [2] with the length 256, and S^z is set the same as Sz. The noise source is the synthesis of the narrowband noise, considering only the three components (i=1,2,3) with amplitude 1 at 100Hz, 200Hz, and 300Hz and being combined with a white noise signal with amplitude of 0.0049. The length of the adaptive FIR filter of the CNFANC method is 150. The order of the adaptive filter of the hidden layer and the output layer of the previous method in [35] and of the proposed method is 150. Regarding these parameters for case 1, the step size of the CNFANC method is μconv=0.8x10−4 and of the proposed method is μ1_prop=0.2 and μ2_prop=2.1x10−3. The bias parameter is B=0.01 and the adjustment parameter is α=0.041. The experiment of case 1 is performed to adjust the parameters by trial and error method to assure the system convergence and stability. The parameters for [35] include the step size of the hidden layer μ1_prev being 0.2 and the step size of the output layer μ2_prev being 1.1×10−4. Figure 7 plots the error signals in the frequency domain, including the CNFANC method (blue), the previous method in [35] (green), the proposed method (red), and the noise signal dn(gold). The CNFANC method and the proposed method thoroughly eliminate the noise with all frequencies, whereas the previous method in [35] eliminates the noise at only 200Hz and 300Hz. Figure 8 plots the learning curve. Obviously, all three methods perform equally in terms of the noise reduction performance. However, the convergence speed of the proposed method and the CNFANC method is better than the existing method in [35].Figure 7
Error and noise signals in frequency domain, showing the error signals in the CNFANC method (blue), the previous method in [35] (green), and the proposed method (red), as well as the noise signal dn (gold).Figure 8
Learning curve of MSE for the CNFANC method (blue), the previous method in [35] (green), and the proposed method (red).


## 4.2. Case 2

In case 2, the secondary path remains as in case 1, but the nonlinear primary path is considered [35].(38)dn=xn−3−0.3xn−4+0.2xn−5+0.8x2n−5,where xn contained sinusoidal signal components at 100Hz, 200Hz, and 300Hz with amplitude 1 and was combined with the white noise signal with amplitude of 0.0049. The order of adaptive filter in the CNFANC method, the previously presented method in [35], and the proposed method is selected the same as case 1. The step size for the CNFANC method is μconv=0.06×10−5. The parameters μ1_prop=0.5 and μ2_prop=3.4×10−4, the bias parameter B=0.021, and the adjustment parameter α=0.2 were used for the proposed work. The step sizes for [35] are μ1_prev=0.21 and μ2_prev=6.4×10−5. Figure 9 shows the noise and error signals in time domain. The proposed method is most efficient in reducing the noise. Figure 10 plots the learning curve. The proposed method is effective in reducing narrowband noise but the other methods failed to reduce the noise efficiently.Figure 9
Noise and error signals in time domain, error signals in the CNFANC method (blue), the previous method in [35] (green), and the proposed method (red), as well as the noise signal dn (gold).Figure 10
Learning curve of MSE for the CNFANC method (blue), the previous method in [35] (green), and the proposed method (red).


## 4.3. Case 3

Case 3 considers the ANC system involving both nonlinear primary and secondary paths. The frequencies of the undesired narrowband noises are changed abruptly to see the responsiveness of the proposed method too. The nonlinear primary path has been modelled as a cascade of a linear filter and a nonlinear one. The former is defined astn=xn−2−0.9xn−3+0.01xn−5, and the latter is selected based on a third-order polynomial model [40–42]: dn=tn−2+0.08tn−22+0.04tn−23, and the nonlinear secondary path is given by a Volterra series [43] y′n=yn+0.35yn−1+0.09yn−2−0.5ynyn−1+0.4ynyn−2, according to Figure 5. The frequencies of the three narrowband components i=1,2,3 are 100Hz, 200Hz, and 400Hz at first and suddenly changed to 150Hz, 250Hz, and 300Hz at the 5th second. Each narrowband noise is with amplitude 1, combining with the white noise with amplitude 0.1. The order of adaptive filter in the CNFANC method, the previous method in [35], and the proposed method is increased to 200. The step size for the CNFANC method is μconv=0.02×10−4 and the parameters are μ1_prop=0.8, μ2_prop=4×10−4, B=0.1×10−2, and α=0.1×10−3 for the proposed method. The step sizes for [35] are μ1_prev=0.8 and μ2_prev=0.1×10−2. Figure 11 presents the error signals in time domain. The convergence rate of the proposed method obviously outperforms those of the other schemes. Although frequencies change abruptly at the 5th second, the proposed method is still stable and converges quickly. Figure 12 plots the learning curves. The results show that the proposed method is still good at reducing the noise in nonlinear system.Figure 11
Noise and error signals in time domain, error signals obtained using the CNFANC method (blue), the previous method in [35] (green), and the proposed method (red), as well as the noise signal dn (gold).Figure 12
Learning curves of the MSE for the CNFANC method (blue), the previous method in [35] (green), and the proposed method (red).These experiments confirm the noise reduction efficiency of the proposed method. The proposed method is effective not only for linear ANC systems but also for nonlinear ANC systems. In contrast, the CNFANC method is effective only for linear ANC systems, as in case 1, but not for nonlinear ANC systems as in cases 2 and 3. Moreover, the proposed method offers improved convergence speed and performance owing to the use of the adjustment parameterα and bias parameter B in various ANC systems. The adjustment parameter α is effectively combined with the bias parameters B according to equation (23) so that the step sizes μ1_prop and μ2_prop can reach high values matching the boundary conditions from equations (36) and (37), making the proposed method converge quickly, as proven by the experimental results. However, adding a feedback component to the hidden layer increases the cost of calculation and could make the system unstable. Hence, the parameter α must be adjusted carefully to enable the ANC system achieving stable and quick convergence.


## 5. Conclusions

This paper analyzed the NAFNC algorithm and considered its stability and convergence. Simulation results confirmed the superiority of the proposed method based on three simulations. Although the proposed method costed computation, it performed well for both linear and nonlinear conditions. In addition, the advantages of the proposed method included the fast and stable convergence. The addition of the feedback element in the hidden layer in the proposed method improved the system performance.



---

*Source: 5555054-2021-05-30.xml*