# Detection Method of Three-Dimensional Echocardiography Based on Deep Learning

Authors: Qiao Wu; Li Gao; Wei Sun; Jianzhong Yang
Journal: Wireless Communications and Mobile Computing
 (2020)

---

## Abstract

In order to improve the detection and recognition ability of 3D echocardiography, a method of 3D echocardiography detection based on depth learning is proposed. The information conduction model of three-dimensional echocardiography is constructed. The edge pixel feature matching method is used to extract the key information of echocardiography, and the information compensation method is used to repair the missing area of three-dimensional echocardiography information. The feature decomposition and information fusion of 3D ultrasonic imaging are carried out by using five stage wavelet decomposition method, and the feature reconstruction and adaptive template matching of 3D echocardiography are processed by depth learning algorithm, modeling and detecting the rationality of three-dimensional echocardiography. The simulation results show that this method has better detection performance; the accuracy of detection and recognition is high, which is more reasonable in the application of 3D echocardiography repair and detection recognition.


---

## Body

## 1. Introduction

With the development of ultrasound technology and the advent of real-time three-dimensional echocardiography, the defects of two-dimensional echocardiography and static and dynamic three-dimensional echocardiography are overcame, and the operation is simple and the imaging is fast. By collecting the actual ventricular data, it can accurately measure the actual volume of the heart and calculate the cardiac function parameters. It is reported that RT3DE can be used in in vitro models and animal experiments to measure ventricular volume and has a significant correlation with magnetic resonance imaging (MRI) [1], so it has been widely used in clinic. At the same time, CT imaging technology is also developing continuously. MSCT imaging technology can reconstruct the scanned data, calculate the ventricular volume size according to the diastolic and systolic images, and calculate the cardiac function parameters according to the relevant data [2].Traditionally, the parameters of left ventricular function are analyzed by multislice spiral CT and real-time three-dimensional echocardiography. It is found that both of the two methods could accurately measure the parameters of cardiac function, and the parameters of LVEF and LVMM are compared between the two groups. The difference is not statistically significant (P>0.05). It is believed that multislice spiral CT is accurate and reliable in evaluating left ventricular function and is highly correlated with echocardiography [3]. The parameters of left ventricular function are measured by real-time three-dimensional echocardiography and multislice spiral CT scanning. Multislice spiral CT and real-time three-dimensional echocardiography can accurately evaluate left ventricular function, but multislice spiral CT can be used to examine coronary angiography and understand the lesions of coronary artery and vein. Therefore, it is necessary to study an effective three-dimensional echocardiographic detection method and apply it to clinical practice, combined with multislice spiral CT to examine the coronary artery, and to understand the coronary artery at the same time, so as to evaluate the value of multislice spiral CT (MSCT) and real-time three-dimensional echocardiography (RT3DE) in measuring left ventricular function [4–6].In this paper, a three-dimensional echocardiographic detection method based on depth learning is proposed. The information conduction model of three-dimensional echocardiography is constructed. The edge pixel feature matching method is used to extract the key information of echocardiography, and the information compensation method is used to repair the missing area of three-dimensional echocardiography information. The feature decomposition and information fusion of 3D ultrasonic imaging are carried out by using the 5-stage wavelet decomposition method, and the feature reconstruction and adaptive template matching of 3D echocardiography are processed by depth learning algorithm, modeling and detecting the rationality of three-dimensional echocardiography.


## 2. Information Conduction Model and Image Preprocessing in Three-Dimensional Echocardiography

### 2.1. Three-Dimensional Echocardiographic Information Conduction Model

By constructing the information conduction model of three-dimensional echocardiography, the information collection and feature extraction of three-dimensional echocardiography are carried out. In the collection of three-dimensional echocardiography, it is necessary to use ultrasound beam scanning three-dimensional echocardiography. The reflected ultrasonic wave is reflected to the output port of the ultrasonic wave, and the pixel features are arranged in different order and the three-dimensional ultrasonic imaging is obtained [7]. In the information reconstruction of three-dimensional echocardiography, the size of the modeling feature region is 16∗16. The three-dimensional echocardiography of each M∗N is divided into M/16+1∗N/16+1 rectangular blocks, as shown in Figure 1.Figure 1
Three-dimensional echocardiographic rectangular segments.The most similar matching block is selected to reconstruct the 3D feature of the image to be repaired, and the information conduction pixel set of the interior of each subblock is obtained. By using the similarity between the dark primary color blocks and the blocks to be repaired in three-dimensional echocardiography, the points on the boundary are determined, and the priority characteristics of information conduction are matched. Gradient smoothing is needed for the relative elements of adjacent blocks in three-dimensional ultrasound imaging. The affine invariant moment feature extraction is carried out with the affine invariant kernel function of3∗3. The affine invariant moment has the rotation translation and the scale invariance [8]. Therefore, the feature mining can be carried out through the template matching of the image, and the image processing template can be determined by the template size. The texture structure information of three-dimensional echocardiography is Gx,y;t, and the intuitionistic fuzzy set of texture subspace of three-dimensional echocardiography is defined as conduction function:
(1)px,t=limΔx→0σu−u+ΔuΔx=−σ∂ux,t∂x.Assume that the edge information of the three-dimensional echocardiography along the gradient direction is shown as follows:(2)Gxx,y;t=∂ux,y;t∂x.The traversal characteristics of the sharp changes of image features in the scene are obtained, and the information flow density vector of 3D echocardiographic texture structure is obtained as follows:(3)px,y;t=−σ∇ux,y;t=−σGx,y;t=−σGxx,y;ti+Gyx,y;tj,Here,i,j are unit direction vectors, based on the visual significance of a target in the detection recognition process, a three-dimensional echocardiography structure texture information conduction model is constructed, the rare degree in the whole scene is obtained [9], and the global rare degree of the three-dimensional echocardiography is obtained by adopting zero uniform traversal. Based on the analysis, the state equation of the three-dimensional echocardiography texture information conduction model is described as follows:
(4)fx1,x2=r1x11−x1N1−σ1x2N2=0,gx1,x2=r2x21−σ2x1N1−x2N2=0.Here,r1 and r2 are the local and global salient feature sets, and σ1 represents the mean value of the image features. Based on the above 3D echocardiographic information conduction model, a 3D echocardiographic information conduction model is constructed. The information collection and feature analysis of three-dimensional echocardiography are realized, which provides an accurate data basis for three-dimensional echocardiography modeling [10].


### 2.2. Priority Determination of Three-Dimensional Echocardiography Reconstruction

In the information conduction model, edge pixel feature matching method and 3D echocardiography are used to determine the priority of information missing region repair. The subspace structure model of three-dimensional echocardiography is designed to calculate the priority coefficient of the block to be reconstructed and update the edge pixel of the three-dimensional echocardiography [11]. The multidimensional search method of subspace feature information is adopted. The information points of three-dimensional echocardiography are searched by gray scale until there are no edge pixels. The mean value of feature is used as pheromone in subspace structure block, and the global rare degree feature of three-dimensional ultrasonic imaging is decomposed. The iterative equation of characteristic decomposition is described as follows:
(5)un+1x,y=unx,y+δu1nx,y,(6)u1nx,y=MΔsunx,y+NΔtunx,y;d.The size of the 3D echocardiography to be reconstructed is assumed to bem×n, and the size of the characteristic scale block Ψp is s×s. By means of edge pixel feature matching, the depth learning algorithm is used to determine the priority of unknown pixel points in 3D echocardiography. The priority sort of pixels meets
(7)PxT¯−K<λχσN≈22π∫0λχe−1/2t2dt=1−χ.Here,xT¯ is the mean value of the local contrast window of the 3D echocardiography, χ is the significance weight, and H is the global rare degree coefficient.


## 2.1. Three-Dimensional Echocardiographic Information Conduction Model

By constructing the information conduction model of three-dimensional echocardiography, the information collection and feature extraction of three-dimensional echocardiography are carried out. In the collection of three-dimensional echocardiography, it is necessary to use ultrasound beam scanning three-dimensional echocardiography. The reflected ultrasonic wave is reflected to the output port of the ultrasonic wave, and the pixel features are arranged in different order and the three-dimensional ultrasonic imaging is obtained [7]. In the information reconstruction of three-dimensional echocardiography, the size of the modeling feature region is 16∗16. The three-dimensional echocardiography of each M∗N is divided into M/16+1∗N/16+1 rectangular blocks, as shown in Figure 1.Figure 1
Three-dimensional echocardiographic rectangular segments.The most similar matching block is selected to reconstruct the 3D feature of the image to be repaired, and the information conduction pixel set of the interior of each subblock is obtained. By using the similarity between the dark primary color blocks and the blocks to be repaired in three-dimensional echocardiography, the points on the boundary are determined, and the priority characteristics of information conduction are matched. Gradient smoothing is needed for the relative elements of adjacent blocks in three-dimensional ultrasound imaging. The affine invariant moment feature extraction is carried out with the affine invariant kernel function of3∗3. The affine invariant moment has the rotation translation and the scale invariance [8]. Therefore, the feature mining can be carried out through the template matching of the image, and the image processing template can be determined by the template size. The texture structure information of three-dimensional echocardiography is Gx,y;t, and the intuitionistic fuzzy set of texture subspace of three-dimensional echocardiography is defined as conduction function:
(1)px,t=limΔx→0σu−u+ΔuΔx=−σ∂ux,t∂x.Assume that the edge information of the three-dimensional echocardiography along the gradient direction is shown as follows:(2)Gxx,y;t=∂ux,y;t∂x.The traversal characteristics of the sharp changes of image features in the scene are obtained, and the information flow density vector of 3D echocardiographic texture structure is obtained as follows:(3)px,y;t=−σ∇ux,y;t=−σGx,y;t=−σGxx,y;ti+Gyx,y;tj,Here,i,j are unit direction vectors, based on the visual significance of a target in the detection recognition process, a three-dimensional echocardiography structure texture information conduction model is constructed, the rare degree in the whole scene is obtained [9], and the global rare degree of the three-dimensional echocardiography is obtained by adopting zero uniform traversal. Based on the analysis, the state equation of the three-dimensional echocardiography texture information conduction model is described as follows:
(4)fx1,x2=r1x11−x1N1−σ1x2N2=0,gx1,x2=r2x21−σ2x1N1−x2N2=0.Here,r1 and r2 are the local and global salient feature sets, and σ1 represents the mean value of the image features. Based on the above 3D echocardiographic information conduction model, a 3D echocardiographic information conduction model is constructed. The information collection and feature analysis of three-dimensional echocardiography are realized, which provides an accurate data basis for three-dimensional echocardiography modeling [10].


## 2.2. Priority Determination of Three-Dimensional Echocardiography Reconstruction

In the information conduction model, edge pixel feature matching method and 3D echocardiography are used to determine the priority of information missing region repair. The subspace structure model of three-dimensional echocardiography is designed to calculate the priority coefficient of the block to be reconstructed and update the edge pixel of the three-dimensional echocardiography [11]. The multidimensional search method of subspace feature information is adopted. The information points of three-dimensional echocardiography are searched by gray scale until there are no edge pixels. The mean value of feature is used as pheromone in subspace structure block, and the global rare degree feature of three-dimensional ultrasonic imaging is decomposed. The iterative equation of characteristic decomposition is described as follows:
(5)un+1x,y=unx,y+δu1nx,y,(6)u1nx,y=MΔsunx,y+NΔtunx,y;d.The size of the 3D echocardiography to be reconstructed is assumed to bem×n, and the size of the characteristic scale block Ψp is s×s. By means of edge pixel feature matching, the depth learning algorithm is used to determine the priority of unknown pixel points in 3D echocardiography. The priority sort of pixels meets
(7)PxT¯−K<λχσN≈22π∫0λχe−1/2t2dt=1−χ.Here,xT¯ is the mean value of the local contrast window of the 3D echocardiography, χ is the significance weight, and H is the global rare degree coefficient.


## 3. Three-Dimensional Echocardiography Detection Algorithm

### 3.1. Characteristic Decomposition and Information Fusion of Three-Dimensional Echocardiography

On the basis of constructing the information conduction model and determining the priority of the reconstruction of three-dimensional echocardiography, the reasonable modeling design of three-dimensional echocardiography is carried out. In this paper, a three-dimensional echocardiographic rationality modeling method based on depth learning is proposed [12]. The characteristic decomposition and information fusion of 3D ultrasonic imaging are carried out by using the 5-stage wavelet decomposition method. The structure similar features of 3D echocardiographic detection and recognition image are obtained by the 5-stage wavelet decomposition of 3D echocardiography:
(8)wsX,Y=2∑i=1Ncx,icy,i+K∑i=1Ncx,i2+∑i=1Ncy,i2+K.The results of feature decomposition and information fusion are expressed as follows:(9)lX,Y=2uxuy+C1ux2+uy2+C1,(10)cX,Y=2σxσy+C2σx2+σy2+C2,(11)sX,Y=σxy+C3σxσy+C3.Here,σxyis the edge information covariance and C1, C2, and C3 are the global rarity constants. The feature reconstruction and adaptive template matching of 3D echocardiography are processed by depth learning algorithm [13].


### 3.2. 3D Echocardiography Reconstruction and Detection Recognition

On the basis of the characteristic decomposition and information fusion of three-dimensional ultrasound imaging using the five-stage wavelet decomposition method, the depth learning is carried out to realize the rational modeling of three-dimensional echocardiography, and the depth learning algorithm is adopted [14]. The parameters of WSSIM are calculated for the wavelet structure similarity of two or 3D echocardiography:
(12)WSSIM=lX,YαcX,YβwsX,Yγ.After the multiscale decomposition of the global rarity, the two-directional subband energies in the information conduction model of the detection and recognition imaging are obtained as follows:(13)EHLi=∑jcjHLi2,ELHi=∑jcjLHi2.By using the depth learning algorithm, the three-dimensional echocardiography is firstly convolution with the Gauss kernel function of different scales [15], and the reconstruction output of the three-dimensional echocardiography is obtained as follows [16, 17]:
(14)ωHLi=EHLiEHLi+ELHi+EHHi,(15)ωLHi=ELHiEHLi+ELHi+EHHi,(16)ωHHi=EHHiEHLi+ELHi+EHHi.The probability of each pixel variance in the whole image is calculated. The depth learning algorithm is used to measure the salience of the feature points of three-dimensional echocardiography [18, 19]. The structural similarity features of the image are calculated in the high frequency subband of wavelet [20]:
(17)WSSIMHi=ωHLi⋅WSSIMHLi+ωLHi⋅WSSIMLHi+ωHHi⋅WSSIMHHi.The wavelet structure similarity of three-dimensional echocardiography is calculated, which is described as FWSSIMI:(18)FWSSIMX,Y=ωLL⋅WSSIMLL+∑i=15ωHi⋅WSSIMHiωLL+∑i=15ωHi.On the basis of above processing, the 3D echocardiographic modeling and detection recognition are realized [21].


## 3.1. Characteristic Decomposition and Information Fusion of Three-Dimensional Echocardiography

On the basis of constructing the information conduction model and determining the priority of the reconstruction of three-dimensional echocardiography, the reasonable modeling design of three-dimensional echocardiography is carried out. In this paper, a three-dimensional echocardiographic rationality modeling method based on depth learning is proposed [12]. The characteristic decomposition and information fusion of 3D ultrasonic imaging are carried out by using the 5-stage wavelet decomposition method. The structure similar features of 3D echocardiographic detection and recognition image are obtained by the 5-stage wavelet decomposition of 3D echocardiography:
(8)wsX,Y=2∑i=1Ncx,icy,i+K∑i=1Ncx,i2+∑i=1Ncy,i2+K.The results of feature decomposition and information fusion are expressed as follows:(9)lX,Y=2uxuy+C1ux2+uy2+C1,(10)cX,Y=2σxσy+C2σx2+σy2+C2,(11)sX,Y=σxy+C3σxσy+C3.Here,σxyis the edge information covariance and C1, C2, and C3 are the global rarity constants. The feature reconstruction and adaptive template matching of 3D echocardiography are processed by depth learning algorithm [13].


## 3.2. 3D Echocardiography Reconstruction and Detection Recognition

On the basis of the characteristic decomposition and information fusion of three-dimensional ultrasound imaging using the five-stage wavelet decomposition method, the depth learning is carried out to realize the rational modeling of three-dimensional echocardiography, and the depth learning algorithm is adopted [14]. The parameters of WSSIM are calculated for the wavelet structure similarity of two or 3D echocardiography:
(12)WSSIM=lX,YαcX,YβwsX,Yγ.After the multiscale decomposition of the global rarity, the two-directional subband energies in the information conduction model of the detection and recognition imaging are obtained as follows:(13)EHLi=∑jcjHLi2,ELHi=∑jcjLHi2.By using the depth learning algorithm, the three-dimensional echocardiography is firstly convolution with the Gauss kernel function of different scales [15], and the reconstruction output of the three-dimensional echocardiography is obtained as follows [16, 17]:
(14)ωHLi=EHLiEHLi+ELHi+EHHi,(15)ωLHi=ELHiEHLi+ELHi+EHHi,(16)ωHHi=EHHiEHLi+ELHi+EHHi.The probability of each pixel variance in the whole image is calculated. The depth learning algorithm is used to measure the salience of the feature points of three-dimensional echocardiography [18, 19]. The structural similarity features of the image are calculated in the high frequency subband of wavelet [20]:
(17)WSSIMHi=ωHLi⋅WSSIMHLi+ωLHi⋅WSSIMLHi+ωHHi⋅WSSIMHHi.The wavelet structure similarity of three-dimensional echocardiography is calculated, which is described as FWSSIMI:(18)FWSSIMX,Y=ωLL⋅WSSIMLL+∑i=15ωHi⋅WSSIMHiωLL+∑i=15ωHi.On the basis of above processing, the 3D echocardiographic modeling and detection recognition are realized [21].


## 4. Simulation Experiment and Result Analysis

In order to verify the effectiveness of this algorithm, different types of three-dimensional echocardiography are used to reconstruct the simulation. The test platform is Pentium (R) 4 CPU 3.00 GHz, 1 GB memory in windows XP system. MATLAB simulation software is used to design the algorithm. Firstly, the information transmission model of three-dimensional echocardiography is constructed, and the information characteristic sampling and information fusion of three-dimensional ultrasonic imaging are realized. According to the simulation environment and parameter setting, 3D echocardiography is performed, and the imaging results are shown in Figure2.Figure 2
Three-dimensional echocardiographic results.
(a)
Sample A(b)
Sample BAccording to the analysis (Figure2), the result of three-dimensional echocardiography using this method is better, the characteristic fusion degree is higher, and the peak signal-to-noise ratio is higher. The accuracy of three-dimensional echocardiography is tested by different methods, and the comparison of detection performance is obtained as shown in Figure 3.Figure 3
Comparison of 3D echocardiographic detection performance.The analysis of Figure3 shows that the accuracy of three-dimensional echocardiography using this method is better.The weighted low frequency coefficient isωLL=3.78 of 3D ultrasonic wavelet decomposition, and the high frequency coefficients of echocardiography are as follows: ωH1=1.00, ωH2=3.75, ωH2=7.20, ωH4=3.48, and ωH5=3.21. Search step size N=4; 3D echocardiographic image sample block matching template is 9×9. The size of the windows is 3∗3.5∗5.9∗9.17∗17. Changes of indicators in the same environment on cardiogram images is shown in Figure 4.Figure 4
Changes of indicators in the same environment on cardiogram images.The characteristic decomposition and information fusion of 3D ultrasonic imaging are carried out by using the 5-stage wavelet decomposition method. The structure similar features of 3D echocardiographic detection and recognition image are obtained by the 5-stage wavelet decomposition of 3D echocardiography. Cardiogram detection indicators in different detection environments are shown in Figure5.Figure 5
Cardiogram detection indicators in different detection environments.The feature decomposition and information fusion of 3D ultrasonic imaging are carried out by using the five-stage wavelet decomposition method, and the feature reconstruction and adaptive template matching of 3D echocardiography are processed by a depth learning algorithm, modeling and detecting the rationality of three-dimensional echocardiography.


## 5. Conclusions

In this paper, a method of 3D echocardiography detection based on depth learning is proposed. The information conduction model of three-dimensional echocardiography is constructed. The edge pixel feature matching method is used to extract the key information of echocardiography, and the information compensation method is used to repair the missing area of three-dimensional echocardiography information. The feature decomposition and information fusion of 3D ultrasonic imaging are carried out by using the five-stage wavelet decomposition method, and the feature reconstruction and adaptive template matching of 3D echocardiography are processed by a depth learning algorithm, modeling and detecting the rationality of three-dimensional echocardiography. The simulation results show that this method has better detection performance, and the accuracy of detection and recognition is high, which is more reasonable in the application of 3D echocardiography repair and detection recognition. This method has good application value in the detection and clinical application of echocardiography.



---

*Source: 8886835-2020-11-25.xml*