# A New Method for Feature Extraction and Classification of Single-Stranded DNA Based on Collaborative Filter

Authors: Bingyong Yan; Haixu Cui; Haitao Fu; Jiale Zhou; Huifeng Wang
Journal: Mathematical Problems in Engineering
 (2020)

---

## Abstract

The traditional support vector machine algorithm is not enough to classify single-stranded DNA molecules, so this paper proposes an improved threshold extraction algorithm based on collaborative filter for the classification of single-stranded DNA. Firstly, according to the different characteristic curves of the blocking current signals formed by the four bases (A, T, C, and T) that make up DNA molecules crossing the nanopore, the collaborative filter feature extraction algorithm with improved threshold is proposed. Then, the feature information is reconstructed and sent to the SVM classifier for training. Finally, the unfiltered, collaborative filter, improved threshold collaborative filter, and Bessel filter data are, respectively, extracted and sent to the SVM classifier for classification and comparison research. The experimental results show that the improved collaborative filter algorithm has higher accuracy in single-stranded DNA molecular classification.


---

## Body

## 1. Introduction

In recent years, nanochannel technology has developed into an indispensable tool for single molecule experiments, which provides a new way for high sensitive detection of single molecules and the study of weak interaction between single molecules. This technology is widely used in DNA single molecule sequencing, protein structure analysis, and early diagnosis of major diseases. Nanochannel technology is mainly used to analyze the weak blocking current signal generated by the unknown molecule that passes through the nanopore and to study the information of biogenetics and life science. Compared with the traditional detection technology, it has the characteristics of simple operation, clear structure, and fast detection speed, so it is called the most promising third generation DNA sequencing technology [1–4].Due to the huge amount of data of blocking current generated by the molecules to be measured crossing the nanopore, the traditional data analysis and processing methods are far from meeting the requirements of DNA sequencing. Therefore, support vector machine and other auxiliary research tools have undoubtedly become one of the powerful tools for analyzing single-stranded DNA data [5].At present, many researchers have applied SVM in bioinformatics recognition [6, 7]. For example, Balachandran et al. [8] used the SVM model to predict in vitro phage virus proteins. Zhao et al. [9] used the SVM model to recognize amino acids. Zhong et al. [10] used SVM as a base classifier to recognize miRNA precursors. Zhou et al. [11] used the SVM model to recognize the DNA sequences of analytes such as Bacillus subtilis. Kumar et al. [12] used SVM to classify RNA-binding and nonbinding proteins. Dai [13] used SVM to classify imbalanced protein data. Through the above research and analysis, we can be seen that the classification rate using traditional SVM for classification is difficult to improve. In order to further improve the recognition rate, Tabard-Cossa et al. [14] and Kowalczyk et al. [15], respectively, studied the synthesis of enhanced nanopores, the mechanism of noise generation, and the noise model of nanopores. Dekker [16] and Goto et al. [17] designed low-noise I-V conversion sensor methods to denoise nanopores. These methods can improve the signal-to-noise ratio of the blocking current, and the accuracy of the recognition is improved to a certain extent. However, because the collected blocking current signal is a very weak picoampere signal, most of the research on denoising of blocking current signal is only based on the analysis of external physical conditions, while there is little research on the specific blocking current signal itself.Considering the existing research problems, this paper proposes a new collaborative filter classification method based on improved threshold. The basic idea is to use a fixed force between a single base and a nanopore [9], while the force between adjacent bases is uncertain, so the fluctuation of blocking current signal value is in a small range, but the block current signal generated by the same base through the nanopore shows a certain similarity in the whole signal [18, 19]. Therefore, based on the self-similar structure of the nanopore blocking current signal in the entire time domain, the collaborative filter algorithm was first used to analyze the grouped signals. By introducing the compensation factor, an improved threshold selection algorithm was proposed to extract the characteristics of the signal. Then, the processed data are reconstructed and sent to the SVM for training. Finally, the above algorithm was used to analyze the blocking current signals generated by A14 and CA3 single-stranded DNA molecules through the nanopore.


## 2. Introduction to Improved Collaborative Filter Algorithm

Considering the similarity of blocking current signals with the same base in the entire blocking current signal, the new feature extraction and classification method proposed in this paper are shown in Figure1.Figure 1
Flowchart of collaborative filter algorithm.The first step is to use the blocking current signal generated from the DNA molecule through the nanopore channel as raw data.The second step is to find out the similar blocks of the raw data and divide the most similarn blocks into a group with a certain threshold.The third step is to coprocess then groups. At this time, each group is a matrix. First, the n group matrix is subjected to two-dimensional discrete transformation, respectively, and then processed by introducing improved thresholds to filter out noise. Finally, two-dimensional discrete inverse transformation is used to reconstruct the raw signal. The reconstructed signal is the filtered signal with obvious characteristics.In the fourth step, the current blocking curves after reconstruction of the characteristics of the two DNA single-stranded moleculesA14 and CA3 processed in the first three steps are labeled and mixed and then sent to the SVM for training, and the classification results are analyzed.The details of each functional module are described below.


### 2.1. Grouping of Signals

Figure2 is a schematic diagram of grouping similar blocks. Each grouping block with similar characteristics is grouped for collaborative processing to reveal the characteristics of noise coverage and provides guarantee for SVM classification.Figure 2
Similar block grouping.The selected blocking current signal is marked asR, a reference segment is first selected from R as D, and the comparative segment L from R is then selected without repeating. And Euclidean distance is used to judge the similarity between D and L [20]:(1)dD,L=∑i=1nDi−Li2,i=1,2,3,...,n,where i is the selected i-th segment.Then, it is normalized [21]:(2)d¯D,L=∑i=1nDi−Li2w,i=1,2,3,...,n,where w is the width of the selected reference segment. d¯D,L is smaller, with higher similarity between D and L.Then, the fixed reference segmentD is selected and searched in the entire area of the blocking current signal length ll≫w. At the same time, L moves across the entire segment R in steps of k and obtains m segments with the smallest distance from the reference segment to form groupD. And it is saved to a two-dimensional array of m rows and w columns, groupDm∗w.Finally, the reference segmentD traverses the entire blocking current signal in steps of k and records groups formed by different reference segments.


### 2.2. Collaborative Processing

For then groups generated in Section 3.1, this section uses collaborative filter to perform filter processing on each group of signals in order to be able to extract the characteristic information of the grouped signals.Collaboration: each segment in each group is traversed through the entire blocking current signal, and each group contains the information of other groups, so this process can be regarded as a “collaborative” process.Collaborative filter consists of three steps:The first step is the two-dimensional discrete transformation of groups, and each group forms a matrix.The second step performs threshold processing on each group matrix to filter the noise information in the raw data.The third step is to transform the two-dimensional discrete inverse transformation on the matrix after the threshold processing in the second step and reconstruct signal with obvious characteristic information.Each step is explained in detail as follows:(1)
Two-dimensional discrete transformation of the group:(3)GD=dct2groupD,wheredct2⋅ is the two-dimensional discrete cosine transform.(2)
A threshold value is selected for each group asλ and threshold noise reduction is performed in the transform domain. Coefficients smaller than the threshold value are set to zero to attenuate noise, and coefficients larger than the threshold value are retained. This paper uses the hard threshold method, which is defined as(4)THg=g,g<λ,0,g≤λ,whereλ is based on the threshold denoising method of Donoho, which is approximately optimal in the sense of mean square error, and at the same time can ensure that the reconstructed signal has the smoothness of the raw signal. The definition of threshold by VisuShrink proposed by Donoho and Johnstone is [22] as follows:(5)λ=δ∗2log∗m∗w,whereδ is the noise standard deviation of the raw signal.Since the noise of the blocking current signal of DNA passing through the nanopore is unknown, this paper uses the absolute deviation of the median of the coefficient matrixGD to estimate [18]:(6)MAD=medianDi−medianDi,i=1,2,3,...,n,where MAD is median absolute deviation,median⋅. Di is the element in the coefficient matrix GD. The estimated noise standard is defined as(7)δ^=MADk,wherek is the scale factor constant, which is generally selected as 0.6745 [23].(3)
After thresholding the transform coefficient matrix, the grouped filter results are obtained by two-dimensional discrete inverse cosine transform, as follows:(8)groupD=idct2THg,where idct2⋅ is the two-dimensional discrete cosine transform.Through three steps, then groups in 2.1 can be processed collaboratively, and finally, n group signals with noise removed can be obtained.


### 2.3. Improved Threshold

In the case of actual measurement, the additional noise changes caused by slight environmental differences and the small changes in hardware circuit components and reference ground can cause signal drift.Although the data can be filtered using a collaborative filter to reduce noise interference, if the input signal has drift and contains nonzero mean noise interference, it will lead to the deviation of the final results of data processing. Therefore, it is necessary to compensate the drift of system.This section improves the threshold value in the second step of collaborative filter data processing in Section2.2 and introduces threshold compensation factor λc to compensate the drift of system.The improved threshold is defined as(9)λ=δ∗2log∗m∗w+λc,where when the circuit is at zero input signal, the output value of the acquisition circuit at this time is R0. The data processing methods in Sections 2.1 and 2.2 are used to obtain the threshold λi,i=1,2,...,n without input.Compensation factor is defined as(10)λc=−1n∑j=1nλji.


### 2.4. Feature Extraction of Signals

Because the traditional SVM-based method is used for classification, feature information of the raw data is drowned in noise, resulting in the unsatisfactory classification effect of SVM. In this paper, the raw signal is processed by the collaborative filter method and then reconstructing data with obvious characteristics.The features of each group are displayed from the submerged noise, and the reconstructed obvious feature structure provides guarantee for the accuracy of the SVM classification.Each group is composed of them most similar to the original reference segment, so there is overlap between these m contrast segments. That is to say, a single point exists in multiple segments at the same time, so the reconstruction of the signal is to arithmetically average these m similar segments [24] to obtain the final output:(11)Resulti=∑i=1mgroupDi∗wm,where groupDi∗w is the row vector in the group.The characteristic reconstructed blocking current signal is(12)signal=resultresult1,result2,…,resultn.


## 2.1. Grouping of Signals

Figure2 is a schematic diagram of grouping similar blocks. Each grouping block with similar characteristics is grouped for collaborative processing to reveal the characteristics of noise coverage and provides guarantee for SVM classification.Figure 2
Similar block grouping.The selected blocking current signal is marked asR, a reference segment is first selected from R as D, and the comparative segment L from R is then selected without repeating. And Euclidean distance is used to judge the similarity between D and L [20]:(1)dD,L=∑i=1nDi−Li2,i=1,2,3,...,n,where i is the selected i-th segment.Then, it is normalized [21]:(2)d¯D,L=∑i=1nDi−Li2w,i=1,2,3,...,n,where w is the width of the selected reference segment. d¯D,L is smaller, with higher similarity between D and L.Then, the fixed reference segmentD is selected and searched in the entire area of the blocking current signal length ll≫w. At the same time, L moves across the entire segment R in steps of k and obtains m segments with the smallest distance from the reference segment to form groupD. And it is saved to a two-dimensional array of m rows and w columns, groupDm∗w.Finally, the reference segmentD traverses the entire blocking current signal in steps of k and records groups formed by different reference segments.


## 2.2. Collaborative Processing

For then groups generated in Section 3.1, this section uses collaborative filter to perform filter processing on each group of signals in order to be able to extract the characteristic information of the grouped signals.Collaboration: each segment in each group is traversed through the entire blocking current signal, and each group contains the information of other groups, so this process can be regarded as a “collaborative” process.Collaborative filter consists of three steps:The first step is the two-dimensional discrete transformation of groups, and each group forms a matrix.The second step performs threshold processing on each group matrix to filter the noise information in the raw data.The third step is to transform the two-dimensional discrete inverse transformation on the matrix after the threshold processing in the second step and reconstruct signal with obvious characteristic information.Each step is explained in detail as follows:(1)
Two-dimensional discrete transformation of the group:(3)GD=dct2groupD,wheredct2⋅ is the two-dimensional discrete cosine transform.(2)
A threshold value is selected for each group asλ and threshold noise reduction is performed in the transform domain. Coefficients smaller than the threshold value are set to zero to attenuate noise, and coefficients larger than the threshold value are retained. This paper uses the hard threshold method, which is defined as(4)THg=g,g<λ,0,g≤λ,whereλ is based on the threshold denoising method of Donoho, which is approximately optimal in the sense of mean square error, and at the same time can ensure that the reconstructed signal has the smoothness of the raw signal. The definition of threshold by VisuShrink proposed by Donoho and Johnstone is [22] as follows:(5)λ=δ∗2log∗m∗w,whereδ is the noise standard deviation of the raw signal.Since the noise of the blocking current signal of DNA passing through the nanopore is unknown, this paper uses the absolute deviation of the median of the coefficient matrixGD to estimate [18]:(6)MAD=medianDi−medianDi,i=1,2,3,...,n,where MAD is median absolute deviation,median⋅. Di is the element in the coefficient matrix GD. The estimated noise standard is defined as(7)δ^=MADk,wherek is the scale factor constant, which is generally selected as 0.6745 [23].(3)
After thresholding the transform coefficient matrix, the grouped filter results are obtained by two-dimensional discrete inverse cosine transform, as follows:(8)groupD=idct2THg,where idct2⋅ is the two-dimensional discrete cosine transform.Through three steps, then groups in 2.1 can be processed collaboratively, and finally, n group signals with noise removed can be obtained.


## 2.3. Improved Threshold

In the case of actual measurement, the additional noise changes caused by slight environmental differences and the small changes in hardware circuit components and reference ground can cause signal drift.Although the data can be filtered using a collaborative filter to reduce noise interference, if the input signal has drift and contains nonzero mean noise interference, it will lead to the deviation of the final results of data processing. Therefore, it is necessary to compensate the drift of system.This section improves the threshold value in the second step of collaborative filter data processing in Section2.2 and introduces threshold compensation factor λc to compensate the drift of system.The improved threshold is defined as(9)λ=δ∗2log∗m∗w+λc,where when the circuit is at zero input signal, the output value of the acquisition circuit at this time is R0. The data processing methods in Sections 2.1 and 2.2 are used to obtain the threshold λi,i=1,2,...,n without input.Compensation factor is defined as(10)λc=−1n∑j=1nλji.


## 2.4. Feature Extraction of Signals

Because the traditional SVM-based method is used for classification, feature information of the raw data is drowned in noise, resulting in the unsatisfactory classification effect of SVM. In this paper, the raw signal is processed by the collaborative filter method and then reconstructing data with obvious characteristics.The features of each group are displayed from the submerged noise, and the reconstructed obvious feature structure provides guarantee for the accuracy of the SVM classification.Each group is composed of them most similar to the original reference segment, so there is overlap between these m contrast segments. That is to say, a single point exists in multiple segments at the same time, so the reconstruction of the signal is to arithmetically average these m similar segments [24] to obtain the final output:(11)Resulti=∑i=1mgroupDi∗wm,where groupDi∗w is the row vector in the group.The characteristic reconstructed blocking current signal is(12)signal=resultresult1,result2,…,resultn.


## 3. SVM Classification and Recognition Based on Improved Feature Extraction

### 3.1. Experimental Data

The block current signals generated by the two single-stranded DNA moleculesA14 and CA3 to be recognized as they pass through the nanopore are shown in Figures 3 and 4, respectively.Figure 3
A14 raw data signal.Figure 4
CA3 raw data signal.The baseline current is 70.00 pA (both 800,000 sampling points).


### 3.2. Parameter Selection

This paper mainly uses signal-noise ratio and root mean squared error [25] as the evaluation criteria to determine the data based on cooperative filter and feature reconstruction and passes these two standards to determine the parameters that the collaborative filter algorithm needs to determine, that is, compare the moving step size k of the segmented segments with the number of sampling points included in each segment.The definition of SNR used in this paper is(13)SNR=10logSN=10log∑i=1NS2i∑i=1NSfi−Si2.The definition of RMSE is(14)RMSE=∑i=1NSfi−Sii2N,where Si is the value of the initial input signal, Sfi is the value of the output signal after collaborative filter, and N is the total length of the input signal. The larger the signal-to-noise ratio, the smaller the root mean square error, and the stronger the desiccation ability.(a)
Moving step of grouped fragmentsIt can be seen from the curve trend in Figure5 that when the width of the segment is 50, the SNR is the largest, the RMSE is the smallest, and the denoising effect is the best, so the moving step of the segment is 30.(b)
The width of the fragmentIt can be seen from the curve trend in Figure6 that when the moving step size of the fixed segment is 50, the SNR is the largest, the RMSE is the smallest, and the denoising effect is the best, so the width of the segment is 10.Figure 5
Change chart of step size.Figure 6
Change chart of width.Through the analysis of the above experimental data, it can be concluded that the collaborative filter algorithm has the best data processing effect when the moving step length of the segment is 30 and the width of the segment is 10. At this time, the SNR is 49.77 and the RMSE is 0.16.


### 3.3. Comparison of Filter Results

The parameters determined in Section3.2 are segment moving step 30 and segment width 10. In order to highlight the performance of the algorithm, this section will compare it with the Bessel filter algorithm [26].Figures7 and 8 compare the data processing effect without and with improved threshold collaborative filter algorithm. Figure 7 shows the entire DNA molecule fragment, and Figure 8 shows a portion of the DNA molecule fragment. From Figures 7 and 8, it can be seen from the overall and partial filter results that the improved threshold collaborative filter algorithm SNR=49.77and RMSE=0.16 has a significantly better effect on data processing than the without improved threshold collaborative filter algorithm SNR=38.62and RMSE=0.89.Figure 7
Comparison diagram with and without improved threshold collaborative filter: (a)A14 raw data; (b) collaborative filter; (c) improved threshold collaborative filter.
(a)(b)(c)Figure 8
Partial diagram of collaborative filter with and without improved threshold collaborative filter: (a)A14 raw data; (b) collaborative filter; (c) improved threshold collaborative filter.
(a)(b)(c)Figures9 and 10 compare the data processing effect without improved threshold collaborative filter algorithm and Bessel algorithm. Figure 9 shows the entire DNA molecule fragment, and Figure 10 shows a portion of the DNA molecule fragment. From Figures 6 and 10, it can be seen from the overall and partial filter that the effect of the collaborative filter algorithm SNR=38.62and RMSE=0.89 on data processing is similar to that of Bessel filter SNR=38.62and RMSE=0.89.Figure 9
Comparison of Bessel and collaborative filters (A14 overall): (a) A14 raw data; (b) Bessel filter; (c) collaborative filter.
(a)(b)(c)Figure 10
Comparison of Bessel and collaborative filters (A14 part): (a) A14 raw data; (b) Bessel filter; (c) collaborative filter.
(a)(b)(c)Figures11 and 12 compare the data processing effect of improved threshold collaborative filter algorithm and Bessel algorithm. Figure 11 shows the entire DNA molecule fragment, and Figure 12 shows a portion of the DNA molecule fragment. From Figures 11 and 12, it can be seen from the overall and partial filter that the effect of the improved threshold collaborative filter algorithm SNR=49.77and RMSE=0.16 on data processing is significantly better than that of Bessel filter on data processing SNR=39.71and RMSE=0.82.Figure 11
Comparison of Bessel and improved threshold collaborative filters (A14 overall): (a) A14 raw data; (b) Bessel filter; (c) improved threshold collaborative filter.
(a)(b)(c)Figure 12
Comparison of Bessel and improved threshold collaborative filters (A14 part): (a) A14 raw data; (b) Bessel filter; (c) improved threshold collaborative filter.
(a)(b)(c)From the above comparison results, it can be concluded that the denoising effect of the improved threshold collaborative filter algorithm is significantly better than without the improved threshold collaborative filter algorithm and Bessel Filter algorithm. Therefore, after the improved threshold collaborative filter algorithm is used to process the raw data, the characteristic information of the data is more obvious.


### 3.4. Comparison of Classification Results

In order to verify the effectiveness of the algorithm proposed in this paper, SVM classification algorithm [27] is used to classify and study the collaborative filter, Bessel Filter, and improved threshold collaborative filter.The blocking current sampling points ofCA3 and A14 molecules are 15822 and 16628, respectively. 70% of the reconstructed datasets are used for training models and 30% for testing the effect of model recognition and classification.Table1 shows the classification accuracy of raw data, Bessel Filter data, collaborative filter data, and collaborative filter data with improved threshold using SVM. According to the classification accuracy in the table, it can be seen that the classification effect of collaborative filter without improved thresholds is similar to that of the Bessel filter by about 77%, while the classification effect of collaborative filter algorithm with improved thresholds is up to 95.88% better than the other two algorithms.Table 1
SVM classification results.
Filter algorithmClassification accuracy (%)Raw data53.53Bessel filter77.05Collaborative filter76.38Collaborative filter with improved threshold95.88


## 3.1. Experimental Data

The block current signals generated by the two single-stranded DNA moleculesA14 and CA3 to be recognized as they pass through the nanopore are shown in Figures 3 and 4, respectively.Figure 3
A14 raw data signal.Figure 4
CA3 raw data signal.The baseline current is 70.00 pA (both 800,000 sampling points).


## 3.2. Parameter Selection

This paper mainly uses signal-noise ratio and root mean squared error [25] as the evaluation criteria to determine the data based on cooperative filter and feature reconstruction and passes these two standards to determine the parameters that the collaborative filter algorithm needs to determine, that is, compare the moving step size k of the segmented segments with the number of sampling points included in each segment.The definition of SNR used in this paper is(13)SNR=10logSN=10log∑i=1NS2i∑i=1NSfi−Si2.The definition of RMSE is(14)RMSE=∑i=1NSfi−Sii2N,where Si is the value of the initial input signal, Sfi is the value of the output signal after collaborative filter, and N is the total length of the input signal. The larger the signal-to-noise ratio, the smaller the root mean square error, and the stronger the desiccation ability.(a)
Moving step of grouped fragmentsIt can be seen from the curve trend in Figure5 that when the width of the segment is 50, the SNR is the largest, the RMSE is the smallest, and the denoising effect is the best, so the moving step of the segment is 30.(b)
The width of the fragmentIt can be seen from the curve trend in Figure6 that when the moving step size of the fixed segment is 50, the SNR is the largest, the RMSE is the smallest, and the denoising effect is the best, so the width of the segment is 10.Figure 5
Change chart of step size.Figure 6
Change chart of width.Through the analysis of the above experimental data, it can be concluded that the collaborative filter algorithm has the best data processing effect when the moving step length of the segment is 30 and the width of the segment is 10. At this time, the SNR is 49.77 and the RMSE is 0.16.


## 3.3. Comparison of Filter Results

The parameters determined in Section3.2 are segment moving step 30 and segment width 10. In order to highlight the performance of the algorithm, this section will compare it with the Bessel filter algorithm [26].Figures7 and 8 compare the data processing effect without and with improved threshold collaborative filter algorithm. Figure 7 shows the entire DNA molecule fragment, and Figure 8 shows a portion of the DNA molecule fragment. From Figures 7 and 8, it can be seen from the overall and partial filter results that the improved threshold collaborative filter algorithm SNR=49.77and RMSE=0.16 has a significantly better effect on data processing than the without improved threshold collaborative filter algorithm SNR=38.62and RMSE=0.89.Figure 7
Comparison diagram with and without improved threshold collaborative filter: (a)A14 raw data; (b) collaborative filter; (c) improved threshold collaborative filter.
(a)(b)(c)Figure 8
Partial diagram of collaborative filter with and without improved threshold collaborative filter: (a)A14 raw data; (b) collaborative filter; (c) improved threshold collaborative filter.
(a)(b)(c)Figures9 and 10 compare the data processing effect without improved threshold collaborative filter algorithm and Bessel algorithm. Figure 9 shows the entire DNA molecule fragment, and Figure 10 shows a portion of the DNA molecule fragment. From Figures 6 and 10, it can be seen from the overall and partial filter that the effect of the collaborative filter algorithm SNR=38.62and RMSE=0.89 on data processing is similar to that of Bessel filter SNR=38.62and RMSE=0.89.Figure 9
Comparison of Bessel and collaborative filters (A14 overall): (a) A14 raw data; (b) Bessel filter; (c) collaborative filter.
(a)(b)(c)Figure 10
Comparison of Bessel and collaborative filters (A14 part): (a) A14 raw data; (b) Bessel filter; (c) collaborative filter.
(a)(b)(c)Figures11 and 12 compare the data processing effect of improved threshold collaborative filter algorithm and Bessel algorithm. Figure 11 shows the entire DNA molecule fragment, and Figure 12 shows a portion of the DNA molecule fragment. From Figures 11 and 12, it can be seen from the overall and partial filter that the effect of the improved threshold collaborative filter algorithm SNR=49.77and RMSE=0.16 on data processing is significantly better than that of Bessel filter on data processing SNR=39.71and RMSE=0.82.Figure 11
Comparison of Bessel and improved threshold collaborative filters (A14 overall): (a) A14 raw data; (b) Bessel filter; (c) improved threshold collaborative filter.
(a)(b)(c)Figure 12
Comparison of Bessel and improved threshold collaborative filters (A14 part): (a) A14 raw data; (b) Bessel filter; (c) improved threshold collaborative filter.
(a)(b)(c)From the above comparison results, it can be concluded that the denoising effect of the improved threshold collaborative filter algorithm is significantly better than without the improved threshold collaborative filter algorithm and Bessel Filter algorithm. Therefore, after the improved threshold collaborative filter algorithm is used to process the raw data, the characteristic information of the data is more obvious.


## 3.4. Comparison of Classification Results

In order to verify the effectiveness of the algorithm proposed in this paper, SVM classification algorithm [27] is used to classify and study the collaborative filter, Bessel Filter, and improved threshold collaborative filter.The blocking current sampling points ofCA3 and A14 molecules are 15822 and 16628, respectively. 70% of the reconstructed datasets are used for training models and 30% for testing the effect of model recognition and classification.Table1 shows the classification accuracy of raw data, Bessel Filter data, collaborative filter data, and collaborative filter data with improved threshold using SVM. According to the classification accuracy in the table, it can be seen that the classification effect of collaborative filter without improved thresholds is similar to that of the Bessel filter by about 77%, while the classification effect of collaborative filter algorithm with improved thresholds is up to 95.88% better than the other two algorithms.Table 1
SVM classification results.
Filter algorithmClassification accuracy (%)Raw data53.53Bessel filter77.05Collaborative filter76.38Collaborative filter with improved threshold95.88


## 4. Conclusion

Due to the large amount of environmental noise and the instrument’s own noise mixed in the raw sampling data, it is difficult to obtain the feature information of the raw data only by SVM for classification, resulting in low classification accuracy. Therefore, in consideration of signal drift caused by various noises, based on the premise of grouping, thresholding, and reconstruction of the raw data based on the collaborative filter algorithm, this paper improves the threshold value selected during the thresholding process in the collaborative algorithm and introduces the threshold drift compensation factor to compensate for signal drift to compensate for the effects of noise.Then, the raw data are processed using a collaborative filter algorithm with improved thresholds to obtain data groups with obvious feature information, and data groups with obvious feature information are used for data reconstruction. Then, the data processing effect of improved threshold collaborative filter is compared with the data processing effect of the unimproved collaborative filter and Bessel filter. The data processing effect of improved threshold collaborative filter is significantly better than the other two data processing methods.Finally, the data processed by the three data processing methods are sent to SVM for training, and the classification accuracy of the data processed by the improved threshold collaborative filter algorithm is obviously better than the other two data processing methods.



---

*Source: 3876367-2020-07-21.xml*