# Boosted Sine Cosine Algorithm with Application to Medical Diagnosis

Authors: Xiaojia Ye; Zhennao Cai; Chenglang Lu; Huiling Chen; Zhifang Pan
Journal: Computational and Mathematical Methods in Medicine
 (2022)

---

## Abstract

The sine cosine algorithm (SCA) was proposed for solving optimization tasks, of which the way to obtain the optimal solution is mainly through the continuous iteration of the sine and cosine update formulas. However, SCA also faces low population diversity and stagnation of locally optimal solutions. Hence, we try to eliminate these problems by proposing an enhanced version of SCA, named ESCA_PSO. ESCA_PSO is proposed based on hybrid SCA and particle swarm optimization (PSO) by incorporating multiple mutation strategies into the original SCA_PSO. To validate the effect of ESCA_PSO in handling global optimization problems, ESCA_PSO was compared with quality algorithms on various types of benchmark functions. In addition, the proposed ESCA_PSO was employed to tune the best parameters of support vector machines for dealing with medical diagnosis tasks. The results prove the efficiency of the proposed algorithms in solving optimization problems.


---

## Body

## 1. Introduction

### 1.1. Motivation

Many problems in real life can be summarized as global optimization problems. When it comes to increasingly complex optimization problems, traditional methods are generally unsatisfactory [1]. Therefore, many scholars began to explore new solutions. The metaheuristic algorithm (MA) is developed for obtaining and grasping information to effectively find approximately optimal solutions through learning strategies. MA has been applied to many scenarios owing to its effective optimization capability [2]. For example, MA has found the great potential in wind speed prediction [3], scheduling problem [4], parameter optimization [5], PID optimization control [6], gate resource allocation [7], fault diagnosis of rolling bearings [8], cloud workflow scheduling [9], energy vehicle dispatch [10], combination optimization problems [11], traveling salesman problem [12], object tracking [13], neural network training [14], and multiattribute decision making [15].In 2016, a new swarm intelligence algorithm named sine cosine algorithm (SCA) [16] was proposed. SCA searches the solution based on the sine function and cosine function. It owns strong global searchability, which can significantly increase the global optimal solution through enough iterations. However, SCA also is faced with some problems, for instance, slow convergence speed, low convergence accuracy, and easily falling into local optimum. To overcome the problems existing in SCA, a hybrid SCA and PSO algorithm (SCA_PSO) was put forward by Nenavath et al. [17], which aims to solve optimization problems and target tracking. The search mechanism of the PSO algorithm is added to the traditional SCA to guide the search for potential candidate solutions. It should be noted that though the SCA_PSO has achieved promising results on object tracking when dealing with complex problems, it is still easy to skip the true optimal solution and lead to premature convergence.According to “No Free Lunch” [18], we have introduced the differential evolution algorithm (DE) and combined mutation strategies into the original SCA_PSO to strengthen its capability of local search and reduce the occurrence of premature convergence. The proposed ESCA_PSO was validated on a benchmark test which includes various types of functions. Experimental results demonstrated that ESCA_PSO was significantly better than SCA_PSO and other competitive counterparts. In addition, the ESCA_PSO was also used to construct an optimal support vector machine model (SVM) to deal with the medical diagnosis problems in an effective manner. In general, ESCA_PSO has improved the performance of SCA_PSO in a significant manner.


### 1.2. Literature Review

SCA has been widely studied and applied in many fields because of its simple implementation and relatively excellent performance in realizing complex problems. For example, SCA was employed to tackle the scheduling problem in [19]. A multiobjective SCA was proposed to solve engineering optimization problems in [20] and forecast the wind speed in [21]. SCA was employed to predict the time series by constructing an optimal support vector regression model in [22]. In [23], SCA was utilized to optimize the parameters of fuzzy k-nearest neighbor to build an optimized classifier for predicting the intention of students for a postgraduate entrance examination. In [24], SCA was applied to optimize the SVM’s parameters and the boosted classifier was trained to predict students’ entrepreneurial intentions.In addition to applications, scholars have also proposed many improved SCA variants. Issa et al. [25] proposed a new idea of SCA, that is, the combination of SCA and PSO. This algorithm was used to solve the problem of pairwise local alignment to look for the longest continuous substring between two biological sequences, which has shown good performance in accuracy and calculation time. Nenavath and Jatoth [26] proposed to select the DE algorithm to merge into SCA and applied it to target tracking. Abd Elaziz et al. [27] mutated SCA (OBSCA) with opposition-based learning mechanisms, which has effectively boosted SCA’s search efficiency and expanded its search scope. Qu et al. [28] improved the SCA by adding three strategies. Kumar et al. [29] tried to mix SCA with Cauchy and Gaussian distributions, which were named CGSCA. Simulations showed that the single-sensor tracking scheme based on CGSCA had better results in terms of tracking time and tracking efficiency. Long et al. [30] combined SCA with inertia weight based on a position updating equation and a nonlinear conversion parameter strategy to ameliorate SCA’s ability in solving high-dimensional problems. Tu et al. [24] proposed to adopt the chaotic local search enhanced SCA for training an optimal support vector machine to predict students’ entrepreneurial intentions. Turgut [31] proposed that mixing SCA with a backtracking search algorithm (BSA) was an efficient way to realize the shell and tube evaporator’s optimal design. With the proposed optimization method, the optimal values of the total design cost of the heat exchanger and the total heat transfer coefficient were better than the results of the other optimizers in the literature. Guo et al. [32] introduced the Riesz fractional derivative and the OBL strategy into SCA and applied the method to deal with the engineering problems. Gupta and Deep [33] proposed to add a leading guidance mechanism and simulated quenching algorithm together to SCA and applied it to train multilayer perceptron. Gupta and Deep [34] utilized the OBL strategy and the self-adaptive component to enhance the SCA. And this improved algorithm’s efficacy was confirmed by lots of benchmark problems and engineering problems. Tawhid and Savsani [20] proposed a novel and effective multiobjective version of SCA (MO-SCA). The difference between MO-SCA and SCA is mainly reflected in two aspects, one is to improve the nondominated level by adding an elite nondominated sorting strategy, and the other is to maintain the diversity of optimal solutions by adding crowded distance method. At present, machine learning methods are still a research hotspot [35–42]. However, the hyperparameters of the model have a crucial impact on its performance. Therefore, combining the improved version of SCA with machine learning methods to obtain the best hyperparameter combination model is also a novel research angle.


### 1.3. Contribution and Paper Organization

The main contributions of this study are as follows:(a)
An improved SCA named ESCA_PSO is proposed(b)
The proposed ESCA_PSO has achieved superior performance to other peers on function optimization and machine learning tasks(c)
Successfully applied ESCA_PSO to SVM parameter optimization problem(d)
Successfully use ESCA_PSO-SVM in the field of medical diagnosisThe rest part of this paper is assigned as follows: The introduction of SCA and SCA-PSO is arranged in Section2. Our proposed ESCA_PSO is presented in Section 3. The details information on experimental results and discussions are described in Section 4. Finally, in Section 5, conclusions and future works are summarized.


## 1.1. Motivation

Many problems in real life can be summarized as global optimization problems. When it comes to increasingly complex optimization problems, traditional methods are generally unsatisfactory [1]. Therefore, many scholars began to explore new solutions. The metaheuristic algorithm (MA) is developed for obtaining and grasping information to effectively find approximately optimal solutions through learning strategies. MA has been applied to many scenarios owing to its effective optimization capability [2]. For example, MA has found the great potential in wind speed prediction [3], scheduling problem [4], parameter optimization [5], PID optimization control [6], gate resource allocation [7], fault diagnosis of rolling bearings [8], cloud workflow scheduling [9], energy vehicle dispatch [10], combination optimization problems [11], traveling salesman problem [12], object tracking [13], neural network training [14], and multiattribute decision making [15].In 2016, a new swarm intelligence algorithm named sine cosine algorithm (SCA) [16] was proposed. SCA searches the solution based on the sine function and cosine function. It owns strong global searchability, which can significantly increase the global optimal solution through enough iterations. However, SCA also is faced with some problems, for instance, slow convergence speed, low convergence accuracy, and easily falling into local optimum. To overcome the problems existing in SCA, a hybrid SCA and PSO algorithm (SCA_PSO) was put forward by Nenavath et al. [17], which aims to solve optimization problems and target tracking. The search mechanism of the PSO algorithm is added to the traditional SCA to guide the search for potential candidate solutions. It should be noted that though the SCA_PSO has achieved promising results on object tracking when dealing with complex problems, it is still easy to skip the true optimal solution and lead to premature convergence.According to “No Free Lunch” [18], we have introduced the differential evolution algorithm (DE) and combined mutation strategies into the original SCA_PSO to strengthen its capability of local search and reduce the occurrence of premature convergence. The proposed ESCA_PSO was validated on a benchmark test which includes various types of functions. Experimental results demonstrated that ESCA_PSO was significantly better than SCA_PSO and other competitive counterparts. In addition, the ESCA_PSO was also used to construct an optimal support vector machine model (SVM) to deal with the medical diagnosis problems in an effective manner. In general, ESCA_PSO has improved the performance of SCA_PSO in a significant manner.


## 1.2. Literature Review

SCA has been widely studied and applied in many fields because of its simple implementation and relatively excellent performance in realizing complex problems. For example, SCA was employed to tackle the scheduling problem in [19]. A multiobjective SCA was proposed to solve engineering optimization problems in [20] and forecast the wind speed in [21]. SCA was employed to predict the time series by constructing an optimal support vector regression model in [22]. In [23], SCA was utilized to optimize the parameters of fuzzy k-nearest neighbor to build an optimized classifier for predicting the intention of students for a postgraduate entrance examination. In [24], SCA was applied to optimize the SVM’s parameters and the boosted classifier was trained to predict students’ entrepreneurial intentions.In addition to applications, scholars have also proposed many improved SCA variants. Issa et al. [25] proposed a new idea of SCA, that is, the combination of SCA and PSO. This algorithm was used to solve the problem of pairwise local alignment to look for the longest continuous substring between two biological sequences, which has shown good performance in accuracy and calculation time. Nenavath and Jatoth [26] proposed to select the DE algorithm to merge into SCA and applied it to target tracking. Abd Elaziz et al. [27] mutated SCA (OBSCA) with opposition-based learning mechanisms, which has effectively boosted SCA’s search efficiency and expanded its search scope. Qu et al. [28] improved the SCA by adding three strategies. Kumar et al. [29] tried to mix SCA with Cauchy and Gaussian distributions, which were named CGSCA. Simulations showed that the single-sensor tracking scheme based on CGSCA had better results in terms of tracking time and tracking efficiency. Long et al. [30] combined SCA with inertia weight based on a position updating equation and a nonlinear conversion parameter strategy to ameliorate SCA’s ability in solving high-dimensional problems. Tu et al. [24] proposed to adopt the chaotic local search enhanced SCA for training an optimal support vector machine to predict students’ entrepreneurial intentions. Turgut [31] proposed that mixing SCA with a backtracking search algorithm (BSA) was an efficient way to realize the shell and tube evaporator’s optimal design. With the proposed optimization method, the optimal values of the total design cost of the heat exchanger and the total heat transfer coefficient were better than the results of the other optimizers in the literature. Guo et al. [32] introduced the Riesz fractional derivative and the OBL strategy into SCA and applied the method to deal with the engineering problems. Gupta and Deep [33] proposed to add a leading guidance mechanism and simulated quenching algorithm together to SCA and applied it to train multilayer perceptron. Gupta and Deep [34] utilized the OBL strategy and the self-adaptive component to enhance the SCA. And this improved algorithm’s efficacy was confirmed by lots of benchmark problems and engineering problems. Tawhid and Savsani [20] proposed a novel and effective multiobjective version of SCA (MO-SCA). The difference between MO-SCA and SCA is mainly reflected in two aspects, one is to improve the nondominated level by adding an elite nondominated sorting strategy, and the other is to maintain the diversity of optimal solutions by adding crowded distance method. At present, machine learning methods are still a research hotspot [35–42]. However, the hyperparameters of the model have a crucial impact on its performance. Therefore, combining the improved version of SCA with machine learning methods to obtain the best hyperparameter combination model is also a novel research angle.


## 1.3. Contribution and Paper Organization

The main contributions of this study are as follows:(a)
An improved SCA named ESCA_PSO is proposed(b)
The proposed ESCA_PSO has achieved superior performance to other peers on function optimization and machine learning tasks(c)
Successfully applied ESCA_PSO to SVM parameter optimization problem(d)
Successfully use ESCA_PSO-SVM in the field of medical diagnosisThe rest part of this paper is assigned as follows: The introduction of SCA and SCA-PSO is arranged in Section2. Our proposed ESCA_PSO is presented in Section 3. The details information on experimental results and discussions are described in Section 4. Finally, in Section 5, conclusions and future works are summarized.


## 2. An Overview of SCA_PSO Algorithm

### 2.1. Standard SCA

In recent years, many new intelligent algorithms have been proposed to solve practical problems, such as hunger games search (HGS) [43], weighted mean of vectors (INFO) [44], Harris hawks optimization (HHO) [45], slime mould algorithm (SMA) [46], and Runge Kutta optimizer (RUN) [47]. These algorithms have shown great potential in various fields such as engineering, medicine, energy, finance, and education. In 2016, Mirjalili [16] put forward a novel swarm intelligence algorithm called SCA for global optimization tasks. Similar to other metaheuristics, it looks for the solution in a random searching space. SCA obtains the optimal solution through triangle sine cosine functions [16].The following location updating formulas are proposed for two phases:(1)Xit+1=Xit+r1×sinr2×r3Pit−Xit,(2)Xit+1=Xit+r1×cosr2×r3Pit−Xit,where Xit is the position of the current solution in i-th dimension at t-th iteration, r1,r2,r3 are random numbers, Pi is the position of the target point in i-th dimension, and || indicates absolute value.Combining the above, the following equation can be obtained:(3)Xit+1=Xit+r1×sinr2×r3Pit−Xit,r4<0.5,Xit+r1×cosr2×r3Pit−Xit,r4≥0.5,where r4 is a random number in the range [0, 1].As the above formulae reveal,r1,r2,r3 and r4 are four important parameters with different meanings. The r1 mainly decides whether the position of the next move is within the boundary range of solution and destination or outside the range. r2 represents the distance required for the movement to reach the destination. The coefficient r3 carries a random load for the destination to stochastically emphasize (r3> 1) or deemphasize (r3 <1) the effect of destination in describing the distance. r4 switches from sine function to cosine function or vice versa in Eq. (3). The values of r2 were set in 0,2π in this study.To achieve a steady global and local search, the range of sine and cosine functions in Eqs. (1)–(3) are altered adaptively according to the following formula:
(4)r1=a−taT,where t means the current iteration, T means the maximum number of iterations, and a is a constant with the value of 2.


### 2.2. SCA_PSO Algorithm

To eliminate the shortcoming of SCA, Nenavath et al. [17] came up with an improved hybrid SCA_PSO for dealing with optimization tasks. The SCA_PSO integrates PSO’s strengths in exploitation and the SCA’s strengths in exploration to approach the global optimal solution.By adding internal storage to SCA, each individual is permitted to follow the coordinates associated with the adaptive values in the search space. And the personal historical best solution of each search agent in the present population is stored in the form of a matrix, SCA-Pbest, which is the same as the concept of Pbest in PSO each iteration. In addition, the solution also keeps track of the optimal value achieved so far by any nearby solution. As a new concept in SCA, Pbest and Gbest enhance the exploitation ability of SCA. The pseudocode of SCA_PSO is shown in Pseudocode 1.


## 2.1. Standard SCA

In recent years, many new intelligent algorithms have been proposed to solve practical problems, such as hunger games search (HGS) [43], weighted mean of vectors (INFO) [44], Harris hawks optimization (HHO) [45], slime mould algorithm (SMA) [46], and Runge Kutta optimizer (RUN) [47]. These algorithms have shown great potential in various fields such as engineering, medicine, energy, finance, and education. In 2016, Mirjalili [16] put forward a novel swarm intelligence algorithm called SCA for global optimization tasks. Similar to other metaheuristics, it looks for the solution in a random searching space. SCA obtains the optimal solution through triangle sine cosine functions [16].The following location updating formulas are proposed for two phases:(1)Xit+1=Xit+r1×sinr2×r3Pit−Xit,(2)Xit+1=Xit+r1×cosr2×r3Pit−Xit,where Xit is the position of the current solution in i-th dimension at t-th iteration, r1,r2,r3 are random numbers, Pi is the position of the target point in i-th dimension, and || indicates absolute value.Combining the above, the following equation can be obtained:(3)Xit+1=Xit+r1×sinr2×r3Pit−Xit,r4<0.5,Xit+r1×cosr2×r3Pit−Xit,r4≥0.5,where r4 is a random number in the range [0, 1].As the above formulae reveal,r1,r2,r3 and r4 are four important parameters with different meanings. The r1 mainly decides whether the position of the next move is within the boundary range of solution and destination or outside the range. r2 represents the distance required for the movement to reach the destination. The coefficient r3 carries a random load for the destination to stochastically emphasize (r3> 1) or deemphasize (r3 <1) the effect of destination in describing the distance. r4 switches from sine function to cosine function or vice versa in Eq. (3). The values of r2 were set in 0,2π in this study.To achieve a steady global and local search, the range of sine and cosine functions in Eqs. (1)–(3) are altered adaptively according to the following formula:
(4)r1=a−taT,where t means the current iteration, T means the maximum number of iterations, and a is a constant with the value of 2.


## 2.2. SCA_PSO Algorithm

To eliminate the shortcoming of SCA, Nenavath et al. [17] came up with an improved hybrid SCA_PSO for dealing with optimization tasks. The SCA_PSO integrates PSO’s strengths in exploitation and the SCA’s strengths in exploration to approach the global optimal solution.By adding internal storage to SCA, each individual is permitted to follow the coordinates associated with the adaptive values in the search space. And the personal historical best solution of each search agent in the present population is stored in the form of a matrix, SCA-Pbest, which is the same as the concept of Pbest in PSO each iteration. In addition, the solution also keeps track of the optimal value achieved so far by any nearby solution. As a new concept in SCA, Pbest and Gbest enhance the exploitation ability of SCA. The pseudocode of SCA_PSO is shown in Pseudocode 1.


## 3. Proposed ESCA_PSO

The improved ESCA_PSO is combined with two efficient strategies. Firstly, a DE with the “random variation” mode is successfully combined with the SCA_PSO to strengthen the global search capability of the SCA_PSO. Then, a combined mutation with the mixed distributions of Gaussian, Cauchy, and Lévy was added to the combination mutation strategy, which can further improve the accuracy of the solution.Pseudocode 1: The pseudocode of the SCA_PSO.
Input:MaxFEs,dim,ub,lbOutput:best_fitnessWhilet≤MaxFEsFor each search agentCalculate fitness valueIf fitness value<SCA_Pbest in the iterationMove the current value to<SCA_Pbest matrixEnd ifIf Fitness value<SCA_GbestSet current value as<SCA_GbestEnd ifEnd forFor each search agentUpdater1,r2,r3,r4Ifr4<0.5UpdateX using Eq.(1)ElseUpdateX using Eq.(2)End ifCheck and correct the new positions based onub, lbEnd forFor each particleInitialize particle withPSO_PbestSetPSO_Gbest as SCA_GbestEnd forWhilet≤MaxFEsFor each particleCalculate fitness valueIf fitness value<PSO_Pbest in historySet current value as newPSO_PbestEnd ifEnd forChoose the particle with the best fitness value of all the particle as thePSO_GbestFor each particlevit+1=wt+C1∗rand∗SCA_Pbestt−xit+C2∗rand∗SCA_Gbestt−xitxit+1=xit+1+vit+1End forEnd whilebest_fitness = PSO_GbestReturnbest_fitness


### 3.1. Combined Mutation of Gaussian, Cauchy, and Lévy

Gaussian distribution (GD) [48] is a significant probability distribution in many subjects such as engineering and mathematics. GD has many excellent features. Plenty of random variables and objects in nature can be presumably expressed as GD, and many probability distributions can be approximated or exported by this distribution. The probability density function of the GD can be expressed according to Eq. (5):
(5)fx=12πσexp−x−μ22σ2,where μ and σ represent the mean and standard deviation, respectively.Cauchy distribution [49] is also called Cauchy-Lorentz distribution. It is a continuous probability distribution named after Augustine-Louis-Cauchy and Hendrick-Lorentz. It is similar to normal distribution. Cauchy distribution is also widely used in statistics. It has the characteristics of the nonexistence of expectation and variance and additivity. The probability density function of the Cauchy distribution can be expressed according to Eq. (6):
(6)fx;x0,y=1πγx−x02+γ2,where x0 is the position parameter defining the location of the distribution peak; γ is the scale parameter defining half the width of the maximum half.Lévy flights [50] based on Lévy distribution are consistent with the search behavior of many organisms in the nature and are widely used in optimization algorithms and optimal search processes. Moreover, the stochastic process can maximize the search efficiency of resources under uncertain conditions. In the search process, Lévy flights can make the whole search process more effective and stable, balancing the proportion of local search and global search. Due to the existence of the random process of the Lévy flight, the short-range exploratory local search and the occasional long-distance walk are in phase. Thus, the algorithm’s local searching speed is faster, and the solutions are more easily searched near the current optimum. The decomposition can search far away from the current optimal value, thus ensuring that the algorithm does not fall into the local optimum (LO). The Lévy formula used is as follows:
(7)σ=Γ1+βsinπβ/2Γ1+β/2β2β‐1/21/β,where Γ (x) is a continuation function of the factorial, that is, when the x is a positive integer Γx+1=x! The value of the variable β determines the shape of the Lévy probability density function, especially in the tail area.
(8)γ=μv1/β,where γ is the flight step, v, is the standard normal distribution, and μ is a normal distribution with the mean of 0 and the variance of σ2.


### 3.2. Combined Mutation Strategy

As mentioned in the foregoing, the DE algorithm can enhance the global search capability of SCA_PSO, while mutation of Gaussian, Cauchy, and Lévy is algorithms that can make the algorithm perform better in local search. A combined mutation strategy was proposed in this study, which combined the different characteristics of the three mutation strategies, making the SCA_PSO find a more balanced manner in performing explorative search and exploitative search. The whole algorithm steps are as shown below:Step 1. Search using the mentioned SCA.Step 2. Mutate the SCA_PSO by the DE algorithm and the new individual will be retained if its fitness value is better than the original one.Step 3. Update using the formula of SCA_PSO. The update formula used is as follows:(9)vk=w∙vk+c1∙r2∙pbest−xik+c2∙r3∙SCAGbestxik,(10)xik=xik+vk,where c1, c2=2.r2, and r3 are in the range of [0, 1].Step 4. Use combined mutation of Gaussian, Cauchy, and Lévy to mutate the current optimal individuals, find the individuals with the smallest of the three results, and update the fitness values and corresponding individuals.(11)X=minX_m_Levy,X_m_gaus,X_m_cauchy,(12)Xmgaus=Xit∙1+k∙randn,(13)Xmcauchy=Xit∙1+k∙cauchy,(14)XmLevy=Xit∙1+k∙Levy1,where X_m_Lévy, X_m_gaus, and X_m_cauchy are the values obtained by the Lévy, Gaussian, and Cauchy strategies, respectively.Pseudocode2 and Figure 1 display the detailed steps and flowchart of ESCA_PSO, respectively.Figure 1
Flowchart of ESCA_PSO.First of all, the current optimal individualSCA_Gbest is obtained by SCA. Then, the particle swarm population is initialized with the help of SCA_Gbest and mutated with the help of DE strategy. Next, the population is updated using SCA_PSO. Finally, it is updated by Gaussian, Cauchy, and Lévy flight strategies.Pseudocode 2: Pseudocode of the ESCA_PSO.
Input: noP,MaxFEs, ub, lb, dim, fobj.Output: SCA_gbest, cg_curve.While (t≤MaxFEs)For each search agentCalculate fitness agentIf fitness value < SCA_Pbest in this iterationMove the current value toSCA_Pbest matrixEnd ifIf Fitness value < SCA_GbestSet current value asSCA_GbestEnd ifEnd forFor each search agentUpdater1,r2,r3,r4Ifr4<0.5Update X using Eq.(1)ElseUpdate X using Eq.(2)End ifCheck and correct the new positions based onub, lbEnd forFor each particleInitialize particle withPSO_PbestSetPSO_Gbest as SCA_GbestEnd forPerform DE strategyWhiletPSO≤PSOMaxFEsFor each particleCalculate fitness valueIf fitness value<PSO_Pbest in historySet current value as newPSO_PbestEnd ifEnd forChoose the particle with the best fitness value of all the particle as thePSO_GbestFor each particleUpdatevk with Eq. (9)Updatevk with Eq. (10)End forEnd whileUpdate X_m_Levy using Eq. (14)Update X_m_gaus using Eq. (12)Update X_m_cauchy using Eq. (13)End whileReturnSCAgbestandcg_curve


### 3.3. Complexity Analysis

The time complexity of the ESCA_PSO is mainly related to the number of four factors, which are algorithm iterations (T), PSO’s iterations (P), population (N), and dimensions (D). And the whole time complexity is analyzed as follows: OESCA_PSO=Oinitialize+T×Ocalculatethefitnessofpopulation+OupdatelocationwithSCA+P×Ocalculatethefitnessofpopulation+OupdatelocationwithPSO+Operformcombinedmutationstrategy. The time complexity of initialization is ON×D. Since there are N individuals, the fitness of the initial populations is ON. Updating location with SCA is ON. Updating location with PSO is O (N×D). Performing the combined mutation strategy is ON. All in all, it is not difficult to conclude that the total time complexity of ESCA_PSO is OESCA_PSO=ON×D+T×ON+ON+P×ON+ON×D+ON=ON×D+T×2ON+P×ON+ON×D+ON.


## 3.1. Combined Mutation of Gaussian, Cauchy, and Lévy

Gaussian distribution (GD) [48] is a significant probability distribution in many subjects such as engineering and mathematics. GD has many excellent features. Plenty of random variables and objects in nature can be presumably expressed as GD, and many probability distributions can be approximated or exported by this distribution. The probability density function of the GD can be expressed according to Eq. (5):
(5)fx=12πσexp−x−μ22σ2,where μ and σ represent the mean and standard deviation, respectively.Cauchy distribution [49] is also called Cauchy-Lorentz distribution. It is a continuous probability distribution named after Augustine-Louis-Cauchy and Hendrick-Lorentz. It is similar to normal distribution. Cauchy distribution is also widely used in statistics. It has the characteristics of the nonexistence of expectation and variance and additivity. The probability density function of the Cauchy distribution can be expressed according to Eq. (6):
(6)fx;x0,y=1πγx−x02+γ2,where x0 is the position parameter defining the location of the distribution peak; γ is the scale parameter defining half the width of the maximum half.Lévy flights [50] based on Lévy distribution are consistent with the search behavior of many organisms in the nature and are widely used in optimization algorithms and optimal search processes. Moreover, the stochastic process can maximize the search efficiency of resources under uncertain conditions. In the search process, Lévy flights can make the whole search process more effective and stable, balancing the proportion of local search and global search. Due to the existence of the random process of the Lévy flight, the short-range exploratory local search and the occasional long-distance walk are in phase. Thus, the algorithm’s local searching speed is faster, and the solutions are more easily searched near the current optimum. The decomposition can search far away from the current optimal value, thus ensuring that the algorithm does not fall into the local optimum (LO). The Lévy formula used is as follows:
(7)σ=Γ1+βsinπβ/2Γ1+β/2β2β‐1/21/β,where Γ (x) is a continuation function of the factorial, that is, when the x is a positive integer Γx+1=x! The value of the variable β determines the shape of the Lévy probability density function, especially in the tail area.
(8)γ=μv1/β,where γ is the flight step, v, is the standard normal distribution, and μ is a normal distribution with the mean of 0 and the variance of σ2.


## 3.2. Combined Mutation Strategy

As mentioned in the foregoing, the DE algorithm can enhance the global search capability of SCA_PSO, while mutation of Gaussian, Cauchy, and Lévy is algorithms that can make the algorithm perform better in local search. A combined mutation strategy was proposed in this study, which combined the different characteristics of the three mutation strategies, making the SCA_PSO find a more balanced manner in performing explorative search and exploitative search. The whole algorithm steps are as shown below:Step 1. Search using the mentioned SCA.Step 2. Mutate the SCA_PSO by the DE algorithm and the new individual will be retained if its fitness value is better than the original one.Step 3. Update using the formula of SCA_PSO. The update formula used is as follows:(9)vk=w∙vk+c1∙r2∙pbest−xik+c2∙r3∙SCAGbestxik,(10)xik=xik+vk,where c1, c2=2.r2, and r3 are in the range of [0, 1].Step 4. Use combined mutation of Gaussian, Cauchy, and Lévy to mutate the current optimal individuals, find the individuals with the smallest of the three results, and update the fitness values and corresponding individuals.(11)X=minX_m_Levy,X_m_gaus,X_m_cauchy,(12)Xmgaus=Xit∙1+k∙randn,(13)Xmcauchy=Xit∙1+k∙cauchy,(14)XmLevy=Xit∙1+k∙Levy1,where X_m_Lévy, X_m_gaus, and X_m_cauchy are the values obtained by the Lévy, Gaussian, and Cauchy strategies, respectively.Pseudocode2 and Figure 1 display the detailed steps and flowchart of ESCA_PSO, respectively.Figure 1
Flowchart of ESCA_PSO.First of all, the current optimal individualSCA_Gbest is obtained by SCA. Then, the particle swarm population is initialized with the help of SCA_Gbest and mutated with the help of DE strategy. Next, the population is updated using SCA_PSO. Finally, it is updated by Gaussian, Cauchy, and Lévy flight strategies.Pseudocode 2: Pseudocode of the ESCA_PSO.
Input: noP,MaxFEs, ub, lb, dim, fobj.Output: SCA_gbest, cg_curve.While (t≤MaxFEs)For each search agentCalculate fitness agentIf fitness value < SCA_Pbest in this iterationMove the current value toSCA_Pbest matrixEnd ifIf Fitness value < SCA_GbestSet current value asSCA_GbestEnd ifEnd forFor each search agentUpdater1,r2,r3,r4Ifr4<0.5Update X using Eq.(1)ElseUpdate X using Eq.(2)End ifCheck and correct the new positions based onub, lbEnd forFor each particleInitialize particle withPSO_PbestSetPSO_Gbest as SCA_GbestEnd forPerform DE strategyWhiletPSO≤PSOMaxFEsFor each particleCalculate fitness valueIf fitness value<PSO_Pbest in historySet current value as newPSO_PbestEnd ifEnd forChoose the particle with the best fitness value of all the particle as thePSO_GbestFor each particleUpdatevk with Eq. (9)Updatevk with Eq. (10)End forEnd whileUpdate X_m_Levy using Eq. (14)Update X_m_gaus using Eq. (12)Update X_m_cauchy using Eq. (13)End whileReturnSCAgbestandcg_curve


## 3.3. Complexity Analysis

The time complexity of the ESCA_PSO is mainly related to the number of four factors, which are algorithm iterations (T), PSO’s iterations (P), population (N), and dimensions (D). And the whole time complexity is analyzed as follows: OESCA_PSO=Oinitialize+T×Ocalculatethefitnessofpopulation+OupdatelocationwithSCA+P×Ocalculatethefitnessofpopulation+OupdatelocationwithPSO+Operformcombinedmutationstrategy. The time complexity of initialization is ON×D. Since there are N individuals, the fitness of the initial populations is ON. Updating location with SCA is ON. Updating location with PSO is O (N×D). Performing the combined mutation strategy is ON. All in all, it is not difficult to conclude that the total time complexity of ESCA_PSO is OESCA_PSO=ON×D+T×ON+ON+P×ON+ON×D+ON=ON×D+T×2ON+P×ON+ON×D+ON.


## 4. Experimental Results

To confirm the effectiveness of ESCA_PSO, the proposed ESCA_PSO is compared with other competitive metaheuristic algorithms on 30 functions of CEC2014 in this part. And then ESCA_PSO carries on the variation mechanism contrast experiment. Finally, ESCA_PSO is used for tuning SVM’s parameters for medical diagnosis purposes.


### 4.1. Benchmark Functions

This experiment used 30 classical functions to substantiate the proposed method and other competitors. These functions include unimodal, multimodal, composition, and hybrid functions. F1-F3 are unimodal functions, F4-F16 are multimodal functions, and F17-F22 are hybrid functions. F23-F30 are composition functions, which are selected from CEC2014. These 30 different benchmark functions can comprehensively estimate the performance of the ESCA_PSO. The related descriptions are demonstrated in Table1, where range means the boundary of the search space for the relevant functions. As we all know, a unimodal function corresponds to a globally optimal solution; so, it can be employed to benchmark development capability. Conversely, the multimodal function possesses a lot of LO solutions, which leads to the algorithm falling into LO. Such functions can test the capability of the method to refrain from stagnation and exploration ability. Moreover, both the hybrid function and multimodal function only have one global optimum but multiple LO solutions. The structures of composition functions are more complex.Table 1
Description of 30 benchmark functions.
IDFunction equationRangeOptimum valueUnimodal functionsF1Rotated high conditioned elliptic function[-100, 100]f1Xmin=100F2Rotated bent cigar function[-100, 100]f2Xmin=200F3Rotated discus function[-100, 100]f3Xmin=300Simple multimodal functionsF4Shifted and rotated Rosenbrock’s function[-100, 100]f4Xmin=400F5Shifted and rotated Ackley’s function[-100, 100]f5Xmin=500F6Shifted and rotated Weierstrass function[-100, 100]]f6Xmin=600F7Shifted and rotated Griewank’s function[-100, 100]f7Xmin=700F8Shifted Rastrigin’s function[-100, 100]f8Xmin=800F9Shifted and rotated Rastrigin’s function[-100, 100]f9Xmin=900F10Shifted Schwefel’s function[-100, 100]f10Xmin=1000F11Shifted and rotated Schwefel’s function[-100, 100]f11Xmin=1100F12Shifted and rotated Katsuura function[-100, 100]f12Xmin=1200F13Shifted and rotated HappyCat function[-100, 100]f13Xmin=1300F14Shifted and rotated HGBat function[-100, 100]f14Xmin=1400F15Shifted and rotated expanded Griewank’s plus Rosenbrock’s function[-100, 100]f15Xmin=1500F16Shifted and rotated expanded Scaffer’s F6 function[-100, 100]f16Xmin=1600Hybrid functionsF17Hybrid function 1 (N=3)[-100, 100]f15Xmin=1700F18Hybrid function 2 (N=3)[-100, 100]f16Xmin=1800F19Hybrid function 3 (N=4)[-100, 100]f17Xmin=1900F20Hybrid function 4 (N=4)[-100, 100]f18Xmin=2000F21Hybrid function 5 (N=5)[-100, 100]f19Xmin=2100F22Hybrid function 6 (N=5)[-100, 100]f22Xmin=2200Composition functionsF23Composition function 1 (N=5)[-100, 100]f23Xmin=2300F24Composition function 2 (N=3)[-100, 100]f24Xmin=2400F25Composition function 3 (N=3)[-100, 100]f25Xmin=2500F26Composition function 4 (N=5)[-100, 100]f26Xmin=2600F27Composition function 5 (N=5)[-100, 100]f27Xmin=2700F28Composition function 6 (N=5)[-100, 100]f28Xmin=2800F29Composition function 7 (N=3)[-100, 100]f29Xmin=2900F30Composition function 8 (N=3)[-100, 100]f30Xmin=3000All the algorithms in the following experiments are coded on MATLAB 2014b. And to be fair, the experimental verification is carried out under the unified condition, i.e., the population size is set to 30, the maximum evaluation time is set to 300000, the dimension is set to 30, and the number of runs is set to 30.


### 4.2. Comparison with Other Algorithms

In this experiment, the ESCA_PSO was contrasted to SCA, GWO [51], MFO [52], BA [53], and PSO [54] on the functions presented in Table 1. To further validate the effect of the proposed ESCA_PSO, two improved SCA variants including SCA_PSO and SCADE [26] were involved for comparison and compare with LSHADE [55] which is the champion algorithm of CEC2014. The parameter configuration of algorithms is shown in Table 2. The detailed comparison results including the average value (Avg) of the best solution and standard deviation (Std) of every approach in 30 independent runs are displayed in Table 3.Table 2
Parameters setting for involved algorithms.
MethodParameterESCA_PSOa=2; c1=2; c2=2; vmax=6SCADEcmin=0.2; cmax=0.8; pCR=0.8SCAa=2SCA-PSOM=4; N=9; vmax=6; wmax=0.9; wmin=0.2CGSCADelta=0.1GWOa=0,2MFOb=1; t=−1,1; a=−1,−2BAa=0.5; r=0.5PSOc1=2; c2=2; vmax=6LSHADEPb=0.1; Ar=1.4Table 3
Results of ESCA_PSO versus other algorithms on 30 benchmark functions.
F1F2F3AvgStdAvgStdAvgStdESCA_PSO8.77E+063.47E+067.49E+077.38E+069.44E+032.27E+03SCADE4.23E +089.19E+072.97E+104.56E+095.46E+046.21E+03SCA2.52E+087.02E+071.76E+102.68E+093.72E+045.71E+03SCA_PSO8.01E+062.83E+063.83E+078.40E+062.99E+031.04E+03CGSCA2.85E+088.98E+071.82E+104.06E+094.15E+045.63E+03GWO5.76E+074.69E+072.18E+092.05E+093.24E+048.29E+03MFO8.50E+071.06E+081.22E+107.01E+091.10E+056.34E+04BA7.40E+052.88E+055.24E+052.80E+054.11E+021.40E+02PSO9.30E+062.45E+061.46E+081.63E+079.60E+029.65E+01LSHADE4.41E+037.34E+032.00E+023.77E-143.00E+021.74E-11F4F5F6AvgStdAvgStdAvgStdESCA_PSO4.73E+023.72E+015.21E+024.33E-026.29E+023.45E+00SCADE2.40E+035.90E+025.21E+023.58E-026.35E+021.86E+00SCA1.43E+032.20E+025.21E+024.98E-026.34E+022.32E+00SCA_PSO4.77E+024.19E+015.21E+026.37E-026.29E+023.03E+00CGSCA1.63E+032.92E+025.21E+025.14E-026.34E+022.33E+00GWO7.02E+022.37E+025.21E+025.08E-026.13E+022.06E+00MFO1.34E+038.51E+025.20E+021.59E-016.24E+023.73E+00BA4.40E+023.98E+015.21E+025.19E-026.34E+023.36E+00PSO4.68E+023.39E+015.21E+024.82E-026.23E+022.99E+00LSHADE4.04E+021.61E+015.20E+021.00E-036.11E+022.23E+00F7F8F9AvgStdAvgStdAvgStdESCA_PSO7.02E+025.88E-029.83E+022.14E+011.13E+032.09E+01SCADE9.10E+023.53E+011.07E+031.63E+011.21E+031.63E+01SCA8.43E+022.36E+011.04E+032.05E+011.18E+031.64E+01SCA_PSO7.01E+027.70E-029.97E+023.65E+011.13E+033.53E+01CGSCA8.67E+022.74E+011.06E+031.61E+011.18E+031.59E+01GWO7.23E+021.75E+018.81E+021.77E+019.99E+022.43E+01MFO8.15E+027.39E+019.36E+022.91E+011.12E+035.57E+01BA7.01E+021.55E-011.03E+034.75E+011.20E+036.92E+01PSO7.02E+021.62E-019.71E+022.31E+011.12E+033.57E+01LSHADE7.00E+021.17E-028.00E+021.82E-019.36E+021.36E+01F10F11F12AvgStdAvgStdAvgStdESCA_PSO4.71E+036.56E+025.69E+036.28E+021.20E+033.92E-01SCADE7.41E+033.71E+028.10E+033.58E+021.20E+032.15E-01SCA6.93E+034.80E+028.10E+033.38E+021.20E+032.81E-01SCA_PSO5.26E+037.19E+025.62E+037.81E+021.20E+033.01E-01CGSCA7.19E+033.88E+028.05E+033.20E+021.20E+032.86E-01GWO3.34E+034.08E+023.93E+034.80E+021.20E+038.77E-01MFO4.56E+039.40E+025.40E+038.30E+021.20E+032.55E-01BA5.16E+036.27E+025.43E+036.13E+021.20E+033.10E-01PSO4.97E+035.63E+025.70E+035.81E+021.20E+032.82E-01LSHADE1.00E+037.66E-012.91E+034.12E+021.20E+033.80E-02F13F14F15AvgStdAvgStdAvgStdESCA_PSO1.30E+039.71E-021.40E+033.81E-021.52E+031.41E+00SCADE1.30E+033.33E-011.49E+031.18E+012.17E+047.85E+03SCA1.30E+033.27E-011.45E+038.31E+005.16E+033.72E+03SCA_PSO1.30E+036.25E-021.40E+034.86E-021.52E+031.49E+00CGSCA1.30E+033.16E-011.45E+031.06E+018.10E+035.63E+03GWO1.30E+033.97E-011.41E+037.06E+001.82E+038.98E+02MFO1.30E+031.45E+001.43E+032.16E+011.28E+053.08E+05BA1.30E+031.38E-011.40E+034.97E-021.53E+036.26E+00PSO1.30E+037.09E-021.40E+031.19E-011.52E+031.11E+00LSHADE1.30E+037.43E-021.40E+039.17E-021.51E+031.76E+00F16F17F18AvgStdAvgStdAvgStdESCA_PSO1.61E+033.67E-014.35E+052.41E+051.93E+066.44E+05SCADE1.61E+032.26E-011.58E+075.49E+061.54E+089.16E+07SCA1.61E+032.37E-015.52E+062.43E+061.74E+087.49E+07SCA_PSO1.61E+034.47E-011.79E+051.09E+057.62E+054.43E+05CGSCA1.61E+032.29E-016.77E+063.75E+061.43E+087.47E+07GWO1.61E+037.29E-011.49E+061.54E+062.88E+061.02E+07MFO1.61E+034.74E-012.40E+063.10E+062.64E+079.98E+07BA1.61E+032.59E-011.09E+058.01E+049.42E+044.63E+04PSO1.61E+035.31E-012.76E+051.21E+052.19E+067.43E+05LSHADE1.61E+033.85E-011.49E+046.33E+041.95E+035.46E+01F19F20F21AvgStdAvgStdAvgStdESCA_PSO1.92E+032.29E+003.81E+031.57E+031.29E+051.10E+05SCADE2.02E+031.98E+012.52E+041.06E+042.18E+061.12E+06SCA1.99E+032.80E+011.56E+043.39E+031.23E+066.00E+05SCA_PSO1.92E+032.72E+002.47E+032.22E+029.35E+044.63E+04CGSCA1.99E+031.65E+011.88E+045.54E+031.67E+067.22E+05GWO1.94E+032.47E+011.97E+041.35E+046.56E+051.16E+06MFO1.96E+034.95E+017.19E+048.18E+048.20E+051.10E+06BA1.92E+031.83E+012.36E+031.13E+025.26E+043.10E+04PSO1.92E+032.43E+002.32E+037.07E+011.17E+056.92E+04LSHADE1.91E+031.84E+003.11E+033.51E+032.78E+032.77E+02F22F23F24AvgStdAvgStdAvgStdESCA_PSO2.97E+032.43E+022.50E+030.00E+002.60E+030.00E+00SCADE3.11E+031.85E+022.50E+030.00E+002.60E+035.15E-06SCA2.99E+031.42E+022.67E+031.07E+012.60E+031.00E-01SCA_PSO3.17E+032.89E+022.50E+030.00E+002.60E+030.00E+00CGSCA3.07E+031.26E+022.50E+030.00E+002.60E+033.55E-06GWO2.59E+031.83E+022.63E+039.77E+002.60E+039.56E-04MFO3.12E+032.90E+022.66E+032.48E+012.68E+032.64E+01BA3.33E+033.17E+022.62E+033.12E-032.67E+033.46E+01PSO2.90E+032.61E+022.62E+037.09E-012.63E+035.18E+00LSHADE2.43E+039.48E+012.62E+031.88E-122.64E+036.32E+00F25F26F27AvgStdAvgStdAvgStdESCA_PSO2.70E+030.00E+002.70E+031.27E-012.90E+030.00E+00SCADE2.70E+030.00E+002.70E+034.66E-013.20E+032.10E+02SCA2.73E+038.20E+002.70E+035.56E-013.57E+033.51E+02SCA_PSO2.70E+030.00E+002.77E+034.48E+012.90E+030.00E+00CGSCA2.70E+030.00E+002.70E+033.72E-012.90E+030.00E+00GWO2.71E+033.94E+002.74E+036.01E+013.32E+031.24E+02MFO2.72E+038.77E+002.70E+031.42E+003.66E+031.76E+02BA2.73E+031.44E+012.70E+031.35E-013.91E+034.20E+02PSO2.71E+035.98E+002.78E+034.07E+013.39E+032.97E+02LSHADE2.71E+033.23E+002.71E+033.04E+013.25E+039.56E+01F28F29F30AvgStdAvgStdAvgStdESCA_PSO3.00E+030.00E+003.19E+038.63E+013.88E+036.83E+02SCADE4.96E+039.21E+021.91E+071.01E+074.90E+051.70E+05SCA4.84E+032.97E+021.37E+077.32E+062.39E+057.38E+04SCA_PSO3.00E+030.00E+001.26E+043.99E+041.53E+041.08E+04CGSCA3.00E+030.00E+003.10E+030.00E+003.20E+030.00E+00GWO3.84E+032.03E+026.26E+052.36E+064.88E+044.04E+04MFO3.98E+032.29E+023.06E+063.58E+065.65E+044.66E+04BA5.29E+036.59E+023.13E+073.38E+071.30E+041.23E+04PSO7.32E+038.69E+029.61E+041.83E+051.44E+047.29E+03LSHADE3.73E+037.27E+013.68E+034.12E+015.47E+031.26E+03We can see that the advantages of ESCA_PSO are not very obvious in the unimodal functions and multimodal functions. In these functions, ESCA_PSO is slightly better than the original algorithm SCA and its variants CGSCA and SCADE. But compared with high-quality algorithms such as LSHADE, there is still a certain gap. However, ESCA_PSO has a very good performance in the complex structure of the composition functions. Compared with other algorithms on F23-F30, it ranks first or second.By the Friedman test, we can get the average ranking of test algorithms, which is usually used to get the difference between many test results. At the same time, to further analyze the experimental structure, Wilcoxon signed-rank test was adopted for statistical work.In Table4, all experimental results were taken from those two tests mentioned above. AVG in the table represents the average ranking of algorithms obtained by the Friedman test, and “+/-/=” represents the performance of the function compared with ESCA_PSO. Specifically, “+” means ESCA_PSO is better than this algorithm, “-” indicates that ESCA_PSO is inferior to this algorithm, and “=” means that the performance is similar to ESCA_PSO. In Wilcoxon signed-rank test, when the p value is less than 0.05, the performance between the two algorithms is significant. It was also used to evaluate the significance of ESCA_PSO versus other approaches. It can see from the table that ESCA ranks second on average, which is better than other algorithms overall. Compared with SCA, SCADE, CGSCA, GWO, and MFO, it is significantly better than 20 functions. However, it is indeed weaker than the champion algorithm LSHADE on multimodal functions and unimodal functions.Table 4
Thep value of ESCA_PSO compared with other algorithms.
(a)FESCA_PSOSCADESCASCA_PSOCGSCAGWOF1N/A1.73E-06+1.73E-06+2.80E-011.73E-06+2.88E-06+F2N/A1.73E-06+1.73E-06+1.73E-06—1.73E-06+1.73E-06+F3N/A1.73E-06+1.73E-06+1.92E-06—1.73E-06+1.73E-06+F4N/A1.73E-06+1.73E-06+8.77E-011.73E-06+1.92E-06+F5N/A1.78E-011.25E-02—6.27E-021.48E-02—1.59E-01F6N/A3.52E-06+1.02E-05+4.53E-011.24E-05+1.73E-06—F7N/A1.73E-06+1.73E-06+1.73E-06—1.73E-06+1.73E-06+F8N/A1.73E-06+1.92E-06+1.53E-011.73E-06+1.73E-06—F9N/A1.73E-06+2.35E-06+5.30E-011.73E-06+1.73E-06—F10N/A1.73E-06+1.73E-06+9.84E-03+1.73E-06+1.73E-06—F11N/A1.73E-06+1.73E-06+6.88E-011.73E-06+1.73E-06—F12N/A2.37E-05+2.58E-03+8.94E-014.53E-04+3.18E-01F13N/A1.73E-06+1.73E-06+4.99E-03—1.73E-06+2.43E-02—F14N/A1.73E-06+1.73E-06+2.70E-02—1.73E-06+5.22E-06+F15N/A1.73E-06+1.73E-06+5.44E-011.73E-06+4.86E-05+F16N/A3.88E-06+1.73E-06+1.96E-03+1.92E-06+2.88E-06—F17N/A1.73E-06+1.73E-06+1.48E-04—1.73E-06+7.71E-04+F18N/A1.73E-06+1.73E-06+2.35E-06—1.73E-06+2.07E-02+F19N/A1.73E-06+1.73E-06+7.97E-011.73E-06+1.74E-04+F20N/A1.73E-06+1.73E-06+1.92E-06—1.73E-06+2.88E-06+F21N/A1.73E-06+1.73E-06+7.19E-021.73E-06+1.15E-04+F22N/A6.42E-03+3.18E-014.11E-03+1.36E-017.69E-06—F23N/A1.00E+001.73E-06+1.00E+001.00E+001.73E-06+F24N/A1.56E-02+1.73E-06+1.00E+002.44E-04+1.73E-06+F25N/A1.00E+001.73E-06+1.00E+001.00E+003.79E-06+F26N/A1.73E-06+1.73E-06+1.64E-05+1.73E-06+4.68E-03+F27N/A5.96E-05+1.73E-06+1.00E+001.00E+001.73E-06+F28N/A1.23E-05+1.73E-06+1.00E+001.00E+001.73E-06+F29N/A1.73E-06+1.73E-06+5.11E-03+5.61E-06—1.73E-06+F30N/A1.73E-06+1.73E-06+6.75E-05+1.32E-04—1.73E-06++/-/=/27/0/328/1/16/8/1022/3/520/8/2Avg2109375(b)FMFOBAPSOLSHADEF13.18E-06+1.73E-06—2.99E-011.73E-06—F21.73E-06+1.73E-06—1.73E-06+1.73E-06—F31.73E-06+1.73E-06—1.73E-06—1.73E-06—F41.73E-06+1.57E-02—9.75E-011.73E-06—F51.73E-06—8.45E-011.53E-011.73E-06—F61.15E-04—3.06E-04+7.69E-06—1.73E-06—F71.73E-06+1.73E-06—1.73E-06+1.73E-06—F81.64E-05—2.83E-04+5.45E-021.73E-06—F92.21E-017.51E-05+2.80E-011.73E-06—F104.53E-014.68E-03+1.85E-011.73E-06—F111.92E-011.11E-019.26E-011.73E-06—F121.73E-06—1.73E-06—4.20E-04+1.73E-06—F131.73E-06+6.56E-027.16E-04—1.80E-05—F141.73E-06+1.64E-05+1.48E-02+8.19E-05+F151.73E-06+1.92E-06+5.32E-03—1.73E-06—F164.29E-06+1.73E-06+5.30E-011.73E-06—F172.41E-03+2.88E-06—2.41E-03—2.13E-06—F183.59E-04+1.73E-06—1.85E-011.73E-06—F192.05E-04+6.87E-025.45E-021.73E-06—F201.73E-06+1.92E-06—1.92E-06—3.59E-04—F211.36E-04+2.84E-05—7.19E-011.73E-06—F224.72E-02+1.15E-04+2.21E-011.73E-06—F231.73E-06+1.73E-06+1.73E-06+4.32E-08+F241.73E-06+1.73E-06+1.73E-06+1.73E-06+F251.73E-06+1.73E-06+1.73E-06+1.73E-06+F261.73E-06+7.52E-021.24E-05+1.02E-01F271.73E-06+1.73E-06+1.73E-06+1.73E-06+F281.73E-06+1.73E-06+1.73E-06+1.73E-06+F291.73E-06+1.73E-06+8.73E-03+1.73E-06+F301.73E-06+1.73E-06+1.73E-06+4.29E-06++/-/=23/4/315/10/512/6/128/21/1Avg8641Figure2 shows nine graphs of convergence we selected. As shown in Figure 2, it can be seen that ESCA_PSO does have a good convergence rate on these functions. It quickly converges to a lower point. And ESCA_PSO has a significant improvement over than original SCA. Of course, it is undeniable that some algorithms converge faster than ESCA_PSO, but ESCA_PSO has higher quality solutions.Figure 2
Convergence curves of ESCA_PSO and other algorithms 9 selected benchmark functions.Despite the great potential of the proposed ESCA_PSO, the approach of sacrificing a certain time complexity in exchange for an increase in terms of accuracy is insufficient side. Nevertheless, the algorithm is still competitive with LSHADE in unimodal and multimodal functions.


### 4.3. Comparison of Mutation Mechanism

As mentioned earlier, three mutation mechanisms were added to ESCA_PSO. To further analyze ESCA_PSO, we conducted comparative experiments on the mutation mechanism of ESCA in this section.To compare the mutation mechanism, we construct three algorithms, namely, ESCA_PSO1, ESCA_PSO2, and ESCA_PSO3. Compared with ESCA_PSO, ESCA_PSO1 only uses Gaussian mutation while others remain unchanged. By analogy, ESCA_PSO2 only uses the Cauchy mutation while ESCA_PSO3 only uses the Lévy mutation. The population dimension and the total number of iterations of this experiment are the same as those in the previous experiment settings.The results obtained from the experiments are shown in Table5, and there is not much difference between these four algorithms, which can be concluded by comparing the whole data. This is because most of the four algorithms are the same, and only the mutation mechanism has changed. From the numerical value obtained from the experiment, ESCA_PSO has not achieved the best results in functions many times. But relatively, ESCA_PSO is rarely ranked last. This is also because ESCA_PSO integrates three mutation mechanisms, which makes it applicable to more functions.Table 5
Results of mutation mechanism comparison experiment.
F1F2F3AvgStdvAvgStdvAvgStdvESCA_PSO1.0121E+074.1281E+067.2870E+076.7257E+069.0781E+031.6748E+03ESCA_PSO11.0956E+076.3712E+067.5147E+077.5579E+069.4351E+032.5065E+03ESCA_PSO28.8248E+064.3297E+067.5579E+076.4189E+068.9495E+032.0387E+03ESCA_PSO38.9362E+063.2913E+067.6554E+075.5330E+068.2034E+032.8244E+03F4F5F6AvgStdvAvgStdvAvgStdvESCA_PSO4.7228E+024.7567E+015.2095E+027.3218E-026.2832E+023.6455E+00ESCA_PSO14.8246E+024.3094E+015.2093E+025.9358E-026.2994E+023.6753E+00ESCA_PSO24.8304E+023.1844E+015.2095E+024.0250E-026.2907E+022.8954E+00ESCA_PSO34.6323E+023.5952E+015.2094E+026.0599E-026.2602E+023.6698E+00F7F8F9AvgStdvAvgStdvAvgStdvESCA_PSO7.0165E+026.6719E-029.7250E+021.7061E+011.1273E+032.1663E+01ESCA_PSO17.0165E+025.8391E-029.7622E+022.0619E+011.1213E+032.3921E+01ESCA_PSO27.0164E+024.8112E-029.7878E+021.5477E+011.1222E+032.4011E+01ESCA_PSO37.0163E+026.2317E-029.5729E+021.6848E+011.1358E+033.5018E+01F10F11F12AvgStdvAvgStdvAvgStdvESCA_PSO4.9137E+037.2648E+025.6985E+035.0594E+021.2023E+033.2946E-01ESCA_PSO14.9133E+036.5258E+025.6409E+037.1573E+021.2023E+032.7883E-01ESCA_PSO24.9278E+036.4952E+025.6196E+035.2887E+021.2023E+032.8632E-01ESCA_PSO33.9106E+037.0806E+025.7900E+036.4145E+021.2025E+031.9371E-01F13F14F15AvgStdvAvgStdvAvgStdvESCA_PSO1.3005E+038.0129E-021.4003E+035.5878E-021.5178E+031.8461E+00ESCA_PSO11.3004E+036.5982E-021.4002E+033.9799E-021.5176E+031.4145E+00ESCA_PSO21.3005E+031.3432E-011.4003E+035.0665E-021.5173E+031.5482E+00ESCA_PSO31.3004E+039.2885E-021.4003E+031.0046E-011.5168E+031.2616E+00F16F17F18AvgStdvAvgStdvAvgStdvESCA_PSO1.6119E+033.7281E-013.5341E+051.5577E+051.9265E+065.4288E+05ESCA_PSO11.6121E+032.7974E-014.7094E+055.3309E+051.9803E+065.1404E+05ESCA_PSO21.6120E+033.9442E-014.2443E+053.0521E+052.1497E+064.0650E+05ESCA_PSO31.6117E+033.5803E-014.4610E+053.0212E+051.7955E+064.8630E+05F19F20F21AvgStdvAvgStdvAvgStdvESCA_PSO1.9176E+032.6584E+004.6963E+032.1120E+031.5933E+051.2738E+05ESCA_PSO11.9195E+031.1064E+014.8166E+032.4521E+031.6422E+051.1183E+05ESCA_PSO21.9182E+032.6893E+004.2130E+031.8120E+031.7741E+051.5670E+05ESCA_PSO31.9210E+031.6909E+012.5728E+033.9978E+021.2953E+059.6487E+04F22F23F24AvgStdvAvgStdvAvgStdvESCA_PSO3.0075E+032.5470E+022.5000E+030.0000E+002.6000E+030.0000E+00ESCA_PSO13.0277E+031.8557E+022.5000E+030.0000E+002.6000E+030.0000E+00ESCA_PSO22.9865E+032.5463E+022.5000E+030.0000E+002.6000E+030.0000E+00ESCA_PSO32.8237E+032.0355E+022.5942E+034.7914E+012.6000E+033.1173E-04F25F26F27AvgStdvAvgStdvAvgStdvESCA_PSO2.7000E+030.0000E+002.7004E+037.7168E-022.9000E+030.0000E+00ESCA_PSO12.7000E+030.0000E+002.7004E+039.2230E-022.9000E+030.0000E+00ESCA_PSO22.7000E+030.0000E+002.7137E+033.4412E+012.9000E+030.0000E+00ESCA_PSO32.7000E+030.0000E+002.7004E+037.1707E-023.4906E+033.4856E+02F28F29F30AvgStdvAvgStdvAvgStdvESCA_PSO3.0000E+030.0000E+003.1619E+035.6888E+013.7103E+036.0049E+02ESCA_PSO13.0000E+030.0000E+003.4574E+034.0471E+025.0126E+031.8702E+03ESCA_PSO23.0000E+030.0000E+007.4310E+042.6321E+051.1615E+048.8958E+03ESCA_PSO33.9181E+038.8744E+023.1047E+034.4337E+003.2472E+034.9782E+01Figure3 shows several convergence graphs in this experiment. From the figure, we can see that in F2, F17, and F19, the convergence curves of the four algorithms are relatively similar, and there is no big difference in general. In F27 and F28, the performance of ESCA_PSO3 is not as good as the other three algorithms. In F29 and F30, ESCA_PSO2 is quite different from the other three algorithms. However, ESCA_PSO can keep a good level in these functions. This shows that the combination of three different mutation mechanisms can help the algorithm adapt to more functions.Figure 3
Convergence curves of ESCA_PSO and other algorithms 9 selected benchmark functions.However, ESCA_PSO that we proposed is not perfect, and there are certain limitations. In the benchmark functions experiment, it can be seen that there is still a gap between the performance of this algorithm and champion algorithms in unimodal functions and multimodal functions.


### 4.4. ESCA_PSO For Optimization of SVM

Like many other machine learning methods [56], SVM has many advantages such as “simple structure,” “overcoming dimension disaster,” and “small sample,” which can overcome the weaknesses of conventional neural networks such as poor learning and generalization ability [57]. Since its introduction, SVM has found its application in many practical problems. Practice shows that the penalty factor C and kernel function variable g have the key influence on the recognition accuracy of the SVM model when solving the recognition problem based on the radial basis kernel function. When the penalty factor C is small, the recognition rate of training and test samples is low, and the SVM is under learning. When C is too large, the accuracy of the training sample is higher, the test sample recognition rate is lower, and the SVM is overlearning. The smaller the kernel function parameter g is, the higher the training sample recognition rate is and the lower the accuracy of the test sample is. When g is larger, the accuracy of training and test samples becomes lower, and SVM is under learning. Traditional methods such as trial and error method and network search method cannot meet the requirements of accuracy in practical application. Currently, with the development and maturity of MAs, good results have been achieved in improving the performance of the SVM model. For example, Li et al. [58] proposed moth-flame optimization (MFO) to tune the best parameters of SVM and applied it to the diagnosis of tuberculous pleural effusion. Li et al. [59] proposed a chaotic enhanced gravitational search algorithm (GSA) for optimizing the parameters of SVM. Das et al. [60] proposed to use the teaching-learning-based optimization (TLBO) for parameter optimization of SVM, and the good performance was validated by a financial case. Tang et al. [61] proposed a Lévy flight-based shuffled frog-leaping algorithm for determining the best parameters of SVM. Ahmadi et al. [62] developed the imperialist competition algorithm (ICA) to determine the best parameters of SVM for stock market timing. Li et al. [22] proposed SCA to tune the best parameters of SVM, and the good results were verified on several benchmark datasets. Rojas-Dominguez et al. [63] proposed to use several metaheuristics to search for the best parameters of SVM, and the results showed that the estimation of distribution algorithms can achieve the best results. Tharwat et al. [64] proposed a chaotic antlion optimizer for tuning the best parameters, and the effectiveness was validated on an array of well-known datasets. Bablani et al. [65] proposed to use the bat algorithm (BA) to simultaneously determine the optimal parameters of SVM and the best subset of features and applied the model for dealing with the electroencephalography (EEG) data.In this study, we applied ESCA_PSO to search for the best parameters of SVM, and the resultant model was called ESCA_PSO-SVM as shown in Figure4. ESCA_PSO-SVM was applied to predict two different medical problems including the Bupa liver and the Cleveland heart.Figure 4
Flowchart of ESCA_PSO-SVM.The Bupa liver diabetes dataset has a total of 345 samples and 7 features. Table6 demonstrates the detailed results got by ESCA_PSO-SVM via 10-fold crossvalidation. As shown in Table 6, ESCA_PSO-SVM has got an average accuracy (ACC) of 73.04%, an average sensitivity of 59.18%, an average specificity of 83.81%, and an average Mathews correlation coefficient (MCC) of 0.4404.Table 6
Results obtained by ESCA_PSO-SVM on the Bupa liver problem.
FoldACC (%)Sensitivity (%)Specificity (%)MCCNo. 174.2961.5481.820.4414No. 267.6536.3682.610.2092No. 380.0071.4385.710.5794No. 482.3590.9178.260.6517No. 582.3564.2995.000.6404No. 671.4354.5579.170.3371No. 764.7155.5675.000.3099No. 862.8638.8988.240.3102No. 977.1465.0093.330.5893No. 1067.6553.3378.950.3354Avg.73.0459.1883.810.4404Max82.3590.9195.000.6517Min62.8636.3675.000.2092From Figure5, it is clear that ESCA_PSO-SVM has more excellent performance than SCA-SVM in such four indexes. Moreover, compared with the prediction accuracy, the ESCA_PSO-SVM has the best precision, while the KNN model has the lowest precision. Based on the sensitivity metric, ESCA_PSO-SVM ranked second, while BP obtained the worst values. In terms of the obtained specificity, ESCA_PSO-SVM was the best, followed by SVM, SCA-SVM, BP, KNN, and CART. In terms of the MCC, ESCA_PSO-SVM provided the best value, followed by SVM, SCA-SVM, CART, BP, and KNN. It suggests that ESCA_PSO-SVM is more advantageous and stable in solving the Bupa liver problem.Figure 5
Comparison between the ESCA_PSO-SVM and other methods on the Bupa liver problem.The Cleveland heart data was got from the UCI repository, and it includes 303 samples and 76 features. Table7 shows the detailed results of ESCA_PSO-SVM through 10-fold crossvalidation on this dataset. From Table 7, ESCA_PSO-SVM has got an average ACC of 82.81%, a sensitivity of 76.88%, a specificity of 86.38%, and an MCC of 0.6486.Table 7
Results obtained by ESCA_PSO-SVM on the Cleveland heart problem.
FoldACC (%)Sensitivity (%)Specificity (%)MCCNo. 176.6772.2283.330.5443No. 287.1078.5794.120.7427No. 383.3376.9288.240.6591No. 477.4276.9277.780.5424No. 580.0069.2388.240.5909No. 676.6778.5775.000.5345No. 783.3387.5078.570.6652No. 883.3350.00100.000.6325No. 993.5590.0095.240.8524No. 1086.6788.8983.330.7222Avg.82.8176.8886.380.6486Max93.5590.00100.000.8524Min76.6750.0075.000.5345In Figure6, ESCA_PSO-SVM is superior to SCA-SVM in terms of four evaluation indexes. Concerning the classification accuracy, it can be seen clearly that the ESCA_PSO-SVM has got the best ACC, whereas BP has the lowest precision. In terms of the sensitivity metric, the value of SVM is the same as that of ESCA_PSO-SVM which takes the first place. As for the specificity metric, although SCA-SVM ranked first place, it was only slightly superior to ESCA_PSO-SVM. According to the MCC metric, ESCA_PSO provided the best value, followed successively by SCA-SVM, SVM, KNN, CART, and BP. These all proved the robustness and stableness of the ESCA_PSO-SVM on the Cleveland heart problem. Shortly, many problems are waiting to be optimized for which ESCA_PSO can be applied, such as disease module identification [66], molecular signatures identification for cancer diagnosis [67], drug-disease associations prediction [68], drug discovery [69], and pharmacoinformatic data mining [70].Figure 6
Comparison between the ESCA_PSO-SVM and other methods on the Cleveland heart problem.


## 4.1. Benchmark Functions

This experiment used 30 classical functions to substantiate the proposed method and other competitors. These functions include unimodal, multimodal, composition, and hybrid functions. F1-F3 are unimodal functions, F4-F16 are multimodal functions, and F17-F22 are hybrid functions. F23-F30 are composition functions, which are selected from CEC2014. These 30 different benchmark functions can comprehensively estimate the performance of the ESCA_PSO. The related descriptions are demonstrated in Table1, where range means the boundary of the search space for the relevant functions. As we all know, a unimodal function corresponds to a globally optimal solution; so, it can be employed to benchmark development capability. Conversely, the multimodal function possesses a lot of LO solutions, which leads to the algorithm falling into LO. Such functions can test the capability of the method to refrain from stagnation and exploration ability. Moreover, both the hybrid function and multimodal function only have one global optimum but multiple LO solutions. The structures of composition functions are more complex.Table 1
Description of 30 benchmark functions.
IDFunction equationRangeOptimum valueUnimodal functionsF1Rotated high conditioned elliptic function[-100, 100]f1Xmin=100F2Rotated bent cigar function[-100, 100]f2Xmin=200F3Rotated discus function[-100, 100]f3Xmin=300Simple multimodal functionsF4Shifted and rotated Rosenbrock’s function[-100, 100]f4Xmin=400F5Shifted and rotated Ackley’s function[-100, 100]f5Xmin=500F6Shifted and rotated Weierstrass function[-100, 100]]f6Xmin=600F7Shifted and rotated Griewank’s function[-100, 100]f7Xmin=700F8Shifted Rastrigin’s function[-100, 100]f8Xmin=800F9Shifted and rotated Rastrigin’s function[-100, 100]f9Xmin=900F10Shifted Schwefel’s function[-100, 100]f10Xmin=1000F11Shifted and rotated Schwefel’s function[-100, 100]f11Xmin=1100F12Shifted and rotated Katsuura function[-100, 100]f12Xmin=1200F13Shifted and rotated HappyCat function[-100, 100]f13Xmin=1300F14Shifted and rotated HGBat function[-100, 100]f14Xmin=1400F15Shifted and rotated expanded Griewank’s plus Rosenbrock’s function[-100, 100]f15Xmin=1500F16Shifted and rotated expanded Scaffer’s F6 function[-100, 100]f16Xmin=1600Hybrid functionsF17Hybrid function 1 (N=3)[-100, 100]f15Xmin=1700F18Hybrid function 2 (N=3)[-100, 100]f16Xmin=1800F19Hybrid function 3 (N=4)[-100, 100]f17Xmin=1900F20Hybrid function 4 (N=4)[-100, 100]f18Xmin=2000F21Hybrid function 5 (N=5)[-100, 100]f19Xmin=2100F22Hybrid function 6 (N=5)[-100, 100]f22Xmin=2200Composition functionsF23Composition function 1 (N=5)[-100, 100]f23Xmin=2300F24Composition function 2 (N=3)[-100, 100]f24Xmin=2400F25Composition function 3 (N=3)[-100, 100]f25Xmin=2500F26Composition function 4 (N=5)[-100, 100]f26Xmin=2600F27Composition function 5 (N=5)[-100, 100]f27Xmin=2700F28Composition function 6 (N=5)[-100, 100]f28Xmin=2800F29Composition function 7 (N=3)[-100, 100]f29Xmin=2900F30Composition function 8 (N=3)[-100, 100]f30Xmin=3000All the algorithms in the following experiments are coded on MATLAB 2014b. And to be fair, the experimental verification is carried out under the unified condition, i.e., the population size is set to 30, the maximum evaluation time is set to 300000, the dimension is set to 30, and the number of runs is set to 30.


## 4.2. Comparison with Other Algorithms

In this experiment, the ESCA_PSO was contrasted to SCA, GWO [51], MFO [52], BA [53], and PSO [54] on the functions presented in Table 1. To further validate the effect of the proposed ESCA_PSO, two improved SCA variants including SCA_PSO and SCADE [26] were involved for comparison and compare with LSHADE [55] which is the champion algorithm of CEC2014. The parameter configuration of algorithms is shown in Table 2. The detailed comparison results including the average value (Avg) of the best solution and standard deviation (Std) of every approach in 30 independent runs are displayed in Table 3.Table 2
Parameters setting for involved algorithms.
MethodParameterESCA_PSOa=2; c1=2; c2=2; vmax=6SCADEcmin=0.2; cmax=0.8; pCR=0.8SCAa=2SCA-PSOM=4; N=9; vmax=6; wmax=0.9; wmin=0.2CGSCADelta=0.1GWOa=0,2MFOb=1; t=−1,1; a=−1,−2BAa=0.5; r=0.5PSOc1=2; c2=2; vmax=6LSHADEPb=0.1; Ar=1.4Table 3
Results of ESCA_PSO versus other algorithms on 30 benchmark functions.
F1F2F3AvgStdAvgStdAvgStdESCA_PSO8.77E+063.47E+067.49E+077.38E+069.44E+032.27E+03SCADE4.23E +089.19E+072.97E+104.56E+095.46E+046.21E+03SCA2.52E+087.02E+071.76E+102.68E+093.72E+045.71E+03SCA_PSO8.01E+062.83E+063.83E+078.40E+062.99E+031.04E+03CGSCA2.85E+088.98E+071.82E+104.06E+094.15E+045.63E+03GWO5.76E+074.69E+072.18E+092.05E+093.24E+048.29E+03MFO8.50E+071.06E+081.22E+107.01E+091.10E+056.34E+04BA7.40E+052.88E+055.24E+052.80E+054.11E+021.40E+02PSO9.30E+062.45E+061.46E+081.63E+079.60E+029.65E+01LSHADE4.41E+037.34E+032.00E+023.77E-143.00E+021.74E-11F4F5F6AvgStdAvgStdAvgStdESCA_PSO4.73E+023.72E+015.21E+024.33E-026.29E+023.45E+00SCADE2.40E+035.90E+025.21E+023.58E-026.35E+021.86E+00SCA1.43E+032.20E+025.21E+024.98E-026.34E+022.32E+00SCA_PSO4.77E+024.19E+015.21E+026.37E-026.29E+023.03E+00CGSCA1.63E+032.92E+025.21E+025.14E-026.34E+022.33E+00GWO7.02E+022.37E+025.21E+025.08E-026.13E+022.06E+00MFO1.34E+038.51E+025.20E+021.59E-016.24E+023.73E+00BA4.40E+023.98E+015.21E+025.19E-026.34E+023.36E+00PSO4.68E+023.39E+015.21E+024.82E-026.23E+022.99E+00LSHADE4.04E+021.61E+015.20E+021.00E-036.11E+022.23E+00F7F8F9AvgStdAvgStdAvgStdESCA_PSO7.02E+025.88E-029.83E+022.14E+011.13E+032.09E+01SCADE9.10E+023.53E+011.07E+031.63E+011.21E+031.63E+01SCA8.43E+022.36E+011.04E+032.05E+011.18E+031.64E+01SCA_PSO7.01E+027.70E-029.97E+023.65E+011.13E+033.53E+01CGSCA8.67E+022.74E+011.06E+031.61E+011.18E+031.59E+01GWO7.23E+021.75E+018.81E+021.77E+019.99E+022.43E+01MFO8.15E+027.39E+019.36E+022.91E+011.12E+035.57E+01BA7.01E+021.55E-011.03E+034.75E+011.20E+036.92E+01PSO7.02E+021.62E-019.71E+022.31E+011.12E+033.57E+01LSHADE7.00E+021.17E-028.00E+021.82E-019.36E+021.36E+01F10F11F12AvgStdAvgStdAvgStdESCA_PSO4.71E+036.56E+025.69E+036.28E+021.20E+033.92E-01SCADE7.41E+033.71E+028.10E+033.58E+021.20E+032.15E-01SCA6.93E+034.80E+028.10E+033.38E+021.20E+032.81E-01SCA_PSO5.26E+037.19E+025.62E+037.81E+021.20E+033.01E-01CGSCA7.19E+033.88E+028.05E+033.20E+021.20E+032.86E-01GWO3.34E+034.08E+023.93E+034.80E+021.20E+038.77E-01MFO4.56E+039.40E+025.40E+038.30E+021.20E+032.55E-01BA5.16E+036.27E+025.43E+036.13E+021.20E+033.10E-01PSO4.97E+035.63E+025.70E+035.81E+021.20E+032.82E-01LSHADE1.00E+037.66E-012.91E+034.12E+021.20E+033.80E-02F13F14F15AvgStdAvgStdAvgStdESCA_PSO1.30E+039.71E-021.40E+033.81E-021.52E+031.41E+00SCADE1.30E+033.33E-011.49E+031.18E+012.17E+047.85E+03SCA1.30E+033.27E-011.45E+038.31E+005.16E+033.72E+03SCA_PSO1.30E+036.25E-021.40E+034.86E-021.52E+031.49E+00CGSCA1.30E+033.16E-011.45E+031.06E+018.10E+035.63E+03GWO1.30E+033.97E-011.41E+037.06E+001.82E+038.98E+02MFO1.30E+031.45E+001.43E+032.16E+011.28E+053.08E+05BA1.30E+031.38E-011.40E+034.97E-021.53E+036.26E+00PSO1.30E+037.09E-021.40E+031.19E-011.52E+031.11E+00LSHADE1.30E+037.43E-021.40E+039.17E-021.51E+031.76E+00F16F17F18AvgStdAvgStdAvgStdESCA_PSO1.61E+033.67E-014.35E+052.41E+051.93E+066.44E+05SCADE1.61E+032.26E-011.58E+075.49E+061.54E+089.16E+07SCA1.61E+032.37E-015.52E+062.43E+061.74E+087.49E+07SCA_PSO1.61E+034.47E-011.79E+051.09E+057.62E+054.43E+05CGSCA1.61E+032.29E-016.77E+063.75E+061.43E+087.47E+07GWO1.61E+037.29E-011.49E+061.54E+062.88E+061.02E+07MFO1.61E+034.74E-012.40E+063.10E+062.64E+079.98E+07BA1.61E+032.59E-011.09E+058.01E+049.42E+044.63E+04PSO1.61E+035.31E-012.76E+051.21E+052.19E+067.43E+05LSHADE1.61E+033.85E-011.49E+046.33E+041.95E+035.46E+01F19F20F21AvgStdAvgStdAvgStdESCA_PSO1.92E+032.29E+003.81E+031.57E+031.29E+051.10E+05SCADE2.02E+031.98E+012.52E+041.06E+042.18E+061.12E+06SCA1.99E+032.80E+011.56E+043.39E+031.23E+066.00E+05SCA_PSO1.92E+032.72E+002.47E+032.22E+029.35E+044.63E+04CGSCA1.99E+031.65E+011.88E+045.54E+031.67E+067.22E+05GWO1.94E+032.47E+011.97E+041.35E+046.56E+051.16E+06MFO1.96E+034.95E+017.19E+048.18E+048.20E+051.10E+06BA1.92E+031.83E+012.36E+031.13E+025.26E+043.10E+04PSO1.92E+032.43E+002.32E+037.07E+011.17E+056.92E+04LSHADE1.91E+031.84E+003.11E+033.51E+032.78E+032.77E+02F22F23F24AvgStdAvgStdAvgStdESCA_PSO2.97E+032.43E+022.50E+030.00E+002.60E+030.00E+00SCADE3.11E+031.85E+022.50E+030.00E+002.60E+035.15E-06SCA2.99E+031.42E+022.67E+031.07E+012.60E+031.00E-01SCA_PSO3.17E+032.89E+022.50E+030.00E+002.60E+030.00E+00CGSCA3.07E+031.26E+022.50E+030.00E+002.60E+033.55E-06GWO2.59E+031.83E+022.63E+039.77E+002.60E+039.56E-04MFO3.12E+032.90E+022.66E+032.48E+012.68E+032.64E+01BA3.33E+033.17E+022.62E+033.12E-032.67E+033.46E+01PSO2.90E+032.61E+022.62E+037.09E-012.63E+035.18E+00LSHADE2.43E+039.48E+012.62E+031.88E-122.64E+036.32E+00F25F26F27AvgStdAvgStdAvgStdESCA_PSO2.70E+030.00E+002.70E+031.27E-012.90E+030.00E+00SCADE2.70E+030.00E+002.70E+034.66E-013.20E+032.10E+02SCA2.73E+038.20E+002.70E+035.56E-013.57E+033.51E+02SCA_PSO2.70E+030.00E+002.77E+034.48E+012.90E+030.00E+00CGSCA2.70E+030.00E+002.70E+033.72E-012.90E+030.00E+00GWO2.71E+033.94E+002.74E+036.01E+013.32E+031.24E+02MFO2.72E+038.77E+002.70E+031.42E+003.66E+031.76E+02BA2.73E+031.44E+012.70E+031.35E-013.91E+034.20E+02PSO2.71E+035.98E+002.78E+034.07E+013.39E+032.97E+02LSHADE2.71E+033.23E+002.71E+033.04E+013.25E+039.56E+01F28F29F30AvgStdAvgStdAvgStdESCA_PSO3.00E+030.00E+003.19E+038.63E+013.88E+036.83E+02SCADE4.96E+039.21E+021.91E+071.01E+074.90E+051.70E+05SCA4.84E+032.97E+021.37E+077.32E+062.39E+057.38E+04SCA_PSO3.00E+030.00E+001.26E+043.99E+041.53E+041.08E+04CGSCA3.00E+030.00E+003.10E+030.00E+003.20E+030.00E+00GWO3.84E+032.03E+026.26E+052.36E+064.88E+044.04E+04MFO3.98E+032.29E+023.06E+063.58E+065.65E+044.66E+04BA5.29E+036.59E+023.13E+073.38E+071.30E+041.23E+04PSO7.32E+038.69E+029.61E+041.83E+051.44E+047.29E+03LSHADE3.73E+037.27E+013.68E+034.12E+015.47E+031.26E+03We can see that the advantages of ESCA_PSO are not very obvious in the unimodal functions and multimodal functions. In these functions, ESCA_PSO is slightly better than the original algorithm SCA and its variants CGSCA and SCADE. But compared with high-quality algorithms such as LSHADE, there is still a certain gap. However, ESCA_PSO has a very good performance in the complex structure of the composition functions. Compared with other algorithms on F23-F30, it ranks first or second.By the Friedman test, we can get the average ranking of test algorithms, which is usually used to get the difference between many test results. At the same time, to further analyze the experimental structure, Wilcoxon signed-rank test was adopted for statistical work.In Table4, all experimental results were taken from those two tests mentioned above. AVG in the table represents the average ranking of algorithms obtained by the Friedman test, and “+/-/=” represents the performance of the function compared with ESCA_PSO. Specifically, “+” means ESCA_PSO is better than this algorithm, “-” indicates that ESCA_PSO is inferior to this algorithm, and “=” means that the performance is similar to ESCA_PSO. In Wilcoxon signed-rank test, when the p value is less than 0.05, the performance between the two algorithms is significant. It was also used to evaluate the significance of ESCA_PSO versus other approaches. It can see from the table that ESCA ranks second on average, which is better than other algorithms overall. Compared with SCA, SCADE, CGSCA, GWO, and MFO, it is significantly better than 20 functions. However, it is indeed weaker than the champion algorithm LSHADE on multimodal functions and unimodal functions.Table 4
Thep value of ESCA_PSO compared with other algorithms.
(a)FESCA_PSOSCADESCASCA_PSOCGSCAGWOF1N/A1.73E-06+1.73E-06+2.80E-011.73E-06+2.88E-06+F2N/A1.73E-06+1.73E-06+1.73E-06—1.73E-06+1.73E-06+F3N/A1.73E-06+1.73E-06+1.92E-06—1.73E-06+1.73E-06+F4N/A1.73E-06+1.73E-06+8.77E-011.73E-06+1.92E-06+F5N/A1.78E-011.25E-02—6.27E-021.48E-02—1.59E-01F6N/A3.52E-06+1.02E-05+4.53E-011.24E-05+1.73E-06—F7N/A1.73E-06+1.73E-06+1.73E-06—1.73E-06+1.73E-06+F8N/A1.73E-06+1.92E-06+1.53E-011.73E-06+1.73E-06—F9N/A1.73E-06+2.35E-06+5.30E-011.73E-06+1.73E-06—F10N/A1.73E-06+1.73E-06+9.84E-03+1.73E-06+1.73E-06—F11N/A1.73E-06+1.73E-06+6.88E-011.73E-06+1.73E-06—F12N/A2.37E-05+2.58E-03+8.94E-014.53E-04+3.18E-01F13N/A1.73E-06+1.73E-06+4.99E-03—1.73E-06+2.43E-02—F14N/A1.73E-06+1.73E-06+2.70E-02—1.73E-06+5.22E-06+F15N/A1.73E-06+1.73E-06+5.44E-011.73E-06+4.86E-05+F16N/A3.88E-06+1.73E-06+1.96E-03+1.92E-06+2.88E-06—F17N/A1.73E-06+1.73E-06+1.48E-04—1.73E-06+7.71E-04+F18N/A1.73E-06+1.73E-06+2.35E-06—1.73E-06+2.07E-02+F19N/A1.73E-06+1.73E-06+7.97E-011.73E-06+1.74E-04+F20N/A1.73E-06+1.73E-06+1.92E-06—1.73E-06+2.88E-06+F21N/A1.73E-06+1.73E-06+7.19E-021.73E-06+1.15E-04+F22N/A6.42E-03+3.18E-014.11E-03+1.36E-017.69E-06—F23N/A1.00E+001.73E-06+1.00E+001.00E+001.73E-06+F24N/A1.56E-02+1.73E-06+1.00E+002.44E-04+1.73E-06+F25N/A1.00E+001.73E-06+1.00E+001.00E+003.79E-06+F26N/A1.73E-06+1.73E-06+1.64E-05+1.73E-06+4.68E-03+F27N/A5.96E-05+1.73E-06+1.00E+001.00E+001.73E-06+F28N/A1.23E-05+1.73E-06+1.00E+001.00E+001.73E-06+F29N/A1.73E-06+1.73E-06+5.11E-03+5.61E-06—1.73E-06+F30N/A1.73E-06+1.73E-06+6.75E-05+1.32E-04—1.73E-06++/-/=/27/0/328/1/16/8/1022/3/520/8/2Avg2109375(b)FMFOBAPSOLSHADEF13.18E-06+1.73E-06—2.99E-011.73E-06—F21.73E-06+1.73E-06—1.73E-06+1.73E-06—F31.73E-06+1.73E-06—1.73E-06—1.73E-06—F41.73E-06+1.57E-02—9.75E-011.73E-06—F51.73E-06—8.45E-011.53E-011.73E-06—F61.15E-04—3.06E-04+7.69E-06—1.73E-06—F71.73E-06+1.73E-06—1.73E-06+1.73E-06—F81.64E-05—2.83E-04+5.45E-021.73E-06—F92.21E-017.51E-05+2.80E-011.73E-06—F104.53E-014.68E-03+1.85E-011.73E-06—F111.92E-011.11E-019.26E-011.73E-06—F121.73E-06—1.73E-06—4.20E-04+1.73E-06—F131.73E-06+6.56E-027.16E-04—1.80E-05—F141.73E-06+1.64E-05+1.48E-02+8.19E-05+F151.73E-06+1.92E-06+5.32E-03—1.73E-06—F164.29E-06+1.73E-06+5.30E-011.73E-06—F172.41E-03+2.88E-06—2.41E-03—2.13E-06—F183.59E-04+1.73E-06—1.85E-011.73E-06—F192.05E-04+6.87E-025.45E-021.73E-06—F201.73E-06+1.92E-06—1.92E-06—3.59E-04—F211.36E-04+2.84E-05—7.19E-011.73E-06—F224.72E-02+1.15E-04+2.21E-011.73E-06—F231.73E-06+1.73E-06+1.73E-06+4.32E-08+F241.73E-06+1.73E-06+1.73E-06+1.73E-06+F251.73E-06+1.73E-06+1.73E-06+1.73E-06+F261.73E-06+7.52E-021.24E-05+1.02E-01F271.73E-06+1.73E-06+1.73E-06+1.73E-06+F281.73E-06+1.73E-06+1.73E-06+1.73E-06+F291.73E-06+1.73E-06+8.73E-03+1.73E-06+F301.73E-06+1.73E-06+1.73E-06+4.29E-06++/-/=23/4/315/10/512/6/128/21/1Avg8641Figure2 shows nine graphs of convergence we selected. As shown in Figure 2, it can be seen that ESCA_PSO does have a good convergence rate on these functions. It quickly converges to a lower point. And ESCA_PSO has a significant improvement over than original SCA. Of course, it is undeniable that some algorithms converge faster than ESCA_PSO, but ESCA_PSO has higher quality solutions.Figure 2
Convergence curves of ESCA_PSO and other algorithms 9 selected benchmark functions.Despite the great potential of the proposed ESCA_PSO, the approach of sacrificing a certain time complexity in exchange for an increase in terms of accuracy is insufficient side. Nevertheless, the algorithm is still competitive with LSHADE in unimodal and multimodal functions.


## 4.3. Comparison of Mutation Mechanism

As mentioned earlier, three mutation mechanisms were added to ESCA_PSO. To further analyze ESCA_PSO, we conducted comparative experiments on the mutation mechanism of ESCA in this section.To compare the mutation mechanism, we construct three algorithms, namely, ESCA_PSO1, ESCA_PSO2, and ESCA_PSO3. Compared with ESCA_PSO, ESCA_PSO1 only uses Gaussian mutation while others remain unchanged. By analogy, ESCA_PSO2 only uses the Cauchy mutation while ESCA_PSO3 only uses the Lévy mutation. The population dimension and the total number of iterations of this experiment are the same as those in the previous experiment settings.The results obtained from the experiments are shown in Table5, and there is not much difference between these four algorithms, which can be concluded by comparing the whole data. This is because most of the four algorithms are the same, and only the mutation mechanism has changed. From the numerical value obtained from the experiment, ESCA_PSO has not achieved the best results in functions many times. But relatively, ESCA_PSO is rarely ranked last. This is also because ESCA_PSO integrates three mutation mechanisms, which makes it applicable to more functions.Table 5
Results of mutation mechanism comparison experiment.
F1F2F3AvgStdvAvgStdvAvgStdvESCA_PSO1.0121E+074.1281E+067.2870E+076.7257E+069.0781E+031.6748E+03ESCA_PSO11.0956E+076.3712E+067.5147E+077.5579E+069.4351E+032.5065E+03ESCA_PSO28.8248E+064.3297E+067.5579E+076.4189E+068.9495E+032.0387E+03ESCA_PSO38.9362E+063.2913E+067.6554E+075.5330E+068.2034E+032.8244E+03F4F5F6AvgStdvAvgStdvAvgStdvESCA_PSO4.7228E+024.7567E+015.2095E+027.3218E-026.2832E+023.6455E+00ESCA_PSO14.8246E+024.3094E+015.2093E+025.9358E-026.2994E+023.6753E+00ESCA_PSO24.8304E+023.1844E+015.2095E+024.0250E-026.2907E+022.8954E+00ESCA_PSO34.6323E+023.5952E+015.2094E+026.0599E-026.2602E+023.6698E+00F7F8F9AvgStdvAvgStdvAvgStdvESCA_PSO7.0165E+026.6719E-029.7250E+021.7061E+011.1273E+032.1663E+01ESCA_PSO17.0165E+025.8391E-029.7622E+022.0619E+011.1213E+032.3921E+01ESCA_PSO27.0164E+024.8112E-029.7878E+021.5477E+011.1222E+032.4011E+01ESCA_PSO37.0163E+026.2317E-029.5729E+021.6848E+011.1358E+033.5018E+01F10F11F12AvgStdvAvgStdvAvgStdvESCA_PSO4.9137E+037.2648E+025.6985E+035.0594E+021.2023E+033.2946E-01ESCA_PSO14.9133E+036.5258E+025.6409E+037.1573E+021.2023E+032.7883E-01ESCA_PSO24.9278E+036.4952E+025.6196E+035.2887E+021.2023E+032.8632E-01ESCA_PSO33.9106E+037.0806E+025.7900E+036.4145E+021.2025E+031.9371E-01F13F14F15AvgStdvAvgStdvAvgStdvESCA_PSO1.3005E+038.0129E-021.4003E+035.5878E-021.5178E+031.8461E+00ESCA_PSO11.3004E+036.5982E-021.4002E+033.9799E-021.5176E+031.4145E+00ESCA_PSO21.3005E+031.3432E-011.4003E+035.0665E-021.5173E+031.5482E+00ESCA_PSO31.3004E+039.2885E-021.4003E+031.0046E-011.5168E+031.2616E+00F16F17F18AvgStdvAvgStdvAvgStdvESCA_PSO1.6119E+033.7281E-013.5341E+051.5577E+051.9265E+065.4288E+05ESCA_PSO11.6121E+032.7974E-014.7094E+055.3309E+051.9803E+065.1404E+05ESCA_PSO21.6120E+033.9442E-014.2443E+053.0521E+052.1497E+064.0650E+05ESCA_PSO31.6117E+033.5803E-014.4610E+053.0212E+051.7955E+064.8630E+05F19F20F21AvgStdvAvgStdvAvgStdvESCA_PSO1.9176E+032.6584E+004.6963E+032.1120E+031.5933E+051.2738E+05ESCA_PSO11.9195E+031.1064E+014.8166E+032.4521E+031.6422E+051.1183E+05ESCA_PSO21.9182E+032.6893E+004.2130E+031.8120E+031.7741E+051.5670E+05ESCA_PSO31.9210E+031.6909E+012.5728E+033.9978E+021.2953E+059.6487E+04F22F23F24AvgStdvAvgStdvAvgStdvESCA_PSO3.0075E+032.5470E+022.5000E+030.0000E+002.6000E+030.0000E+00ESCA_PSO13.0277E+031.8557E+022.5000E+030.0000E+002.6000E+030.0000E+00ESCA_PSO22.9865E+032.5463E+022.5000E+030.0000E+002.6000E+030.0000E+00ESCA_PSO32.8237E+032.0355E+022.5942E+034.7914E+012.6000E+033.1173E-04F25F26F27AvgStdvAvgStdvAvgStdvESCA_PSO2.7000E+030.0000E+002.7004E+037.7168E-022.9000E+030.0000E+00ESCA_PSO12.7000E+030.0000E+002.7004E+039.2230E-022.9000E+030.0000E+00ESCA_PSO22.7000E+030.0000E+002.7137E+033.4412E+012.9000E+030.0000E+00ESCA_PSO32.7000E+030.0000E+002.7004E+037.1707E-023.4906E+033.4856E+02F28F29F30AvgStdvAvgStdvAvgStdvESCA_PSO3.0000E+030.0000E+003.1619E+035.6888E+013.7103E+036.0049E+02ESCA_PSO13.0000E+030.0000E+003.4574E+034.0471E+025.0126E+031.8702E+03ESCA_PSO23.0000E+030.0000E+007.4310E+042.6321E+051.1615E+048.8958E+03ESCA_PSO33.9181E+038.8744E+023.1047E+034.4337E+003.2472E+034.9782E+01Figure3 shows several convergence graphs in this experiment. From the figure, we can see that in F2, F17, and F19, the convergence curves of the four algorithms are relatively similar, and there is no big difference in general. In F27 and F28, the performance of ESCA_PSO3 is not as good as the other three algorithms. In F29 and F30, ESCA_PSO2 is quite different from the other three algorithms. However, ESCA_PSO can keep a good level in these functions. This shows that the combination of three different mutation mechanisms can help the algorithm adapt to more functions.Figure 3
Convergence curves of ESCA_PSO and other algorithms 9 selected benchmark functions.However, ESCA_PSO that we proposed is not perfect, and there are certain limitations. In the benchmark functions experiment, it can be seen that there is still a gap between the performance of this algorithm and champion algorithms in unimodal functions and multimodal functions.


## 4.4. ESCA_PSO For Optimization of SVM

Like many other machine learning methods [56], SVM has many advantages such as “simple structure,” “overcoming dimension disaster,” and “small sample,” which can overcome the weaknesses of conventional neural networks such as poor learning and generalization ability [57]. Since its introduction, SVM has found its application in many practical problems. Practice shows that the penalty factor C and kernel function variable g have the key influence on the recognition accuracy of the SVM model when solving the recognition problem based on the radial basis kernel function. When the penalty factor C is small, the recognition rate of training and test samples is low, and the SVM is under learning. When C is too large, the accuracy of the training sample is higher, the test sample recognition rate is lower, and the SVM is overlearning. The smaller the kernel function parameter g is, the higher the training sample recognition rate is and the lower the accuracy of the test sample is. When g is larger, the accuracy of training and test samples becomes lower, and SVM is under learning. Traditional methods such as trial and error method and network search method cannot meet the requirements of accuracy in practical application. Currently, with the development and maturity of MAs, good results have been achieved in improving the performance of the SVM model. For example, Li et al. [58] proposed moth-flame optimization (MFO) to tune the best parameters of SVM and applied it to the diagnosis of tuberculous pleural effusion. Li et al. [59] proposed a chaotic enhanced gravitational search algorithm (GSA) for optimizing the parameters of SVM. Das et al. [60] proposed to use the teaching-learning-based optimization (TLBO) for parameter optimization of SVM, and the good performance was validated by a financial case. Tang et al. [61] proposed a Lévy flight-based shuffled frog-leaping algorithm for determining the best parameters of SVM. Ahmadi et al. [62] developed the imperialist competition algorithm (ICA) to determine the best parameters of SVM for stock market timing. Li et al. [22] proposed SCA to tune the best parameters of SVM, and the good results were verified on several benchmark datasets. Rojas-Dominguez et al. [63] proposed to use several metaheuristics to search for the best parameters of SVM, and the results showed that the estimation of distribution algorithms can achieve the best results. Tharwat et al. [64] proposed a chaotic antlion optimizer for tuning the best parameters, and the effectiveness was validated on an array of well-known datasets. Bablani et al. [65] proposed to use the bat algorithm (BA) to simultaneously determine the optimal parameters of SVM and the best subset of features and applied the model for dealing with the electroencephalography (EEG) data.In this study, we applied ESCA_PSO to search for the best parameters of SVM, and the resultant model was called ESCA_PSO-SVM as shown in Figure4. ESCA_PSO-SVM was applied to predict two different medical problems including the Bupa liver and the Cleveland heart.Figure 4
Flowchart of ESCA_PSO-SVM.The Bupa liver diabetes dataset has a total of 345 samples and 7 features. Table6 demonstrates the detailed results got by ESCA_PSO-SVM via 10-fold crossvalidation. As shown in Table 6, ESCA_PSO-SVM has got an average accuracy (ACC) of 73.04%, an average sensitivity of 59.18%, an average specificity of 83.81%, and an average Mathews correlation coefficient (MCC) of 0.4404.Table 6
Results obtained by ESCA_PSO-SVM on the Bupa liver problem.
FoldACC (%)Sensitivity (%)Specificity (%)MCCNo. 174.2961.5481.820.4414No. 267.6536.3682.610.2092No. 380.0071.4385.710.5794No. 482.3590.9178.260.6517No. 582.3564.2995.000.6404No. 671.4354.5579.170.3371No. 764.7155.5675.000.3099No. 862.8638.8988.240.3102No. 977.1465.0093.330.5893No. 1067.6553.3378.950.3354Avg.73.0459.1883.810.4404Max82.3590.9195.000.6517Min62.8636.3675.000.2092From Figure5, it is clear that ESCA_PSO-SVM has more excellent performance than SCA-SVM in such four indexes. Moreover, compared with the prediction accuracy, the ESCA_PSO-SVM has the best precision, while the KNN model has the lowest precision. Based on the sensitivity metric, ESCA_PSO-SVM ranked second, while BP obtained the worst values. In terms of the obtained specificity, ESCA_PSO-SVM was the best, followed by SVM, SCA-SVM, BP, KNN, and CART. In terms of the MCC, ESCA_PSO-SVM provided the best value, followed by SVM, SCA-SVM, CART, BP, and KNN. It suggests that ESCA_PSO-SVM is more advantageous and stable in solving the Bupa liver problem.Figure 5
Comparison between the ESCA_PSO-SVM and other methods on the Bupa liver problem.The Cleveland heart data was got from the UCI repository, and it includes 303 samples and 76 features. Table7 shows the detailed results of ESCA_PSO-SVM through 10-fold crossvalidation on this dataset. From Table 7, ESCA_PSO-SVM has got an average ACC of 82.81%, a sensitivity of 76.88%, a specificity of 86.38%, and an MCC of 0.6486.Table 7
Results obtained by ESCA_PSO-SVM on the Cleveland heart problem.
FoldACC (%)Sensitivity (%)Specificity (%)MCCNo. 176.6772.2283.330.5443No. 287.1078.5794.120.7427No. 383.3376.9288.240.6591No. 477.4276.9277.780.5424No. 580.0069.2388.240.5909No. 676.6778.5775.000.5345No. 783.3387.5078.570.6652No. 883.3350.00100.000.6325No. 993.5590.0095.240.8524No. 1086.6788.8983.330.7222Avg.82.8176.8886.380.6486Max93.5590.00100.000.8524Min76.6750.0075.000.5345In Figure6, ESCA_PSO-SVM is superior to SCA-SVM in terms of four evaluation indexes. Concerning the classification accuracy, it can be seen clearly that the ESCA_PSO-SVM has got the best ACC, whereas BP has the lowest precision. In terms of the sensitivity metric, the value of SVM is the same as that of ESCA_PSO-SVM which takes the first place. As for the specificity metric, although SCA-SVM ranked first place, it was only slightly superior to ESCA_PSO-SVM. According to the MCC metric, ESCA_PSO provided the best value, followed successively by SCA-SVM, SVM, KNN, CART, and BP. These all proved the robustness and stableness of the ESCA_PSO-SVM on the Cleveland heart problem. Shortly, many problems are waiting to be optimized for which ESCA_PSO can be applied, such as disease module identification [66], molecular signatures identification for cancer diagnosis [67], drug-disease associations prediction [68], drug discovery [69], and pharmacoinformatic data mining [70].Figure 6
Comparison between the ESCA_PSO-SVM and other methods on the Cleveland heart problem.


## 5. Conclusions and Future Directions

To make up for the deficiency of SCA_PSO, this paper proposed ESCA_PSO, an enhanced version of SCA_PSO. The chance of prematurely falling into convergence was effectively reduced by introducing DE and joint mutation mechanisms. To verify its performance, it was compared with seven advanced algorithms on 30 benchmark function sets. The experimental results showed that the performance of the proposed algorithm was better than that of the traditional optimization algorithms and had certain competitiveness with LSHADE. Inspired by the “No Free Lunch” theory, this paper further explored the application of ESCA_PSO in medical diagnosis and successfully applied it to hyperparameter optimization of support vector machine.The results showed that the support vector machine model combined with the proposed algorithm outperformed the other five existing models and achieved an average accuracy of 82.81%. In conclusion, the proposed algorithm can be regarded as a reliable technique for solving practical problems.For future work, there are still many problems worthy of study. First of all, we will continue to improve the algorithm, by means such as trying to introduce other metaheuristic algorithms or optimizing the time complexity while ensuring the effect. In addition, we will try to apply ESCA_PSO to other fields such as image segmentation, clustering optimization, and discrete optimization.



---

*Source: 6215574-2022-06-22.xml*