# An Evolutionary Frog Leaping Algorithm for Global Optimization Problems and Applications

Authors: Deyu Tang; Jie Zhao; Jin Yang; Zhen Liu; Yongming Cai
Journal: Computational Intelligence and Neuroscience
 (2021)

---

## Abstract

Shuffled frog leaping algorithm, a novel heuristic method, is inspired by the foraging behavior of the frog population, which has been designed by the shuffled process and the PSO framework. To increase the convergence speed and effectiveness, the currently improved versions are focused on the local search ability in PSO framework, which limited the development of SFLA. Therefore, we first propose a new scheme based on evolutionary strategy, which is accomplished by quantum evolution and eigenvector evolution. In this scheme, the frog leaping rule based on quantum evolution is achieved by two potential wells with the historical information for the local search, and eigenvector evolution is achieved by the eigenvector evolutionary operator for the global search. To test the performance of the proposed approach, the basic benchmark suites, CEC2013 and CEC2014, and a parameter optimization problem of SVM are used to compare 15 well-known algorithms. Experimental results demonstrate that the performance of the proposed algorithm is better than that of the other heuristic algorithms.


---

## Body

## 1. Introduction

In these years, a large number of complex nonlinear optimization problems are solved using mathematical tools by mathematic models. In these cases, traditional approaches often cannot obtain a better solution, which promotes the development of the heuristic optimization techniques. Metaheuristic approach is inspired by the characteristics of the different species in nature, which has rapidly progressed by the theory of biology, physics, society, and so on. Not only one solution but also several solutions are obtained by the heuristic process to find the exact or approximate global optimum. In order to accelerate the convergence speed and find the global solution, researchers have proposed more and more new or improved algorithms. These approaches can be divided into three categories: swarm intelligence (SI), evolutionary algorithms (EAs), and physical phenomena (PP) algorithms.Swarm intelligence algorithms are inspired by the collective behaviors of natural species such as insects, animals, microorganism, and human. In SI algorithms, the population is a set of individuals (solutions) distributed in search space, which can work in cooperation by survival or competition mechanism to solve problems. In these years, more SI algorithms have been proposed, such as spotted hyena optimizer (SHO) [1], forest optimization algorithm (FOA) [2], particle swarm optimization (PSO) [3], whale optimization algorithm (WOA) [4], artificial bee colony (ABC) algorithm [5], grey wolf optimizer (GWO) [6], grasshopper optimization algorithm (GOA) [7], teaching-learning-based optimization (TLBO) [8], invasive tumor growth optimization (ITGO) algorithm [9], artificial algae algorithm (AAA) [10], and Salp swarm algorithm [11].Evolutionary algorithms (EAs) are inspired by the Darwinian principles of nature’s capability to evolve living beings well adapted to their environment. The key is to imitate the individual’s evolution through mutation, selection, and crossover operation, thus resulting in a better solution. The typical evolutionary algorithms are genetic algorithms [12, 13], evolutionary strategies [14, 15], evolutionary programming [16], and genetic programming [17]. Fusing the mutation mechanism of PSO, differential evolution (DE) and its improved versions are proposed and have achieved greater success in many fields for the continuous optimization problems, such as the typical differential evolution (DE) [18] and adaptive differential evolution (SHADE, LSHADE, and iL-SHADE) [19–21].Physical phenomena (PP) algorithms mimic physical rules in some physical phenomena. Contrast to SIs or EAs, each individual in a population moves and communicates in the search space according to the physical rules. The typical PP algorithms are thermal exchange optimization (TEO) [22], gravitational search algorithm (GSA) [23], lightning attachment procedure optimization (LAPO) [24], black hole (BH) [25], ray optimization (RO) algorithm [26], and so on.In recent decades, more than hundreds of population-based optimization algorithms have been proposed yet. We are puzzled: is it necessary to propose a new or improved optimization algorithm? Fortunately, the No Free Lunch (NFL) theorem [27] has been proposed. This theorem has logically proved that there is no metaheuristic algorithm best suited for solving all the optimization problems. It is to say that a particular metaheuristic approach may show very good results on a set of problems, but the same algorithm may show poor performance on a different set of problems. Therefore, we need to propose a new approach to solve the continuous optimization problems, which can better achieve the balance between the exploitation ability and the exploration ability. In addition, we want that the proposed method can solve more different optimization problems whether they are in the coordinate system or in the rotated coordinate system. In this paper, we focus on the research about the advantages and disadvantages of the shuffled frog leaping algorithm (SFLA) [28] and the related technique in order to propose a new approach for the continuous optimization problems.The shuffled frog leaping algorithm is a SI algorithm inspired by the foraging behavior of frogs, which combines the mechanism of meme diffusion for the global exploration and search by PSO for the local exploitation. Due to its simplicity and efficiency, it has been widely applied to many real-world optimization problems such as the traveling salesman problem (TSP) [28], vehicle routing problem [29], economic dispatch problem [30, 31], 0/1 knapsack problem [32], resource-constrained project scheduling problem [33, 34], flow shop scheduling problem [35, 36], and grid task scheduling problem [37]. The version of SFLA for the discrete optimization problems has achieved great success, but the version of SFLA for the continuous optimization problems is not performing well due to its low convergence speed and premature problem. In this case, some improved versions of SFLA have been proposed. For instance, Xia Li et al. [38] considered the historical information for the local exploration and proposed an extremal optimization process, which was completed by the fine-grained Gaussian mutation and the coarse-grained Cauchy mutation. In order to enhance the diversity of population and the local exploration ability, the opposition-based learning (OBL) strategy was used in literature [39]. The initial population was produced by the basic uniform distribution and the opposition-based learning process, which reinforces the diversity of the population. In addition, the frog leaping rule was improved by the normal and opposition-based search. Morteza Alinia Ahandani et al. [40] diversified the search rule of SFAL by the differential evolution operator substituted for the basic frog leaping rule. Sharma S et al. [41] found that it was not enough that each worst frog was guided only by the best frog in each subpopulation. So, the centroid of three new individuals was considered for the frog leaping rule. Hong-bo Wang et al. [42] combined the historical information, information of the local frog and global frog substituted for the basic frog leaping search method, and the mutation operation by the normal distribution and Cauchy distribution was used for the globally best frog and the worst frog. Liu C et al. [43] used the chaotic opposition-based learning to achieve the population initialization, and then the adaptive nonlinear inertia weight and the perturbation operator strategy based on Gaussian mutation were used for the balance between the exploration and the exploitation. Paper [44] presents grouped SFLA for solving continuous optimization problems combined with the excellent characteristics of cloud model transformation between qualitative and quantitative research. Deyu Tang et al. [45] proposed a lévy flight mutation operator for the frog leaping rule and an interaction learning rule for the global search. Wenjuan Li et al. [46] used quantum movement equations to search for the optimal location according to the co-evolution of the quantum frog colony.As mentioned above, we find that the shuffled frog leaping algorithm has been successfully applied to many combinatorial optimization problems, but it is not efficient for the continuous optimization problem due to the weakness of balance between the exploration and the exploitation, such as the weakness of the exploitation ability (the local search ability) and the loss of the exploration operator (the global search operator). Only using the shuffled strategy and the guidance by the best local frog is not enough for the complex problems such as the multimodal optimization problems. Therefore, researchers used the opposition-based learning strategy [39], chaotic strategy [43], and so on to enhance the diversity of the population. Meanwhile, the differential operators [40] and the reserving the historical information strategy [38] are adopted for the exploration. In addition, the first version of quantum inspired SFLA by Q-bits and Q-gate [46] was proposed, which can be seen as the quantum computing approach. However, the quantum simulation approach has not been utilized for SFLA. So far, the improved versions of SFLA are still based on the PSO framework. In addition, we find that some improved SFLA algorithms can be used successfully to solve the optimization problems in the coordinate system but lose to solve these problems in the rotated coordinate system or contrary. Therefore, we attempt to establish a new framework of SFLA based on quantum evolution and eigenvector evolution in order to achieve the balance between the exploitation (quantum evolution) and the exploration (eigenvector evolution) to solve more different optimization problems whether they are in the coordinate system or in the rotated coordinate system.The major contributions are as follows. First, we propose a two-stage search framework of SFLA based on the quantum evolution and eigenvector evolution for the balance between the exploitation and the exploration. Second, the exploitation is achieved by a quantum evolutionary operator with historical information for the frog leaping rule. Third, the exploration is achieved by the adaptive eigenvector evolutionary operator.The rest of the paper is organized as follows. In Section2, the shuffled frog leaping algorithm is introduced. Related work is reviewed and discussed in Section 3. In Section 4, we propose the evolutionary frog leaping algorithm. Experimental results and analysis are shown in Section 5. Finally, conclusions and further discussions are given in Section 6.


## 2. Shuffled Frog Leaping Algorithm (SFLA)

The shuffled frog leaping algorithm is a heuristic approach inspired by the frog foraging behavior, which is designed according to the memetic evolution principle and the PSO framework. Suppose each frog has thought and is living by the meme information (culture information). The frog population is divided into different memeplexes (communities or groups) according to the common thought (or meme). In each global iteration step, memeplexes are divided again by the shuffled process according to the memetic evolution principle, which can be seen as the global exploration process. In each submemeplex, the frog leaping process is achieved by the simplified PSO, which can be seen as the local exploration process. In each local step, the worst frog and the best frog are obtained, and the worst frog is guided by the best frog to find the best food. The memetic evolution process and the frog leaping process are completed alternately corresponding to the balance between the exploration and the exploitation. The SFLA can be described as follows: Firstly, the initial population is generated randomly and divided intom submemeplexes in a descending sort. The shuffled process can be represented as equation (1) where popsize (popsize=m×n) is an integer which indicates the population size, m indicates the number of memeplexes, and n indicates the number of frogs in each submemeplex. The fitness f(i) for the ith frog can be evaluated and sorted in descending order to form m memeplexes H1H2, …, Hb, …, Hm, which can be constructed by(1)Hb=Xib|Xib=Xb+mk−1,k=1,2,…,n,b=1,2,…,m,where H is a set of solutions in a memeplex and Xi indicates a solution and it is a vector.Second, the frogs finish the updating step in each submemeplex according to the following equation:(2)Xworst′=Xworst+rand⋅Xbest−Xworst,where Xworst represents the position of the worst frog, Xbest represents the position of the best frog, rand denotes a random number of uniform distribution between (0, 1), and Xworst and Xbest belong to the same submemeplex. If the fitness of Xworst′ is better than Xworst, Xworst is updated. Otherwise, Xbest is replaced by the position of the globally best frog Xg; if the fitness of Xworst′ is better than Xworst, Xworst is updated. If there is still no improvement, a feasible solution is generated to replace Xworst. This updating step can be seen as a local search step, which continues until the threshold value reaches the predefined number of iteration within each memeplex. The local search step and the shuffling processes alternate until a predefined convergence criterion is satisfied. The time complexity of getting the best frog and the worst frog in a submemeplex is On, where n is the number of frogs in each submemeplex. Thus, the total time complexity of SFLA is as follows:(3)OSFLA=Om∗k∗n∗T∗D=Ops∗k∗T∗D,where ps is the population size, m is the number of submemeplexes, k is the local iteration number in each submemeplex, n is the number of frogs in each submemeplex, ps=m∗n, T is the number of the total iteration, and D is the dimension. Pseudo code of SFLA is shown in Algorithm 1.Algorithm 1:Pseudo code of SFLA.
(1)
The pseudo code of SFLA ( )(2)
FES = 0;//fitness evaluation number(3)
Randomized initializationxd1,xd2,…,xdk and evaluate fitness values f(xk), for k = 1, 2, …, ps.(4)
FES = FES +ps;(5)
While FES< = MAX_FES//the max fitness evaluation number(6)
Sort and arrange population (ps = m∗n) according to the fitness, where m is the number of memeplexes, n is the number of frogs in each memeplex, and k is the local iteration number.(7)
Get the global best frogXg;(8)
Fori = 1 to m do//m memeplexes(9)
Forj = 1 to k do//k is the local iteration number in ith memeplex(10)
Get the worst and best frog xworst, xbest in the ith memeplex; //n frogs in ith memeplex(11)
Xworst′ = Xworst + rand ∗ (X best − X worst);(12)
FES = FES + 1;(13)
IffXworst′ < ffXworst(14)
Xworst = Xworst′(15)
ELSEIFfXworst′ >= fXworst(16)
Xworst′ = Xworst + rand ∗ (Xg −−Xworst);(17)
IffXworst′ < ffXworst(18)
Xworst = Xworst′(19)
End IF(20)
FES = FES + 1;(21)
ELSEIFfXworst′ > = fXworst(22)
Xworst  =  Xlb + rand (1, D) ∗ (Xub−Xlb); //lb, ub denote the search boundary(23)
END IF(24)
End for//m frogs(25)
End for//n memeplexes(26)
End while


## 3. Related Research

The balance between the exploitation and the exploration is a core task for metaheuristic approach. For this goal, some approaches use one operator with more units to achieve this task, such as PSO. The search operator of PSO is accomplished by the global search unit and historical search unit, in which the global search unit achieves the exploitation task and historical search unit achieves the exploration task. Another approach uses two or more operators to achieve the balance between the exploitation and the exploration, such as ABC, CS, and TLBO. For the ABC, the operator of employed bees and the operator of scout bees achieve exploration task and the operator of onlooker bees achieves exploitation task. For the CS, lévy flight operator achieves exploitation task with a mutation method and nest selection operator achieves the exploration task. For TLBO, the teaching operator achieves the exploitation task and the learning operator achieves the exploration task. As we know, the SFLA has only one operator, which achieves the exploitation task. The operator for exploration of SFLA is missing. Therefore, the framework by the two stage for SFLA can be considered.


### 3.1. Quantum Simulation (QS) Methods

In 2004, J. Sun et al. [47] proposed the first quantum behaved particle swarm optimization, which simulates the quantum evolutionary process under the particle swarm optimization framework. After that, many improved QS algorithms are developed such as weighed mean best position [48], Gaussian probability distribution for the local attractor [49], group search optimizer [50], diversity control strategy [51, 52], cooperative mechanism [53], chaotic mutation operator [54], decentralized strategy with cellular structured population [55], memetic algorithm [56], two-stage search method [57], and collaborative attractor [58]. More and more improved versions of QPSO are based on the basic quantum simulation model. The quantum search operator is proposed according to the Schrodinger equation and Monte Carlo method.The state functionψx¯,t in time can be represented by the Schrodinger equation, in which H^ is the Hamiltonian operator and t denotes the time.(4)ih∂∂tψx¯,t=H^ψx¯,t.The massm of one particle in a potential field Vx¯ can be represented as follows:(5)H^=−h22m∇2+Vx¯,where h means the Planck constant.Using the Monte Carlo method, we can obtain equation (6) according to the Delta potential well model:(6)Xi=Pi±gXi−Piln1rand,where g denotes the parameter of search, Pi is the potential well, Xi denotes a particle i in D dimensional space, and rand denotes a random number of uniform distribution between (0, 1).Considering the convergence,Xit⟶Pit, when t⟶∞. Here, t denotes the time. Quantum simulations have not been used for SFLA, so we attempt to achieve the quantum evolution as a component of SFLA for the exploitation.


### 3.2. Eigenvector Approach

Eigenvector information of the covariance matrix of a set can rotate the coordinate system, and it can be used for a multivariate statistical method of principal component analysis (PCA) [59], which can reduce the dimension of the handled multivariate data to some extent. The inspiration of PCPSO is derived from a methodology known as the Lagrange point of view [60] for creating and flying in a dynamic coordinate system with the particles. Chu et al. [61] introduced principal component analysis into PSO to remedy the problem caused by the absorbing bound-handling approach. Inspired by the Hamiltonian Monte Carlo (HMC) method, Kuznetsova et al. [62] proposed the PCA-based stochastic optimization (PCA-SO) algorithm. Xinchao Zhao et al. [63] proposed the improved version of PSO by the PCA and the line search method. All these approaches are based on the principle of PCA, in which eigenvector has not been used directly for the optimization problem. In 2015, literature [64] first proposed an eigenvector-based crossover operator for differential evolution (DE) in order to improve the performance of nonrotationally invariant crossovers by rotating the coordinate system to make the function landscape be pseudo-separable. In 2016, Noor H. Awad et al. [65] used the eigenvector-based crossover operator and other methods to improve the LSHADE version and proposed the LSHADE-EpSin algorithm. However, the eigenvector search method is sensitive to the parameter setting. In this paper, we attempt to achieve a simple eigenvector evolutionary operator without parameter setting as a component of SFLA for the exploration.To sum up, the SFLA has the idea of balance between the exploitation and the exploration. However, the exploitation by frog leaping rule is only guided by the best frogs, which can speed up the convergence but is easy to fall into the local optimum. More importantly, the real exploration operator in SFLA is missing. In quantum simulation approach, the individual is guided by the potential well not the best individual, which can enhance the diversity of population. So, it can be considered as the component of SFLA for exploitation. The eigenvector crossover operator has achieved the rotationally invariant of differential evolution for complex optimization problems. However, the real eigenvector search approach without parameter setting is not proposed. If an eigenvector evolutionary operator can be completed, it can be considered as the component of SFLA for the exploration operator.


## 3.1. Quantum Simulation (QS) Methods

In 2004, J. Sun et al. [47] proposed the first quantum behaved particle swarm optimization, which simulates the quantum evolutionary process under the particle swarm optimization framework. After that, many improved QS algorithms are developed such as weighed mean best position [48], Gaussian probability distribution for the local attractor [49], group search optimizer [50], diversity control strategy [51, 52], cooperative mechanism [53], chaotic mutation operator [54], decentralized strategy with cellular structured population [55], memetic algorithm [56], two-stage search method [57], and collaborative attractor [58]. More and more improved versions of QPSO are based on the basic quantum simulation model. The quantum search operator is proposed according to the Schrodinger equation and Monte Carlo method.The state functionψx¯,t in time can be represented by the Schrodinger equation, in which H^ is the Hamiltonian operator and t denotes the time.(4)ih∂∂tψx¯,t=H^ψx¯,t.The massm of one particle in a potential field Vx¯ can be represented as follows:(5)H^=−h22m∇2+Vx¯,where h means the Planck constant.Using the Monte Carlo method, we can obtain equation (6) according to the Delta potential well model:(6)Xi=Pi±gXi−Piln1rand,where g denotes the parameter of search, Pi is the potential well, Xi denotes a particle i in D dimensional space, and rand denotes a random number of uniform distribution between (0, 1).Considering the convergence,Xit⟶Pit, when t⟶∞. Here, t denotes the time. Quantum simulations have not been used for SFLA, so we attempt to achieve the quantum evolution as a component of SFLA for the exploitation.


## 3.2. Eigenvector Approach

Eigenvector information of the covariance matrix of a set can rotate the coordinate system, and it can be used for a multivariate statistical method of principal component analysis (PCA) [59], which can reduce the dimension of the handled multivariate data to some extent. The inspiration of PCPSO is derived from a methodology known as the Lagrange point of view [60] for creating and flying in a dynamic coordinate system with the particles. Chu et al. [61] introduced principal component analysis into PSO to remedy the problem caused by the absorbing bound-handling approach. Inspired by the Hamiltonian Monte Carlo (HMC) method, Kuznetsova et al. [62] proposed the PCA-based stochastic optimization (PCA-SO) algorithm. Xinchao Zhao et al. [63] proposed the improved version of PSO by the PCA and the line search method. All these approaches are based on the principle of PCA, in which eigenvector has not been used directly for the optimization problem. In 2015, literature [64] first proposed an eigenvector-based crossover operator for differential evolution (DE) in order to improve the performance of nonrotationally invariant crossovers by rotating the coordinate system to make the function landscape be pseudo-separable. In 2016, Noor H. Awad et al. [65] used the eigenvector-based crossover operator and other methods to improve the LSHADE version and proposed the LSHADE-EpSin algorithm. However, the eigenvector search method is sensitive to the parameter setting. In this paper, we attempt to achieve a simple eigenvector evolutionary operator without parameter setting as a component of SFLA for the exploration.To sum up, the SFLA has the idea of balance between the exploitation and the exploration. However, the exploitation by frog leaping rule is only guided by the best frogs, which can speed up the convergence but is easy to fall into the local optimum. More importantly, the real exploration operator in SFLA is missing. In quantum simulation approach, the individual is guided by the potential well not the best individual, which can enhance the diversity of population. So, it can be considered as the component of SFLA for exploitation. The eigenvector crossover operator has achieved the rotationally invariant of differential evolution for complex optimization problems. However, the real eigenvector search approach without parameter setting is not proposed. If an eigenvector evolutionary operator can be completed, it can be considered as the component of SFLA for the exploration operator.


## 4. The Proposed Approach

In SFLA, frogs only have jumping behavior to spread information like humans, which is not enough to simulate their social behaviors. Indeed, interactive learning among a population is popular in society. Therefore, interactive learning characteristic can be modeled to simulate the social behaviors of frogs. In this paper, we propose a two-stage search framework of SFLA for the balance between the exploitation and the exploration. In the first search stage, the local search is achieved in terms of the quantum evolutionary operator instead of the PSO operator, which simulates the jumping behavior of frogs in the quantum space. In the second search stage, the global search is achieved in terms of the adaptive eigenvector evolutionary operator instead of only using the shuffled operator, which simulates the interactive learning characteristic of frogs.


### 4.1. Quantum Evolutionary Operator

The quantum evolutionary operator is achieved in different submemeplexes by the shuffled process as equation (1). Therefore, it can be considered as a local search process. According to the quantum simulation model introduced above, we know that the quantum evolutionary operator is achieved by the Monte Carlo method according to the potential well model. In equation (6), considering the convergence, Xit⟶Pit, when t⟶∞, where Pi is considered as the potential well. The basic quantum evolutionary operator only uses one potential well, which accelerates the search speed but is easy to fall into the local optimum. For this, we propose the second potential well with memory to enhance the search ability for quantum evolution. The new search operator can be represented by the following equation.(7)Xi=Pi±g.Xi−Pi′memoryln1rand,i=1,2,…,popsize,where Pi denotes the first potential well, Pi′memory denotes the second potential well, g is the search parameter, and popsize is the population size. rand denotes a random number of the uniform distribution in [0, 1]. Pi is a vector in D dimensional space, and Pi′memory is also a vector in D dimensional space.In SFLA, the frog leaping rule equation (2) can be considered as the first potential well Pk because the location of the search is located in a rectangle area between the worst frog and the best frog. It can be represented as the following equation:(8)Pi=Xworst+rand⋅Xbest−Xworst=w⋅Xworst+1−w⋅Xbest,w=rand⋅0,1,i=1,2,…,popsize.The second potential well can be represented by equations (9) and (10).(9)Pi′=1n∑c=1nXc,where Pi′ indicates the means of n positions of frogs in a submemeplex (a group), and it is a local center.(10)Pi′memory=Pi′memoryv+Pi′.Equation (10) denotes a recurrence formula, v is an integer, and it is increased from 1 to nv=1,2,…,n. The initial value of v is set as 1. n is the number of frogs in a submemeplex, which is equal to the iteration number of the local search process. The initial Pi′memory is a zero vector.(11)g=1.5−0.5∗FESMAX_FES.Equation (11) is a linear function, which controls the search scope. FES is the fitness evaluation number, and MAX_FES is the max numbers of fitness value.Figure1 shows an instance of the quantum evolutionary process. First, the population is divided into different submemeplexes according to equation (1). It can be observed in the left section of Figure 1. Twelve frogs in the population are divided into three submemeplexes (different colors such as green, yellow, and purple), and there are four frogs in each submemeplex. The 12 frogs X1, X2, X3, .., X12 are arranged according to the descending order by fitness value. For example, X6 is an ordinary frog, it can be arranged into the purple submemeplex according to equation (1), i.e., X6 = X3 + 3 ∗ (2 − 1) (b = 3, k = 2). X3 denotes the best frog, and X12 denotes the worst frog in the purple submemeplex. The quantum evolution operator is achieved by the worst frog in each submemeplex. The search process can be observed in the search space (the right section of Figure 1). The 12 balls in search space are corresponding to the 12 rectangles in fitness space for 12 frogs. The red ball with vertical line denotes the first potential well Pi, the blue ball with horizontal line denotes the second potential well Pi′, and the grey ball with horizontal line denotes the historical Pi′. Pi′memory is achieved by the current Pi′ (blue ball) and the historical Pi′ (grey ball) by the recurrence formula in equation (10). The first potential well Pi is obtained in a rectangle region by a diagonal between Xworst and Xbest according to equation (8). In fact, it is the basic search operator of the shuffled frog leaping algorithm. The worst frog Xworst runs toward the position of the best frog Xbest, and it is easy to converge to the local optimum. Fortunately, the worst frog Xworst is guided not only by the first potential well Pi but also by the second potential well Pi′ in the quantum evolutionary operator. The basic second potential well Pi′ is the centroid of the local submemeplex according to equation (9). It can be observed that Pi′ can guide the worst frog Xworst search in a quadrilateral region by the frog X3, X6, X9, and X12 as shown in Figure 1, which can enhance the diversity of the population. However, it cannot ensure that the worst frog Xworst flees from the local optimum. Therefore, we propose an improved potential well Pi′memory instead of Pi′, which retains the historical information for each search process. The potential well Pi′memory is produced by many historical Pi′ (grey balls) and the current Pi′ (blue ball), which can ensure that it can run out of the quadrilateral region (it can be seen as equation (10) and Figure 1). It can be observed that the search of the worst frog Xworst is guided by the first potential well Pi and the second potential well Pi′memory. In contrast to the old search rule as equation (2), the worst frog Xworst is not easy to fall into the local optimum (blue region). In other words, the worst frog Xworst has more opportunities to run toward the direction of the global optimum (red region) guided by the different potential wells not only guided by the best frog Xbest.Figure 1
Quantum evolutionary process.


### 4.2. Adaptive Eigenvector Evolutionary Operator

Interactive learning behavior is achieved in the whole population not in the local population (a submemeplex). Therefore, it is a global search process. It can be represented as the following equation:(12)Yi=Xi+2⋅rand⋅Xv−Xo,where Xi,Xv,andXo are three vectors in D dimensional space corresponding to three frogs. i,v,andoi≠v≠o are three different integers in a set as 1,2,…popsize, where popsize is the population size. Xi is a solution vector, which can be updated by the difference between Xv and Xo. rand denotes a random number of the uniform distribution in [0, 1]. Xi,∗¯ is the mean of all the Xi in the population, and Xj,∗¯ is the mean of all the Xj in the population.(13)covi,j=∑k=1popsizeXi,k−Xi,∗¯Xj,k−Xj,∗¯popsize−1.To compute the eigenvector basis, we factorize the covariance matrixcovY into a canonical form as follows:(14)covX=QΛQ−1,where Q is the square matrix (D rows and D columns) whose ith column is the eigenvector qi of covY. Λ is the diagonal matrix whose diagonal elements are the corresponding eigenvalues. The eigenvector evolutionary operator can be represented as follows: (15)Yi,j′=QT⋅Xij,j∉Ui,QT⋅Yij,j∈Ui,i=1,2,…,popsize;j=1,2,…D,where Xi (or Yi) denotes an individual and it is a vector with one column and D rows, QT is a square matrix by D rows and D columns, and D denotes the dimension of a solution vector. So, QT⋅Xi (orQT⋅Yi) denotes a new individual, and it is a vector with one column and D rows. Ui is a set of integers as {1,2, 3, …, D}, which denotes the randomly selected r rows for the individual QT⋅Yi, and r is a randomly selected integer from the set as {1,2, 3, …, D}.(16)Yieig=Q⋅Yi′.When the solution is updated in the eigenvector basis, the updating behavior will become rotationally invariant in the natural basis. To reduce the risk of ineffective behavior of rotationally invariant operatorYeig, we introduce an adaptive selection strategy for the original operator and the eigenvector evolutionary operator.(17)Xinew=Yi,IF rand<p,Yieigelse,where rand is a random number of uniform distribution in [0, 1] and p is a self-adapting selection parameter value. It can be represented as follows:(18)p=p∗1−1ps0+1ps0∗p1p1+p2.The initial valuep0=0.5 and ps0=2. p1 denotes the number of success by original operator as shown in equation (12), and p2 denotes the number of success by eigenvector evolutionary operator as shown in equation (16).Here, we explain our approach by a shifted rotated expanded Scaffer F6 function in a two-dimensional space (shown in Figures2 and 3). Figure 3 shows the major characteristic of the eigenvector basis, and the eigenvector evolution shows the search direction in a rotationally invariant. Considering the complexity of real-world optimization problems, the original operator and the eigenvector evolutionary operator are running alternately according to the success rate, and it is achieved by an adaptive selection mechanism (equations (17) and (18)). Pseudo code of the proposed approach is shown in Algorithm 2.Figure 2
Shifted rotated expanded Scaffers F6.Figure 3
Adaptive eigenvector evolutionary operator.Algorithm 2:Pseudo code.
(1)
The pseuco code of EFLA ( )(2)
Parameter setting: population sizeps, m, n Max fitness number (MAX_FES) etc.(3)
Initialize a populationX of ps frogs with random solutions and compute the fitness.(4)
while FES< = MAX_FES(5)
//Local search process (exploitation)(6)
sortX; //descending order for the population X according to the fitness values(7)
For (i = 1; i < = m; i + +)//m is the number of memeplexes(8)
For (j = 1; j < = n; j + +)//n is the number of frogs in one submemeplex(9)
Get the best frogXbest and the worst frog Xworst in one memeplex;(10)
Computing the two potential wells and length of search by equations (8), (9), (10), and (11);(11)
Updating the position of frogs by equation (7);(12)
End for(13)
End for(14)
//Global search process (exploration)(15)
For (i = 1; i< = ps; i + +)(16)
Obtain the new positionYi of frogs by equation (12); // Xi means a vector(17)
End for(18)
Use equations (13), (14), (15), (16), and (17); //the eigenvector basis based search operator(19)
For (i = 1; i < = ps; i + +)//(20)
If rand <p(21)
Xnew1 = Yi;//standard search equation (12)(22)
Else//X, Y means the same matrix with ps columns and d rows(23)
Xnew2=Yieig; //eigenvector search (equations (15), (16), and (17))(24)
End IF(25)
p = p∗(1−1/ps0) + (1/ps0) ∗ (p1/(p1 + p2)); //equation (18), Initial p0 = 0.5; ps0 = 2(26)
//p1 is the number of success by Xnew1 according to the fitness value(27)
//p2 is the number of success by Xnew2 according to the fitness value(28)
End for(29)
End While


## 4.1. Quantum Evolutionary Operator

The quantum evolutionary operator is achieved in different submemeplexes by the shuffled process as equation (1). Therefore, it can be considered as a local search process. According to the quantum simulation model introduced above, we know that the quantum evolutionary operator is achieved by the Monte Carlo method according to the potential well model. In equation (6), considering the convergence, Xit⟶Pit, when t⟶∞, where Pi is considered as the potential well. The basic quantum evolutionary operator only uses one potential well, which accelerates the search speed but is easy to fall into the local optimum. For this, we propose the second potential well with memory to enhance the search ability for quantum evolution. The new search operator can be represented by the following equation.(7)Xi=Pi±g.Xi−Pi′memoryln1rand,i=1,2,…,popsize,where Pi denotes the first potential well, Pi′memory denotes the second potential well, g is the search parameter, and popsize is the population size. rand denotes a random number of the uniform distribution in [0, 1]. Pi is a vector in D dimensional space, and Pi′memory is also a vector in D dimensional space.In SFLA, the frog leaping rule equation (2) can be considered as the first potential well Pk because the location of the search is located in a rectangle area between the worst frog and the best frog. It can be represented as the following equation:(8)Pi=Xworst+rand⋅Xbest−Xworst=w⋅Xworst+1−w⋅Xbest,w=rand⋅0,1,i=1,2,…,popsize.The second potential well can be represented by equations (9) and (10).(9)Pi′=1n∑c=1nXc,where Pi′ indicates the means of n positions of frogs in a submemeplex (a group), and it is a local center.(10)Pi′memory=Pi′memoryv+Pi′.Equation (10) denotes a recurrence formula, v is an integer, and it is increased from 1 to nv=1,2,…,n. The initial value of v is set as 1. n is the number of frogs in a submemeplex, which is equal to the iteration number of the local search process. The initial Pi′memory is a zero vector.(11)g=1.5−0.5∗FESMAX_FES.Equation (11) is a linear function, which controls the search scope. FES is the fitness evaluation number, and MAX_FES is the max numbers of fitness value.Figure1 shows an instance of the quantum evolutionary process. First, the population is divided into different submemeplexes according to equation (1). It can be observed in the left section of Figure 1. Twelve frogs in the population are divided into three submemeplexes (different colors such as green, yellow, and purple), and there are four frogs in each submemeplex. The 12 frogs X1, X2, X3, .., X12 are arranged according to the descending order by fitness value. For example, X6 is an ordinary frog, it can be arranged into the purple submemeplex according to equation (1), i.e., X6 = X3 + 3 ∗ (2 − 1) (b = 3, k = 2). X3 denotes the best frog, and X12 denotes the worst frog in the purple submemeplex. The quantum evolution operator is achieved by the worst frog in each submemeplex. The search process can be observed in the search space (the right section of Figure 1). The 12 balls in search space are corresponding to the 12 rectangles in fitness space for 12 frogs. The red ball with vertical line denotes the first potential well Pi, the blue ball with horizontal line denotes the second potential well Pi′, and the grey ball with horizontal line denotes the historical Pi′. Pi′memory is achieved by the current Pi′ (blue ball) and the historical Pi′ (grey ball) by the recurrence formula in equation (10). The first potential well Pi is obtained in a rectangle region by a diagonal between Xworst and Xbest according to equation (8). In fact, it is the basic search operator of the shuffled frog leaping algorithm. The worst frog Xworst runs toward the position of the best frog Xbest, and it is easy to converge to the local optimum. Fortunately, the worst frog Xworst is guided not only by the first potential well Pi but also by the second potential well Pi′ in the quantum evolutionary operator. The basic second potential well Pi′ is the centroid of the local submemeplex according to equation (9). It can be observed that Pi′ can guide the worst frog Xworst search in a quadrilateral region by the frog X3, X6, X9, and X12 as shown in Figure 1, which can enhance the diversity of the population. However, it cannot ensure that the worst frog Xworst flees from the local optimum. Therefore, we propose an improved potential well Pi′memory instead of Pi′, which retains the historical information for each search process. The potential well Pi′memory is produced by many historical Pi′ (grey balls) and the current Pi′ (blue ball), which can ensure that it can run out of the quadrilateral region (it can be seen as equation (10) and Figure 1). It can be observed that the search of the worst frog Xworst is guided by the first potential well Pi and the second potential well Pi′memory. In contrast to the old search rule as equation (2), the worst frog Xworst is not easy to fall into the local optimum (blue region). In other words, the worst frog Xworst has more opportunities to run toward the direction of the global optimum (red region) guided by the different potential wells not only guided by the best frog Xbest.Figure 1
Quantum evolutionary process.


## 4.2. Adaptive Eigenvector Evolutionary Operator

Interactive learning behavior is achieved in the whole population not in the local population (a submemeplex). Therefore, it is a global search process. It can be represented as the following equation:(12)Yi=Xi+2⋅rand⋅Xv−Xo,where Xi,Xv,andXo are three vectors in D dimensional space corresponding to three frogs. i,v,andoi≠v≠o are three different integers in a set as 1,2,…popsize, where popsize is the population size. Xi is a solution vector, which can be updated by the difference between Xv and Xo. rand denotes a random number of the uniform distribution in [0, 1]. Xi,∗¯ is the mean of all the Xi in the population, and Xj,∗¯ is the mean of all the Xj in the population.(13)covi,j=∑k=1popsizeXi,k−Xi,∗¯Xj,k−Xj,∗¯popsize−1.To compute the eigenvector basis, we factorize the covariance matrixcovY into a canonical form as follows:(14)covX=QΛQ−1,where Q is the square matrix (D rows and D columns) whose ith column is the eigenvector qi of covY. Λ is the diagonal matrix whose diagonal elements are the corresponding eigenvalues. The eigenvector evolutionary operator can be represented as follows: (15)Yi,j′=QT⋅Xij,j∉Ui,QT⋅Yij,j∈Ui,i=1,2,…,popsize;j=1,2,…D,where Xi (or Yi) denotes an individual and it is a vector with one column and D rows, QT is a square matrix by D rows and D columns, and D denotes the dimension of a solution vector. So, QT⋅Xi (orQT⋅Yi) denotes a new individual, and it is a vector with one column and D rows. Ui is a set of integers as {1,2, 3, …, D}, which denotes the randomly selected r rows for the individual QT⋅Yi, and r is a randomly selected integer from the set as {1,2, 3, …, D}.(16)Yieig=Q⋅Yi′.When the solution is updated in the eigenvector basis, the updating behavior will become rotationally invariant in the natural basis. To reduce the risk of ineffective behavior of rotationally invariant operatorYeig, we introduce an adaptive selection strategy for the original operator and the eigenvector evolutionary operator.(17)Xinew=Yi,IF rand<p,Yieigelse,where rand is a random number of uniform distribution in [0, 1] and p is a self-adapting selection parameter value. It can be represented as follows:(18)p=p∗1−1ps0+1ps0∗p1p1+p2.The initial valuep0=0.5 and ps0=2. p1 denotes the number of success by original operator as shown in equation (12), and p2 denotes the number of success by eigenvector evolutionary operator as shown in equation (16).Here, we explain our approach by a shifted rotated expanded Scaffer F6 function in a two-dimensional space (shown in Figures2 and 3). Figure 3 shows the major characteristic of the eigenvector basis, and the eigenvector evolution shows the search direction in a rotationally invariant. Considering the complexity of real-world optimization problems, the original operator and the eigenvector evolutionary operator are running alternately according to the success rate, and it is achieved by an adaptive selection mechanism (equations (17) and (18)). Pseudo code of the proposed approach is shown in Algorithm 2.Figure 2
Shifted rotated expanded Scaffers F6.Figure 3
Adaptive eigenvector evolutionary operator.Algorithm 2:Pseudo code.
(1)
The pseuco code of EFLA ( )(2)
Parameter setting: population sizeps, m, n Max fitness number (MAX_FES) etc.(3)
Initialize a populationX of ps frogs with random solutions and compute the fitness.(4)
while FES< = MAX_FES(5)
//Local search process (exploitation)(6)
sortX; //descending order for the population X according to the fitness values(7)
For (i = 1; i < = m; i + +)//m is the number of memeplexes(8)
For (j = 1; j < = n; j + +)//n is the number of frogs in one submemeplex(9)
Get the best frogXbest and the worst frog Xworst in one memeplex;(10)
Computing the two potential wells and length of search by equations (8), (9), (10), and (11);(11)
Updating the position of frogs by equation (7);(12)
End for(13)
End for(14)
//Global search process (exploration)(15)
For (i = 1; i< = ps; i + +)(16)
Obtain the new positionYi of frogs by equation (12); // Xi means a vector(17)
End for(18)
Use equations (13), (14), (15), (16), and (17); //the eigenvector basis based search operator(19)
For (i = 1; i < = ps; i + +)//(20)
If rand <p(21)
Xnew1 = Yi;//standard search equation (12)(22)
Else//X, Y means the same matrix with ps columns and d rows(23)
Xnew2=Yieig; //eigenvector search (equations (15), (16), and (17))(24)
End IF(25)
p = p∗(1−1/ps0) + (1/ps0) ∗ (p1/(p1 + p2)); //equation (18), Initial p0 = 0.5; ps0 = 2(26)
//p1 is the number of success by Xnew1 according to the fitness value(27)
//p2 is the number of success by Xnew2 according to the fitness value(28)
End for(29)
End While


## 5. Experimental Results and Analysis

To test the performance of the proposed approach, we conduct a real-world parameter optimization problem of SVM and the 30 benchmark functions recommended by literature [45], CEC2013 [66], and CEC2014 [67]. Fifteen functions (F1–F15) belong to the basic optimization problem, nine functions (F16–F24) belong to CEC2013, and six functions (F25–F30) belong to CEC2014. Different problems (unimodal, multimodal, rotated, and composition) are considered. To verify the effectiveness of the proposed algorithm, 12 well-known algorithms including NNA [68], LAPO [69], GbABC [70], SFLA [71], SCA [72], SSA [11], GWO [6], CMAES [73], WQPSO [48], TSQPSO [57], SaDE [74], and AAA [10] are used for benchmark suites. Each algorithm is carried out independently on the same machine by the MATLAB 2009R for 30 runs. For fair comparison, the fitness evaluation number (FES) is used instead of using the number of iteration. The max evaluation number (MAX_FES) is set as D∗1E4, and D is the dimension. We record all the fitness evaluations and the error values fx−f∗, where f∗ denotes the global optimum value. The basis analysis such as mean and standard deviation is used. In addition, we adopt the T-test [75], Wilcoxon signed-rank test [76], and Friedman test [76].Wilcoxon’s test is used in our experimental study, the first step is to compute theR + and R− related to the comparisons between EFLA and the rest of algorithms. Let R + be the sum of ranks for the problems in which the first algorithm outperformed the second, and R− be the sum of ranks for the opposite. Once they have been obtained, their associated p values can be computed. The null hypothesis H0 was used for the Wilcoxon signed-rank tests for purpose of this paper. The statistical significant value used to test H0 hypothesis is τ = 0.05. If in any test a p value that is smaller than or equal to significance level τ value is produced, then the H0 hypothesis for that test is rejected and the alternative hypothesis is selected.The Friedman test is a nonparametric analog of the parametric two-way analysis of variance, which can be used to detect whether there exist significance among the results of the algorithms. Inside the field of statistics, hypothesis testing can be used to draw inferences about one or more populations from the given results. The null hypothesis for Friedman’s test states equality of results between the algorithms. The alternative hypothesis is defined as the negation of the null hypothesis, so it is nondirectional. The statistical significance value used to test H0 hypothesis isτ = 0.05. If in any test a p value that is smaller than or equal to significance level τ value is produced, then the H0 hypothesis for that test is rejected and the alternative hypothesis is selected. It ranks the algorithms for each problem separately; the best performing algorithm ranks 1, the second best has a rank of 2, and so on.The details of the 30 benchmark functions are shown in Table1, and the parameter setting of 13 algorithms is shown in Table 2.Table 1
Details of benchmark problem.
FunBenchmark problemType lowLowUpDimOptimum valuesF1Sphere functionU−100100300F2Schwefel’s problem 2.22U−1010300F3Schwefel’s problem 1.2U−100100300F4Quartic functionU−1.281.28300F5Rastrigrin functionM−5.125.12300F6Ackley functionM−3232300F7Griewank functionM−600600300F8Rosenbrock functionM−1010300F9Penalized functionM−5050300F10Weierstrass’s functionM−0.50.5300F11Zakharov functionM−510300F12Alpine functionM−1010300F13Salomon problemM−100100300F14Periodic problemM−1010300.9F15Inverted cosine mixture problemM−11300F16Sphere functionU−10010030−1400F17Rotated high conditioned elliptic functionU−10010030−1300F18Rotated discus functionU−10010030−1100F19Different powers functionU−10010030−1000F20Rotated Ackley’s functionM−10010030−700F21Rotated Weierstrass functionM−10010030−600F22Rotated Griewank’s functionM−10010030−500F23Rotated Schwefel’s functionM−10010030100F24Expanded Scaffer’s F6 functionM−10010030600F25Shifted and rotated Schwefel’s functionM−100100301100F26Hybrid function 1 (N = 3)M−100100301700F27Hybrid function 2 (N = 3)M−100100301800F28Hybrid function 4 (N = 4)M−100100302000F29Hybrid function 5 (N = 5)M−100100302100F30Composition function 2 (N = 3)M−100100302400Table 2
Parameters setting.
No.AlgorithmParameter setting1NNA [68]w = 1/(2∗ log(2)), c1 = 0.5 + log(2), c2 = c1, pop_size = 502LAPO [69]F = 0.5, CR = 0.9, pop_size = 403GbABC [70]SN = 12, limit = 1.12∗ (popsize/2) ∗ D, C = 1.507, pop_size = 244SFLA [38]c = 1, le = 5, m = 8, n = 5, pop_size = 405SCA [72]pmodify = 1, PMutate = 0.01, elitism parameter = 2, pop_size = 306SSA [11]Rpower = 2, Rnorm = 2, ElitistCheck = 1, pop_size = 307GWO [6]pop_size = 308CMAES [73]σ=0.25,μ=floor4+floor3⋅logD/2 pop_size = 4 + floor(3 log (D)), D is the dimension9WQPSO [48]W = Wmin + (MAX_FES-FES)/MAX_FES∗ (Wmax-Wmin), Wwin = 0.5, Wmax = 1.0, pop_size = 8010TSQPSO [57]W = Wmin + (MAX_FES-FES)/MAX_FES∗ (Wmax−Wmin), Wwin = 0.5, Wmax = 1.0, pop_size = 5011SaDE [74]F ∼N (0.5, 0.3), CR ∼N (CRm, 0.1), mutation strategies and crossover strategies, learngen = 50; pop_size = 5012AAA [10]e = 0.3, delta = 2, Ap = 0.5, pop_size = 4013EFLAm = 6, n = 5, pop_size = 30


### 5.1. Experimental Results and Analysis on the First Test Suite for Low Dimension (D = 30)

In this test, we compare the proposed algorithm with the 12 well-known algorithms for the 30 benchmark functions in low dimension (D = 30). Tables 3 and 4 show the comparison results with EFLA and 12 algorithms including two quantum simulation based-PSO versions (TSQPSO and WQPSO), seven SI algorithms (NNA, LAPO, SFLA, SSA, SCA, GWO, and AAA), an improved ABC algorithm (GbABC), and two evolutionary algorithms (SaDE and CMAES). The mean and standard deviation of the error values obtained by the 13 algorithms are listed in Tables 3 and 4, where the performance rank of the 13 algorithms is also represented. The character ‘R’ in the first line of Tables 3 and 4 is the abbreviation of word ‘rank’; each column starting with ‘R’ after each algorithm denotes the rank of the 13 algorithms. It can be observed that the proposed algorithm is a competitive SFLA variant for the first test suite. According to the theorem of ‘No Free Lunch’ [27], one algorithm cannot offer better performance than all the others on every aspect or on every kind of problem. This is also observed in our experimental results. In optimizing the 30 functions, EFLA is ranked the first for 10 times, the second for 7 times, the third for 5 times, and ranked the fourth and fifth for 2 and 1 times, respectively. Compared with the solution accuracy on seven unimodal functions (F1, F2, F3, F4, F16, F17, and F18), EFLA is ranked first 2 times, CMAES is ranked first 2 times, SaDE is ranked first 2 times, LAPO is ranked first 4 times, SaDE and EFLA are ranked first 2 times, and GWO is ranked first 1 time. It indicates that EFLA achieves the global optimum for sphere function (F1) and Schwefel’s problem 1.2 (F3). On many multimodal functions, EFLA represents the better exploration ability than others. Rastrigrin function (F5) and Griewank function (F7) have many local optima, and it can be seen that EFLA obtains the global optimum. Especially, it is observed that EFLA achieves better solution accuracy than the other 12 algorithms for the hybrid function 1 (N = 3) and hybrid function 2 (N = 3), which are complex multimodal and nonseparable problems. We can also observe that EFLA achieves the better solution accuracy than LAPO TSQPSO, WQPSO, GbABC, NNA, SaDE, SFLA, SSA, CMAES, SCA, AAA, and GWO for F1, F3, F5, F7, F10, F11, F23, F26, F27, and F29.Table 3
Comparison results of EFLA and other algorithms.
FuncLAPORTSQPSORWQPSORGbABCRNNARSaDEREFLARF1 mean2.0679E − 14842.6238E − 21134.8770E − 11362.9012E − 16122.7095E − 17119.1574E − 13151.9097E − 2321Std.4.2386E − 1480.0000E + 001.7583E − 1125.0880E − 174.6804E − 173.4926E − 1300.0000E + 00F2 mean3.7638E − 14947.8721E − 21134.2486E − 11462.7007E − 16121.6208E − 19111.0352E − 13153.3520E − 2332Std.1.8902E − 1480.0000E + 001.1122E − 1134.5535E − 172.6731E − 194.1658E − 1310.0000E + 00F3 mean3.6017E − 3324.1406E − 0384.2179E − 0191.7557E + 03131.6058E − 0965.2152E − 0773.3911E − 341Std.1.9395E − 327.0602E − 031.3847E + 001.1055E + 033.5930E − 091.1523E − 061.5866E − 33F4 mean4.7463E − 0513.7149E − 0441.1896E − 0352.2604E − 02122.6980E − 0432.5599E − 0381.7149E − 036Std.3.2024E − 051.6593E − 043.9106E − 045.1604E − 031.5368E − 041.0640E − 031.0814E − 03F5 mean0.0000E + 0011.0518E + 0291.5472E + 0150.0000E + 0014.0321E + 0170.0000E + 0010.0000E + 001Std.0.0000E + 002.9610E + 013.6786E + 000.0000E + 003.2685E + 010.0000E + 000.0000E + 00F6 mean1.0463E + 0194.5001E − 1515.6843E − 1522.9132E − 1458.2543E − 1066.2087E − 0277.2239E − 153Std.8.3330E − 011.5979E − 151.7702E − 152.3603E − 151.2301E − 092.3628E − 011.4703E − 15F7 mean1.8553E − 0353.6281E − 0439.8442E − 0380.0000E + 0011.9066E − 0364.5956E − 0370.0000E + 001Std.1.0162E − 021.9827E − 031.1601E − 020.0000E + 007.4693E − 038.9739E − 030.0000E + 00F8 mean2.8902E + 01112.5087E + 0172.4225E + 0162.6748E + 0022.5286E + 0182.3092E + 0151.9977E + 014Std.3.0136E − 021.6761E − 011.0980E + 011.2591E + 011.0413E + 019.8351E + 007.8322E − 01F9 mean5.8221E − 01109.4438E − 0651.5715E − 0632.5623E − 1627.3370E − 0643.4556E − 0364.4920E − 029Std.1.2562E − 017.7667E − 062.0857E − 073.1052E − 171.1419E − 051.8927E − 021.1119E − 01F10 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0011.4559E − 0724.8788E − 0330.0000E + 001Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 002.9588E − 072.1574E − 020.0000E + 00F11 mean7.0369E − 5726.0621E − 2463.1426E − 1581.5685E + 02133.3002E − 1671.4262E − 1294.0066E − 751Std.2.5996E − 562.4055E − 233.7257E − 154.1783E + 014.9773E − 162.7601E − 121.6367E − 74F12 mean3.4937E − 8123.8208E − 01116.7492E − 0398.5518E − 0873.5388E + 00132.0354E − 1744.9165E − 166Std.5.3073E − 812.0428E + 001.3164E − 024.6840E − 072.2808E + 001.1148E − 168.0839E − 16F13 mean9.9873E − 0211.6654E − 0152.0321E − 0176.5987E − 01121.5321E − 0142.5654E − 0181.9987E − 016Std.2.6587E − 094.7946E − 023.1984E − 021.3287E − 015.0742E − 026.2606E − 022.6261E − 02F14 mean2.2111E + 00112.9183E + 00121.2187E + 00101.0000E − 0141.4937E − 0161.1274E − 0151.6718E − 017Std.1.3244E + 007.6066E − 011.2750E + 001.8426E − 067.6006E − 025.4024E − 034.8375E − 02F15 mean6.1931E − 15141.7370E − 2142.4477E − 11655.1648E − 1791.3067E − 2084.9261E − 03112.3950E − 2362Std.1.9234E − 1500.0000E + 001.0387E − 1156.3433E − 183.9609E − 202.6982E − 020.0000E + 00F16 mean4.9333E + 04133.4645E + 0093.2837E − 0176.2149E − 1362.2862E + 0080.0000E + 0013.7138E − 134Std.3.4293E + 037.6157E + 004.6514E − 021.4545E − 134.0603E + 000.0000E + 001.9333E − 13F17 mean6.2032E + 08137.2635E + 0674.4582E + 0661.7429E + 0791.2600E + 0784.2644E + 0531.5593E + 052Std.2.4118E + 082.8245E + 062.2790E + 065.2228E + 064.3819E + 062.4265E + 051.0031E + 05F18 mean6.4263E + 04121.4323E + 0332.1750E + 0348.7421E + 04139.6899E + 0383.1923E + 0365.5248E + 002Std.3.1371E + 036.4265E + 029.1906E + 021.2549E + 043.9949E + 031.5177E + 035.3507E + 00F19 mean1.9648E + 04134.4660E + 01102.3662E − 0171.1823E − 1241.5171E + 0080.0000E + 0016.0633E − 133Std.6.7840E + 031.5296E + 012.6707E − 022.9945E − 132.9757E + 000.0000E + 003.3022E − 13F20 mean2.0942E + 0182.0945E + 0192.0936E + 0152.0957E + 01122.0952E + 01102.0930E + 0132.0921E + 012Std.6.6635E − 024.2900E − 024.8137E − 024.3188E − 024.7127E − 025.4512E − 026.9368E − 02F21 mean3.3880E + 01123.2223E + 01101.9235E + 0122.9199E + 0162.9536E + 0181.7362E + 0112.1746E + 013Std.1.1392E + 003.2294E + 003.9092E + 002.2216E + 002.9798E + 002.8439E + 003.2228E + 00F22 mean7.5833E + 03131.5974E + 0191.3157E + 0071.2354E + 0069.9663E + 0082.5310E − 0142.1249E − 013Std.1.4622E + 031.1760E + 012.1498E − 014.0112E − 018.0468E + 001.2585E − 011.1696E − 01F23 mean7.2429E + 03125.9708E + 0397.1367E + 03113.9898E + 0334.6973E + 0374.5802E + 0363.0790E + 031Std.3.3604E + 029.0511E + 023.6869E + 024.3627E + 027.2290E + 021.1312E + 035.8848E + 02F24 mean1.2784E + 0191.1985E + 0151.1978E + 0141.4554E + 01131.2935E + 01111.0801E + 0111.1167E + 012Std.3.8517E − 014.8984E − 014.4676E − 012.1412E − 017.5276E − 015.1674E − 018.5698E − 01F25 mean6.6897E + 03105.4734E + 0395.3861E + 03122.0737E + 0313.9468E + 0373.1024E + 0342.7380E + 033Std.3.2043E + 027.7868E + 021.2302E + 033.5805E + 026.6736E + 026.7238E + 025.7139E + 02F26 mean5.3508E + 07132.1023E + 0542.9649E + 0565.9358E + 06118.9966E + 0581.0982E + 0439.3688E + 021Std.3.4832E + 071.2160E + 051.8309E + 053.7139E + 067.6690E + 051.1758E + 042.7344E + 02F27 mean3.8211E + 09131.8409E + 0367.7833E + 0385.6953E + 04102.6359E + 0498.1686E + 0248.4483E + 011Std.1.5410E + 092.0800E + 037.8001E + 037.4420E + 044.8954E + 049.0611E + 022.1385E + 01F28 mean9.4589E + 04132.8808E + 0244.5894E + 0251.0856E + 04116.1975E + 0397.8279E + 0118.5297E + 012Std.3.6264E + 041.8178E + 021.8715E + 024.4541E + 034.2717E + 035.6083E + 014.1632E + 01F29 mean1.1208E + 07138.1877E + 0458.0641E + 0448.2012E + 05113.6377E +  0593.8309E + 0334.1560E + 021Std.9.9516E + 066.1105E + 047.9208E + 044.8406E + 052.8624E + 053.7988E + 031.6027E + 02F30 mean2.0000E + 0212.1146E + 0242.2985E + 02112.2947E + 02102.2436E + 0262.2694E + 0292.1221E + 025Std.2.0568E − 031.4433E + 016.0633E + 001.1562E + 001.4539E + 014.0580E + 001.3611E + 01Table 4
Comparison results of EFLA and other algorithms.
FuncSFLARSSARCMAESRSCARAAARGWOREFLARF1 mean1.4983E − 14131.8953E − 5281.8594E − 29103.0185E − 5297.7636E − 8173.9830E − 22921.9097E − 2321Std.6.8321E − 143.0968E − 532.1514E − 301.4485E − 511.1026E − 800.0000E + 000.0000E + 00F2 mean.4.1071E − 16131.8339E − 5481.9386E − 29108.0787E − 5291.0913E − 8377.7509E − 23413.3520E − 2332Std.2.1422E − 153.7522E − 552.1448E − 304.4249E − 511.8890E − 830.0000E + 000.0000E + 00F3 mean1.0252E + 01117.5471E − 1157.0456E − 2832.0687E + 01126.0855E + 00109.8559E − 2743.3911E − 341Std.4.6762E + 001.5092E − 109.4987E − 291.0603E + 024.4564E + 004.0907E − 261.5866E − 33F4 mean2.0006E − 0371.7915E − 02115.5304E − 02132.6205E − 0399.4294E − 03102.2596E − 0421.7149E − 036Std.5.2913E − 046.7959E − 031.5263E − 022.6535E − 032.2864E − 031.1757E − 041.0814E − 03F5 mean1.9710E + 0166.6961E + 0182.3242E + 02101.2529E + 0043.3165E − 0228.2594E − 0130.0000E + 001Std.7.1148E + 001.3697E + 014.9397E + 016.8622E + 001.8165E − 012.0051E + 000.0000E + 00F6 mean2.0516E − 0181.8791E + 00101.9416E + 01136.0329E + 00111.3145E − 1441.0121E + 01127.2239E − 153Std.3.8173E − 019.6749E − 012.0146E − 019.3730E + 002.1173E − 151.0294E + 011.4703E − 15F7 mean3.8681E − 02101.0916E − 0291.5606E − 0340.0000E + 0010.0000E + 0012.7034E − 0420.0000E + 001Std.2.9514E − 021.0414E − 023.7436E − 030.0000E + 000.0000E + 001.4807E − 030.0000E + 00F8 mean3.0799E + 01123.4417E + 01132.6577E − 0112.7378E + 01108.4609E + 0032.5979E + 0191.9977E + 014Std.1.3159E + 012.3269E + 011.0114E + 006.8511E − 011.4282E + 015.3992E − 017.8322E − 01F9 mean3.4562E − 0362.4483E + 00126.9113E − 0373.5419E − 01111.5705E − 3217.9047E − 0384.4920E − 029Std.1.8927E − 022.2790E + 002.6302E − 028.5982E − 025.5674E − 487.8180E − 031.1119E − 01F10 mean2.3550E + 0041.3917E + 0162.7419E + 0050.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 001Std.1.0955E + 003.3271E + 002.0527E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F11 mean4.0243E + 00123.1346E − 4542.9481E − 2752.5242E − 07101.3122E − 01112.7033E − 4534.0066E − 751Std.1.9618E + 001.7163E − 443.8367E − 285.3396E − 071.5176E − 018.5571E − 451.6367E − 74F12 mean1.8256E − 0482.7640E + 00129.1571E − 02108.8684E − 3533.7515E − 1654.0050E − 14214.9165E − 166Std.5.1853E − 041.3874E + 001.4377E − 014.8574E − 347.4335E − 162.1936E − 1418.0839E − 16F13 mean4.1654E − 01105.3321E − 01112.8746E + 01131.0987E − 0124.1331E − 0191.4987E − 0131.9987E − 016Std.5.9209E − 028.4418E − 029.6013E + 003.0513E − 026.8037E − 025.0855E − 022.6261E − 02F14 mean1.8365E − 0181.0000E − 0121.0000E − 0111.5591E + 0091.0000E − 0135.9277E + 00131.6718E − 017Std.2.2196E − 011.0506E − 167.0575E − 171.7118E + 001.0811E − 163.7705E − 014.8375E − 02F15 mean3.3461E − 04101.2266E + 00133.1035E − 01129.7236E − 5471.2226E − 8465.3910E − 23712.3950E − 2362Std.1.8095E − 034.0361E − 012.2413E − 015.3258E − 531.7662E − 840.0000E + 000.0000E + 00F16 mean1.9029E + 02104.0927E − 1353.0316E − 1421.1694E + 04122.6527E − 1336.5110E + 02113.7138E − 134Std.6.7655E + 011.3876E − 137.8614E − 141.5834E + 038.6186E − 144.5105E + 021.9333E − 13F17 mean1.8713E + 07103.5035E + 0652.2737E − 1411.3770E + 08123.3818E + 0641.9410E + 07111.5593E + 052Std.2.9155E + 061.7388E + 066.9378E − 144.3839E + 072.3501E + 068.8776E + 061.0031E + 05F18 mean1.0201E + 0494.1146E + 0374.5475E − 1413.5670E + 04103.7660E + 04113.1308E + 0355.5248E + 002Std.1.2569E + 032.1389E + 039.2504E − 145.3129E + 039.1768E + 031.6376E + 035.3507E +  + 00F19 mean8.5316E + 0193.2161E − 0362.4481E − 1252.4590E + 03122.6527E − 1323.6569E + 02116.0633E − 133Std.1.5073E + 012.9560E − 045.2136E − 128.6868E + 026.2149E − 142.0308E + 023.3022E − 13F20 mean2.0960E + 01132.0908E + 0112.0954E + 01112.0939E + 0162.0931E + 0142.0941E + 0172.0921E + 012Std.3.8597E − 027.3270E − 024.0485E − 025.7432E − 025.7590E − 025.4833E − 026.9368E − 02F21 mean3.2559E + 0172.6683E + 0154.5021E + 01133.9251E + 01112.4122E + 0143.3938E + 0192.1746E + 013Std.3.1236E + 003.0815E + 006.6350E + 001.3787E + 002.4257E + 008.0021E + 003.2228E + 00F22 mean6.6800E + 01101.0450E − 0121.6916E − 0211.5845E + 03122.3036E − 0152.0064E + 02112.1249E − 013Std.1.1481E + 014.5148E − 021.1343E − 023.5064E + 028.9844E − 021.0603E + 021.1696E − 01F23 mean4.0343E + 0344.2009E + 0355.0284E + 0387.4363E + 03133.6318E + 0327.0628E + 03103.0790E + 031Std.6.0325E + 026.7592E + 027.0278E + 022.3183E + 025.1933E + 026.7585E + 025.8848E + 02F24 mean1.2788E + 01101.2548E + 0181.2319E + 0161.4018E + 01121.2545E + 0171.1801E + 0131.1167E + 012Std.8.7092E − 011.2020E + 007.4841E − 013.1337E − 018.3427E − 015.8045E − 018.5698E − 01F25 mean3.4020E + 0353.8534E + 0365.0874E + 0386.9619E + 03112.0730E + 0325.8655E + 03132.7380E + 033Std.7.3450E + 025.9094E + 026.8133E + 023.2297E + 024.3520E + 021.6214E + 035.7139E + 02F26 mean1.3462E + 0692.9059E + 0551.5367E + 0325.9984E + 06127.7577E + 0571.5977E + 06109.3688E + 021Std.3.6288E + 052.1346E + 053.6940E + 022.5093E + 065.0958E + 051.0360E + 062.7344E + 02F27 mean5.0549E + 0235.4088E + 0371.3463E + 0221.4413E + 08121.4795E + 0352.5011E + 06118.4483E + 011Std.3.0414E + 025.9412E + 035.2506E + 018.8005E + 071.8325E + 036.0566E + 062.1385E + 01F28 mean5.3673E + 0381.4662E + 0373.0114E + 0231.4684E + 04127.2467E + 03109.0622E + 0268.5297E + 012Std.2.0421E + 031.3799E + 031.3330E + 025.6078E + 035.3916E + 031.4077E + 034.1632E + 01F29 mean2.6622E + 0581.0791E + 0561.0405E + 0321.4249E + 06121.5329E + 0574.9044E + 05104.1560E + 021Std.1.5496E + 058.1334E + 044.0995E + 024.6378E + 051.1548E + 054.5133E + 051.6027E + 02F30 mean2.2546E + 0282.4364E + 02132.3203E + 02122.0010E + 0232.2520E + 0272.0001E + 0222.1221E + 025Std.2.2867E + 005.6068E + 006.5750E + 009.8715E − 028.5013E − 013.8083E − 031.3611E + 01For the thorough analysis, the ‘robustness’ in this paper is used to evaluate the search stability of the algorithms under different condition (such as the rotated and unrotated test function). It means that the proposed algorithm can obtain better performance whether the optimization problem is in the rotated system or in the unrotated system. We know that the 30 optimization problems in this suite are combined by the two types. Type 1 (F1–F15) is the basic unrotated benchmark functions, and Type 2 (F16–F30) is the rotated, composition or hybrid problems. It is observed from Tables3 and 4 that WQPSO, CMAES, SaDE, and SSA can achieve the better solution accuracy for Type 2 but poor accuracy for Type 1. Contrary, LAPO, SCA, NNA, TSQPSO, GbABC, and GWO can achieve the better accuracy for Type 1 but poor accuracy for Type 2. In comparison with them, it is observed that EFLA achieves the better solution accuracy for more optimization problems including not only Type 1 but also Type 2, which means that it has the better robustness than others.TheT−test method is used to compare the difference between EFLA to the other 12 algorithms for the 30 optimization problems. In these experiments, a two-tailed test with significance level of 0.05 is adopted, and the p value and t-value are recorded and shown in Tables 5 and 6. The better results of EFLA than other algorithms are shown in bold. ‘−’ means that EFLA and the other algorithm obtain almost the same global optimum (it cannot be computed by t−test). The last lines in Table 5 and 6 denote the number of ‘B,’’ ‘N,’ and ‘W.’ ‘B’ means that EFLA is significantly better than the other algorithm, ‘N’ means that there is no significant difference between EFLA and the other algorithm, and ‘W’ means that the other algorithm is significantly better than EFLA. The average excellent rate between EFLA and the other 12 algorithms for the 30 functions is 71.11%, which can be computed as the following equation:(19)rate=∑i=112∑j=130Bi,j∑i=112∑j=130Bi,j+Ni,j+Wi,j.Table 5
T-test for comparison results with EFLA and other algorithms.
FuncLAPOTSQPSOWQPSOGbABCNNASaDEF1p value6.1172E − 030.0000E + 006.9769E − 023.5402E − 241.7874E − 038.0836E − 02t-value2.6722E + 006.5535E + 041.5192E + 003.1231E + 013.1708E + 001.4361E + 00F2p value1.4221E − 010.0000E + 002.2638E − 021.1654E − 241.2156E − 039.1988E − 02t-value1.0906E + 006.5535E + 042.0923E + 003.2486E + 013.3210E + 001.3611E + 00F3p value1.8380E − 011.6081E − 035.3001E − 027.0531E − 101.0328E − 029.6192E − 03t-value9.1528E − 013.2122E + 001.6684E + 008.6990E + 002.4479E + 002.4789E + 00F4p value1.0000E + 001.0000E + 009.9181E − 014.0816E − 201.0000E + 002.8020E − 03t-value−8.4184E + 00−6.7403E + 00−2.5485E + 002.2326E + 01−7.2306E + 002.9924E + 00F5p value—1.7304E − 181.7242E − 20—1.0224E − 07—t-value—1.9456E + 012.3036E + 01—6.7569E + 00—F6p value5.6081E − 341.0000E + 009.9988E − 011.4270E − 294.7918E − 048.0394E − 02t-value6.8771E + 01−8.3316E + 00−4.1763E + 004.8325E + 013.6754E + 001.4392E + 00F7p value1.6279E − 011.6225E − 013.3740E − 05—8.6346E − 024.4460E − 03t-value1.0000E + 001.0023E + 004.6476E + 00—1.3981E + 002.8049E + 00F8p value7.3722E − 331.0287E − 252.0964E − 021.0000E + 005.2738E − 034.4960E − 02t-value6.2889E + 013.5394E + 012.1284E + 00−7.4374E + 002.7342E + 001.7544E + 00F9p value4.1085E − 179.8251E − 019.8253E − 019.8253E − 019.8251E − 019.7187E − 01t-value1.7285E + 01−2.2123E + 00−2.2127E + 00−2.2127E + 00−2.2124E + 00−1.9886E + 00F10p value————5.7935E − 031.1271E − 01t-value————2.6950E + 001.2386E + 00F11p value7.4481E − 028.9015E − 023.6433E − 053.8744E − 195.3836E − 044.1812E − 03t-value1.4826E + 001.3803E + 004.6199E + 002.0561E + 013.6316E + 002.8301E + 00F12p value9.9882E − 011.5705E − 014.4113E − 031.6279E − 011.1539E − 099.9794E − 01t-value−3.3312E + 001.0244E + 002.8081E + 001.0000E + 008.4983E + 00−3.1153E + 00F13p value1.0000E + 009.9732E − 013.3119E − 011.5281E − 179.9983E − 014.1641E − 05t-value−2.0857E + 01−3.0104E + 004.4114E − 011.7940E + 01−4.0649E + 004.5717E + 00F14p value1.3970E − 091.1918E − 185.8521E − 051.0000E + 008.7069E − 011.0000E + 00t-value8.4209E + 001.9727E + 014.4485E + 00−7.6068E + 00−1.1523E + 00−6.1445E + 00F15p value4.4169E − 020.0000E + 001.0351E − 011.4225E − 284.0579E − 021.6279E − 01t-value1.7636E + 006.5535E + 041.2907E + 004.4596E + 011.8069E + 001.0000E + 00F16p value2.2146E − 351.8681E − 021.6670E − 269.4398E − 064.4541E − 032.0580E − 11t-value7.8793E + 012.4917E + 003.8667E + 015.3557E + 003.0840E + 00−1.0521E + 01F17p value1.6862E − 142.8856E − 142.9742E − 112.4646E − 171.4025E − 152.7998E − 05t-value1.4084E + 011.3789E + 011.0355E + 011.8085E + 011.5515E + 014.9645E + 00F18p value8.1734E − 406.2243E − 131.5126E − 132.4389E − 267.4395E − 142.6112E − 12t-value1.1216E + 021.2186E + 011.2907E + 013.8153E + 011.3279E + 011.1485E + 01F19p value7.8659E − 166.3716E − 162.5304E − 297.3198E − 099.1664E − 035.7997E − 11t-value1.5863E + 011.5992E + 014.8529E + 018.0358E + 002.7924E + 00−1.0057E + 01F20p value2.0538E − 011.0945E − 013.5879E − 011.5016E − 024.2555E − 025.8238E − 01t-value1.2955E + 001.6514E + 009.3247E − 012.5855E + 002.1214E + 005.5614E − 01F21p value8.3632E − 199.8736E − 131.4395E − 022.9524E − 122.6133E − 102.2364E − 05t-value2.0503E + 011.1958E + 01−2.6035E + 001.1426E + 019.4036E + 00−5.0453E + 00F22p value1.0184E − 224.1524E − 081.6168E − 202.1637E − 142.7111E − 072.3769E − 01t-value2.8405E + 017.3599E + 002.3678E + 011.3947E + 016.6517E + 001.2057E + 00F23p value7.7098E − 251.6951E − 152.7714E − 221.9645E − 071.3576E − 101.3455E − 06t-value3.3782E + 011.5402E + 012.7407E + 016.7718E + 009.6849E + 006.0616E + 00F24p value2.3504E − 111.6781E − 041.8959E − 051.0796E − 191.3665E − 096.1715E − 02t-value1.0461E + 014.3178E + 005.1047E + 002.2099E + 018.7120E + 00−1.9435E + 00F25p value3.0199E − 113.3384E − 111.4110E − 095.0912E − 062.0152E − 081.3272E − 02t-value6.6456E + 006.6308E + 006.0542E + 00−4.5610E + 005.6107E + 002.4764E + 00F26p value3.0199E − 113.0199E − 113.0199E − 113.0199E − 113.0199E − 113.0199E − 11t-value6.6456E + 006.6456E + 006.6456E + 006.6456E + 006.6456E + 006.6456E + 00F27p value3.0199E − 113.0199E − 113.0199E − 113.0199E − 113.0199E − 118.4848E − 09t-value6.6456E + 006.6456E + 006.6456E + 006.6456E + 006.6456E + 005.7585E + 00F28p value3.0199E − 111.3289E − 103.3384E − 113.0199E − 113.0199E − 111.4532E − 01t-value6.6456E + 006.4238E +  + 006.6308E + 006.6456E + 006.6456E + 00−1.4563E + 00F29p value3.0199E − 113.0199E − 113.0199E − 113.0199E − 113.0199E − 115.0922E − 08t-value6.6456E + 006.6456E + 006.6456E + 006.6456E + 006.6456E + 005.4481E + 00F30p value4.6159E − 101.6285E − 028.1975E − 078.4848E − 096.3560E − 057.2208E − 06t-value−6.2316E + 00−2.4025E + 004.9306E + 005.7585E + 003.9992E + 004.4871E + 00B/N/W19/10/117/12/121/9/023/6/125/5/017/13/0Table 6
T−test for comparison results with EFLA and other algorithms.
FuncSFLASSACMAESSCAAAAGWOF1p value1.1970E − 014.7988E − 252.5751E − 291.3152E − 012.9482E − 040.0000E + 00t-value1.2012E + 003.3521E + 014.7340E + 011.1414E + 003.8566E + 006.5535E + 04F2p value1.5116E − 012.6757E − 227.1377E − 301.6279E − 011.8179E − 031.0000E + 00t-value1.0501E + 002.6769E + 014.9508E + 011.0000E + 003.1642E + 006.5535E + 04F3p value4.4555E − 135.2131E − 032.0376E − 271.4702E − 011.5207E − 089.8639E − 02t-value1.2008E + 012.7391E + 004.0626E + 011.0686E + 007.4795E + 001.3196E + 00F4p value1.0803E − 013.7450E − 142.0769E − 184.5253E − 023.7838E − 161.0000E + 00t-value1.2646E + 001.3276E + 011.9325E + 011.7511E + 001.5887E + 01−7.7421E + 00F5p value1.2480E − 152.6583E − 227.7173E − 221.6279E − 011.6279E − 011.5887E − 02t-value1.5173E + 012.6776E + 012.5771E + 011.0000E + 001.0000E + 002.2562E + 00F6p value3.1631E − 037.9655E − 121.3084E − 597.1294E − 048.6649E − 144.3506E − 06t-value2.9436E + 001.0638E + 015.2787E + 023.5254E + 001.2836E + 015.3851E + 00F7p value3.3383E − 081.6255E − 061.4964E − 02−−1.6279E − 01t-value7.1786E + 005.7407E + 002.2833E + 00−−1.0000E + 00F8p value4.9354E − 051.0092E − 031.0000E + 001.3414E − 259.9993E − 017.5857E − 26t-value4.5102E + 003.3927E + 00−8.6414E + 013.5064E + 01−4.3746E + 003.5776E + 01F9p value9.7187E − 011.7840E − 069.5712E − 019.1216E − 139.8253E − 019.6146E − 01t-value−1.9886E + 005.7071E + 00−1.7788E + 001.1658E + 01−2.2127E + 00−1.8331E + 00F10p value7.1766E − 132.0033E − 202.3274E − 08——−t-value1.1774E + 012.2911E + 017.3162E + 00——−F11p value2.2041E − 121.6271E − 017.4411E − 287.4421E − 032.6435E − 054.7099E − 02t-value1.1235E + 011.0003E + 004.2086E + 012.5893E + 004.7356E + 001.7303E + 00F12p value3.1827E − 024.3936E − 127.8558E − 049.9882E − 017.4249E − 019.9882E − 01t-value1.9284E + 001.0912E + 013.4885E + 00−3.3312E + 00−6.5912E − 01−3.3312E + 00F13p value7.7454E − 191.0832E − 181.9836E − 161.0000E + 002.9930E − 169.9998E − 01t-value2.0043E + 011.9796E + 011.6283E + 01−1.6155E + 011.6030E + 01−4.7848E + 00F14p value3.4856E − 011.0000E + 001.0000E + 005.6018E − 051.0000E + 001.2412E − 36t-value3.9309E − 01−7.6068E + 00−7.6068E + 004.4644E + 00−7.6068E + 008.4996E + 01F15p value1.5976E − 011.1120E − 161.1595E − 081.6279E − 013.5115E − 041.0000E + 00t-value1.0128E + 001.6646E + 017.5843E + 001.0000E + 003.7916E + 006.5535E + 04F16 p value1.6843E − 153.9318E − 016.3185E − 114.6127E − 272.0380E − 021.0156E − 08t-value1.5406E + 018.6677E − 01−1.0019E + 014.0450E + 01−2.4538E + 007.9065E + 00F17p value3.3232E − 251.9599E − 112.2203E − 099.5786E − 172.9649E − 081.1868E − 12t-value3.4801E + 011.0543E + 01−8.5140E + 001.7185E + 017.4894E + 001.1867E + 01F18p value3.2445E − 282.0759E − 114.1154E − 066.9813E − 266.8464E − 202.4283E − 11t-value4.4391E + 011.0517E + 01−5.6554E + 003.6768E + 012.2469E + 011.0446E + 01F19p value8.7173E − 246.9426E − 326.1959E − 021.4268E − 153.5211E − 069.0159E − 11t-value3.1002E + 015.9593E + 011.9416E + 001.5504E + 01−5.7118E + 009.8630E + 00F20p value1.2367E − 024.6527E − 014.6523E − 023.1829E − 015.1373E − 012.3344E − 01t-value2.6677E + 00−7.3997E − 012.0795E + 001.0154E + 006.6115E − 011.2169E + 00F21p value4.7609E − 152.8266E − 077.4429E − 172.0334E − 212.2252E − 031.1693E − 07t-value1.4798E + 016.6362E + 001.7350E + 012.5517E + 013.3552E + 006.9665E + 00F22p value4.5203E − 241.7111E − 046.8284E − 104.7594E − 215.1359E − 013.0037E − 11t-value3.1732E + 01−4.3107E + 00−8.9989E + 002.4747E + 016.6138E − 011.0350E + 01F23p value1.5634E − 063.1673E − 077.1356E − 112.3312E − 252.8253E − 041.6599E − 19t-value6.0068E + 006.5939E + 009.9656E + 003.5238E + 014.1277E + 002.1755E + 01F24p value6.3207E − 071.4501E − 042.2210E − 061.3569E − 153.9789E − 074.9996E − 04t-value6.3385E + 004.3708E + 005.8790E + 001.5534E + 016.5093E + 003.9177E + 00F25p value6.9125E − 041.8500E − 088.1527E − 113.0199E − 111.5292E − 056.9125E − 04t-value3.3930E + 005.6255E + 006.4978E + 006.6456E + 00−4.3244E + 003.3930E + 00F26p value3.0199E − 113.0199E − 113.6459E − 083.0199E − 113.0199E − 113.0199E − 11t-value6.6456E + 006.6456E + 005.5072E + 006.6456E + 006.6456E + 006.6456E + 00F27p value3.0199E − 113.0199E − 114.3531E − 053.0199E − 116.7362E − 063.0199E − 11t-value6.6456E + 006.6456E + 004.0879E + 006.6456E + 004.5019E + 006.6456E + 00F28p value3.0199E − 113.0199E − 113.4742E − 103.0199E − 113.0199E − 113.0199E − 11t-value6.6456E + 006.6456E + 006.2760E + 006.6456E + 006.6456E + 006.6456E + 00F29p value3.0199E − 113.0199E − 116.1210E − 103.0199E − 113.0199E − 113.0199E − 11t-value6.6456E + 006.6456E + 006.1873E + 006.6456E + 006.6456E + 006.6456E + 00F30p value1.4067E − 046.0658E − 111.2541E − 075.2014E − 012.5974E − 058.8411E − 07t-value3.8070E + 006.5421E + 005.2854E + 00−6.4312E − 014.2062E + 00−4.9158E + 00B/N/W24/6/025/4/124/3/322/8/020/8219/11/0It means the average performance of EFLA is good although it is not always the best for all the functions with respect to the 12 algorithms.Table7 indicates more details of comparison results by Wilcoxon’s test. ‘+’ means that the EFLA is better than the other algorithms.‘ = ’ means that the EFLA obtains the equal results than the other algorithms. ‘−’ means that the EFLA is less than the other algorithms. The last three columns show the number of winner (w), equal (e), and lose (l) including the p values and the z-values. Table 7 shows that the average excellent rate between EFLA and the other 12 algorithms for the 30 functions is 80.55%, which can be computed as follows:(20)rate=∑i=112∑j=130wi,j∑i=112∑j=130wi,j+ei,j+li,j.Table 7
Wilcoxon signed-rank test for comparison results of EFLA and other algorithms.
FuncLAPOTSQPSOWQPSOGbABCNNASaDESFLASSACMAESSCAAAAGWOF1++++++++++++F2+++++++++++−F3++++++++++++F4−−−+−++++++−F5=++=+=++++++F6+−−+++++++++F7+++=+++++==+F8+++−++++−+−+F9+−−−−−−+−+−−F10====+++++===F11++++++++++++F12−++++−+++−−−F13−−++−++++−+−F14+++−−−+−−+−+F15+++++++++++−F16+++++−++−+−+F17++++++++−+++F18++++++++−+++F19+++++−++++−+F20+++++++−++++F21++−++−++++++F22+++++++−−+++F23++++++++++++F24+++++−++++++F25+++−++++++−+F26++++++++++++F27+++++−++++++F28++++++++++++F29++++++++++++F30−−+++++++−+−Totalw/e/l24/2/424/1/525/1/423/3/426/0/421/1/829/0/127/0/323/0/725/2/321/2/722/1/7p value1.07e − 0041.53e − 0037.14e − 0041.28e − 0032.83e − 0042.00e − 0025.73e − 0066.31e − 0052.95e − 0038.97e − 0051.39e − 0021.32e − 003z−value−3.8737−3.1678−3.3840−3.2195−3.6303−2.3245−4.5358−4.0006−2.9721−3.9167−2.4593−3.2110In addition, Friedman’s test is used. Table8 shows the average rank of 13 algorithms. We can see that the performance of EFLA is better than that of the other 12 algorithms with the minimal average rank value (3.12). Table 9 shows that the comparison of 13 algorithms has significant difference with p value = 9.43E − 11 (<0.05).Table 8
Friedman test for EFLA and other algorithms.
OrderAlgorithmAverages ranks1EFLA3.122SaDE5.123AAA5.504TSQPSO6.355WQPSO6.486GWO6.827CMAES7.008SSA7.779NNA7.9310GbABC7.9811LAPO8.3012SFLA9.2713SCA9.37Table 9
Statistical value of the Friedman test for EFLA and other algorithms.
MethodStatistical valueP valueFriedman test72.82909.43E−11To compare the convergence speed of 13 algorithms, the convergence curve is drawn in Figure4. We can see that the EFLA outperforms the 12 algorithms for the 6 different optimization problems including unrotated multimodal functions (F3, F7, and F11) and rotated multimodal functions (F23, F27, and F29). It is observed that the proposed algorithm converges faster than the others in overall iteration process for F7, F28, and F29. For rotated Schwefel’s function (F23), SSA converges faster than EFLA in the early iteration. However, in the late iteration, EFLA achieves the best solution than SSA. It means that SSA has the stronger exploitation ability but weak exploration ability. For EFLA, it completes the better balance between exploitation and exploration.Figure 4
Convergence curve: (a) F3 Schwefel’s problem 1.2; (b) F7 Griewank function; (c) F11 Zakharov function; (d) F15 inverted cosine mixture problem; (e) F21 rotated Schwefel’s function; (f) F25 hybrid function 2 (N = 3); (g) F26 hybrid function 4 (N = 4); (h) F27 hybrid function 5 (N = 5); (i) F28 hybrid function 6 (N = 5).
(a)(b)(c)(d)(e)(f)(g)(h)(i)


### 5.2. Scalability Analysis for the Second Test Suite for High Dimension (D-100)

We know that the performance of many heuristic optimization algorithms decreases drastically with the increase in the problem scale. In this experiment, we conduct scalability analysis for the 13 algorithms to test the performance of 100-D functions including two unrotated multimodal functions (F1 and F3) and four rotated multimodal functions (F20, F23, F28, and F29). Experimental settings are the same as those described in Table2. Table 10 reports the mean and standard deviation of the error values obtained by the 13 algorithms, where the best results are marked in bold. The character ‘R’ in the first line of Table 10 is the abbreviation of word ‘rank’; each column starting with ‘R’ after each algorithm denotes the rank of the 13 algorithms. The grey shading of each cell denotes that the performance of EFLA is better than that of the other algorithm. It can be observed that EFLA is ranked the first for 1 times, the second for 2 times, and the third for 3 times, respectively. There are at least four optimization problems that EFLA outperforms each one in the other 12 algorithms. For hybrid function 4 (N = 4) (F28), EFLA obtains the better accuracy than LAPO, TSQPSO, WQPSO, GbABC, NNA, SaDE, SFLA, SSA, CMAES, SCA, AAA, and GWO. For sphere function (F1), EFLA obtains the better accuracy than LAPO, TSQPSO, WQPSO, GbABC, NNA, SaDE, SFLA, SSA, CMAES, SCA, and AAA except for GWO.Table 10
Comparison results for 13 algorithms (D = 100).
AlgorithmsF1RF3RF20RF23RF28RF29RAAA mean1.1125E−7964.4886E + 03102.1242E + 0111.4474E + 0417.1266E + 04102.5430E + 066Std.2.5740E−791.4235E + 036.0063E − 021.2360E + 031.7915E + 049.6863E + 05EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E−022.4380E + 031.4322E + 027.2197E + 04GWO mean0.0000E + 0015.8937E−0342.1277E + 0142.9645E + 04101.0410E + 0471.1259E + 0710Std.0.0000E + 002.0000E−024.8661E−023.7559E + 036.0506E + 034.2230E + 06EFLA mean6.6252E−2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04CMAES mean1.3759E−2888.7795E − 2722.1278E + 0151.6447E + 0468.7535E + 0223.6520E + 031Std.6.7881E−306.1501E − 285.3762E−021.3676E + 031.6156E + 025.4436E + 02EFLA mean6.6252E − 2866.0290E−072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E−063.4012E − 022.4380E + 031.4322E + 027.2197E + 04LAPO mean0.0000E + 0012.8293E − 3212.1293E + 0183.0373E + 04117.6865E + 05133.7556E + 0813Std.0.0000E + 001.5481E − 312.7631E−026.1967E + 021.5186E + 057.3274E + 07EFLA mean6.6252E−2866.0290E−072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E−063.4012E − 022.4380E + 031.4322E + 027.2197E + 04SFLA mean1.4904E−13113.0880E + 0292.1303E + 01101.6551E + 0471.0833E + 0483.2197E + 067Std.8.0803E−135.9743E + 012.2014E−022.0443E + 031.4502E + 035.3386E + 05EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04NNA mean5.1299E−1793.6852E + 0052.1283E + 0161.9107E + 0481.2615E + 0497.7348E + 06Std.1.2987E−161.4683E + 013.6170E−021.5868E + 036.1335E + 032.5688E + 06EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 0511Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04GbABC mean1.5196E−15104.5842E + 04122.1308E + 01131.6237E + 0451.2516E + 05111.1578E + 07Std.1.2251E−167.5077E + 032.4901E−029.0027E + 022.8233E + 043.5576E + 06EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04SSA mean2.1980E−5172.3486E + 0282.1252E + 0121.4561E + 0421.7156E + 0359.2387E + 054Std.2.7362E−527.1058E + 014.5617E − 021.5796E + 033.5664E + 024.4898E + 05EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E−022.4380E + 031.4322E + 027.2197E + 04SCA mean1.6964E + 01127.6202E + 04132.1304E + 01113.0799E + 04131.3059E + 05127.6041E + 0712Std.9.2820E + 012.1699E + 042.6376E−024.6271E + 023.4908E + 042.1585E + 07EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04TSQPSO mean2.0134E−24432.3121E + 0272.1287E + 0172.8306E + 0491.1922E + 0333.2510E + 068Std.0.0000E + 009.2601E + 014.0094E−021.4779E + 033.7968E + 021.1347E + 06EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04WQPSO mean3.1583E−8851.1209E + 04112.1296E + 0193.0533E + 04121.3082E + 0343.6247E + 069Std.8.1474E−883.9403E + 033.6636E−024.3334E + 023.1719E + 021.4590E + 06EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04SaDE mean6.7961E−9444.7911E + 0062.1305E + 01121.4912E + 0446.7720E + 0362.9824E + 053Std.3.1491E−932.0130E + 002.8644E−022.0069E + 032.9429E + 031.0970E + 05EFLA mean6.6252E − 28626.0290E − 0732.1253E + 0131.4736E + 0438.4302E + 0211.5399E + 052Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04Particularly, for the multimodal functions, the number of local optima increases drastically with the problem dimension, which makes some algorithms vulnerable to premature convergence. As shown in Table3, Table 4, and Table 10, EFLA is the robust algorithm that can maintain a good global search ability in such cases for rotated Schwefel’s function (F23) and hybrid function 4 (N = 5) (F29), whereas the performance of the other algorithms deteriorates severely. Figure 5 shows the convergence curve of 13 algorithms for the F28 and F29. We can see that EFLA converges faster than 12 algorithms for F23 except F29. Though EFLA converges slowly than some other algorithms such as LAPO and GbABC, for F23, it achieves the best or almost the same fitness value than the other algorithms in the last iteration.Figure 5
Convergence curve: (a) F23 rotated Schwefel’s function; (b) F28 hybrid function 4(n = 4).
(a)(b)In addition, Friedman’s test is used. Table11 shows the average rank of 13 algorithms. We can see that the performance of EFLA is better than that of the other 12 algorithms with the minimal average rank value (2.50). Table 12 shows that the comparison of 13 algorithms has significant difference with p value = 0.001 (< 0.05).Table 11
Friedman test for EFLA and other algorithms.
OrderAlgorithmAverages ranks1EFLA2.502CMAES4.173SSA4.834AAA5.675SaDE6.006GWO6.087TSQPSO6.178NNA7.839LAPO7.9210WQPSO8.3311SFLA8.6712GbABC10.5013SCA12.33Table 12
Statistical value of the Friedman test for EFLA and other algorithms.
MethodStatistical valuep valueFriedman test33.2730.001


### 5.3. Parameter Sensitivity Analysis

Three parameters in our proposed approach, namely,popsize, m, and n, should be tuned. m is the number of submemeplexes and n is the number of frogs in each submemeplex. It is obvious that population size (popsize) is equal to m∗n. There are 12 combinations for the three parameters (popsize, m, and n). The proposed algorithms with 12 different parameter settings are run 30 times for the 30 benchmark optimization problems in Table 13. The results are shown in Table 13 in terms of the mean and standard deviation of the error values fx−f∗ obtained in the 30 runs independently by EFLA with different parameter combinations, and the bold font denotes the winner. The character ‘R’ in the first line of Table 13 is the abbreviation of word ‘rank’; each column starting with ‘R’ after each EFLA algorithm means the rank of the different twelve parameter combinations. The last line of Table 13 shows the number of winners for the EFLA by different parameter combinations. In order to analyze the impact of population size (popsize) of EFLA, the twelve parameter combinations are arranged to six groups as popsize = 20 (EFLA01, EFLA02, EFLA03, and EFLA04), popsize = 30 (EFLA05), popsize = 40 (EFLA06), popsize = 50 (FELA07), popsize = 60 (EFLA08), and popsize = 100 (EFLA09, EFLA10, EFLA11, and EFLA12). Generally speaking, the performances of many metaheuristic algorithms are affected by the population size. The larger population size can enhance the diversity of population but can reduce the convergence speed. Therefore, the population size of EFLA like other algorithms should be tuned according to the different optimization problems. In Table 13, it can be observed that EFLAs (EFLA01, EFLA02, EFLA03, and EFLA04) by the minimal population size (popsize = 20) obtain the larger number of winners especially for the Type 1 (basic unrotated benchmark functions, F1–F15). Contrast to the Type 2 (F16–F30, the rotated, composition, and hybrid problems), EFLAs (from EFLA05 to EFLA12) corresponding to the population size (from popsize = 30 to popsize = 100) obtain the larger number of winners especially for the Type 2. It can be observed that EFLAs can obtain better performance for Type 1 and Type 2 problems when the population size is increased from 30 to 60. In addition, the other two parameter combinations (m, n) also affect the performance of EFLA by the same population size. According to equations (6) and (7), we know that the number of submemeplexes (m) is equal to the number of the best solution (Xbest), which influences the first potential well Pk. EFLA with smaller number of submemeplexes is easy to trap into the local optimum for the multimodal problems due to the small numbers (parameter m) of the best solution (Xbest). In contrast, the larger number of submemeplexes (m) can increase the diversity of the population but cannot ensure that it obtains better solution. Figure 6 shows the performance of EFLAs with different parameter combinations by Friedman’s test. It can be observed that EFLA obtains the poor performance by the smaller values of m (m = 2 for population size 20 or 100) whether the population size is larger or smaller. Table 14 shows the average rank results by the Friedman test. We can see that the best parameter combination of popsize, m, and n is (popsize = 50, m = 10, and n = 5). Table 15 shows the statistical value (p−value = 0.003); it indicates that the performance of EFLA with different four parameters has significant difference. In addition, we compare the performance of the 12 algorithms with that of the EFLA algorithms with the 12 different parameter combinations by Friedman’s test. The statistical value is equal to 200.829, and p value is equal to 2.40E−30. It means that there are significant differences among the 24 algorithms. Figure 7 shows the ranks among the 24 algorithms. It is worth mentioning that the EFLA outperforms all the 12 algorithms no matter which parameter combination is chosen.Table 13
Comparison results of EFLA with different parameters.
FuncEFLA01REFLA02REFLA03REFLA04REFLA05REFLA06R(m = 2, n = 10)(m = 4, n = 5)(m = 5, n = 4)(m = 10, n = 2)(m = 6, n = 5)(m = 5, n = 8F1 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0011.9097E − 23226.2681E − 1833Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F2 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0013.3520E − 23329.5917E − 1853Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F3 mean1.7978E − 4018.0141E − 3721.1384E − 3631.4129E − 3063.3911E − 3448.8138E − 315Std.5.7417E − 404.0605E − 364.5785E − 366.5852E − 301.5866E − 334.5372E − 30F4 mean1.7724E − 0351.6305E − 0331.3683E − 0321.2968E − 0311.7149E − 0342.0379E − 037Std.7.0959E − 048.2673E − 046.7566E − 046.9047E − 041.0814E − 035.9870E − 04F5 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0014.3163E − 013Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 002.3641E + 00F6 mean8.7634E − 1597.3423E − 1556.8686E − 1525.4475E − 1517.2239E − 1547.5791E − 156Std.3.0566E − 151.2973E − 159.0135E − 161.8027E − 151.4703E − 151.8027E − 15F7 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 001Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F8 mean2.0006E + 0192.1241E + 01102.1404E + 01112.1583E + 01121.9977E + 0181.5395E + 013Std.8.9636E − 017.0601E − 013.0286E − 015.8636E − 017.8322E − 011.3703E + 00F9 mean7.6067E − 02101.1415E − 01113.1100E − 0247.6015E − 0284.4920E − 0261.4528E − 0112Std.2.7508E − 012.6342E − 015.5459E − 021.5139E − 011.1119E − 013.0329E − 01F10 mean7.4015E − 1820.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 001Std.4.0540E − 170.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F11 mean4.3004E − 10715.4823E − 10722.3415E − 10636.4680E − 9944.0066E − 7555.3763E − 616Std.1.4184E − 1062.2547E − 1067.9515E − 1063.4630E − 981.6367E − 741.0385E − 60F12 mean3.0928E − 05102.−1463.8303E − 1637.7723E − 1714.9165E − 1641.2857E − 117Std.1.6940E − 041.1912E − 131.1343E − 154.2566E − 168.0839E − 167.0414E − 11F13 mean2.0321E − 0151.9654E − 0131.8321E − 0121.1987E − 0111.9987E − 0142.1987E − 017Std.3.1984E − 023.1984E − 023.7905E − 024.0684E − 022.6261E − 024.8423E − 02F14 mean2.4212E − 0182.4905E − 0191.4753E − 0151.0062E − 0121.6718E − 0161.1603E − 013Std.1.6847E − 011.9466E − 019.4435E − 023.3954E − 034.8375E − 021.1973E − 02F15 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0012.3950E − 23621.6645E − 1873Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F16 mean1.0914E − 1268.7918E − 1351.1141E − 1274.3201E − 1283.7138E − 1343.3348E − 133Std.8.9447E − 131.0146E − 121.5263E − 121.9162E − 111.9333E − 131.2991E − 13F17 mean5.1744E + 05113.4622E + 0594.0731E + 05108.0419E + 05121.5593E + 0588.4804E + 047Std.2.8828E + 051.3763E + 052.0986E + 054.5759E + 051.0031E + 056.3997E + 04F18 mean3.6167E + 02122.2199E + 01111.6293E + 01102.3579E − 0175.5248E + 0092.7280E + 008Std.3.4804E + 022.3441E + 012.0719E + 012.9995E − 015.3507E + 002.3433E + 00F19 mean8.8440E + 01128.1627E − 1231.7751E − 0946.2990E − 0686.0633E − 1313.6090E − 096Std.1.3947E + 021.9885E − 119.6843E − 093.1457E − 053.3022E − 131.2103E − 08F20 mean2.0909E + 0132.0923E + 0162.0899E + 0112.0908E + 0122.0921E + 0152.0926E + 017Std.6.2772E − 024.8322E − 026.6776E − 025.5540E − 026.9368E − 024.6310E − 02F21 mean2.3906E + 0192.5747E + 01112.4908E + 01102.8350E + 01122.1746E + 0182.0498E + 017Std.2.8843E + 003.0756E + 002.7934E + 002.9965E + 003.2228E + 002.6114E + 00F22 mean3.5454E − 01123.0340E − 01102.8817E − 0193.0853E − 01112.1249E − 0171.1537E − 015Std.3.2317E − 011.7580E − 011.1671E − 011.3304E − 011.1696E − 017.6889E − 02F23 mean3.7874E + 0363.3063E + 0333.6298E + 0353.3104E + 0343.0790E + 0313.2067E + 032Std.8.3395E + 027.4574E + 027.2296E + 025.8917E + 025.8848E + 027.3814E + 02F24 mean1.1745E + 01121.1274E + 0191.1216E + 0161.1705E + 01111.1167E + 0141.1165E + 013Std.4.9468E − 018.3977E − 016.8667E − 019.3060E − 018.5698E − 017.3902E − 01F25 mean3.2821E + 0383.0343E + 0373.0077E + 0353.0111E + 0362.7380E + 0322.7457E + 033Std.6.4796E + 025.2848E + 026.0257E + 025.0123E + 025.7139E + 024.6850E + 02F26 mean2.2106E + 03102.0075E + 0392.8073E + 03122.7058E + 03119.3688E + 0266.1365E + 021Std.9.2791E + 027.0836E + 022.5755E + 031.6280E + 032.7344E + 022.0362E + 02F27 mean4.3187E + 02112.3164E + 0293.4622E + 02101.5558E + 03128.4483E + 0187.9338E + 017Std.1.5688E + 032.8944E + 025.5363E + 021.9408E + 032.1385E + 013.7933E + 01F28 mean1.6340E + 02121.2592E + 02111.1945E + 02101.1183E + 0298.5297E + 0186.2142E + 017Std.6.7125E + 015.1143E + 015.2491E + 016.2047E + 014.1632E + 011.9968E + 01F29 mean6.3684E + 0295.5887E + 0265.2171E + 0247.3378E + 02124.1560E + 0214.5805E + 022Std.2.4983E + 022.7218E + 022.4827E + 027.5234E + 021.6027E + 021.5578E + 02F30 mean2.1929E + 0272.1535E + 0222.1836E + 0262.1757E + 0252.1221E + 0212.2536E + 0210Std.1.8484E + 011.6550E + 011.7093E + 011.5568E + 011.3611E + 016.1665E + 00Number of winners7571073F1 mean1.8634E − 14443.3710E − 13056.6891E − 10365.6670E − 9177.4384E − 8181.5166E − 749Std.7.8287E − 1447.3291E − 1302.6303E − 1021.9990E − 903.2S044E − 804.9493E − 74F2 mean1.0174E − 14641.2462E − 13158.2644E − 10566.7337E − 9375.3107E − 8382.3385E − 769Std.2.2306E − 1463.8761E − 1312.8562E − 1042.1117E − 921.3153E − 824.7131E − 76F3 mean8.6727E − 2772.6669E − 2481.0175E − 17108.7691E − 1891.0958E − 17111.4858E − 1612Std.2.4801E − 261.2058E − 233.0450E − 171.5707E − 172.2461E − 172.9935E − 16F4 mean1.9003E − 0362.7789E − 03113.6375E − 03122.7137E − 0392.0692E − 0382.4249E − 0310Std.7.0614E − 041.0254E − 031.2242E − 039.0594E − 046.1624E − 047.4433E − 04F5 mean0.0000E + 0013.0540E − 0122.5139E + 0079.1928E − 0166.5257E − 0155.0356E − 014Std.0.0000E + 001.6727E + 005.5399E + 002.9102E + 001.7325E + 001.5684E + 00F6 mean7.2239E − 1548.0528E − 1587.5791E − 1567.8160E − 1577.5791E − 1567.1054E − 153Std.1.4703E − 152.4567E − 151.8027E − 152.1681E − 151.8027E − 150.0000E + 00F7 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 001Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F8 mean1.5547E + 0141.3778E + 0111.7801E + 0171.6904E + 0161.5922E + 0151.4829E + 012Std.1.6655E + 008.3997E − 012.0629E + 001.3511E + 007.6778E − 017.3994E − 01F9 mean1.3823E − 0224.1464E − 0256.9108E − 0277.6016E − 0292.4189E − 0231.0367E − 021Std.3.5843E − 028.8627E − 029.1643E − 021.4893E − 015.2247E − 023.1632E − 02F10 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 001Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F11 mean5.6481E − 5071.4373E − 4484.9543E − 3391.1272E − 31103.6466E − 30113.4290E − 2812Std.1.8424E − 493.6834E − 441.2025E − 322.5961E − 314.7243E − 305.1504E − 28F12 mean1.1665E − 1623.1371E − 1084.4620E − 04123.9128E − 05119.3514E − 0891.7797E − 155Std.4.4445E − 161.7165E − 099.6886E − 042.0864E − 044.8628E − 071.6281E − 15F13 mean2.0987E − 0162.3987E − 0192.7321E − 01112.3989E − 01102.3321E − 0182.0987E − 016Std.3.0513E − 024.9827E − 025.8329E − 024.9812E − 024.7946E − 023.0513E − 02F14 mean1.3266E − 0141.7522E − 0173.5749E − 01104.2629E − 01116.7110E − 01121.0031E + 001Std.3.2946E − 025.7259E − 021.3949E − 012.4293E − 012.7434E − 013.1508E − 01F15 mean6.2031E − 14942.0046E − 13458.7140E − 10661.3911E − 9474.8466E − 8587.4000E − 799Std.1.4971E − 1484.4859E − 1343.1137E − 1054.1234E − 941.3312E − 841.3354E − 78F16 mean3.3348E − 1332.5769E − 1321.9115E − 08101.7205E − 1192.3495E − 1312.3495E − 131Std.1.2991E − 137.8614E − 142.0880E − 083.7190E − 114.1513E − 144.1513E − 14F17 mean2.5911E + 0462.0236E + 0451.5404E + 0444.2028E + 0331.3939E + 0323.9232E + 021Std.1.7876E + 042.0596E + 041.7468E + 041.0755E + 042.2990E + 035.2340E + 02F18 mean8.3293E − 0262.0654E − 0411.0079E − 0222.7159E − 0243.3594E − 0252.5218E − 023Std.1.5820E − 012.1159E − 043.6116E − 031.0117E − 021.0102E − 029.7995E − 03F19 mean1.0383E − 1221.9659E − 0672.1229E + 01116.9545E + 00101.2045E − 0593.3831E − 095Std.9.6454E − 136.9306E − 062.3423E + 011.1080E + 013.1678E − 055.1730E − 09F20 mean2.0921E + 0152.0915E + 0142.0944E + 01112.0932E + 01102.0931E + 0192.0930E + 018Std.4.9477E − 026.0050E − 023.8063E − 026.2609E − 026.4298E − 026.4638E − 02F21 mean1.8475E + 0151.7112E + 0141.9149E + 0161.7047E + 0121.6573E + 0111.7062E + 013Std.2.2045E + 003.1375E + 003.0854E + 002.2433E + 003.8705E + 004.7870E + 00F22 mean1.2080E − 0167.6487E − 0242.7264E − 0184.9529E − 0224.6303E − 0215.7641E − 023Std.6.9533E − 025.9331E − 025.0913E − 013.4914E − 022.4240E − 024.5834E − 02F23 mean3.8294E + 0374.0173E + 0384.7015E + 0395.0416E + 03105.2883E + 03115.5463E + 0312Std.7.4079E + 027.2649E + 029.3202E + 027.7981E + 024.3313E + 023.8622E + 02F24 mean1.1178E + 0151.1054E + 0111.1128E + 0121.1231E + 0171.1235E + 0181.1365E + 0110Std.6.6333E − 017.1771E − 016.6137E − 014.7694E − 015.4140E − 015.2287E − 01F25 mean2.6819E + 0312.8717E + 0343.4417E + 0393.3570E + 03103.6201E + 03114.4863E + 0312Std.6.5599E + 026.5461E + 028.6057E + 027.3188E + 028.4552E + 026.6389E + 02F26 mean6.3444E + 0226.7682E + 0237.9835E + 0249.1618E + 0259.8952E + 0279.9537E + 028Std.2.3050E + 021.6475E + 022.4100E + 021.9385E + 021.6113E + 021.8164E + 02F27 mean5.3847E + 0115.8104E + 0146.1993E + 0156.3941E + 0165.6147E + 0125.6436E + 013Std.1.6743E + 011.4715E + 011.1871E + 011.2469E + 011.0674E + 019.3082E + 00F28 mean4.1302E + 0154.3142E + 0163.7295E + 0123.8066E + 0133.8498E + 0143.5921E + 011Std.1.5566E + 011.6008E + 011.2944E + 016.7568E + 006.7459E + 007.0100E + 00F29 mean4.9136E + 0235.9505E + 0275.4938E + 0256.3168E + 0286.9930E + 02116.8864E + 0210Std.1.7069E + 021.2566E + 021.5177E + 021.3670E + 021.3562E + 029.5989E + 01F30 mean2.1627E + 0232.2452E + 0292.2704E + 02122.2677E + 02112.2398E + 0282.1671E + 024Std.1.3038E + 019.7575E + 001.0816E + 015.2881E + 007.4227E + 001.1142E + 01Number of winners552257Figure 6
Comparison of parameter setting.Table 14
Friedman test for EFLAs.
OrderAlgorithmAverages ranks1EFLA074.732EFLA055.023EFLA035.624EFLA065.905EFLA086.056EFLA026.287EFLA046.358EFLA126.839EFLA117.4010EFLA017.7211EFLA098.0512EFLA108.05Table 15
Statistical value of the Friedman test for EFLA.
MethodStatistical valuep valueFriedman test34.4933.00E − 4Figure 7
Comparison of parameter setting.


### 5.4. The Time Complexity of EFLA Algorithm

#### 5.4.1. Theoretical Analysis for the Time Complexity

In this paper, the time complexity of the proposed method depends on the number of fitness evaluation, number of iterations, population size, covariance matrix, and eigen decomposition. So, the overall time complexity can be presented as follows:(21)OEFLA=OQE+OAEE,where QE means the time complexity of quantum evolution (QE) operator and AEE means the time complexity of adaptive eigenvector evolution (AEE) operator. For the quantum evolutionary operator, the time complexity of the potential well is On, where n is the number of frogs in each submemeplex. Thus, the total time complexity of QE is as follows:(22)OQE=Om∗n∗n∗T∗D=Ops∗n∗T∗D,where ps is the population size, m is the number of submemeplexes, n is the number of frogs, ps=m∗n, T is the number of iteration, and D is the dimension. For the time complexity of the eigenvector evolutionary operator (EE), the covariance matrix contains D∗D elements, each of which requires ps cycles to be done. The eigen decomposition is solved by Jacobi’s method, of which the time complexity is OD3. In the proposed method, the adaptive evolutionary operator is completed. Thus, in extreme cases, if all the individuals in population achieve the eigenvector evolutionary operator, the overall time complexity of the eigenvector evolution is as follows:(23)OEE=OD2∗ps∗T+OD3∗T.In another case, if all the individuals in the population achieve the basic evolutionary operatorBE, the overall time complexity is as follows:(24)OBE=Ops∗T∗D.So,OBE≤OAEE≤OEE.Therefore, in the worst case, the overall time complexity of EFLA is as follows:(25)OEFLA=Ops∗n∗T∗D+OD2∗ps∗T+OD3∗T.In the best case, the overall time complexity of EFLA is as follows:(26)OEFLA=Ops∗n∗T∗D+Ops∗T∗D.


#### 5.4.2. Experimental Results and Analysis for the Running times

All the algorithms are run by Matlab R2016a using the Windows 7 operating system. Hardware configuration of the computer is as follows: four CPU, Intel (R) Core (TM) i5−4200 U, CPU 1.60 GHz, and RAM 4.00 GB. Five optimization problems (F26, F27, F28, F29, and F30) in Table1 are adopted. We select these five functions because they are hybrid functions or composition functions, which means that these problems are more complex and need more running times. Each algorithm is run 30 times for each optimization problem independently, and all the running times (minutes) are saved. All the parameter settings of the 13 algorithms are adopted as mentioned above. The experimental results are shown in Table 16. The character ‘R’ in the first line of Table 16 is the abbreviation of word ‘rank’; each column starting with ‘R’ after each algorithm denotes the rank of the 13 algorithms. The bold fonts denote the winner for the running times. In addition, the second column and the third column denote the rank and averages rank value by the Friedman test, where the p value = 3.14E − 4, and the statistical value = 36.0791. It can be observed that the rank of the 13 algorithms is GbABC (R_All = 1), LAPO (R_All = 2), AAA (R_All = 3), EFLA (R_All = 4), WQPSO (R_All = 5), SFLA (R_All = 6), SSA (TSQPSO) (R_All = 7), NNA (SCA) (R_All = 8), GWO (R_All = 9), CMAES (R_All = 10), and SaDE (R_All = 11). Although LAPO and GbABC obtain the better running time than other algorithms, they cannot obtain the better performance than many algorithms (it can be seen in Table 3). The classical algorithms such as SaDE and CMAES obtain the worst running times although they can obtain the better performance for some problems. EFLA obtains the best performance than the other 12 algorithm (it can be seen in Table 3) by an acceptable running time.Table 16
Comparison results for running times of 13 algorithms.
AlgorithmsR_AllFriedman test (averages ranks)F26RF27RF28RF29RF30RLAPO mean22.0018.85073221.11916210.19375115.70117226.024023Std.14.737498.332195.0469455.13832210.486TSQPSO mean78.0083.41357973.35816863.16787762.40167580.7066511Std.31.4929123.2344338.2281518.7934122.89638WQPSO mean57.2072.62881468.48122554.22318572.05188994.3936413Std.13.9561215.889424.88253816.0036530.18515GbABC mean11.2014.00864113.3273123.13617213.57485121.855131Std.1.9273541.4276458.6808840.4917322.723891NNA mean89.0079.35531870.78343765.0304885.669191369.787159Std.25.4997923.3843128.4195328.9678459.49232SaDE mean1110.8084.985721084.293691179.899361380.653291269.25138Std.19.3312516.1858131.6542914.6133523.55451SFLA mean67.80136.389112125.16091257.82334667.01151725.037482Std.40.3615620.9280413.4806542.317112.74917SSA mean78.0073.86124669.47877667.937341068.23441875.246110Std.8.4044636.3022244.5916375.1220814.807183CMAES mean109.40146.78981375.25055973.715991264.8051662.047436Std.154.63338.39721121.5818910.059674.808734SCA mean89.0072.91107574.073311067.25726978.534731082.0858912Std.8.7724886.2975134.3471058.0894367.584847AAA mean33.2042.31129341.42464352.36864338.31735348.021824Std.20.7865812.9545112.774878.2880769.548955GWO mean99.20115.075411146.36541353.906480.473291166.434777Std.30.330420.570775.8327884.62230216.92118EFLA mean46.2077.65418761.11634469.183291160.45171461.774475Std.49.9313717.7591913.7071614.070252.787357


### 5.5. Experiment on the Parameter Optimization of SVM

Support vector machine (SVM) is a statistical classification method based on the VC (Vapnik–Chervonenkis) statistical learning theory and the structural risk minimization principle proposed by Vapnik et al. [77], which has been applied widely to many fields. Given a set of training data samples as x1,y1,x2,y2,…,xl,yl∈x×yl, i=1,2,…,l, where xi∈x⊂Rn represents the input vector and yi=−1,+1 represents the number of class. The task of classification is to find the maximum margin separating hyper plane. It is an optimal problem, which can be represented as follows:(27)min12∑i,j=1lyiyjαiαjKxi⋅xj−∑j=1lαj,s.t.∑i=1lyiαi=0,0≤αi≤C,i=1,2,…,l,where K⋅,⋅ denotes the kernel function, Kxi,xj=exp−xi−xj2/2σ2 is the generally used kernel functions, and σ is a parameter. Experiments show that the parameters C,σ should be tuned before SVM is used. It can be seen as a black box optimization problem and can be solved by the metaheuristic algorithms.In this test, six benchmark data sets chosen from machine learning databases [78] are used for the LIBSVM tool provided by Chih-Jen Lin [79]. To achieve the parameter optimization, the searching space of C,σ is set as [1E−1, 1E3] for C and [1E−2, 1E3] for σ. The accuracy of prediction (%) of SVM by the 10-cross validation is used as the fitness value. For fair comparison, the parameter setting including the population size is set as Table 17 according to the related literature, and the max fitness evaluation is set as MAX_FES = 1000. Four methods including LSHADE [20], LSHADE-EpSin [65], TLBO [8], and LAPO [69] are selected for comparison. And the parameter settings of LSHADE and LSHADE-EpSin are used as literatures [20, 65]. Specifically, LSHADE obtains the winner in CEC 2014 and LSHADE-EpSin obtains the winner in CEC 2016. Each algorithm is run 20 times, and the median, mean, and std. are recorded for comparison.Table 17
Parameters setting.
NO.AlgorithmParameter setting1LAPOpop_size = 402TLBOpop_size = 203LSHADEp_best_rate = 0.11, arc_rate = 2.6, memory_size = 6, pop_size = 18∗ 2, min_pop_size = 4.04LSHADE−cnEpSinp_best_rate = 0.11, arc_rate = 1.4, memory_size = 5, pop_size = 18∗ 2, min_pop_size = 4.013EFLAm = 6, n = 5, pop_size = 30Table18 shows the details of the six data sets with different dimension. Table 19 shows the median and std. of the five algorithms for six data sets. We can see that EFLA obtains the best accuracy of prediction than LSHADE, LSHADE-cnEpSin, TLBO, and LAPO for PBCW data set (F4) in high dimension and heart data set (F6) in low dimension space. It indicates the better scalability of EFLA to solve the parameter optimization problems of SVM. EFLA obtains the same accuracy of LSHADE, LSHADE-cnEpSin, TLBO, and LAPO for F2, F3, and F5.Table 18
Details of six data sets.
No.Data setNumber of classDimensionNumber of samplesF1Glass610214F2Wine314178F3OBCW210699F4PBCW233198F5WDBC231569F6Heart213270Table 19
Comparison with EFLA and 4 algorithms (LAPO, TLBO, LSHADE, and LSHADE-cnEpSin) for SVM.
LAPO (%)TLBO (%)LSHADE (%)LSHADE−cnEpSin (%)EFLA (%)F1 median72.89774.76674.76674.76673.832Std.9.0204e − 0011.4980e − 0141.47771.9703e − 0016.3013F2 median98.87698.87698.87698.87698.876Std.2.9160e − 0141.4980e − 0141.49802.3687e − 0012.9160e − 014F3 median96.85396.85396.85396.85396.853Std.3.1990e − 0027.5400e − 00204.5240e − 0028.6524e − 002F4 median82.32382.32382.32382.32382.828Std.0.00e + 0000.00e + 0000.00e + 0000.00e + 0002.0727e − 001F5 median98.06798.06798.06798.06798.067Std.1.4580e − 0141.4980e − 0141.66735.5576e − 0027.2125e − 002F6 median69.259e + 00169.63068.88969.25970.000Std.3.0399e − 0013.1232e − 0013.1232e − 0015.1793e − 0011.6454e − 001In addition, we draw the convergence curve as Figure8 for the fair comparison including the search speed and the accuracy. In the early iteration, the proposed algorithm does not converge faster than the other algorithms. It means that it has stronger exploration ability and is not easy to trap into the local optimum. In the late iteration, the proposed algorithm jumps out the local optimum and finds the better solution. To sum up, we can see that EFLA has better performance than LSHADE, LSHADE-cnEpSin, TLBO, and LAPO.Figure 8
(a) Glass; (b) wine; (c) OBCW; (d) PBCW; (e) WDBC; (f) heart.
(a)(b)(c)(d)(e)(f)


## 5.1. Experimental Results and Analysis on the First Test Suite for Low Dimension (D = 30)

In this test, we compare the proposed algorithm with the 12 well-known algorithms for the 30 benchmark functions in low dimension (D = 30). Tables 3 and 4 show the comparison results with EFLA and 12 algorithms including two quantum simulation based-PSO versions (TSQPSO and WQPSO), seven SI algorithms (NNA, LAPO, SFLA, SSA, SCA, GWO, and AAA), an improved ABC algorithm (GbABC), and two evolutionary algorithms (SaDE and CMAES). The mean and standard deviation of the error values obtained by the 13 algorithms are listed in Tables 3 and 4, where the performance rank of the 13 algorithms is also represented. The character ‘R’ in the first line of Tables 3 and 4 is the abbreviation of word ‘rank’; each column starting with ‘R’ after each algorithm denotes the rank of the 13 algorithms. It can be observed that the proposed algorithm is a competitive SFLA variant for the first test suite. According to the theorem of ‘No Free Lunch’ [27], one algorithm cannot offer better performance than all the others on every aspect or on every kind of problem. This is also observed in our experimental results. In optimizing the 30 functions, EFLA is ranked the first for 10 times, the second for 7 times, the third for 5 times, and ranked the fourth and fifth for 2 and 1 times, respectively. Compared with the solution accuracy on seven unimodal functions (F1, F2, F3, F4, F16, F17, and F18), EFLA is ranked first 2 times, CMAES is ranked first 2 times, SaDE is ranked first 2 times, LAPO is ranked first 4 times, SaDE and EFLA are ranked first 2 times, and GWO is ranked first 1 time. It indicates that EFLA achieves the global optimum for sphere function (F1) and Schwefel’s problem 1.2 (F3). On many multimodal functions, EFLA represents the better exploration ability than others. Rastrigrin function (F5) and Griewank function (F7) have many local optima, and it can be seen that EFLA obtains the global optimum. Especially, it is observed that EFLA achieves better solution accuracy than the other 12 algorithms for the hybrid function 1 (N = 3) and hybrid function 2 (N = 3), which are complex multimodal and nonseparable problems. We can also observe that EFLA achieves the better solution accuracy than LAPO TSQPSO, WQPSO, GbABC, NNA, SaDE, SFLA, SSA, CMAES, SCA, AAA, and GWO for F1, F3, F5, F7, F10, F11, F23, F26, F27, and F29.Table 3
Comparison results of EFLA and other algorithms.
FuncLAPORTSQPSORWQPSORGbABCRNNARSaDEREFLARF1 mean2.0679E − 14842.6238E − 21134.8770E − 11362.9012E − 16122.7095E − 17119.1574E − 13151.9097E − 2321Std.4.2386E − 1480.0000E + 001.7583E − 1125.0880E − 174.6804E − 173.4926E − 1300.0000E + 00F2 mean3.7638E − 14947.8721E − 21134.2486E − 11462.7007E − 16121.6208E − 19111.0352E − 13153.3520E − 2332Std.1.8902E − 1480.0000E + 001.1122E − 1134.5535E − 172.6731E − 194.1658E − 1310.0000E + 00F3 mean3.6017E − 3324.1406E − 0384.2179E − 0191.7557E + 03131.6058E − 0965.2152E − 0773.3911E − 341Std.1.9395E − 327.0602E − 031.3847E + 001.1055E + 033.5930E − 091.1523E − 061.5866E − 33F4 mean4.7463E − 0513.7149E − 0441.1896E − 0352.2604E − 02122.6980E − 0432.5599E − 0381.7149E − 036Std.3.2024E − 051.6593E − 043.9106E − 045.1604E − 031.5368E − 041.0640E − 031.0814E − 03F5 mean0.0000E + 0011.0518E + 0291.5472E + 0150.0000E + 0014.0321E + 0170.0000E + 0010.0000E + 001Std.0.0000E + 002.9610E + 013.6786E + 000.0000E + 003.2685E + 010.0000E + 000.0000E + 00F6 mean1.0463E + 0194.5001E − 1515.6843E − 1522.9132E − 1458.2543E − 1066.2087E − 0277.2239E − 153Std.8.3330E − 011.5979E − 151.7702E − 152.3603E − 151.2301E − 092.3628E − 011.4703E − 15F7 mean1.8553E − 0353.6281E − 0439.8442E − 0380.0000E + 0011.9066E − 0364.5956E − 0370.0000E + 001Std.1.0162E − 021.9827E − 031.1601E − 020.0000E + 007.4693E − 038.9739E − 030.0000E + 00F8 mean2.8902E + 01112.5087E + 0172.4225E + 0162.6748E + 0022.5286E + 0182.3092E + 0151.9977E + 014Std.3.0136E − 021.6761E − 011.0980E + 011.2591E + 011.0413E + 019.8351E + 007.8322E − 01F9 mean5.8221E − 01109.4438E − 0651.5715E − 0632.5623E − 1627.3370E − 0643.4556E − 0364.4920E − 029Std.1.2562E − 017.7667E − 062.0857E − 073.1052E − 171.1419E − 051.8927E − 021.1119E − 01F10 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0011.4559E − 0724.8788E − 0330.0000E + 001Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 002.9588E − 072.1574E − 020.0000E + 00F11 mean7.0369E − 5726.0621E − 2463.1426E − 1581.5685E + 02133.3002E − 1671.4262E − 1294.0066E − 751Std.2.5996E − 562.4055E − 233.7257E − 154.1783E + 014.9773E − 162.7601E − 121.6367E − 74F12 mean3.4937E − 8123.8208E − 01116.7492E − 0398.5518E − 0873.5388E + 00132.0354E − 1744.9165E − 166Std.5.3073E − 812.0428E + 001.3164E − 024.6840E − 072.2808E + 001.1148E − 168.0839E − 16F13 mean9.9873E − 0211.6654E − 0152.0321E − 0176.5987E − 01121.5321E − 0142.5654E − 0181.9987E − 016Std.2.6587E − 094.7946E − 023.1984E − 021.3287E − 015.0742E − 026.2606E − 022.6261E − 02F14 mean2.2111E + 00112.9183E + 00121.2187E + 00101.0000E − 0141.4937E − 0161.1274E − 0151.6718E − 017Std.1.3244E + 007.6066E − 011.2750E + 001.8426E − 067.6006E − 025.4024E − 034.8375E − 02F15 mean6.1931E − 15141.7370E − 2142.4477E − 11655.1648E − 1791.3067E − 2084.9261E − 03112.3950E − 2362Std.1.9234E − 1500.0000E + 001.0387E − 1156.3433E − 183.9609E − 202.6982E − 020.0000E + 00F16 mean4.9333E + 04133.4645E + 0093.2837E − 0176.2149E − 1362.2862E + 0080.0000E + 0013.7138E − 134Std.3.4293E + 037.6157E + 004.6514E − 021.4545E − 134.0603E + 000.0000E + 001.9333E − 13F17 mean6.2032E + 08137.2635E + 0674.4582E + 0661.7429E + 0791.2600E + 0784.2644E + 0531.5593E + 052Std.2.4118E + 082.8245E + 062.2790E + 065.2228E + 064.3819E + 062.4265E + 051.0031E + 05F18 mean6.4263E + 04121.4323E + 0332.1750E + 0348.7421E + 04139.6899E + 0383.1923E + 0365.5248E + 002Std.3.1371E + 036.4265E + 029.1906E + 021.2549E + 043.9949E + 031.5177E + 035.3507E + 00F19 mean1.9648E + 04134.4660E + 01102.3662E − 0171.1823E − 1241.5171E + 0080.0000E + 0016.0633E − 133Std.6.7840E + 031.5296E + 012.6707E − 022.9945E − 132.9757E + 000.0000E + 003.3022E − 13F20 mean2.0942E + 0182.0945E + 0192.0936E + 0152.0957E + 01122.0952E + 01102.0930E + 0132.0921E + 012Std.6.6635E − 024.2900E − 024.8137E − 024.3188E − 024.7127E − 025.4512E − 026.9368E − 02F21 mean3.3880E + 01123.2223E + 01101.9235E + 0122.9199E + 0162.9536E + 0181.7362E + 0112.1746E + 013Std.1.1392E + 003.2294E + 003.9092E + 002.2216E + 002.9798E + 002.8439E + 003.2228E + 00F22 mean7.5833E + 03131.5974E + 0191.3157E + 0071.2354E + 0069.9663E + 0082.5310E − 0142.1249E − 013Std.1.4622E + 031.1760E + 012.1498E − 014.0112E − 018.0468E + 001.2585E − 011.1696E − 01F23 mean7.2429E + 03125.9708E + 0397.1367E + 03113.9898E + 0334.6973E + 0374.5802E + 0363.0790E + 031Std.3.3604E + 029.0511E + 023.6869E + 024.3627E + 027.2290E + 021.1312E + 035.8848E + 02F24 mean1.2784E + 0191.1985E + 0151.1978E + 0141.4554E + 01131.2935E + 01111.0801E + 0111.1167E + 012Std.3.8517E − 014.8984E − 014.4676E − 012.1412E − 017.5276E − 015.1674E − 018.5698E − 01F25 mean6.6897E + 03105.4734E + 0395.3861E + 03122.0737E + 0313.9468E + 0373.1024E + 0342.7380E + 033Std.3.2043E + 027.7868E + 021.2302E + 033.5805E + 026.6736E + 026.7238E + 025.7139E + 02F26 mean5.3508E + 07132.1023E + 0542.9649E + 0565.9358E + 06118.9966E + 0581.0982E + 0439.3688E + 021Std.3.4832E + 071.2160E + 051.8309E + 053.7139E + 067.6690E + 051.1758E + 042.7344E + 02F27 mean3.8211E + 09131.8409E + 0367.7833E + 0385.6953E + 04102.6359E + 0498.1686E + 0248.4483E + 011Std.1.5410E + 092.0800E + 037.8001E + 037.4420E + 044.8954E + 049.0611E + 022.1385E + 01F28 mean9.4589E + 04132.8808E + 0244.5894E + 0251.0856E + 04116.1975E + 0397.8279E + 0118.5297E + 012Std.3.6264E + 041.8178E + 021.8715E + 024.4541E + 034.2717E + 035.6083E + 014.1632E + 01F29 mean1.1208E + 07138.1877E + 0458.0641E + 0448.2012E + 05113.6377E +  0593.8309E + 0334.1560E + 021Std.9.9516E + 066.1105E + 047.9208E + 044.8406E + 052.8624E + 053.7988E + 031.6027E + 02F30 mean2.0000E + 0212.1146E + 0242.2985E + 02112.2947E + 02102.2436E + 0262.2694E + 0292.1221E + 025Std.2.0568E − 031.4433E + 016.0633E + 001.1562E + 001.4539E + 014.0580E + 001.3611E + 01Table 4
Comparison results of EFLA and other algorithms.
FuncSFLARSSARCMAESRSCARAAARGWOREFLARF1 mean1.4983E − 14131.8953E − 5281.8594E − 29103.0185E − 5297.7636E − 8173.9830E − 22921.9097E − 2321Std.6.8321E − 143.0968E − 532.1514E − 301.4485E − 511.1026E − 800.0000E + 000.0000E + 00F2 mean.4.1071E − 16131.8339E − 5481.9386E − 29108.0787E − 5291.0913E − 8377.7509E − 23413.3520E − 2332Std.2.1422E − 153.7522E − 552.1448E − 304.4249E − 511.8890E − 830.0000E + 000.0000E + 00F3 mean1.0252E + 01117.5471E − 1157.0456E − 2832.0687E + 01126.0855E + 00109.8559E − 2743.3911E − 341Std.4.6762E + 001.5092E − 109.4987E − 291.0603E + 024.4564E + 004.0907E − 261.5866E − 33F4 mean2.0006E − 0371.7915E − 02115.5304E − 02132.6205E − 0399.4294E − 03102.2596E − 0421.7149E − 036Std.5.2913E − 046.7959E − 031.5263E − 022.6535E − 032.2864E − 031.1757E − 041.0814E − 03F5 mean1.9710E + 0166.6961E + 0182.3242E + 02101.2529E + 0043.3165E − 0228.2594E − 0130.0000E + 001Std.7.1148E + 001.3697E + 014.9397E + 016.8622E + 001.8165E − 012.0051E + 000.0000E + 00F6 mean2.0516E − 0181.8791E + 00101.9416E + 01136.0329E + 00111.3145E − 1441.0121E + 01127.2239E − 153Std.3.8173E − 019.6749E − 012.0146E − 019.3730E + 002.1173E − 151.0294E + 011.4703E − 15F7 mean3.8681E − 02101.0916E − 0291.5606E − 0340.0000E + 0010.0000E + 0012.7034E − 0420.0000E + 001Std.2.9514E − 021.0414E − 023.7436E − 030.0000E + 000.0000E + 001.4807E − 030.0000E + 00F8 mean3.0799E + 01123.4417E + 01132.6577E − 0112.7378E + 01108.4609E + 0032.5979E + 0191.9977E + 014Std.1.3159E + 012.3269E + 011.0114E + 006.8511E − 011.4282E + 015.3992E − 017.8322E − 01F9 mean3.4562E − 0362.4483E + 00126.9113E − 0373.5419E − 01111.5705E − 3217.9047E − 0384.4920E − 029Std.1.8927E − 022.2790E + 002.6302E − 028.5982E − 025.5674E − 487.8180E − 031.1119E − 01F10 mean2.3550E + 0041.3917E + 0162.7419E + 0050.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 001Std.1.0955E + 003.3271E + 002.0527E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F11 mean4.0243E + 00123.1346E − 4542.9481E − 2752.5242E − 07101.3122E − 01112.7033E − 4534.0066E − 751Std.1.9618E + 001.7163E − 443.8367E − 285.3396E − 071.5176E − 018.5571E − 451.6367E − 74F12 mean1.8256E − 0482.7640E + 00129.1571E − 02108.8684E − 3533.7515E − 1654.0050E − 14214.9165E − 166Std.5.1853E − 041.3874E + 001.4377E − 014.8574E − 347.4335E − 162.1936E − 1418.0839E − 16F13 mean4.1654E − 01105.3321E − 01112.8746E + 01131.0987E − 0124.1331E − 0191.4987E − 0131.9987E − 016Std.5.9209E − 028.4418E − 029.6013E + 003.0513E − 026.8037E − 025.0855E − 022.6261E − 02F14 mean1.8365E − 0181.0000E − 0121.0000E − 0111.5591E + 0091.0000E − 0135.9277E + 00131.6718E − 017Std.2.2196E − 011.0506E − 167.0575E − 171.7118E + 001.0811E − 163.7705E − 014.8375E − 02F15 mean3.3461E − 04101.2266E + 00133.1035E − 01129.7236E − 5471.2226E − 8465.3910E − 23712.3950E − 2362Std.1.8095E − 034.0361E − 012.2413E − 015.3258E − 531.7662E − 840.0000E + 000.0000E + 00F16 mean1.9029E + 02104.0927E − 1353.0316E − 1421.1694E + 04122.6527E − 1336.5110E + 02113.7138E − 134Std.6.7655E + 011.3876E − 137.8614E − 141.5834E + 038.6186E − 144.5105E + 021.9333E − 13F17 mean1.8713E + 07103.5035E + 0652.2737E − 1411.3770E + 08123.3818E + 0641.9410E + 07111.5593E + 052Std.2.9155E + 061.7388E + 066.9378E − 144.3839E + 072.3501E + 068.8776E + 061.0031E + 05F18 mean1.0201E + 0494.1146E + 0374.5475E − 1413.5670E + 04103.7660E + 04113.1308E + 0355.5248E + 002Std.1.2569E + 032.1389E + 039.2504E − 145.3129E + 039.1768E + 031.6376E + 035.3507E +  + 00F19 mean8.5316E + 0193.2161E − 0362.4481E − 1252.4590E + 03122.6527E − 1323.6569E + 02116.0633E − 133Std.1.5073E + 012.9560E − 045.2136E − 128.6868E + 026.2149E − 142.0308E + 023.3022E − 13F20 mean2.0960E + 01132.0908E + 0112.0954E + 01112.0939E + 0162.0931E + 0142.0941E + 0172.0921E + 012Std.3.8597E − 027.3270E − 024.0485E − 025.7432E − 025.7590E − 025.4833E − 026.9368E − 02F21 mean3.2559E + 0172.6683E + 0154.5021E + 01133.9251E + 01112.4122E + 0143.3938E + 0192.1746E + 013Std.3.1236E + 003.0815E + 006.6350E + 001.3787E + 002.4257E + 008.0021E + 003.2228E + 00F22 mean6.6800E + 01101.0450E − 0121.6916E − 0211.5845E + 03122.3036E − 0152.0064E + 02112.1249E − 013Std.1.1481E + 014.5148E − 021.1343E − 023.5064E + 028.9844E − 021.0603E + 021.1696E − 01F23 mean4.0343E + 0344.2009E + 0355.0284E + 0387.4363E + 03133.6318E + 0327.0628E + 03103.0790E + 031Std.6.0325E + 026.7592E + 027.0278E + 022.3183E + 025.1933E + 026.7585E + 025.8848E + 02F24 mean1.2788E + 01101.2548E + 0181.2319E + 0161.4018E + 01121.2545E + 0171.1801E + 0131.1167E + 012Std.8.7092E − 011.2020E + 007.4841E − 013.1337E − 018.3427E − 015.8045E − 018.5698E − 01F25 mean3.4020E + 0353.8534E + 0365.0874E + 0386.9619E + 03112.0730E + 0325.8655E + 03132.7380E + 033Std.7.3450E + 025.9094E + 026.8133E + 023.2297E + 024.3520E + 021.6214E + 035.7139E + 02F26 mean1.3462E + 0692.9059E + 0551.5367E + 0325.9984E + 06127.7577E + 0571.5977E + 06109.3688E + 021Std.3.6288E + 052.1346E + 053.6940E + 022.5093E + 065.0958E + 051.0360E + 062.7344E + 02F27 mean5.0549E + 0235.4088E + 0371.3463E + 0221.4413E + 08121.4795E + 0352.5011E + 06118.4483E + 011Std.3.0414E + 025.9412E + 035.2506E + 018.8005E + 071.8325E + 036.0566E + 062.1385E + 01F28 mean5.3673E + 0381.4662E + 0373.0114E + 0231.4684E + 04127.2467E + 03109.0622E + 0268.5297E + 012Std.2.0421E + 031.3799E + 031.3330E + 025.6078E + 035.3916E + 031.4077E + 034.1632E + 01F29 mean2.6622E + 0581.0791E + 0561.0405E + 0321.4249E + 06121.5329E + 0574.9044E + 05104.1560E + 021Std.1.5496E + 058.1334E + 044.0995E + 024.6378E + 051.1548E + 054.5133E + 051.6027E + 02F30 mean2.2546E + 0282.4364E + 02132.3203E + 02122.0010E + 0232.2520E + 0272.0001E + 0222.1221E + 025Std.2.2867E + 005.6068E + 006.5750E + 009.8715E − 028.5013E − 013.8083E − 031.3611E + 01For the thorough analysis, the ‘robustness’ in this paper is used to evaluate the search stability of the algorithms under different condition (such as the rotated and unrotated test function). It means that the proposed algorithm can obtain better performance whether the optimization problem is in the rotated system or in the unrotated system. We know that the 30 optimization problems in this suite are combined by the two types. Type 1 (F1–F15) is the basic unrotated benchmark functions, and Type 2 (F16–F30) is the rotated, composition or hybrid problems. It is observed from Tables3 and 4 that WQPSO, CMAES, SaDE, and SSA can achieve the better solution accuracy for Type 2 but poor accuracy for Type 1. Contrary, LAPO, SCA, NNA, TSQPSO, GbABC, and GWO can achieve the better accuracy for Type 1 but poor accuracy for Type 2. In comparison with them, it is observed that EFLA achieves the better solution accuracy for more optimization problems including not only Type 1 but also Type 2, which means that it has the better robustness than others.TheT−test method is used to compare the difference between EFLA to the other 12 algorithms for the 30 optimization problems. In these experiments, a two-tailed test with significance level of 0.05 is adopted, and the p value and t-value are recorded and shown in Tables 5 and 6. The better results of EFLA than other algorithms are shown in bold. ‘−’ means that EFLA and the other algorithm obtain almost the same global optimum (it cannot be computed by t−test). The last lines in Table 5 and 6 denote the number of ‘B,’’ ‘N,’ and ‘W.’ ‘B’ means that EFLA is significantly better than the other algorithm, ‘N’ means that there is no significant difference between EFLA and the other algorithm, and ‘W’ means that the other algorithm is significantly better than EFLA. The average excellent rate between EFLA and the other 12 algorithms for the 30 functions is 71.11%, which can be computed as the following equation:(19)rate=∑i=112∑j=130Bi,j∑i=112∑j=130Bi,j+Ni,j+Wi,j.Table 5
T-test for comparison results with EFLA and other algorithms.
FuncLAPOTSQPSOWQPSOGbABCNNASaDEF1p value6.1172E − 030.0000E + 006.9769E − 023.5402E − 241.7874E − 038.0836E − 02t-value2.6722E + 006.5535E + 041.5192E + 003.1231E + 013.1708E + 001.4361E + 00F2p value1.4221E − 010.0000E + 002.2638E − 021.1654E − 241.2156E − 039.1988E − 02t-value1.0906E + 006.5535E + 042.0923E + 003.2486E + 013.3210E + 001.3611E + 00F3p value1.8380E − 011.6081E − 035.3001E − 027.0531E − 101.0328E − 029.6192E − 03t-value9.1528E − 013.2122E + 001.6684E + 008.6990E + 002.4479E + 002.4789E + 00F4p value1.0000E + 001.0000E + 009.9181E − 014.0816E − 201.0000E + 002.8020E − 03t-value−8.4184E + 00−6.7403E + 00−2.5485E + 002.2326E + 01−7.2306E + 002.9924E + 00F5p value—1.7304E − 181.7242E − 20—1.0224E − 07—t-value—1.9456E + 012.3036E + 01—6.7569E + 00—F6p value5.6081E − 341.0000E + 009.9988E − 011.4270E − 294.7918E − 048.0394E − 02t-value6.8771E + 01−8.3316E + 00−4.1763E + 004.8325E + 013.6754E + 001.4392E + 00F7p value1.6279E − 011.6225E − 013.3740E − 05—8.6346E − 024.4460E − 03t-value1.0000E + 001.0023E + 004.6476E + 00—1.3981E + 002.8049E + 00F8p value7.3722E − 331.0287E − 252.0964E − 021.0000E + 005.2738E − 034.4960E − 02t-value6.2889E + 013.5394E + 012.1284E + 00−7.4374E + 002.7342E + 001.7544E + 00F9p value4.1085E − 179.8251E − 019.8253E − 019.8253E − 019.8251E − 019.7187E − 01t-value1.7285E + 01−2.2123E + 00−2.2127E + 00−2.2127E + 00−2.2124E + 00−1.9886E + 00F10p value————5.7935E − 031.1271E − 01t-value————2.6950E + 001.2386E + 00F11p value7.4481E − 028.9015E − 023.6433E − 053.8744E − 195.3836E − 044.1812E − 03t-value1.4826E + 001.3803E + 004.6199E + 002.0561E + 013.6316E + 002.8301E + 00F12p value9.9882E − 011.5705E − 014.4113E − 031.6279E − 011.1539E − 099.9794E − 01t-value−3.3312E + 001.0244E + 002.8081E + 001.0000E + 008.4983E + 00−3.1153E + 00F13p value1.0000E + 009.9732E − 013.3119E − 011.5281E − 179.9983E − 014.1641E − 05t-value−2.0857E + 01−3.0104E + 004.4114E − 011.7940E + 01−4.0649E + 004.5717E + 00F14p value1.3970E − 091.1918E − 185.8521E − 051.0000E + 008.7069E − 011.0000E + 00t-value8.4209E + 001.9727E + 014.4485E + 00−7.6068E + 00−1.1523E + 00−6.1445E + 00F15p value4.4169E − 020.0000E + 001.0351E − 011.4225E − 284.0579E − 021.6279E − 01t-value1.7636E + 006.5535E + 041.2907E + 004.4596E + 011.8069E + 001.0000E + 00F16p value2.2146E − 351.8681E − 021.6670E − 269.4398E − 064.4541E − 032.0580E − 11t-value7.8793E + 012.4917E + 003.8667E + 015.3557E + 003.0840E + 00−1.0521E + 01F17p value1.6862E − 142.8856E − 142.9742E − 112.4646E − 171.4025E − 152.7998E − 05t-value1.4084E + 011.3789E + 011.0355E + 011.8085E + 011.5515E + 014.9645E + 00F18p value8.1734E − 406.2243E − 131.5126E − 132.4389E − 267.4395E − 142.6112E − 12t-value1.1216E + 021.2186E + 011.2907E + 013.8153E + 011.3279E + 011.1485E + 01F19p value7.8659E − 166.3716E − 162.5304E − 297.3198E − 099.1664E − 035.7997E − 11t-value1.5863E + 011.5992E + 014.8529E + 018.0358E + 002.7924E + 00−1.0057E + 01F20p value2.0538E − 011.0945E − 013.5879E − 011.5016E − 024.2555E − 025.8238E − 01t-value1.2955E + 001.6514E + 009.3247E − 012.5855E + 002.1214E + 005.5614E − 01F21p value8.3632E − 199.8736E − 131.4395E − 022.9524E − 122.6133E − 102.2364E − 05t-value2.0503E + 011.1958E + 01−2.6035E + 001.1426E + 019.4036E + 00−5.0453E + 00F22p value1.0184E − 224.1524E − 081.6168E − 202.1637E − 142.7111E − 072.3769E − 01t-value2.8405E + 017.3599E + 002.3678E + 011.3947E + 016.6517E + 001.2057E + 00F23p value7.7098E − 251.6951E − 152.7714E − 221.9645E − 071.3576E − 101.3455E − 06t-value3.3782E + 011.5402E + 012.7407E + 016.7718E + 009.6849E + 006.0616E + 00F24p value2.3504E − 111.6781E − 041.8959E − 051.0796E − 191.3665E − 096.1715E − 02t-value1.0461E + 014.3178E + 005.1047E + 002.2099E + 018.7120E + 00−1.9435E + 00F25p value3.0199E − 113.3384E − 111.4110E − 095.0912E − 062.0152E − 081.3272E − 02t-value6.6456E + 006.6308E + 006.0542E + 00−4.5610E + 005.6107E + 002.4764E + 00F26p value3.0199E − 113.0199E − 113.0199E − 113.0199E − 113.0199E − 113.0199E − 11t-value6.6456E + 006.6456E + 006.6456E + 006.6456E + 006.6456E + 006.6456E + 00F27p value3.0199E − 113.0199E − 113.0199E − 113.0199E − 113.0199E − 118.4848E − 09t-value6.6456E + 006.6456E + 006.6456E + 006.6456E + 006.6456E + 005.7585E + 00F28p value3.0199E − 111.3289E − 103.3384E − 113.0199E − 113.0199E − 111.4532E − 01t-value6.6456E + 006.4238E +  + 006.6308E + 006.6456E + 006.6456E + 00−1.4563E + 00F29p value3.0199E − 113.0199E − 113.0199E − 113.0199E − 113.0199E − 115.0922E − 08t-value6.6456E + 006.6456E + 006.6456E + 006.6456E + 006.6456E + 005.4481E + 00F30p value4.6159E − 101.6285E − 028.1975E − 078.4848E − 096.3560E − 057.2208E − 06t-value−6.2316E + 00−2.4025E + 004.9306E + 005.7585E + 003.9992E + 004.4871E + 00B/N/W19/10/117/12/121/9/023/6/125/5/017/13/0Table 6
T−test for comparison results with EFLA and other algorithms.
FuncSFLASSACMAESSCAAAAGWOF1p value1.1970E − 014.7988E − 252.5751E − 291.3152E − 012.9482E − 040.0000E + 00t-value1.2012E + 003.3521E + 014.7340E + 011.1414E + 003.8566E + 006.5535E + 04F2p value1.5116E − 012.6757E − 227.1377E − 301.6279E − 011.8179E − 031.0000E + 00t-value1.0501E + 002.6769E + 014.9508E + 011.0000E + 003.1642E + 006.5535E + 04F3p value4.4555E − 135.2131E − 032.0376E − 271.4702E − 011.5207E − 089.8639E − 02t-value1.2008E + 012.7391E + 004.0626E + 011.0686E + 007.4795E + 001.3196E + 00F4p value1.0803E − 013.7450E − 142.0769E − 184.5253E − 023.7838E − 161.0000E + 00t-value1.2646E + 001.3276E + 011.9325E + 011.7511E + 001.5887E + 01−7.7421E + 00F5p value1.2480E − 152.6583E − 227.7173E − 221.6279E − 011.6279E − 011.5887E − 02t-value1.5173E + 012.6776E + 012.5771E + 011.0000E + 001.0000E + 002.2562E + 00F6p value3.1631E − 037.9655E − 121.3084E − 597.1294E − 048.6649E − 144.3506E − 06t-value2.9436E + 001.0638E + 015.2787E + 023.5254E + 001.2836E + 015.3851E + 00F7p value3.3383E − 081.6255E − 061.4964E − 02−−1.6279E − 01t-value7.1786E + 005.7407E + 002.2833E + 00−−1.0000E + 00F8p value4.9354E − 051.0092E − 031.0000E + 001.3414E − 259.9993E − 017.5857E − 26t-value4.5102E + 003.3927E + 00−8.6414E + 013.5064E + 01−4.3746E + 003.5776E + 01F9p value9.7187E − 011.7840E − 069.5712E − 019.1216E − 139.8253E − 019.6146E − 01t-value−1.9886E + 005.7071E + 00−1.7788E + 001.1658E + 01−2.2127E + 00−1.8331E + 00F10p value7.1766E − 132.0033E − 202.3274E − 08——−t-value1.1774E + 012.2911E + 017.3162E + 00——−F11p value2.2041E − 121.6271E − 017.4411E − 287.4421E − 032.6435E − 054.7099E − 02t-value1.1235E + 011.0003E + 004.2086E + 012.5893E + 004.7356E + 001.7303E + 00F12p value3.1827E − 024.3936E − 127.8558E − 049.9882E − 017.4249E − 019.9882E − 01t-value1.9284E + 001.0912E + 013.4885E + 00−3.3312E + 00−6.5912E − 01−3.3312E + 00F13p value7.7454E − 191.0832E − 181.9836E − 161.0000E + 002.9930E − 169.9998E − 01t-value2.0043E + 011.9796E + 011.6283E + 01−1.6155E + 011.6030E + 01−4.7848E + 00F14p value3.4856E − 011.0000E + 001.0000E + 005.6018E − 051.0000E + 001.2412E − 36t-value3.9309E − 01−7.6068E + 00−7.6068E + 004.4644E + 00−7.6068E + 008.4996E + 01F15p value1.5976E − 011.1120E − 161.1595E − 081.6279E − 013.5115E − 041.0000E + 00t-value1.0128E + 001.6646E + 017.5843E + 001.0000E + 003.7916E + 006.5535E + 04F16 p value1.6843E − 153.9318E − 016.3185E − 114.6127E − 272.0380E − 021.0156E − 08t-value1.5406E + 018.6677E − 01−1.0019E + 014.0450E + 01−2.4538E + 007.9065E + 00F17p value3.3232E − 251.9599E − 112.2203E − 099.5786E − 172.9649E − 081.1868E − 12t-value3.4801E + 011.0543E + 01−8.5140E + 001.7185E + 017.4894E + 001.1867E + 01F18p value3.2445E − 282.0759E − 114.1154E − 066.9813E − 266.8464E − 202.4283E − 11t-value4.4391E + 011.0517E + 01−5.6554E + 003.6768E + 012.2469E + 011.0446E + 01F19p value8.7173E − 246.9426E − 326.1959E − 021.4268E − 153.5211E − 069.0159E − 11t-value3.1002E + 015.9593E + 011.9416E + 001.5504E + 01−5.7118E + 009.8630E + 00F20p value1.2367E − 024.6527E − 014.6523E − 023.1829E − 015.1373E − 012.3344E − 01t-value2.6677E + 00−7.3997E − 012.0795E + 001.0154E + 006.6115E − 011.2169E + 00F21p value4.7609E − 152.8266E − 077.4429E − 172.0334E − 212.2252E − 031.1693E − 07t-value1.4798E + 016.6362E + 001.7350E + 012.5517E + 013.3552E + 006.9665E + 00F22p value4.5203E − 241.7111E − 046.8284E − 104.7594E − 215.1359E − 013.0037E − 11t-value3.1732E + 01−4.3107E + 00−8.9989E + 002.4747E + 016.6138E − 011.0350E + 01F23p value1.5634E − 063.1673E − 077.1356E − 112.3312E − 252.8253E − 041.6599E − 19t-value6.0068E + 006.5939E + 009.9656E + 003.5238E + 014.1277E + 002.1755E + 01F24p value6.3207E − 071.4501E − 042.2210E − 061.3569E − 153.9789E − 074.9996E − 04t-value6.3385E + 004.3708E + 005.8790E + 001.5534E + 016.5093E + 003.9177E + 00F25p value6.9125E − 041.8500E − 088.1527E − 113.0199E − 111.5292E − 056.9125E − 04t-value3.3930E + 005.6255E + 006.4978E + 006.6456E + 00−4.3244E + 003.3930E + 00F26p value3.0199E − 113.0199E − 113.6459E − 083.0199E − 113.0199E − 113.0199E − 11t-value6.6456E + 006.6456E + 005.5072E + 006.6456E + 006.6456E + 006.6456E + 00F27p value3.0199E − 113.0199E − 114.3531E − 053.0199E − 116.7362E − 063.0199E − 11t-value6.6456E + 006.6456E + 004.0879E + 006.6456E + 004.5019E + 006.6456E + 00F28p value3.0199E − 113.0199E − 113.4742E − 103.0199E − 113.0199E − 113.0199E − 11t-value6.6456E + 006.6456E + 006.2760E + 006.6456E + 006.6456E + 006.6456E + 00F29p value3.0199E − 113.0199E − 116.1210E − 103.0199E − 113.0199E − 113.0199E − 11t-value6.6456E + 006.6456E + 006.1873E + 006.6456E + 006.6456E + 006.6456E + 00F30p value1.4067E − 046.0658E − 111.2541E − 075.2014E − 012.5974E − 058.8411E − 07t-value3.8070E + 006.5421E + 005.2854E + 00−6.4312E − 014.2062E + 00−4.9158E + 00B/N/W24/6/025/4/124/3/322/8/020/8219/11/0It means the average performance of EFLA is good although it is not always the best for all the functions with respect to the 12 algorithms.Table7 indicates more details of comparison results by Wilcoxon’s test. ‘+’ means that the EFLA is better than the other algorithms.‘ = ’ means that the EFLA obtains the equal results than the other algorithms. ‘−’ means that the EFLA is less than the other algorithms. The last three columns show the number of winner (w), equal (e), and lose (l) including the p values and the z-values. Table 7 shows that the average excellent rate between EFLA and the other 12 algorithms for the 30 functions is 80.55%, which can be computed as follows:(20)rate=∑i=112∑j=130wi,j∑i=112∑j=130wi,j+ei,j+li,j.Table 7
Wilcoxon signed-rank test for comparison results of EFLA and other algorithms.
FuncLAPOTSQPSOWQPSOGbABCNNASaDESFLASSACMAESSCAAAAGWOF1++++++++++++F2+++++++++++−F3++++++++++++F4−−−+−++++++−F5=++=+=++++++F6+−−+++++++++F7+++=+++++==+F8+++−++++−+−+F9+−−−−−−+−+−−F10====+++++===F11++++++++++++F12−++++−+++−−−F13−−++−++++−+−F14+++−−−+−−+−+F15+++++++++++−F16+++++−++−+−+F17++++++++−+++F18++++++++−+++F19+++++−++++−+F20+++++++−++++F21++−++−++++++F22+++++++−−+++F23++++++++++++F24+++++−++++++F25+++−++++++−+F26++++++++++++F27+++++−++++++F28++++++++++++F29++++++++++++F30−−+++++++−+−Totalw/e/l24/2/424/1/525/1/423/3/426/0/421/1/829/0/127/0/323/0/725/2/321/2/722/1/7p value1.07e − 0041.53e − 0037.14e − 0041.28e − 0032.83e − 0042.00e − 0025.73e − 0066.31e − 0052.95e − 0038.97e − 0051.39e − 0021.32e − 003z−value−3.8737−3.1678−3.3840−3.2195−3.6303−2.3245−4.5358−4.0006−2.9721−3.9167−2.4593−3.2110In addition, Friedman’s test is used. Table8 shows the average rank of 13 algorithms. We can see that the performance of EFLA is better than that of the other 12 algorithms with the minimal average rank value (3.12). Table 9 shows that the comparison of 13 algorithms has significant difference with p value = 9.43E − 11 (<0.05).Table 8
Friedman test for EFLA and other algorithms.
OrderAlgorithmAverages ranks1EFLA3.122SaDE5.123AAA5.504TSQPSO6.355WQPSO6.486GWO6.827CMAES7.008SSA7.779NNA7.9310GbABC7.9811LAPO8.3012SFLA9.2713SCA9.37Table 9
Statistical value of the Friedman test for EFLA and other algorithms.
MethodStatistical valueP valueFriedman test72.82909.43E−11To compare the convergence speed of 13 algorithms, the convergence curve is drawn in Figure4. We can see that the EFLA outperforms the 12 algorithms for the 6 different optimization problems including unrotated multimodal functions (F3, F7, and F11) and rotated multimodal functions (F23, F27, and F29). It is observed that the proposed algorithm converges faster than the others in overall iteration process for F7, F28, and F29. For rotated Schwefel’s function (F23), SSA converges faster than EFLA in the early iteration. However, in the late iteration, EFLA achieves the best solution than SSA. It means that SSA has the stronger exploitation ability but weak exploration ability. For EFLA, it completes the better balance between exploitation and exploration.Figure 4
Convergence curve: (a) F3 Schwefel’s problem 1.2; (b) F7 Griewank function; (c) F11 Zakharov function; (d) F15 inverted cosine mixture problem; (e) F21 rotated Schwefel’s function; (f) F25 hybrid function 2 (N = 3); (g) F26 hybrid function 4 (N = 4); (h) F27 hybrid function 5 (N = 5); (i) F28 hybrid function 6 (N = 5).
(a)(b)(c)(d)(e)(f)(g)(h)(i)


## 5.2. Scalability Analysis for the Second Test Suite for High Dimension (D-100)

We know that the performance of many heuristic optimization algorithms decreases drastically with the increase in the problem scale. In this experiment, we conduct scalability analysis for the 13 algorithms to test the performance of 100-D functions including two unrotated multimodal functions (F1 and F3) and four rotated multimodal functions (F20, F23, F28, and F29). Experimental settings are the same as those described in Table2. Table 10 reports the mean and standard deviation of the error values obtained by the 13 algorithms, where the best results are marked in bold. The character ‘R’ in the first line of Table 10 is the abbreviation of word ‘rank’; each column starting with ‘R’ after each algorithm denotes the rank of the 13 algorithms. The grey shading of each cell denotes that the performance of EFLA is better than that of the other algorithm. It can be observed that EFLA is ranked the first for 1 times, the second for 2 times, and the third for 3 times, respectively. There are at least four optimization problems that EFLA outperforms each one in the other 12 algorithms. For hybrid function 4 (N = 4) (F28), EFLA obtains the better accuracy than LAPO, TSQPSO, WQPSO, GbABC, NNA, SaDE, SFLA, SSA, CMAES, SCA, AAA, and GWO. For sphere function (F1), EFLA obtains the better accuracy than LAPO, TSQPSO, WQPSO, GbABC, NNA, SaDE, SFLA, SSA, CMAES, SCA, and AAA except for GWO.Table 10
Comparison results for 13 algorithms (D = 100).
AlgorithmsF1RF3RF20RF23RF28RF29RAAA mean1.1125E−7964.4886E + 03102.1242E + 0111.4474E + 0417.1266E + 04102.5430E + 066Std.2.5740E−791.4235E + 036.0063E − 021.2360E + 031.7915E + 049.6863E + 05EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E−022.4380E + 031.4322E + 027.2197E + 04GWO mean0.0000E + 0015.8937E−0342.1277E + 0142.9645E + 04101.0410E + 0471.1259E + 0710Std.0.0000E + 002.0000E−024.8661E−023.7559E + 036.0506E + 034.2230E + 06EFLA mean6.6252E−2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04CMAES mean1.3759E−2888.7795E − 2722.1278E + 0151.6447E + 0468.7535E + 0223.6520E + 031Std.6.7881E−306.1501E − 285.3762E−021.3676E + 031.6156E + 025.4436E + 02EFLA mean6.6252E − 2866.0290E−072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E−063.4012E − 022.4380E + 031.4322E + 027.2197E + 04LAPO mean0.0000E + 0012.8293E − 3212.1293E + 0183.0373E + 04117.6865E + 05133.7556E + 0813Std.0.0000E + 001.5481E − 312.7631E−026.1967E + 021.5186E + 057.3274E + 07EFLA mean6.6252E−2866.0290E−072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E−063.4012E − 022.4380E + 031.4322E + 027.2197E + 04SFLA mean1.4904E−13113.0880E + 0292.1303E + 01101.6551E + 0471.0833E + 0483.2197E + 067Std.8.0803E−135.9743E + 012.2014E−022.0443E + 031.4502E + 035.3386E + 05EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04NNA mean5.1299E−1793.6852E + 0052.1283E + 0161.9107E + 0481.2615E + 0497.7348E + 06Std.1.2987E−161.4683E + 013.6170E−021.5868E + 036.1335E + 032.5688E + 06EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 0511Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04GbABC mean1.5196E−15104.5842E + 04122.1308E + 01131.6237E + 0451.2516E + 05111.1578E + 07Std.1.2251E−167.5077E + 032.4901E−029.0027E + 022.8233E + 043.5576E + 06EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04SSA mean2.1980E−5172.3486E + 0282.1252E + 0121.4561E + 0421.7156E + 0359.2387E + 054Std.2.7362E−527.1058E + 014.5617E − 021.5796E + 033.5664E + 024.4898E + 05EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E−022.4380E + 031.4322E + 027.2197E + 04SCA mean1.6964E + 01127.6202E + 04132.1304E + 01113.0799E + 04131.3059E + 05127.6041E + 0712Std.9.2820E + 012.1699E + 042.6376E−024.6271E + 023.4908E + 042.1585E + 07EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04TSQPSO mean2.0134E−24432.3121E + 0272.1287E + 0172.8306E + 0491.1922E + 0333.2510E + 068Std.0.0000E + 009.2601E + 014.0094E−021.4779E + 033.7968E + 021.1347E + 06EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04WQPSO mean3.1583E−8851.1209E + 04112.1296E + 0193.0533E + 04121.3082E + 0343.6247E + 069Std.8.1474E−883.9403E + 033.6636E−024.3334E + 023.1719E + 021.4590E + 06EFLA mean6.6252E − 2866.0290E − 072.1253E + 011.4736E + 048.4302E + 021.5399E + 05Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04SaDE mean6.7961E−9444.7911E + 0062.1305E + 01121.4912E + 0446.7720E + 0362.9824E + 053Std.3.1491E−932.0130E + 002.8644E−022.0069E + 032.9429E + 031.0970E + 05EFLA mean6.6252E − 28626.0290E − 0732.1253E + 0131.4736E + 0438.4302E + 0211.5399E + 052Std.0.0000E + 001.4203E − 063.4012E − 022.4380E + 031.4322E + 027.2197E + 04Particularly, for the multimodal functions, the number of local optima increases drastically with the problem dimension, which makes some algorithms vulnerable to premature convergence. As shown in Table3, Table 4, and Table 10, EFLA is the robust algorithm that can maintain a good global search ability in such cases for rotated Schwefel’s function (F23) and hybrid function 4 (N = 5) (F29), whereas the performance of the other algorithms deteriorates severely. Figure 5 shows the convergence curve of 13 algorithms for the F28 and F29. We can see that EFLA converges faster than 12 algorithms for F23 except F29. Though EFLA converges slowly than some other algorithms such as LAPO and GbABC, for F23, it achieves the best or almost the same fitness value than the other algorithms in the last iteration.Figure 5
Convergence curve: (a) F23 rotated Schwefel’s function; (b) F28 hybrid function 4(n = 4).
(a)(b)In addition, Friedman’s test is used. Table11 shows the average rank of 13 algorithms. We can see that the performance of EFLA is better than that of the other 12 algorithms with the minimal average rank value (2.50). Table 12 shows that the comparison of 13 algorithms has significant difference with p value = 0.001 (< 0.05).Table 11
Friedman test for EFLA and other algorithms.
OrderAlgorithmAverages ranks1EFLA2.502CMAES4.173SSA4.834AAA5.675SaDE6.006GWO6.087TSQPSO6.178NNA7.839LAPO7.9210WQPSO8.3311SFLA8.6712GbABC10.5013SCA12.33Table 12
Statistical value of the Friedman test for EFLA and other algorithms.
MethodStatistical valuep valueFriedman test33.2730.001


## 5.3. Parameter Sensitivity Analysis

Three parameters in our proposed approach, namely,popsize, m, and n, should be tuned. m is the number of submemeplexes and n is the number of frogs in each submemeplex. It is obvious that population size (popsize) is equal to m∗n. There are 12 combinations for the three parameters (popsize, m, and n). The proposed algorithms with 12 different parameter settings are run 30 times for the 30 benchmark optimization problems in Table 13. The results are shown in Table 13 in terms of the mean and standard deviation of the error values fx−f∗ obtained in the 30 runs independently by EFLA with different parameter combinations, and the bold font denotes the winner. The character ‘R’ in the first line of Table 13 is the abbreviation of word ‘rank’; each column starting with ‘R’ after each EFLA algorithm means the rank of the different twelve parameter combinations. The last line of Table 13 shows the number of winners for the EFLA by different parameter combinations. In order to analyze the impact of population size (popsize) of EFLA, the twelve parameter combinations are arranged to six groups as popsize = 20 (EFLA01, EFLA02, EFLA03, and EFLA04), popsize = 30 (EFLA05), popsize = 40 (EFLA06), popsize = 50 (FELA07), popsize = 60 (EFLA08), and popsize = 100 (EFLA09, EFLA10, EFLA11, and EFLA12). Generally speaking, the performances of many metaheuristic algorithms are affected by the population size. The larger population size can enhance the diversity of population but can reduce the convergence speed. Therefore, the population size of EFLA like other algorithms should be tuned according to the different optimization problems. In Table 13, it can be observed that EFLAs (EFLA01, EFLA02, EFLA03, and EFLA04) by the minimal population size (popsize = 20) obtain the larger number of winners especially for the Type 1 (basic unrotated benchmark functions, F1–F15). Contrast to the Type 2 (F16–F30, the rotated, composition, and hybrid problems), EFLAs (from EFLA05 to EFLA12) corresponding to the population size (from popsize = 30 to popsize = 100) obtain the larger number of winners especially for the Type 2. It can be observed that EFLAs can obtain better performance for Type 1 and Type 2 problems when the population size is increased from 30 to 60. In addition, the other two parameter combinations (m, n) also affect the performance of EFLA by the same population size. According to equations (6) and (7), we know that the number of submemeplexes (m) is equal to the number of the best solution (Xbest), which influences the first potential well Pk. EFLA with smaller number of submemeplexes is easy to trap into the local optimum for the multimodal problems due to the small numbers (parameter m) of the best solution (Xbest). In contrast, the larger number of submemeplexes (m) can increase the diversity of the population but cannot ensure that it obtains better solution. Figure 6 shows the performance of EFLAs with different parameter combinations by Friedman’s test. It can be observed that EFLA obtains the poor performance by the smaller values of m (m = 2 for population size 20 or 100) whether the population size is larger or smaller. Table 14 shows the average rank results by the Friedman test. We can see that the best parameter combination of popsize, m, and n is (popsize = 50, m = 10, and n = 5). Table 15 shows the statistical value (p−value = 0.003); it indicates that the performance of EFLA with different four parameters has significant difference. In addition, we compare the performance of the 12 algorithms with that of the EFLA algorithms with the 12 different parameter combinations by Friedman’s test. The statistical value is equal to 200.829, and p value is equal to 2.40E−30. It means that there are significant differences among the 24 algorithms. Figure 7 shows the ranks among the 24 algorithms. It is worth mentioning that the EFLA outperforms all the 12 algorithms no matter which parameter combination is chosen.Table 13
Comparison results of EFLA with different parameters.
FuncEFLA01REFLA02REFLA03REFLA04REFLA05REFLA06R(m = 2, n = 10)(m = 4, n = 5)(m = 5, n = 4)(m = 10, n = 2)(m = 6, n = 5)(m = 5, n = 8F1 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0011.9097E − 23226.2681E − 1833Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F2 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0013.3520E − 23329.5917E − 1853Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F3 mean1.7978E − 4018.0141E − 3721.1384E − 3631.4129E − 3063.3911E − 3448.8138E − 315Std.5.7417E − 404.0605E − 364.5785E − 366.5852E − 301.5866E − 334.5372E − 30F4 mean1.7724E − 0351.6305E − 0331.3683E − 0321.2968E − 0311.7149E − 0342.0379E − 037Std.7.0959E − 048.2673E − 046.7566E − 046.9047E − 041.0814E − 035.9870E − 04F5 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0014.3163E − 013Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 002.3641E + 00F6 mean8.7634E − 1597.3423E − 1556.8686E − 1525.4475E − 1517.2239E − 1547.5791E − 156Std.3.0566E − 151.2973E − 159.0135E − 161.8027E − 151.4703E − 151.8027E − 15F7 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 001Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F8 mean2.0006E + 0192.1241E + 01102.1404E + 01112.1583E + 01121.9977E + 0181.5395E + 013Std.8.9636E − 017.0601E − 013.0286E − 015.8636E − 017.8322E − 011.3703E + 00F9 mean7.6067E − 02101.1415E − 01113.1100E − 0247.6015E − 0284.4920E − 0261.4528E − 0112Std.2.7508E − 012.6342E − 015.5459E − 021.5139E − 011.1119E − 013.0329E − 01F10 mean7.4015E − 1820.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 001Std.4.0540E − 170.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F11 mean4.3004E − 10715.4823E − 10722.3415E − 10636.4680E − 9944.0066E − 7555.3763E − 616Std.1.4184E − 1062.2547E − 1067.9515E − 1063.4630E − 981.6367E − 741.0385E − 60F12 mean3.0928E − 05102.−1463.8303E − 1637.7723E − 1714.9165E − 1641.2857E − 117Std.1.6940E − 041.1912E − 131.1343E − 154.2566E − 168.0839E − 167.0414E − 11F13 mean2.0321E − 0151.9654E − 0131.8321E − 0121.1987E − 0111.9987E − 0142.1987E − 017Std.3.1984E − 023.1984E − 023.7905E − 024.0684E − 022.6261E − 024.8423E − 02F14 mean2.4212E − 0182.4905E − 0191.4753E − 0151.0062E − 0121.6718E − 0161.1603E − 013Std.1.6847E − 011.9466E − 019.4435E − 023.3954E − 034.8375E − 021.1973E − 02F15 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0012.3950E − 23621.6645E − 1873Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F16 mean1.0914E − 1268.7918E − 1351.1141E − 1274.3201E − 1283.7138E − 1343.3348E − 133Std.8.9447E − 131.0146E − 121.5263E − 121.9162E − 111.9333E − 131.2991E − 13F17 mean5.1744E + 05113.4622E + 0594.0731E + 05108.0419E + 05121.5593E + 0588.4804E + 047Std.2.8828E + 051.3763E + 052.0986E + 054.5759E + 051.0031E + 056.3997E + 04F18 mean3.6167E + 02122.2199E + 01111.6293E + 01102.3579E − 0175.5248E + 0092.7280E + 008Std.3.4804E + 022.3441E + 012.0719E + 012.9995E − 015.3507E + 002.3433E + 00F19 mean8.8440E + 01128.1627E − 1231.7751E − 0946.2990E − 0686.0633E − 1313.6090E − 096Std.1.3947E + 021.9885E − 119.6843E − 093.1457E − 053.3022E − 131.2103E − 08F20 mean2.0909E + 0132.0923E + 0162.0899E + 0112.0908E + 0122.0921E + 0152.0926E + 017Std.6.2772E − 024.8322E − 026.6776E − 025.5540E − 026.9368E − 024.6310E − 02F21 mean2.3906E + 0192.5747E + 01112.4908E + 01102.8350E + 01122.1746E + 0182.0498E + 017Std.2.8843E + 003.0756E + 002.7934E + 002.9965E + 003.2228E + 002.6114E + 00F22 mean3.5454E − 01123.0340E − 01102.8817E − 0193.0853E − 01112.1249E − 0171.1537E − 015Std.3.2317E − 011.7580E − 011.1671E − 011.3304E − 011.1696E − 017.6889E − 02F23 mean3.7874E + 0363.3063E + 0333.6298E + 0353.3104E + 0343.0790E + 0313.2067E + 032Std.8.3395E + 027.4574E + 027.2296E + 025.8917E + 025.8848E + 027.3814E + 02F24 mean1.1745E + 01121.1274E + 0191.1216E + 0161.1705E + 01111.1167E + 0141.1165E + 013Std.4.9468E − 018.3977E − 016.8667E − 019.3060E − 018.5698E − 017.3902E − 01F25 mean3.2821E + 0383.0343E + 0373.0077E + 0353.0111E + 0362.7380E + 0322.7457E + 033Std.6.4796E + 025.2848E + 026.0257E + 025.0123E + 025.7139E + 024.6850E + 02F26 mean2.2106E + 03102.0075E + 0392.8073E + 03122.7058E + 03119.3688E + 0266.1365E + 021Std.9.2791E + 027.0836E + 022.5755E + 031.6280E + 032.7344E + 022.0362E + 02F27 mean4.3187E + 02112.3164E + 0293.4622E + 02101.5558E + 03128.4483E + 0187.9338E + 017Std.1.5688E + 032.8944E + 025.5363E + 021.9408E + 032.1385E + 013.7933E + 01F28 mean1.6340E + 02121.2592E + 02111.1945E + 02101.1183E + 0298.5297E + 0186.2142E + 017Std.6.7125E + 015.1143E + 015.2491E + 016.2047E + 014.1632E + 011.9968E + 01F29 mean6.3684E + 0295.5887E + 0265.2171E + 0247.3378E + 02124.1560E + 0214.5805E + 022Std.2.4983E + 022.7218E + 022.4827E + 027.5234E + 021.6027E + 021.5578E + 02F30 mean2.1929E + 0272.1535E + 0222.1836E + 0262.1757E + 0252.1221E + 0212.2536E + 0210Std.1.8484E + 011.6550E + 011.7093E + 011.5568E + 011.3611E + 016.1665E + 00Number of winners7571073F1 mean1.8634E − 14443.3710E − 13056.6891E − 10365.6670E − 9177.4384E − 8181.5166E − 749Std.7.8287E − 1447.3291E − 1302.6303E − 1021.9990E − 903.2S044E − 804.9493E − 74F2 mean1.0174E − 14641.2462E − 13158.2644E − 10566.7337E − 9375.3107E − 8382.3385E − 769Std.2.2306E − 1463.8761E − 1312.8562E − 1042.1117E − 921.3153E − 824.7131E − 76F3 mean8.6727E − 2772.6669E − 2481.0175E − 17108.7691E − 1891.0958E − 17111.4858E − 1612Std.2.4801E − 261.2058E − 233.0450E − 171.5707E − 172.2461E − 172.9935E − 16F4 mean1.9003E − 0362.7789E − 03113.6375E − 03122.7137E − 0392.0692E − 0382.4249E − 0310Std.7.0614E − 041.0254E − 031.2242E − 039.0594E − 046.1624E − 047.4433E − 04F5 mean0.0000E + 0013.0540E − 0122.5139E + 0079.1928E − 0166.5257E − 0155.0356E − 014Std.0.0000E + 001.6727E + 005.5399E + 002.9102E + 001.7325E + 001.5684E + 00F6 mean7.2239E − 1548.0528E − 1587.5791E − 1567.8160E − 1577.5791E − 1567.1054E − 153Std.1.4703E − 152.4567E − 151.8027E − 152.1681E − 151.8027E − 150.0000E + 00F7 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 001Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F8 mean1.5547E + 0141.3778E + 0111.7801E + 0171.6904E + 0161.5922E + 0151.4829E + 012Std.1.6655E + 008.3997E − 012.0629E + 001.3511E + 007.6778E − 017.3994E − 01F9 mean1.3823E − 0224.1464E − 0256.9108E − 0277.6016E − 0292.4189E − 0231.0367E − 021Std.3.5843E − 028.8627E − 029.1643E − 021.4893E − 015.2247E − 023.1632E − 02F10 mean0.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 0010.0000E + 001Std.0.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 000.0000E + 00F11 mean5.6481E − 5071.4373E − 4484.9543E − 3391.1272E − 31103.6466E − 30113.4290E − 2812Std.1.8424E − 493.6834E − 441.2025E − 322.5961E − 314.7243E − 305.1504E − 28F12 mean1.1665E − 1623.1371E − 1084.4620E − 04123.9128E − 05119.3514E − 0891.7797E − 155Std.4.4445E − 161.7165E − 099.6886E − 042.0864E − 044.8628E − 071.6281E − 15F13 mean2.0987E − 0162.3987E − 0192.7321E − 01112.3989E − 01102.3321E − 0182.0987E − 016Std.3.0513E − 024.9827E − 025.8329E − 024.9812E − 024.7946E − 023.0513E − 02F14 mean1.3266E − 0141.7522E − 0173.5749E − 01104.2629E − 01116.7110E − 01121.0031E + 001Std.3.2946E − 025.7259E − 021.3949E − 012.4293E − 012.7434E − 013.1508E − 01F15 mean6.2031E − 14942.0046E − 13458.7140E − 10661.3911E − 9474.8466E − 8587.4000E − 799Std.1.4971E − 1484.4859E − 1343.1137E − 1054.1234E − 941.3312E − 841.3354E − 78F16 mean3.3348E − 1332.5769E − 1321.9115E − 08101.7205E − 1192.3495E − 1312.3495E − 131Std.1.2991E − 137.8614E − 142.0880E − 083.7190E − 114.1513E − 144.1513E − 14F17 mean2.5911E + 0462.0236E + 0451.5404E + 0444.2028E + 0331.3939E + 0323.9232E + 021Std.1.7876E + 042.0596E + 041.7468E + 041.0755E + 042.2990E + 035.2340E + 02F18 mean8.3293E − 0262.0654E − 0411.0079E − 0222.7159E − 0243.3594E − 0252.5218E − 023Std.1.5820E − 012.1159E − 043.6116E − 031.0117E − 021.0102E − 029.7995E − 03F19 mean1.0383E − 1221.9659E − 0672.1229E + 01116.9545E + 00101.2045E − 0593.3831E − 095Std.9.6454E − 136.9306E − 062.3423E + 011.1080E + 013.1678E − 055.1730E − 09F20 mean2.0921E + 0152.0915E + 0142.0944E + 01112.0932E + 01102.0931E + 0192.0930E + 018Std.4.9477E − 026.0050E − 023.8063E − 026.2609E − 026.4298E − 026.4638E − 02F21 mean1.8475E + 0151.7112E + 0141.9149E + 0161.7047E + 0121.6573E + 0111.7062E + 013Std.2.2045E + 003.1375E + 003.0854E + 002.2433E + 003.8705E + 004.7870E + 00F22 mean1.2080E − 0167.6487E − 0242.7264E − 0184.9529E − 0224.6303E − 0215.7641E − 023Std.6.9533E − 025.9331E − 025.0913E − 013.4914E − 022.4240E − 024.5834E − 02F23 mean3.8294E + 0374.0173E + 0384.7015E + 0395.0416E + 03105.2883E + 03115.5463E + 0312Std.7.4079E + 027.2649E + 029.3202E + 027.7981E + 024.3313E + 023.8622E + 02F24 mean1.1178E + 0151.1054E + 0111.1128E + 0121.1231E + 0171.1235E + 0181.1365E + 0110Std.6.6333E − 017.1771E − 016.6137E − 014.7694E − 015.4140E − 015.2287E − 01F25 mean2.6819E + 0312.8717E + 0343.4417E + 0393.3570E + 03103.6201E + 03114.4863E + 0312Std.6.5599E + 026.5461E + 028.6057E + 027.3188E + 028.4552E + 026.6389E + 02F26 mean6.3444E + 0226.7682E + 0237.9835E + 0249.1618E + 0259.8952E + 0279.9537E + 028Std.2.3050E + 021.6475E + 022.4100E + 021.9385E + 021.6113E + 021.8164E + 02F27 mean5.3847E + 0115.8104E + 0146.1993E + 0156.3941E + 0165.6147E + 0125.6436E + 013Std.1.6743E + 011.4715E + 011.1871E + 011.2469E + 011.0674E + 019.3082E + 00F28 mean4.1302E + 0154.3142E + 0163.7295E + 0123.8066E + 0133.8498E + 0143.5921E + 011Std.1.5566E + 011.6008E + 011.2944E + 016.7568E + 006.7459E + 007.0100E + 00F29 mean4.9136E + 0235.9505E + 0275.4938E + 0256.3168E + 0286.9930E + 02116.8864E + 0210Std.1.7069E + 021.2566E + 021.5177E + 021.3670E + 021.3562E + 029.5989E + 01F30 mean2.1627E + 0232.2452E + 0292.2704E + 02122.2677E + 02112.2398E + 0282.1671E + 024Std.1.3038E + 019.7575E + 001.0816E + 015.2881E + 007.4227E + 001.1142E + 01Number of winners552257Figure 6
Comparison of parameter setting.Table 14
Friedman test for EFLAs.
OrderAlgorithmAverages ranks1EFLA074.732EFLA055.023EFLA035.624EFLA065.905EFLA086.056EFLA026.287EFLA046.358EFLA126.839EFLA117.4010EFLA017.7211EFLA098.0512EFLA108.05Table 15
Statistical value of the Friedman test for EFLA.
MethodStatistical valuep valueFriedman test34.4933.00E − 4Figure 7
Comparison of parameter setting.


## 5.4. The Time Complexity of EFLA Algorithm

### 5.4.1. Theoretical Analysis for the Time Complexity

In this paper, the time complexity of the proposed method depends on the number of fitness evaluation, number of iterations, population size, covariance matrix, and eigen decomposition. So, the overall time complexity can be presented as follows:(21)OEFLA=OQE+OAEE,where QE means the time complexity of quantum evolution (QE) operator and AEE means the time complexity of adaptive eigenvector evolution (AEE) operator. For the quantum evolutionary operator, the time complexity of the potential well is On, where n is the number of frogs in each submemeplex. Thus, the total time complexity of QE is as follows:(22)OQE=Om∗n∗n∗T∗D=Ops∗n∗T∗D,where ps is the population size, m is the number of submemeplexes, n is the number of frogs, ps=m∗n, T is the number of iteration, and D is the dimension. For the time complexity of the eigenvector evolutionary operator (EE), the covariance matrix contains D∗D elements, each of which requires ps cycles to be done. The eigen decomposition is solved by Jacobi’s method, of which the time complexity is OD3. In the proposed method, the adaptive evolutionary operator is completed. Thus, in extreme cases, if all the individuals in population achieve the eigenvector evolutionary operator, the overall time complexity of the eigenvector evolution is as follows:(23)OEE=OD2∗ps∗T+OD3∗T.In another case, if all the individuals in the population achieve the basic evolutionary operatorBE, the overall time complexity is as follows:(24)OBE=Ops∗T∗D.So,OBE≤OAEE≤OEE.Therefore, in the worst case, the overall time complexity of EFLA is as follows:(25)OEFLA=Ops∗n∗T∗D+OD2∗ps∗T+OD3∗T.In the best case, the overall time complexity of EFLA is as follows:(26)OEFLA=Ops∗n∗T∗D+Ops∗T∗D.


### 5.4.2. Experimental Results and Analysis for the Running times

All the algorithms are run by Matlab R2016a using the Windows 7 operating system. Hardware configuration of the computer is as follows: four CPU, Intel (R) Core (TM) i5−4200 U, CPU 1.60 GHz, and RAM 4.00 GB. Five optimization problems (F26, F27, F28, F29, and F30) in Table1 are adopted. We select these five functions because they are hybrid functions or composition functions, which means that these problems are more complex and need more running times. Each algorithm is run 30 times for each optimization problem independently, and all the running times (minutes) are saved. All the parameter settings of the 13 algorithms are adopted as mentioned above. The experimental results are shown in Table 16. The character ‘R’ in the first line of Table 16 is the abbreviation of word ‘rank’; each column starting with ‘R’ after each algorithm denotes the rank of the 13 algorithms. The bold fonts denote the winner for the running times. In addition, the second column and the third column denote the rank and averages rank value by the Friedman test, where the p value = 3.14E − 4, and the statistical value = 36.0791. It can be observed that the rank of the 13 algorithms is GbABC (R_All = 1), LAPO (R_All = 2), AAA (R_All = 3), EFLA (R_All = 4), WQPSO (R_All = 5), SFLA (R_All = 6), SSA (TSQPSO) (R_All = 7), NNA (SCA) (R_All = 8), GWO (R_All = 9), CMAES (R_All = 10), and SaDE (R_All = 11). Although LAPO and GbABC obtain the better running time than other algorithms, they cannot obtain the better performance than many algorithms (it can be seen in Table 3). The classical algorithms such as SaDE and CMAES obtain the worst running times although they can obtain the better performance for some problems. EFLA obtains the best performance than the other 12 algorithm (it can be seen in Table 3) by an acceptable running time.Table 16
Comparison results for running times of 13 algorithms.
AlgorithmsR_AllFriedman test (averages ranks)F26RF27RF28RF29RF30RLAPO mean22.0018.85073221.11916210.19375115.70117226.024023Std.14.737498.332195.0469455.13832210.486TSQPSO mean78.0083.41357973.35816863.16787762.40167580.7066511Std.31.4929123.2344338.2281518.7934122.89638WQPSO mean57.2072.62881468.48122554.22318572.05188994.3936413Std.13.9561215.889424.88253816.0036530.18515GbABC mean11.2014.00864113.3273123.13617213.57485121.855131Std.1.9273541.4276458.6808840.4917322.723891NNA mean89.0079.35531870.78343765.0304885.669191369.787159Std.25.4997923.3843128.4195328.9678459.49232SaDE mean1110.8084.985721084.293691179.899361380.653291269.25138Std.19.3312516.1858131.6542914.6133523.55451SFLA mean67.80136.389112125.16091257.82334667.01151725.037482Std.40.3615620.9280413.4806542.317112.74917SSA mean78.0073.86124669.47877667.937341068.23441875.246110Std.8.4044636.3022244.5916375.1220814.807183CMAES mean109.40146.78981375.25055973.715991264.8051662.047436Std.154.63338.39721121.5818910.059674.808734SCA mean89.0072.91107574.073311067.25726978.534731082.0858912Std.8.7724886.2975134.3471058.0894367.584847AAA mean33.2042.31129341.42464352.36864338.31735348.021824Std.20.7865812.9545112.774878.2880769.548955GWO mean99.20115.075411146.36541353.906480.473291166.434777Std.30.330420.570775.8327884.62230216.92118EFLA mean46.2077.65418761.11634469.183291160.45171461.774475Std.49.9313717.7591913.7071614.070252.787357


## 5.4.1. Theoretical Analysis for the Time Complexity

In this paper, the time complexity of the proposed method depends on the number of fitness evaluation, number of iterations, population size, covariance matrix, and eigen decomposition. So, the overall time complexity can be presented as follows:(21)OEFLA=OQE+OAEE,where QE means the time complexity of quantum evolution (QE) operator and AEE means the time complexity of adaptive eigenvector evolution (AEE) operator. For the quantum evolutionary operator, the time complexity of the potential well is On, where n is the number of frogs in each submemeplex. Thus, the total time complexity of QE is as follows:(22)OQE=Om∗n∗n∗T∗D=Ops∗n∗T∗D,where ps is the population size, m is the number of submemeplexes, n is the number of frogs, ps=m∗n, T is the number of iteration, and D is the dimension. For the time complexity of the eigenvector evolutionary operator (EE), the covariance matrix contains D∗D elements, each of which requires ps cycles to be done. The eigen decomposition is solved by Jacobi’s method, of which the time complexity is OD3. In the proposed method, the adaptive evolutionary operator is completed. Thus, in extreme cases, if all the individuals in population achieve the eigenvector evolutionary operator, the overall time complexity of the eigenvector evolution is as follows:(23)OEE=OD2∗ps∗T+OD3∗T.In another case, if all the individuals in the population achieve the basic evolutionary operatorBE, the overall time complexity is as follows:(24)OBE=Ops∗T∗D.So,OBE≤OAEE≤OEE.Therefore, in the worst case, the overall time complexity of EFLA is as follows:(25)OEFLA=Ops∗n∗T∗D+OD2∗ps∗T+OD3∗T.In the best case, the overall time complexity of EFLA is as follows:(26)OEFLA=Ops∗n∗T∗D+Ops∗T∗D.


## 5.4.2. Experimental Results and Analysis for the Running times

All the algorithms are run by Matlab R2016a using the Windows 7 operating system. Hardware configuration of the computer is as follows: four CPU, Intel (R) Core (TM) i5−4200 U, CPU 1.60 GHz, and RAM 4.00 GB. Five optimization problems (F26, F27, F28, F29, and F30) in Table1 are adopted. We select these five functions because they are hybrid functions or composition functions, which means that these problems are more complex and need more running times. Each algorithm is run 30 times for each optimization problem independently, and all the running times (minutes) are saved. All the parameter settings of the 13 algorithms are adopted as mentioned above. The experimental results are shown in Table 16. The character ‘R’ in the first line of Table 16 is the abbreviation of word ‘rank’; each column starting with ‘R’ after each algorithm denotes the rank of the 13 algorithms. The bold fonts denote the winner for the running times. In addition, the second column and the third column denote the rank and averages rank value by the Friedman test, where the p value = 3.14E − 4, and the statistical value = 36.0791. It can be observed that the rank of the 13 algorithms is GbABC (R_All = 1), LAPO (R_All = 2), AAA (R_All = 3), EFLA (R_All = 4), WQPSO (R_All = 5), SFLA (R_All = 6), SSA (TSQPSO) (R_All = 7), NNA (SCA) (R_All = 8), GWO (R_All = 9), CMAES (R_All = 10), and SaDE (R_All = 11). Although LAPO and GbABC obtain the better running time than other algorithms, they cannot obtain the better performance than many algorithms (it can be seen in Table 3). The classical algorithms such as SaDE and CMAES obtain the worst running times although they can obtain the better performance for some problems. EFLA obtains the best performance than the other 12 algorithm (it can be seen in Table 3) by an acceptable running time.Table 16
Comparison results for running times of 13 algorithms.
AlgorithmsR_AllFriedman test (averages ranks)F26RF27RF28RF29RF30RLAPO mean22.0018.85073221.11916210.19375115.70117226.024023Std.14.737498.332195.0469455.13832210.486TSQPSO mean78.0083.41357973.35816863.16787762.40167580.7066511Std.31.4929123.2344338.2281518.7934122.89638WQPSO mean57.2072.62881468.48122554.22318572.05188994.3936413Std.13.9561215.889424.88253816.0036530.18515GbABC mean11.2014.00864113.3273123.13617213.57485121.855131Std.1.9273541.4276458.6808840.4917322.723891NNA mean89.0079.35531870.78343765.0304885.669191369.787159Std.25.4997923.3843128.4195328.9678459.49232SaDE mean1110.8084.985721084.293691179.899361380.653291269.25138Std.19.3312516.1858131.6542914.6133523.55451SFLA mean67.80136.389112125.16091257.82334667.01151725.037482Std.40.3615620.9280413.4806542.317112.74917SSA mean78.0073.86124669.47877667.937341068.23441875.246110Std.8.4044636.3022244.5916375.1220814.807183CMAES mean109.40146.78981375.25055973.715991264.8051662.047436Std.154.63338.39721121.5818910.059674.808734SCA mean89.0072.91107574.073311067.25726978.534731082.0858912Std.8.7724886.2975134.3471058.0894367.584847AAA mean33.2042.31129341.42464352.36864338.31735348.021824Std.20.7865812.9545112.774878.2880769.548955GWO mean99.20115.075411146.36541353.906480.473291166.434777Std.30.330420.570775.8327884.62230216.92118EFLA mean46.2077.65418761.11634469.183291160.45171461.774475Std.49.9313717.7591913.7071614.070252.787357


## 5.5. Experiment on the Parameter Optimization of SVM

Support vector machine (SVM) is a statistical classification method based on the VC (Vapnik–Chervonenkis) statistical learning theory and the structural risk minimization principle proposed by Vapnik et al. [77], which has been applied widely to many fields. Given a set of training data samples as x1,y1,x2,y2,…,xl,yl∈x×yl, i=1,2,…,l, where xi∈x⊂Rn represents the input vector and yi=−1,+1 represents the number of class. The task of classification is to find the maximum margin separating hyper plane. It is an optimal problem, which can be represented as follows:(27)min12∑i,j=1lyiyjαiαjKxi⋅xj−∑j=1lαj,s.t.∑i=1lyiαi=0,0≤αi≤C,i=1,2,…,l,where K⋅,⋅ denotes the kernel function, Kxi,xj=exp−xi−xj2/2σ2 is the generally used kernel functions, and σ is a parameter. Experiments show that the parameters C,σ should be tuned before SVM is used. It can be seen as a black box optimization problem and can be solved by the metaheuristic algorithms.In this test, six benchmark data sets chosen from machine learning databases [78] are used for the LIBSVM tool provided by Chih-Jen Lin [79]. To achieve the parameter optimization, the searching space of C,σ is set as [1E−1, 1E3] for C and [1E−2, 1E3] for σ. The accuracy of prediction (%) of SVM by the 10-cross validation is used as the fitness value. For fair comparison, the parameter setting including the population size is set as Table 17 according to the related literature, and the max fitness evaluation is set as MAX_FES = 1000. Four methods including LSHADE [20], LSHADE-EpSin [65], TLBO [8], and LAPO [69] are selected for comparison. And the parameter settings of LSHADE and LSHADE-EpSin are used as literatures [20, 65]. Specifically, LSHADE obtains the winner in CEC 2014 and LSHADE-EpSin obtains the winner in CEC 2016. Each algorithm is run 20 times, and the median, mean, and std. are recorded for comparison.Table 17
Parameters setting.
NO.AlgorithmParameter setting1LAPOpop_size = 402TLBOpop_size = 203LSHADEp_best_rate = 0.11, arc_rate = 2.6, memory_size = 6, pop_size = 18∗ 2, min_pop_size = 4.04LSHADE−cnEpSinp_best_rate = 0.11, arc_rate = 1.4, memory_size = 5, pop_size = 18∗ 2, min_pop_size = 4.013EFLAm = 6, n = 5, pop_size = 30Table18 shows the details of the six data sets with different dimension. Table 19 shows the median and std. of the five algorithms for six data sets. We can see that EFLA obtains the best accuracy of prediction than LSHADE, LSHADE-cnEpSin, TLBO, and LAPO for PBCW data set (F4) in high dimension and heart data set (F6) in low dimension space. It indicates the better scalability of EFLA to solve the parameter optimization problems of SVM. EFLA obtains the same accuracy of LSHADE, LSHADE-cnEpSin, TLBO, and LAPO for F2, F3, and F5.Table 18
Details of six data sets.
No.Data setNumber of classDimensionNumber of samplesF1Glass610214F2Wine314178F3OBCW210699F4PBCW233198F5WDBC231569F6Heart213270Table 19
Comparison with EFLA and 4 algorithms (LAPO, TLBO, LSHADE, and LSHADE-cnEpSin) for SVM.
LAPO (%)TLBO (%)LSHADE (%)LSHADE−cnEpSin (%)EFLA (%)F1 median72.89774.76674.76674.76673.832Std.9.0204e − 0011.4980e − 0141.47771.9703e − 0016.3013F2 median98.87698.87698.87698.87698.876Std.2.9160e − 0141.4980e − 0141.49802.3687e − 0012.9160e − 014F3 median96.85396.85396.85396.85396.853Std.3.1990e − 0027.5400e − 00204.5240e − 0028.6524e − 002F4 median82.32382.32382.32382.32382.828Std.0.00e + 0000.00e + 0000.00e + 0000.00e + 0002.0727e − 001F5 median98.06798.06798.06798.06798.067Std.1.4580e − 0141.4980e − 0141.66735.5576e − 0027.2125e − 002F6 median69.259e + 00169.63068.88969.25970.000Std.3.0399e − 0013.1232e − 0013.1232e − 0015.1793e − 0011.6454e − 001In addition, we draw the convergence curve as Figure8 for the fair comparison including the search speed and the accuracy. In the early iteration, the proposed algorithm does not converge faster than the other algorithms. It means that it has stronger exploration ability and is not easy to trap into the local optimum. In the late iteration, the proposed algorithm jumps out the local optimum and finds the better solution. To sum up, we can see that EFLA has better performance than LSHADE, LSHADE-cnEpSin, TLBO, and LAPO.Figure 8
(a) Glass; (b) wine; (c) OBCW; (d) PBCW; (e) WDBC; (f) heart.
(a)(b)(c)(d)(e)(f)


## 6. Conclusions

In this paper, we propose an improved SFLA algorithm (called EFLA) by the quantum evolutionary operator and the adaptive eigenvector evolutionary operator. The quantum evolutionary operator is used as the local search step instead of the traditional guidance mechanism, and the adaptive eigenvector evolutionary operator is used as the global search step instead of only using the shuffled operator. In addition, the basic search rule and the eigenvector search rule are chosen alternately to solve more different optimization problems in the coordinate system or in the rotated coordinate system. The adaptive eigenvector evolutionary operator enhances the search ability to solve the optimization problems in the rotated coordinate system.Then, we compare the proposed approach with the 15 well−known algorithms by the best parameter setting including NNA, SSA, SCA, SFLA, LAPO, CMAES, GWO, GbABC, WQPSO, TSQPSO, SaDE, AAA, TLBO, LSHADE, and LSHADE−cnEpSin for the 30 benchmark problems and real−world parameter optimization problems of SVM. TheT-test, Wilcoxon signed-rank test, and Friedman’s test are used to verify the performance of EFLA. In addition, we analyze the influence of the three major parameters of EFLA: popsize, m, and n. In general, we recommend that the three parameters (popsize, m, and n) can be set as [5, 6, 30] or [5, 10, 50] according to the experimental results and analysis. Finally, we analyze the time complexity of the EFLA algorithm and compare the running time of it with that of the 12 other algorithms. We obtain the accepted running time of EFLA with the best performance than the others (rank = 4).In future, the proposed algorithm can be considered to solve more real-world continuous optimization problems in different fields. Such as, it may be used for an experimental evolutionary model in the domain of magnetorheological fluids [80]. Second, the quantum evolutionary operator can be used to improve the performance of the other heuristic algorithms. Third, the proposed eigenvector evolution method can be extended to solve other problems.



---

*Source: 8928182-2021-12-14.xml*