# A Quantum Particle Swarm Optimization Algorithm with Teamwork Evolutionary Strategy

Authors: Guoqiang Liu; Weiyi Chen; Huadong Chen; Jiahui Xie
Journal: Mathematical Problems in Engineering
 (2019)

---

## Abstract

The quantum particle swarm optimization algorithm is a global convergence guarantee algorithm. Its searching performance is better than the original particle swarm optimization algorithm (PSO), but the control parameters are less and easy to fall into local optimum. The paper proposed teamwork evolutionary strategy for balance global search and local search. This algorithm is based on a novel learning strategy consisting of cross-sequential quadratic programming and Gaussian chaotic mutation operators. The former performs the local search on the sample and the interlaced operation on the parent individual while the descendants of the latter generated by Gaussian chaotic mutation may produce new regions in the search space. Experiments performed on multimodal test and composite functions with or without coordinate rotation demonstrated that the population information could be utilized by the TEQPSO algorithm more effectively compared with the eight QSOs and PSOs variants. This improves the algorithm performance, significantly.


---

## Body

## 1. Introduction

With the development of real-life engineering technology, the related optimization problems are more and more complicated. Experience shows that using traditional methods to solve these complex problems is inefficient. In order to cope with this limitation, a variety of artificial intelligence algorithms, such as particle swarm optimization- (PSO-) based memetic algorithm (MA) [1], simulated annealing algorithm (SABA) [2], ant colony optimization (MSCRSP–ACO) [3], bat algorithm (BA) [4], firefly algorithm [5], biogeography-based optimization (BBO) [6], the cuckoo search algorithm [7, 8], charged system search (CSS) [9], gravitational search algorithm [10], grey wolf optimizer (GWO) [11], ant colony optimization (ACO) algorithm [12], and new adaptive ant algorithm [13], have been proposed and applied to solve optimization problems. The particle swarm optimization (PSO) method is a broader class of swarm intelligence methods for solving GO problems. The method was originally proposed by Kennedy to simulate the social behaviour of flocks and was first introduced as an optimization method in 1995. Unlike other evolutionary algorithms that use evolutionary operators to manipulate individuals, PSO relies on the exchange of information between individuals. Each particle in the particle swarm algorithm flies in the searching space at a certain speed, and speed is dynamically adjusted according to the information of the particle itself.Since 1995, many have been made to improve the performance of PSO by experts and scholars [14, 15]. However, Van den Bergh [16] proved that PSO is not a global optimization algorithm. Sun et al. [17] combined the quantum theory with the particle swarm optimization (PSO) algorithm to establish a quantum behavior particle swarm optimization algorithm (QPSO). This algorithm ensures finding the global optimal solution in the search space. Experimental results performed on various benchmark functions demonstrate that the proposed algorithm could improve the standard PSO algorithm. The global convergence of QPSO guarantees that the global optimal solution is calculated in the case of infinite searching iterations. However, in practical problems, this condition is unrealistic because any optimization algorithm allows only a limited number of iterations to search for the optimal solution. When solving complex problems, QPSO is also prone to fall into local optimum or slow convergence. Experts and scholars have developed various strategies to improve the convergence speed and global optimal performance of QPSO. Liu et al. [18] introduced simulated annealing into the QPSO algorithm; Chen et al. [19] presented an improved GSO optimizer with quantum-behaved operator for scroungers; Li et al. [20] presented cooperative quantum-behaved particle swarm optimization (CQPSO); Li et al. [21] proposed a dynamic-context cooperative quantum-behaved particle swarm optimization algorithm; H Long et al. [22, 23] proposed a new algorithm PDCQPSO and diversity maintained into QPSO; Leandro dos Santos Coelho [24, 25] presented a novel quantum-behaved PSO (QPSO) using chaotic mutation operator, mutation operator with Gaussian probability distribution; Qin et al. [26] presented a hybrid improved QPSO algorithm (LTQPSO); Tian et al. [27] proposed a heuristic method known as quantum-behaved particle swarm optimization (QPSO) to solve the inverse advection–dispersion problem.However, it is quite difficult to improve global search capabilities and speed up convergence at the same time. If you try to avoid falling into the local optimal state, the convergence speed may be slower, so the QPSO algorithm needs to be specifically modified to be suitable for the practical optimization problem.In the group intelligence algorithm, how to balance the global and local search ability is a key issue that is the balance between exploration and gain. Particle swarms have some shortcomings in this respect. In terms of exploration, the fast convergence characteristics easily lead to premature convergence and, in the aspect of gain, the single search mode of particle swarm has the problem of insufficient convergence precision, and, in the multiobjective particle swarm, the frequent replacement of global optimal solution leads to more prominent problem of exploration and development. In summary, this paper proposes a new cooperative evolutionary strategy teamwork particle swarm optimization algorithm (TEQPSO) for solving nonlinear numerical problems including unimodal and multipeak test functions. The main difference between the comprehensive learning particle swarm optimizer (CLPSO) [28] and traditional QPSO is that CLQPSO uses cooperative evolution strategy to generate local attractors for each particle, as follows: (1) using two operators (cross-sequential quadratic programming operators and the cooperative learning strategy consisting of Gaussian chaotic mutation operator generates local attractors; (2) it uses a cooperative learning strategy composed of two operators to generate local attractors; (3) a probability factor p is employed to control the implementation of these two operators to realize a balance between exploration and gain of the teamwork evolutionary strategy.


## 2. Teamwork Evolutionary Strategy Quantum Particle Swarm Optimization

### 2.1. Cooperative Evolutionary Strategy Quantum Particle Swarm Optimization

Consider that the particle moved on a one-dimensional wellδ. Now, its position (x) could be calculated from the following equation:(1)x=p±L2ln⁡1uwherep is the particle motion centre. In QPSO algorithm, it is also called theattractor of the particle. L is the characteristic length of the potential well δ where its value is directly related to the convergence speed and searching ability of the algorithm. u is a random number with a uniform distribution function in the range (0,1).ParameterL should be appropriately determined through the QPSO algorithm. This parameter could be calculated from the following equations: (2)Li,j=2β·mbestj-xi,jwhere(3)mbest=1N∑i=1Npbestiwherepbesti is the optimal position of the individual in the search history of the particle xi. β is the Contraction-Expansion (CE) factor. This parameter should be decreased during the algorithm running.In the QPSO algorithm, each particle takes the weighted average position of the individual historical optimal position and the optimal position of the group history as its own attraction point. This calculation method could be concluded from the particle motion trajectory results [29, 30]. Although this kind of calculation is simple, it has two obvious defects: (i) apart from its own experience learning, each particle position depends on the historical optimal position of the group. This leads to rapid decline in the diversity of large groups which reduces the algorithm capability for solving complex multipeak optimization problems. (ii) The possible distribution space of each particle attraction point gradually decreases during the evolution process of the algorithm. The particles are limited to a rectangle with vertices pbesti,t and gbesti,t. The attractori,t gradually approaches gbesti,t. Finally, this algorithm could not jump out of local optimum in the final stage. Now, we have(4)attractori,t=ui,tpbesti,t+1-ui,tpbestb,t+Δi,twhereui,t is a random number with uniform distribution function over the interval [0,1]. The subscript i is the number of a randomly selected particle with the best fitness value. Moreover, the ratio of the particles is selected as m∈(0,1]. Δi,t=Δi,t1,Δi,t2,…,Δi,tD is a perturbation vector defined as(5)Δi,t=pbesta,t-pbestc,t2where subscripts b and c are two randomly selected particles in the group anda≠b≠c≠i.The following observation (update) equation for the particle position in the QPSO algorithm could be obtained. Consider(6)xi,t=attractori,t±2βmbestj-xi,t


### 2.2. TE Strategy

In the evolution procedure, some useful information about individual particles and the global optimal position may lose through the algorithm. In addition, the movement of some attractors in a worse direction leads to poor fitness in the next evolutionary process. Therefore, to improve the algorithm performance, the effective information on the individual and global optimal positions of the particles should be utilized through an appropriate method. To improve the optimization ability of the algorithm using the mentioned information, the cross-over algorithm and local search are incorporated into a cross-sequential quadratic programming (SQP) algorithm. The algorithm falls into local optimum in its final stage. This means that the individual and global optimum positions of the particles in the population are very close to each other or even the same. Considering the mentioned problem, a Gaussian chaotic mutation operator is proposed to improve the population diversity and jump out of the local optimum.


### 2.3. CROSS-SQP Operator

(  1) Local Search Based on the SQP Algorithm. The SQP method [31] is one of the nonlinear programming methods for constrained optimization. In the SQP algorithm, the quasi-Newton update method is utilized. In this method, the Lagrange function’s Hessian function in each iteration is calculated, approximately. Then, the quadratic programming subquestion is generated to calculate the searching direction of the line searching process. Thus, the following optimization problem could be written:(7)mind∈Rn12dTHkd+∇fxkTd(8)s.t.∇gxkTd+gxk≤0where the subscriptk is the current number of iterations; H is the Hession matrix that could be approximated by the quasi-Newton and the BFGS methods. The solution of the quadratic programming subproblem is employed as the linear search direction for the next iteration.In summary, the SQP method mainly includes three stages: (i) updating the Hessian matrix of the Lagrangian function; (ii) calculating the line search and performance function; and (iii) solving the quadratic programming problem.(  2) Cross-Algorithm. The crossover operator is derived from the genetic algorithm [32]. Through cross-operation, the information exchange between individuals in the group could be performed. As a result, the excellent genes are gradually retained during the evolutionary process. Accordingly, the group evolves into a good direction. To solve complex multipeak optimization problems through the QPSO algorithm, the group diversity and the algorithm performance should be improved by incorporating the crossover operator into the algorithm. In the beginning, the measurement position Xi,t+1 corresponding to the particle xi is generated. Then, Xi,t+1 and the individual historical optimal position pbesti,t are discretely intersected to generate a test position Qi,t=qi,t1,qi,t2,…,qi,tD. The crossover equation is given as(9)qi,t+1j=xi,t+1jrandj0,1<pbestorj=jrandpci,tjotherwhererandj(0,1) is a random number with a uniform distribution function in the interval [0,1]; jrand is an integer number that is uniformly generated in the interval [1,D]; pc is the crossover operation probability. This operation is similar to the binomial operation in the differential evolution algorithm [33].Finally, the optimal historical position of the updated particle is calculated as(10)pbesti,t+1j=qi,t+1jfqi,t+1j<fpbesti,t+1jpbesti,t+1jotherwheref(∗) is the fitness function. Without loss of generality, this paper only considers the minimization problem.Different optimization problems require different optimal parameters at different stages of evolution. Therefore, finding an appropriate valuep for all problems is difficult. In this paper, this parameter is directly encoded into each particle by an adaptive method to attain an adaptive control method. The particle i in the extended coded group could be described as(11)Xi,t=xi,t1,xi,t2,…,xi,tD,pbesti,tFor each group particle, the crossover probability could be updated according to the following adaptation rule:(12)pbesti,t+1=rand10,1rand20,1<λpbesti,totherwhere λ is the probability of updating parameter pbesti.The individual historical optimal positionpbesti,t could be calculated through the CROSS-SQP operator. It could be employed as the attractor attractori,t of particle xi.


### 2.4. Gaussian Chaotic Mutation Operator

Necessary conditions for global convergence of the QPSO algorithm could be obtained through a convergence analysis approach; that is, each particlexi, j(t) converges on ki=(ki1,ki2,…kin)T. Its expression is (13)ki,jt=φ∙pbesti,jt+1-φ∙gbestjtwhere φ∈(0,1), pbesti,j(t) is the historical optimal position of the particle and gbestj(t) is the optimal particle position.In the TEQPSO algorithm, the dimension of the particle is considered as one. The chaotic mapping relationship is established by calculating the distance between positionsxi(t) and ki(t) for particle i. In addition, the chaotic search range for each generated particle is dynamically adjusted, iteratively. The searching range of particles is calculated as follows:(14)xi,min=kit-kit-xitukit≠xitkit-kit·zkit=xit(15)xi,max=kit+kit-xitukit≠xitkit+kit·1-ukit=xitThe Gaussian chaotic variation in [34] could be employed to improve the single-objective PSO algorithm into the multiobjective PSO algorithm. Accordingly, we have(16)xikt=xikt+αgiklg-xiktxi,max-xi′ktα≥0xikt+αgiklg-xiktxi′kt-xi,minα≤0where α is the random number in the interval [-1,1], lg-xik is the distance from the global optimal position of the particle i and xi′k(t) is the introduced logistic chaotic map value that is calculated such that the omnidirectional ergodicity property for the variation is realized, or(17)xi′kt=xi,min+rikxi,max-xi,min(18)rik=4rik1-rikThe initial value ofrik is considered as ri,0k∈rand(0,1) and ri,0k≠0.25,0.5,0.75, xi,max and xi,min are the upper and lower bounds of the particle search space, and sik(t) is a Gaussian process with the following distribution function:(19)sikt=exp-pgt-xikt22σ2k(20)σ2k=σ2e-k/cwhere k is the current number of iterations, T is the maximum number of iterations, and σ0 is the initial variance.The detailed operation flow of the Gaussian chaotic mutation operator is shown in Table2. Before applying Gaussian chaotic mutation operators, the number of Gaussian variations should be determined first. If the number of variations is too large, the calculating time of the algorithm increases greatly while if the number of mutations is too small, the probability that the algorithm jumps out of the local optimum decreases.


### 2.5. “Exploration” and “Gain” Analysis in Cooperative Evolution Strategy

“Exploration” in the algorithm refers to adding cross-sequential quadratic programming operators to enhance the local search capability of the optimization algorithm. The “gain” refers to accessing the areas that were visited in the historical search to enhance the global search or the refining capability of the optimization algorithm [32]. The crossover operator and SQP strategy have been employed in the cross-sequential quadratic programming operator to strengthen the local search capability or “exploration” in the teamwork evolutionary strategy. The descendants of the Gaussian chaotic mutation operator generated by the Gaussian chaotic mutation may appear in the new searching space. Therefore, the Gaussian chaotic operator is nearer to the “gain” in the teamwork evolutionary strategy.The TEQPSO algorithm could be summarized through the following steps.( 1 ) Generate particle groups Pi=(x1,x2,…,xn) in the decision space, randomly. Now, initialize the global and individual optimal values. Calculate the fitness value f(xi) for each particle, the maximum number of iterationsT, and the upper and lower bounds (xi,max and xi,min) for the particle xi.( 2 ) Calculate the current optimal position gbesti for particle xi and the optimal position gbesti for all particles. Let stopi be zero for each particle xi, where stopi indicates that individual optimal position for the particle xi remains unchanged.( 3 ) For the acquisition method of the attractor attractori of the particle xi: (i) if stopi≤T, then attractori is obtained according to the CROSS-SQP operator; (ii) if stopi≠T&pbesti=gbest, then attractori is obtained according to the Gaussian chaotic operator. The Gaussian chaotic operator operation is carried out by the steps given in Table 2; (iii) if stopi≠T&pbesti≠gbest, according to the CROSS-SQP operator attractori, this operator is applied using the corresponding steps given in Table 1. Otherwise, attractori is obtained according to the Gaussian chaotic mutation operator where its steps are illustrated in Table 2.Table 1
CROSS-SQP operator algorithm.
CROSS-SQP operator ( 1 ) Update the Hessian matrix of the Lagrangian function and calculate the attraction points of the particles according to Equations (1)-(6); ( 2 ) Solve the SQP problem using the BFGS method according to Equations (7) and (8); ( 3 ) Generate the measurement position of the particles; ( 4 ) Evaluate the fitness value of the test location; ( 5 ) Update the crossover probability ( 6 ) Select the best individual pbesti,t in the calculated sample as attractori,t of the particle xiTable 2
Gaussian chaotic mutation operator flow.
Gaussian chaotic mutation algorithm ( 1 ) Calculate the attractor fixed point attractori, according to Equation (6). ( 2 ) Set the chaotic map search interval ximax and ximin according to Equations (14) and (15). ( 3 ) The particle xi is subjected to the chaotic mapping operation corresponding to Equations (17) and (18). ( 4 ) Apply the Gaussian mutation operation on particle xi according to Equations (19) and (20). ( 5 ) Is it better to evaluate the fitness function of the current value of the particle of the chaotic map sequence? pbesti,j(t) and gbestj(t) updatepbesti,j(t) and gbestj(t). ( 6 ) Select the best individual pbesti,t+1 in the calculated sample as the attractor attractori,t of xi.( 4 ) Update the particle swarm and fitness values. If f(xi+1)>f(xi),pbesti=xi,stopi=0; if f(xi+1)<f(xi), pbesti=pbesti+1,stopi=stopi+1.( 5 ) Determine whether the algorithm satisfies the termination condition; then output pbesti. Otherwise, return to step (3).


## 2.1. Cooperative Evolutionary Strategy Quantum Particle Swarm Optimization

Consider that the particle moved on a one-dimensional wellδ. Now, its position (x) could be calculated from the following equation:(1)x=p±L2ln⁡1uwherep is the particle motion centre. In QPSO algorithm, it is also called theattractor of the particle. L is the characteristic length of the potential well δ where its value is directly related to the convergence speed and searching ability of the algorithm. u is a random number with a uniform distribution function in the range (0,1).ParameterL should be appropriately determined through the QPSO algorithm. This parameter could be calculated from the following equations: (2)Li,j=2β·mbestj-xi,jwhere(3)mbest=1N∑i=1Npbestiwherepbesti is the optimal position of the individual in the search history of the particle xi. β is the Contraction-Expansion (CE) factor. This parameter should be decreased during the algorithm running.In the QPSO algorithm, each particle takes the weighted average position of the individual historical optimal position and the optimal position of the group history as its own attraction point. This calculation method could be concluded from the particle motion trajectory results [29, 30]. Although this kind of calculation is simple, it has two obvious defects: (i) apart from its own experience learning, each particle position depends on the historical optimal position of the group. This leads to rapid decline in the diversity of large groups which reduces the algorithm capability for solving complex multipeak optimization problems. (ii) The possible distribution space of each particle attraction point gradually decreases during the evolution process of the algorithm. The particles are limited to a rectangle with vertices pbesti,t and gbesti,t. The attractori,t gradually approaches gbesti,t. Finally, this algorithm could not jump out of local optimum in the final stage. Now, we have(4)attractori,t=ui,tpbesti,t+1-ui,tpbestb,t+Δi,twhereui,t is a random number with uniform distribution function over the interval [0,1]. The subscript i is the number of a randomly selected particle with the best fitness value. Moreover, the ratio of the particles is selected as m∈(0,1]. Δi,t=Δi,t1,Δi,t2,…,Δi,tD is a perturbation vector defined as(5)Δi,t=pbesta,t-pbestc,t2where subscripts b and c are two randomly selected particles in the group anda≠b≠c≠i.The following observation (update) equation for the particle position in the QPSO algorithm could be obtained. Consider(6)xi,t=attractori,t±2βmbestj-xi,t


## 2.2. TE Strategy

In the evolution procedure, some useful information about individual particles and the global optimal position may lose through the algorithm. In addition, the movement of some attractors in a worse direction leads to poor fitness in the next evolutionary process. Therefore, to improve the algorithm performance, the effective information on the individual and global optimal positions of the particles should be utilized through an appropriate method. To improve the optimization ability of the algorithm using the mentioned information, the cross-over algorithm and local search are incorporated into a cross-sequential quadratic programming (SQP) algorithm. The algorithm falls into local optimum in its final stage. This means that the individual and global optimum positions of the particles in the population are very close to each other or even the same. Considering the mentioned problem, a Gaussian chaotic mutation operator is proposed to improve the population diversity and jump out of the local optimum.


## 2.3. CROSS-SQP Operator

(  1) Local Search Based on the SQP Algorithm. The SQP method [31] is one of the nonlinear programming methods for constrained optimization. In the SQP algorithm, the quasi-Newton update method is utilized. In this method, the Lagrange function’s Hessian function in each iteration is calculated, approximately. Then, the quadratic programming subquestion is generated to calculate the searching direction of the line searching process. Thus, the following optimization problem could be written:(7)mind∈Rn12dTHkd+∇fxkTd(8)s.t.∇gxkTd+gxk≤0where the subscriptk is the current number of iterations; H is the Hession matrix that could be approximated by the quasi-Newton and the BFGS methods. The solution of the quadratic programming subproblem is employed as the linear search direction for the next iteration.In summary, the SQP method mainly includes three stages: (i) updating the Hessian matrix of the Lagrangian function; (ii) calculating the line search and performance function; and (iii) solving the quadratic programming problem.(  2) Cross-Algorithm. The crossover operator is derived from the genetic algorithm [32]. Through cross-operation, the information exchange between individuals in the group could be performed. As a result, the excellent genes are gradually retained during the evolutionary process. Accordingly, the group evolves into a good direction. To solve complex multipeak optimization problems through the QPSO algorithm, the group diversity and the algorithm performance should be improved by incorporating the crossover operator into the algorithm. In the beginning, the measurement position Xi,t+1 corresponding to the particle xi is generated. Then, Xi,t+1 and the individual historical optimal position pbesti,t are discretely intersected to generate a test position Qi,t=qi,t1,qi,t2,…,qi,tD. The crossover equation is given as(9)qi,t+1j=xi,t+1jrandj0,1<pbestorj=jrandpci,tjotherwhererandj(0,1) is a random number with a uniform distribution function in the interval [0,1]; jrand is an integer number that is uniformly generated in the interval [1,D]; pc is the crossover operation probability. This operation is similar to the binomial operation in the differential evolution algorithm [33].Finally, the optimal historical position of the updated particle is calculated as(10)pbesti,t+1j=qi,t+1jfqi,t+1j<fpbesti,t+1jpbesti,t+1jotherwheref(∗) is the fitness function. Without loss of generality, this paper only considers the minimization problem.Different optimization problems require different optimal parameters at different stages of evolution. Therefore, finding an appropriate valuep for all problems is difficult. In this paper, this parameter is directly encoded into each particle by an adaptive method to attain an adaptive control method. The particle i in the extended coded group could be described as(11)Xi,t=xi,t1,xi,t2,…,xi,tD,pbesti,tFor each group particle, the crossover probability could be updated according to the following adaptation rule:(12)pbesti,t+1=rand10,1rand20,1<λpbesti,totherwhere λ is the probability of updating parameter pbesti.The individual historical optimal positionpbesti,t could be calculated through the CROSS-SQP operator. It could be employed as the attractor attractori,t of particle xi.


## 2.4. Gaussian Chaotic Mutation Operator

Necessary conditions for global convergence of the QPSO algorithm could be obtained through a convergence analysis approach; that is, each particlexi, j(t) converges on ki=(ki1,ki2,…kin)T. Its expression is (13)ki,jt=φ∙pbesti,jt+1-φ∙gbestjtwhere φ∈(0,1), pbesti,j(t) is the historical optimal position of the particle and gbestj(t) is the optimal particle position.In the TEQPSO algorithm, the dimension of the particle is considered as one. The chaotic mapping relationship is established by calculating the distance between positionsxi(t) and ki(t) for particle i. In addition, the chaotic search range for each generated particle is dynamically adjusted, iteratively. The searching range of particles is calculated as follows:(14)xi,min=kit-kit-xitukit≠xitkit-kit·zkit=xit(15)xi,max=kit+kit-xitukit≠xitkit+kit·1-ukit=xitThe Gaussian chaotic variation in [34] could be employed to improve the single-objective PSO algorithm into the multiobjective PSO algorithm. Accordingly, we have(16)xikt=xikt+αgiklg-xiktxi,max-xi′ktα≥0xikt+αgiklg-xiktxi′kt-xi,minα≤0where α is the random number in the interval [-1,1], lg-xik is the distance from the global optimal position of the particle i and xi′k(t) is the introduced logistic chaotic map value that is calculated such that the omnidirectional ergodicity property for the variation is realized, or(17)xi′kt=xi,min+rikxi,max-xi,min(18)rik=4rik1-rikThe initial value ofrik is considered as ri,0k∈rand(0,1) and ri,0k≠0.25,0.5,0.75, xi,max and xi,min are the upper and lower bounds of the particle search space, and sik(t) is a Gaussian process with the following distribution function:(19)sikt=exp-pgt-xikt22σ2k(20)σ2k=σ2e-k/cwhere k is the current number of iterations, T is the maximum number of iterations, and σ0 is the initial variance.The detailed operation flow of the Gaussian chaotic mutation operator is shown in Table2. Before applying Gaussian chaotic mutation operators, the number of Gaussian variations should be determined first. If the number of variations is too large, the calculating time of the algorithm increases greatly while if the number of mutations is too small, the probability that the algorithm jumps out of the local optimum decreases.


## 2.5. “Exploration” and “Gain” Analysis in Cooperative Evolution Strategy

“Exploration” in the algorithm refers to adding cross-sequential quadratic programming operators to enhance the local search capability of the optimization algorithm. The “gain” refers to accessing the areas that were visited in the historical search to enhance the global search or the refining capability of the optimization algorithm [32]. The crossover operator and SQP strategy have been employed in the cross-sequential quadratic programming operator to strengthen the local search capability or “exploration” in the teamwork evolutionary strategy. The descendants of the Gaussian chaotic mutation operator generated by the Gaussian chaotic mutation may appear in the new searching space. Therefore, the Gaussian chaotic operator is nearer to the “gain” in the teamwork evolutionary strategy.The TEQPSO algorithm could be summarized through the following steps.( 1 ) Generate particle groups Pi=(x1,x2,…,xn) in the decision space, randomly. Now, initialize the global and individual optimal values. Calculate the fitness value f(xi) for each particle, the maximum number of iterationsT, and the upper and lower bounds (xi,max and xi,min) for the particle xi.( 2 ) Calculate the current optimal position gbesti for particle xi and the optimal position gbesti for all particles. Let stopi be zero for each particle xi, where stopi indicates that individual optimal position for the particle xi remains unchanged.( 3 ) For the acquisition method of the attractor attractori of the particle xi: (i) if stopi≤T, then attractori is obtained according to the CROSS-SQP operator; (ii) if stopi≠T&pbesti=gbest, then attractori is obtained according to the Gaussian chaotic operator. The Gaussian chaotic operator operation is carried out by the steps given in Table 2; (iii) if stopi≠T&pbesti≠gbest, according to the CROSS-SQP operator attractori, this operator is applied using the corresponding steps given in Table 1. Otherwise, attractori is obtained according to the Gaussian chaotic mutation operator where its steps are illustrated in Table 2.Table 1
CROSS-SQP operator algorithm.
CROSS-SQP operator ( 1 ) Update the Hessian matrix of the Lagrangian function and calculate the attraction points of the particles according to Equations (1)-(6); ( 2 ) Solve the SQP problem using the BFGS method according to Equations (7) and (8); ( 3 ) Generate the measurement position of the particles; ( 4 ) Evaluate the fitness value of the test location; ( 5 ) Update the crossover probability ( 6 ) Select the best individual pbesti,t in the calculated sample as attractori,t of the particle xiTable 2
Gaussian chaotic mutation operator flow.
Gaussian chaotic mutation algorithm ( 1 ) Calculate the attractor fixed point attractori, according to Equation (6). ( 2 ) Set the chaotic map search interval ximax and ximin according to Equations (14) and (15). ( 3 ) The particle xi is subjected to the chaotic mapping operation corresponding to Equations (17) and (18). ( 4 ) Apply the Gaussian mutation operation on particle xi according to Equations (19) and (20). ( 5 ) Is it better to evaluate the fitness function of the current value of the particle of the chaotic map sequence? pbesti,j(t) and gbestj(t) updatepbesti,j(t) and gbestj(t). ( 6 ) Select the best individual pbesti,t+1 in the calculated sample as the attractor attractori,t of xi.( 4 ) Update the particle swarm and fitness values. If f(xi+1)>f(xi),pbesti=xi,stopi=0; if f(xi+1)<f(xi), pbesti=pbesti+1,stopi=stopi+1.( 5 ) Determine whether the algorithm satisfies the termination condition; then output pbesti. Otherwise, return to step (3).


## 3. Test Functions and Settings

### 3.1. Test Function

To evaluate the performance of the algorithm, the optimization function defined in IEEE-CEC 2014 is selected, as shown in Table3. The MATLAB code for these functions can be downloaded from http://www.ntu.edu.sg/home/epnsugan/. Table 3 gives some main information about the relevant test functions. It could be seen from Table 3 that the twelve test functions could be divided into four categories, in which the function types of functions F1 and F2 are identical to single-mode functions, the functions of F3~F6 are consistently multimodal functions, F7 and F8 are rotating multimode, and F9~F12 are multiobjective test functions. For the state function, to rotate the multimodal function, first construct an orthogonal matrix N and multiply the variables x by the multimodal function to obtain a new variable y. This variable could be utilized to calculate the fitness value of the function [38].Table 3
CEC 2014 related test functions.
Functions Formulations Initialization Max.range Sphere f 1 ( x ) =  ∑ i = 1 n x i 2 [ - 100,100 ] D [ - 100,50 ] D  Rosenbrock f 2 ( x ) =  ∑ i = 1 D - 1 100 x i + 1 - x i 2 2 + x i - 1 2 [ - 2048,2048 ] D [ - 2048,2048 ] D  Ackley f 3 ( x ) = - 20  e x p - 0.2 1 D  ∑ i = 1 D x i 2 - e x p 1 D  ∑ i = 1 D cos ⁡ 2 π x i + 20 + e [ - 32768,32768 ] D [ - 32768,16 ] D  Griewank f 4 ( x ) = 1 4000  ∑ i = 1 n x i 2 -  ∏ i = 1 n c o s x i i + 1 [ - 600,600 ] D [ - 600,200 ] D  Step f 5 ( x ) =  ∑ i = 1 D x i + 0.5 2 [ - 100,100 ] D [ - 100,100 ] D  Rastrigin f 6 ( x ) =  ∑ i = 1 D x i 2 - 10 cos ⁡ 2 π x i + 10 [ - 5.12,5.12 ] D [ - 5.12,2 ] D  Rotated Griewank f 7 x = 1 4000  ∑ i = 1 n y i 2 -  ∏ i = 1 n cos ⁡ y i i + 1 ,   y = N ∗ x [ - 600,600 ] D [ - 600,200 ] D  Rotated Rastrigin f 8 ( x ) =  ∑ i = 1 D y i 2 - 10 cos ⁡ 2 π y i + 10 ,   y = N ∗ x [ - 0.5,0.5 ] D [ - 0.5,0.2 ] DAmong them,N=N11N12⋯N1DN21N22⋯N2D⋯⋯⋯ND1ND2⋯NDD, x=x1,x2,…,xDT, and y=y1,y2,…,yDT; then yi=ni1x1+ni2x2+…+niDxD.


### 3.2. Algorithm Parameter Analysis

The TEQPSO algorithm mainly uses three new parameters: probability factorp, the number of mutations c, and the maximum number of iterations T. These three parameters could be analysed accurately by selecting each function from three types of functions (f1,f3,f4,f6,f7,f8). The TEQPSO algorithm could work effectively if appropriate values are chosen for p, c, and T. To find the optimal values for these parameters, two of them are considered constant while the other one changes within the setting range. Now, the parameters giving the best fitness values for f1,f3,f4,f6,f7,f8 functions are selected as the optimal parameters. This ensures the accuracy of the algorithm and reduces the statistical error. The experimental results given below are obtained from 50 independent running statistics of the algorithm. For each test function, each algorithm performs a subfunction evaluation (FEs) 2.5×105 times.(  1) Probability Factor p. In the TEQPSO algorithm, the probability factor p is introduced to decide whether to use the crossover operator or the Gaussian chaotic mutation operator. This makes an effective balance between the local and global search effects. To investigate the effect of different probability factors on the algorithm performance and find the best probability factor, the number of mutationsc=8 and the stagnation factor T=9 are selected. Figure 1(a) shows the average result of 50 independent running times of the TEQPSO algorithm. As what could be seen from Figure 1(a), good results are obtained for most of the test functions for p=0.15. Thus, p=0.15 could be a suitable value for the probability factor of the TEQPSO algorithm.Figure 1
The change in the fitness value of the test function for different parameters: (a) probability parameter; (b) mutation times; (c) stagnation factors.
(a) (b) (c)(  2) Number of Mutations c. During the chaotic operator execution, the number of mutations c determines the number of chaotic variations in the particles. If large value is chosen for this parameter, the algorithm will waste too much computation time. Considering small values for this parameter reduces the capability of the algorithm to jump out of the local optimum. Therefore, an appropriate value for number of mutations should be chosen. Figure 1(b) gives the statistical results of the algorithm running for different values of c. The probability factor p=0.15 and the stagnation factor T=9 are considered. It could be seen from Figure 1(b) that superior results for most test functions could be obtained by choosing c=8.(  3) Stagnation Factor T. In the TEQPSO algorithm, if the particle does not change its individual optimal position inTth iteration, a cooperative learning strategy is adopted to construct the attractor so that the particle jumps out of the current position. Therefore, the stop factorT could be utilized to control the constructing attractor frequencies using the teamwork evolutionary strategy. To derive the appropriate stopping factor, the probability factor p=0.15 and the number of mutations c=8 are selected. The running results of the algorithm for different values of the stagnation factors are presented in Figure 1(c). It is obvious that the algorithm gives better results for most of the test functions for T=9.


### 3.3. Related Algorithm Parameter Settings

We make two groups of experiments, with each to test the standard QPSO [34], the CSPSO [35], the CLPSO [28], the WQPSO [36], the CQPSO [20], the COQPSO [37], and TEQPSO in this paper. The parameter settings of the TEQPSO algorithm and other algorithms are shown in Table 4. When solving the 10-dimensional (10D) problem, the population size is set to 10, and the maximum fitness evaluation (FE) is set to 400000. When solving the 30-dimensional (30D) problem, the population size is set to 40 and the maximum FE is set to 400000. All experiments were performed 30 times, and the mean and standard deviation from the calculation results on each algorithm were given. In solving multiobjective optimization problems, because the PSO has higher computational efficiency, usually the fitness calculation takes the most time. Therefore, this article does not compare the algorithm-related calculation times of these algorithms.Table 4
Parameter settings of each algorithm.
References Algorithm Parameter settings [34] QPSO α = 1 ~ 0.5 [35] CSPSO w = 0.4 ,  c 1 = c 2 = 2 ,  p v = 0.8 [28] CLPSO w = 0.9 ~ 0.4 ,  c = 1.495 ,  V m a x = 0.2 × r a n g e [36] WQPSO α = 1.5 ~ 0.5 , β = 1.0 ~ 0.5 [20] CQPSO α = 1 ~ 0.5 , p 0 = 0.9 , τ = 0.2 [37] COQPSO α = 1 ~ 0.5 ,  G = 5 ,  k = 2 ,  p = 0.7 This paper TEQPSO α = 1 ~ 0.5 ,  T = 9 ,  c = 8 ,  p = 0.15


## 3.1. Test Function

To evaluate the performance of the algorithm, the optimization function defined in IEEE-CEC 2014 is selected, as shown in Table3. The MATLAB code for these functions can be downloaded from http://www.ntu.edu.sg/home/epnsugan/. Table 3 gives some main information about the relevant test functions. It could be seen from Table 3 that the twelve test functions could be divided into four categories, in which the function types of functions F1 and F2 are identical to single-mode functions, the functions of F3~F6 are consistently multimodal functions, F7 and F8 are rotating multimode, and F9~F12 are multiobjective test functions. For the state function, to rotate the multimodal function, first construct an orthogonal matrix N and multiply the variables x by the multimodal function to obtain a new variable y. This variable could be utilized to calculate the fitness value of the function [38].Table 3
CEC 2014 related test functions.
Functions Formulations Initialization Max.range Sphere f 1 ( x ) =  ∑ i = 1 n x i 2 [ - 100,100 ] D [ - 100,50 ] D  Rosenbrock f 2 ( x ) =  ∑ i = 1 D - 1 100 x i + 1 - x i 2 2 + x i - 1 2 [ - 2048,2048 ] D [ - 2048,2048 ] D  Ackley f 3 ( x ) = - 20  e x p - 0.2 1 D  ∑ i = 1 D x i 2 - e x p 1 D  ∑ i = 1 D cos ⁡ 2 π x i + 20 + e [ - 32768,32768 ] D [ - 32768,16 ] D  Griewank f 4 ( x ) = 1 4000  ∑ i = 1 n x i 2 -  ∏ i = 1 n c o s x i i + 1 [ - 600,600 ] D [ - 600,200 ] D  Step f 5 ( x ) =  ∑ i = 1 D x i + 0.5 2 [ - 100,100 ] D [ - 100,100 ] D  Rastrigin f 6 ( x ) =  ∑ i = 1 D x i 2 - 10 cos ⁡ 2 π x i + 10 [ - 5.12,5.12 ] D [ - 5.12,2 ] D  Rotated Griewank f 7 x = 1 4000  ∑ i = 1 n y i 2 -  ∏ i = 1 n cos ⁡ y i i + 1 ,   y = N ∗ x [ - 600,600 ] D [ - 600,200 ] D  Rotated Rastrigin f 8 ( x ) =  ∑ i = 1 D y i 2 - 10 cos ⁡ 2 π y i + 10 ,   y = N ∗ x [ - 0.5,0.5 ] D [ - 0.5,0.2 ] DAmong them,N=N11N12⋯N1DN21N22⋯N2D⋯⋯⋯ND1ND2⋯NDD, x=x1,x2,…,xDT, and y=y1,y2,…,yDT; then yi=ni1x1+ni2x2+…+niDxD.


## 3.2. Algorithm Parameter Analysis

The TEQPSO algorithm mainly uses three new parameters: probability factorp, the number of mutations c, and the maximum number of iterations T. These three parameters could be analysed accurately by selecting each function from three types of functions (f1,f3,f4,f6,f7,f8). The TEQPSO algorithm could work effectively if appropriate values are chosen for p, c, and T. To find the optimal values for these parameters, two of them are considered constant while the other one changes within the setting range. Now, the parameters giving the best fitness values for f1,f3,f4,f6,f7,f8 functions are selected as the optimal parameters. This ensures the accuracy of the algorithm and reduces the statistical error. The experimental results given below are obtained from 50 independent running statistics of the algorithm. For each test function, each algorithm performs a subfunction evaluation (FEs) 2.5×105 times.(  1) Probability Factor p. In the TEQPSO algorithm, the probability factor p is introduced to decide whether to use the crossover operator or the Gaussian chaotic mutation operator. This makes an effective balance between the local and global search effects. To investigate the effect of different probability factors on the algorithm performance and find the best probability factor, the number of mutationsc=8 and the stagnation factor T=9 are selected. Figure 1(a) shows the average result of 50 independent running times of the TEQPSO algorithm. As what could be seen from Figure 1(a), good results are obtained for most of the test functions for p=0.15. Thus, p=0.15 could be a suitable value for the probability factor of the TEQPSO algorithm.Figure 1
The change in the fitness value of the test function for different parameters: (a) probability parameter; (b) mutation times; (c) stagnation factors.
(a) (b) (c)(  2) Number of Mutations c. During the chaotic operator execution, the number of mutations c determines the number of chaotic variations in the particles. If large value is chosen for this parameter, the algorithm will waste too much computation time. Considering small values for this parameter reduces the capability of the algorithm to jump out of the local optimum. Therefore, an appropriate value for number of mutations should be chosen. Figure 1(b) gives the statistical results of the algorithm running for different values of c. The probability factor p=0.15 and the stagnation factor T=9 are considered. It could be seen from Figure 1(b) that superior results for most test functions could be obtained by choosing c=8.(  3) Stagnation Factor T. In the TEQPSO algorithm, if the particle does not change its individual optimal position inTth iteration, a cooperative learning strategy is adopted to construct the attractor so that the particle jumps out of the current position. Therefore, the stop factorT could be utilized to control the constructing attractor frequencies using the teamwork evolutionary strategy. To derive the appropriate stopping factor, the probability factor p=0.15 and the number of mutations c=8 are selected. The running results of the algorithm for different values of the stagnation factors are presented in Figure 1(c). It is obvious that the algorithm gives better results for most of the test functions for T=9.


## 3.3. Related Algorithm Parameter Settings

We make two groups of experiments, with each to test the standard QPSO [34], the CSPSO [35], the CLPSO [28], the WQPSO [36], the CQPSO [20], the COQPSO [37], and TEQPSO in this paper. The parameter settings of the TEQPSO algorithm and other algorithms are shown in Table 4. When solving the 10-dimensional (10D) problem, the population size is set to 10, and the maximum fitness evaluation (FE) is set to 400000. When solving the 30-dimensional (30D) problem, the population size is set to 40 and the maximum FE is set to 400000. All experiments were performed 30 times, and the mean and standard deviation from the calculation results on each algorithm were given. In solving multiobjective optimization problems, because the PSO has higher computational efficiency, usually the fitness calculation takes the most time. Therefore, this article does not compare the algorithm-related calculation times of these algorithms.Table 4
Parameter settings of each algorithm.
References Algorithm Parameter settings [34] QPSO α = 1 ~ 0.5 [35] CSPSO w = 0.4 ,  c 1 = c 2 = 2 ,  p v = 0.8 [28] CLPSO w = 0.9 ~ 0.4 ,  c = 1.495 ,  V m a x = 0.2 × r a n g e [36] WQPSO α = 1.5 ~ 0.5 , β = 1.0 ~ 0.5 [20] CQPSO α = 1 ~ 0.5 , p 0 = 0.9 , τ = 0.2 [37] COQPSO α = 1 ~ 0.5 ,  G = 5 ,  k = 2 ,  p = 0.7 This paper TEQPSO α = 1 ~ 0.5 ,  T = 9 ,  c = 8 ,  p = 0.15


## 4. Experimental Results and Analysis

### 4.1. Results of 10-Dimensional (10D) Problems

Table5 shows the mean and variance of seven algorithms running 30 times for eight test functions. As can be seen from Table 5, the TEQPSO algorithm obtains the highest f1 precision solution to the unimodal function; the mean and standard deviation values of TEQPSO are 0.00e+00 and 0.00e+00, followed by WQPSO, COQPSO, CQPSO, QPSO, CLPSO, and CSPSO. The CLPSO algorithm has the best performance in the unimodal function f2. The mean and standard deviation values of CLPSO are 6.18e+00 and 2.89e+00, followed by CSPSO, COQPSO, QPSO, WQPSO, TEQPSO, and CQPSO. Then, the TEQPSO algorithm achieves the best results of the multimodal function f3~f6, with the mean and variance values of 0.00e+00 and 0.00e+00. For the other six algorithms of functions f3, f4, and f6, they fall into local optimum; only TEQPSO obtains the best solution. The results show that the TEQPSO algorithm can maintain better population diversity, enhance the ability of the algorithm to jump out of local optimum, and have higher search accuracy on complex multimodal functions. The functions f7 and f8 are rotational mode function, and the other five algorithms are difficult to solve. Only CLPSO and TEQPSO obtain better calculation results. CLPSO obtains the highest precision solution in the rotation function f7. The mean and standard deviation values of CLPSO are 6.41e-05 and 3.58e-05, followed by CSPSO, CQPSO, WQPSO, COQPSO, QPSO, and TEQPSO. And TEQPSO obtains the most accurate solution in the rotation function f8. The mean and standard deviation of TEQPSO are 1.88e+00 and 1.05e+00, followed by WQPSO, CQPSO, COQPSO, CLPSO, QPSO, and CSPSO. In summary, the quality of TEQPSO solutions to functions f1, f3, f4, f5, f6, and f8 is significantly better than the other six algorithms.Table 5
Comparison results of seven algorithms in 10-dimensional test function.
Func QPSO CSPSO CLPSO WQPSO CQPSO COQPSO TEQPSO Mean Mean Mean Mean Mean Mean Mean (Std) (Std) (Std) (Std) (Std) (Std) (Std) f 1 3.11e-41 1.52e-23 6.55e-31 9.11e-56 6.04e-48 3.17e-52 0.00e+00 (2.84e-29) (7.29e-22) (3.89e-31) (5.36e-57) (6.22e-49) (3.00e-52) (0.00e+00)  f 2 5.18e+01 3.22e+01 6.18e+00 7.01e+01 3.56e+01 1.08e+02 7.25e+01 (4.70e-01) (1.79e+01) (2.89e+00) (4.28e-01) (2.33e+01) (6.44e+01) (4.34e-01)  f 3 4.00e-03 3.74e-13 6.82e-15 5.70e-19 8.03e-02 6.22e-23 0.00e+00 (1.72e-03) (2.00e-12) (3.17e-15) (3.78e-19) (5.34e-02) (3.25e-24) (0.00e+00)  f 4 2.02e-02 8.69e+01 6.04e+00 7.33e-2 4.17e+00 1.84e-01 0.00e+00 (2.15e-02) (9.55e+00) (6.77e+00) (6.84e-01) (2.86e+00) (2.00e-01) (0.00e+00)  f 5 0.00e+00 2.08e-03 3.41e-03 0.00e+00 0.00e+00 0.00e+00 0.00e+00 (0.00e+00) (2.33-03) (3.27e-03) (0.00e+00) (0.00e+00) (0.00e+00) (0.00e+00)  f 6 4.80e+00 5.87e+05 5.01e+04 4.05e+00 5.02e+01 4.35e+01 3.85e+00 (1.32e+00) (1.77e+05) (1.63e+04) (9.40e+00) (1.59e+01) (1.01e+01) (1.25e-03)  f 7 7.08e+00 5.92e-02 6.41e-05 1.07e+00 5.74e-01 3.18e+00 7.02e+01 (1.08e-01) (7.37e-01) (3.58e-05) (3.45e-01) (8.43e+00) (8.50e-00) (3.39e+00)  f 8 8.24e+01 9.58e+01 5.88e+01 2.01e+00 9.97e+00 1.31e+01 1.88e+00 (4.03e+01) (2.68e+01) (2.95e+01) (1.55e+00) (2.47e+01) (3.58e+00) (1.05e+00)In order to compare the convergence of several algorithms, Figures2–9 show the convergence of the seven algorithms under eight test functions. It can be seen from the figure that, compared with the TEQPSO, the other four quantum particle swarm algorithms have obvious faster convergence speed, but they are also very easy to fall into local optimum. The other two particle swarm optimization algorithms converge slowly and perform better in unimodal functions. Therefore, after adopting the teamwork evolutionary strategy, compared with the other four quantum particle swarm optimization algorithms, the convergence speed of the TEQPSO is slowed down, but the ability of the algorithm to jump out of the local optimal region is also significantly enhanced.Figure 2
Comparison of convergence process with seven algorithms in sphere function.Figure 3
Comparison of convergence process with seven algorithms in Rosenbrock function.Figure 4
Comparison of convergence process with seven algorithms in Ackley function.Figure 5
Comparison of convergence process with seven algorithms in Griewank function.Figure 6
Comparison of convergence process with seven algorithms in step function.Figure 7
Comparison of convergence process with seven algorithms in Rastrigin function.Figure 8
Comparison of convergence process with seven algorithms in rotated Griewank function.Figure 9
Comparison of convergence process with seven algorithms in rotated Rastrigin function.


### 4.2. Results of the 30-Dimensional (30D) Problem

Table6 shows the mean and variance of seven algorithms running 30 times on the eight test functions. The best results of seven algorithms are shown in bold.Table 6
Comparison results of seven algorithms in 30-dimensional test function.
Func QPSO CSPSO CLPSO WQPSO CQPSO COQPSO TEQPSO Mean Mean Mean Mean Mean Mean Mean (Std) (Std) (Std) (Std) (Std) (Std) (Std) f 1 6.50e-14 5.11e-9 4.01e-10 4.30e-33 7.82e-17 1.81e-30 0.00e+00 (1.38e-14) (7.07e-9) (4.28e-10) (6.72e-33) (1.04e-17) (3.44e-30) (0.00e+00)  f 2 1.57e+02 6.78e-01 2.78e+00 6.4e+01 3.56e+01 4.11e+02 1.02e+01 (8.2e+01) (1.39e-01) (1.46e+00) (4.86e+01) (2.33e+01) (3.58e+02) (1.6e+00)  f 3 6.01e-02 4.94e-12 7.05e-13 2.07e-13 3.08e-02 4.59e-10 7.40e-17 (9.79e-01) (7.61-12) (9.20e-12) (6.37e-13) (5.64e-02) (1.59e-10) (4.94e-17)  f 4 2.59e-01 7.69e+00 2.04e+00 5.18e-01 2.97e-01 1.04e-01 0.00e+00 (1.74e-01) (4.55e+00) (1.57e+00) (4.64e-01) (2.66e-01) (9.40e+00) (0.00e+00)  f 5 2.18e-12 4.78e-02 6.55e-03 1.29e-05 2.18e-06 2.18e-13 0.00e+00 (2.15e-12) (7.61-02) (3.84-03) (7.15e-04) (1.15e-06) (2.15e-13) (0.00e+00)  f 6 2.88e+01 3.37e+02 1.28e+02 2.60e+01 2.35e+02 6.87e+01 0.00e+00 (1.34e+01) (1.75e+02) (1.11e+02) (6.95e+00) (3.25e+01) (7.29e+01) (0.00e+00)  f 7 3.54e-01 6.02e-01 3.78e-01 8.27e-03 2.04e-02 1.28e-01 4.00e-03 (4.20e-01) (5.55e-01) (2.02e-01) (1.55e-03) (9.47e-01) (1.89e-01) (2.31e-03)  f 8 1.07e+01 4.11e+02 3.56e+02 5.24e+01 8.87e+01 1.88e+01 3.77e+00 (5.33e+00) (1.06e+02) (1.83e+02) (1.55e+01) (2.47e+01) (5.95e+00) (1.82e+00)It can be seen from Table6 that TEQPSO algorithm obtains the most accurate solution in the unimodal function f1, which jumps out of the local optimum; the mean and standard deviation values of TEQPSO are 0.00e+00 and 0.00e+00, followed by WQPSO, COQPSO, CQPSO, QPSO, CLPSO, and CSPSO. The CSPSO algorithm has the best performance in the unimodal function f2; the mean and standard deviation values of CSPSO are 6.78e-01 and 1.39e-01, followed by CLPSO, TEQPSO, CQPSO, WQPSO, QPSO, and COQPSO.Then, the algorithm of TEQPSO obtains the best results on the multimodal functionsf3~f6; the mean and standard deviation values of f3 are 7.40e-17 and 4.94e-17 and the mean and standard deviation values of f4~f6 are 0.00e+00 and 0.00e+00. For the functions f4, f5, and f6, the other six algorithms fall into local optimum and only TEQPSO obtains the best solution. The results show that TEQPSO algorithm can maintain better population diversity, enhance the ability of the algorithm to jump out of local optimum, and have higher search accuracy on complex multimodal functions. The functions f7 and f8 are rotational modal functions. The other five algorithms are difficult to solve the functions f7 and f8. Only WQPSO and TEQPSO can obtain better calculation results. WQPSO obtains the highest precision solution in the rotation function f7; the mean and standard deviation values of WQPSO are 8.27e-03 and 1.55e-03, followed by WQPSO, TEQPSO, CQPSO, CSPSO, QPSO, CLPSO, and COQPSO. TEQPSO obtains the highest precision solution in the rotation function f8; the mean and standard deviation values of TEQPSO are 3.77e+00 and 1.82e+00, followed by QPSO, COQPSO, WQPSO, CQPSO, CSPSO, and CLPSO. In summary, the precision of the TEQPSO solutions in functions f1, f3, f4, f5, f6, and f8 is better than the other six algorithms significantly. Since the convergence characteristics of seven algorithms under 30-dimensional test function are similar to the 10-dimensional convergence characteristics, the convergence characteristics of seven algorithms under 30D are not given in this paper.


### 4.3. Calculation Results Discussion

By analyzing the experimental results of the TEQPSO algorithm in the case of 10D and 30D, it could be concluded that this algorithm does not work well for unimodal functions. The TEQPSO algorithm gives superior results for multimodal functions compared with other QPSO algorithms. Jumping out of local optimum and achieving better search accuracy for rotating multimodal functions, which is very helpful for solving complex problems, are other advantages of this algorithm. According to the “No Free Lunch” theorem, the TEQPSO algorithm leads to higher search accuracy for multimodal and rotating multimodal functions. However, its convergence speed is significantly slower than other QPSO algorithms. Therefore, the TEQPSO algorithm gives obvious advantages in solving multiobjective and complex problems. In addition, the calculation effect is better.


## 4.1. Results of 10-Dimensional (10D) Problems

Table5 shows the mean and variance of seven algorithms running 30 times for eight test functions. As can be seen from Table 5, the TEQPSO algorithm obtains the highest f1 precision solution to the unimodal function; the mean and standard deviation values of TEQPSO are 0.00e+00 and 0.00e+00, followed by WQPSO, COQPSO, CQPSO, QPSO, CLPSO, and CSPSO. The CLPSO algorithm has the best performance in the unimodal function f2. The mean and standard deviation values of CLPSO are 6.18e+00 and 2.89e+00, followed by CSPSO, COQPSO, QPSO, WQPSO, TEQPSO, and CQPSO. Then, the TEQPSO algorithm achieves the best results of the multimodal function f3~f6, with the mean and variance values of 0.00e+00 and 0.00e+00. For the other six algorithms of functions f3, f4, and f6, they fall into local optimum; only TEQPSO obtains the best solution. The results show that the TEQPSO algorithm can maintain better population diversity, enhance the ability of the algorithm to jump out of local optimum, and have higher search accuracy on complex multimodal functions. The functions f7 and f8 are rotational mode function, and the other five algorithms are difficult to solve. Only CLPSO and TEQPSO obtain better calculation results. CLPSO obtains the highest precision solution in the rotation function f7. The mean and standard deviation values of CLPSO are 6.41e-05 and 3.58e-05, followed by CSPSO, CQPSO, WQPSO, COQPSO, QPSO, and TEQPSO. And TEQPSO obtains the most accurate solution in the rotation function f8. The mean and standard deviation of TEQPSO are 1.88e+00 and 1.05e+00, followed by WQPSO, CQPSO, COQPSO, CLPSO, QPSO, and CSPSO. In summary, the quality of TEQPSO solutions to functions f1, f3, f4, f5, f6, and f8 is significantly better than the other six algorithms.Table 5
Comparison results of seven algorithms in 10-dimensional test function.
Func QPSO CSPSO CLPSO WQPSO CQPSO COQPSO TEQPSO Mean Mean Mean Mean Mean Mean Mean (Std) (Std) (Std) (Std) (Std) (Std) (Std) f 1 3.11e-41 1.52e-23 6.55e-31 9.11e-56 6.04e-48 3.17e-52 0.00e+00 (2.84e-29) (7.29e-22) (3.89e-31) (5.36e-57) (6.22e-49) (3.00e-52) (0.00e+00)  f 2 5.18e+01 3.22e+01 6.18e+00 7.01e+01 3.56e+01 1.08e+02 7.25e+01 (4.70e-01) (1.79e+01) (2.89e+00) (4.28e-01) (2.33e+01) (6.44e+01) (4.34e-01)  f 3 4.00e-03 3.74e-13 6.82e-15 5.70e-19 8.03e-02 6.22e-23 0.00e+00 (1.72e-03) (2.00e-12) (3.17e-15) (3.78e-19) (5.34e-02) (3.25e-24) (0.00e+00)  f 4 2.02e-02 8.69e+01 6.04e+00 7.33e-2 4.17e+00 1.84e-01 0.00e+00 (2.15e-02) (9.55e+00) (6.77e+00) (6.84e-01) (2.86e+00) (2.00e-01) (0.00e+00)  f 5 0.00e+00 2.08e-03 3.41e-03 0.00e+00 0.00e+00 0.00e+00 0.00e+00 (0.00e+00) (2.33-03) (3.27e-03) (0.00e+00) (0.00e+00) (0.00e+00) (0.00e+00)  f 6 4.80e+00 5.87e+05 5.01e+04 4.05e+00 5.02e+01 4.35e+01 3.85e+00 (1.32e+00) (1.77e+05) (1.63e+04) (9.40e+00) (1.59e+01) (1.01e+01) (1.25e-03)  f 7 7.08e+00 5.92e-02 6.41e-05 1.07e+00 5.74e-01 3.18e+00 7.02e+01 (1.08e-01) (7.37e-01) (3.58e-05) (3.45e-01) (8.43e+00) (8.50e-00) (3.39e+00)  f 8 8.24e+01 9.58e+01 5.88e+01 2.01e+00 9.97e+00 1.31e+01 1.88e+00 (4.03e+01) (2.68e+01) (2.95e+01) (1.55e+00) (2.47e+01) (3.58e+00) (1.05e+00)In order to compare the convergence of several algorithms, Figures2–9 show the convergence of the seven algorithms under eight test functions. It can be seen from the figure that, compared with the TEQPSO, the other four quantum particle swarm algorithms have obvious faster convergence speed, but they are also very easy to fall into local optimum. The other two particle swarm optimization algorithms converge slowly and perform better in unimodal functions. Therefore, after adopting the teamwork evolutionary strategy, compared with the other four quantum particle swarm optimization algorithms, the convergence speed of the TEQPSO is slowed down, but the ability of the algorithm to jump out of the local optimal region is also significantly enhanced.Figure 2
Comparison of convergence process with seven algorithms in sphere function.Figure 3
Comparison of convergence process with seven algorithms in Rosenbrock function.Figure 4
Comparison of convergence process with seven algorithms in Ackley function.Figure 5
Comparison of convergence process with seven algorithms in Griewank function.Figure 6
Comparison of convergence process with seven algorithms in step function.Figure 7
Comparison of convergence process with seven algorithms in Rastrigin function.Figure 8
Comparison of convergence process with seven algorithms in rotated Griewank function.Figure 9
Comparison of convergence process with seven algorithms in rotated Rastrigin function.


## 4.2. Results of the 30-Dimensional (30D) Problem

Table6 shows the mean and variance of seven algorithms running 30 times on the eight test functions. The best results of seven algorithms are shown in bold.Table 6
Comparison results of seven algorithms in 30-dimensional test function.
Func QPSO CSPSO CLPSO WQPSO CQPSO COQPSO TEQPSO Mean Mean Mean Mean Mean Mean Mean (Std) (Std) (Std) (Std) (Std) (Std) (Std) f 1 6.50e-14 5.11e-9 4.01e-10 4.30e-33 7.82e-17 1.81e-30 0.00e+00 (1.38e-14) (7.07e-9) (4.28e-10) (6.72e-33) (1.04e-17) (3.44e-30) (0.00e+00)  f 2 1.57e+02 6.78e-01 2.78e+00 6.4e+01 3.56e+01 4.11e+02 1.02e+01 (8.2e+01) (1.39e-01) (1.46e+00) (4.86e+01) (2.33e+01) (3.58e+02) (1.6e+00)  f 3 6.01e-02 4.94e-12 7.05e-13 2.07e-13 3.08e-02 4.59e-10 7.40e-17 (9.79e-01) (7.61-12) (9.20e-12) (6.37e-13) (5.64e-02) (1.59e-10) (4.94e-17)  f 4 2.59e-01 7.69e+00 2.04e+00 5.18e-01 2.97e-01 1.04e-01 0.00e+00 (1.74e-01) (4.55e+00) (1.57e+00) (4.64e-01) (2.66e-01) (9.40e+00) (0.00e+00)  f 5 2.18e-12 4.78e-02 6.55e-03 1.29e-05 2.18e-06 2.18e-13 0.00e+00 (2.15e-12) (7.61-02) (3.84-03) (7.15e-04) (1.15e-06) (2.15e-13) (0.00e+00)  f 6 2.88e+01 3.37e+02 1.28e+02 2.60e+01 2.35e+02 6.87e+01 0.00e+00 (1.34e+01) (1.75e+02) (1.11e+02) (6.95e+00) (3.25e+01) (7.29e+01) (0.00e+00)  f 7 3.54e-01 6.02e-01 3.78e-01 8.27e-03 2.04e-02 1.28e-01 4.00e-03 (4.20e-01) (5.55e-01) (2.02e-01) (1.55e-03) (9.47e-01) (1.89e-01) (2.31e-03)  f 8 1.07e+01 4.11e+02 3.56e+02 5.24e+01 8.87e+01 1.88e+01 3.77e+00 (5.33e+00) (1.06e+02) (1.83e+02) (1.55e+01) (2.47e+01) (5.95e+00) (1.82e+00)It can be seen from Table6 that TEQPSO algorithm obtains the most accurate solution in the unimodal function f1, which jumps out of the local optimum; the mean and standard deviation values of TEQPSO are 0.00e+00 and 0.00e+00, followed by WQPSO, COQPSO, CQPSO, QPSO, CLPSO, and CSPSO. The CSPSO algorithm has the best performance in the unimodal function f2; the mean and standard deviation values of CSPSO are 6.78e-01 and 1.39e-01, followed by CLPSO, TEQPSO, CQPSO, WQPSO, QPSO, and COQPSO.Then, the algorithm of TEQPSO obtains the best results on the multimodal functionsf3~f6; the mean and standard deviation values of f3 are 7.40e-17 and 4.94e-17 and the mean and standard deviation values of f4~f6 are 0.00e+00 and 0.00e+00. For the functions f4, f5, and f6, the other six algorithms fall into local optimum and only TEQPSO obtains the best solution. The results show that TEQPSO algorithm can maintain better population diversity, enhance the ability of the algorithm to jump out of local optimum, and have higher search accuracy on complex multimodal functions. The functions f7 and f8 are rotational modal functions. The other five algorithms are difficult to solve the functions f7 and f8. Only WQPSO and TEQPSO can obtain better calculation results. WQPSO obtains the highest precision solution in the rotation function f7; the mean and standard deviation values of WQPSO are 8.27e-03 and 1.55e-03, followed by WQPSO, TEQPSO, CQPSO, CSPSO, QPSO, CLPSO, and COQPSO. TEQPSO obtains the highest precision solution in the rotation function f8; the mean and standard deviation values of TEQPSO are 3.77e+00 and 1.82e+00, followed by QPSO, COQPSO, WQPSO, CQPSO, CSPSO, and CLPSO. In summary, the precision of the TEQPSO solutions in functions f1, f3, f4, f5, f6, and f8 is better than the other six algorithms significantly. Since the convergence characteristics of seven algorithms under 30-dimensional test function are similar to the 10-dimensional convergence characteristics, the convergence characteristics of seven algorithms under 30D are not given in this paper.


## 4.3. Calculation Results Discussion

By analyzing the experimental results of the TEQPSO algorithm in the case of 10D and 30D, it could be concluded that this algorithm does not work well for unimodal functions. The TEQPSO algorithm gives superior results for multimodal functions compared with other QPSO algorithms. Jumping out of local optimum and achieving better search accuracy for rotating multimodal functions, which is very helpful for solving complex problems, are other advantages of this algorithm. According to the “No Free Lunch” theorem, the TEQPSO algorithm leads to higher search accuracy for multimodal and rotating multimodal functions. However, its convergence speed is significantly slower than other QPSO algorithms. Therefore, the TEQPSO algorithm gives obvious advantages in solving multiobjective and complex problems. In addition, the calculation effect is better.


## 5. Conclusion

This paper proposes a QPSO algorithm for the teamwork evolutionary strategy. The algorithm adopts a novel learning strategy, namely, teamwork evolutionary strategy, which consists of cross-sequential quadratic programming and Gaussian chaotic mutation operators. The new strategy allows the particle to have more samples to learn and larger potential space to fly. Through analysis and experiments, it is derived that the teamwork evolutionary strategy increases the TEQPSO algorithm ability to utilize the information in the group. In comparison with the eight QSOs and PSOs variants, it could be concluded that the TEQPSO algorithm significantly improves the algorithm performance for multipeak cost functions while the TEQPSO algorithm is effective in solving single-peak cost functions.



---

*Source: 1805198-2019-04-14.xml*