# Particle Swarm Optimization with Double Learning Patterns

Authors: Yuanxia Shen; Linna Wei; Chuanhua Zeng; Jian Chen
Journal: Computational Intelligence and Neuroscience
 (2016)

---

## Abstract

Particle Swarm Optimization (PSO) is an effective tool in solving optimization problems. However, PSO usually suffers from the premature convergence due to the quick losing of the swarm diversity. In this paper, we first analyze the motion behavior of the swarm based on the probability characteristic of learning parameters. Then a PSO with double learning patterns (PSO-DLP) is developed, which employs the master swarm and the slave swarm with different learning patterns to achieve a trade-off between the convergence speed and the swarm diversity. The particles in the master swarm and the slave swarm are encouraged to explore search for keeping the swarm diversity and to learn from the global best particle for refining a promising solution, respectively. When the evolutionary states of two swarms interact, an interaction mechanism is enabled. This mechanism can help the slave swarm in jumping out of the local optima and improve the convergence precision of the master swarm. The proposed PSO-DLP is evaluated on 20 benchmark functions, including rotated multimodal and complex shifted problems. The simulation results and statistical analysis show that PSO-DLP obtains a promising performance and outperforms eight PSO variants.


---

## Body

## 1. Introduction

Particle Swarm Optimization (PSO) [1, 2], firstly proposed by Kennedy and Eberhart in 1995, was inspired by the simulation of simplified social behaviors including fish schooling and bird flocking. Similar to genetic algorithm, it is also a population-based algorithm, but it has no evolutionary operations such as crossover, mutation, or selection. PSO finds the global best solution by adjusting the trajectory of each particle not only towards its personal best particlepbest but also towards the historically global best particlegbest [3]. Recently, PSO has been successfully applied to optimization problems in many fields [4–7].In the basic PSO [1], each particle in the swarm learns frompbest andgbest. During the evolutionary process,gbestis the only shared information acquired by the whole swarm, which finally leads to all particles converging to the same destination and the diversity losing quickly. Ifgbestis a local optimum far from the global one, the swarm is easy to be trapped in local optimum. The learning mechanism of the basic PSO can cause a fast convergence rate, but it easily leads to the premature convergence when solving multimodal optimization problems. In order to overcome this problem, researchers proposed many strategies to improve it.An adaptive strategy of the learning parameter [3, 8–18] is an effective way to improve the PSO performance. Shi and Eberhart [8] proposed a linearly decreasing inertia weight (LDIW) to balance the local search and global search. Ratnaweera et al. [3] proposed a time-varying acceleration coefficient (TVAC), which is beneficial to enhancing the exploration ability of particles in the early evolutionary phase and improving the local searching ability of particles in the late phase. In [3], the two variants of the PSO-TVAC were developed, namely, the PSO-TVAC with mutation (MPSO-TVAC) and the self-organizing hierarchical PSO-TVAC (HPSO). Zhan et al. [9] proposed an adaptive PSO in which the learning parameters were adaptively adjusted with the change of the evolutionary states of the swarm. Kundu et al. [10] proposed a nonlinearly time-varying acceleration coefficient and an aging guideline to avoid the premature convergence. They also suggested a mean learning strategy to enhance the exploitation search.To increase the swarm diversity, auxiliary techniques are introduced into PSO’s framework, such as genetic operators [3, 12, 13, 19], differential evolution [20], and artificial bee colony (ABC) [21, 22]. Mahmoodabadi et al. [22] combined the multicrossover and the bee colony mechanism to improve the exploration capability of PSO. In [9], an elitist learning strategy, similar to the mutation operation, is developed to help thegbest particle jump out of the local optima.The topological structure of the swarm has a significant effect on the performance of PSO [23–26]. Kennedy [23] pointed out that small neighborhood is fit for complex problems, while large neighborhood is used for simple problems. Parsopoulos and Vrahatis [24] integrated the benefits of the global PSO and the local PSO and then proposed a unified PSO (UPSO). Mendes et al. [25] proposed a fully informed PSO (FIPSO) in which the updating velocity depends on neighborhoods of each particle instead ofgbest andpbest. Bratton and Kennedy [26] proposed a standard version of PSO (SPSO) in which a local ring topology is employed. Experimental results indicated that the local model is more effective than the global model on many test problems.The design of learning strategies improves the performance of PSO in complex multimodal problems [27–31]. In the basic PSO, each particle learns fromgbest. Hence, the swarm diversity loses easily in the initial evolutionary process. Zhou et al. [27] developed a random position PSO (RPPSO). In [27], if the randomly generated number is smaller than the acceptance probability, a random position is used to guide the particle. Liang et al. [28] proposed a comprehensive learning PSO (CLPSO) in which each particle can select itspbest or other’spbest as the learning exemplar according to the given probability. Li et al. [29] developed a self-learning PSO which contains four learning strategies: exploitation, jumping out, exploration, and convergence. Huang et al. [30] proposed an example-based learning PSO (ELPSO) algorithm that uses multiple global best positions as elite examples to retain the swarm diversity. Chen et al. [31] proposed a PSO with an aging leader and challengers (ALC-PSO). In [31], an aging mechanism is designed to promote a suitable leader to lead the evolution of the swarm.Multiswarm PSO (MS-PSO) [32–36] is developed to maintain the balance of the exploration/exploitation search. In a homogenous MS-PSO, each swarm adopts a similar learning strategy. On the contrary, each swarm uses different learning strategy to implement the different search task in a heterogeneous MS-PSO. Niu et al. [32] presented a multiswarm cooperative optimizer (MCPSO) where the population consists of a master swarm and several slave swarms. Each slave swarm searches the better solution independently, while the master swarm collects the best particles from the slaves to refine the global optimization. Sun and Li [33] presented a two-swarm cooperative PSO (TCPSO) where one swarm is used to concentrate around the local optimum and accelerate the convergence, and the particles of the other one are dispersed around the search interval to keep the diversity.Local topological structures and dynamical exemplar strategies can keep the swarm diversity to efficiently prevent the premature convergence, but the convergence rate is slow. The heterogeneous multiswarm method is powerful in balancing the local search and the global search by taking advantage of different learning strategies of the subswarms. In this method, it is important to design learning strategies which directly influence the performance of the algorithm. In order to develop efficient learning strategies, this paper analyzes the motion behavior of the swarm based on the probability characteristic of the learning parameters. Meanwhile, we point out that the probability characteristic of the learning parameters has an influence on the search space of the particles. Then, we propose a PSO with double learning patterns (PSO-DLP) to improve both the convergence rate and the accuracy of PSO. PSO-DLP adopts the master swarm and the slave swarm to obtain a good balance between the exploitation and exploration search. The master swarm is used in the exploration search, and the slave swarm is employed to carry out the exploitation search and to accelerate the convergence. The two swarms fulfill their tasks by adjusting the probability characteristics of the learning parameters. An interaction mechanism between two swarms is developed, which can help the slave swarm in jumping out of the premature convergence and improve the convergence precision of the master swarm. The simulation results show that PSO-DLP has powerful ability of global search and fast convergence speed. Experimental studies on 20 well-known benchmark functions show that the proposed PSO-DLP obtains a promising performance in terms of the accuracy and the convergence speed.The rest of this paper is organized as follows. Section2 describes the basic PSO. Section 3 presents the behavior analysis of the basic PSO. Section 4 presents the methodologies of PSO-DLP in detail. Section 5 provides the experimental settings and the results. Finally, Section 6 concludes this work.


## 2. Basic PSO

PSO is a population-based algorithm, which consists of a group of particles. Each particlei is represented by two vectors, namely, a position vector Xi=(Xi1,Xi2,…,XiD) and a velocity vector Vi=(Vi1,Vi2,…,ViD). The position of each particle in the search space is treated as a potential solution. Each particle i updates its velocity and position with the following equations: (1)Vidt+1=wVidt+c1r1tPbidt-Xidt+c2r2tGbdt-Xidt(2)Xidt+1=Xidt+Vidt+1,where Xid(t+1) and Vid(t+1) represent the dth dimension of the position and the velocity of particle i at the (t+1)th iteration. Pbi=(Pbi1,Pbi2,…,PbiD) (pbest) is the personal best experience of the ith particle and Gb=(Gb1,Gb2,…,GbD) (gbest) is the group best experience found by the whole swarm. w is an inertia weight; c1 and c2 are acceleration coefficients reflecting the weighting of the stochastic acceleration terms that pull each particle towardpbest andgbest, respectively. Random factors r1 and r2 are two independent random numbers in the range of [0,1].The first item of (1) (i.e., wVid) is the previous velocity, which provides the necessary momentum for particles to roam around the search space. The second item (i.e., c1r1(Pbid-Xid)), known as the “cognitive’’ component, represents the personal thinking of each particle. The cognitive component encourages the particles to move towardspbest. The third item (i.e., c2r2(Gbd-Xid)), regarded as the “social’’ component, expresses the collaborative effect of the particles in finding the global optimal solution. The social component always pulls the particles togbest.


## 3. Behavior Analysis of PSO

In the basic PSO, each particle toward the optimum solution is guided by the cognitive component and the social component. Therefore, proper control of these two components is very important to find the optimum solution accurately and efficiently [3]. Hence, researchers have proposed various strategies, such as the linearly varying acceleration coefficients [3], the nonlinearly varying acceleration coefficients [9–11], and the time-varying acceleration coefficients with the evolutionary state [16, 17]. In addition, Krohling [14] presented a Gaussian PSO in which random factors and acceleration coefficients are instead of the two positive random numbers generated according to the Gaussian distribution. Similar to the Gaussian PSO, Richer and Blackwell [15] introduced the Lèvy distribution to replace the uniform distribution of random factors. The previous works show that the setting of acceleration coefficients and the probability distribution of random factors can affect the performance of PSO.In order to facilitate the analysis, the velocity updating equation needs to be transformed. Substituting (1) into (2), we obtain(3)Xidt+1=Xidt+c1r1tPbidt-Xidt+c2r2tGbdt-Xidt+wVidt.According to (3), we can also write(4)Xidt+1=Xidt+wVidt+c1+c2c1r1c1+c2+c2r2c1+c2c1r1Pbidtc1r1+c2r2+c2r2Gbdtc1r1+c2r2-Xidt.Let k=c1/(c1+c2). Then (4) can be simplified as follows:(5)Xidt+1=Xidt+wVidt+c1+c2kr1+1-kr2kr1Pbidtkr1+1-kr2+1-kr2Gbdtkr1+1-kr2-Xidt.Let Df=kr1+(1-k)r2 and   Lf=kr1/(kr1+(1-k)r2); then from (5), we get(6)Xidt+1=Xidt+c1+c2DfLfPbidt+1-LfGbdt-Xidt+wVidt,where Df and Lf are functions with respect to the random factors r1, r2 and the undetermined parameter k. Hence Df and Lf are correlative random variables in [0,1]. From (6), the movement of the particles from the tth iteration to the (t+1)th iteration can be divided into two parts. The particles firstly enter into a search space, defined by the second term of (6), and then make an inertia motion decided by the third term. Let Pu=LfPbid(t)+1-LfGbd(t), where Pu is a point on the line connected by Pbid(t) and Gbd(t). Given a fixed Lf, the term (Pu-Xid(t)) represents a line segment from Xid(t) to Pu, namely, one-step search space. The acceleration coefficient and the variable Df can influence the size of the one-step search space, and Df can also decide the distribution of the location of particles in this space. The variable Lf is the weighting coefficient, which reflects the differences of exploitation ofpbest andgbest. When Lf=1, the particle learns frompbest; when Lf=0, the particle learns fromgbest. Variables Lf and Df are the learning factor and the distribution factor.In order to analyze the effect of the two factors on the one-step search space, we need to calculate the probabilistic characteristics of the factors. Considering a general situation, that is,c1=c2 (i.e., k=0.5), we obtain(7)Lf=r1r1+r2Df=0.5r1+0.5r2.r
1 and r2 are two independent uniform random numbers in the range of [0,1]. Hence we calculate the density function (fLf(lf)) of the learning factor and the joint density (f(df,lf)) of the learning factor and the distribution factor (see the Appendix). The density function fLf(lf) and the joint density f(df,lf) are given by(8)
f
L
f
l
f
=
1
2
1
-
l
f
2
,
0
≤
l
f
<0.5
1
2
l
f
2
,
0.5
≤
l
f
≤
1
<0.5
0
,
other
(9)
f
d
f
,
l
f
=
4
d
f
,
0
≤
d
f
≤
1
,
max
⁡
0,1
-
1
2
d
f
≤
l
f
≤
min
⁡
1
,
1
2
d
f
0
,
other.Using (8) and (9), we can calculate fDf∣Lfdf∣lf the conditional probability density of Df given Lf:(10)fDf∣Lfdf∣lf=8df1-lf2,0≤lf<12,0≤df<121-lf8dflf2,12≤lf<1,0≤df<12lf.We can see from (8) that f(lf) is a unimodal function and it is symmetrical at Lf equal to 0.5 (Figure 1(a)). If the interval of the learning factor is divided into three smaller ones, that is, (0, 0.25), (0.25, 0.75), and (0.75, 1), the probability of the learning factor lying in the interval [0,0.25] is the same as that in interval [0.75,1]. When the learning factor is located in the interval [0,0.25], we consider the particle emphasis on learning fromgbest. If, on the contrary, the learning factor is located in the interval [0.75,1], the particle pays attention to learning frompbest.Figure 1
The probability characteristics of the learning parameters.
(a)
The density function of learning factor
(b)
The relationship betweenLf and DfFrom (10), we can see that the range of the distribution factordepends on the value of the learning factor. The relationship between the learning factor and the distribution factor is shown in Figure 1(b). When the learning factor equals 0.5, the value of the distribution factor ranges from 0 to 1. When the learning factor equals 0 or 1, the value of the distribution factor ranges from 0 to 0.5. If given a fixed Z, fdf∣lf increases with the rising of the distribution factor. This means that the particles tend to the large value of the distribution factor.In the basic PSO, the probability characteristics of the learning factor and the distribution factor may bring forth the clustering of the swarm.(1) During an iteration, each particle emphasizes learning fromgbest with the probability that P(0<lf<0.25)=1/6; at the same time, the value range of the distribution factor is restricted because the learning factor is in the interval of [0,0.25], which means that the one-step space of the particle is lessened. This situation will eventually lead to the swarm clustering move towardgbest. (2) The conditional probability density fdf∣lf of the distribution factor is an increasing function with the increased distribution factor, which means that the particle trends to a “long-distance flying’’ in the one-step space. This flying may accelerate the clustering of the particles. (3) When the learning factor equals 0.5, the value of the distribution factor falls into its maximum range from 0 to 1. But the probability of the learning factor around 0.5 is 0.182, P(0.5-δ<df<0.5+δ)=0.182  (δ=0.05). In other words, the one-step space of the particle is shrunk with the probability of 0.818. All of the above reasons may bring about the quick clustering of the swarm.


## 4. PSO with Double Learning Patterns (PSO-DLP)

In this section, we describe PSO-DLP in detail. According to the analysis of the basic PSO, we know that the probability characteristics of the learning parameters can influence the search behavior of particles. PSO-DLP takes advantage of the probability characteristics of the leaning parameters to achieve the global search.


### 4.1. Learning Patterns

In PSO-DLP, we develop two learning patterns, called a uniform exploration and an enhanced exploitation. And two swarms, namely, a master swarm and a slave swarm, are also employed. The master swarm adopts the uniform exploration to avoid the premature convergence and the slave swarm uses the enhanced exploitation to accelerate the convergence speed.In the uniform exploration learning, we present three novel strategies. Firstly, the learning factor and the distribution factor are independent. The value of the distribution factor varies from 0 to 1, which enlarges the search space of particles efficiently. In the basic PSO, the value of the distribution factor reaches its maximum value of 1 only when the value of the learning factor equals 0.5. Secondly, the distribution factor is subject to the uniform distribution in[0,1], which is beneficial for preserving the swarm diversity. Thirdly, the learning factor decreases with iteration, which helps the particles in emphasizing the exploration in the earlier stage of the evolution and enhancing the convergence in the later stage. For particle i in the master swarm, its velocity Vim is updated as follows:(11)Vidmt+1=wVidmt+c1m+c2mDfmLfm·Pbidmt+1-LfmGbdmt-Xidmt(12)fLfmlfm=1,0≤lfm<10,other(13)Lfm=Lf,maxm-Lf,maxm-Lf,minmiteritermax,where Lf,maxm=1, Lf,minm=0; iter  is the number of fitness evaluations (FEs); and itermax is the maximum FEs defined by the user. Gbm is thegbestof the master swarm.The purpose of the enhanced exploitation learning is to make the search focus on a region for refining a promising solution. In this pattern, the learning factor and the distribution factor are independent. The learning factor is a uniform random number in [0, 0.5], which can make the search concentrate aroundgbest. The distribution factor is also a random number generated in the interval of [0,0.5] uniformly, which shrinks the search space to accelerate the convergence.For particlei in the master swarm, its velocity Vi updates as follows:(14)Vidst+1=wVidst+c1s+c2sDfsLfs·Pbidst+1-LfsGbdst-Xidst(15)fLfslfs=2,0≤lfs<0.50,other(16)fDfsdfs=2,0≤dfs<0.50,other,where Gbs is thegbestof the slave swarm.


### 4.2. Interaction between Swarms

In PSO-DLP, two learning patterns play different roles in the evolutionary process. The master swarm is used for the global search, while the slave swarm is employed for the local search. But particles in the slave swarm get easily trapped in the local optima. To improve the convergence precision of the slave swarm, the interaction between two swarms is necessary. This interaction is unidirectional and the information flow is from the master swarm to the slave swarm. Particles in the master swarm do not receive information from the slave swarms in order to keep the ability to perform the global search. When the best particle(Gbs) in the slave swarm is not improved from L successive FEs or the fitness value of Gbs is less than the one of the best particle (Gbm) in the slave swarm (the higher the fitness value, the better the performance of the particle), particles in the slave swarm can learn from the best particle in the master swarm (Gbm)  (Gbs=Gbm). Too small values and too large ones of L are not desirable, as the former tends to weaken the exploitation capability of particles in the slave swarm and the latter leads to wasting computation resources (as the slave swarm may suffer from the premature convergence). In this study, we set L=50.


### 4.3. PSO-DLP Procedure

PSO-DLP is developed based on the two learning patterns and the interaction between the swarms discussed above. The pseudocode of the PSO-DLP is given in Algorithm1. As no additional operation is introduced into PSO-DLP, the computational complexity and the storage memory are the same as the basic PSO. Therefore, PSO-DLP keeps the simplicity of the basic PSO.Algorithm 1
Particle swarm optimization with double learning patterns.
Input:
Master swarm size (Nm), slave swarm size (Ns), the dimensionality of the problem space
(D), maximum number of fitness evolution (iterMax), objective function (f)
(1) Randomly initialize the positionXim and velocity Vim of all particles in the master swarm.
(2) Randomly initialize the positionXis and velocity Vis of all particles in the slave swarm.
(3) Calculate the fitness values ofXm and Xs,
(4) SetXm and Xs to be Pbm=(Pb1m,Pb2m,…,PbNmm) and Pbs=(Pb1s,Pb2s,…,PbNss) for each
particle of the master swarm and slave swarm, respectively.
(5) Set the particle with the best fitness of the master swarm to beGbm, and set the particle
with the best fitness of the slave swarm to be Gbs.
(6) Set generationk=0, the counter fj=0.
(7)while  k ≤ iterMax  do
(8)for  i=1:Nm  do
(9)for  d=1:D  do
(10)Update the dimensional velocity Vi,dm according to (11), and Update the dimensional
position Xi,dm according to (2).
(11)end for
(12)Calculate the fitness value f(Xim);
(13)if  f(Xim)<f(Pbim)  then
(14)  Pbim=Xim; f(Pbim)=f(Xim);
(15)  if  f(XiM)<f(Gbm)  then
(16)   Gbm=Xim; f(Gbm)=f(Xim);
(17)  end if
(18)end if
(19)end for
(20)for  i=1:Ns  do
(21)for  d=1:D  do
(22)Update the dimensional velocity Vi,ds according to (14), and Update the dimensional
position Xi,ds according to (2);
(23)end for
(24)Calculate the fitness value f(Xis);
(25)if  f(Xis)<f(Pbis)  then
(26)  Pbis=Xis;  f(Pbis)=f(Xis);
(27)  if  f(Xis)<f(Gbs)  then
(28)   Gbis=Xis; f(Gbis)=f(Xis); fj=0;
(29)  else
(30)   fj=fj+1;
(31)  end if
(32)end if
(33)end for
(34)if  fj==L  then
(35)Gbs=Gbm;
(36)end if
(37)k=k+1;
(38)end while
(39) Set the global best positionGb=min⁡(Gbs,Gbm)
(40)return  Gb


## 4.1. Learning Patterns

In PSO-DLP, we develop two learning patterns, called a uniform exploration and an enhanced exploitation. And two swarms, namely, a master swarm and a slave swarm, are also employed. The master swarm adopts the uniform exploration to avoid the premature convergence and the slave swarm uses the enhanced exploitation to accelerate the convergence speed.In the uniform exploration learning, we present three novel strategies. Firstly, the learning factor and the distribution factor are independent. The value of the distribution factor varies from 0 to 1, which enlarges the search space of particles efficiently. In the basic PSO, the value of the distribution factor reaches its maximum value of 1 only when the value of the learning factor equals 0.5. Secondly, the distribution factor is subject to the uniform distribution in[0,1], which is beneficial for preserving the swarm diversity. Thirdly, the learning factor decreases with iteration, which helps the particles in emphasizing the exploration in the earlier stage of the evolution and enhancing the convergence in the later stage. For particle i in the master swarm, its velocity Vim is updated as follows:(11)Vidmt+1=wVidmt+c1m+c2mDfmLfm·Pbidmt+1-LfmGbdmt-Xidmt(12)fLfmlfm=1,0≤lfm<10,other(13)Lfm=Lf,maxm-Lf,maxm-Lf,minmiteritermax,where Lf,maxm=1, Lf,minm=0; iter  is the number of fitness evaluations (FEs); and itermax is the maximum FEs defined by the user. Gbm is thegbestof the master swarm.The purpose of the enhanced exploitation learning is to make the search focus on a region for refining a promising solution. In this pattern, the learning factor and the distribution factor are independent. The learning factor is a uniform random number in [0, 0.5], which can make the search concentrate aroundgbest. The distribution factor is also a random number generated in the interval of [0,0.5] uniformly, which shrinks the search space to accelerate the convergence.For particlei in the master swarm, its velocity Vi updates as follows:(14)Vidst+1=wVidst+c1s+c2sDfsLfs·Pbidst+1-LfsGbdst-Xidst(15)fLfslfs=2,0≤lfs<0.50,other(16)fDfsdfs=2,0≤dfs<0.50,other,where Gbs is thegbestof the slave swarm.


## 4.2. Interaction between Swarms

In PSO-DLP, two learning patterns play different roles in the evolutionary process. The master swarm is used for the global search, while the slave swarm is employed for the local search. But particles in the slave swarm get easily trapped in the local optima. To improve the convergence precision of the slave swarm, the interaction between two swarms is necessary. This interaction is unidirectional and the information flow is from the master swarm to the slave swarm. Particles in the master swarm do not receive information from the slave swarms in order to keep the ability to perform the global search. When the best particle(Gbs) in the slave swarm is not improved from L successive FEs or the fitness value of Gbs is less than the one of the best particle (Gbm) in the slave swarm (the higher the fitness value, the better the performance of the particle), particles in the slave swarm can learn from the best particle in the master swarm (Gbm)  (Gbs=Gbm). Too small values and too large ones of L are not desirable, as the former tends to weaken the exploitation capability of particles in the slave swarm and the latter leads to wasting computation resources (as the slave swarm may suffer from the premature convergence). In this study, we set L=50.


## 4.3. PSO-DLP Procedure

PSO-DLP is developed based on the two learning patterns and the interaction between the swarms discussed above. The pseudocode of the PSO-DLP is given in Algorithm1. As no additional operation is introduced into PSO-DLP, the computational complexity and the storage memory are the same as the basic PSO. Therefore, PSO-DLP keeps the simplicity of the basic PSO.Algorithm 1
Particle swarm optimization with double learning patterns.
Input:
Master swarm size (Nm), slave swarm size (Ns), the dimensionality of the problem space
(D), maximum number of fitness evolution (iterMax), objective function (f)
(1) Randomly initialize the positionXim and velocity Vim of all particles in the master swarm.
(2) Randomly initialize the positionXis and velocity Vis of all particles in the slave swarm.
(3) Calculate the fitness values ofXm and Xs,
(4) SetXm and Xs to be Pbm=(Pb1m,Pb2m,…,PbNmm) and Pbs=(Pb1s,Pb2s,…,PbNss) for each
particle of the master swarm and slave swarm, respectively.
(5) Set the particle with the best fitness of the master swarm to beGbm, and set the particle
with the best fitness of the slave swarm to be Gbs.
(6) Set generationk=0, the counter fj=0.
(7)while  k ≤ iterMax  do
(8)for  i=1:Nm  do
(9)for  d=1:D  do
(10)Update the dimensional velocity Vi,dm according to (11), and Update the dimensional
position Xi,dm according to (2).
(11)end for
(12)Calculate the fitness value f(Xim);
(13)if  f(Xim)<f(Pbim)  then
(14)  Pbim=Xim; f(Pbim)=f(Xim);
(15)  if  f(XiM)<f(Gbm)  then
(16)   Gbm=Xim; f(Gbm)=f(Xim);
(17)  end if
(18)end if
(19)end for
(20)for  i=1:Ns  do
(21)for  d=1:D  do
(22)Update the dimensional velocity Vi,ds according to (14), and Update the dimensional
position Xi,ds according to (2);
(23)end for
(24)Calculate the fitness value f(Xis);
(25)if  f(Xis)<f(Pbis)  then
(26)  Pbis=Xis;  f(Pbis)=f(Xis);
(27)  if  f(Xis)<f(Gbs)  then
(28)   Gbis=Xis; f(Gbis)=f(Xis); fj=0;
(29)  else
(30)   fj=fj+1;
(31)  end if
(32)end if
(33)end for
(34)if  fj==L  then
(35)Gbs=Gbm;
(36)end if
(37)k=k+1;
(38)end while
(39) Set the global best positionGb=min⁡(Gbs,Gbm)
(40)return  Gb


## 5. Experimental Setup and Simulation Results

### 5.1. Benchmark Functions

The 20 scalable benchmark functions are used to investigate the performance of the proposed algorithm, including unimodal functions, multimodal functions, rotated functions, and shifted functions. These functions are widely adopted in [3, 8–13, 19–40]. These problems are minimization problems and the expressions of the functions are given in Table 1. The shifting and rotating methods used in the test functions are from [28, 39]. In Table 1, M denotes the orthogonal matrix, and o denotes the shifted global optimum and fbias denotes the shifted fitness value. All functions are evaluated with 30 variables.Table 1
Benchmark functions used in this paper.
Number
Description and expression
Search space
ε
F
(
X
∗
)
Group 1: conventional problems
F
1
SphereF1(x)=∑i=1Dxi2
[−100, 100]D
10−6
0
F
2
Schwefel’s function 1.2F2(x)=∑i=1D(∑k=1ixk)2
[−100, 100]D
10−6
0
F
3
Noise quadricF3(x)=∑i=1Dixi4+random(0,1)
[−1.28, 1.28]D
10−2
0
F
4
RosenbrockF4=∑i=1D[100(xi+1-xi2)2+(xi-1)2]
[−10, 10]D
10−2
0
F
5
AckleyF5(x)=-20exp⁡-0.2(∑i=1Dxi2)/D-exp⁡((∑i=1Dcos(2πxi))/D)+20+e
[−32.768, 32.768]D
10−6
0
F
6
GriewankF6(x)=∑i=1Dxi2/4000-∏i=1Dcos⁡(xi/i)+1
[−600, 600]D
10−6
0
F
7
RastriginF7(x)=∑i=1D(xi2-10cos⁡(2πxi)+10)
[−5.12, 5.12]D
10−6
0
F
8
Noncontinuous RastriginF8(x)=F7(y)  (yi=xi,xi<0.5;round(2xi)/2,|xi|≥0.5)
[−5.12, 5.12]D
10−6
0
F
9
Expanded SchafferF9x=∑i=1D-1yxi,xi+1+yxD,x1 y(u,v)=0.5+(sin2⁡(u2+v2)-0.5)/(1+0.001(u2+v2))2
[−100, 100]D
10−6
0
Group 2: rotated problems
F
10
Rotated RosenbrockF10(xi)=F4(qi), qi=M∗xi, M is an orthogonal matrix
[−10, 10]D
10
0
F
11
Rotated AckleyF11(xi)=F5(qi), qi=M∗xi
[−32.768, 32.768]D
10
0
F
12
Rotated GriewankF12(xi)=F6(qi), qi=M∗xi
[−600, 600]D
10
0
F
13
Rotated RastriginF13(xi)=F7(qi), qi=M∗xi
[−5.12, 5.12]D
10
0
F
14
Rotated noncontinuous RastriginF14(xi)=F8(qi), qi=M∗xi
[−5.12, 5.12]D
10
0
Group 3: shifted problems
F
15
Shifted SphereF15(xi)=F1(qi)+fbias1, qi=xi-o, fbias1=-450
[−100, 100]D
10−6
−450
F
16
Shifted RosenbrockF16(xi)=F4(qi)+fbias2, qi=xi-o, fbias2=390
[−10, 10]D
10−6
390
F
17
Shifted RastriginF17(xi)=F7(qi)+fbias4, qi=xi-o, fbias4=-330
[−5.12, 5.12]D
10−6
−330
F
18
Shifted non-RastriginF18(xi)=F8(qi)+fbias5, qi=xi-o, fbias5=-330
[−5.12, 5.12]D
10−6
−330
F
19
Shifted rotated Ackley’s function with global optimum on bounds
[−32.76, 32.76]D
10−6
−140
F
20
Shifted rotated Rastrigin’s function
[−5.12, 5.12]D
10−6
−330


### 5.2. Parameter Settings for the Involved PSO Variants

For the comprehensive comparison with PSO-DLP, eight PSO variants are employed in this paper. They are PSO-W [8], HPSO [3], FIPS [25], CLPSO [28], SPSO [26], HEPSO [22], COMPSO [32], and TS-CPSO [33]. The parameter settings of each peer algorithm are extracted from the corresponding literatures and they are given in Table 2.Table 2
Parameter settings of algorithms used in the comparisons.
Algorithm
Year
Population  topology
Parameter  settings
PSO-LDIW
1998
Fully  connected
ω: 0.9–0.4, c1=c2=2.0
HPSO
2004
Fully  connected
ω: 0.9–0.4, c1: 2.5–0.5, c2: 0.5–2.5
FIPSO
2004
Local Ring
λ
=
0.729, Σci=4.1
CLPSO
2006
Comprehensive  learning
ω: 0.9–0.4, c=2.0, m=7
SPSO
2007
Local Ring
ω
=
0.729, c1=c2=1.193
COMPSO
2007
Multiswarm (fully connected)
ω: 0.9–0.4, c1s=c2s=2.05, c1M=c2M=c3M=2
HEPSO
2014
Fully  connected
ω: 0.9–0.4, c1: 2.5−0.5, c2: 0.5−2.5, Pc=0.95, Pb=0.02
TS-COMPSO
2014
Multiswarm (fully  connected  and  local  ring)
ω
M
=
0.9, c1s=c2s=3.4, c1M=c2M=c3M=4.5
CMA-ES
2007
—
σ
=
0.25, μ=(4+2log⁡(N))/2
SADE
2009
—
F
~
N
(
C
R
,
0.3
), CR~N(CRm,0.1), CR0=0.5, LP=50
JADE
2009
—
p
=
0.05, c=0.1
PSO-DLP
—
Multiswarm (fully connected)
ω: 0.9–0.3, c1s=c2s=c1m=c2m=2.0, L=50The swarm size is set to 40 [28] for eight algorithms expect for COMPSO. For COMPSO, the population size is set at 80, as the suggestion proposed by its author. COMPSO has four subswarms, and TS-CPSO and PSO-DLP have two subswarms. In the three algorithms, each subswarm has the same size which is set to 20. To ensure a fair comparison, the maximum number of fitness evaluations (FEs) is set at 1.00E+5. Each algorithm was run 30 times independently to reduce random discrepancy.


### 5.3. Performance Metrics

In this study, we adopted the fitness mean (Fm), success rate (SR), and success performance (SP) to assess the accuracy, the reliability, and the efficiency of PSO, respectively [39]. Fm is the mean difference f(x)-f(x∗) between the best fitness value of the algorithm and the global optimum (x∗ and x represent the global solution and the best solution found by an algorithm, resp.). SR denotes the consistency of an algorithm to achieve the solution with a predefined ε. SP denotes the number of FEs required by an algorithm to solve the problem with a predefined ε. The Wilcoxon test [41, 42] is applied to perform pairwise comparison between PSO-DLP and its peers. The confidence level is fixed at 0.95. If the performance of PSO-DLP is better than its peer, the h value is denoted by “+’’; if the h value is “=’’ or “−’’, this indicates that the performance of PSO-DLP is almost the same as or is significantly worse than its peers, respectively. The average ranking can be calculated to undertake multiple comparisons [41, 42].


### 5.4. Parameter Sensitivity Analysis

The effect of parameterL on the performance of PSO-DLP was investigated. The seven benchmarks are selected, namely, F1, F4, F7, F8, F10, F12, F14, and F17. The L value of PSO-DLP was set to an integer value varying from 10 to 100. Table 3 presents the mean values and the standard deviation obtained by PSO-DLP with different L.Table 3
Effects of the parameterL on PSO-DLP in 30-D.
Fm
L
=
10
L
=
20
L
=
30
L
=
40
L
=
50
L
=
60
L
=
70
L
=
80
L
=
90
L
=
100
F
1
SD
2.80E − 191
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
Fm
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
F
4
SD
7.97E − 17
7.57E − 17
8.07E − 18
7.97E − 17
2.01E − 19
3.04E − 19
7.97E − 17
7.97E − 17
8.27E − 17
8.05E − 17
Fm
1.17E − 17
2.10E − 17
3.05E − 18
2.00E − 17
6.19E − 19
2.33E − 19
2.01E − 17
1.02E − 17
2.31E − 17
5.01E − 17
F
7
SD
5.90E − 13
4.76E − 14
3.55E − 16
1.06E − 15
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
1.59E − 14
1.17E − 14
Fm
1.28E − 12
1.04E − 13
7.94E − 16
2.38E − 15
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
2.43E − 14
7.53E − 15
F
8
SD
1.93E − 13
6.82E − 14
2.84E − 15
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
3.19E − 15
4.28E − 15
Fm
2.67E − 13
1.48E − 13
4.08E − 15
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
7.14E − 15
1.56E − 15
F
10
SD
1.71E + 00
1.71E + 00
1.19E + 00
7.46E − 01
2.00E − 01
2.01E − 01
2.87E − 01
1.72E + 00
1.09E + 00
1.94E + 00
Fm
1.10E + 00
2.10E + 00
1.54E + 00
1.53E − 01
2.83E  − 01
2.93E  − 01
1.86E  − 01
1.55E + 00
1.72E + 00
1.91E + 00
F
12
SD
7.90E − 03
7.90E − 03
5.40E − 03
7.40E − 03
3.70E − 03
3.70E − 03
1.08E − 02
4.90E − 03
6.94E − 03
5.91E − 03
Fm
5.11E − 03
1.39E − 03
8.60E − 03
7.00E − 03
5.23E − 03
5.23E − 03
1.01E − 02
7.00E − 03
9.60E − 03
5.70E − 03
F
14
SD
3.48E + 01
3.56E + 01
3.02E + 01
2.65E + 01
2.55E + 01
2.55E + 01
2.92E + 01
2.98E + 01
2.56E + 01
2.60E + 01
Fm
4.02E + 00
8.08E + 00
7.22E + 00
4.60E + 00
1.34E + 01
1.54E + 01
5.97E + 00
3.56E + 00
6.58E + 00
9.87E + 00
F
17
SD
5.68E − 14
5.11E − 14
5.11E − 14
5.11E − 14
1.27E − 14
1.54E − 14
1.97E − 14
3.97E − 14
4.54E − 14
3.41E − 14
Fm
0.00E + 00
1.27E − 14
1.27E − 14
1.27E − 14
1.48E − 13
1.55E − 14
1.57E − 14
1.55E − 14
1.55E − 14
1.27E − 14From Table3, we can see that the experimental results of functions F1 and F4 decrease with the increasing of L  because F1 and F2 are unimodal and the higher value of L is beneficial to the exploitation search. For multimodal functions F7, F8, F10, F12, F14, and F17, the performance of PSO-DLP tends to deteriorate when L is set too low (i.e., L = 10, 20, and 30) or too high (i.e., L = 90, 100). When L is set too low, the interaction between subswarms is overemphasized such that the slave swarm receives the best solution from the master swarm so frequently that the search of the slave swarm is not sufficient to refine the search. When L is set too high, the interaction between swarms is not enough such that the slave swarm may get into the premature convergence for solving multimodal functions. If the interaction interval L is long, the master swarm could not help the slave swarm in getting out of the local optimum. From the above experimental findings, the parameter value of L at 50 had the promising performance of PSO-DLP. Hence, this parameter setting was adopted in the following experiments.


### 5.5. Experimental Results and Discussions

#### 5.5.1. Comparison among the Fm Results

Table4 presents the results of the fitness means Fm and standard deviation SD of the nine algorithms on the conventional problems, rotated problems, and shifted problems. The best results among the nine algorithms are shown in bold.Table 4
Experimental result comparisons among nine PSOs.
PSO-W
SPSO
CLPSO
HPSO
FIPS
HEPSO
TS-CPSO
COMPSO
PSO-DLP
F
1
Fm
1.34E − 117
8.86E − 97
3.35E − 87
5.87E − 322
5.66E − 05
0.00E + 00
5.92E − 322
1.48E − 323
0.00E + 00
SD
2.16E − 116
1.86E − 96
5.37E − 87
2.18E − 322
9.24E − 06
0.00E + 00
4.09E − 322
1.87E − 323
0.00E + 00
h
+
+
+
=
+
+
=
=
F
2
Fm
1.41E − 45
5.29E − 02
4.48E − 07
7.61E − 53
1.56E − 02
4.81E − 43
3.96E − 09
2.92E − 47
3.00E − 86
SD
1.47E − 45
3.47E − 02
2.26E − 07
1.68E − 52
8.60E − 02
2.48E − 43
5.33E − 09
5.89E − 47
4.25E − 86
h
+
+
+
+
+
+
+
+
F
3
Fm
2.34E − 03
5.62E − 03
3.50E − 03
3.10E − 03
4.50E − 03
1.61E − 03
9.43E − 03
1.21E − 03
2.05E − 04
SD
9.83E − 04
1.61E − 03
8.73E − 04
2.40E − 03
1.30E − 03
6.15E − 04
4.80E − 03
4.60E − 04
1.24E − 05
h
+
+
+
+
+
+
+
+
F
4
Fm
2.53E + 01
2.25E + 01
1.40E + 01
2.89E + 00
2.02E + 01
1.36E + 01
7.71E − 02
9.806E − 01
2.01E − 19
SD
1.81E + 00
3.76E + 00
3.50E + 00
4.03E + 00
2.30E − 01
2.194E + 00
3.87E − 02
2.19E + 00
6.19E − 19
h
+
+
+
+
+
+
+
+
F
5
Fm
7.11E − 15
5.68E − 15
7.10E − 15
7.10E − 15
7.54E − 05
0.00E + 00
3.34E − 13
4.97E − 15
7.11E − 15
SD
0.00E + 00
1.94E − 15
0.00E + 00
0.00E + 00
2.47E − 06
0.00E + 00
3.45E − 13
1.94E − 15
0.00E + 00
h
=
=
=
=
=
=
+
=
F
6
Fm
7.39E − 03
1.04E − 14
0.00E + 00
1.47E − 02
1.02E − 04
0.00E + 00
2.65E − 02
5.30E − 03
0.00E + 00
SD
1.05E − 02
1.47E − 14
0.00E + 00
2.08E − 02
5.19E − 05
0.00E + 00
1.46E − 02
7.30E − 03
0.00E + 00
h
+
+
+
+
+
=
+
+
F
7
Fm
2.12E + 01
1.31E + 01
1.15E − 14
1.50E − 12
8.98E + 02
0.00E + 00
1.42E − 15
1.65E + 01
0.00E + 00
SD
1.02E + 01
1.25E + 01
3.63E − 15
3.20E − 12
8.17E + 01
0.00E + 00
1.48E − 15
3.19E + 00
0.00E + 00
h
+
+
+
+
+
=
=
+
F
8
Fm
2.37E + 01
3.97E + 01
4.85E − 10
2.00E − 01
7.36E + 01
9.93E − 13
1.20E + 00
1.34E + 01
0.00E + 00
SD
1.45E + 01
4.48E + 00
2.44E − 10
4.47E − 01
1.42E + 01
5.67E − 13
1.09E + 00
1.34E + 00
0.00E + 00
h
+
+
+
+
+
=
+
+
F
9
Fm
1.27E + 00
2.36E + 00
2.59E + 00
1.25E + 00
9.07E + 00
1.31E + 00
7.03E + 00
2.18E + 00
6.87E − 01
SD
4.43E − 01
5.21E − 01
5.53E − 01
1.75E − 01
9.10E − 02
3.33E − 01
1.43E − 01
4.36E − 01
3.60E − 01
h
+
+
+
+
+
+
+
+
F
10
Fm
2.51E + 01
2.55E + 01
2.09E + 01
2.57E + 01
2.17E + 01
1.35E + 01
1.70E + 01
9.65E + 00
2.00E − 01
SD
2.14E + 01
1.48E + 01
4.05E + 01
2.79E + 01
4.94E − 02
7.16E + 00
1.80E + 00
5.14E + 00
2.83E − 01
h
+
+
+
+
+
+
+
+
F
11
Fm
1.34E + 00
7.11E − 15
1.05E − 13
1.20E + 00
7.56E − 05
3.61E − 12
1.92E + 00
1.48E + 00
7.11E − 15
SD
3.14E − 01
0.00E + 00
2.13E − 14
7.42E − 01
3.85E − 06
8.02E − 12
2.97E − 01
5.52E − 01
0.00E + 00
h
+
=
+
+
+
+
+
+
F
12
Fm
3.93E − 02
1.30E − 06
8.13E − 10
4.12E − 02
6.03E − 05
0.00E + 00
1.28E − 02
2.16E − 02
3.70E − 03
SD
3.81E − 02
2.88E − 06
1.01E − 11
2.30E − 02
2.81E − 06
0.00E + 00
1.36E − 02
3.03E − 02
5.23E − 03
h
+
−
−
+
−
−
+
+
F
13
Fm
5.17E + 01
5.59E + 01
3.46E + 01
5.51E + 01
1.59E + 02
2.89E + 01
2.63E + 01
4.29E + 01
2.87E + 01
SD
2.25E + 01
1.80E + 00
3.69E + 00
10.0E + 00
9.76E + 00
5.33E + 00
3.02E + 00
7.42E + 00
3.68E + 00
h
+
+
+
+
+
+
−
+
F
14
Fm
4.05E + 01
5.46E + 01
3.77E + 01
3.78E + 01
1.15E + 02
2.78E + 01
3.22E + 01
4.48E + 01
2.55E + 01
SD
1.48E + 01
8.26E + 00
5.44E + 00
5.40E + 00
13.0E + 01
3.74E + 00
8.07E + 00
8.70E + 00
1.34E + 01
h
+
+
+
+
+
+
+
+
F
15
Fm
5.68E − 14
4.48E − 14
5.68E − 10
4.54E − 14
2.40E + 01
5.01E − 07
5.68E − 14
3.41E − 14
0.00E + 00
SD
0.00E + 00
3.21E − 14
1.23E − 10
2.54E − 14
2.72E + 01
3.23E − 07
1.01E − 14
3.11E − 14
0.00E + 00
h
+
+
+
+
+
+
+
+
F
16
Fm
1.04E + 01
3.03E + 01
1.25E + 01
2.10E + 00
2.02E + 01
4.87E + 01
1.40E − 01
4.26E + 00
1.44E − 09
SD
2.11E + 00
7.93E + 00
8.10E + 00
4.69E + 00
2.64E − 01
1.63E + 00
2.37E − 01
5.20E + 00
3.21E − 09
h
+
+
+
+
+
+
+
+
F
17
Fm
2.41E + 01
1.86E + 01
5.68E − 14
3.58E + 00
1.25E + 02
8.36E + 00
4.58E + 01
1.51E + 01
1.27E − 14
SD
1.19E + 01
1.02E + 01
1.63E − 14
4.19E + 00
3.26E + 01
6.20E + 00
2.25E + 01
3.92E + 00
1.48E − 15
h
+
+
+
+
+
+
+
+
F
18
Fm
2.51E + 01
1.84E + 01
8.68E − 8
4.60E + 00
1.09E + 02
5.75E + 00
3.56E + 02
1.54E + 01
4.55E − 14
SD
1.32E + 01
8.73E + 00
1.83E − 8
3.04E + 00
2.63E + 01
2.29E + 00
4.65E + 02
5.77E + 00
2.54E − 14
h
+
+
+
+
+
+
+
+
F
19
Fm
2.06E + 01
2.08E + 01
2.07E + 01
2.06E + 01
2.09E + 01
2.05E + 01
2.04E + 01
2.08E + 01
2.04E + 01
SD
6.74E − 01
7.57E − 01
4.96E − 01
6.74E − 01
2.20E − 01
4.03E − 01
2.61E − 01
6.51E − 02
6.25E − 02
h
+
+
+
+
+
+
=
+
F
20
Fm
7.78E + 01
9.67E + 01
6.03E + 01
1.89E + 02
4.20E + 01
8.20E + 01
4.01E + 01
6.72E + 01
3.68E + 01
SD
1.38E + 01
2.09E + 01
9.64E + 00
9.88E + 00
8.08E + 00
2.25E + 01
2.13E + 01
1.34E + 01
2.81E + 00
h
+
+
+
+
+
+
+
+From Table4, we obverse that PSO-DLP obtains the best searching accuracy in the eight conventional problems, except for the function F5. To be specific, PSO-DLP finds the global optima of F1, F6, F7, and F8. In addition, PSO-DLP is the only algorithm to achieve the accuracy level of 10−19 for the function F4. For the function F5, COMPSO obtains the best result and PSO-DLP ranks the third.The functions in group 2 (F10–F14) are multimodal functions with coordinate rotations. As can be seen from Table 3, all the algorithms perform worse for the rotated functions than the unrotated counterparts. PSO-DLP performs the best on functions F10, F11, and F14, that is, 3 out of 5 functions, in terms of the Fm. For function F13, TS-CPSO obtains the best fitness value, followed by PSO-DLP.From Table4, we observe that all involved algorithms cannot find the global optima for shifted problems (F15–F18) and complex problems (F19-F20), except for function 15. Function 15 is an easy shifted problem; only PSO-DLP achieves the global optima (Fm=0). PSO-DLP surpasses all other algorithms on the four functions. This implies that PSO-DLP is the least sensitive one to the shifted problem. Complex problems are rotating and shifting operations (F19-F20). PSO-DLP obtains the best solutions on complex functions.


#### 5.5.2. Comparison of Nonparametric Statistical Test Results

The Wilcoxon test results between PSO-DLP and peers are reported in Table4. From the test results, PSO-DLP significantly outperforms all other algorithms on functions F2, F3, F4, F8, F9, F10, F14, F15, F16, F17, F18, and F20. COMPSO performs the best on function F5. For function F5, PSO-DLP and COMPSO do not show significant difference according to their statistical test values. PSO-DLP obtains the global solution on functions F6 and F7. For functions F6 and F7, the performance of HEPSO, TS-CPSO, and CLPSO is almost the same as that of PSO-DLP as the Wilcoxon test results show.To compare the performance of multiple algorithms, we used the average ranking of the Friedman test to evaluate the effectiveness of PSO-DLP comprehensively. The algorithm with the better convergence accuracy is assigned to a smaller rank value. Table5 shows the average ranking of nine PSO variants on functions F1–F20. According to the result of the average ranking, nine algorithms can be sorted into the following order: PSO-DLP, HEPSO, COMPSO, CLPSO, HPSO, TS-CPSO, PSO-W, SPSO, and FIPS. PSO-DLP obtains the best performance.Table 5
Average rankings achieved by Friedman test for the nine PSO algorithms.
Algorithm
Ranking
PSO-W
5.85 (8)
SPSO
6.4 (7)
CLPSO
4.65 (4)
HPSO
5.5 (5)
FIPS
7.3 (9)
HEPSO
3.4 (2)
TS-CPSO
5.15 (6)
COMPSO
4.45 (3)
PSO-DLP
1.5 (
1
)


#### 5.5.3. Comparisons of the SR Value and the SP Value

The SR values and the SP values of all algorithms are shown in Table6. If an algorithm is unable to completely solve the problems, then the value of SR is set at zero (i.e., SR=0) and the value of SP is assigned an infinity value (i.e., SP =“inf”). As shown in Table 6, we observe that PSO-DLP has more superior search reliability among the compared peers. It can completely solve all conventional problems and rotated problems except for functions F9, F13, and F14. For functions F9, F13, and F14, none of the compared algorithms can solve the problem completely at the predefined ε and PSO-DLP can achieve the best result on functions F9 and F14 from Table 3. For the shifted problems, PSO-DLP completely solves four out of six functions at the predefined ε. Meanwhile, none of the algorithms are able to solve functions F19 and F20. Nevertheless, PSO-DLP can obtain the smallest Fm value for functions F19 and F20.Table 6
Comparisons of the SR and the SP among nine PSOs.
PSO-W
SPSO
CLPSO
HPSO
FIPS
HEPSO
TS-CPSO
COMPSO
PSO-DLP
F
1
SR
100
100
100
100
56.00
100
100
100
0.00E + 00
SP
2.17E + 03
5.23E + 04
6.44E + 04
3.45E + 03
INF
3.12E + 04
2.23E + 03
2.47E + 03
2.04E + 03
F
2
SR
100
0.00
93.33
100
0.00
100
100
100
100
SP
8.23E + 04
INF
8.89E + 04
3.68E + 04
INF
3.12E + 04
7.15E + 04
1.12E + 04
2.54E + 04
F
3
SR
100
86.66
90.00
100
83.3
100
90.00
100
100
SP
6.23E + 04
7.48E + 04
4.16E + 04
3.17E + 04
8.33E + 04
3.92E + 04
3.54E + 04
2.57E + 04
1.83E + 04
F
4
SR
0
0
0
0
0
0
0
0
100
SP
INF
INF
INF
INF
INF
INF
INF
INF
4.62E + 04
F
5
SR
100
100
100
100
100
100
100
100
100
SP
4.21E + 04
6.34E + 04
5.84E + 04
2.12E + 04
6.16E + 04
5.52E + 04
9.23E + 03
9.85E + 03
1.51E + 04
F
6
SR
0
100
100
0
0
100
0
0
100
SP
INF
7.56E + 04
3.81E + 04
INF
INF
2.35E + 04
INF
INF
4.15E + 04
F
7
SR
0
0
100
100
0
100
100
0
100
SP
INF
INF
6.14E + 04
5.52E + 04
INF
4.36E + 04
5.74E + 04
INF
4.26E + 04
F
8
SR
0
0
100
0
0
100
0
0
100
SP
INF
INF
9.78E + 04
INF
INF
8.94E + 04
INF
INF
4.85E + 04
F
9
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INF
F
10
SR
0
0
0
0
0
0
0
80.00
100
SP
INF
INF
INF
INF
INF
INF
INF
8.15E + 04
3.27E + 04
F
11
SR
100
100
100
100
100
100
100
100
100
SP
3.85E + 04
4.27E + 04
3.27E + 04
1.32E + 04
6.28E + 04
4.87E + 04
3.75E + 04
3.27E + 04
5.63E + 04
F
12
SR
100
100
100
100
100
100
100
100
100
SP
3.61E + 04
5.78E + 04
2.57E + 04
3.15E + 04
5.27E + 04
3.16E + 04
2.10E + 04
2.18E + 04
1.36E + 04
F
13
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INF
F
14
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INF
F
15
SR
100
100
100
100
0
90.00
100
100
100
SP
4.93E + 04
5.63E + 04
5.63E + 04
5.63E + 04
INF
9.29E + 04
9.08E + 03
1.06E + 04
1.41E + 04
F
16
SR
0
0
0
0
0
0
0
0
100
SP
INF
INF
INF
INF
INF
INF
INF
INF
1.35E + 04
F
17
SR
0
0
100
0
0
0
0
0
100
SP
INF
INF
5.19E + 04
INF
INF
INF
INF
INF
5.04E + 04
F
18
SR
0
0
100
0
0
0
0
0
100
SP
INF
INF
4.55E + 04
INF
INF
INF
INF
INF
8.21E + 04
F
19
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INF
F
20
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INFAs reported in Table6, PSO-DLP can get seven best SP values in conventional problems and rotated problems. The results show that PSO-DLP costs the least computation to solve these problems at the predefined ε. Figure 2 shows the convergence curves of the nine PSO algorithms on all functions. It can be seen that the convergence curves for functions F2, F4, F10, F11, and F20 (Figures 2(b), 2(d), 2(j), 2(k), and 2(t)) show that the PSO-DLP has the competitive convergence speed among its peers. For functions F9, F17, and F18 (Figures 2(i), 2(q), and 2(r)), PSO-DLP converges slowly at the beginning and achieves with fast convergence in later stage of the evolution. Particularly, the convergence speed of PSO-DLP in functions F6, F7, and F8 (Figures 2(f), 2(g), and 2(h)) is significantly faster than its peers in the middle stage of the evolution. Overall, PSO-DLP has better control of the convergence speed and accuracy than the involved PSO variants.Figure 2
Convergence curves of test functions. (a)F1, (b) F2, (c) F3, (d) F4, (e) F5, (f) F6, (g) F7, (h) F8, (i) F9, and (j) F10. Convergence curves of test functions. (k) F11, (l) F12, (m) F13, (n) F14, (o) F15, (p) F16, (q) F17, (r) F18, (s) F19, and (t) F20.
(a)
(b)
(c)
(d)
(e)
(f)
(g)
(h)
(i)
(j)
(k)
(l)
(m)
(n)
(o)
(p)
(q)
(r)
(s)
(t)


#### 5.5.4. Effect of Different Strategies

The proposed PSO-DLP employs two learning patterns: the uniform exploration leaning (UEL) and the enhanced exploitation learning (EEL). To investigate the effects of them, we studied the performance of PSO-W, PSO with UEL (PSO-UEL), PSO with EEL (PSO-EEL), and the complete PSO-DLP. PSO-UEL and PSO-EEL adopt one swarm so that there is no interaction between the subswarms. The Fm values of all involved algorithms are presented in Table7.Table 7
Fm values achieved by PSO-W and PSO-DLP variants in 30-D problems.
PSO-W
PSO-UEL
PSO-EEL
PSO-DLP
F
1
1.34E − 117 ± 2.16E − 116
5.60E − 58 ± 6.46E − 59
5.93E − 323 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
F
2
1.41E − 45 ± 1.47E − 45
4.58E − 10 ± 6.29E − 10
6.94E − 184 ± 0.00E + 00
3.00E − 86 ± 4.25E − 86
F
3
2.34E − 03 ± 9.83E − 04
1.20E − 03 ± 9.43E − 04
4.06E − 03 ± 1.90E − 03
2.05E − 04 ± 1.24E − 05
F
4
2.53E + 01 ± 1.81E + 00
2.28E + 01 ± 6.61E − 01
4.78E − 17 ± 6.08E − 17
2.01E − 19 ± 6.19E − 19
F
5
7.11E − 15 ± 0.00E + 00
2.84E − 14 ± 6.15E − 15
1.18E − 14 ± 4.10E − 15
7.11E − 15 ± 0.00E + 00
F
6
7.39E − 03 ± 1.05E − 02
2.13E − 03 ± 2.09E − 03
6.68E − 02 ± 5.87E − 02
0.00E + 00 ± 0.00E + 00
F
7
2.12E + 01 ± 1.02E + 01
0.00E + 00 ± 0.00E + 00
1.16E + 01 ± 1.52E + 00
0.00E + 00 ± 0.00E + 00
F
8
2.37E + 01 ± 1.45E + 01
0.00E + 00 ± 0.00E + 00
3.33E − 01 ± 5.77E − 01
0.00E + 00 ± 0.00E + 00
F
9
1.27E + 00 ± 4.43E − 01
7.53E − 01 ± 3.43E − 01
1.46E + 00 ± 5.58E − 01
6.87E − 01 ± 3.60E − 01
F
10
2.51E + 01 ± 2.14E + 01
2.37E + 01 ± 2.50E − 01
5.70E − 01 ± 5.22E − 01
2.00E − 01 ± 2.83E − 01
F
11
1.34E + 00 ± 3.14E − 01
3.20E − 14 ± 6.15E − 15
4.47E − 01 ± 7.74E − 01
7.11E − 15 ± 0.00E + 00
F
12
3.93E − 02 ± 3.81E − 02
2.46E − 02 ± 3.64E − 02
1.40E − 02 ± 7.09E − 03
3.70E − 03 ± 5.23E − 03
F
13
5.17E + 01 ± 2.25E + 01
4.21E + 01 ± 6.77E + 00
6.04E + 01 ± 9.56E + 00
2.87E + 01 ± 3.68E + 00
F
14
4.05E + 01 ± 1.48E + 01
2.67E + 01 ± 3.06E + 00
5.40E + 01 ± 2.00E + 00
2.55E + 01 ± 1.34E + 01
F
15
5.68E − 14 ± 0.00E + 00
1.14E − 13 ± 0.00E + 00
7.58E − 14 ± 3.28E − 14
0.00E + 00 ± 0.00E + 00
F
16
1.04E + 01 ± 2.11E + 00
2.27E + 01 ± 5.57E − 01
6.56E − 11 ± 6.74E − 11
1.44E − 09 ± 3.21E − 09
F
17
2.41E + 01 ± 1.19E + 01
1.89E − 13 ± 3.28E − 14
9.62E + 00 ± 5.11E + 00
1.27E − 14 ± 1.48E − 15
F
18
2.51E + 01 ± 1.32E + 01
1.71E − 13 ± 5.68E − 14
5.11E + 00 ± 2.33E + 00
4.55E − 14 ± 2.54E − 14
F
19
2.06E + 01 ± 6.74E − 01
2.04E + 01 ± 1.85E − 01
2.05E + 01 ± 3.63E − 02
2.04E + 01 ±6.25E − 02
F
20
7.78E + 01 ± 1.38E + 01
5.93E + 01 ± 1.14E + 01
9.68E + 01 ± 4.34E + 01
3.68E + 01 ± 2.81E + 00From Table7, PSO-UEL achieves better results than PSO-W on 15 functions, and it successfully solves multimodal functions F7 and F8, which means that PSO-UEL has strong exploration ability. Meanwhile, we observe that PSO-EEL performed well in unimodal functions (F1, F2, F3, and F15) and Rosenbrock functions (F4, F10, and F16), but it fails to solve the other multimodal functions. This observation means that PSO-EEL is easier to be trapped in the local optima for multimodal functions. By integrating the two learning patterns, PSO-DLP obtains excellent performance.


#### 5.5.5. Performance Comparisons between PSO-DLP and Other Evolutionary Algorithms

In this section, we compare PSO-DLP with the covariance matrix adaptation evolution strategy (CMA-ES) [43], self-adaptive DE (SaDE) [44], and adaptive DE with optional external archive (JADE) [45]. The CMA-ES algorithm is a powerful stochastic optimization technique, where the multivariate normal distribution has a mean and a covariance matrix constantly updated during the evolutionary process. Differential evolution (DE) has been shown to be an efficient stochastic search algorithm for solving optimization problems. SaDE provides a mutation strategy pool, where the strategy is adaptively selected according to its previous performance. The JADE is another adaptive DE-variant, where a novel mutation strategy is developed and an external archive is employed to store information of progress direction. Simulation results showed that JADE has competitive performances.Twenty benchmark functions as presented in Table1 are used to test the performance of four algorithms. The parameter values of CMA-ES and DEs are selected according to the recommendations of their respective references, as listed in Table 3. The maximum number of fitness evaluations is set at 1.00E+5 and population size N is set at 40 (N=(4+3log⁡(D)) for CMA-ES) for all algorithms. All functions are tested on 30 dimensions (D=30). All algorithms are run independently 30 times to ensure the fair assessment.The mean (Fm) and the standard deviation (SD) of the results obtained by each algorithm for all algorithms are summarized in Table8. From Table 8, we observed that PSO-DLP has better performance on eleven functions and has the same performance with DEs or CMA-ES on six functions. From the final rank, we can obtain the order of the involved algorithms: PSO-DLP, JADE, CMA-ES, and SADE. PSO-DLP has competitive performance among these algorithms on the tested functions.Table 8
Comparisons between PSO-DLP and other evolutionary algorithms in 30-D problems.
CMA-ES
JADE
SADE
PSO-DLP
F
1
4.83E − 131 ± 4.35E − 131
5.70E − 116 ± 3.19E − 116
4.57E − 81 ± 3.10E + 81
0.00E + 00 ± 0.00E + 00
F
2
1.51E − 26 ± 3.61E − 27
2.84E − 75 ± 3.25E − 76
9.37E − 62 ± 5.44E − 63
3.00E − 86 ± 4.25E − 86
F
3
5.31E − 01 ± 2.50E − 03
5.14E – 04 ± 2.14E − 05
1.12E − 03 ± 6.27E − 04
2.05E − 04 ± 1.24E − 05
F
4
7.43E − 02 ± 3.64E − 03
7.09E − 02 ± 2.54E − 03
1.25E + 01 ± 3.18E + 00
2.01E − 19 ± 6.19E − 19
F
5
7.11E − 15 ± 0.00E + 00
4.45E − 15 ± 3.24E − 15
1.18E − 14 ± 4.10E − 15
7.11E − 15 ± 0.00E + 00
F
6
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
F
7
1.54E + 01 ± 7.04E − 01
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
F
8
1.65E + 01 ± 4.95E + 00
0.00E + 00 ± 0.00E + 00
6.24E − 14 ± 3.54E − 15
0.00E + 00 ± 0.00E + 00
F
9
0.00E + 00 ± 0.00E + 00
7.53E − 01 ± 3.43E − 01
1.46E + 00 ± 5.58E − 01
6.87E − 01 ± 3.60E − 01
F
10
2.88E + 01 ± 2.20E − 02
1.41E + 01 ± 4.31E + 00
2.98E + 01 ± 3.08E + 00
2.00E − 01 ±2.83E − 01
F
11
1.03E + 00 ± 6.07E − 02
7.34E − 15 ± 1.56E − 15
7.11E − 15 ± 0.00E + 00
7.11E − 15 ± 0.00E + 00
F
12
0.00E + 00 ± 0.00E + 00
1.23E − 02 ± 3.98E − 03
8.21E − 03 ± 9.21E − 04
3.70E − 03 ± 5.23E − 03
F
13
3.12E + 01 ± 1.05E − 01
2.81E + 01 ± 3.15E − 01
3.14E + 01 ± 9.56E + 00
2.87E + 01 ± 3.68E + 00
F
14
7.89E + 01 ± 3.58E − 01
2.71E + 01 ± 1.32E + 00
2.86E + 01 ± 3.45E − 01
2.55E + 01 ± 1.34E + 01
F
15
1.77E − 26 ± 5.19E − 27
5.68E − 24 ± 3.42E − 24
4.78E − 23 ± 9.85E − 24
0.00E + 00 ± 0.00E + 00
F
16
1.23E + 00 ± 2.50E − 03
1.02E + 01 ± 1.15E + 00
4.86E + 01 ± 5.78E + 00
1.44E − 09 ± 3.21E − 09
F
17
1.94E + 01 ± 7.74E + 00
1.89E − 14 ± 3.28E − 15
1.62E − 13 ± 1.71E − 14
1.27E − 14 ± 1.48E − 15
F
18
2.14E + 01 ± 6.34E + 00
1.71E − 13 ± 5.68E − 14
2.35E − 13 ± 5.24E − 14
4.55E − 14 ± 2.54E − 14
F
19
2.12E + 01 ± 2.14E − 03
2.09E + 01 ± 1.85E − 01
2.09 + 01 ± 4.61E − 02
2.04E + 01 ±6.25E − 02
F
20
4.87E + 01 ± 1.12E + 01
3.95E + 01 ± 8.35E + 00E
5.67E + 01 ± 3.39E + 00
3.68E + 01 ± 2.81E + 00
Average rank
2.9
2.15
3.25
1.2
Final rank
3
2
4
1


## 5.1. Benchmark Functions

The 20 scalable benchmark functions are used to investigate the performance of the proposed algorithm, including unimodal functions, multimodal functions, rotated functions, and shifted functions. These functions are widely adopted in [3, 8–13, 19–40]. These problems are minimization problems and the expressions of the functions are given in Table 1. The shifting and rotating methods used in the test functions are from [28, 39]. In Table 1, M denotes the orthogonal matrix, and o denotes the shifted global optimum and fbias denotes the shifted fitness value. All functions are evaluated with 30 variables.Table 1
Benchmark functions used in this paper.
Number
Description and expression
Search space
ε
F
(
X
∗
)
Group 1: conventional problems
F
1
SphereF1(x)=∑i=1Dxi2
[−100, 100]D
10−6
0
F
2
Schwefel’s function 1.2F2(x)=∑i=1D(∑k=1ixk)2
[−100, 100]D
10−6
0
F
3
Noise quadricF3(x)=∑i=1Dixi4+random(0,1)
[−1.28, 1.28]D
10−2
0
F
4
RosenbrockF4=∑i=1D[100(xi+1-xi2)2+(xi-1)2]
[−10, 10]D
10−2
0
F
5
AckleyF5(x)=-20exp⁡-0.2(∑i=1Dxi2)/D-exp⁡((∑i=1Dcos(2πxi))/D)+20+e
[−32.768, 32.768]D
10−6
0
F
6
GriewankF6(x)=∑i=1Dxi2/4000-∏i=1Dcos⁡(xi/i)+1
[−600, 600]D
10−6
0
F
7
RastriginF7(x)=∑i=1D(xi2-10cos⁡(2πxi)+10)
[−5.12, 5.12]D
10−6
0
F
8
Noncontinuous RastriginF8(x)=F7(y)  (yi=xi,xi<0.5;round(2xi)/2,|xi|≥0.5)
[−5.12, 5.12]D
10−6
0
F
9
Expanded SchafferF9x=∑i=1D-1yxi,xi+1+yxD,x1 y(u,v)=0.5+(sin2⁡(u2+v2)-0.5)/(1+0.001(u2+v2))2
[−100, 100]D
10−6
0
Group 2: rotated problems
F
10
Rotated RosenbrockF10(xi)=F4(qi), qi=M∗xi, M is an orthogonal matrix
[−10, 10]D
10
0
F
11
Rotated AckleyF11(xi)=F5(qi), qi=M∗xi
[−32.768, 32.768]D
10
0
F
12
Rotated GriewankF12(xi)=F6(qi), qi=M∗xi
[−600, 600]D
10
0
F
13
Rotated RastriginF13(xi)=F7(qi), qi=M∗xi
[−5.12, 5.12]D
10
0
F
14
Rotated noncontinuous RastriginF14(xi)=F8(qi), qi=M∗xi
[−5.12, 5.12]D
10
0
Group 3: shifted problems
F
15
Shifted SphereF15(xi)=F1(qi)+fbias1, qi=xi-o, fbias1=-450
[−100, 100]D
10−6
−450
F
16
Shifted RosenbrockF16(xi)=F4(qi)+fbias2, qi=xi-o, fbias2=390
[−10, 10]D
10−6
390
F
17
Shifted RastriginF17(xi)=F7(qi)+fbias4, qi=xi-o, fbias4=-330
[−5.12, 5.12]D
10−6
−330
F
18
Shifted non-RastriginF18(xi)=F8(qi)+fbias5, qi=xi-o, fbias5=-330
[−5.12, 5.12]D
10−6
−330
F
19
Shifted rotated Ackley’s function with global optimum on bounds
[−32.76, 32.76]D
10−6
−140
F
20
Shifted rotated Rastrigin’s function
[−5.12, 5.12]D
10−6
−330


## 5.2. Parameter Settings for the Involved PSO Variants

For the comprehensive comparison with PSO-DLP, eight PSO variants are employed in this paper. They are PSO-W [8], HPSO [3], FIPS [25], CLPSO [28], SPSO [26], HEPSO [22], COMPSO [32], and TS-CPSO [33]. The parameter settings of each peer algorithm are extracted from the corresponding literatures and they are given in Table 2.Table 2
Parameter settings of algorithms used in the comparisons.
Algorithm
Year
Population  topology
Parameter  settings
PSO-LDIW
1998
Fully  connected
ω: 0.9–0.4, c1=c2=2.0
HPSO
2004
Fully  connected
ω: 0.9–0.4, c1: 2.5–0.5, c2: 0.5–2.5
FIPSO
2004
Local Ring
λ
=
0.729, Σci=4.1
CLPSO
2006
Comprehensive  learning
ω: 0.9–0.4, c=2.0, m=7
SPSO
2007
Local Ring
ω
=
0.729, c1=c2=1.193
COMPSO
2007
Multiswarm (fully connected)
ω: 0.9–0.4, c1s=c2s=2.05, c1M=c2M=c3M=2
HEPSO
2014
Fully  connected
ω: 0.9–0.4, c1: 2.5−0.5, c2: 0.5−2.5, Pc=0.95, Pb=0.02
TS-COMPSO
2014
Multiswarm (fully  connected  and  local  ring)
ω
M
=
0.9, c1s=c2s=3.4, c1M=c2M=c3M=4.5
CMA-ES
2007
—
σ
=
0.25, μ=(4+2log⁡(N))/2
SADE
2009
—
F
~
N
(
C
R
,
0.3
), CR~N(CRm,0.1), CR0=0.5, LP=50
JADE
2009
—
p
=
0.05, c=0.1
PSO-DLP
—
Multiswarm (fully connected)
ω: 0.9–0.3, c1s=c2s=c1m=c2m=2.0, L=50The swarm size is set to 40 [28] for eight algorithms expect for COMPSO. For COMPSO, the population size is set at 80, as the suggestion proposed by its author. COMPSO has four subswarms, and TS-CPSO and PSO-DLP have two subswarms. In the three algorithms, each subswarm has the same size which is set to 20. To ensure a fair comparison, the maximum number of fitness evaluations (FEs) is set at 1.00E+5. Each algorithm was run 30 times independently to reduce random discrepancy.


## 5.3. Performance Metrics

In this study, we adopted the fitness mean (Fm), success rate (SR), and success performance (SP) to assess the accuracy, the reliability, and the efficiency of PSO, respectively [39]. Fm is the mean difference f(x)-f(x∗) between the best fitness value of the algorithm and the global optimum (x∗ and x represent the global solution and the best solution found by an algorithm, resp.). SR denotes the consistency of an algorithm to achieve the solution with a predefined ε. SP denotes the number of FEs required by an algorithm to solve the problem with a predefined ε. The Wilcoxon test [41, 42] is applied to perform pairwise comparison between PSO-DLP and its peers. The confidence level is fixed at 0.95. If the performance of PSO-DLP is better than its peer, the h value is denoted by “+’’; if the h value is “=’’ or “−’’, this indicates that the performance of PSO-DLP is almost the same as or is significantly worse than its peers, respectively. The average ranking can be calculated to undertake multiple comparisons [41, 42].


## 5.4. Parameter Sensitivity Analysis

The effect of parameterL on the performance of PSO-DLP was investigated. The seven benchmarks are selected, namely, F1, F4, F7, F8, F10, F12, F14, and F17. The L value of PSO-DLP was set to an integer value varying from 10 to 100. Table 3 presents the mean values and the standard deviation obtained by PSO-DLP with different L.Table 3
Effects of the parameterL on PSO-DLP in 30-D.
Fm
L
=
10
L
=
20
L
=
30
L
=
40
L
=
50
L
=
60
L
=
70
L
=
80
L
=
90
L
=
100
F
1
SD
2.80E − 191
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
Fm
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
F
4
SD
7.97E − 17
7.57E − 17
8.07E − 18
7.97E − 17
2.01E − 19
3.04E − 19
7.97E − 17
7.97E − 17
8.27E − 17
8.05E − 17
Fm
1.17E − 17
2.10E − 17
3.05E − 18
2.00E − 17
6.19E − 19
2.33E − 19
2.01E − 17
1.02E − 17
2.31E − 17
5.01E − 17
F
7
SD
5.90E − 13
4.76E − 14
3.55E − 16
1.06E − 15
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
1.59E − 14
1.17E − 14
Fm
1.28E − 12
1.04E − 13
7.94E − 16
2.38E − 15
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
2.43E − 14
7.53E − 15
F
8
SD
1.93E − 13
6.82E − 14
2.84E − 15
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
3.19E − 15
4.28E − 15
Fm
2.67E − 13
1.48E − 13
4.08E − 15
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
0.00E + 00
7.14E − 15
1.56E − 15
F
10
SD
1.71E + 00
1.71E + 00
1.19E + 00
7.46E − 01
2.00E − 01
2.01E − 01
2.87E − 01
1.72E + 00
1.09E + 00
1.94E + 00
Fm
1.10E + 00
2.10E + 00
1.54E + 00
1.53E − 01
2.83E  − 01
2.93E  − 01
1.86E  − 01
1.55E + 00
1.72E + 00
1.91E + 00
F
12
SD
7.90E − 03
7.90E − 03
5.40E − 03
7.40E − 03
3.70E − 03
3.70E − 03
1.08E − 02
4.90E − 03
6.94E − 03
5.91E − 03
Fm
5.11E − 03
1.39E − 03
8.60E − 03
7.00E − 03
5.23E − 03
5.23E − 03
1.01E − 02
7.00E − 03
9.60E − 03
5.70E − 03
F
14
SD
3.48E + 01
3.56E + 01
3.02E + 01
2.65E + 01
2.55E + 01
2.55E + 01
2.92E + 01
2.98E + 01
2.56E + 01
2.60E + 01
Fm
4.02E + 00
8.08E + 00
7.22E + 00
4.60E + 00
1.34E + 01
1.54E + 01
5.97E + 00
3.56E + 00
6.58E + 00
9.87E + 00
F
17
SD
5.68E − 14
5.11E − 14
5.11E − 14
5.11E − 14
1.27E − 14
1.54E − 14
1.97E − 14
3.97E − 14
4.54E − 14
3.41E − 14
Fm
0.00E + 00
1.27E − 14
1.27E − 14
1.27E − 14
1.48E − 13
1.55E − 14
1.57E − 14
1.55E − 14
1.55E − 14
1.27E − 14From Table3, we can see that the experimental results of functions F1 and F4 decrease with the increasing of L  because F1 and F2 are unimodal and the higher value of L is beneficial to the exploitation search. For multimodal functions F7, F8, F10, F12, F14, and F17, the performance of PSO-DLP tends to deteriorate when L is set too low (i.e., L = 10, 20, and 30) or too high (i.e., L = 90, 100). When L is set too low, the interaction between subswarms is overemphasized such that the slave swarm receives the best solution from the master swarm so frequently that the search of the slave swarm is not sufficient to refine the search. When L is set too high, the interaction between swarms is not enough such that the slave swarm may get into the premature convergence for solving multimodal functions. If the interaction interval L is long, the master swarm could not help the slave swarm in getting out of the local optimum. From the above experimental findings, the parameter value of L at 50 had the promising performance of PSO-DLP. Hence, this parameter setting was adopted in the following experiments.


## 5.5. Experimental Results and Discussions

### 5.5.1. Comparison among the Fm Results

Table4 presents the results of the fitness means Fm and standard deviation SD of the nine algorithms on the conventional problems, rotated problems, and shifted problems. The best results among the nine algorithms are shown in bold.Table 4
Experimental result comparisons among nine PSOs.
PSO-W
SPSO
CLPSO
HPSO
FIPS
HEPSO
TS-CPSO
COMPSO
PSO-DLP
F
1
Fm
1.34E − 117
8.86E − 97
3.35E − 87
5.87E − 322
5.66E − 05
0.00E + 00
5.92E − 322
1.48E − 323
0.00E + 00
SD
2.16E − 116
1.86E − 96
5.37E − 87
2.18E − 322
9.24E − 06
0.00E + 00
4.09E − 322
1.87E − 323
0.00E + 00
h
+
+
+
=
+
+
=
=
F
2
Fm
1.41E − 45
5.29E − 02
4.48E − 07
7.61E − 53
1.56E − 02
4.81E − 43
3.96E − 09
2.92E − 47
3.00E − 86
SD
1.47E − 45
3.47E − 02
2.26E − 07
1.68E − 52
8.60E − 02
2.48E − 43
5.33E − 09
5.89E − 47
4.25E − 86
h
+
+
+
+
+
+
+
+
F
3
Fm
2.34E − 03
5.62E − 03
3.50E − 03
3.10E − 03
4.50E − 03
1.61E − 03
9.43E − 03
1.21E − 03
2.05E − 04
SD
9.83E − 04
1.61E − 03
8.73E − 04
2.40E − 03
1.30E − 03
6.15E − 04
4.80E − 03
4.60E − 04
1.24E − 05
h
+
+
+
+
+
+
+
+
F
4
Fm
2.53E + 01
2.25E + 01
1.40E + 01
2.89E + 00
2.02E + 01
1.36E + 01
7.71E − 02
9.806E − 01
2.01E − 19
SD
1.81E + 00
3.76E + 00
3.50E + 00
4.03E + 00
2.30E − 01
2.194E + 00
3.87E − 02
2.19E + 00
6.19E − 19
h
+
+
+
+
+
+
+
+
F
5
Fm
7.11E − 15
5.68E − 15
7.10E − 15
7.10E − 15
7.54E − 05
0.00E + 00
3.34E − 13
4.97E − 15
7.11E − 15
SD
0.00E + 00
1.94E − 15
0.00E + 00
0.00E + 00
2.47E − 06
0.00E + 00
3.45E − 13
1.94E − 15
0.00E + 00
h
=
=
=
=
=
=
+
=
F
6
Fm
7.39E − 03
1.04E − 14
0.00E + 00
1.47E − 02
1.02E − 04
0.00E + 00
2.65E − 02
5.30E − 03
0.00E + 00
SD
1.05E − 02
1.47E − 14
0.00E + 00
2.08E − 02
5.19E − 05
0.00E + 00
1.46E − 02
7.30E − 03
0.00E + 00
h
+
+
+
+
+
=
+
+
F
7
Fm
2.12E + 01
1.31E + 01
1.15E − 14
1.50E − 12
8.98E + 02
0.00E + 00
1.42E − 15
1.65E + 01
0.00E + 00
SD
1.02E + 01
1.25E + 01
3.63E − 15
3.20E − 12
8.17E + 01
0.00E + 00
1.48E − 15
3.19E + 00
0.00E + 00
h
+
+
+
+
+
=
=
+
F
8
Fm
2.37E + 01
3.97E + 01
4.85E − 10
2.00E − 01
7.36E + 01
9.93E − 13
1.20E + 00
1.34E + 01
0.00E + 00
SD
1.45E + 01
4.48E + 00
2.44E − 10
4.47E − 01
1.42E + 01
5.67E − 13
1.09E + 00
1.34E + 00
0.00E + 00
h
+
+
+
+
+
=
+
+
F
9
Fm
1.27E + 00
2.36E + 00
2.59E + 00
1.25E + 00
9.07E + 00
1.31E + 00
7.03E + 00
2.18E + 00
6.87E − 01
SD
4.43E − 01
5.21E − 01
5.53E − 01
1.75E − 01
9.10E − 02
3.33E − 01
1.43E − 01
4.36E − 01
3.60E − 01
h
+
+
+
+
+
+
+
+
F
10
Fm
2.51E + 01
2.55E + 01
2.09E + 01
2.57E + 01
2.17E + 01
1.35E + 01
1.70E + 01
9.65E + 00
2.00E − 01
SD
2.14E + 01
1.48E + 01
4.05E + 01
2.79E + 01
4.94E − 02
7.16E + 00
1.80E + 00
5.14E + 00
2.83E − 01
h
+
+
+
+
+
+
+
+
F
11
Fm
1.34E + 00
7.11E − 15
1.05E − 13
1.20E + 00
7.56E − 05
3.61E − 12
1.92E + 00
1.48E + 00
7.11E − 15
SD
3.14E − 01
0.00E + 00
2.13E − 14
7.42E − 01
3.85E − 06
8.02E − 12
2.97E − 01
5.52E − 01
0.00E + 00
h
+
=
+
+
+
+
+
+
F
12
Fm
3.93E − 02
1.30E − 06
8.13E − 10
4.12E − 02
6.03E − 05
0.00E + 00
1.28E − 02
2.16E − 02
3.70E − 03
SD
3.81E − 02
2.88E − 06
1.01E − 11
2.30E − 02
2.81E − 06
0.00E + 00
1.36E − 02
3.03E − 02
5.23E − 03
h
+
−
−
+
−
−
+
+
F
13
Fm
5.17E + 01
5.59E + 01
3.46E + 01
5.51E + 01
1.59E + 02
2.89E + 01
2.63E + 01
4.29E + 01
2.87E + 01
SD
2.25E + 01
1.80E + 00
3.69E + 00
10.0E + 00
9.76E + 00
5.33E + 00
3.02E + 00
7.42E + 00
3.68E + 00
h
+
+
+
+
+
+
−
+
F
14
Fm
4.05E + 01
5.46E + 01
3.77E + 01
3.78E + 01
1.15E + 02
2.78E + 01
3.22E + 01
4.48E + 01
2.55E + 01
SD
1.48E + 01
8.26E + 00
5.44E + 00
5.40E + 00
13.0E + 01
3.74E + 00
8.07E + 00
8.70E + 00
1.34E + 01
h
+
+
+
+
+
+
+
+
F
15
Fm
5.68E − 14
4.48E − 14
5.68E − 10
4.54E − 14
2.40E + 01
5.01E − 07
5.68E − 14
3.41E − 14
0.00E + 00
SD
0.00E + 00
3.21E − 14
1.23E − 10
2.54E − 14
2.72E + 01
3.23E − 07
1.01E − 14
3.11E − 14
0.00E + 00
h
+
+
+
+
+
+
+
+
F
16
Fm
1.04E + 01
3.03E + 01
1.25E + 01
2.10E + 00
2.02E + 01
4.87E + 01
1.40E − 01
4.26E + 00
1.44E − 09
SD
2.11E + 00
7.93E + 00
8.10E + 00
4.69E + 00
2.64E − 01
1.63E + 00
2.37E − 01
5.20E + 00
3.21E − 09
h
+
+
+
+
+
+
+
+
F
17
Fm
2.41E + 01
1.86E + 01
5.68E − 14
3.58E + 00
1.25E + 02
8.36E + 00
4.58E + 01
1.51E + 01
1.27E − 14
SD
1.19E + 01
1.02E + 01
1.63E − 14
4.19E + 00
3.26E + 01
6.20E + 00
2.25E + 01
3.92E + 00
1.48E − 15
h
+
+
+
+
+
+
+
+
F
18
Fm
2.51E + 01
1.84E + 01
8.68E − 8
4.60E + 00
1.09E + 02
5.75E + 00
3.56E + 02
1.54E + 01
4.55E − 14
SD
1.32E + 01
8.73E + 00
1.83E − 8
3.04E + 00
2.63E + 01
2.29E + 00
4.65E + 02
5.77E + 00
2.54E − 14
h
+
+
+
+
+
+
+
+
F
19
Fm
2.06E + 01
2.08E + 01
2.07E + 01
2.06E + 01
2.09E + 01
2.05E + 01
2.04E + 01
2.08E + 01
2.04E + 01
SD
6.74E − 01
7.57E − 01
4.96E − 01
6.74E − 01
2.20E − 01
4.03E − 01
2.61E − 01
6.51E − 02
6.25E − 02
h
+
+
+
+
+
+
=
+
F
20
Fm
7.78E + 01
9.67E + 01
6.03E + 01
1.89E + 02
4.20E + 01
8.20E + 01
4.01E + 01
6.72E + 01
3.68E + 01
SD
1.38E + 01
2.09E + 01
9.64E + 00
9.88E + 00
8.08E + 00
2.25E + 01
2.13E + 01
1.34E + 01
2.81E + 00
h
+
+
+
+
+
+
+
+From Table4, we obverse that PSO-DLP obtains the best searching accuracy in the eight conventional problems, except for the function F5. To be specific, PSO-DLP finds the global optima of F1, F6, F7, and F8. In addition, PSO-DLP is the only algorithm to achieve the accuracy level of 10−19 for the function F4. For the function F5, COMPSO obtains the best result and PSO-DLP ranks the third.The functions in group 2 (F10–F14) are multimodal functions with coordinate rotations. As can be seen from Table 3, all the algorithms perform worse for the rotated functions than the unrotated counterparts. PSO-DLP performs the best on functions F10, F11, and F14, that is, 3 out of 5 functions, in terms of the Fm. For function F13, TS-CPSO obtains the best fitness value, followed by PSO-DLP.From Table4, we observe that all involved algorithms cannot find the global optima for shifted problems (F15–F18) and complex problems (F19-F20), except for function 15. Function 15 is an easy shifted problem; only PSO-DLP achieves the global optima (Fm=0). PSO-DLP surpasses all other algorithms on the four functions. This implies that PSO-DLP is the least sensitive one to the shifted problem. Complex problems are rotating and shifting operations (F19-F20). PSO-DLP obtains the best solutions on complex functions.


### 5.5.2. Comparison of Nonparametric Statistical Test Results

The Wilcoxon test results between PSO-DLP and peers are reported in Table4. From the test results, PSO-DLP significantly outperforms all other algorithms on functions F2, F3, F4, F8, F9, F10, F14, F15, F16, F17, F18, and F20. COMPSO performs the best on function F5. For function F5, PSO-DLP and COMPSO do not show significant difference according to their statistical test values. PSO-DLP obtains the global solution on functions F6 and F7. For functions F6 and F7, the performance of HEPSO, TS-CPSO, and CLPSO is almost the same as that of PSO-DLP as the Wilcoxon test results show.To compare the performance of multiple algorithms, we used the average ranking of the Friedman test to evaluate the effectiveness of PSO-DLP comprehensively. The algorithm with the better convergence accuracy is assigned to a smaller rank value. Table5 shows the average ranking of nine PSO variants on functions F1–F20. According to the result of the average ranking, nine algorithms can be sorted into the following order: PSO-DLP, HEPSO, COMPSO, CLPSO, HPSO, TS-CPSO, PSO-W, SPSO, and FIPS. PSO-DLP obtains the best performance.Table 5
Average rankings achieved by Friedman test for the nine PSO algorithms.
Algorithm
Ranking
PSO-W
5.85 (8)
SPSO
6.4 (7)
CLPSO
4.65 (4)
HPSO
5.5 (5)
FIPS
7.3 (9)
HEPSO
3.4 (2)
TS-CPSO
5.15 (6)
COMPSO
4.45 (3)
PSO-DLP
1.5 (
1
)


### 5.5.3. Comparisons of the SR Value and the SP Value

The SR values and the SP values of all algorithms are shown in Table6. If an algorithm is unable to completely solve the problems, then the value of SR is set at zero (i.e., SR=0) and the value of SP is assigned an infinity value (i.e., SP =“inf”). As shown in Table 6, we observe that PSO-DLP has more superior search reliability among the compared peers. It can completely solve all conventional problems and rotated problems except for functions F9, F13, and F14. For functions F9, F13, and F14, none of the compared algorithms can solve the problem completely at the predefined ε and PSO-DLP can achieve the best result on functions F9 and F14 from Table 3. For the shifted problems, PSO-DLP completely solves four out of six functions at the predefined ε. Meanwhile, none of the algorithms are able to solve functions F19 and F20. Nevertheless, PSO-DLP can obtain the smallest Fm value for functions F19 and F20.Table 6
Comparisons of the SR and the SP among nine PSOs.
PSO-W
SPSO
CLPSO
HPSO
FIPS
HEPSO
TS-CPSO
COMPSO
PSO-DLP
F
1
SR
100
100
100
100
56.00
100
100
100
0.00E + 00
SP
2.17E + 03
5.23E + 04
6.44E + 04
3.45E + 03
INF
3.12E + 04
2.23E + 03
2.47E + 03
2.04E + 03
F
2
SR
100
0.00
93.33
100
0.00
100
100
100
100
SP
8.23E + 04
INF
8.89E + 04
3.68E + 04
INF
3.12E + 04
7.15E + 04
1.12E + 04
2.54E + 04
F
3
SR
100
86.66
90.00
100
83.3
100
90.00
100
100
SP
6.23E + 04
7.48E + 04
4.16E + 04
3.17E + 04
8.33E + 04
3.92E + 04
3.54E + 04
2.57E + 04
1.83E + 04
F
4
SR
0
0
0
0
0
0
0
0
100
SP
INF
INF
INF
INF
INF
INF
INF
INF
4.62E + 04
F
5
SR
100
100
100
100
100
100
100
100
100
SP
4.21E + 04
6.34E + 04
5.84E + 04
2.12E + 04
6.16E + 04
5.52E + 04
9.23E + 03
9.85E + 03
1.51E + 04
F
6
SR
0
100
100
0
0
100
0
0
100
SP
INF
7.56E + 04
3.81E + 04
INF
INF
2.35E + 04
INF
INF
4.15E + 04
F
7
SR
0
0
100
100
0
100
100
0
100
SP
INF
INF
6.14E + 04
5.52E + 04
INF
4.36E + 04
5.74E + 04
INF
4.26E + 04
F
8
SR
0
0
100
0
0
100
0
0
100
SP
INF
INF
9.78E + 04
INF
INF
8.94E + 04
INF
INF
4.85E + 04
F
9
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INF
F
10
SR
0
0
0
0
0
0
0
80.00
100
SP
INF
INF
INF
INF
INF
INF
INF
8.15E + 04
3.27E + 04
F
11
SR
100
100
100
100
100
100
100
100
100
SP
3.85E + 04
4.27E + 04
3.27E + 04
1.32E + 04
6.28E + 04
4.87E + 04
3.75E + 04
3.27E + 04
5.63E + 04
F
12
SR
100
100
100
100
100
100
100
100
100
SP
3.61E + 04
5.78E + 04
2.57E + 04
3.15E + 04
5.27E + 04
3.16E + 04
2.10E + 04
2.18E + 04
1.36E + 04
F
13
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INF
F
14
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INF
F
15
SR
100
100
100
100
0
90.00
100
100
100
SP
4.93E + 04
5.63E + 04
5.63E + 04
5.63E + 04
INF
9.29E + 04
9.08E + 03
1.06E + 04
1.41E + 04
F
16
SR
0
0
0
0
0
0
0
0
100
SP
INF
INF
INF
INF
INF
INF
INF
INF
1.35E + 04
F
17
SR
0
0
100
0
0
0
0
0
100
SP
INF
INF
5.19E + 04
INF
INF
INF
INF
INF
5.04E + 04
F
18
SR
0
0
100
0
0
0
0
0
100
SP
INF
INF
4.55E + 04
INF
INF
INF
INF
INF
8.21E + 04
F
19
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INF
F
20
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INFAs reported in Table6, PSO-DLP can get seven best SP values in conventional problems and rotated problems. The results show that PSO-DLP costs the least computation to solve these problems at the predefined ε. Figure 2 shows the convergence curves of the nine PSO algorithms on all functions. It can be seen that the convergence curves for functions F2, F4, F10, F11, and F20 (Figures 2(b), 2(d), 2(j), 2(k), and 2(t)) show that the PSO-DLP has the competitive convergence speed among its peers. For functions F9, F17, and F18 (Figures 2(i), 2(q), and 2(r)), PSO-DLP converges slowly at the beginning and achieves with fast convergence in later stage of the evolution. Particularly, the convergence speed of PSO-DLP in functions F6, F7, and F8 (Figures 2(f), 2(g), and 2(h)) is significantly faster than its peers in the middle stage of the evolution. Overall, PSO-DLP has better control of the convergence speed and accuracy than the involved PSO variants.Figure 2
Convergence curves of test functions. (a)F1, (b) F2, (c) F3, (d) F4, (e) F5, (f) F6, (g) F7, (h) F8, (i) F9, and (j) F10. Convergence curves of test functions. (k) F11, (l) F12, (m) F13, (n) F14, (o) F15, (p) F16, (q) F17, (r) F18, (s) F19, and (t) F20.
(a)
(b)
(c)
(d)
(e)
(f)
(g)
(h)
(i)
(j)
(k)
(l)
(m)
(n)
(o)
(p)
(q)
(r)
(s)
(t)


### 5.5.4. Effect of Different Strategies

The proposed PSO-DLP employs two learning patterns: the uniform exploration leaning (UEL) and the enhanced exploitation learning (EEL). To investigate the effects of them, we studied the performance of PSO-W, PSO with UEL (PSO-UEL), PSO with EEL (PSO-EEL), and the complete PSO-DLP. PSO-UEL and PSO-EEL adopt one swarm so that there is no interaction between the subswarms. The Fm values of all involved algorithms are presented in Table7.Table 7
Fm values achieved by PSO-W and PSO-DLP variants in 30-D problems.
PSO-W
PSO-UEL
PSO-EEL
PSO-DLP
F
1
1.34E − 117 ± 2.16E − 116
5.60E − 58 ± 6.46E − 59
5.93E − 323 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
F
2
1.41E − 45 ± 1.47E − 45
4.58E − 10 ± 6.29E − 10
6.94E − 184 ± 0.00E + 00
3.00E − 86 ± 4.25E − 86
F
3
2.34E − 03 ± 9.83E − 04
1.20E − 03 ± 9.43E − 04
4.06E − 03 ± 1.90E − 03
2.05E − 04 ± 1.24E − 05
F
4
2.53E + 01 ± 1.81E + 00
2.28E + 01 ± 6.61E − 01
4.78E − 17 ± 6.08E − 17
2.01E − 19 ± 6.19E − 19
F
5
7.11E − 15 ± 0.00E + 00
2.84E − 14 ± 6.15E − 15
1.18E − 14 ± 4.10E − 15
7.11E − 15 ± 0.00E + 00
F
6
7.39E − 03 ± 1.05E − 02
2.13E − 03 ± 2.09E − 03
6.68E − 02 ± 5.87E − 02
0.00E + 00 ± 0.00E + 00
F
7
2.12E + 01 ± 1.02E + 01
0.00E + 00 ± 0.00E + 00
1.16E + 01 ± 1.52E + 00
0.00E + 00 ± 0.00E + 00
F
8
2.37E + 01 ± 1.45E + 01
0.00E + 00 ± 0.00E + 00
3.33E − 01 ± 5.77E − 01
0.00E + 00 ± 0.00E + 00
F
9
1.27E + 00 ± 4.43E − 01
7.53E − 01 ± 3.43E − 01
1.46E + 00 ± 5.58E − 01
6.87E − 01 ± 3.60E − 01
F
10
2.51E + 01 ± 2.14E + 01
2.37E + 01 ± 2.50E − 01
5.70E − 01 ± 5.22E − 01
2.00E − 01 ± 2.83E − 01
F
11
1.34E + 00 ± 3.14E − 01
3.20E − 14 ± 6.15E − 15
4.47E − 01 ± 7.74E − 01
7.11E − 15 ± 0.00E + 00
F
12
3.93E − 02 ± 3.81E − 02
2.46E − 02 ± 3.64E − 02
1.40E − 02 ± 7.09E − 03
3.70E − 03 ± 5.23E − 03
F
13
5.17E + 01 ± 2.25E + 01
4.21E + 01 ± 6.77E + 00
6.04E + 01 ± 9.56E + 00
2.87E + 01 ± 3.68E + 00
F
14
4.05E + 01 ± 1.48E + 01
2.67E + 01 ± 3.06E + 00
5.40E + 01 ± 2.00E + 00
2.55E + 01 ± 1.34E + 01
F
15
5.68E − 14 ± 0.00E + 00
1.14E − 13 ± 0.00E + 00
7.58E − 14 ± 3.28E − 14
0.00E + 00 ± 0.00E + 00
F
16
1.04E + 01 ± 2.11E + 00
2.27E + 01 ± 5.57E − 01
6.56E − 11 ± 6.74E − 11
1.44E − 09 ± 3.21E − 09
F
17
2.41E + 01 ± 1.19E + 01
1.89E − 13 ± 3.28E − 14
9.62E + 00 ± 5.11E + 00
1.27E − 14 ± 1.48E − 15
F
18
2.51E + 01 ± 1.32E + 01
1.71E − 13 ± 5.68E − 14
5.11E + 00 ± 2.33E + 00
4.55E − 14 ± 2.54E − 14
F
19
2.06E + 01 ± 6.74E − 01
2.04E + 01 ± 1.85E − 01
2.05E + 01 ± 3.63E − 02
2.04E + 01 ±6.25E − 02
F
20
7.78E + 01 ± 1.38E + 01
5.93E + 01 ± 1.14E + 01
9.68E + 01 ± 4.34E + 01
3.68E + 01 ± 2.81E + 00From Table7, PSO-UEL achieves better results than PSO-W on 15 functions, and it successfully solves multimodal functions F7 and F8, which means that PSO-UEL has strong exploration ability. Meanwhile, we observe that PSO-EEL performed well in unimodal functions (F1, F2, F3, and F15) and Rosenbrock functions (F4, F10, and F16), but it fails to solve the other multimodal functions. This observation means that PSO-EEL is easier to be trapped in the local optima for multimodal functions. By integrating the two learning patterns, PSO-DLP obtains excellent performance.


### 5.5.5. Performance Comparisons between PSO-DLP and Other Evolutionary Algorithms

In this section, we compare PSO-DLP with the covariance matrix adaptation evolution strategy (CMA-ES) [43], self-adaptive DE (SaDE) [44], and adaptive DE with optional external archive (JADE) [45]. The CMA-ES algorithm is a powerful stochastic optimization technique, where the multivariate normal distribution has a mean and a covariance matrix constantly updated during the evolutionary process. Differential evolution (DE) has been shown to be an efficient stochastic search algorithm for solving optimization problems. SaDE provides a mutation strategy pool, where the strategy is adaptively selected according to its previous performance. The JADE is another adaptive DE-variant, where a novel mutation strategy is developed and an external archive is employed to store information of progress direction. Simulation results showed that JADE has competitive performances.Twenty benchmark functions as presented in Table1 are used to test the performance of four algorithms. The parameter values of CMA-ES and DEs are selected according to the recommendations of their respective references, as listed in Table 3. The maximum number of fitness evaluations is set at 1.00E+5 and population size N is set at 40 (N=(4+3log⁡(D)) for CMA-ES) for all algorithms. All functions are tested on 30 dimensions (D=30). All algorithms are run independently 30 times to ensure the fair assessment.The mean (Fm) and the standard deviation (SD) of the results obtained by each algorithm for all algorithms are summarized in Table8. From Table 8, we observed that PSO-DLP has better performance on eleven functions and has the same performance with DEs or CMA-ES on six functions. From the final rank, we can obtain the order of the involved algorithms: PSO-DLP, JADE, CMA-ES, and SADE. PSO-DLP has competitive performance among these algorithms on the tested functions.Table 8
Comparisons between PSO-DLP and other evolutionary algorithms in 30-D problems.
CMA-ES
JADE
SADE
PSO-DLP
F
1
4.83E − 131 ± 4.35E − 131
5.70E − 116 ± 3.19E − 116
4.57E − 81 ± 3.10E + 81
0.00E + 00 ± 0.00E + 00
F
2
1.51E − 26 ± 3.61E − 27
2.84E − 75 ± 3.25E − 76
9.37E − 62 ± 5.44E − 63
3.00E − 86 ± 4.25E − 86
F
3
5.31E − 01 ± 2.50E − 03
5.14E – 04 ± 2.14E − 05
1.12E − 03 ± 6.27E − 04
2.05E − 04 ± 1.24E − 05
F
4
7.43E − 02 ± 3.64E − 03
7.09E − 02 ± 2.54E − 03
1.25E + 01 ± 3.18E + 00
2.01E − 19 ± 6.19E − 19
F
5
7.11E − 15 ± 0.00E + 00
4.45E − 15 ± 3.24E − 15
1.18E − 14 ± 4.10E − 15
7.11E − 15 ± 0.00E + 00
F
6
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
F
7
1.54E + 01 ± 7.04E − 01
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
F
8
1.65E + 01 ± 4.95E + 00
0.00E + 00 ± 0.00E + 00
6.24E − 14 ± 3.54E − 15
0.00E + 00 ± 0.00E + 00
F
9
0.00E + 00 ± 0.00E + 00
7.53E − 01 ± 3.43E − 01
1.46E + 00 ± 5.58E − 01
6.87E − 01 ± 3.60E − 01
F
10
2.88E + 01 ± 2.20E − 02
1.41E + 01 ± 4.31E + 00
2.98E + 01 ± 3.08E + 00
2.00E − 01 ±2.83E − 01
F
11
1.03E + 00 ± 6.07E − 02
7.34E − 15 ± 1.56E − 15
7.11E − 15 ± 0.00E + 00
7.11E − 15 ± 0.00E + 00
F
12
0.00E + 00 ± 0.00E + 00
1.23E − 02 ± 3.98E − 03
8.21E − 03 ± 9.21E − 04
3.70E − 03 ± 5.23E − 03
F
13
3.12E + 01 ± 1.05E − 01
2.81E + 01 ± 3.15E − 01
3.14E + 01 ± 9.56E + 00
2.87E + 01 ± 3.68E + 00
F
14
7.89E + 01 ± 3.58E − 01
2.71E + 01 ± 1.32E + 00
2.86E + 01 ± 3.45E − 01
2.55E + 01 ± 1.34E + 01
F
15
1.77E − 26 ± 5.19E − 27
5.68E − 24 ± 3.42E − 24
4.78E − 23 ± 9.85E − 24
0.00E + 00 ± 0.00E + 00
F
16
1.23E + 00 ± 2.50E − 03
1.02E + 01 ± 1.15E + 00
4.86E + 01 ± 5.78E + 00
1.44E − 09 ± 3.21E − 09
F
17
1.94E + 01 ± 7.74E + 00
1.89E − 14 ± 3.28E − 15
1.62E − 13 ± 1.71E − 14
1.27E − 14 ± 1.48E − 15
F
18
2.14E + 01 ± 6.34E + 00
1.71E − 13 ± 5.68E − 14
2.35E − 13 ± 5.24E − 14
4.55E − 14 ± 2.54E − 14
F
19
2.12E + 01 ± 2.14E − 03
2.09E + 01 ± 1.85E − 01
2.09 + 01 ± 4.61E − 02
2.04E + 01 ±6.25E − 02
F
20
4.87E + 01 ± 1.12E + 01
3.95E + 01 ± 8.35E + 00E
5.67E + 01 ± 3.39E + 00
3.68E + 01 ± 2.81E + 00
Average rank
2.9
2.15
3.25
1.2
Final rank
3
2
4
1


## 5.5.1. Comparison among the Fm Results

Table4 presents the results of the fitness means Fm and standard deviation SD of the nine algorithms on the conventional problems, rotated problems, and shifted problems. The best results among the nine algorithms are shown in bold.Table 4
Experimental result comparisons among nine PSOs.
PSO-W
SPSO
CLPSO
HPSO
FIPS
HEPSO
TS-CPSO
COMPSO
PSO-DLP
F
1
Fm
1.34E − 117
8.86E − 97
3.35E − 87
5.87E − 322
5.66E − 05
0.00E + 00
5.92E − 322
1.48E − 323
0.00E + 00
SD
2.16E − 116
1.86E − 96
5.37E − 87
2.18E − 322
9.24E − 06
0.00E + 00
4.09E − 322
1.87E − 323
0.00E + 00
h
+
+
+
=
+
+
=
=
F
2
Fm
1.41E − 45
5.29E − 02
4.48E − 07
7.61E − 53
1.56E − 02
4.81E − 43
3.96E − 09
2.92E − 47
3.00E − 86
SD
1.47E − 45
3.47E − 02
2.26E − 07
1.68E − 52
8.60E − 02
2.48E − 43
5.33E − 09
5.89E − 47
4.25E − 86
h
+
+
+
+
+
+
+
+
F
3
Fm
2.34E − 03
5.62E − 03
3.50E − 03
3.10E − 03
4.50E − 03
1.61E − 03
9.43E − 03
1.21E − 03
2.05E − 04
SD
9.83E − 04
1.61E − 03
8.73E − 04
2.40E − 03
1.30E − 03
6.15E − 04
4.80E − 03
4.60E − 04
1.24E − 05
h
+
+
+
+
+
+
+
+
F
4
Fm
2.53E + 01
2.25E + 01
1.40E + 01
2.89E + 00
2.02E + 01
1.36E + 01
7.71E − 02
9.806E − 01
2.01E − 19
SD
1.81E + 00
3.76E + 00
3.50E + 00
4.03E + 00
2.30E − 01
2.194E + 00
3.87E − 02
2.19E + 00
6.19E − 19
h
+
+
+
+
+
+
+
+
F
5
Fm
7.11E − 15
5.68E − 15
7.10E − 15
7.10E − 15
7.54E − 05
0.00E + 00
3.34E − 13
4.97E − 15
7.11E − 15
SD
0.00E + 00
1.94E − 15
0.00E + 00
0.00E + 00
2.47E − 06
0.00E + 00
3.45E − 13
1.94E − 15
0.00E + 00
h
=
=
=
=
=
=
+
=
F
6
Fm
7.39E − 03
1.04E − 14
0.00E + 00
1.47E − 02
1.02E − 04
0.00E + 00
2.65E − 02
5.30E − 03
0.00E + 00
SD
1.05E − 02
1.47E − 14
0.00E + 00
2.08E − 02
5.19E − 05
0.00E + 00
1.46E − 02
7.30E − 03
0.00E + 00
h
+
+
+
+
+
=
+
+
F
7
Fm
2.12E + 01
1.31E + 01
1.15E − 14
1.50E − 12
8.98E + 02
0.00E + 00
1.42E − 15
1.65E + 01
0.00E + 00
SD
1.02E + 01
1.25E + 01
3.63E − 15
3.20E − 12
8.17E + 01
0.00E + 00
1.48E − 15
3.19E + 00
0.00E + 00
h
+
+
+
+
+
=
=
+
F
8
Fm
2.37E + 01
3.97E + 01
4.85E − 10
2.00E − 01
7.36E + 01
9.93E − 13
1.20E + 00
1.34E + 01
0.00E + 00
SD
1.45E + 01
4.48E + 00
2.44E − 10
4.47E − 01
1.42E + 01
5.67E − 13
1.09E + 00
1.34E + 00
0.00E + 00
h
+
+
+
+
+
=
+
+
F
9
Fm
1.27E + 00
2.36E + 00
2.59E + 00
1.25E + 00
9.07E + 00
1.31E + 00
7.03E + 00
2.18E + 00
6.87E − 01
SD
4.43E − 01
5.21E − 01
5.53E − 01
1.75E − 01
9.10E − 02
3.33E − 01
1.43E − 01
4.36E − 01
3.60E − 01
h
+
+
+
+
+
+
+
+
F
10
Fm
2.51E + 01
2.55E + 01
2.09E + 01
2.57E + 01
2.17E + 01
1.35E + 01
1.70E + 01
9.65E + 00
2.00E − 01
SD
2.14E + 01
1.48E + 01
4.05E + 01
2.79E + 01
4.94E − 02
7.16E + 00
1.80E + 00
5.14E + 00
2.83E − 01
h
+
+
+
+
+
+
+
+
F
11
Fm
1.34E + 00
7.11E − 15
1.05E − 13
1.20E + 00
7.56E − 05
3.61E − 12
1.92E + 00
1.48E + 00
7.11E − 15
SD
3.14E − 01
0.00E + 00
2.13E − 14
7.42E − 01
3.85E − 06
8.02E − 12
2.97E − 01
5.52E − 01
0.00E + 00
h
+
=
+
+
+
+
+
+
F
12
Fm
3.93E − 02
1.30E − 06
8.13E − 10
4.12E − 02
6.03E − 05
0.00E + 00
1.28E − 02
2.16E − 02
3.70E − 03
SD
3.81E − 02
2.88E − 06
1.01E − 11
2.30E − 02
2.81E − 06
0.00E + 00
1.36E − 02
3.03E − 02
5.23E − 03
h
+
−
−
+
−
−
+
+
F
13
Fm
5.17E + 01
5.59E + 01
3.46E + 01
5.51E + 01
1.59E + 02
2.89E + 01
2.63E + 01
4.29E + 01
2.87E + 01
SD
2.25E + 01
1.80E + 00
3.69E + 00
10.0E + 00
9.76E + 00
5.33E + 00
3.02E + 00
7.42E + 00
3.68E + 00
h
+
+
+
+
+
+
−
+
F
14
Fm
4.05E + 01
5.46E + 01
3.77E + 01
3.78E + 01
1.15E + 02
2.78E + 01
3.22E + 01
4.48E + 01
2.55E + 01
SD
1.48E + 01
8.26E + 00
5.44E + 00
5.40E + 00
13.0E + 01
3.74E + 00
8.07E + 00
8.70E + 00
1.34E + 01
h
+
+
+
+
+
+
+
+
F
15
Fm
5.68E − 14
4.48E − 14
5.68E − 10
4.54E − 14
2.40E + 01
5.01E − 07
5.68E − 14
3.41E − 14
0.00E + 00
SD
0.00E + 00
3.21E − 14
1.23E − 10
2.54E − 14
2.72E + 01
3.23E − 07
1.01E − 14
3.11E − 14
0.00E + 00
h
+
+
+
+
+
+
+
+
F
16
Fm
1.04E + 01
3.03E + 01
1.25E + 01
2.10E + 00
2.02E + 01
4.87E + 01
1.40E − 01
4.26E + 00
1.44E − 09
SD
2.11E + 00
7.93E + 00
8.10E + 00
4.69E + 00
2.64E − 01
1.63E + 00
2.37E − 01
5.20E + 00
3.21E − 09
h
+
+
+
+
+
+
+
+
F
17
Fm
2.41E + 01
1.86E + 01
5.68E − 14
3.58E + 00
1.25E + 02
8.36E + 00
4.58E + 01
1.51E + 01
1.27E − 14
SD
1.19E + 01
1.02E + 01
1.63E − 14
4.19E + 00
3.26E + 01
6.20E + 00
2.25E + 01
3.92E + 00
1.48E − 15
h
+
+
+
+
+
+
+
+
F
18
Fm
2.51E + 01
1.84E + 01
8.68E − 8
4.60E + 00
1.09E + 02
5.75E + 00
3.56E + 02
1.54E + 01
4.55E − 14
SD
1.32E + 01
8.73E + 00
1.83E − 8
3.04E + 00
2.63E + 01
2.29E + 00
4.65E + 02
5.77E + 00
2.54E − 14
h
+
+
+
+
+
+
+
+
F
19
Fm
2.06E + 01
2.08E + 01
2.07E + 01
2.06E + 01
2.09E + 01
2.05E + 01
2.04E + 01
2.08E + 01
2.04E + 01
SD
6.74E − 01
7.57E − 01
4.96E − 01
6.74E − 01
2.20E − 01
4.03E − 01
2.61E − 01
6.51E − 02
6.25E − 02
h
+
+
+
+
+
+
=
+
F
20
Fm
7.78E + 01
9.67E + 01
6.03E + 01
1.89E + 02
4.20E + 01
8.20E + 01
4.01E + 01
6.72E + 01
3.68E + 01
SD
1.38E + 01
2.09E + 01
9.64E + 00
9.88E + 00
8.08E + 00
2.25E + 01
2.13E + 01
1.34E + 01
2.81E + 00
h
+
+
+
+
+
+
+
+From Table4, we obverse that PSO-DLP obtains the best searching accuracy in the eight conventional problems, except for the function F5. To be specific, PSO-DLP finds the global optima of F1, F6, F7, and F8. In addition, PSO-DLP is the only algorithm to achieve the accuracy level of 10−19 for the function F4. For the function F5, COMPSO obtains the best result and PSO-DLP ranks the third.The functions in group 2 (F10–F14) are multimodal functions with coordinate rotations. As can be seen from Table 3, all the algorithms perform worse for the rotated functions than the unrotated counterparts. PSO-DLP performs the best on functions F10, F11, and F14, that is, 3 out of 5 functions, in terms of the Fm. For function F13, TS-CPSO obtains the best fitness value, followed by PSO-DLP.From Table4, we observe that all involved algorithms cannot find the global optima for shifted problems (F15–F18) and complex problems (F19-F20), except for function 15. Function 15 is an easy shifted problem; only PSO-DLP achieves the global optima (Fm=0). PSO-DLP surpasses all other algorithms on the four functions. This implies that PSO-DLP is the least sensitive one to the shifted problem. Complex problems are rotating and shifting operations (F19-F20). PSO-DLP obtains the best solutions on complex functions.


## 5.5.2. Comparison of Nonparametric Statistical Test Results

The Wilcoxon test results between PSO-DLP and peers are reported in Table4. From the test results, PSO-DLP significantly outperforms all other algorithms on functions F2, F3, F4, F8, F9, F10, F14, F15, F16, F17, F18, and F20. COMPSO performs the best on function F5. For function F5, PSO-DLP and COMPSO do not show significant difference according to their statistical test values. PSO-DLP obtains the global solution on functions F6 and F7. For functions F6 and F7, the performance of HEPSO, TS-CPSO, and CLPSO is almost the same as that of PSO-DLP as the Wilcoxon test results show.To compare the performance of multiple algorithms, we used the average ranking of the Friedman test to evaluate the effectiveness of PSO-DLP comprehensively. The algorithm with the better convergence accuracy is assigned to a smaller rank value. Table5 shows the average ranking of nine PSO variants on functions F1–F20. According to the result of the average ranking, nine algorithms can be sorted into the following order: PSO-DLP, HEPSO, COMPSO, CLPSO, HPSO, TS-CPSO, PSO-W, SPSO, and FIPS. PSO-DLP obtains the best performance.Table 5
Average rankings achieved by Friedman test for the nine PSO algorithms.
Algorithm
Ranking
PSO-W
5.85 (8)
SPSO
6.4 (7)
CLPSO
4.65 (4)
HPSO
5.5 (5)
FIPS
7.3 (9)
HEPSO
3.4 (2)
TS-CPSO
5.15 (6)
COMPSO
4.45 (3)
PSO-DLP
1.5 (
1
)


## 5.5.3. Comparisons of the SR Value and the SP Value

The SR values and the SP values of all algorithms are shown in Table6. If an algorithm is unable to completely solve the problems, then the value of SR is set at zero (i.e., SR=0) and the value of SP is assigned an infinity value (i.e., SP =“inf”). As shown in Table 6, we observe that PSO-DLP has more superior search reliability among the compared peers. It can completely solve all conventional problems and rotated problems except for functions F9, F13, and F14. For functions F9, F13, and F14, none of the compared algorithms can solve the problem completely at the predefined ε and PSO-DLP can achieve the best result on functions F9 and F14 from Table 3. For the shifted problems, PSO-DLP completely solves four out of six functions at the predefined ε. Meanwhile, none of the algorithms are able to solve functions F19 and F20. Nevertheless, PSO-DLP can obtain the smallest Fm value for functions F19 and F20.Table 6
Comparisons of the SR and the SP among nine PSOs.
PSO-W
SPSO
CLPSO
HPSO
FIPS
HEPSO
TS-CPSO
COMPSO
PSO-DLP
F
1
SR
100
100
100
100
56.00
100
100
100
0.00E + 00
SP
2.17E + 03
5.23E + 04
6.44E + 04
3.45E + 03
INF
3.12E + 04
2.23E + 03
2.47E + 03
2.04E + 03
F
2
SR
100
0.00
93.33
100
0.00
100
100
100
100
SP
8.23E + 04
INF
8.89E + 04
3.68E + 04
INF
3.12E + 04
7.15E + 04
1.12E + 04
2.54E + 04
F
3
SR
100
86.66
90.00
100
83.3
100
90.00
100
100
SP
6.23E + 04
7.48E + 04
4.16E + 04
3.17E + 04
8.33E + 04
3.92E + 04
3.54E + 04
2.57E + 04
1.83E + 04
F
4
SR
0
0
0
0
0
0
0
0
100
SP
INF
INF
INF
INF
INF
INF
INF
INF
4.62E + 04
F
5
SR
100
100
100
100
100
100
100
100
100
SP
4.21E + 04
6.34E + 04
5.84E + 04
2.12E + 04
6.16E + 04
5.52E + 04
9.23E + 03
9.85E + 03
1.51E + 04
F
6
SR
0
100
100
0
0
100
0
0
100
SP
INF
7.56E + 04
3.81E + 04
INF
INF
2.35E + 04
INF
INF
4.15E + 04
F
7
SR
0
0
100
100
0
100
100
0
100
SP
INF
INF
6.14E + 04
5.52E + 04
INF
4.36E + 04
5.74E + 04
INF
4.26E + 04
F
8
SR
0
0
100
0
0
100
0
0
100
SP
INF
INF
9.78E + 04
INF
INF
8.94E + 04
INF
INF
4.85E + 04
F
9
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INF
F
10
SR
0
0
0
0
0
0
0
80.00
100
SP
INF
INF
INF
INF
INF
INF
INF
8.15E + 04
3.27E + 04
F
11
SR
100
100
100
100
100
100
100
100
100
SP
3.85E + 04
4.27E + 04
3.27E + 04
1.32E + 04
6.28E + 04
4.87E + 04
3.75E + 04
3.27E + 04
5.63E + 04
F
12
SR
100
100
100
100
100
100
100
100
100
SP
3.61E + 04
5.78E + 04
2.57E + 04
3.15E + 04
5.27E + 04
3.16E + 04
2.10E + 04
2.18E + 04
1.36E + 04
F
13
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INF
F
14
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INF
F
15
SR
100
100
100
100
0
90.00
100
100
100
SP
4.93E + 04
5.63E + 04
5.63E + 04
5.63E + 04
INF
9.29E + 04
9.08E + 03
1.06E + 04
1.41E + 04
F
16
SR
0
0
0
0
0
0
0
0
100
SP
INF
INF
INF
INF
INF
INF
INF
INF
1.35E + 04
F
17
SR
0
0
100
0
0
0
0
0
100
SP
INF
INF
5.19E + 04
INF
INF
INF
INF
INF
5.04E + 04
F
18
SR
0
0
100
0
0
0
0
0
100
SP
INF
INF
4.55E + 04
INF
INF
INF
INF
INF
8.21E + 04
F
19
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INF
F
20
SR
0
0
0
0
0
0
0
0
0
SP
INF
INF
INF
INF
INF
INF
INF
INF
INFAs reported in Table6, PSO-DLP can get seven best SP values in conventional problems and rotated problems. The results show that PSO-DLP costs the least computation to solve these problems at the predefined ε. Figure 2 shows the convergence curves of the nine PSO algorithms on all functions. It can be seen that the convergence curves for functions F2, F4, F10, F11, and F20 (Figures 2(b), 2(d), 2(j), 2(k), and 2(t)) show that the PSO-DLP has the competitive convergence speed among its peers. For functions F9, F17, and F18 (Figures 2(i), 2(q), and 2(r)), PSO-DLP converges slowly at the beginning and achieves with fast convergence in later stage of the evolution. Particularly, the convergence speed of PSO-DLP in functions F6, F7, and F8 (Figures 2(f), 2(g), and 2(h)) is significantly faster than its peers in the middle stage of the evolution. Overall, PSO-DLP has better control of the convergence speed and accuracy than the involved PSO variants.Figure 2
Convergence curves of test functions. (a)F1, (b) F2, (c) F3, (d) F4, (e) F5, (f) F6, (g) F7, (h) F8, (i) F9, and (j) F10. Convergence curves of test functions. (k) F11, (l) F12, (m) F13, (n) F14, (o) F15, (p) F16, (q) F17, (r) F18, (s) F19, and (t) F20.
(a)
(b)
(c)
(d)
(e)
(f)
(g)
(h)
(i)
(j)
(k)
(l)
(m)
(n)
(o)
(p)
(q)
(r)
(s)
(t)


## 5.5.4. Effect of Different Strategies

The proposed PSO-DLP employs two learning patterns: the uniform exploration leaning (UEL) and the enhanced exploitation learning (EEL). To investigate the effects of them, we studied the performance of PSO-W, PSO with UEL (PSO-UEL), PSO with EEL (PSO-EEL), and the complete PSO-DLP. PSO-UEL and PSO-EEL adopt one swarm so that there is no interaction between the subswarms. The Fm values of all involved algorithms are presented in Table7.Table 7
Fm values achieved by PSO-W and PSO-DLP variants in 30-D problems.
PSO-W
PSO-UEL
PSO-EEL
PSO-DLP
F
1
1.34E − 117 ± 2.16E − 116
5.60E − 58 ± 6.46E − 59
5.93E − 323 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
F
2
1.41E − 45 ± 1.47E − 45
4.58E − 10 ± 6.29E − 10
6.94E − 184 ± 0.00E + 00
3.00E − 86 ± 4.25E − 86
F
3
2.34E − 03 ± 9.83E − 04
1.20E − 03 ± 9.43E − 04
4.06E − 03 ± 1.90E − 03
2.05E − 04 ± 1.24E − 05
F
4
2.53E + 01 ± 1.81E + 00
2.28E + 01 ± 6.61E − 01
4.78E − 17 ± 6.08E − 17
2.01E − 19 ± 6.19E − 19
F
5
7.11E − 15 ± 0.00E + 00
2.84E − 14 ± 6.15E − 15
1.18E − 14 ± 4.10E − 15
7.11E − 15 ± 0.00E + 00
F
6
7.39E − 03 ± 1.05E − 02
2.13E − 03 ± 2.09E − 03
6.68E − 02 ± 5.87E − 02
0.00E + 00 ± 0.00E + 00
F
7
2.12E + 01 ± 1.02E + 01
0.00E + 00 ± 0.00E + 00
1.16E + 01 ± 1.52E + 00
0.00E + 00 ± 0.00E + 00
F
8
2.37E + 01 ± 1.45E + 01
0.00E + 00 ± 0.00E + 00
3.33E − 01 ± 5.77E − 01
0.00E + 00 ± 0.00E + 00
F
9
1.27E + 00 ± 4.43E − 01
7.53E − 01 ± 3.43E − 01
1.46E + 00 ± 5.58E − 01
6.87E − 01 ± 3.60E − 01
F
10
2.51E + 01 ± 2.14E + 01
2.37E + 01 ± 2.50E − 01
5.70E − 01 ± 5.22E − 01
2.00E − 01 ± 2.83E − 01
F
11
1.34E + 00 ± 3.14E − 01
3.20E − 14 ± 6.15E − 15
4.47E − 01 ± 7.74E − 01
7.11E − 15 ± 0.00E + 00
F
12
3.93E − 02 ± 3.81E − 02
2.46E − 02 ± 3.64E − 02
1.40E − 02 ± 7.09E − 03
3.70E − 03 ± 5.23E − 03
F
13
5.17E + 01 ± 2.25E + 01
4.21E + 01 ± 6.77E + 00
6.04E + 01 ± 9.56E + 00
2.87E + 01 ± 3.68E + 00
F
14
4.05E + 01 ± 1.48E + 01
2.67E + 01 ± 3.06E + 00
5.40E + 01 ± 2.00E + 00
2.55E + 01 ± 1.34E + 01
F
15
5.68E − 14 ± 0.00E + 00
1.14E − 13 ± 0.00E + 00
7.58E − 14 ± 3.28E − 14
0.00E + 00 ± 0.00E + 00
F
16
1.04E + 01 ± 2.11E + 00
2.27E + 01 ± 5.57E − 01
6.56E − 11 ± 6.74E − 11
1.44E − 09 ± 3.21E − 09
F
17
2.41E + 01 ± 1.19E + 01
1.89E − 13 ± 3.28E − 14
9.62E + 00 ± 5.11E + 00
1.27E − 14 ± 1.48E − 15
F
18
2.51E + 01 ± 1.32E + 01
1.71E − 13 ± 5.68E − 14
5.11E + 00 ± 2.33E + 00
4.55E − 14 ± 2.54E − 14
F
19
2.06E + 01 ± 6.74E − 01
2.04E + 01 ± 1.85E − 01
2.05E + 01 ± 3.63E − 02
2.04E + 01 ±6.25E − 02
F
20
7.78E + 01 ± 1.38E + 01
5.93E + 01 ± 1.14E + 01
9.68E + 01 ± 4.34E + 01
3.68E + 01 ± 2.81E + 00From Table7, PSO-UEL achieves better results than PSO-W on 15 functions, and it successfully solves multimodal functions F7 and F8, which means that PSO-UEL has strong exploration ability. Meanwhile, we observe that PSO-EEL performed well in unimodal functions (F1, F2, F3, and F15) and Rosenbrock functions (F4, F10, and F16), but it fails to solve the other multimodal functions. This observation means that PSO-EEL is easier to be trapped in the local optima for multimodal functions. By integrating the two learning patterns, PSO-DLP obtains excellent performance.


## 5.5.5. Performance Comparisons between PSO-DLP and Other Evolutionary Algorithms

In this section, we compare PSO-DLP with the covariance matrix adaptation evolution strategy (CMA-ES) [43], self-adaptive DE (SaDE) [44], and adaptive DE with optional external archive (JADE) [45]. The CMA-ES algorithm is a powerful stochastic optimization technique, where the multivariate normal distribution has a mean and a covariance matrix constantly updated during the evolutionary process. Differential evolution (DE) has been shown to be an efficient stochastic search algorithm for solving optimization problems. SaDE provides a mutation strategy pool, where the strategy is adaptively selected according to its previous performance. The JADE is another adaptive DE-variant, where a novel mutation strategy is developed and an external archive is employed to store information of progress direction. Simulation results showed that JADE has competitive performances.Twenty benchmark functions as presented in Table1 are used to test the performance of four algorithms. The parameter values of CMA-ES and DEs are selected according to the recommendations of their respective references, as listed in Table 3. The maximum number of fitness evaluations is set at 1.00E+5 and population size N is set at 40 (N=(4+3log⁡(D)) for CMA-ES) for all algorithms. All functions are tested on 30 dimensions (D=30). All algorithms are run independently 30 times to ensure the fair assessment.The mean (Fm) and the standard deviation (SD) of the results obtained by each algorithm for all algorithms are summarized in Table8. From Table 8, we observed that PSO-DLP has better performance on eleven functions and has the same performance with DEs or CMA-ES on six functions. From the final rank, we can obtain the order of the involved algorithms: PSO-DLP, JADE, CMA-ES, and SADE. PSO-DLP has competitive performance among these algorithms on the tested functions.Table 8
Comparisons between PSO-DLP and other evolutionary algorithms in 30-D problems.
CMA-ES
JADE
SADE
PSO-DLP
F
1
4.83E − 131 ± 4.35E − 131
5.70E − 116 ± 3.19E − 116
4.57E − 81 ± 3.10E + 81
0.00E + 00 ± 0.00E + 00
F
2
1.51E − 26 ± 3.61E − 27
2.84E − 75 ± 3.25E − 76
9.37E − 62 ± 5.44E − 63
3.00E − 86 ± 4.25E − 86
F
3
5.31E − 01 ± 2.50E − 03
5.14E – 04 ± 2.14E − 05
1.12E − 03 ± 6.27E − 04
2.05E − 04 ± 1.24E − 05
F
4
7.43E − 02 ± 3.64E − 03
7.09E − 02 ± 2.54E − 03
1.25E + 01 ± 3.18E + 00
2.01E − 19 ± 6.19E − 19
F
5
7.11E − 15 ± 0.00E + 00
4.45E − 15 ± 3.24E − 15
1.18E − 14 ± 4.10E − 15
7.11E − 15 ± 0.00E + 00
F
6
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
F
7
1.54E + 01 ± 7.04E − 01
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
F
8
1.65E + 01 ± 4.95E + 00
0.00E + 00 ± 0.00E + 00
6.24E − 14 ± 3.54E − 15
0.00E + 00 ± 0.00E + 00
F
9
0.00E + 00 ± 0.00E + 00
7.53E − 01 ± 3.43E − 01
1.46E + 00 ± 5.58E − 01
6.87E − 01 ± 3.60E − 01
F
10
2.88E + 01 ± 2.20E − 02
1.41E + 01 ± 4.31E + 00
2.98E + 01 ± 3.08E + 00
2.00E − 01 ±2.83E − 01
F
11
1.03E + 00 ± 6.07E − 02
7.34E − 15 ± 1.56E − 15
7.11E − 15 ± 0.00E + 00
7.11E − 15 ± 0.00E + 00
F
12
0.00E + 00 ± 0.00E + 00
1.23E − 02 ± 3.98E − 03
8.21E − 03 ± 9.21E − 04
3.70E − 03 ± 5.23E − 03
F
13
3.12E + 01 ± 1.05E − 01
2.81E + 01 ± 3.15E − 01
3.14E + 01 ± 9.56E + 00
2.87E + 01 ± 3.68E + 00
F
14
7.89E + 01 ± 3.58E − 01
2.71E + 01 ± 1.32E + 00
2.86E + 01 ± 3.45E − 01
2.55E + 01 ± 1.34E + 01
F
15
1.77E − 26 ± 5.19E − 27
5.68E − 24 ± 3.42E − 24
4.78E − 23 ± 9.85E − 24
0.00E + 00 ± 0.00E + 00
F
16
1.23E + 00 ± 2.50E − 03
1.02E + 01 ± 1.15E + 00
4.86E + 01 ± 5.78E + 00
1.44E − 09 ± 3.21E − 09
F
17
1.94E + 01 ± 7.74E + 00
1.89E − 14 ± 3.28E − 15
1.62E − 13 ± 1.71E − 14
1.27E − 14 ± 1.48E − 15
F
18
2.14E + 01 ± 6.34E + 00
1.71E − 13 ± 5.68E − 14
2.35E − 13 ± 5.24E − 14
4.55E − 14 ± 2.54E − 14
F
19
2.12E + 01 ± 2.14E − 03
2.09E + 01 ± 1.85E − 01
2.09 + 01 ± 4.61E − 02
2.04E + 01 ±6.25E − 02
F
20
4.87E + 01 ± 1.12E + 01
3.95E + 01 ± 8.35E + 00E
5.67E + 01 ± 3.39E + 00
3.68E + 01 ± 2.81E + 00
Average rank
2.9
2.15
3.25
1.2
Final rank
3
2
4
1


## 6. Conclusion

In this paper we study the motion behavior of the swarm and point out that the probabilistic characteristics of the learning factor and the distribution factor in the updating equation can affect the searching behavior of particles. We develop a Particle Swarm Optimization with double learning patterns (PSO-DLP), which uses two swarms with different searching ability and the interaction mechanism between swarms to control exploration and exploitation searches. In the PSO-DLP, the master swarm encourages the exploration process while the slave swarm concentrates on a small region in order to find its best local optimum easily and accelerate its convergence. The two swarms fulfill their searching tasks by adopting two different learning patterns in which the searching behavior is controlled by adjusting the probabilistic characteristics of the learning factor and the distribution factor.The significant feature of PSO-DLP is that it has a better balance between high precision and fast convergence. Another attractive property of PSO-DLP is that it employs the probabilistic characteristics of the learning parameters to control the swarm diversity so that it does not need any additional operation.In our future work, we will study the effect of the topological structure of the uniform exploration learning pattern. And PSO-DLP will be extended to the image segmentation and multiobjective problems.



---

*Source: 6510303-2015-12-27.xml*