# Quantum-Behaved Particle Swarm Optimization Based on Diversity-Controlled

Haixia Long, Haiyan Fu, Chun Shi

<figure><img src="image_1.png" /></figure>

► To cite this version:

Haixia Long, Haiyan Fu, Chun Shi. Quantum-Behaved Particle Swarm Optimization Based on Diversity-Controlled. 13th Conference on e-Business, e-Services and e-Society (I3E), Nov 2014, Sanya, China. pp.132-143, 10.1007/978-3-662-45526-5_13 . hal-01342138

HAL Id: hal-01342138

https://inria.hal.science/hal-01342138

Submitted on 5 Jul 2016

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_2.png" /></figure>
Quantum-behaved particle swarm optimization based on
Diversity-controlled

HaiXia Long¹, , HaiYan Fu², Chun Shi³

¹,²,³ School of Information Science Technology, Hainan Normal University, Haikou 571158,
Hainan, China

¹haixia_long@163.com

²48318159@qq.com

³605515770@qq.com

**Abstract.** Quantum-behaved particle swarm optimization (QPSO) algorithm is a global convergence guaranteed algorithms, which outperforms original PSO in search ability but has fewer parameters to control. But QPSO algorithm is to be easily trapped into local optima as a result of the rapid decline in diversity. So this paper describes diversity-controlled into QPSO (QPSO-DC) to enhance the diversity of particle swarm, and then improve the search ability of QPSO. The experiment results on benchmark functions show that QPSO-DC has stronger global search ability than QPSO and standard PSO.

**Keywords:** global convergence; quantum-behaved particle swarm optimization; diversity-controlled; benchmark function.

# 1 Introduction

Particle swarm optimization (PSO) is a kind of stochastic optimization algorithms proposed by Kennedy and Eberhart [1] that can be easily implemented and is computationally inexpensive. The core of PSO is based on an analogy of the social behavior of flocks of birds when they search for food. PSO has been proved to be an efficient approach for many continuous global optimization problems. However, as demonstrated by F. Van Den Bergh [2], PSO is not a global convergence guaranteed algorithm because the particle is restricted to a finite sampling space for each of the iterations. This restriction weakens the global search ability of the algorithm and may lead to premature convergence in many cases.

Several authors developed strategies to improve on PSO. Clerc [3] suggested a PSO variant in which the velocity to the best point found by the swarm is replaced by the velocity to the current best point of the swarm, although he does not test this variant. Clerc [4] and Zhang et al. [5] dynamically change the size of the swarm according to the performance of the algorithm. Eberhart and Shi [6], He et al. [7] adopted strategies based on dynamically modifying the value of the PSO parameter called inertia weight. Various other solutions have been proposed for preventing premature convergence: objective functions that change over time [8]; noisy evaluation of the function objective [9]; repulsion to keep particles away from the optimum [10]; dis-
persion between particles that are too close to one another [11]; reduction of the attraction of the swarm center to prevent the particles clustering too tightly in one region of the search space [12]; hybrids with other meta-heuristic such as genetic algorithms [13]; or ant colony optimization [14]; an up-to-date overview of the PSO [15].

Recently, a new variant of PSO, called Quantum-behaved Particle Swarm Optimization (QPSO) [16, 17], which is inspired by quantum mechanics and particle swarm optimization model. QPSO has only the position vector without velocity, so it is simpler than standard particle swarm optimization algorithm. Furthermore, several benchmark test functions show that QPSO performs better than standard particle swarm optimization algorithm. Although the QPSO algorithm is a promising algorithm for the optimization problems, like other evolutionary algorithm, QPSO also confronts the problem of premature convergence, and decrease the diversity in the latter period of the search. Therefore a lot of revised QPSO algorithms have been proposed since the QPSO had emerged. In Sun et al. [18], the mechanism of probability distribution was proposed to make the swarm more efficient in global search. Simulated Annealing is further adopted to effectively employ both the ability to jump out of the local minima in Simulated Annealing and the capability of searching the global optimum in QPSO algorithm [19]. Mutation operator with Gaussian probability distribution was introduced to enhance the performance of QPSO in Coelho [20]. Immune operator based on the immune memory and vaccination was introduced into QPSO to increase the convergent speed by using the characteristic of the problem to guide the search process [21].

In this paper, QPSO with diversity-controlled is introduced. This strategy is to prevent the diversity of particle swarm declining in the search of later stage.

The rest of the paper is organized as follows. In Section 2, the principle of the PSO is introduced. The concept of QPSO is presented in Section 3 and the QPSO with diversity-controlled is proposed in Section 4. Section 5 gives the numerical results on some benchmark functions and discussion. Some concluding remarks and future work are presented in the last section.

## 2 PSO Algorithm

In the original PSO with M individuals, each individual is treated as an infinitesimal particle in the D-dimensional space, with the position vector and velocity vector of particle i, $X_i(t) = (X_{i1}(t), X_{i2}(t), \dots, X_{iD}(t))$ and $V_i(t) = (V_{i1}(t), V_{i2}(t), \dots, V_{iD}(t))$. The particle moves according to the following equations:

$$V_{ij}(t+1) = V_{ij}(t) + c_1 \cdot r_1 \cdot (P_{ij}(t) - X_{ij}(t)) + c_2 \cdot r_2 \cdot (P_{gj}(t) - X_{ij}(t)) \quad (1)$$

$$X_{ij}(t+1) = X_{ij}(t) + V_{ij}(t+1) \quad (2)$$

for $i=1,2,\dots,M$; $j=1,2,\dots,D$. The parameters $c_1$ and $c_2$ are called the acceleration coefficients. Vector $P_i = (P_{i1}, P_{i2}, \dots, P_{iD})$ known as the personal best position, is the best previous position (the position giving the best fitness value so far) of particle i, vector $P_g = (P_{g1}, P_{g2}, \dots, P_{gD})$ is the position of the best particle among all the particles and is known as the global best position. The parameters $r_1$ and $r_2$ are two random num-
bers distributed uniformly in (0, 1), that is $r_1, r_2 \sim U(0,1)$. Generally, the value of $V_{ij}$ is restricted in the interval $[-V_{max}, V_{max}]$.

Many revised versions of PSO algorithm are proposed to improve the performance since its origin in 1995. Two most important improvements are the version with an Inertia Weight [22], and a Constriction Factor [23]. In the inertia-weighted PSO the velocity is updated by using

$$V_{ij}(t+1) = w \cdot V_{ij}(t) + c_1 \cdot r_1(P_{ij}(t) - X_{ij}(t)) + c_2 \cdot r_2(P_{gj}(t) - X_{ij}(t)) \quad (3)$$

while in the Constriction Factor model the velocity is calculated by using

$$V_{ij}(t+1) = K \cdot [V_{ij}(t) + c_1 \cdot r_2 \cdot (P_{ij}(t) - X_{ij}(t)) + c_2 \cdot r_2 \cdot (P_{gj}(t) - X_{ij}(t))] \quad (4)$$

where

$$k = \frac{2}{|2 - \varphi - \sqrt{\varphi^2 - 4\varphi}|} \quad \varphi = c_1 + c_2, \quad \varphi > 4 \quad (5)$$

The inertia-weighted PSO was introduced by Shi and Eberhart [6] and is known as the Standard PSO.

## 3 QPSO Algorithm

Trajectory analyses in Clerc and Kennedy [24] demonstrated the fact that convergence of PSO algorithm may be achieved if each particle converges to its local attractor $p_i = (p_{i1}, p_{i2}, \dots, p_{iD})$ with coordinates

$$p_{ij}(t) = (c_1 r_1 P_{ij}(t) + c_2 r_2 P_{gj}(t)) / (c_1 r_1 + c_2 r_2), \text{ or } p_{ij}(t) = \varphi \cdot P_{ij}(t) + (1-\varphi) \cdot P_{gj}(t) \quad (6)$$

where $\varphi = c_1 r_1 / (c_1 r_1 + c_2 r_2)$. It can be seen that the local attractor is a stochastic attractor of particle i that lies in a hyper-rectangle with $P_i$ and $P_g$ being two ends of its diagonal. We introduce the concepts of QPSO as follows.

Assume that each individual particle move in the search space with a $\delta$ potential on each dimension, of which the center is the point $p_{ij}$. For simplicity, we consider a particle in one-dimensional space, with point p the center of potential. Solving Schrödinger equation of one-dimensional $\delta$ potential well, we can get the probability distribution function $D(x) = e^{-2|p-x|/L}$. Using Monte Carlo method, we obtain

$$x = p \pm \frac{L}{2} \ln(1/u) \quad u \sim U(0,1) \quad (7)$$

The above is the fundamental iterative equation of QPSO.

In Sun et al. (2004b) a global point called Mainstream Thought or Mean Best Position of the population is introduced into PSO. The mean best position, denoted as C, is defined as the mean of the personal best positions among all particles. That is

$$C(t) = (C_1(t), C_2(t), \dots, C_D(t)) = \left( \frac{1}{M} \sum_{i=1}^{M} P_{i1}(t), \frac{1}{M} \sum_{i=1}^{M} P_{i2}(t), \dots, \frac{1}{M} \sum_{i=1}^{M} P_{iD}(t) \right) \quad (8)$$

where M is the population size and $P_i$ is the personal best position of particle i. Then the value of L is evaluated by $L = 2\alpha \cdot |C_j(t) - X_{ij}(t)|$ and the position are updated by
$$X_{ij}(t+1) = p_{ij}(t) \pm \alpha \cdot |C_j(t) - X_{ij}(t)| \cdot \ln(1/u) \quad (9)$$

where parameter α is called Contraction-Expansion (CE) Coefficient, which can be tuned to control the convergence speed of the algorithms. Generally, we always call the PSO with equation (9) Quantum-behaved Particle Swarm Optimization (QPSO), where parameter α must be set as α < 1.782 to guarantee convergence of the particle [16]. In most cases, α decrease linearly from α₀ to α₄ (α₀ < α₄).

We outline the procedure of the QPSO algorithm as follows:

Procedure of the QPSO algorithm:

Step1: Initialize the population;

Step2: Computer the personal position and global best position;

Step3: Computer the mean best position C;

Step4: Properly select the value of α ;

Step 5: Update the particle position according to Eq. (9);

Step6: While the termination condition is not met, return to step (2);

Step7: Output the results.

## 4 QPSO with diversity-controlled

QPSO is a promising optimization problem solver that outperforms PSO in many real application areas. First of all, the introduced exponential distribution of positions makes QPSO global convergent. The QPSO algorithm in the initial stage of search, as the particle swarm initialization, its diversity is relatively high. In the subsequent search process, due to the gradual convergence of the particle, the diversity of the population continues to decline. As the result, the ability of local search ability is continuously enhanced, and the global convergence ability is continuously weakened. In early and middle search, reducing the diversity of particle swarm optimization for contraction efficiency improvement is necessary, however, to late stage of search, because the particles are gathered in a relatively small range, particles swarm diversity is very low, the global search ability becomes very weak, the ability for a large range of search has been very small, this algorithm will occur the phenomenon of premature.

To overcome this shortcoming, we introduce diversity-controlled into QPSO.

The population diversity of the QPSO-DC is denoted as diversity (pbest) and is measured by average Euclidean distance from the particle's personal best position to the mean best position, namely

$$\text{diversity(pbest)} = \frac{1}{|M|} \cdot \sum_{l=1}^{M} \sqrt{\sum_{l=1}^{D} (\text{pbest}_{l} - \text{pbest})^2} \quad (10)$$

where M is the population of the particle, |M| is the length of longest the diagonal in the search pace, and D is the dimension of the problem. Hence, we may guide the search of the particles with the diversity measures when the algorithm is running. In the QPSO-DC algorithm, only low bound dLow is set for diversity (pbest) to prevent the diversity from constantly decreasing. The procedure of the algorithm is as follows. After initialization, the algorithm is running in convergence mode. In process of convergence, the convergence mode is realized by Contraction-Expansion (CE) Coeffi-
cient. On the course of evolution, if the diversity measure diversity (pbest) of the swarm drops to below the low bound d<sub>low</sub>, the mean best position is reinitialized.

## 5 Experiment Results and Discussion

To test the performance of the QPSO with diversity-controlled, seven widely known benchmark functions listed in Table 1 are tested for comparison with Standard PSO (SPSO), QPSO. These functions are all minimization problems with minimum objective function values zeros. The initial range of the population listed in Table 2 is asymmetry as used in Shi and Eberhart [25]. Table 2 also lists V<sub>max</sub> for SPSO. The fitness value is set as function value and the neighborhood of a particle is the whole population.

As in Angeline [22], for each function, three different dimension sizes are tested. They are dimension sizes: 10, 20 and 30. The maximum number of generations is set as 1000, 1500, and 2000 corresponding to the dimensions 10, 20, and 30 for first six functions, respectively. The maximum generation for the last function is 2000.In order to investigate whether the QPSO-RS algorithm well or not, different population sizes are used for each function with different dimension. They are population sizes of 20, 40, and 80.For SPSO, the acceleration coefficients are set to be c1=c2=2 and the inertia weight is decreasing linearly from 0.9 to 0.4 as in Shi and Eberhart [25]. In experiments for QPSO, the value of CE Coefficient varies from 1.0 to 0.5 linearly over the running of the algorithm as in [18], while in QPSO-DC, the value of CE Coefficient is listed in Table 3 and Table 4. From the Table 3 and Table 4, we also obtain the CE COEFFICIENT of QPSO-DC decreases from 0.8 to 0.5 linearly. We had 50 trial runs for every instance and recorded mean best fitness and standard deviation

The mean values and standard deviations of best fitness values for 50 runs of each function are recorded in Table 5 to Table 11.

<table><caption>Table 1. Expression of the five tested benchmark functions</caption><thead><tr><th></th><th>Function Expression</th><th>Search Domain</th></tr></thead><tbody><tr><td>Sphere</td><td>f<sub>1</sub>(X) = &sum;<sub>i=1</sub><sup>n</sup> x<sub>i</sub><sup>2</sup></td><td>-100 &le; x<sub>i</sub> &le; 100</td></tr><tr><td>Rosenbrock</td><td>f<sub>2</sub>(X) = &sum;<sub>i=1</sub><sup>n-1</sup> (100 &middot; (x<sub>i</sub><sup>2</sup> + x<sub>i</sub> - 1)<sup>2</sup>)</td><td>-100 &le; x<sub>i</sub> &le; 100</td></tr><tr><td>Rastrigin</td><td>f<sub>3</sub>(X) = &sum;<sub>i=1</sub><sup>n</sup> (x<sub>i</sub><sup>2</sup> - 10 &middot; cos(2&pi;x<sub>i</sub>) + 10)</td><td>-10 &le; x<sub>i</sub> &le; 10</td></tr><tr><td>Greiwank</td><td>f<sub>4</sub>(X) = <sup>1</sup>&frasl;<sub>4000</sub> &sum;<sub>i=1</sub><sup>n</sup> x<sub>i</sub><sup>2</sup> - &prod;<sub>i=1</sub><sup>n</sup> cos(<sup>x<sub>i</sub></sup>&frasl;<sub>&radic;i</sub>) + 1</td><td>-600 &le; x<sub>i</sub> &le; 600</td></tr><tr><td>Ackley</td><td>f<sub>5</sub> = 20 + e - 20e<sup>-<sup>1</sup>&frasl;<sub>5</sub> &sum;<sub>i=1</sub><sup>n</sup> x<sub>i</sub><sup>2</sup></sup> - e - <sup>1</sup>&frasl;<sub>n</sub> &sum;<sub>i=1</sub><sup>n</sup> cos(2&pi;x<sub>i</sub>)</td><td>-30 &le; x<sub>i</sub> &le; 30</td></tr><tr><td>Schwefel</td><td>f<sub>6</sub> = 418.9829 &sum;<sub>i=1</sub><sup>n</sup> (x<sub>i</sub> sin(&radic|x<sub>i</sub>|))</td><td>-500 &le; x<sub>i</sub> &le; 500</td></tr></tbody></table>
<table><caption>Table 2. The initial range of population for all the tested algorithms and Vmax for SPSO</caption><tr><td>Shaffer's</td><td>f<sub>7</sub>(X) = 0.5 + <div style="display: inline-block; vertical-align: middle; text-align: center;"><div style="border-bottom: 1px solid black; padding: 0 5px;">(sin(√x<sup>2</sup> + y<sup>2</sup>))<sup>2</sup></div><div style="padding: 0 5px;">(1.0 + 0.001(x<sup>2</sup> + y<sup>2</sup>))<sup>2</sup></div></div></td><td>-100 ≤ x<sub>i</sub> ≤ 100</td></tr></table>

<table><caption>Table 3. Parameter value of QPSO-dc</caption><thead><tr><th></th><th>Initial Range</th><th>Vmax</th></tr></thead><tbody><tr><td>f<sub>1</sub></td><td>(50, 100)</td><td>100</td></tr><tr><td>f<sub>2</sub></td><td>(15, 30)</td><td>100</td></tr><tr><td>f<sub>3</sub></td><td>(2.56, 5.12)</td><td>10</td></tr><tr><td>f<sub>4</sub></td><td>(300, 600)</td><td>600</td></tr><tr><td>f<sub>5</sub></td><td>(15,30)</td><td>30</td></tr><tr><td>f<sub>6</sub></td><td>(250,500)</td><td>500</td></tr><tr><td>f<sub>7</sub></td><td>(30, 100)</td><td>100</td></tr></tbody></table>

<table><caption>Table 4. Table 3 (continue)</caption><thead><tr><th rowspan="2">CE<br>Coefficient</th><th colspan="3">Sphere function</th><th colspan="2">Rosenbrock function</th><th colspan="2">Rastrigin function</th></tr><tr><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th></tr></thead><tbody><tr><td>(1.0,0.5)</td><td>1.0050e-013</td><td>2.8029e-013</td><td>63.6787</td><td>112.2467</td><td>96.4876</td><td>11.2102</td></tr><tr><td>(0.9,0.5)</td><td>2.1644e-017</td><td>3.3232e-017</td><td>53.2366</td><td>75.9345</td><td>94.8874</td><td>11.2350</td></tr><tr><td>(0.8,0.5)</td><td>4.9846e-026</td><td>1.7413e-025</td><td>39.2303</td><td>37.6453</td><td>89.7231</td><td>9.9548</td></tr><tr><td>(0.7,0.5)</td><td>9.7934e-022</td><td>3.6896e-021</td><td>73.4979</td><td>100.0602</td><td>83.4991</td><td>11.6756</td></tr><tr><td>(1.0,0.4)</td><td>4.6673e-012</td><td>2.4765e-011</td><td>48.4907</td><td>46.6895</td><td>81.5502</td><td>13.5262</td></tr><tr><td>(0.9,0.4)</td><td>1.9889e-014</td><td>7.9829e-014</td><td>78.9340</td><td>124.4234</td><td>80.8902</td><td>12.1062</td></tr><tr><td>(0.8,0.4)</td><td>6.0362e-015</td><td>3.4761e-014</td><td>72.1817</td><td>102.6235</td><td>74.1639</td><td>10.4042</td></tr><tr><td>(0.7,0.4)</td><td>1.6104e-018</td><td>4.5714e-018</td><td>102.6623</td><td>155.5243</td><td>70.7840</td><td>15.0399</td></tr><tr><td>(1.0,0.3)</td><td>1.7248e-010</td><td>4.4884e-010</td><td>59.0231</td><td>74.3503</td><td>64.9413</td><td>19.3783</td></tr><tr><td>(0.9,0.3)</td><td>1.0957e-011</td><td>6.1253e-011</td><td>76.6616</td><td>103.9478</td><td>59.4859</td><td>17.9470</td></tr><tr><td>(0.8,0.3)</td><td>6.2854e-014</td><td>1.2280e-013</td><td>80.0582</td><td>91.4265</td><td>56.3751</td><td>17.4575</td></tr><tr><td>(0.7,0.3)</td><td>2.4054e-013</td><td>9.3876e-013</td><td>106.6513</td><td>133.7599</td><td>48.8128</td><td>20.5664</td></tr></tbody></table>

<table><thead><tr><th rowspan="2">CE<br>Coefficient</th><th colspan="2">Griewank function</th><th colspan="2">Ackley function</th><th colspan="2">Schwefel function</th><th colspan="2">Shaffer's f6 function</th></tr><tr><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th></tr></thead><tbody><tr><td>(1.0,0.5)</td><td>0.0219</td><td>0.0254</td><td>3.0209e-013</td><td>4.3354e-013</td><td>5.0840e+003</td><td>238.6654</td><td>7.7802e-004</td><td>0.0027</td></tr><tr><td>(0.9,0.5)</td><td>0.0165</td><td>0.0171</td><td>3.2649e-014</td><td>8.3201e-014</td><td>4.9791e+003</td><td>218.1045</td><td>5.8366e-004</td><td>0.0023</td></tr><tr><td>(0.8,0.5)</td><td>0.0078</td><td>0.0096</td><td>1.0978e-014</td><td>9.2924e-015</td><td>3.9491e+003</td><td>682.3425</td><td>7.8734e-004</td><td>0.0027</td></tr><tr><td>(0.7,0.5)</td><td>0.0141</td><td>0.0183</td><td>3.9826e-014</td><td>5.6935e-014</td><td>4.4273e+003</td><td>347.6864</td><td>0.0019</td><td>0.0039</td></tr><tr><td>(1.0,0.4)</td><td>0.0131</td><td>0.0170</td><td>3.7380e-011</td><td>1.3192e-010</td><td>5.0548e+003</td><td>251.4751</td><td>5.8369e-004</td><td>0.0023</td></tr><tr><td>(0.9,0.4)</td><td>0.0182</td><td>0.0191</td><td>1.5916e-011</td><td>3.8720e-011</td><td>5.0319e+003</td><td>238.8422</td><td>7.9738e-004</td><td>0.0027</td></tr></tbody></table>
<table><caption>Table 5. Numerical results on Sphere function</caption><thead><tr><th></th><th></th><th></th><th>012</th><th>012</th><th></th><th></th><th>004</th></tr></thead><tbody><tr><td>(0.8,0.4)</td><td>0.0096</td><td>0.0106</td><td>8.0437e-013</td><td>1.2495e-012</td><td>4.8485e+003</td><td>267.2251</td><td>0.0016</td><td>0.0036</td></tr><tr><td>(0.7,0.4)</td><td>0.0130</td><td>0.0175</td><td>0.0231</td><td>0.1634</td><td>4.3537e+003</td><td>513.4628</td><td>0.0027</td><td>0.0044</td></tr><tr><td>(1.0,0.3)</td><td>0.0139</td><td>0.0143</td><td>3.9977e-010</td><td>7.1079e-010</td><td>4.9716e+003</td><td>262.9720</td><td>1.0843e-007</td><td>2.0595e-007</td></tr><tr><td>(0.9,0.3)</td><td>0.0129</td><td>0.0207</td><td>8.3162e-011</td><td>1.1640e-010</td><td>4.9157e+003</td><td>242.6659</td><td>7.9009e-004</td><td>0.0027</td></tr><tr><td>(0.8,0.3)</td><td>0.0148</td><td>0.0141</td><td>1.4957e-010</td><td>3.6527e-010</td><td>4.7433e+003</td><td>334.3465</td><td>0.0017</td><td>0.0038</td></tr><tr><td>(0.7,0.3)</td><td>0.0142</td><td>0.0123</td><td>0.0231</td><td>0.1634</td><td>4.8584e+003</td><td>273.0154</td><td>0.0027</td><td>0.0044</td></tr></tbody></table>

<table><caption>Table 6. Numerical results on Rosenbrock function</caption><thead><tr><th rowspan="2">M</th><th rowspan="2">Dim.</th><th rowspan="2">Gmax</th><th colspan="2">SPSO</th><th colspan="2">QPSO</th><th colspan="2">QPSO-DC</th></tr><tr><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th></tr></thead><tbody><tr><td rowspan="4">20</td><td>10</td><td>1000</td><td>4.6119e-021</td><td>1.0352e-020</td><td>3.1979e-043</td><td>2.2057e-042</td><td>5.2719e-045</td><td>1.5684e-045</td></tr><tr><td>20</td><td>1500</td><td>9.0266e-012</td><td>3.5473e-011</td><td>1.9197e-024</td><td>7.1551e-024</td><td>2.5427e-026</td><td>4.2876e-026</td></tr><tr><td>30</td><td>2000</td><td>3.9672e-008</td><td>7.0434e-008</td><td>7.3736e-015</td><td>2.1796e-014</td><td>3.2486e-016</td><td>5.3971e-016</td></tr><tr><td>10</td><td>1000</td><td>1.3178e-024</td><td>3.7737e-024</td><td>2.7600e-076</td><td>1.8954e-075</td><td>8.4527e-074</td><td>2.3460e-074</td></tr><tr><td rowspan="4">40</td><td>20</td><td>1500</td><td>2.3057e-015</td><td>6.6821e-015</td><td>3.9152e-044</td><td>1.8438e-043</td><td>5.4381e-045</td><td>8.5426e-045</td></tr><tr><td>30</td><td>2000</td><td>1.1286e-010</td><td>2.2994e-010</td><td>2.6424e-031</td><td>6.3855e-031</td><td>2.5419e-032</td><td>1.3645e-032</td></tr><tr><td>10</td><td>1000</td><td>1.6097e-028</td><td>7.1089e-028</td><td>2.5607e-103</td><td>6.4847e-103</td><td>1.9824e-104</td><td>2.5681e-104</td></tr><tr><td>20</td><td>1500</td><td>6.3876e-018</td><td>1.4821e-017</td><td>1.4113e-068</td><td>7.4451e-068</td><td>1.5873e-068</td><td>4.3876e-068</td></tr><tr><td rowspan="2">80</td><td>30</td><td>2000</td><td>3.2771e-013</td><td>7.5971e-013</td><td>6.5764e-050</td><td>3.6048e-049</td><td>2.0254e-050</td><td>1.2574e-050</td></tr></tbody></table>

<table><caption>Table 7. Numerical results on Rastrigin function</caption><thead><tr><th rowspan="2">M</th><th rowspan="2">Dim.</th><th rowspan="2">Gmax</th><th colspan="2">SPSO</th><th colspan="2">QPSO</th><th colspan="2">QPSO-DC</th></tr><tr><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th></tr></thead><tbody><tr><td rowspan="4">20</td><td>10</td><td>1000</td><td>51.0633</td><td>153.7913</td><td>9.5657</td><td>16.6365</td><td>7.5341</td><td>0.8634</td></tr><tr><td>20</td><td>1500</td><td>100.2386</td><td>140.9822</td><td>82.4294</td><td>138.2429</td><td>32.8419</td><td>28.3476</td></tr><tr><td>30</td><td>2000</td><td>160.4400</td><td>214.0316</td><td>98.7948</td><td>122.5744</td><td>69.3102</td><td>54.3791</td></tr><tr><td>10</td><td>1000</td><td>24.9641</td><td>49.5707</td><td>8.9983</td><td>17.8202</td><td>4.9810</td><td>3.2094</td></tr><tr><td rowspan="4">40</td><td>20</td><td>1500</td><td>59.8256</td><td>95.9586</td><td>40.7449</td><td>41.1751</td><td>15.3429</td><td>12.3076</td></tr><tr><td>30</td><td>2000</td><td>124.1786</td><td>269.7275</td><td>43.5582</td><td>38.0533</td><td>35.2487</td><td>24.8619</td></tr><tr><td>10</td><td>1000</td><td>19.0259</td><td>41.6069</td><td>6.8312</td><td>0.3355</td><td>4.1086</td><td>3.5476</td></tr><tr><td>20</td><td>1500</td><td>40.2289</td><td>46.8491</td><td>33.5287</td><td>31.6415</td><td>15.6271</td><td>0.0367</td></tr><tr><td rowspan="2">80</td><td>30</td><td>2000</td><td>56.8773</td><td>57.8794</td><td>44.5946</td><td>31.6739</td><td>22.3706</td><td>0.1648</td></tr></tbody></table>

<table><thead><tr><th rowspan="2">M</th><th rowspan="2">Dim.</th><th rowspan="2">Gmax</th><th colspan="2">SPSO</th><th colspan="2">QPSO</th><th colspan="2">QPSO-DC</th></tr><tr><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th></tr></thead><tbody><tr><td rowspan="4">20</td><td>10</td><td>1000</td><td>5.8310</td><td>2.5023</td><td>4.0032</td><td>2.1409</td><td>2.6871</td><td>1.9684</td></tr><tr><td>20</td><td>1500</td><td>23.3922</td><td>6.9939</td><td>15.0648</td><td>6.0725</td><td>13.5970</td><td>12.3458</td></tr><tr><td>30</td><td>2000</td><td>51.1831</td><td>12.5231</td><td>28.3027</td><td>12.5612</td><td>22.3694</td><td>4.2061</td></tr><tr><td>10</td><td>1000</td><td>3.7812</td><td>1.4767</td><td>2.6452</td><td>1.5397</td><td>1.8541</td><td>2.1380</td></tr><tr><td rowspan="3">40</td><td>20</td><td>1500</td><td>18.5002</td><td>5.5980</td><td>11.3109</td><td>3.5995</td><td>12.3471</td><td>7.2684</td></tr><tr><td>30</td><td>2000</td><td>39.5259</td><td>10.3430</td><td>18.9279</td><td>4.8342</td><td>14.3796</td><td>6.9173</td></tr><tr><td>10</td><td>1000</td><td>2.3890</td><td>1.1020</td><td>2.2617</td><td>1.4811</td><td>1.0367</td><td>1.3574</td></tr></tbody></table>
<table><caption>Table 8. Numerical results on Griewank function</caption><tr><td>80</td><td>20</td><td>1500</td><td>12.8594</td><td>3.6767</td><td>8.4121</td><td>2.5798</td><td>6.3247</td><td>4.6873</td></tr><tr><td></td><td>30</td><td>2000</td><td>30.2140</td><td>7.0279</td><td>14.8574</td><td>5.0408</td><td>13.6975</td><td>5.3671</td></tr></table>

<table><caption>Table 9. Numerical results on Ackley function</caption><thead><tr><th rowspan="2">M</th><th rowspan="2">Dim.</th><th rowspan="2">Gmax</th><th colspan="2">SPSO</th><th colspan="2">QPSO</th><th colspan="2">QPSO-DC</th></tr><tr><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th></tr></thead><tbody><tr><td rowspan="4">20</td><td>10</td><td>1000</td><td>0.0920</td><td>0.0469</td><td>0.0739</td><td>0.0559</td><td>0.0657</td><td>0.0502</td></tr><tr><td>20</td><td>1500</td><td>0.0288</td><td>0.0285</td><td>0.0190</td><td>0.0208</td><td>0.0262</td><td>0.0227</td></tr><tr><td>30</td><td>2000</td><td>0.0150</td><td>0.0145</td><td>0.0075</td><td>0.0114</td><td>0.0082</td><td>0.0235</td></tr><tr><td>10</td><td>1000</td><td>0.0873</td><td>0.0430</td><td>0.0487</td><td>0.0241</td><td>0.0587</td><td>0.0822</td></tr><tr><td rowspan="4">40</td><td>20</td><td>1500</td><td>0.0353</td><td>0.0300</td><td>0.0206</td><td>0.0197</td><td>0.0135</td><td>0.0431</td></tr><tr><td>30</td><td>2000</td><td>0.0116</td><td>0.0186</td><td>0.0079</td><td>0.0092</td><td>0.0020</td><td>0.0123</td></tr><tr><td>10</td><td>1000</td><td>0.0658</td><td>0.0266</td><td>0.0416</td><td>0.0323</td><td>0.0424</td><td>0.0682</td></tr><tr><td>20</td><td>1500</td><td>0.0304</td><td>0.0248</td><td>0.0137</td><td>0.0135</td><td>0.0050</td><td>0.0103</td></tr><tr><td>80</td><td>30</td><td>2000</td><td>0.0161</td><td>0.0174</td><td>0.0071</td><td>0.0109</td><td>1.0570e-006</td><td>5.3089e-006</td></tr></tbody></table>

<table><caption>Table 10. Numerical results on Schwefel function</caption><thead><tr><th rowspan="2">M</th><th rowspan="2">Dim.</th><th rowspan="2">Gmax</th><th colspan="2">SPSO</th><th colspan="2">QPSO</th><th colspan="2">QPSO-DC</th></tr><tr><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th></tr></thead><tbody><tr><td rowspan="4">20</td><td>10</td><td>1000</td><td>2.0489e-011</td><td>3.0775e-011</td><td>6.8985e-012</td><td>1.2600e-011</td><td>2.7356e-015</td><td>5.0243e-016</td></tr><tr><td>20</td><td>1500</td><td>0.0285</td><td>0.2013</td><td>1.5270e-008</td><td>2.1060e-008</td><td>9.7700e-015</td><td>5.8751e-015</td></tr><tr><td>30</td><td>2000</td><td>0.2044</td><td>0.4899</td><td>4.3113e-007</td><td>4.4188e-007</td><td>7.1797e-013</td><td>1.5299e-012</td></tr><tr><td>10</td><td>1000</td><td>2.4460e-013</td><td>5.2901e-013</td><td>2.5935e-015</td><td>5.0243e-016</td><td>2.6645e-015</td><td>0</td></tr><tr><td rowspan="4">40</td><td>20</td><td>1500</td><td>2.6078e-008</td><td>4.0653e-008</td><td>6.3491e-013</td><td>1.3305e-012</td><td>3.5882e-015</td><td>1.5742e-015</td></tr><tr><td>30</td><td>2000</td><td>3.7506e-006</td><td>6.4828e-006</td><td>5.5577e-011</td><td>8.6059e-011</td><td>6.5015e-015</td><td>1.8772e-015</td></tr><tr><td>10</td><td>1000</td><td>5.5778e-015</td><td>7.4138e-015</td><td>2.4514e-015</td><td>8.5229e-016</td><td>2.2382e-015</td><td>1.1662e-015</td></tr><tr><td>20</td><td>1500</td><td>5.2979e-010</td><td>7.2683e-010</td><td>5.8620e-015</td><td>1.6446e-015</td><td>2.7356e-015</td><td>5.0243e-016</td></tr><tr><td>80</td><td>30</td><td>2000</td><td>1.6353e-007</td><td>2.1300e-007</td><td>6.7253e-014</td><td>4.4759e-014</td><td>5.4357e-015</td><td>1.4866e-015</td></tr></tbody></table>

<table><thead><tr><th rowspan="2">M</th><th rowspan="2">Dim.</th><th rowspan="2">Gmax</th><th colspan="2">SPSO</th><th colspan="2">QPSO</th><th colspan="2">QPSO-DC</th></tr><tr><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th></tr></thead><tbody><tr><td rowspan="4">20</td><td>10</td><td>1000</td><td>630.6798</td><td>169.9164</td><td>1.0784e+003</td><td>342.1967</td><td>740.4763</td><td>293.0045</td></tr><tr><td>20</td><td>1500</td><td>2.0827e+003</td><td>327.0313</td><td>4.0026e+003</td><td>679.1461</td><td>3.4182e+003</td><td>1.0382e+003</td></tr><tr><td>30</td><td>2000</td><td>4.1097e+003</td><td>481.8801</td><td>6.5075e+003</td><td>589.9931</td><td>6.8196e+003</td><td>1.1614e+003</td></tr><tr><td>10</td><td>1000</td><td>494.0236</td><td>169.5594</td><td>1.4359e+003</td><td>246.9290</td><td>876.2897</td><td>382.1407</td></tr><tr><td rowspan="4">40</td><td>20</td><td>1500</td><td>1.8516e+003</td><td>273.8690</td><td>4.5580e+003</td><td>242.8220</td><td>3.9461e+003</td><td>816.6767</td></tr><tr><td>30</td><td>2000</td><td>3.4042e+003</td><td>384.3150</td><td>7.3380e+003</td><td>288.9463</td><td>7.3466e+003</td><td>879.8090</td></tr><tr><td>10</td><td>1000</td><td>426.0796</td><td>130.5357</td><td>1.6060e+003</td><td>132.0009</td><td>979.6775</td><td>363.0876</td></tr></tbody></table>
<table><caption>Table 11. Numerical results on Shaffer's f6 function</caption><tr><td>80</td><td>20</td><td>1500</td><td>1.5466e+003</td><td>270.5587</td><td>4.6407e+003</td><td>225.9431</td><td>4.1601e+003</td><td>518.4552</td></tr><tr><td>30</td><td>2000</td><td>3.0325e+003</td><td>419.8580</td><td>8.0583e+003</td><td>226.3796</td><td>7.3655e+003</td><td>852.6205</td><td></td></tr></table>

<table><thead><tr><th rowspan="2">M</th><th rowspan="2">Dim.</th><th rowspan="2">Gmax</th><th colspan="2">SPSO</th><th colspan="2">QPSO</th><th colspan="2">QPSO-DC</th></tr><tr><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th><th>fitness</th><th>St. Dev.</th></tr></thead><tbody><tr><td>20</td><td>2</td><td>2000</td><td>3.8965e-004</td><td>0.0019</td><td>0.0016</td><td>0.0036</td><td>1.3764e-007</td><td>7.3542e-007</td></tr><tr><td>40</td><td>2</td><td>2000</td><td>1.9432e-004</td><td>0.0014</td><td>5.8308e-004</td><td>0.0023</td><td>1.2681e-008</td><td>3.6984e-008</td></tr><tr><td>80</td><td>2</td><td>2000</td><td>0.0000</td><td>0.0000</td><td>7.5695e-009</td><td>2.5080e-008</td><td>5.9540e-009</td><td>8.0367e-009</td></tr></tbody></table>

The results show that both QPSO, QPSO-DC are superior to SPSO except on Schwefel and Shaffer's f6 function. On Shpere Function the QPSO works better than QPSO-DC when the warm size is 40 and dimension is 10, and when the warm size is 80 and dimension is 20. Expect for the above two instance, the best result is QPSO-DC. The Rosenbrock function is a mono-modal function, but its optimal solution lies in a narrow area that the particles are always apt to escape. The experiment results on Rosenbrock function show that the QPSO-DC outperforms the QPSO. Rastrigrin function and Griewank function are both multi-modal and usually tested for comparing the global search ability of the algorithm. On Rastrigrin function, it is also shown that the QPSO-DC generated best results than QPSO. On Griewank function, QPSO-DC has better performance than QPSO algorithm. On Ackley function, QPSO-DC has best performance when the dimension is 10, except for above functions, the QPSO-DC has minimal value. On the Schwefel function, SPSO is best performance in any situation. On Shaffer's function, it has sub-optima 0.0097. The QPSO-DC shows its stronger ability to escape the local minima 0.0097 than the QPSO, and even than SPSO. Generally speaking, the QPSO-DC has better global search ability than SPSO and QPSO.

Figure 1 shows the convergence process of the three algorithms on the first four benchmark functions with dimension 30 and swarm size 40 averaged on 50 trail runs. It is shown that, although QPSO-DC converges more slowly than the QPSO during the early stage of search, it may catch up with QPSO at later stage and could generate better solutions at the end of search.

<figure><img src="image_3.png" /></figure>

<figure><img src="image_4.png" /></figure>
<figure><img src="image_5.png" /><figcaption>Figure1. Convergence process of the three algorithm on the first four benchmark functions with dimension 30 and swarm size 40 averaged on 50 trail runs</figcaption></figure>

From the results above in the tables and figures, it can be concluded that the
QPSO-DC has better global search ability than SPSO, QPSO.

Acknowledgements.

This work was financially supported by the National Natural Science Fund (No. 71461008, No. 61362016) and the Hainan Province Natural Science Fund (No. 614235), and the Higher School Scientific Research Project of Hainan Province (Hjkj2013-22).

**References**

1. Kennedy, J, Eberhart, R, Particle swarm optimization, In: Proc.IEEE Int. Conf. Neural Networks, 1995, pp.1942–1948. F. Van den Bergh, An Analysis of Particle Swarm Optimizers. University of Pretoria, South Africa, 2001.

2. Clerc, M, Discrete particle swarm optimization illustrated by the traveling salesman problem. New optimization techniques in engineering, Berlin: Springer; 2004, pp. 219–239.

3. Clerc, M, Particle swarm optimization, ISTE, 2006.

4. Zhang, W., Liu, Y., Clerc, M. An adaptive PSO algorithm for reactive power optimization, In: Sixth international conference on advances in power control, operation and management, Hong Kong, 2003.

5. Eberhart, R. C., Shi, Y. Comparing inertia weights and constriction factors in particle swarm optimization, In: IEEE international conference on evolutionary computation, 2001, pp. 81–86.

6. He, S., Wu, Q. H., Wen, J. Y. Saunders J R, Paton R C, A particle swarm optimizer with passive congregation. Biosystems 78, 2004, 135–47.

7. Hu, X., Eberhart, R. C. Tracking dynamic systems with PSO: where's the cheese?, In: Proceedings of the workshop on particle swarm optimization, Indianapolis, USA, 2001.

8. Parsopoulos, K. E., Vrahatis, M. N. Particle swarm optimizer in noisy and continuously changing environments, Artificial intelligence and soft computing, 2001, 289–294.
9. Parsopoulos, K., E., Vrahatis, M. N. On the computation of all global minimizers thorough particle swarm optimization, IEEE Transactions on Evolutionary Computation 8, 2004, 211–24.

10. LoZvbjerg, M., Krink, T. Extending particle swarms with self-organized criticality, In: Proceedings of the IEEE congress on evolutionary computation, 2002, pp. 1588–1593.

11. Blackwell, T., Bentley, P. J. Don't push me! Collision-avoiding swarms, In: Proceedings of the IEEE congress on evolutionary computation, 2002, pp. 1691–1696.

12. Robinson, J., Sinton, S. Rahmat-Samii, Y. Particle swarm, genetic algorithm, and their hybrids: optimization of a profiled corrugated horn antenna, In: IEEE swarm intelligence symposium, 2002, pp. 314–317.

13. Hendtlass, T. A combined swarm differential evolution algorithm for optimization problems, In: Lecture notes in computer science 2070 (2001) 11–18.

14. Poli, R., Kennedy, J. Blackwell T, Particle swarm optimization, Swarm Intelligence 1, 2007, 33-57.

15. Sun, J., Xu, W. B. Feng B, Particle swarm optimization with particles having quantum behavior, Proc. Congress on Evolutionary Computation, 2004, pp. 325-331.

16. Sun, J., Xu, W. B. Feng B, A global search strategy of quantum behaved particle swarm optimization, Proc. IEEE Conference on Cybernetics and Intelligent Systems, 2004, pp. 111-116.

17. Sun, J., Xu, W. B. Fang W, Quantum-behaved particle swarm optimization with a hybrid probability distribution, In the proceeding of 9th Pacific Rim International Conference on Artificial Intelligence, 2006.

18. Liu, J., Sun, J., Xu, W. B. Improving quantum-behaved particle swarm optimization by simulated annealing, LNAI 4203, Springer, Italy, 2006, pp. 77-83.

19. Coelho, L. S. Novel Gaussian quantum-behaved particle swarm optimizer applied to electromagnetic design, Science, Measurement & Technology 1, 2007, 290-294.

20. Liu, J., Sun, J., Xu, W. B. Quantum-behaved particle swarm optimization with immune memory and vaccination, In: Proc. IEEE International conference on Granular Computing, USA, 2006, pp. 453-456.

21. Angeline, P. J. Using Selection to Improve Particle Swarm Optimization, In: Proc. 1998 IEEE International Conference on Evolutionary Computation. Piscataway, NJ, 1998, pp. 84-89.

22. Shi, Y., Eberhart, R.C. A Modified Particle Swarm, In: Proc.1998 IEEE International Conference on Evolutionary Computation, Piscataway, NJ, 1998, pp. 69-73.

23. Clerc, M., Kennedy, J. The Particle Swarm: Explosion, Stability, and Convergence in a Multi-dimensional Complex Space, IEEE Transactions on Evolutionary Computation, Piscataway, NJ, 6, 2002, 58-73.

24. Shi, Y. Eberhart R, Empirical Study of Particle Swarm Optimization, in: Proc. 1999 Congress on Evolutionary Computation, Piscataway, NJ, 1999, pp. 1945-1950.