# Multiscale Quantum Harmonic Oscillator Algorithm for Multimodal Optimization

Authors: Peng Wang; Kun Cheng; Yan Huang; Bo Li; Xinggui Ye; Xiuhong Chen
Journal: Computational Intelligence and Neuroscience
 (2018)

---

## Abstract

This paper presents a variant of multiscale quantum harmonic oscillator algorithm for multimodal optimization named MQHOA-MMO. MQHOA-MMO has only two main iterative processes: quantum harmonic oscillator process and multiscale process. In the two iterations, MQHOA-MMO only does one thing: sampling according to the wave function at different scales. A set of benchmark test functions including some challenging functions are used to test the performance of MQHOA-MMO. Experimental results demonstrate good performance of MQHOA-MMO in solving multimodal function optimization problems. For the 12 test functions, all of the global peaks can be found without being trapped in a local optimum, and MQHOA-MMO converges within 10 iterations.


---

## Body

## 1. Introduction

Many real-world optimization problems are multimodal optimization problems, such as classification problems in machine learning [1] and inversion of teleseismic waves [2]. Multimodal optimization problems always contain several high quality global or local solutions which have to be identified and the most appropriate solution should be chosen. Global optimization of a continuous multimodal function aims at finding its several global minima or the most appropriate solution, without being trapped in a local optimum. When facing complex multimodal optimization problems, traditional optimization methods, such as gradient descent, quasi-Newton method, and Nelder–Mead’s simplex methods, which may exploit all local information in an effective way, can easily be trapped into the local optimum. If a point-by-point classical optimization approach is used for this task, the approach must have to be applied several times, each time hoping to find a different optimal solution. There are two main reasons for us to find such optima as many as possible. Firstly, an optimal solution currently favorable in the future may not remain to be so. With the knowledge of another optimal solution for the problem, users can simply switch to this new optimal solution when such a predicament occurs. Secondly, the sheer knowledge of multiple optimal solutions in the search space may provide useful insights to the properties of optimal solutions of the problem. Evolutionary algorithms (EAs) and particle swarm optimization (PSO) are used to tackle multimodal optimization problems.Due to the population-based approach, EAs have natural advantage over classical optimization techniques. EAs maintain a population of candidate solutions, which are processed in every generation. If several distinct solutions can be preserved over all these generations, we will get multiple good solutions, rather than the only best solution. In recent years, there are several attempts to improve EAs so as to deal with multimodal fitness landscapes. Niching methods are widely used in genetic algorithms (GA), differential evolution (DE), and other evolutionary algorithms for multimodal optimization [1, 3–16].Similar to EAs, PSO is also an iterative, population-based optimization technique. The principle of PSO is that each particle has learning ability. It can learn from itself (pbest) and its best neighbor (gbest). According to the learning approaches of particles, PSO can be divided into two models. One is the global model, the other one is the local model. In the local PSO model, each particle learns from the best particle in its neighborhood while in the global model every particle learns from the best particle in the whole population. To ensure different particles in the population converge into different optima in the solution space, the way of choosing neighborhood topology structure is crucial. This property leads to the application of PSO for multimodal optimization problems in recent years [17, 18]. Owing to PSO’s features of easy-to-implement and robust adaptability, the PSO converges quickly. But once it gets stuck into the local optimum, it will be very difficult to get out from the local optimum. To overcome this problem, quantum theories are introduced into PSO system. Quantum behaved Particle Swarm Optimization (QPSO) is the quantum model of a PSO. In QPSO, individual particles have quantum behavior [19, 20]. Instead of position and velocity, wavefunction ψ(x,t) [21, 22] is used to depict the state of a particle in QPSO [23]. Though QPSO performs better in global optimization than standard PSO, it also has the problem of premature convergence.A novel optimization algorithm named multiscale quantum harmonic oscillator algorithm (MQHOA) is proposed in 2013 [24]. The population parameter and sampling parameter are researched in [24]. The uncertainty principle, zero energy and quantum tunnel effect of MQHOA are researched in [25]. MQHOA was inspired by the wavefunction of quantum harmonic oscillator. It tranforms the optimization problems to find the low energy state of potential V(x)=f(x). The complex objective function’s second order Taylor approximation is Harmonic oscillator potential. According to quantum theory, the wavefunction of quantum harmonic oscillator represents the distribution of optimal solution. Different spring coefficients in quantum harmonic oscillator correspond with different search scales. Different spring coefficients vary inversely with search scales.MQHOA’s structure is elegant and pithy. It only includes two iteration processes: Quantum harmonic oscillator process (QHO process) and multiscale process (M process). The goal of optimization problem is searching the lowest energy positionf(xbest) (where xbest is global minimum position). QHO process simulates the quantum harmonic oscillator annealing from high energy level to ground state. In M process, MQHOA chooses σ decreasing with a series of 1/2 to get an increased series spring coefficient. With the same σ, in QHO process, MQHOA defines a new wavefunction to get sufficient sampling points in the global optimal area. The new wavefunction is defined as the summation of Gaussian probability-density functions. MQHOA’s wavefunction in scale σs is the sum of k Gaussian probability-density functions which take ki as centers. It depicts the probability distribution of optimal solutions in domain. The equation can be written as(1)ψsx=∑i=1k12πσse-x-ki2/2σs2.The experimental results of 15 typical two-dimensional test functions show that MQHOA performs well in finding global optima [24].In this paper, we present a variant of MQHOA for multimodal optimization named MQHOA-MMO. Similar to PSO’s local version, in the proposed MQHOA-MMO, for each scale, every sampling point just needs to compare with the sampling points which are of the same Gaussian distribution.This paper is organized as follows. Section2 describe the framework of MQHOA-MMO. Test functions and comparasion algorithms are presented in Section 3. The results of experiments are discussed in Section 4. Finally, Section 5 concludes the paper.


## 2. The Framework of MQHOA-MMO

This section presents the framework of MQHOA-MMO. We define the symbols as follows:(i)
k is the number of swarms and Gaussian distributions.(ii)
m is the number of sampling points of each Gaussian distribution.(iii)
σmin is the accuracy of optimization.(iv)
σ is the standard deviation for all xi.(v)
σk is the standard deviation for all new xi.(vi)
Δσ is the absolute value of the difference between σ and σk.(vii)
σs is the current scale for iteration, the initial value is defined as the domain length.(viii)
S=x1,…,xi,…,xk is the swarm of k particles such that xi indicates particle i(i=1,2,3,…,k). xi is randomly generated in domain. For every xi, generate mxiq(q=1,2,3,…,m), which are following probability distribution N(xi,σs2). k×m sampling positions are needed by every iteration. k optimal positions are stored in xi.(ix)
xibest is the optimal position selected from m sampling positions xiq.(x)
xbest′ is the optimal position the algorithm has found.MQHOA-MMO includes just two nested iteration processes: QHO process and M process. In MQHOA-MMO, the QHO process is nested inside the M process. The convergence conditions of QHO process and M process areΔσ<σs and σs≤σmin respectively. The framework of MQHOA-MMO is described in Algorithm 1.Algorithm 1:The framework of MQHOA-MMO.
begin (1) initialize: k, m, σmin, σs=dmax-dmin (2) randomly generate xi(i=1,…,k) in domain (3) calculate the standard deviation σ for all xi (4) do (5)do (6)∀xi, generate xiqq=1,…,m~N(xi,σs2) (7)∀xi, select xibest from all xiq (8)update xi:xi←xibest (9)calculate the standard deviation σk for all new xi (10)Δσ=σk-σ (11)update σ:σ←σk (12)while: (Δσ>σs) (13) update σs:σs←σs/2 (14) while  (σs>σmin) (15) output  xbest′,fbest endThe elaborate interpretation of the framework of MQHOA-MMO is as follows:(1)
Initializeσmin=0.00001, dmin=-10, dmax=10. So σs=20. Here, we choose k=20, m=200, the influence of the value k will be discussed in Section 4.1.(2)
Randomly generatexi(i=1,…,20) in [-10,10]. Calculate the standard deviation σ for all xi.(3)
For eachxi, generate xiq(q=1,…,200), which are following probability distribution N(xi,σs2).(4)
Choose the optimal positionxibest from all xiq(q=1,…,200) for each xi.(5)
For eachxi, xi=xibest. Calculate the standard deviation σk for all new xi.(6)
CalculateΔσ=σk-σ.(7)
CompareΔσ and σs. If Δσ>σs, return to step (3). If Δσ<σs, σs=σs/2.(8)
Compareσmin and σs. If σs>σmin, return to step (3). If σs<σmin, return xbest′, fbest.According to the framework above, only two parameters (k and m) need to be set. The selection of k is discussed in Section 4.1.In framework the superposition ofk Gauss sampling areas constructs the wavefunction. Wavefunction written as equation (1) depicts the probability distribution of optimal solutions in domain. The changes of wavefunction in iterations are showed in Figure 5. In order to reduce the energy of system, k optimal positions xibest are retained from k×m sampling positions. In QHO process, σs=σs/2 transforms the system from high energy state at scale σs to ground state at scale σs/2.For high dimensional test functions, MQHOA-MMO can use two-dimensional arrayxij to store the k high dimensional central positions of Gauss sampling area (N(xij,σs)). Where i is dimension, j is the number of Gauss sampling areas. For every dimension, MQHOA-MMO calculates the value of σk and Δσ. The QHO process at scale σs will end until Δσ≤σs in every dimension.


## 3. Experimental Setup

In this section, we give a brief description of benchmark functions and comparison algorithms. Experimental setup is present at the end of this section.


### 3.1. Test Functions

The benchmark functions we choose are widely used in multimodal optimization. Some test functions have various characteristics, such as irregular landscape, symmetric or equal distribution of optima. The goals are thus to evaluate the ability to tackle a complicated problem, to validate its capacity to detect all the global peaks of a function. A brief description of the functions is listed in Table1.Table 1
Benchmark function.
Function name D Range Benchmark function Optima E1-F1:Equal maxima 1 x ∈ 0     1 F 1 x = sin 6 ⁡ 5 π x 5 E1-F2:Uneven maxima 1 x ∈ 0     1 F 2 x = sin 6 ⁡ 5 π x 3 / 4 - 0.05 5 E1-F3:Himmelblau’s 2 x ∈ - 4     4 F 3 x , y = 200 - x 2 + y - 11 2 - x + y 2 - 7 2 4 y ∈ - 4     4 E1-F4:Six-Hump Camel 2 x ∈ - 1.9     1.9 F 4 x , y = 4 - 2.1 x 2 + x 4 3 x 2 + x y + - 4 + 4 y 2 y 2 2 y ∈ - 1.1     1.1 E1-F5:Shekel’s foxholes 2 x ∈ - 65.54     65.54 F 5 x , y = 500 - 1 0.002 + ∑ i = 0 24 1 / 1 + i + x - a i 6 + y - b i 6 1 y ∈ - 65.54     65.54 E1-F6:Branin RCOS 2 x ∈ - 5     10 F 6 x , y = y - 5.1 4 π 2 x 2 + 5 π x - 6 2 + 10 1 - 1 8 π cos ⁡ x + 10 3 y ∈ 0     15 E1-F7:Root function 2 x = x 1 + i x 2 F 7 x = 1 1 + x 6 - 1 6 x ∈ - 2     2 E1-F8:Hansen 2 x ∈ - 10     10 F 8 x , y =  ∑ i = 1 5 i cos ⁡ i - 1 x - i ⋅  ∑ j = 1 5 j cos ⁡ j + 1 y + j 9 y ∈ - 10     10 E1-F9:Holder Table 2 x ∈ - 10     10 F 9 x , y = - sin ⁡ x 1 cos ⁡ x 2 ⋅ exp ⁡ 1 - x 1 2 + x 2 2 π 4 E1-F10:Rescaled Six-Hump Camel 2 x ∈ - 1.9     1.9 F 10 x , y = - 4 - 2.1 x 2 + x 4 3 x 2 + 10 x y + - 4 + 4 10 y 4 2 x ∈ - 1.1     1.1 E1-F11:2D Inverted Shubert 2 x 1 ∈ - 10     10 F 11 X → = -  ∏ i = 1 D ∑ j = 1 5 j cos ⁡ j + 1 x i + j 18 x 2 ∈ - 10     10 E1-F12:Cross-In-Tray 2 X i ∈ [ - 10     10 ] F 12 x = - 0.0001 sin ⁡ x 1 sin ⁡ x 2 exp ⁡ 100 - x 1 2 + x 2 2 π + 1 0.1 4


### 3.2. Comparasion Algorithms

To evaluate the performance of MQHAO-MMO, MQHAO-MMO is compared with the following standard multimodal evolutionary algorithms. MQHOA-MMO is marked as AL0.AL1 (IWO-σ-GSO [26]): the vasion weed optimization-σ-group search optimizers;AL2 (scma [27]): CAM-ES with Self-Adaptive Niche Radius;AL3 (cde [28]): the original crowding DE;AL4 (sde [29]): speciation-based DE;AL5 (ferpso [30]): fitness-Euclidean distance Ratio;AL6 (spso [31]): speciation-based PSO;AL7 (r2pso [31]): a lbest PSO with a ring topology, each member interacts with only its immediate member to its right;AL8 (r3pso [31]): a lbest PSO with a ring topology, each member interacts with only its immediate member to its left;AL9 (r2psolhc): the same as r2pso [32], but with no overlapping neighborhoods;AL10 (r3psolhc): the same as r3pso [32], but with no overlapping neighborhoods.


### 3.3. Experimental Environment and Criteria

MQHOA-MMO is coded in Matlab R2014 and the simulations are run on i5 CPU 2.9 GHz with 8 GB memory. Results are averaged over 30 independent runs. If the difference between a computed solution and a known global optimum is less thanε, the peak is considered to be found. The performance of all multimodal algorithms is measured in terms of the following two criteria:(1)
Success rate: The percentage of runs in which an algorithm can detect all the global peaks.(2)
Average peak number: Peak number found over 30 runs for each function.


## 3.1. Test Functions

The benchmark functions we choose are widely used in multimodal optimization. Some test functions have various characteristics, such as irregular landscape, symmetric or equal distribution of optima. The goals are thus to evaluate the ability to tackle a complicated problem, to validate its capacity to detect all the global peaks of a function. A brief description of the functions is listed in Table1.Table 1
Benchmark function.
Function name D Range Benchmark function Optima E1-F1:Equal maxima 1 x ∈ 0     1 F 1 x = sin 6 ⁡ 5 π x 5 E1-F2:Uneven maxima 1 x ∈ 0     1 F 2 x = sin 6 ⁡ 5 π x 3 / 4 - 0.05 5 E1-F3:Himmelblau’s 2 x ∈ - 4     4 F 3 x , y = 200 - x 2 + y - 11 2 - x + y 2 - 7 2 4 y ∈ - 4     4 E1-F4:Six-Hump Camel 2 x ∈ - 1.9     1.9 F 4 x , y = 4 - 2.1 x 2 + x 4 3 x 2 + x y + - 4 + 4 y 2 y 2 2 y ∈ - 1.1     1.1 E1-F5:Shekel’s foxholes 2 x ∈ - 65.54     65.54 F 5 x , y = 500 - 1 0.002 + ∑ i = 0 24 1 / 1 + i + x - a i 6 + y - b i 6 1 y ∈ - 65.54     65.54 E1-F6:Branin RCOS 2 x ∈ - 5     10 F 6 x , y = y - 5.1 4 π 2 x 2 + 5 π x - 6 2 + 10 1 - 1 8 π cos ⁡ x + 10 3 y ∈ 0     15 E1-F7:Root function 2 x = x 1 + i x 2 F 7 x = 1 1 + x 6 - 1 6 x ∈ - 2     2 E1-F8:Hansen 2 x ∈ - 10     10 F 8 x , y =  ∑ i = 1 5 i cos ⁡ i - 1 x - i ⋅  ∑ j = 1 5 j cos ⁡ j + 1 y + j 9 y ∈ - 10     10 E1-F9:Holder Table 2 x ∈ - 10     10 F 9 x , y = - sin ⁡ x 1 cos ⁡ x 2 ⋅ exp ⁡ 1 - x 1 2 + x 2 2 π 4 E1-F10:Rescaled Six-Hump Camel 2 x ∈ - 1.9     1.9 F 10 x , y = - 4 - 2.1 x 2 + x 4 3 x 2 + 10 x y + - 4 + 4 10 y 4 2 x ∈ - 1.1     1.1 E1-F11:2D Inverted Shubert 2 x 1 ∈ - 10     10 F 11 X → = -  ∏ i = 1 D ∑ j = 1 5 j cos ⁡ j + 1 x i + j 18 x 2 ∈ - 10     10 E1-F12:Cross-In-Tray 2 X i ∈ [ - 10     10 ] F 12 x = - 0.0001 sin ⁡ x 1 sin ⁡ x 2 exp ⁡ 100 - x 1 2 + x 2 2 π + 1 0.1 4


## 3.2. Comparasion Algorithms

To evaluate the performance of MQHAO-MMO, MQHAO-MMO is compared with the following standard multimodal evolutionary algorithms. MQHOA-MMO is marked as AL0.AL1 (IWO-σ-GSO [26]): the vasion weed optimization-σ-group search optimizers;AL2 (scma [27]): CAM-ES with Self-Adaptive Niche Radius;AL3 (cde [28]): the original crowding DE;AL4 (sde [29]): speciation-based DE;AL5 (ferpso [30]): fitness-Euclidean distance Ratio;AL6 (spso [31]): speciation-based PSO;AL7 (r2pso [31]): a lbest PSO with a ring topology, each member interacts with only its immediate member to its right;AL8 (r3pso [31]): a lbest PSO with a ring topology, each member interacts with only its immediate member to its left;AL9 (r2psolhc): the same as r2pso [32], but with no overlapping neighborhoods;AL10 (r3psolhc): the same as r3pso [32], but with no overlapping neighborhoods.


## 3.3. Experimental Environment and Criteria

MQHOA-MMO is coded in Matlab R2014 and the simulations are run on i5 CPU 2.9 GHz with 8 GB memory. Results are averaged over 30 independent runs. If the difference between a computed solution and a known global optimum is less thanε, the peak is considered to be found. The performance of all multimodal algorithms is measured in terms of the following two criteria:(1)
Success rate: The percentage of runs in which an algorithm can detect all the global peaks.(2)
Average peak number: Peak number found over 30 runs for each function.


## 4. Experimental Studies

The experimental studies and analyses are presented in this section. MQHOA-MMO had been run untilσs<σmin or the maximum number of function evaluation was exhausted.


### 4.1. Parameter Experiment

In this section, we examine the effectiveness and efficiency of MQHOA-MMO by applying it to selected four benchmark functions: Six-Hump Camel Back Function (E1-F4), Himmelblaus’s Function (E1-F3), Hansen Function (E1-F8) and 2D Inverted Shubert Function (E1-F18). The numbers of solution individuals are 2, 4, 9, and 18, respectively.In MQHOA-MMO, we generate initial population using two parameters:k and m. We choose different initial parameter k to test the impact on the ability of finding global optima. We run over 30 times for each k while m=200. Figure 1 contains four relation figures between the parameter k and the number of global optima which MQHOA-MMO can find. The initial k value begins at 5 and increases by 5 each time. According to Figures 1(c) and 1(d), while k is smaller than the number of global optima, MQHOA-MMO can only find part of global optima. With the increasing of k, we can find most global optima when the initial k is close to the number of global optima. When the number of optimal solutions is small, for example, less than 10, the increased k can find all the optimal solutions. But when the number of global optima is lager (more than 10), with the increase of k, the number of global optima which MQHOA-MMO can find also increases. When k increases to a certain number, the number of global optima which MQHOA-MMO can find is stable. When the domain is large, k should increase in a large scale more than ten times. We can make a conclusion that to find all the global optima the initial value of k should be larger than the number of the global optima. Besides, along with the increase of domain, the number of k should increase correspondingly.Figure 1
Relation ofk and optimal solution with m=200, σmin=10e-6, and repeat time = 30.
(a)
Six-Hump Camel Back Function (b)
Himmelblaus’s Function (c)
Hansen Function (d)
2D Inverted Shubert Function


### 4.2. Convergence Experiment

To be more intuitive, we apply 12 benchmark test functions to demonstrate the convergence and verify the effectiveness of MQHOA-MMO. Figures2, 3, and 4 show the relationship between fitness and iteration times. Fitness is the average of k optimum function values of test functions. The value of iteration times is the number of QHO processes. For the 12 benchmark test functions, we set parameters as follows: k=50, m=200, and σmin=10e-6. Results are averaged over 30 independent runs.Figure 2
Convergence ofF1–F4, where k=50, m=200, σmin=10e-6, repeat time = 30.Figure 3
Convergence ofF5–F8, where k=50, m=200, σmin=10e-6, repeat time = 30.Figure 4
Convergence ofF9–F11, where k=50, m=200, σmin=10e-6, repeat time = 30.Figure 5
Changes of wavefunction in iterations.
(a)
Incipient 35 swarms centers withσ=20 (b)
Incipient 35 swarms centers withσ=2.5 (c)
Incipient 35 swarms centers withσ=1.25 (d)
Incipient 35 swarms centers withσ=0.3125 (e)
Incipient wavefunction withσ=20 (f)
Incipient wavefunction withσ=2.5  (g)
Incipient wavefunction withσ=1.25 (h)
Incipient wavefunction withσ=0.3125 (i)
Last wavefunction withσ=20 (j)
Last wavefunction withσ=2.5 (k)
Last wavefunction withσ=1.25 (l)
Last wavefunction withσ=0.3125From Figures2–4, we find that almost all the functions have converged to several small areas before the tenth iteration. Some functions, such as F1, F2, F3, F5, F6, F9, and F12, can converge to several small areas at the fifth iteration. Table 2 presents the iteration times of 12 test functions while σs<σmin or the maximum number of function evaluations was exhausted. The results mean that MQHOA-MMO has a fast convergent ability, and for most test functions there is only one QHO process in each M process.Table 2
Iteration times (N) for 12 test functions, where k=50, m=200, σmin=10e-6, σs=dmax-dmin, and repeat time = 30.
F1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 F 9 F 10 F 11 F 12 20 20 20 20 27 24 22 25 25 22 25 25


### 4.3. Changes of Wavefunction

In this section, we choose Hansen function (E1-F8) to present the changes of wavefunction in MQHOA-MMO. We setk=35, m=200, dmin=-10, and dmax=10. The function is written as follows:(2)Fx,y=∑i=15icos⁡i-1x-i∑j=15jcos⁡j+1y+j.MQHOA-MMO’s wavefunction is written as (1). To describe wavefunction clearly, we have defined three notions. First notion is incipient centers of k swarms, which are xi used in QHO’s first iteration for each σs. Second notion is incipient wavefunction, which is the wavefunction of xi used in QHO’s first iteration for each σs. The last notion is last wavefunction, which is the wavefunction of xi used in QHO’s last iteration for each σs. After the last QHO iteration for each σs, σs will be cut half to σs/2.Figure5 presents the change of wavefunction in iterations. Figures 5(a)–5(d) show the incipient centers of k swarms with different σs. Figures 5(e)–5(h) show the incipient wavefunctions with different σs. Figures 5(i)–5(l) show the last wavefunctions with different σs. With σs=20, Figure 5(a) shows the incipient centers of swarms and Figure 5(e) shows the incipient wavefunction while the last wavefunction is shown in Figure 5(i). With σs=2.5, Figure 5(b) shows the incipient centers of swarms, Figure 5(f) shows the incipient wavefunction, and the last wavefunction is shown in Figure 5(j). With σs=1.25, Figure 5(c) shows the incipient centers of swarms, Figure 5(g) shows the incipient wavefunction, and the last wavefunction is shown in Figure 5(k). With σs=0.3125, Figure 5(d) shows the incipient centers of swarms, Figure 5(h) shows the incipient wavefunction, and the last wavefunction is shown in Figure 5(l).Figures of the sameσs show the changes of wavefunctions in different QHO iterations. For example, Figures 5(g) and 5(k) show the changes in QHO iterations with σs=1.25. As mentioned in Section 4.2 the number of QHO iterations is small in each M iteration, so the change of wavefunctions is not obvious in different QHO iterations with the same σs. Figures of different σs give us the differences of wavefunctions in different M iterations. For example, Figures 5(i), 5(j), 5(k), and 5(l) show the changes of wavefunctions in M iterations. According to our definition, Figures 5(j) and 5(g) have the same centers of k swarms and the different σs. From the wavefunctions, we also can find that if there is a large probability of the optimal solution at a certain point, the point will be more attracted in this area, according to Gauss sampling law. It means that the higher probability is that the optimal solution is in the region. With the decrease of σs, the probability distribution of particles is more and more concentrated. This is the principle that MQHOA-MMO uses multiscale to implement the precision of the algorithm.


### 4.4. Comparison Experiments

In this section, we will present a detailed discussion on the performance of various algorithms that were chosen in the comparative study. We use 6 challenging functions of various characteristics to evaluate the MQHOA-MMO’s performance. MQHOA-MMO runs untilσs<σmin or the maximum number of function evaluations was exhausted. The experimental results of other algorithms are quoted from [26]. All performances of MQHOA-MMO are calculated and averaged over 30 independent runs with k=50, m=200, and σmin=10e-6. From Table 3, we can find that MQHOA-MMO’s success rate can reach up to 100%. For some complex test functions, such as F3, F5, and F6, MQHOA-MMO can also get 100% success rate while some other algorithms even cannot find the global optima.Table 3
Success rates for test functions; the parameters for MQHOA-MMO are as follows:k=50, m=200, σmin=10e-6, and repeat time = 30; the domain of definition is different with different functions.
Func ε AL0 AL1 AL2 AL3 AL4 AL5 AL6 AL7 AL8 AL9 AL10 F 1 0.000001 100 100 92 28 72 84 88 92 88 100 92 F 2 0.000001 100 100 88 28 60 100 92 88 72 92 92 F 3 0.0005 100 88 72 0 72 72 0 24 28 24 24 F 4 0.000001 100 60 60 0 100 96 0 60 56 52 60 F 5 0.00001 100 100 88 52 32 100 56 88 76 72 60 F 6 0.1 100 92 74 82 78 76 70 72 66 60 62Table4 shows the average number of global peaks detected by the MQHOA-MMO and other ten evolutionary multimodal optimization algorithms on test functions. Table 4 further indicates that MQHOA-MMO is able to detect the global optima in the test cases, and MQHOA-MMO can yield a good level of accuracy. IWO-σ-GSO is a new excellent combination algorithm. It can generate acceptable results over the test functions. SCMA can also generate good results over simple and low dimension. Their performance gradually becomes poor when the dimension increases. SDE algorithm shows very poor performance if the number of peaks has high accuracy. Other SDE could not be able to generate satisfactory solution. FERPSO is able to generate relatively satisfactory results in many test functions. For MQHOA-MMO, given suitable parameters, it can get all global optima.Table 4
Average number of peaks found for the test functions; the parameters for MQHOA-MMO are as follows:k=50, m=200, σmin=10e-6, and repeat time = 30, and the domain of definition is different with different functions.
Func ε AL0 AL1 AL2 AL3 AL4 AL5 AL6 AL7 AL8 AL9 AL10 F 1 0.000001 5 5 4.92 3.84 4.72 4.84 4.88 4.92 4.88 5 4.92 F 2 0.000001 5 5 4.88 3.96 4.6 5 4.92 4.88 4.72 4.92 4.88 F 3 0.0005 4 3.88 3.72 0.32 3.72 3.68 0.84 2.92 2.76 3 3.12 F 4 0.000001 2 1.6 1.6 0.04 2 1.96 0.08 1.44 1.56 1.56 1.48 F 5 0.00001 1 1 0.88 0.52 0.32 1 0.56 0.88 0.76 0.72 0.6 F 6 0.1 3 2.88 2.56 2.76 2.72 2.64 2.48 2.52 2.44 2.36 2.40


## 4.1. Parameter Experiment

In this section, we examine the effectiveness and efficiency of MQHOA-MMO by applying it to selected four benchmark functions: Six-Hump Camel Back Function (E1-F4), Himmelblaus’s Function (E1-F3), Hansen Function (E1-F8) and 2D Inverted Shubert Function (E1-F18). The numbers of solution individuals are 2, 4, 9, and 18, respectively.In MQHOA-MMO, we generate initial population using two parameters:k and m. We choose different initial parameter k to test the impact on the ability of finding global optima. We run over 30 times for each k while m=200. Figure 1 contains four relation figures between the parameter k and the number of global optima which MQHOA-MMO can find. The initial k value begins at 5 and increases by 5 each time. According to Figures 1(c) and 1(d), while k is smaller than the number of global optima, MQHOA-MMO can only find part of global optima. With the increasing of k, we can find most global optima when the initial k is close to the number of global optima. When the number of optimal solutions is small, for example, less than 10, the increased k can find all the optimal solutions. But when the number of global optima is lager (more than 10), with the increase of k, the number of global optima which MQHOA-MMO can find also increases. When k increases to a certain number, the number of global optima which MQHOA-MMO can find is stable. When the domain is large, k should increase in a large scale more than ten times. We can make a conclusion that to find all the global optima the initial value of k should be larger than the number of the global optima. Besides, along with the increase of domain, the number of k should increase correspondingly.Figure 1
Relation ofk and optimal solution with m=200, σmin=10e-6, and repeat time = 30.
(a)
Six-Hump Camel Back Function (b)
Himmelblaus’s Function (c)
Hansen Function (d)
2D Inverted Shubert Function


## 4.2. Convergence Experiment

To be more intuitive, we apply 12 benchmark test functions to demonstrate the convergence and verify the effectiveness of MQHOA-MMO. Figures2, 3, and 4 show the relationship between fitness and iteration times. Fitness is the average of k optimum function values of test functions. The value of iteration times is the number of QHO processes. For the 12 benchmark test functions, we set parameters as follows: k=50, m=200, and σmin=10e-6. Results are averaged over 30 independent runs.Figure 2
Convergence ofF1–F4, where k=50, m=200, σmin=10e-6, repeat time = 30.Figure 3
Convergence ofF5–F8, where k=50, m=200, σmin=10e-6, repeat time = 30.Figure 4
Convergence ofF9–F11, where k=50, m=200, σmin=10e-6, repeat time = 30.Figure 5
Changes of wavefunction in iterations.
(a)
Incipient 35 swarms centers withσ=20 (b)
Incipient 35 swarms centers withσ=2.5 (c)
Incipient 35 swarms centers withσ=1.25 (d)
Incipient 35 swarms centers withσ=0.3125 (e)
Incipient wavefunction withσ=20 (f)
Incipient wavefunction withσ=2.5  (g)
Incipient wavefunction withσ=1.25 (h)
Incipient wavefunction withσ=0.3125 (i)
Last wavefunction withσ=20 (j)
Last wavefunction withσ=2.5 (k)
Last wavefunction withσ=1.25 (l)
Last wavefunction withσ=0.3125From Figures2–4, we find that almost all the functions have converged to several small areas before the tenth iteration. Some functions, such as F1, F2, F3, F5, F6, F9, and F12, can converge to several small areas at the fifth iteration. Table 2 presents the iteration times of 12 test functions while σs<σmin or the maximum number of function evaluations was exhausted. The results mean that MQHOA-MMO has a fast convergent ability, and for most test functions there is only one QHO process in each M process.Table 2
Iteration times (N) for 12 test functions, where k=50, m=200, σmin=10e-6, σs=dmax-dmin, and repeat time = 30.
F1 F 2 F 3 F 4 F 5 F 6 F 7 F 8 F 9 F 10 F 11 F 12 20 20 20 20 27 24 22 25 25 22 25 25


## 4.3. Changes of Wavefunction

In this section, we choose Hansen function (E1-F8) to present the changes of wavefunction in MQHOA-MMO. We setk=35, m=200, dmin=-10, and dmax=10. The function is written as follows:(2)Fx,y=∑i=15icos⁡i-1x-i∑j=15jcos⁡j+1y+j.MQHOA-MMO’s wavefunction is written as (1). To describe wavefunction clearly, we have defined three notions. First notion is incipient centers of k swarms, which are xi used in QHO’s first iteration for each σs. Second notion is incipient wavefunction, which is the wavefunction of xi used in QHO’s first iteration for each σs. The last notion is last wavefunction, which is the wavefunction of xi used in QHO’s last iteration for each σs. After the last QHO iteration for each σs, σs will be cut half to σs/2.Figure5 presents the change of wavefunction in iterations. Figures 5(a)–5(d) show the incipient centers of k swarms with different σs. Figures 5(e)–5(h) show the incipient wavefunctions with different σs. Figures 5(i)–5(l) show the last wavefunctions with different σs. With σs=20, Figure 5(a) shows the incipient centers of swarms and Figure 5(e) shows the incipient wavefunction while the last wavefunction is shown in Figure 5(i). With σs=2.5, Figure 5(b) shows the incipient centers of swarms, Figure 5(f) shows the incipient wavefunction, and the last wavefunction is shown in Figure 5(j). With σs=1.25, Figure 5(c) shows the incipient centers of swarms, Figure 5(g) shows the incipient wavefunction, and the last wavefunction is shown in Figure 5(k). With σs=0.3125, Figure 5(d) shows the incipient centers of swarms, Figure 5(h) shows the incipient wavefunction, and the last wavefunction is shown in Figure 5(l).Figures of the sameσs show the changes of wavefunctions in different QHO iterations. For example, Figures 5(g) and 5(k) show the changes in QHO iterations with σs=1.25. As mentioned in Section 4.2 the number of QHO iterations is small in each M iteration, so the change of wavefunctions is not obvious in different QHO iterations with the same σs. Figures of different σs give us the differences of wavefunctions in different M iterations. For example, Figures 5(i), 5(j), 5(k), and 5(l) show the changes of wavefunctions in M iterations. According to our definition, Figures 5(j) and 5(g) have the same centers of k swarms and the different σs. From the wavefunctions, we also can find that if there is a large probability of the optimal solution at a certain point, the point will be more attracted in this area, according to Gauss sampling law. It means that the higher probability is that the optimal solution is in the region. With the decrease of σs, the probability distribution of particles is more and more concentrated. This is the principle that MQHOA-MMO uses multiscale to implement the precision of the algorithm.


## 4.4. Comparison Experiments

In this section, we will present a detailed discussion on the performance of various algorithms that were chosen in the comparative study. We use 6 challenging functions of various characteristics to evaluate the MQHOA-MMO’s performance. MQHOA-MMO runs untilσs<σmin or the maximum number of function evaluations was exhausted. The experimental results of other algorithms are quoted from [26]. All performances of MQHOA-MMO are calculated and averaged over 30 independent runs with k=50, m=200, and σmin=10e-6. From Table 3, we can find that MQHOA-MMO’s success rate can reach up to 100%. For some complex test functions, such as F3, F5, and F6, MQHOA-MMO can also get 100% success rate while some other algorithms even cannot find the global optima.Table 3
Success rates for test functions; the parameters for MQHOA-MMO are as follows:k=50, m=200, σmin=10e-6, and repeat time = 30; the domain of definition is different with different functions.
Func ε AL0 AL1 AL2 AL3 AL4 AL5 AL6 AL7 AL8 AL9 AL10 F 1 0.000001 100 100 92 28 72 84 88 92 88 100 92 F 2 0.000001 100 100 88 28 60 100 92 88 72 92 92 F 3 0.0005 100 88 72 0 72 72 0 24 28 24 24 F 4 0.000001 100 60 60 0 100 96 0 60 56 52 60 F 5 0.00001 100 100 88 52 32 100 56 88 76 72 60 F 6 0.1 100 92 74 82 78 76 70 72 66 60 62Table4 shows the average number of global peaks detected by the MQHOA-MMO and other ten evolutionary multimodal optimization algorithms on test functions. Table 4 further indicates that MQHOA-MMO is able to detect the global optima in the test cases, and MQHOA-MMO can yield a good level of accuracy. IWO-σ-GSO is a new excellent combination algorithm. It can generate acceptable results over the test functions. SCMA can also generate good results over simple and low dimension. Their performance gradually becomes poor when the dimension increases. SDE algorithm shows very poor performance if the number of peaks has high accuracy. Other SDE could not be able to generate satisfactory solution. FERPSO is able to generate relatively satisfactory results in many test functions. For MQHOA-MMO, given suitable parameters, it can get all global optima.Table 4
Average number of peaks found for the test functions; the parameters for MQHOA-MMO are as follows:k=50, m=200, σmin=10e-6, and repeat time = 30, and the domain of definition is different with different functions.
Func ε AL0 AL1 AL2 AL3 AL4 AL5 AL6 AL7 AL8 AL9 AL10 F 1 0.000001 5 5 4.92 3.84 4.72 4.84 4.88 4.92 4.88 5 4.92 F 2 0.000001 5 5 4.88 3.96 4.6 5 4.92 4.88 4.72 4.92 4.88 F 3 0.0005 4 3.88 3.72 0.32 3.72 3.68 0.84 2.92 2.76 3 3.12 F 4 0.000001 2 1.6 1.6 0.04 2 1.96 0.08 1.44 1.56 1.56 1.48 F 5 0.00001 1 1 0.88 0.52 0.32 1 0.56 0.88 0.76 0.72 0.6 F 6 0.1 3 2.88 2.56 2.76 2.72 2.64 2.48 2.52 2.44 2.36 2.40


## 5. Conclusion

In this paper, we proposed a multimodal optimization algorithm named MQHOA-MMO. We used wave function to locate the possibility positions of the optimal solutions. The experimental study undertook 12 distinct test functions with number of global peaks varying from 2 to 25. Through comparison of results which were obtained from optimization of several benchmark functions using MQHOA-MMO and other optimization algorithms with two criteria and results obtained from performance experiments it is revealed that MQHOA-MMO can detect all the global optimum in a fast effective, controllable, and higher accuracy. Furthermore, this algorithm can find the global optimum of multifunction without being trapped in local optimum. The experimental study clearly indicated that, in most of the test cases, performance of MQHOA-MMO remains statistically better than all the other algorithms compared with it. For some complex functions, MQHOA-MMO could not have a good success rate. Future research of MQHOA-MMO will be focused on the optimization of such complex functions and higher-dimensional functions.



---

*Source: 8430175-2018-05-13.xml*