# An Improved Harmony Search Based on Teaching-Learning Strategy for Unconstrained Optimization Problems

Authors: Shouheng Tuo; Longquan Yong; Tao Zhou
Journal: Mathematical Problems in Engineering
 (2013)

---

## Abstract

Harmony search (HS) algorithm is an emerging population-based metaheuristic algorithm, which is inspired by the music improvisation process. The HS method has been developed rapidly and applied widely during the past decade. In this paper, an improved global harmony search algorithm, named harmony search based on teaching-learning (HSTL), is presented for high dimension complex optimization problems. In HSTL algorithm, four strategies (harmony memory consideration, teaching-learning strategy, local pitch adjusting, and random mutation) are employed to maintain the proper balance between convergence and population diversity, and dynamic strategy is adopted to change the parameters. The proposed HSTL algorithm is investigated and compared with three other state-of-the-art HS optimization algorithms. Furthermore, to demonstrate the robustness and convergence, the success rate and convergence analysis is also studied. The experimental results of 31 complex benchmark functions demonstrate that the HSTL method has strong convergence and robustness and has better balance capacity of space exploration and local exploitation on high dimension complex optimization problems.


---

## Body

## 1. Introduction

With the development of scientific technology, many real-life optimization problems are becoming more and more complex and difficult. So how to resolve the complex problems in an exact manner within a reasonable time cost is very important. The traditional optimization algorithms are difficult to solve the nonlinear and nondifferential problems. In recent years, most popular swarm intelligence optimization algorithms, such as genetic algorithm (GA), particle swarm optimization (PSO), and differential evolution (DE) algorithm, have been successfully applied to large-scale complicated problems of scientific and engineering computing.Inspired by the process of the musicians’ improvisation of the harmony, the harmony search (HS) algorithm is proposed by Geem et al. [1, 2]. Similar to the GA and PSO, the HS algorithm is a meta-heuristic random optimization algorithm. In recent years, HS has been applied more broadly in the fields of engineering optimization. Such as pipe network design [3], structural optimization [4], clustering of text document [5], combined heat and power economic dispatch problem [6], and scheduling of multiple dam system [7]. The aforementioned applications show that HS algorithm has significant in solving complex engineering application problems. It has strong ability of exploration and has a cheap running cost. However, the classical harmony search algorithm is not efficient enough for solving large-scale problems, which has a slow convergence speed and low-precision solution. So some improved HS algorithms were proposed. Mahdavi et al. proposed an improved HS algorithm (IHS) [8] that employed a novel method generating new solution vectors which enhanced accuracy and convergence speed. Recently, Omran and Mahdavi tried to improve the performance of HS by incorporating some techniques from swarm intelligence. Tuo and Yong presented an improved harmony search algorithm with chaos (HSCH) [9]. The new variant named GHS (Global Best Harmony Search) [10] reportedly outperformed the HS and IHS algorithm over the benchmark problems.HS algorithm has strong ability on exploring the regions of the solution space in a reasonable time. However, it has lower exploitation ability in later period. Therefore, some improved HS algorithm is proposed to enhance the local search ability and solution precision, such as local-best harmony search algorithm with dynamic subpopulations (DLHS) [11], harmony search algorithm with differential mutation operator (HSDE) [12], and novel global harmony search algorithm for unconstrained problems (NGHS) [13, 14]. In addition, Gao et al. proposed modified harmony search methods for unimodal and multimodal optimization [15]. Pan et al. proposed self-adaptive harmony search algorithm for optimization (SGHS) [16]. Yadav et al. presented an intelligent tuned HS algorithm [17].Now some existing state-of-the-art harmony search algorithms, such as NGHS, HSDE, and SGHS, have shown exceptional problem-solving ability, but they have some disadvantages over the multimodal and high dimensional function. To enhance the performance of high dimensional multimodal problem by HS method, this paper proposed an improved large-scale HS algorithm with harmony search teaching-learning (HSTL). In the HSTL algorithm, the HS algorithm is improved by embedding teaching-learning-based-optimization (TLBO) [17, 18] method which has a strong searching capacity for high dimensional problem.The rest of this paper is organized as follows. In Section2, the basic framework of the classical harmony search method is summarized in a comprehensive style, and the two excellent variants of HS (SGHS and NGHS) are briefly presented. A novel teaching-learning-based-optimization algorithm is provided, and the details of HSTL algorithm are presented in Section 3. In Section 4, 31 different characteristic benchmark problems, which consist of separable problems, nonseparable problems, shifted problems, shifted rotated problems, and hybrid composite problems, are considered, and the numerical results of HSTL method are demonstrated. Furthermore, to investigate the robustness and convergent performance of the HSTL algorithm, the comparison results of convergence speed and success rate are presented, and convergence analysis is preliminary put out. Finally, the research findings and contributions of the proposed HSTL algorithm are discussed in Section 5.


## 2. HS Algorithm and Other Variants

In this section, we introduce the classical harmony search (HS) algorithm and two excellent variants of HS algorithms: self-adaptive global-best harmony search (SGHS) algorithm and novel global harmony search (NGHS) algorithm.


### 2.1. Classical Harmony Search Algorithm (HS)

The steps in the procedure of classical harmony search algorithm are as follows.Step 1 (initialize the problem and algorithm parameters).
In this step, the optimization problem is specified as follows:(1)minf(x),s.t.x=(x1,x2,…,xD),xi∈[xiL,xiU],i=1,2,…,D,
where f(x) is an objective function, D is the number of decision variables.The HS algorithm parameters are also specified in this step.HMS: the harmony memory size or the number of solution vectors in the population;HMCR: the harmony considering rate;PAR: pitch adjusting rate;BW: bandwidth;maxFEs: the maximum number of improvisations.Step 2 (initialize the harmony memory).
The  harmony memory (HM) consists of HMS harmony vectors. Each harmony vector is generated from a uniform distribution in the feasible space, as(2)xij=xiL+(xiU-xiL)×rand(),i=1,2,…,D;j=1,2,…,HMS,
where rand() is a random between 0 and 1.
(3)HM=[x1x2⋮xHMS]=[x11x21⋯xD1x12x22⋯xD2⋮⋮⋮⋮x1HMSx2HMS⋯xDHMS].Step 3 (improvise a new harmony).
A new harmony vectorxnew=(x1new,x2new,…,xDnew) is generated based on three rules:(a)
Memory consideration;(b)
Pitch adjustment;(c)
Random generation.The improvisation procedure of new harmony vector works as Algorithm1.Algorithm 1:The improvisation procedure of new harmony vector by HS.
For  i = 1 to D  do
If  rand() ≤ HMCR  then
xinew=xij,j∈U{1,2,…,HMS}
If  rand() ≤ PAR  then
xinew=xinew±rand()×BW(i)
xinew=min(max(xinew,xiL),xiU)
End  If
Else
xinew=xiL+(xiU-xiL)×rand()
End  If
End  ForA new potential variation (or an offspring) is generated in Step3, which is equivalent to mutation and crossover operator in standard evolution algorithms (EAs).Step 4 (update harmony memory).
Get the worst harmony memoryxworst from the HM. If  xnew is better than  xworst then xworst:=xnew.Step 5 (check stopping criterion).
If the stopping criterion (maxFEs) is satisfied, computation is terminated. Otherwise, Steps3 and 4 are repeated.


### 2.2. The SGHS Algorithm

In order to select the best parameters automatically, a self-adaptive global-best harmony search (SGHS) algorithm is proposed by Pan et al. [16]. The SGHS dynamically changes BW according to
(4)BW(t)={BWmax-BWmax-BWminTmax×2t,ift<Tmax,BWmin,ift≥Tmax,
where BWmax and BWmin are the maximum and minimum distance bandwidths.HMCR (PAR) is dynamically selected from a suitable normally distribution with mean HMCRm (PARm) and standard deviation 0.01 (0.05). Initially, HMCRm (PARm) is set at 0.98 (0.9). After a specified number of generations, HMCRm (PARm) is recalculated by averaging all the recorded HMCR (PAR) values during the period of evolution.


### 2.3. The NGHS Algorithm

In the novel global harmony search (NGHS) algorithm [13, 14], three significant parameters, harmony memory considering rate (HMCR), bandwidth (BW), and pitch adjusting rate (PAR), are excluded from NGHS, and a random select rate (pm) is included in the NGHS. In Step 3, NGHS works as Algorithm 2.Algorithm 2:The NGHS modifies improvisation step.
For  i=1  to  D  do
xir=2×xibest-xiworst
xir=min(max(xir,xiL),xiU)
xinew=xiworst+rand()×(xir-xiworst).
If  rand() ≤ pm   //random mutation
xinew=xiL+(xiU-xiL)×rand()
End  If
End  For.Wherexbest and xworst, respectively, are the best harmony and the worst harmony in HM, rand() is uniformly generated random number in [0,1].


## 2.1. Classical Harmony Search Algorithm (HS)

The steps in the procedure of classical harmony search algorithm are as follows.Step 1 (initialize the problem and algorithm parameters).
In this step, the optimization problem is specified as follows:(1)minf(x),s.t.x=(x1,x2,…,xD),xi∈[xiL,xiU],i=1,2,…,D,
where f(x) is an objective function, D is the number of decision variables.The HS algorithm parameters are also specified in this step.HMS: the harmony memory size or the number of solution vectors in the population;HMCR: the harmony considering rate;PAR: pitch adjusting rate;BW: bandwidth;maxFEs: the maximum number of improvisations.Step 2 (initialize the harmony memory).
The  harmony memory (HM) consists of HMS harmony vectors. Each harmony vector is generated from a uniform distribution in the feasible space, as(2)xij=xiL+(xiU-xiL)×rand(),i=1,2,…,D;j=1,2,…,HMS,
where rand() is a random between 0 and 1.
(3)HM=[x1x2⋮xHMS]=[x11x21⋯xD1x12x22⋯xD2⋮⋮⋮⋮x1HMSx2HMS⋯xDHMS].Step 3 (improvise a new harmony).
A new harmony vectorxnew=(x1new,x2new,…,xDnew) is generated based on three rules:(a)
Memory consideration;(b)
Pitch adjustment;(c)
Random generation.The improvisation procedure of new harmony vector works as Algorithm1.Algorithm 1:The improvisation procedure of new harmony vector by HS.
For  i = 1 to D  do
If  rand() ≤ HMCR  then
xinew=xij,j∈U{1,2,…,HMS}
If  rand() ≤ PAR  then
xinew=xinew±rand()×BW(i)
xinew=min(max(xinew,xiL),xiU)
End  If
Else
xinew=xiL+(xiU-xiL)×rand()
End  If
End  ForA new potential variation (or an offspring) is generated in Step3, which is equivalent to mutation and crossover operator in standard evolution algorithms (EAs).Step 4 (update harmony memory).
Get the worst harmony memoryxworst from the HM. If  xnew is better than  xworst then xworst:=xnew.Step 5 (check stopping criterion).
If the stopping criterion (maxFEs) is satisfied, computation is terminated. Otherwise, Steps3 and 4 are repeated.


## 2.2. The SGHS Algorithm

In order to select the best parameters automatically, a self-adaptive global-best harmony search (SGHS) algorithm is proposed by Pan et al. [16]. The SGHS dynamically changes BW according to
(4)BW(t)={BWmax-BWmax-BWminTmax×2t,ift<Tmax,BWmin,ift≥Tmax,
where BWmax and BWmin are the maximum and minimum distance bandwidths.HMCR (PAR) is dynamically selected from a suitable normally distribution with mean HMCRm (PARm) and standard deviation 0.01 (0.05). Initially, HMCRm (PARm) is set at 0.98 (0.9). After a specified number of generations, HMCRm (PARm) is recalculated by averaging all the recorded HMCR (PAR) values during the period of evolution.


## 2.3. The NGHS Algorithm

In the novel global harmony search (NGHS) algorithm [13, 14], three significant parameters, harmony memory considering rate (HMCR), bandwidth (BW), and pitch adjusting rate (PAR), are excluded from NGHS, and a random select rate (pm) is included in the NGHS. In Step 3, NGHS works as Algorithm 2.Algorithm 2:The NGHS modifies improvisation step.
For  i=1  to  D  do
xir=2×xibest-xiworst
xir=min(max(xir,xiL),xiU)
xinew=xiworst+rand()×(xir-xiworst).
If  rand() ≤ pm   //random mutation
xinew=xiL+(xiU-xiL)×rand()
End  If
End  For.Wherexbest and xworst, respectively, are the best harmony and the worst harmony in HM, rand() is uniformly generated random number in [0,1].


## 3. HSTL Algorithm

In this section, we proposed a novel harmony search method with teaching-learning (HSTL) strategy which was derived from teaching-learning-based optimization (TLBO) algorithm. Above all, the TLBO algorithm is introduced and analyzed, and then we focus on the details of HSTL algorithm and the strategies of dynamically adjusting the parameters.


### 3.1. The TLBO Algorithm

Teaching-learning-based Optimization (TLBO) algorithm [18–20] is a new nature-inspired algorithm; it mimics the teaching process of teacher and learning process among learners in a class. TLBO shows a better performance with less computational effort for large scale problems [19], that is, problems of a high dimensionality. In addition, TLBO needs very few parameters.In the TLBO method, it is the task of teacher to try to increase mean knowledge of all learners of the class in the subject taught by him or her depending on his or her capability. Learners make efforts to increase their knowledge by interaction among themselves. A learner is considered as a solution or a vector, and different design variables of vector will be analogous to different subjects offered to learners and the learners’ result is analogous to the “fitness” as in other population-based optimization techniques. The teacher is considered as the best solution obtained so far. The process of working of TLBO is divided into two phases, teacher phase and learner phase.(
1
)
Teacher Phase. Assume there are D number of subjects (i.e., design variables), “NP” number of learners (i.e., population size,), then  xibest is the best learner (i.e., teacher) in subject i (i=1,2,…,D). The works of teaching are as follows:
(5)xij,new=xij,old+rand()×(xibest-TF×Meani),Meani=1NP∑j=1NP‍xij,j=1,2,…,NP,i=1,2,…,D,
where xij,old denotes the result of the jth (j=1,2,…,NP) learner before learning the ith (i=1,2,…,D) subject, and xij,new is the result of the jth learner after learning the ith subject. TF is the teaching factor which decides the value of Meani to be changed. The value of TF is generated randomly with probability as TF = round[1 + rand()].When the leanerxj finished his or her learning from the teacher, update the xj by xj,new if xj,new is better than xj,old.(2)Learner Phase. Another important approach to increase knowledge for a learner is to interact with other learners. Learning method is expressed in Algorithm 3.Algorithm 3:The procedure of learner phase.
For each learner  xj (j=1,2,…,NP)
Randomly select another learnerxk(j≠k)
If  xj is superior to xk then
xj,new=xj,old+rand()×(xj-xk)
Else
xj,new=xj,old+rand()×(xk-xj)
End
End  for
If  xj,new is superior to xj,old  then
xj=xj,new
End  IfEven since the TLBO algorithm proposed in 2011 by Rao et al. [18], it has been applied in the fields of engineering optimization, such as mechanical design optimization [18, 21], heat exchangers [22], thermoelectric cooler [23], and unconstrained and constrained real parameter optimization problems [24].In the TLBO method, teacher phase relying on the best solution found so far usually has the fast convergence speed and the best ability of exploitation; it is more suitable for improving accuracy of the global optimal solution. Learner phase relying on other learners usually has the slow convergence speed; however, it bears stronger exploration capability for solving multimodal problems. Therefore, we use the TLBO method to improve the performance and efficiency of HS algorithm in the HSTL method.


### 3.2. The HSTL Algorithm

In order to achieve the most satisfactory optimization performance by applying the HS algorithm to a given problem, we develop a novel harmony search algorithm combined with teaching-learning strategy, in which both new harmony generation strategies and associated control parameter values can be dynamically changed according to the process of evolution.It is of a high importance between the convergence and the diversity in order to improve the search efficiency. In the classical HS algorithm, a new harmony is generated in Step3. After the selecting operation in Step 4, the population variance may increase or decrease. With a high population variance, the diversity and exploration power will increase, in the same time the convergence and the exploitation power will decrease accordingly. Conversely, with a low population variance, the convergence and the exploitation power will increase [25]; the diversity and the exploration power will decrease. So it is significant how to keep balance between the convergence and the diversity. Classical HS algorithm loses its ability easily at later evolution process [26], because of improvising new harmony from HM with a high HMCR and local adjusting with PAR. And HM diversity decreases gradually from the early iteration to the last. However, in HS algorithm, a low HMCR employed will increase the probability (1-HMCR) of random selection in search space; the exploration power will enhance, but the local search ability and the exploitation accuracy cannot be improved by single pitch adjusting strategy.To overcome the inherent weaknesses of HS, in this section, we propose HSTL method. An improved teaching-learning strategy is employed to improve the search ability of optimal solution in the HSTL method. The HSTL algorithm works as follows.(1)
Optimization target vector preparation:xnew=xr, where xr (r=1,2,…,HMS) is a harmony vector selected randomly in HM. Next, four strategies are employed to improve the target vector.(2)
Improve the target vectorxnew with the following 4 strategies.(a)Harmony Memory Consideration. The ith design value of the target vector xinew, (i=1,2,…,D) is chosen randomly from harmony memory (HM) with a probability of HMCR as
(6)xinew=xij,j∈U{1,2,…,HMS},i=1,2,…,D.The HMCR is the rate of choosing one value from the historical values stored in the HM, which varies between 0 and 1.(b)Teaching-Learning Strategy. If the ith (i=1,2,…,D) design variable of the target vector xjnew has not been considered in HM, it will learn from the best harmony (i.e., teacher) with probability TLP in the teacher phase or from other harmony (i.e., learner) in the learner phase. The TLP is the probability of performing teaching-learning operator on design variables that have not been considered in (a). It works as follows.Teacher Phase. In this phase, learner will learn from the best learner (i.e., teacher) in class. Learner modification is expressed as
(7)xinew=xinew+rand()×[xibest-TF×Mi],Mi=(xiworst+xinew)2,i=1,2,…,D,
where xbest is the best harmony in HM, xworst is the worst harmony in HM, and rand() is a uniformly distributed random number between 0 and 1.The contribution in this section is that the mean value of population is replaced withMi=(xiworst+xinew)/2. There are two aspects to this apparent superiority. First, there are cheap to running cost because it do not need to compute the mean value of population in every iteration. Second, diversity of population will be enhanced more than the standard TLBO algorithm, that is because the new mean value Mi will be different for each individual, but the Meani in standard TLBO method is the same for every individual.Learner Phase. In this phase, through comparing the advantages and disadvantages between the other two learners, the learner xnew will learn from their advantages, which draw on the idea of differential evolution algorithm. The process is as follows.Randomly select two differential integerr1 and r2 from 1,2,…,HMS.If  xr1 is better than xr2xinew=xinew+rand()×(xir1-xir2)Elsexinew=xinew+rand()×(xir2-xir1)End If(c)Local Pitch Adjusting Strategy. To achieve better solutions in the search space, it will carry out the local pitch adjusting strategy with probability PAR when the ith design variable has not performed Harmony memory consideration and Teaching-Learning Strategy as
(8)xinew=xinew±rand()×BW(i),
where rand() is a uniformly distributed random number between 0 and 1, and BW(i) is an arbitrary distance bandwidth.(d)Random Mutation Operator. As with the HS algorithm, if design variable did not perform previous actions (harmony memory consideration, teaching-learning strategy, and local pitch adjusting strategy), the HSTL method will carry out random mutation operator in feasible space with probability Pm on ith design variable of  xnew as follows:
(9)xinew=xiL+(xiU-xiL)×rand().The improvisation of new target harmony in HSTL algorithm is shown in Algorithm4.Algorithm 4:The improvisation process of new harmony in HSTL algorithm.
x
new
=
x
r (r=1, 2,…, HMS);         //  randomly select xr as optimization target vector
For  i=1  to  D  do
If  rand( ) ≤ HMCR      //(a) Harmony memory consideration
xinew=xij (j=1,2,…,HMS)
Else  If rand( ) ≤ TLP  //(b)  Teaching-Learning strategy
If rand( ) ≤ 0.5
//Teaching
xinew=xinew+rand()×[xibest-0.5TF×(xiworst+xinew)]
Else
//Learning
Randomly select r1 and r2 from {1,2,…,HMS}
If  xr1 is better than xr2
xinew=xinew+rand()×(xir1-xir2)
Else
xinew=xinew+rand()×(xir2-xir1)
End
End
xinew=min(max(xinew,xiL),xlU)
Else  If rand(0, 1) ≤ PAR  // (c) Local pitch adjusting strategy
xinew=xinew±rand()×BW(i)
xinew=min(max(xinew,xiL),xlU)
Else  If rand(0, 1) ≤ Pm   // (d) Random mutation operator
xinew=xiL+(xiU-xiL)×rand()
End  If
End  ForThe flow chart of HSTL algorithm is shown in Figure1.Figure 1
The flowchart of HSTL algorithm.Parameters Dynamically Changed. To efficiently balance the exploration and exploitation power of the HSTL algorithm, HMCR, PAR, BW, and TLP parameters are dynamically adapted to a suitable range with the increase of generations. Equation (10) shows the dynamic change of HMCR, PAR, BW, and TLP, respectively.Consider the following [8]:
(10)HMCR=HMCRmin+(HMCRmax-HMCRmin)×(tTmax)2,TLP=TLPmin+(TLPmax-TLPmin)×(tTmax)k,k=5,PAR=PARmax-(PARmax-PARmin)×tTmax,BW=BWmax+exp[ln(BWminBWmax)×tTmax].


## 3.1. The TLBO Algorithm

Teaching-learning-based Optimization (TLBO) algorithm [18–20] is a new nature-inspired algorithm; it mimics the teaching process of teacher and learning process among learners in a class. TLBO shows a better performance with less computational effort for large scale problems [19], that is, problems of a high dimensionality. In addition, TLBO needs very few parameters.In the TLBO method, it is the task of teacher to try to increase mean knowledge of all learners of the class in the subject taught by him or her depending on his or her capability. Learners make efforts to increase their knowledge by interaction among themselves. A learner is considered as a solution or a vector, and different design variables of vector will be analogous to different subjects offered to learners and the learners’ result is analogous to the “fitness” as in other population-based optimization techniques. The teacher is considered as the best solution obtained so far. The process of working of TLBO is divided into two phases, teacher phase and learner phase.(
1
)
Teacher Phase. Assume there are D number of subjects (i.e., design variables), “NP” number of learners (i.e., population size,), then  xibest is the best learner (i.e., teacher) in subject i (i=1,2,…,D). The works of teaching are as follows:
(5)xij,new=xij,old+rand()×(xibest-TF×Meani),Meani=1NP∑j=1NP‍xij,j=1,2,…,NP,i=1,2,…,D,
where xij,old denotes the result of the jth (j=1,2,…,NP) learner before learning the ith (i=1,2,…,D) subject, and xij,new is the result of the jth learner after learning the ith subject. TF is the teaching factor which decides the value of Meani to be changed. The value of TF is generated randomly with probability as TF = round[1 + rand()].When the leanerxj finished his or her learning from the teacher, update the xj by xj,new if xj,new is better than xj,old.(2)Learner Phase. Another important approach to increase knowledge for a learner is to interact with other learners. Learning method is expressed in Algorithm 3.Algorithm 3:The procedure of learner phase.
For each learner  xj (j=1,2,…,NP)
Randomly select another learnerxk(j≠k)
If  xj is superior to xk then
xj,new=xj,old+rand()×(xj-xk)
Else
xj,new=xj,old+rand()×(xk-xj)
End
End  for
If  xj,new is superior to xj,old  then
xj=xj,new
End  IfEven since the TLBO algorithm proposed in 2011 by Rao et al. [18], it has been applied in the fields of engineering optimization, such as mechanical design optimization [18, 21], heat exchangers [22], thermoelectric cooler [23], and unconstrained and constrained real parameter optimization problems [24].In the TLBO method, teacher phase relying on the best solution found so far usually has the fast convergence speed and the best ability of exploitation; it is more suitable for improving accuracy of the global optimal solution. Learner phase relying on other learners usually has the slow convergence speed; however, it bears stronger exploration capability for solving multimodal problems. Therefore, we use the TLBO method to improve the performance and efficiency of HS algorithm in the HSTL method.


## 3.2. The HSTL Algorithm

In order to achieve the most satisfactory optimization performance by applying the HS algorithm to a given problem, we develop a novel harmony search algorithm combined with teaching-learning strategy, in which both new harmony generation strategies and associated control parameter values can be dynamically changed according to the process of evolution.It is of a high importance between the convergence and the diversity in order to improve the search efficiency. In the classical HS algorithm, a new harmony is generated in Step3. After the selecting operation in Step 4, the population variance may increase or decrease. With a high population variance, the diversity and exploration power will increase, in the same time the convergence and the exploitation power will decrease accordingly. Conversely, with a low population variance, the convergence and the exploitation power will increase [25]; the diversity and the exploration power will decrease. So it is significant how to keep balance between the convergence and the diversity. Classical HS algorithm loses its ability easily at later evolution process [26], because of improvising new harmony from HM with a high HMCR and local adjusting with PAR. And HM diversity decreases gradually from the early iteration to the last. However, in HS algorithm, a low HMCR employed will increase the probability (1-HMCR) of random selection in search space; the exploration power will enhance, but the local search ability and the exploitation accuracy cannot be improved by single pitch adjusting strategy.To overcome the inherent weaknesses of HS, in this section, we propose HSTL method. An improved teaching-learning strategy is employed to improve the search ability of optimal solution in the HSTL method. The HSTL algorithm works as follows.(1)
Optimization target vector preparation:xnew=xr, where xr (r=1,2,…,HMS) is a harmony vector selected randomly in HM. Next, four strategies are employed to improve the target vector.(2)
Improve the target vectorxnew with the following 4 strategies.(a)Harmony Memory Consideration. The ith design value of the target vector xinew, (i=1,2,…,D) is chosen randomly from harmony memory (HM) with a probability of HMCR as
(6)xinew=xij,j∈U{1,2,…,HMS},i=1,2,…,D.The HMCR is the rate of choosing one value from the historical values stored in the HM, which varies between 0 and 1.(b)Teaching-Learning Strategy. If the ith (i=1,2,…,D) design variable of the target vector xjnew has not been considered in HM, it will learn from the best harmony (i.e., teacher) with probability TLP in the teacher phase or from other harmony (i.e., learner) in the learner phase. The TLP is the probability of performing teaching-learning operator on design variables that have not been considered in (a). It works as follows.Teacher Phase. In this phase, learner will learn from the best learner (i.e., teacher) in class. Learner modification is expressed as
(7)xinew=xinew+rand()×[xibest-TF×Mi],Mi=(xiworst+xinew)2,i=1,2,…,D,
where xbest is the best harmony in HM, xworst is the worst harmony in HM, and rand() is a uniformly distributed random number between 0 and 1.The contribution in this section is that the mean value of population is replaced withMi=(xiworst+xinew)/2. There are two aspects to this apparent superiority. First, there are cheap to running cost because it do not need to compute the mean value of population in every iteration. Second, diversity of population will be enhanced more than the standard TLBO algorithm, that is because the new mean value Mi will be different for each individual, but the Meani in standard TLBO method is the same for every individual.Learner Phase. In this phase, through comparing the advantages and disadvantages between the other two learners, the learner xnew will learn from their advantages, which draw on the idea of differential evolution algorithm. The process is as follows.Randomly select two differential integerr1 and r2 from 1,2,…,HMS.If  xr1 is better than xr2xinew=xinew+rand()×(xir1-xir2)Elsexinew=xinew+rand()×(xir2-xir1)End If(c)Local Pitch Adjusting Strategy. To achieve better solutions in the search space, it will carry out the local pitch adjusting strategy with probability PAR when the ith design variable has not performed Harmony memory consideration and Teaching-Learning Strategy as
(8)xinew=xinew±rand()×BW(i),
where rand() is a uniformly distributed random number between 0 and 1, and BW(i) is an arbitrary distance bandwidth.(d)Random Mutation Operator. As with the HS algorithm, if design variable did not perform previous actions (harmony memory consideration, teaching-learning strategy, and local pitch adjusting strategy), the HSTL method will carry out random mutation operator in feasible space with probability Pm on ith design variable of  xnew as follows:
(9)xinew=xiL+(xiU-xiL)×rand().The improvisation of new target harmony in HSTL algorithm is shown in Algorithm4.Algorithm 4:The improvisation process of new harmony in HSTL algorithm.
x
new
=
x
r (r=1, 2,…, HMS);         //  randomly select xr as optimization target vector
For  i=1  to  D  do
If  rand( ) ≤ HMCR      //(a) Harmony memory consideration
xinew=xij (j=1,2,…,HMS)
Else  If rand( ) ≤ TLP  //(b)  Teaching-Learning strategy
If rand( ) ≤ 0.5
//Teaching
xinew=xinew+rand()×[xibest-0.5TF×(xiworst+xinew)]
Else
//Learning
Randomly select r1 and r2 from {1,2,…,HMS}
If  xr1 is better than xr2
xinew=xinew+rand()×(xir1-xir2)
Else
xinew=xinew+rand()×(xir2-xir1)
End
End
xinew=min(max(xinew,xiL),xlU)
Else  If rand(0, 1) ≤ PAR  // (c) Local pitch adjusting strategy
xinew=xinew±rand()×BW(i)
xinew=min(max(xinew,xiL),xlU)
Else  If rand(0, 1) ≤ Pm   // (d) Random mutation operator
xinew=xiL+(xiU-xiL)×rand()
End  If
End  ForThe flow chart of HSTL algorithm is shown in Figure1.Figure 1
The flowchart of HSTL algorithm.Parameters Dynamically Changed. To efficiently balance the exploration and exploitation power of the HSTL algorithm, HMCR, PAR, BW, and TLP parameters are dynamically adapted to a suitable range with the increase of generations. Equation (10) shows the dynamic change of HMCR, PAR, BW, and TLP, respectively.Consider the following [8]:
(10)HMCR=HMCRmin+(HMCRmax-HMCRmin)×(tTmax)2,TLP=TLPmin+(TLPmax-TLPmin)×(tTmax)k,k=5,PAR=PARmax-(PARmax-PARmin)×tTmax,BW=BWmax+exp[ln(BWminBWmax)×tTmax].


## 4. Numerical Experiments and Results

### 4.1. Test Functions

The test functionsF1–F23 [27–29] are shown in Table 1, and F24–F31 are demonstrated. Table 2 in Functions F24–F31 [30] are hybrid composition functions. The hybrid composition functions are built combining a nonseparable (NS) function with other functions. The considered functions are as folows.(i)
Nonseparable functions:
(a)
F15: shifted Rosenbrock's function,(b)
F17: shifted Griewank's function,(c)
NS-F21: nonshifted Extended F10,(d)
NS-F22: nonshifted Bohachevsky.(ii)
Other component functions:
(a)
F13: shifted sphere function,(b)
F16: shifted Rastrigin function,(c)
F20: Schwefel2.22 function.Table 1
Benchmark test functions.
Function name
Benchmark functions expression
Search range
Optimum value
F
1: Ackley function
F
1
(
x
)
=
-
20
e
(
1
/
5
)
(
1
/
D
)
∑
i
=
1
D
x
i
2
-
e
(
1
/
D
)
∑
i
=
1
D
cos
(
2
π
x
i
)
+
20
-
e
[
-
15,30
]
D
x
*
=
(
0,0
,
…
,
0
), F1(x*)=0
F
2: Dixon and Price function
F
2
(
x
)
=
(
x
1
+
1
)
2
+
∑
i
=
2
D
i
(
2
x
i
2
-
x
i
-
1
)
2
[
-
10,10
]
D
F
2
(
x
*
)
=
0
F
3: Griewank function
F
3
=
(
1
/
4000
)
∑
i
=
1
D
x
i
2
-
∏
i
=
1
D
(
cos
(
x
i
/
i
)
)
+
1
[
-
600,600
]
D
x
*
=
(
0,0
,
…
,
0
), F3(x*)=0
F
4: Levy function
F
4
(
x
)
=
sin
2
(
π
y
1
)
+
∑
i
=
1
D
-
1
[
(
y
i
-
1
)
2
(
1
+
10
sin
2
(
π
y
i
+
1
)
)
]
[
-
10,10
]
D
x
*
=
(
1,1
,
…
,
1
), F4(x*)=0
+
(
y
D
-
1
)
2
(
1
+
10
sin
2
(
2
π
y
D
)
), where yi=1+((xi-1)/4), i=1,2,…,D
F
5: Michalewics function
F
5
(
x
)
=
-
∑
i
=
1
D
sin
(
x
i
)
(
sin
(
i
x
i
2
/
π
)
)
2
m
;
m
=
10
[
-
10
,
π
]
D
n
=
5
;
F
5
(
x
*
)
=
-
4.687658
F
6: Powell function
F
6
(
x
)
=
∑
i
=
1
D
/
4
[
(
x
4
i
-
3
+
10
x
4
i
-
2
)
2
+
5
(
x
4
i
-
1
-
x
4
i
)
2
+
(
x
4
i
-
2
-
x
4
i
-
1
)
2
+
10
(
x
4
i
-
3
-
x
4
i
)
4
]
[
-
4,5
]
D
x* =  (3, −1, 0, 1, …, 3, −1, 0, 1), F6(x*)=0
F
7: Rastrigin function
F
7
(
x
)
=
10
D
+
∑
i
=
1
D
(
x
i
2
-
10
cos
(
2
π
x
i
)
)
[
-
5.12,5.12
]
D
x
*
=
(
0,0
,
…
,
0
), F7(x*)=0
F
8: Rosenbrock function
F
8
(
x
)
=
∑
i
=
1
D
-
1
[
100
(
x
i
2
-
x
i
-
1
)
2
+
(
x
i
-
1
)
2
]
[
-
10,10
]
D
x
*
=
(
1,1
,
…
,
1
), F8(x*)=0
F
9: Schwefel2.26 function
F
9
(
x
)
=
418.9829
D
+
∑
i
=
1
D
x
i
2
sin
(
|
x
i
|
)
[
-
512,512
]
D
x
*
=
(
420.9687,420.9687
,
…, 420.9687), F9(x*)=0
F
10: Sphere function
F
10
(
x
)
=
∑
i
=
1
D
x
i
2
[
-
100,100
]
D
x
*
=
(
0,0
,
…
,
0
), F10(x*)=0
F
11: Trid function
F
11
(
x
)
=
∑
i
=
1
D
(
x
i
-
1
)
2
-
∑
i
=
2
D
x
i
x
i
-
1
[
-
D
2
,
D
2
]
D
D
=
5
;
F
11
(
x
*
)
=
-
30
F
12: Zakharov function
F
12
(
x
)
=
∑
i
=
1
D
x
i
2
+
(
∑
i
=
1
D
0.5
i
x
i
)
2
+
(
∑
i
=
1
D
0.5
i
x
i
)
4
[
-
5,10
]
D
x
*
=
(
0,0
,
…
,
0
), F12(x*)=0
F
13: Sphere shift function
F
13
(
x
)
=
∑
i
=
1
D
z
i
2
+
f
_
bia
s
13, f_bias13=-450, z=x-o; o=[o1,o2,...,oD]
[
-
100,100
]
D
x
*
=
o, F12(x*)=-450
F
14: Schwefel shift function
F
14
=
max
(
|
z
|
)
+
f
_
bia
s
14, f_bias14=-450, z=x-o; o=[o1,o2,...,oD]
[
-
100,100
]
D
x
*
=
o, F14(x*)=-450
F
15: Rosenbrock shift function
F
15
(
x
)
=
∑
i
=
1
D
-
1
[
100
(
z
i
2
-
z
i
-
1
)
2
+
(
z
i
-
1
)
2
]
+
f
_
bia
s
15, f_bias15=390, z=x-o; o=[o1,o2,...,oD]
[
-
100,100
]
D
x
*
=
o, F15(x*)=390
F
16: Griewank shift function
F
16
=
(
1
/
4000
)
∑
i
=
1
D
z
i
2
-
∏
i
=
1
D
(
cos
(
z
i
/
i
)
)
+
1
+
f
_
bia
s
16, f_bias16=-180, z=(x-o)×M, o=[o1,o2,...,oD]
[
-
600,600
]
D
x
*
=
o, F16(x*)=-180
F
17: Rastrigin shift function
F
17
(
x
)
=
10
D
+
∑
i
=
1
D
(
z
i
2
-
10
cos
(
2
π
z
i
)
)
+
f
_
bia
s
17, f_bias17=-330, z=x-o; o=[o1,o2,...,oD]
[
-
5.12,5.12
]
D
x
*
=
o, F17(x*)=-330
F
18: Ackley shift  function
F
18
(
x
)
=
-
20
e
(
1
/
5
)
(
1
/
D
)
∑
i
=
1
D
z
i
2
-
e
(
1
/
D
)
∑
i
=
1
D
cos
(
2
π
z
i
)
+
20
-
e, f_bias18=-140, z=x-o; o=[o1,o2,...,oD]
[
-
32,32
]
D
x
*
=
o, F18(x*)=-140
F
19: Fast Fractal “Double Dip” function
F
19
(
x
)
=
∑
i
=
1
D
fractal
1
D
(
x
i
+
twist
(
x
(
i
mod
D
)
+
1
)
)
Unknown
[-1,1]D
twist
(
y
)
=
4
(
y
4
-
2
y
3
+
y
2
)
fractal
1
D
(
x
)
≈
∑
k
=
1
3
∑
1
2
k
-
1
∑
1
ran2
(
o
)
doubledip
(
x
,
ran
1
(
o
)
,
1
2
k
-
1
(
2
-
ran
1
(
o
)
)
)
doubledip
(
x
,
c
,
s
)
=
{
(
-
6144
(
x
-
c
)
6
+
3088
(
x
-
c
)
4
-
392
(
x
-
c
)
2
+
1
)
s
0
,
otherwise
ran
1
(
o
): double, pseudo randomly chosen, with seed o, with equal probability from the interval [0,1]  ran2(o): integer, pseudo randomly chosen, with seed o, with equal probability from the set {0,1,2}  fractal1D(x) is an approximation to a recursive algorithm, it does not take account of wrapping at the boundaries, or local reseeding of the random generators.
F
20: Schwefel2.22 function
F
20
(
x
)
=
∑
i
=
1
D
|
x
i
|
+
∏
i
=
1
D
|
x
i
|
[
-
10,10
]
D
x
*
=
(
0,0
,
.
.
.
,
0
), F20(x*)=0
F
21: Extended_f10 shift function
F
21
(
x
)
=
(
∑
i
=
1
D
-
1
f
10
(
z
i
,
z
i
+
1
)
)
+
f
10
(
z
D
,
z
1
)
,
z
=
x
-
o
f
10
=
(
x
2
+
y
2
)
0.25
·
(
sin
2
(
50
·
(
x
2
+
y
2
)
0.1
)
+
1
)
[
-
100,100
]
D
x
*
=
o, F21(x*)=0
F
22: Bohachevsky function
F
22
(
x
)
=
∑
i
=
1
D
(
z
i
2
+
2
z
i
+
1
2
-
0.3
cos
(
3
π
z
i
)
-
0.4
cos
(
4
π
z
i
+
1
)
+
0.7
)
,
z
=
x
-
o
[
-
15,15
]
D
x
*
=
o, F22(x*)=0
F
23: Schaffer shift function
F
23
(
x
)
=
∑
i
=
1
D
-
1
(
z
i
2
+
z
i
+
1
2
)
0.25
(
sin
2
(
50
·
(
z
i
2
+
z
i
+
1
2
)
0.1
)
+
1
)
,
z
=
x
-
o
[
-
100,100
]
D
x
*
=
o, F23(x*)=0Table 2
The hybrid functions (F24–F31).
Function
F
ns
F
′
m
ns
Range
Fitness optimum
F
24
NS-F21
F
13
0.25
[
-
100,100
]
D
−450
F
25
NS-F22
F
15
0.25
[
-
100,100
]
D
390
F
26
NS-F23
F
16
0.25
[
-
5,5
]
D
−330
F
27
NS-F22
NS-F20
0.25
[
-
10,10
]
D
0
F
28
NS-F21
F
13
0.5
[
-
100,100
]
D
−450
F
29
NS-F21
F
15
0.75
[
-
100,100
]
D
390
F
30
NS-F21
F
16
0.75
[
-
5,5
]
D
−330
F
31
NS-F22
NS-F20
0.75
[
-
10,10
]
D
0Hybrid functionFns⊕F′(S) is composed of a nonseparable function Fns and other function F′. The hybrid procedure is shown as follows.  (1)  S is divided into two parts (part1 and part2) as followsIf  mns≤0.5 then
part1 is composed by the first D·mns even variables. (length (part1) = D·mns)part2 is composed by the remaining variables. (length (part2) = D-length (part1))Else
part2 is composed by the first D·(1-mns) odd variables. (length (part2) = D·(1-mns))part1 is composed by the remaining variables. (length (part1) = D-length (part2))End If(2) Return Fns(part1)⊕F′(part2).We have used 31 well-known unconstrained benchmark functions [27–30] as a testbed to evaluate the performance of the HSTL algorithm presented in this paper. These test functions are considered as particularly challenging for many existing meta-heuristic optimization algorithms except for F10. The composition of these test functions contains some characteristics, such as separable design variables, nonseparable design variables, strong unimodality, strong multimodality, and hybrid. Many of them blend different characteristics together. Table 3 shows the characteristics of all test functions.Table 3
The characteristics of all test functions.
Function
F
1
F
2
F
3
F
4
F
5
F
6
F
7
F
8
F
9
F
10
F
11
F
12
F
13
F
14
F
15
F
16
Unimodal (U)/multimodal (M)
M
M
M
M
M
M
M
M
M
U
U
U
U
U
M
M
Shifted (Y/N)
N
N
N
N
N
N
N
N
N
N
N
N
Y
Y
Y
Y
Separable (Y/N)
Y
N
N
Y
Y
N
Y
N
Y
Y
Y
Y
Y
N
N
Y
Hybrid (Y/N)
N
N
N
N
N
N
N
N
N
N
N
N
N
N
N
N
Function
F
17
F
18
F
19
F
20
F
21
F
22
F
23
F
24
F
25
F
26
F
27
F
28
F
29
F
30
F
31
Unimodal (U)/multimodal (M)
M
M
M
U
U
U
U
U
M
M
M
U
M
M
N
Shifted (Y/N)
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
N
Separable (Y/N)
N
N
N
N
N
N
N
N
N
N
N
N
N
N
N
Hybrid (Y/N)
N
N
N
N
N
N
Y
Y
Y
Y
Y
Y
Y
Y
Y


### 4.2. Experimental Setup

Simulation experiments are carried out to compare the optimization (minimization) capabilities of the presented method (HSTL) with respect to (a) classical HS [1, 2], (b) SGHS [16], and (c) NGHS [13, 14]. All the experiments were performed on Windows XP 32 system with Intel(R) Core(TM) i3-2120 CPU@3.30 GHz and 2 GB RAM, and all the program codes were written in MATLAB R2009a.In the experiments, the parameters settings for the compared HS algorithms are shown in Table4; the dimensions of the benchmark problems are set as 50, 100, and 200, respectively. To make the comparison fair, the populations for all the competitor algorithms (for all problems tested) were initialized using the same random seeds. The variants of HS algorithm were set at the same termination criteria: the number of improvisations (function evaluation times: FEs) FEs = 500D, respectively.Table 4
Parameter settings for the compared HS algorithms (HS, SGHS, NGHS, HSTL).
Algorithm
HMS
HMCR
PAR
BW
Others
HS
35
0.98
0.33
BW = (UB − LB)/1000
SGHS
35
HMCR
m = 0.9
PARmax = 0.99,PARmin = 0.01
BWmax = (UB − LB)/10BWmin = 0.0005
LP = 100
NGHS
35
/
/
/
P
m = 0.01
HSTL
35
HMCRmax = 0.99
PARmax = 0.8
BWmax = (UB − LB)/20
TLPmax = 0.5, TLPmin = 0.15
HMCRmin = 0.75
PARmin = 0.2
BWmin = (UB − LB)/3500
P
m = 0.15, k = 5The best and worst fitness values of each benchmark problem are recorded for 30 independent runs; the mean fitness, standard deviation (STD), and mean runtime of each function are calculated for 30 independent runs, and the Mean fitness, Standard Deviation (STD) and mean runtime of each function are calculated for 30 independent runs.


### 4.3. The Results Comparison between HSTL, HS, SGHS, and NGHS Algorithm

From Table5, it can be found that the mean optimal fitness values of HSTL are always less than those of other 3 HS algorithms for all test functions except for F12, F14, F16, and F29 when dimension are equal to 50 and maxFEs = 25000, and all these mean optimal fitness values are slightly larger than the NGHS algorithm for F12, F14, F16, and F29. According to criterions (best, mean, worst, and STD), the over performance of HSTL method outperforms the other three HS algorithms for 31 benchmark problems except F12, F14, and F29. Taken together, the beast, mean, and STD obtained by the HSTL method are better than those of other three methods for most test functions. In addition, the runtime is less than SGHS for all problems.Table 5
The optimization results of four harmony search algorithms forF1–F31 (D = 50, FEs = 500D).
Function
Algorithm
Best
Mean
Worst
STD
Runtime
F
1
HS
2.566680
E
+
00
3.302045
E
+
00
3.884725
E
+
00
3.248466
E
-
01
5.916126
E
-
01
SGHS
1.813356
E
+
00
2.557675
E
+
00
3.129460
E
+
00
3.608468
E
-
01
1.539694
E
+
00
NGHS
3.447238
E
-
02
5.592492
E
-
02
8.840852
E
-
02
1.464912
E
-
02
6.187550
E
-
01
HSTL
9.224783
E
-
04
1.775338
E
-
03
2.516676
E
-
03
3.736810
E
-
04
1.150359
E
+
00
F
2
HS
2.528891
E
+
01
1.303365
E
+
02
2.064702
E
+
02
4.764531
E
+
01
3.728292
E
-
01
SGHS
2.291379
E
+
01
5.454353
E
+
01
1.405853
E
+
02
2.704011
E
+
01
1.335320
E
+
00
NGHS
7.771989
E
-
01
5.744259
E
+
00
1.159369
E
+
01
3.130084
E
+
00
4.210442
E
-
01
HSTL
6.666789
E
-
01
7.870821
E
-
01
1.185710
E
+
00
1.526289
E
-
01
8.835301
E
-
01
F
3
HS
1.498964
E
+
00
1.663430
E
+
00
1.988965
E
+
00
1.398770
E
-
01
6.367849
E
-
01
SGHS
1.190177
E
+
00
1.475248
E
+
00
2.130067
E
+
00
2.263591
E
-
01
1.593317
E
+
00
NGHS
4.418931
E
-
02
7.146802
E
-
02
1.559262
E
-
01
2.679798
E
-
02
6.544169
E
-
01
HSTL
2.933239
E
-
05
8.315104
E
-
04
1.506785
E
-
02
3.351017
E
-
03
1.209138
E
+
00
F
4
HS
2.734048
E
-
01
3.341458
E
-
01
4.153356
E
-
01
3.844929
E
-
02
1.368443
E
+
00
SGHS
1.417380
E
-
01
1.714592
E
+
00
3.739141
E
+
00
1.116863
E
+
00
2.390772
E
+
00
NGHS
2.066964
E
-
04
3.193237
E
-
04
5.845768
E
-
04
9.202494
E
-
05
1.393585
E
+
00
HSTL
4.120272
E
-
06
6.258354
E
-
06
9.738134
E
-
06
1.414984
E
-
06
2.027401
E
+
00
F
5
HS
-
4.170235
E
+
01
-
4.036729
E
+
01
-
3.828157
E
+
01
9.770373
E
-
01
8.758810
E
-
01
SGHS
-
4.660214
E
+
01
-
4.506838
E
+
01
-
4.284438
E
+
01
9.381859
E
-
01
1.822759
E
+
00
NGHS
-
4.761973
E
+
01
-
4.653808
E
+
01
-
4.546623
E
+
01
5.188843
E
-
01
9.208168
E
-
01
HSTL
-
4.848365
E
+
01
-
4.783102
E
+
01
-
4.713305
E
+
01
3.899320
E
-
01
1.454742
E
+
00
F
6
HS
4.064420
E
+
00
1.023338
E
+
01
1.807872
E
+
01
4.174841
E
+
00
1.270949
E
+
00
SGHS
3.787277
E
+
00
2.168953
E
+
01
5.037661
E
+
01
1.367783
E
+
01
2.307965
E
+
00
NGHS
4.732459
E
-
02
9.566685
E
-
02
1.331749
E
-
01
2.187037
E
-
02
1.313182
E
+
00
HSTL
3.072186
E
-
02
7.276520
E
-
02
1.260607
E
-
01
2.847471
E
-
02
1.955321
E
+
00
F
7
HS
2.373168
E
+
01
3.076467
E
+
01
3.740304
E
+
01
3.698242
E
+
00
4.206309
E
-
01
SGHS
4.212332
E
+
01
5.047204
E
+
01
5.912495
E
+
01
5.715449
E
+
00
1.387887
E
+
00
NGHS
4.155143
E
+
00
8.088647
E
+
00
1.126315
E
+
01
1.970674
E
+
00
4.668058
E
-
01
HSTL
3.164383
E
-
05
3.450611
E
-
03
3.265254
E
-
02
8.899514
E
-
03
9.399841
E
-
01
F
8
HS
5.951376
E
+
01
4.482384
E
+
02
8.417699
E
+
02
2.411457
E
+
02
3.847198
E
-
01
SGHS
2.024308
E
+
02
4.029735
E
+
02
1.163300
E
+
03
2.088718
E
+
02
1.346647
E
+
00
NGHS
2.246655
E
+
01
1.232892
E
+
02
2.151188
E
+
02
5.247493
E
+
01
4.322725
E
-
01
HSTL
4.179333
E
+
01
7.883687
E
+
01
1.109876
E
+
02
3.016135
E
+
01
9.006008
E
-
01
F
9
HS
1.891514
E
+
02
2.441957
E
+
02
3.147589
E
+
02
3.822653
E
+
01
4.938682
E
-
01
SGHS
4.914947
E
+
02
1.155863
E
+
03
1.616206
E
+
03
3.125553
E
+
02
1.506911
E
+
00
NGHS
1.177227
E
+
00
1.939242
E
+
02
5.928832
E
+
02
1.437114
E
+
02
5.429397
E
-
01
HSTL
2.831025
E
-
03
4.800827
E
+
01
2.559129
E
+
02
8.324164
E
+
01
1.055470
E
+
00
F
1
0
HS
4.982674
E
+
01
7.634414
E
+
01
1.088877
E
+
02
1.384184
E
+
01
5.155853
E
-
01
SGHS
1.941824
E
+
01
5.712271
E
+
01
1.173837
E
+
02
2.463712
E
+
01
1.483779
E
+
00
NGHS
2.933452
E
-
02
5.495792
E
-
02
1.250118
E
-
01
2.413133
E
-
02
5.503947
E
-
01
HSTL
5.196982
E
-
05
1.156867
E
-
04
1.822736
E
-
04
3.949670
E
-
05
1.105805
E
+
00
F
1
1
HS
-
8.495269
E
+
03
2.112918
E
+
05
6.120867
E
+
05
1.507484
E
+
05
5.529535
E
-
01
SGHS
1.495650
E
+
05
2.926573
E
+
05
4.921806
E
+
05
8.867408
E
+
04
1.522435
E
+
00
NGHS
7.811770
E
+
02
6.724066
E
+
04
1.795737
E
+
05
4.051646
E
+
04
5.825563
E
-
01
HSTL
3.586693
E
+
03
3.982094
E
+
04
1.129715
E
+
05
3.077074
E
+
04
1.154489
E
+
00
F
1
2
HS
1.808763
E
+
02
2.922832
E
+
02
3.779931
E
+
02
5.595106
E
+
01
5.278572
E
-
01
SGHS
1.966065
E
+
02
2.939376
E
+
02
4.245442
E
+
02
6.167682
E
+
01
1.413886
E
+
00
NGHS
2.263637
E
+
01
5.379553
E
+
01
9.021302
E
+
01
1.550666
E
+
01
5.732848
E
-
01
HSTL
1.598764
E
+
02
2.741391
E
+
02
3.460420
E
+
02
5.654623
E
+
01
1.075394
E
+
00
F
1
3
HS
-
3.982491
E
+
02
-
3.703682
E
+
02
-
3.359549
E
+
02
1.639155
E
+
01
1.281255
E
+
00
SGHS
-
4.342564
E
+
02
-
4.020580
E
+
02
-
3.757443
E
+
02
1.465006
E
+
01
2.355018
E
+
00
NGHS
-
4.499802
E
+
02
-
4.499468
E
+
02
-
4.498976
E
+
02
2.171095
E
-
02
1.325362
E
+
00
HSTL
-
4.499992
E
+
02
-
4.499987
E
+
02
-
4.499983
E
+
02
2.372395
E
-
04
2.063549
E
+
00
F
1
4
HS
-
4.330907
E
+
02
-
4.272501
E
+
02
-
4.198265
E
+
02
3.339807
E
+
00
1.293516
E
+
00
SGHS
-
4.290403
E
+
02
-
4.161920
E
+
02
-
4.061673
E
+
02
6.869724
E
+
00
2.335600
E
+
00
NGHS
-
4.475734
E
+
02
-
4.467607
E
+
02
-
4.456620
E
+
02
5.729226
E
-
01
1.334976
E
+
00
HSTL
-
4.345355
E
+
02
-
4.303615
E
+
02
-
4.257539
E
+
02
2.813241
E
+
00
2.110056
E
+
00
F
1
5
HS
4.518000
E
+
04
1.178572
E
+
05
2.758509
E
+
05
5.318182
E
+
04
1.548986
E
+
00
SGHS
1.546908
E
+
04
1.439934
E
+
05
1.140938
E
+
06
2.428257
E
+
05
2.663552
E
+
00
NGHS
5.520145
E
+
02
1.096629
E
+
03
5.304441
E
+
03
1.408912
E
+
03
1.595152
E
+
00
HSTL
4.364245
E
+
02
8.663389
E
+
02
6.714816
E
+
03
1.380399
E
+
03
2.384685
E
+
00
F
1
6
HS
-
3.073606
E
+
02
-
2.979182
E
+
02
-
2.930230
E
+
02
3.428569
E
+
00
1.388468
E
+
00
SGHS
-
2.904807
E
+
02
-
2.795281
E
+
02
-
2.653651
E
+
02
7.917957
E
+
00
2.457957
E
+
00
NGHS
-
3.247746
E
+
02
-
3.221057
E
+
02
-
3.177697
E
+
02
2.003994
E
+
00
1.425334
E
+
00
HSTL
-
3.257734
E
+
02
-
3.194510
E
+
02
-
3.131576
E
+
02
3.257068
E
+
00
2.154368
E
+
00
F
1
7
HS
-
1.784876
E
+
02
-
1.782673
E
+
02
-
1.779930
E
+
02
1.484480
E
-
01
1.920537
E
+
00
SGHS
-
1.788319
E
+
02
-
1.785108
E
+
02
-
1.778547
E
+
02
2.823212
E
-
01
3.026930
E
+
00
NGHS
-
1.799673
E
+
02
-
1.799278
E
+
02
-
1.798487
E
+
02
2.657279
E
-
02
1.936843
E
+
00
HSTL
-
1.799993
E
+
02
-
1.799977
E
+
02
-
1.799891
E
+
02
2.941948
E
-
03
2.661228
E
+
00
F
1
8
HS
-
1.373170
E
+
02
-
1.367418
E
+
02
-
1.362105
E
+
02
3.320310
E
-
01
1.538989
E
+
00
SGHS
-
1.380207
E
+
02
-
1.373137
E
+
02
-
1.363707
E
+
02
3.842756
E
-
01
2.631186
E
+
00
NGHS
-
1.399544
E
+
02
-
1.399264
E
+
02
-
1.399026
E
+
02
1.478740
E
-
02
1.556766
E
+
00
HSTL
-
1.399944
E
+
02
-
1.399932
E
+
02
-
1.399923
E
+
02
4.802592
E
-
04
2.308382
E
+
00
F
1
9
HS
-
7.783258
E
+
02
-
7.574243
E
+
02
-
7.440193
E
+
02
9.549819
E
+
00
3.364700
E
+
00
SGHS
-
7.977925
E
+
02
-
7.830542
E
+
02
-
7.648281
E
+
02
8.315008
E
+
00
4.449306
E
+
00
NGHS
-
8.126267
E
+
02
-
7.983609
E
+
02
-
7.807750
E
+
02
7.476016
E
+
00
3.453860
E
+
00
HSTL
-
8.133893
E
+
02
-
8.054826
E
+
02
-
7.933937
E
+
02
5.255994
E
+
00
4.110440
E
+
00
F
20
HS
3.235346
E
+
01
4.619696
E
+
01
6.603604
E
+
01
9.209638
E
+
00
6.108355
E
-
01
SGHS
1.840610
E
+
01
2.931223
E
+
01
4.219485
E
+
01
6.705792
E
+
00
1.656616
E
+
00
NGHS
1.023646
E
+
00
1.326115
E
+
00
1.638720
E
+
00
1.801950
E
-
01
6.740073
E
-
01
HSTL
1.666479
E
-
02
2.377405
E
-
02
3.561417
E
-
02
3.989928
E
-
03
1.340302
E
+
00
F
21
HS
1.039417
E
+
02
1.371442
E
+
02
1.606956
E
+
02
1.457780
E
+
01
1.692515
E
+
01
SGHS
6.337241
E
+
01
8.847938
E
+
01
1.032481
E
+
02
9.606610
E
+
00
1.883071
E
+
01
NGHS
2.804776
E
+
01
3.706996
E
+
01
4.978956
E
+
01
6.433861
E
+
00
1.691865
E
+
01
HSTL
4.874162
E
+
00
5.839427
E
+
00
7.688011
E
+
00
8.479931
E
-
01
1.766882
E
+
01
F
22
HS
2.466530
E
+
01
3.127048
E
+
01
3.564485
E
+
01
3.212730
E
+
00
1.153501
E
+
01
SGHS
1.342097
E
+
01
2.030578
E
+
01
2.459678
E
+
01
3.326658
E
+
00
1.349578
E
+
01
NGHS
4.017501
E
-
02
7.928514
E
-
02
1.477305
E
-
01
3.097912
E
-
02
1.160670
E
+
01
HSTL
8.611143
E
-
04
2.201951
E
-
02
4.140857
E
-
01
9.228328
E
-
02
1.214935
E
+
01
F
23
HS
1.167773
E
+
02
1.315135
E
+
02
1.534918
E
+
02
1.135387
E
+
01
1.264720
E
+
01
SGHS
7.270431
E
+
01
8.324425
E
+
01
1.008921
E
+
02
6.879689
E
+
00
1.442205
E
+
01
NGHS
2.477052
E
+
01
3.758657
E
+
01
5.407804
E
+
01
7.976231
E
+
00
1.312881
E
+
01
HSTL
4.038784
E
+
00
6.052038
E
+
00
1.261065
E
+
01
1.761817
E
+
00
1.385192
E
+
01
F
24
HS
-
4.217519
E
+
02
-
4.046735
E
+
02
-
3.782667
E
+
02
1.257151
E
+
01
1.359617
E
+
01
SGHS
-
4.431356
E
+
02
-
4.312111
E
+
02
-
3.858681
E
+
02
1.369453
E
+
01
1.555383
E
+
01
NGHS
-
4.499996
E
+
02
-
4.499993
E
+
02
-
4.499982
E
+
02
3.724625
E
-
04
1.364959
E
+
01
HSTL
-
4.499996
E
+
02
-
4.499994
E
+
02
-
4.499991
E
+
02
1.730785
E
-
04
1.440449
E
+
01
F
25
HS
2.665579
E
+
04
6.003134
E
+
04
1.020993
E
+
05
2.295715
E
+
04
1.384424
E
+
01
SGHS
6.783432
E
+
03
3.423766
E
+
04
1.447178
E
+
05
3.728901
E
+
04
1.574535
E
+
01
NGHS
4.838503
E
+
02
5.491368
E
+
02
6.308092
E
+
02
4.002266
E
+
01
1.387828
E
+
01
HSTL
4.283814
E
+
02
5.425790
E
+
02
1.213942
E
+
03
1.982288
E
+
02
1.433272
E
+
01
F
26
HS
-
3.056734
E
+
02
-
3.005925
E
+
02
-
2.916669
E
+
02
3.782453
E
+
00
1.339199
E
+
01
SGHS
-
2.924154
E
+
02
-
2.838442
E
+
02
-
2.713927
E
+
02
6.793276
E
+
00
1.527401
E
+
01
NGHS
-
3.267093
E
+
02
-
3.228070
E
+
02
-
3.183256
E
+
02
2.244713
E
+
00
1.341534
E
+
01
HSTL
-
3.289412
E
+
02
-
3.236531
E
+
02
-
3.188403
E
+
02
2.872375
E
+
00
1.421595
E
+
01
F
27
HS
4.849375
E
+
00
6.498510
E
+
00
8.495851
E
+
00
1.017495
E
+
00
1.262153
E
+
01
SGHS
1.619215
E
+
00
4.090404
E
+
00
6.379225
E
+
00
1.193628
E
+
00
1.455011
E
+
01
NGHS
6.034321
E
-
02
8.531001
E
-
02
1.167611
E
-
01
1.717796
E
-
02
1.266599
E
+
01
HSTL
8.329468
E
-
03
9.918090
E
-
03
1.162367
E
-
02
1.094430
E
-
03
1.344353
E
+
01
F
28
HS
-
4.495086
E
+
02
-
4.478733
E
+
02
-
4.443561
E
+
02
1.460489
E
+
00
1.617566
E
+
01
SGHS
-
4.499731
E
+
02
-
4.498848
E
+
02
-
4.497073
E
+
02
8.308225
E
-
02
1.816665
E
+
01
NGHS
-
4.500000
E
+
02
-
4.500000
E
+
02
-
4.500000
E
+
02
5.050670
E
-
14
1.633242
E
+
01
HSTL
-
4.500000
E
+
02
-
4.500000
E
+
02
-
4.500000
E
+
02
3.894074
E
-
06
1.700242
E
+
01
F
29
HS
7.984189
E
+
02
5.231460
E
+
03
2.285396
E
+
04
5.423033
E
+
03
1.646778
E
+
01
SGHS
6.857379
E
+
02
2.714991
E
+
03
1.007518
E
+
04
2.839634
E
+
03
1.841738
E
+
01
NGHS
4.290961
E
+
02
5.562601
E
+
02
1.377085
E
+
03
2.419459
E
+
02
1.656795
E
+
01
HSTL
4.073724
E
+
02
1.159148
E
+
03
9.324027
E
+
03
2.181373
E
+
03
1.728557
E
+
01
F
30
HS
-
3.077579
E
+
02
-
3.023452
E
+
02
-
2.973287
E
+
02
3.007979
E
+
00
1.629385
E
+
01
SGHS
-
3.057815
E
+
02
-
2.971863
E
+
02
-
2.874010
E
+
02
4.692703
E
+
00
1.819898
E
+
01
NGHS
-
3.260430
E
+
02
-
3.234723
E
+
02
-
3.198728
E
+
02
1.579631
E
+
00
1.644573
E
+
01
HSTL
-
3.295820
E
+
02
-
3.280941
E
+
02
-
3.260903
E
+
02
1.159512
E
+
00
1.714851
E
+
01
F
31
HS
1.196768
E
+
01
1.679724
E
+
01
2.010432
E
+
01
2.439712
E
+
00
1.279175
E
+
01
SGHS
4.187297
E
+
00
9.601911
E
+
00
1.575427
E
+
01
3.206880
E
+
00
1.473686
E
+
01
NGHS
2.868378
E
-
02
4.841433
E
-
02
9.156237
E
-
02
1.566071
E
-
02
1.283577
E
+
01
HSTL
2.103222
E
-
03
2.808338
E
-
03
3.640376
E
-
03
4.063424
E
-
04
1.358129
E
+
01In Tables6 and 7, the results are shown for 100D and 200D problems, respectively. According to the results (best, mean, worst, and STD) of HSTL algorithm outperforms the other three harmony search algorithm. And it can be seen from Tables 6 and 7 that, compared with 50D problems, the HSTL method has more obvious advantages than other three HS algorithms (HS, SGHS, and NSGH).Table 6
The optimization results of four harmony search algorithms forF1–F31 (D = 100, FEs = 500D).
Function
Algorithm
Best
Mean
Worst
STD
Runtime
F
1
HS
3.472069
E
+
00
3.820833
E
+
00
4.047963
E
+
00
1.596325
E
-
01
1.769219
E
+
00
SGHS
3.132910
E
+
00
3.913786
E
+
00
5.083229
E
+
00
5.509827
E
-
01
4.010046
E
+
00
NGHS
1.444919
E
+
00
1.767520
E
+
00
2.084939
E
+
00
1.790358
E
-
01
1.750870
E
+
00
HSTL
2.287774
E
-
03
2.786403
E
-
03
3.224305
E
-
03
2.716016
E
-
04
3.008579
E
+
00
F
2
HS
3.167536
E
+
02
6.351839
E
+
02
1.255875
E
+
03
2.510796
E
+
02
1.193827
E
+
00
SGHS
3.589095
E
+
02
1.471320
E
+
03
3.982050
E
+
03
1.068029
E
+
03
3.400621
E
+
00
NGHS
3.974602
E
+
01
6.225108
E
+
01
8.429758
E
+
01
1.057944
E
+
01
1.243040
E
+
00
HSTL
6.668194
E
-
01
1.286474
E
+
00
7.749294
E
+
00
1.726882
E
+
00
2.346918
E
+
00
F
3
HS
2.603003
E
+
00
3.327735
E
+
00
3.759840
E
+
00
2.519202
E
-
01
1.920741
E
+
00
SGHS
2.174329
E
+
00
4.132405
E
+
00
6.281051
E
+
00
1.173173
E
+
00
4.125897
E
+
00
NGHS
1.188965
E
+
00
1.242508
E
+
00
1.340110
E
+
00
3.865128
E
-
02
1.920139
E
+
00
HSTL
1.376879
E
-
04
2.346120
E
-
04
5.029240
E
-
04
7.730570
E
-
05
3.209074
E
+
00
F
4
HS
8.948965
E
-
01
1.142211
E
+
00
1.519557
E
+
00
1.440158
E
-
01
5.019303
E
+
00
SGHS
5.690498
E
+
00
1.420662
E
+
01
2.458487
E
+
01
5.224712
E
+
00
7.419859
E
+
00
NGHS
9.494633
E
-
02
1.460202
E
-
01
2.463073
E
-
01
3.355741
E
-
02
5.010614
E
+
00
HSTL
1.635147
E
-
05
1.380600
E
-
04
2.370741
E
-
03
5.255262
E
-
04
6.668101
E
+
00
F
5
HS
-
6.672187
E
+
01
-
6.350148
E
+
01
-
6.043354
E
+
01
2.052348
E
+
00
2.969232
E
+
00
SGHS
-
8.968012
E
+
01
-
8.648817
E
+
01
-
8.264598
E
+
01
1.813756
E
+
00
5.086223
E
+
00
NGHS
-
8.313566
E
+
01
-
8.029515
E
+
01
-
7.690579
E
+
01
1.438337
E
+
00
2.968101
E
+
00
HSTL
-
9.585843
E
+
01
-
9.464151
E
+
01
-
9.352011
E
+
01
5.668992
E
-
01
4.289409
E
+
00
F
6
HS
2.275081
E
+
01
3.404998
E
+
01
4.701336
E
+
01
7.463806
E
+
00
4.601501
E
+
00
SGHS
6.202169
E
+
01
1.021203
E
+
02
1.576931
E
+
02
2.604590
E
+
01
7.029177
E
+
00
NGHS
2.559237
E
+
00
4.248504
E
+
00
7.194444
E
+
00
1.263185
E
+
00
4.571996
E
+
00
HSTL
1.159057
E
-
01
2.164533
E
-
01
3.013113
E
-
01
4.862855
E
-
02
6.357763
E
+
00
F
7
HS
8.761768
E
+
01
9.968145
E
+
01
1.095680
E
+
02
5.125492
E
+
00
1.397587
E
+
00
SGHS
1.204523
E
+
02
1.515871
E
+
02
1.806614
E
+
02
1.516934
E
+
01
3.643591
E
+
00
NGHS
5.302534
E
+
01
7.188578
E
+
01
8.426157
E
+
01
7.828465
E
+
00
1.433040
E
+
00
HSTL
1.577470
E
-
04
9.978969
E
-
02
9.954242
E
-
01
3.062646
E
-
01
2.611144
E
+
00
F
8
HS
5.880175
E
+
02
1.300531
E
+
03
2.082232
E
+
03
3.831144
E
+
02
1.223890
E
+
00
SGHS
8.999245
E
+
02
1.790814
E
+
03
2.911281
E
+
03
5.768125
E
+
02
3.494810
E
+
00
NGHS
3.079063
E
+
02
4.138027
E
+
02
5.638547
E
+
02
7.193641
E
+
01
1.255683
E
+
00
HSTL
9.318870
E
+
01
1.469698
E
+
02
2.571664
E
+
02
4.541752
E
+
01
2.443950
E
+
00
F
9
HS
7.122610
E
+
02
8.396009
E
+
02
9.466086
E
+
02
6.566372
E
+
01
1.529895
E
+
00
SGHS
3.806886
E
+
03
4.736018
E
+
03
6.005643
E
+
03
6.494470
E
+
02
3.877912
E
+
00
NGHS
6.828367
E
+
02
1.783404
E
+
03
2.842955
E
+
03
4.795603
E
+
02
1.569362
E
+
00
HSTL
7.968585
E
+
00
1.720210
E
+
02
3.973356
E
+
02
1.098869
E
+
02
2.854428
E
+
00
F
10
HS
2.129878
E
+
02
2.699577
E
+
02
3.362863
E
+
02
3.021370
E
+
01
1.482740
E
+
00
SGHS
1.475702
E
+
02
3.215163
E
+
02
5.256382
E
+
02
1.308856
E
+
02
3.719739
E
+
00
NGHS
1.599879
E
+
01
2.545197
E
+
01
3.908629
E
+
01
5.800758
E
+
00
1.488095
E
+
00
HSTL
2.404241
E
-
04
3.881772
E
-
04
5.946775
E
-
04
9.559413
E
-
05
2.861329
E
+
00
F
11
HS
3.939318
E
+
06
7.748172
E
+
06
1.544812
E
+
07
2.861829
E
+
06
1.567541
E
+
00
SGHS
1.156049
E
+
07
2.205330
E
+
07
3.666560
E
+
07
7.051009
E
+
06
3.787745
E
+
00
NGHS
3.799257
E
+
06
6.908533
E
+
06
9.606336
E
+
06
1.677867
E
+
06
1.569956
E
+
00
HSTL
3.921902
E
+
05
1.520828
E
+
06
3.598060
E
+
06
9.375356
E
+
05
2.978233
E
+
00
F
12
HS
7.150539
E
+
02
9.583770
E
+
02
1.225170
E
+
03
1.259891
E
+
02
1.530910
E
+
00
SGHS
7.715070
E
+
02
9.708888
E
+
02
1.242580
E
+
03
1.201418
E
+
02
3.590301
E
+
00
NGHS
2.108479
E
+
02
2.650550
E
+
02
3.204091
E
+
02
3.392485
E
+
01
1.553830
E
+
00
HSTL
6.766070
E
+
02
8.735240
E
+
02
1.063928
E
+
03
1.027158
E
+
02
2.874153
E
+
00
F
13
HS
-
2.375559
E
+
02
-
1.738990
E
+
02
-
1.079270
E
+
02
3.473333
E
+
01
3.058755
E
+
00
SGHS
-
3.131437
E
+
02
-
2.097408
E
+
02
-
8.276031
E
+
01
7.569102
E
+
01
5.492338
E
+
00
NGHS
-
4.332349
E
+
02
-
4.262997
E
+
02
-
4.192761
E
+
02
3.856018
E
+
00
3.064137
E
+
00
HSTL
-
4.499970
E
+
02
-
4.499959
E
+
02
-
4.499951
E
+
02
5.433935
E
-
04
4.894014
E
+
00
F
14
HS
-
4.232215
E
+
02
-
4.193171
E
+
02
-
4.108272
E
+
02
2.989275
E
+
00
3.133809
E
+
00
SGHS
-
3.977762
E
+
02
-
3.880149
E
+
02
-
3.766792
E
+
02
5.980155
E
+
00
5.474201
E
+
00
NGHS
-
4.402313
E
+
02
-
4.377563
E
+
02
-
4.360122
E
+
02
1.032261
E
+
00
3.189262
E
+
00
HSTL
-
4.245886
E
+
02
-
4.181521
E
+
02
-
4.133119
E
+
02
3.501804
E
+
00
4.858567
E
+
00
F
15
HS
3.297507
E
+
05
5.050010
E
+
05
7.154538
E
+
05
1.134203
E
+
05
3.715503
E
+
00
SGHS
2.141247
E
+
05
2.473414
E
+
06
9.215806
E
+
06
2.312600
E
+
06
6.170230
E
+
00
NGHS
6.173097
E
+
03
1.336579
E
+
04
2.527368
E
+
04
6.553278
E
+
03
3.722490
E
+
00
HSTL
6.679117
E
+
02
2.123307
E
+
03
6.663690
E
+
03
1.898390
E
+
03
5.447209
E
+
00
F
16
HS
-
2.417986
E
+
02
-
2.316766
E
+
02
-
2.243841
E
+
02
4.720329
E
+
00
3.407872
E
+
00
SGHS
-
1.978875
E
+
02
-
1.657988
E
+
02
-
1.304433
E
+
02
1.954773
E
+
01
5.825132
E
+
00
NGHS
-
2.700495
E
+
02
-
2.575340
E
+
02
-
2.441387
E
+
02
7.491290
E
+
00
3.388501
E
+
00
HSTL
-
3.134902
E
+
02
-
3.059890
E
+
02
-
2.968384
E
+
02
4.108868
E
+
00
5.092343
E
+
00
F
17
HS
-
1.769331
E
+
02
-
1.764810
E
+
02
-
1.760164
E
+
02
2.480479
E
-
01
5.401888
E
+
00
SGHS
-
1.779920
E
+
02
-
1.770352
E
+
02
-
1.750318
E
+
02
8.297157
E
-
01
7.875262
E
+
00
NGHS
-
1.788120
E
+
02
-
1.787740
E
+
02
-
1.787241
E
+
02
2.570359
E
-
02
5.350236
E
+
00
HSTL
-
1.799984
E
+
02
-
1.799963
E
+
02
-
1.799876
E
+
02
3.066164
E
-
03
7.034552
E
+
00
F
18
HS
-
1.365537
E
+
02
-
1.361589
E
+
02
-
1.357947
E
+
02
2.159838
E
-
01
3.742110
E
+
00
SGHS
-
1.369490
E
+
02
-
1.362044
E
+
02
-
1.344587
E
+
02
6.516864
E
-
01
6.201829
E
+
00
NGHS
-
1.385604
E
+
02
-
1.381231
E
+
02
-
1.377560
E
+
02
2.656460
E
-
01
3.702051
E
+
00
HSTL
-
1.399928
E
+
02
-
1.399894
E
+
02
-
1.399455
E
+
02
1.034768
E
-
02
5.419278
E
+
00
F
19
HS
-
1.397521
E
+
03
-
1.360864
E
+
03
-
1.328214
E
+
03
2.038863
E
+
01
1.091921
E
+
01
SGHS
-
1.452010
E
+
03
-
1.426324
E
+
03
-
1.397075
E
+
03
1.631505
E
+
01
1.335878
E
+
01
NGHS
-
1.451444
E
+
03
-
1.428229
E
+
03
-
1.393381
E
+
03
1.340884
E
+
01
1.124146
E
+
01
HSTL
-
1.513615
E
+
03
-
1.499926
E
+
03
-
1.485147
E
+
03
8.517545
E
+
00
1.261544
E
+
01
F
20
HS
1.193796
E
+
02
1.193796
E
+
02
1.193796
E
+
02
1.193796
E
+
02
1.193796
E
+
02
SGHS
9.824839
E
+
01
9.824839
E
+
01
9.824839
E
+
01
9.824839
E
+
01
9.824839
E
+
01
NGHS
3.473853
E
+
01
3.473853
E
+
01
3.473853
E
+
01
3.473853
E
+
01
3.473853
E
+
01
HSTL
6.151721
E
-
02
6.151721
E
-
02
6.151721
E
-
02
6.151721
E
-
02
6.151721
E
-
02
F
21
HS
2.731607
E
+
02
3.018028
E
+
02
3.309987
E
+
02
1.465698
E
+
01
5.400367
E
+
01
SGHS
2.061790
E
+
02
2.668907
E
+
02
3.219105
E
+
02
3.133660
E
+
01
5.782494
E
+
01
NGHS
1.520321
E
+
02
1.848391
E
+
02
2.324962
E
+
02
1.945112
E
+
01
5.352526
E
+
01
HSTL
1.216583
E
+
01
1.522370
E
+
01
1.868875
E
+
01
2.164395
E
+
00
5.544992
E
+
01
F
22
HS
7.035058
E
+
01
7.966205
E
+
01
8.675826
E
+
01
4.501205
E
+
00
3.134446
E
+
01
SGHS
4.845036
E
+
01
7.002079
E
+
01
1.031254
E
+
02
1.472650
E
+
01
3.551839
E
+
01
NGHS
1.890592
E
+
01
2.264589
E
+
01
2.708944
E
+
01
2.757052
E
+
00
3.129377
E
+
01
HSTL
3.312806
E
-
03
4.788330
E
-
01
2.104085
E
+
00
7.191299
E
-
01
3.285056
E
+
01
F
23
HS
2.474923
E
+
02
2.926433
E
+
02
3.154565
E
+
02
1.633700
E
+
01
3.787547
E
+
01
SGHS
2.077105
E
+
02
2.618490
E
+
02
3.486951
E
+
02
3.410635
E
+
01
4.192231
E
+
01
NGHS
1.600018
E
+
02
1.868942
E
+
02
2.193507
E
+
02
1.802714
E
+
01
3.742503
E
+
01
HSTL
1.226995
E
+
01
1.528464
E
+
01
2.013004
E
+
01
2.366879
E
+
00
3.842275
E
+
01
F
24
HS
-
3.539791
E
+
02
-
3.147048
E
+
02
-
2.647908
E
+
02
1.949672
E
+
01
3.449387
E
+
01
SGHS
-
4.095286
E
+
02
-
3.591410
E
+
02
-
2.333805
E
+
02
5.324971
E
+
01
3.871345
E
+
01
NGHS
-
4.493291
E
+
02
-
4.489227
E
+
02
-
4.485923
E
+
02
2.120875
E
-
01
3.486910
E
+
01
HSTL
-
4.499990
E
+
02
-
4.499985
E
+
02
-
4.499980
E
+
02
2.414762
E
-
04
3.688151
E
+
01
F
25
HS
1.051141
E
+
05
1.874186
E
+
05
2.937699
E
+
05
4.432322
E
+
04
3.544980
E
+
01
SGHS
5.004828
E
+
04
6.949195
E
+
05
3.958335
E
+
06
9.272106
E
+
05
3.953879
E
+
01
NGHS
1.111344
E
+
03
1.579429
E
+
03
4.609411
E
+
03
7.698066
E
+
02
3.568522
E
+
01
HSTL
4.768735
E
+
02
8.024700
E
+
02
2.168501
E
+
03
4.225175
E
+
02
3.736183
E
+
01
F
26
HS
-
2.598286
E
+
02
-
2.502187
E
+
02
-
2.401834
E
+
02
5.848484
E
+
00
3.371420
E
+
01
SGHS
-
2.231800
E
+
02
-
1.912732
E
+
02
-
1.659675
E
+
02
1.303039
E
+
01
3.722651
E
+
01
NGHS
-
2.870567
E
+
02
-
2.734730
E
+
02
-
2.629992
E
+
02
5.510929
E
+
00
3.296890
E
+
01
HSTL
-
3.207702
E
+
02
-
3.136777
E
+
02
-
3.092977
E
+
02
2.615418
E
+
00
3.492102
E
+
01
F
27
HS
1.761478
E
+
01
1.978397
E
+
01
2.313474
E
+
01
1.461489
E
+
00
3.122492
E
+
01
SGHS
1.215437
E
+
01
2.186805
E
+
01
3.511913
E
+
01
5.628417
E
+
00
3.560859
E
+
01
NGHS
2.810761
E
+
00
3.983730
E
+
00
4.655769
E
+
00
4.301760
E
-
01
3.140541
E
+
01
HSTL
2.089110
E
-
02
2.831916
E
-
02
5.808363
E
-
02
8.512059
E
-
03
3.310728
E
+
01
F
28
HS
-
4.469079
E
+
02
-
4.443488
E
+
02
-
4.405620
E
+
02
1.967662
E
+
00
4.318177
E
+
01
SGHS
-
4.494424
E
+
02
-
4.483361
E
+
02
-
4.463611
E
+
02
1.058420
E
+
00
4.732766
E
+
01
NGHS
-
4.500000
E
+
02
-
4.500000
E
+
02
-
4.500000
E
+
02
3.611281
E
-
10
4.326785
E
+
01
HSTL
-
4.500000
E
+
02
-
4.500000
E
+
02
-
4.500000
E
+
02
9.511311
E
-
06
4.509948
E
+
01
F
29
HS
6.093107
E
+
03
1.397065
E
+
04
2.184820
E
+
04
1.114053
E
+
04
4.387041
E
+
01
SGHS
8.168591
E
+
03
9.147798
E
+
03
1.012700
E
+
04
1.384807
E
+
03
4.815433
E
+
01
NGHS
6.891292
E
+
02
7.565447
E
+
02
8.239602
E
+
02
9.533993
E
+
01
4.375258
E
+
01
HSTL
4.954684
E
+
02
5.024741
E
+
02
5.094799
E
+
02
9.907604
E
+
00
4.518065
E
+
01
F
30
HS
-
2.708213
E
+
02
-
2.658142
E
+
02
-
2.553643
E
+
02
4.447667
E
+
00
4.291836
E
+
01
SGHS
-
2.498452
E
+
02
-
2.356727
E
+
02
-
2.214623
E
+
02
6.894224
E
+
00
4.714809
E
+
01
NGHS
-
2.967689
E
+
02
-
2.895710
E
+
02
-
2.794822
E
+
02
4.509198
E
+
00
4.315103
E
+
01
HSTL
-
3.281517
E
+
02
-
3.254159
E
+
02
-
3.216770
E
+
02
1.727024
E
+
00
4.476932
E
+
01
F
31
HS
3.744918
E
+
01
4.335719
E
+
01
4.893459
E
+
01
3.361402
E
+
00
3.044300
E
+
01
SGHS
2.842099
E
+
01
4.402938
E
+
01
6.465355
E
+
01
8.002441
E
+
00
3.374892
E
+
01
NGHS
5.436447
E
+
00
8.517679
E
+
00
1.110289
E
+
01
1.334154
E
+
00
2.980321
E
+
01
HSTL
7.377615
E
-
03
8.118152
E
-
02
4.421143
E
-
01
1.112750
E
-
01
3.135758
E
+
01Table 7
The optimization results of four harmony search algorithms forF1–F31 (D = 200, FEs = 500D).
Function
Algorithm
Best
Mean
Worst
STD
Runtime
F
1
HS
4.603726
E
+
00
4.929354
E
+
00
5.266226
E
+
00
1.613707
E
-
01
5.715312
E
+
00
SGHS
4.421737
E
+
00
5.637606
E
+
00
7.262746
E
+
00
8.839935
E
-
01
1.138709
E
+
01
NGHS
5.145771
E
+
00
5.521262
E
+
00
5.794585
E
+
00
1.715834
E
-
01
5.721544
E
+
00
HSTL
3.575306
E
-
03
4.026710
E
-
03
4.538061
E
-
03
2.396758
E
-
04
8.701444
E
+
00
F
2
HS
4.078042
E
+
03
6.153632
E
+
03
8.488061
E
+
03
1.312734
E
+
03
4.147045
E
+
00
SGHS
7.148166
E
+
03
3.459359
E
+
04
1.047654
E
+
05
2.687689
E
+
04
9.907156
E
+
00
NGHS
2.696362
E
+
03
4.466500
E
+
03
5.439083
E
+
03
6.579299
E
+
02
4.042910
E
+
00
HSTL
6.688204
E
-
01
9.705961
E
+
00
5.070641
E
+
01
1.456647
E
+
01
7.049820
E
+
00
F
3
HS
9.161714
E
+
00
1.244639
E
+
01
1.459380
E
+
01
1.320806
E
+
00
6.456437
E
+
00
SGHS
8.285825
E
+
00
1.792049
E
+
01
5.102385
E
+
01
9.342384
E
+
00
1.205154
E
+
01
NGHS
1.653665
E
+
01
1.945936
E
+
01
2.288375
E
+
01
1.916412
E
+
00
6.373141
E
+
00
HSTL
3.399743
E
-
04
1.932473
E
-
03
2.008061
E
-
02
4.825732
E
-
03
9.435844
E
+
00
F
4
HS
3.848564
E
+
00
4.708132
E
+
00
5.294488
E
+
00
3.531660
E
-
01
1.828390
E
+
01
SGHS
4.320375
E
+
01
6.698858
E
+
01
9.905690
E
+
01
1.803405
E
+
01
2.448338
E
+
01
NGHS
7.186447
E
+
00
8.321538
E
+
00
9.657602
E
+
00
6.923441
E
-
01
1.812159
E
+
01
HSTL
3.729585
E
-
02
1.541456
E
-
01
2.844556
E
-
01
7.373455
E
-
02
2.201131
E
+
01
F
5
HS
-
9.228155
E
+
01
-
8.912511
E
+
01
-
8.545813
E
+
01
2.196104
E
+
00
1.075750
E
+
01
SGHS
-
1.691553
E
+
02
-
1.632416
E
+
02
-
1.554168
E
+
02
4.230945
E
+
00
1.607256
E
+
01
NGHS
-
1.266981
E
+
02
-
1.212701
E
+
02
-
1.165799
E
+
02
2.487909
E
+
00
1.057139
E
+
01
HSTL
-
1.879057
E
+
02
-
1.859165
E
+
02
-
1.841057
E
+
02
9.032725
E
-
01
1.379854
E
+
01
F
6
HS
1.059685
E
+
02
1.605423
E
+
02
2.171595
E
+
02
3.043869
E
+
01
1.913746
E
+
01
SGHS
2.877414
E
+
02
5.597265
E
+
02
1.076033
E
+
03
1.825775
E
+
02
2.544270
E
+
01
NGHS
1.476215
E
+
02
1.815020
E
+
02
2.722819
E
+
02
2.829572
E
+
01
1.891687
E
+
01
HSTL
4.134323
E
-
01
8.303796
E
-
01
1.245398
E
+
00
1.952532
E
-
01
2.286965
E
+
01
F
7
HS
3.049237
E
+
02
3.272066
E
+
02
3.630817
E
+
02
1.403316
E
+
01
5.018255
E
+
00
SGHS
3.796419
E
+
02
4.822636
E
+
02
5.650928
E
+
02
4.455035
E
+
01
1.075236
E
+
01
NGHS
4.522705
E
+
02
5.209768
E
+
02
5.738802
E
+
02
3.656850
E
+
01
4.953818
E
+
00
HSTL
1.658281
E
-
03
1.295575
E
+
00
3.005119
E
+
00
1.058554
E
+
00
7.836046
E
+
00
F
8
HS
3.896266
E
+
03
5.289774
E
+
03
7.844040
E
+
03
1.015647
E
+
03
4.297905
E
+
00
SGHS
6.818663
E
+
03
1.570204
E
+
04
2.975647
E
+
04
8.010501
E
+
03
1.001014
E
+
01
NGHS
3.307225
E
+
03
4.050635
E
+
03
5.045072
E
+
03
4.439356
E
+
02
4.207027
E
+
00
HSTL
1.929455
E
+
02
2.304209
E
+
02
3.286657
E
+
02
4.180170
E
+
01
7.172235
E
+
00
F
9
HS
3.233837
E
+
03
3.714921
E
+
03
4.247033
E
+
03
2.604085
E
+
02
5.199977
E
+
00
SGHS
1.175294
E
+
04
1.460607
E
+
04
1.810298
E
+
04
1.831608
E
+
03
1.119387
E
+
01
NGHS
1.228090
E
+
04
1.400627
E
+
04
1.550115
E
+
04
8.852628
E
+
02
5.119688
E
+
00
HSTL
1.550538
E
+
03
1.951142
E
+
03
2.716798
E
+
03
3.492572
E
+
02
8.289662
E
+
00
F
10
HS
1.035974
E
+
03
1.224840
E
+
03
1.408721
E
+
03
9.946126
E
+
01
4.635011
E
+
00
SGHS
9.842122
E
+
02
1.758492
E
+
03
3.754911
E
+
03
7.377144
E
+
02
1.040168
E
+
01
NGHS
1.861439
E
+
03
2.058453
E
+
03
2.504462
E
+
03
1.837061
E
+
02
4.467012
E
+
00
HSTL
1.314733
E
-
03
1.760664
E
-
03
2.393748
E
-
03
2.837635
E
-
04
7.936856
E
+
00
F
11
HS
3.073770
E
+
08
5.529318
E
+
08
7.578658
E
+
08
1.318618
E
+
08
5.023786
E
+
00
SGHS
8.707673
E
+
08
1.161818
E
+
09
1.767454
E
+
09
2.629050
E
+
08
1.075328
E
+
01
NGHS
7.093037
E
+
08
9.105403
E
+
08
1.190901
E
+
09
1.208984
E
+
08
4.824641
E
+
00
HSTL
2.965758
E
+
07
8.970849
E
+
07
1.931661
E
+
08
3.740898
E
+
07
8.290714
E
+
00
F
12
HS
2.178914
E
+
03
2.482882
E
+
03
2.815688
E
+
03
1.988376
E
+
02
4.845730
E
+
00
SGHS
2.308245
E
+
03
2.584773
E
+
03
2.953531
E
+
03
2.051620
E
+
02
1.019302
E
+
01
NGHS
9.284727
E
+
02
1.072448
E
+
03
1.250569
E
+
03
9.258004
E
+
01
4.699592
E
+
00
HSTL
1.938323
E
+
03
2.308801
E
+
03
2.714633
E
+
03
1.905069
E
+
02
8.051031
E
+
00
F
13
HS
4.977364
E
+
02
8.339352
E
+
02
1.058941
E
+
03
1.248060
E
+
02
8.006508
E
+
00
SGHS
2.137557
E
+
02
1.083748
E
+
03
2.437995
E
+
03
5.816088
E
+
02
1.404649
E
+
01
NGHS
1.392416
E
+
03
1.708667
E
+
03
1.994529
E
+
03
1.697142
E
+
02
7.789651
E
+
00
HSTL
-
3.915048
E
+
02
-
3.394840
E
+
02
-
2.719662
E
+
02
2.748671
E
+
01
1.184497
E
+
01
F
14
HS
-
4.084859
E
+
02
-
4.048983
E
+
02
-
3.994353
E
+
02
2.724485
E
+
00
8.170102
E
+
00
SGHS
-
3.756669
E
+
02
-
3.637827
E
+
02
-
3.512079
E
+
02
6.398155
E
+
00
1.406004
E
+
01
NGHS
-
4.248494
E
+
02
-
4.217489
E
+
02
-
4.171032
E
+
02
1.942003
E
+
00
7.962233
E
+
00
HSTL
-
4.078666
E
+
02
-
4.041830
E
+
02
-
4.006726
E
+
02
1.886381
E
+
00
1.207676
E
+
01
F
15
HS
2.261680
E
+
06
4.109099
E
+
06
5.954376
E
+
06
9.167839
E
+
05
9.762151
E
+
00
SGHS
6.929055
E
+
06
5.330388
E
+
07
2.498381
E
+
08
5.898978
E
+
07
1.596695
E
+
01
NGHS
5.823986
E
+
06
7.816998
E
+
06
1.131635
E
+
07
1.505165
E
+
06
9.593909
E
+
00
HSTL
2.775018
E
+
05
5.853541
E
+
05
9.776046
E
+
05
2.019841
E
+
05
1.376301
E
+
01
F
16
HS
-
2.948123
E
+
01
-
5.791258
E
-
01
1.683795
E
+
01
1.195259
E
+
01
9.144801
E
+
00
SGHS
7.067304
E
+
01
1.786652
E
+
02
2.626093
E
+
02
5.419678
E
+
01
1.508770
E
+
01
NGHS
1.593170
E
+
02
1.986273
E
+
02
2.485464
E
+
02
2.374692
E
+
01
8.921733
E
+
00
HSTL
-
2.547415
E
+
02
-
2.353550
E
+
02
-
2.151499
E
+
02
9.688531
E
+
00
1.285946
E
+
01
F
17
HS
-
1.685846
E
+
02
-
1.671598
E
+
02
-
1.654225
E
+
02
8.709843
E
-
01
1.678058
E
+
01
SGHS
-
1.751726
E
+
02
-
1.626560
E
+
02
-
1.461760
E
+
02
7.197573
E
+
00
2.278318
E
+
01
NGHS
-
1.634951
E
+
02
-
1.604326
E
+
02
-
1.574177
E
+
02
1.704898
E
+
00
1.650759
E
+
01
HSTL
-
1.783495
E
+
02
-
1.781095
E
+
02
-
1.778417
E
+
02
1.456349
E
-
01
2.036008
E
+
01
F
18
HS
-
1.354532
E
+
02
-
1.350248
E
+
02
-
1.346804
E
+
02
1.775738
E
-
01
9.748667
E
+
00
SGHS
-
1.341637
E
+
02
-
1.319425
E
+
02
-
1.279421
E
+
02
1.937096
E
+
00
1.586162
E
+
01
NGHS
-
1.348232
E
+
02
-
1.344521
E
+
02
-
1.342897
E
+
02
1.505267
E
-
01
9.520511
E
+
00
HSTL
-
1.385641
E
+
02
-
1.382701
E
+
02
-
1.380733
E
+
02
1.368319
E
-
01
1.358972
E
+
01
F
19
HS
-
2.603380
E
+
03
-
2.531804
E
+
03
-
2.473751
E
+
03
3.179450
E
+
01
2.876496
E
+
01
SGHS
-
2.721608
E
+
03
-
2.665352
E
+
03
-
2.578190
E
+
03
3.671259
E
+
01
3.458217
E
+
01
NGHS
-
2.581654
E
+
03
-
2.492258
E
+
03
-
2.446278
E
+
03
3.258052
E
+
01
2.814525
E
+
01
HSTL
-
2.929585
E
+
03
-
2.904859
E
+
03
-
2.882272
E
+
03
1.460064
E
+
01
3.221904
E
+
01
F
20
HS
9.189454
E
+
02
5.077136
E
+
27
1.015427
E
+
29
2.270564
E
+
28
5.038898
E
+
00
SGHS
5.059004
E
+
02
8.779452
E
+
02
1.348477
E
+
03
1.953273
E
+
02
1.104361
E
+
01
NGHS
1.246908
E
+
03
2.028307
E
+
03
2.888645
E
+
03
4.719852
E
+
02
5.148672
E
+
00
HSTL
1.837030
E
-
01
2.280353
E
-
01
2.673117
E
-
01
2.164823
E
-
02
8.886787
E
+
00
F
21
HS
6.377972
E
+
02
6.978627
E
+
02
7.582129
E
+
02
3.386564
E
+
01
1.646089
E
+
02
SGHS
6.320206
E
+
02
7.707349
E
+
02
8.819430
E
+
02
5.316649
E
+
01
1.737214
E
+
02
NGHS
7.097658
E
+
02
7.856465
E
+
02
8.525136
E
+
02
4.013482
E
+
01
1.646784
E
+
02
HSTL
9.040644
E
+
01
9.986598
E
+
01
1.162748
E
+
02
6.666442
E
+
00
1.696227
E
+
02
F
22
HS
2.143132
E
+
02
2.280396
E
+
02
2.618505
E
+
02
1.143029
E
+
01
7.711841
E
+
01
SGHS
1.576182
E
+
02
2.361854
E
+
02
4.033144
E
+
02
5.873130
E
+
01
8.653562
E
+
01
NGHS
2.229408
E
+
02
2.658819
E
+
02
2.931895
E
+
02
1.367509
E
+
01
7.686817
E
+
01
HSTL
9.638521
E
+
00
1.807740
E
+
01
2.585962
E
+
01
3.506528
E
+
00
8.063761
E
+
01
F
23
HS
6.234643
E
+
02
6.947096
E
+
02
7.419847
E
+
02
3.350395
E
+
01
1.019985
E
+
02
SGHS
6.526572
E
+
02
7.693093
E
+
02
8.338596
E
+
02
4.956235
E
+
01
1.112867
E
+
02
NGHS
6.898719
E
+
02
7.661332
E
+
02
8.566126
E
+
02
4.173909
E
+
01
1.018226
E
+
02
HSTL
8.482421
E
+
01
9.938394
E
+
01
1.108417
E
+
02
8.042784
E
+
00
1.054352
E
+
02
F
24
HS
4.553252
E
+
01
2.076506
E
+
02
4.542336
E
+
02
1.063305
E
+
02
8.318836
E
+
01
SGHS
-
2.939057
E
+
02
7.490397
E
+
01
6.242859
E
+
02
3.186816
E
+
02
9.254373
E
+
01
NGHS
-
2.373270
E
+
02
-
1.728535
E
+
02
-
9.543890
E
+
01
4.073554
E
+
01
8.306743
E
+
01
HSTL
-
4.499950
E
+
02
-
4.499933
E
+
02
-
4.499913
E
+
02
9.985585
E
-
04
8.722270
E
+
01
F
25
HS
7.366636
E
+
05
1.041736
E
+
06
1.399154
E
+
06
1.825535
E
+
05
8.464179
E
+
01
SGHS
8.054915
E
+
05
1.228918
E
+
07
4.659116
E
+
07
1.341661
E
+
07
9.395835
E
+
01
NGHS
1.559065
E
+
05
2.605101
E
+
05
3.969066
E
+
05
6.581579
E
+
04
8.432677
E
+
01
HSTL
1.448330
E
+
03
4.054597
E
+
03
9.585072
E
+
03
2.811645
E
+
03
8.853785
E
+
01
F
26
HS
-
8.620111
E
+
01
-
6.877671
E
+
01
-
4.175610
E
+
01
1.198860
E
+
01
8.370164
E
+
01
SGHS
3.837488
E
+
01
9.840901
E
+
01
2.221608
E
+
02
5.104657
E
+
01
9.300928
E
+
01
NGHS
-
1.214266
E
+
01
7.757135
E
+
00
3.280678
E
+
01
1.408601
E
+
01
8.382478
E
+
01
HSTL
-
2.834421
E
+
02
-
2.731218
E
+
02
-
2.591557
E
+
02
6.993937
E
+
00
8.785385
E
+
01
F
27
HS
6.017485
E
+
01
6.526806
E
+
01
7.041752
E
+
01
2.646571
E
+
00
8.031504
E
+
01
SGHS
8.524694
E
+
01
1.156612
E
+
02
1.717014
E
+
02
2.490438
E
+
01
8.958076
E
+
01
NGHS
5.648135
E
+
01
6.439351
E
+
01
7.123722
E
+
01
4.693589
E
+
00
7.798441
E
+
01
HSTL
2.094078
E
+
00
2.833941
E
+
00
4.047095
E
+
00
5.585953
E
-
01
8.093007
E
+
01
F
28
HS
-
4.289935
E
+
02
-
4.211903
E
+
02
-
4.163227
E
+
02
3.623053
E
+
00
1.249831
E
+
02
SGHS
-
4.488077
E
+
02
-
4.432399
E
+
02
-
4.317460
E
+
02
4.446639
E
+
00
1.353388
E
+
02
NGHS
-
4.499999
E
+
02
-
4.499997
E
+
02
-
4.499995
E
+
02
9.834457
E
-
05
1.265239
E
+
02
HSTL
-
4.500000
E
+
02
-
4.499999
E
+
02
-
4.499999
E
+
02
2.351848
E
-
05
1.325924
E
+
02
F
29
HS
2.233712
E
+
04
3.892963
E
+
04
5.633712
E
+
04
9.226538
E
+
03
1.300818
E
+
02
SGHS
5.525834
E
+
03
2.751029
E
+
05
2.276536
E
+
06
5.361823
E
+
05
1.405805
E
+
02
NGHS
1.510576
E
+
03
2.042038
E
+
03
6.840093
E
+
03
1.160782
E
+
03
1.305521
E
+
02
HSTL
4.888426
E
+
02
1.232585
E
+
03
5.838617
E
+
03
1.452099
E
+
03
1.351203
E
+
02
F
30
HS
-
1.772284
E
+
02
-
1.610854
E
+
02
-
1.510294
E
+
02
6.803769
E
+
00
1.289660
E
+
02
SGHS
-
9.536516
E
+
01
-
6.623147
E
+
01
-
3.230639
E
+
01
1.639332
E
+
01
1.391979
E
+
02
NGHS
-
1.574155
E
+
02
-
1.463189
E
+
02
-
1.301902
E
+
02
7.514495
E
+
00
1.291356
E
+
02
HSTL
-
3.201694
E
+
02
-
3.156785
E
+
02
-
3.090753
E
+
02
3.220219
E
+
00
1.337009
E
+
02
F
31
HS
1.212613
E
+
02
1.318822
E
+
02
1.410318
E
+
02
5.212928
E
+
00
8.330888
E
+
01
SGHS
1.123687
E
+
02
1.636391
E
+
02
1.993816
E
+
02
2.540267
E
+
01
9.407166
E
+
01
NGHS
1.189049
E
+
02
1.313797
E
+
02
1.457549
E
+
02
6.404969
E
+
00
8.467554
E
+
01
HSTL
4.403576
E
+
00
7.020892
E
+
00
1.210083
E
+
01
1.807576
E
+
00
8.733987
E
+
01The convergence of HSTL method is compared with three other HS algorithms: HS, SGHS, and NGHS on 50-D functions F3, F10, and F27, where the HSTL algorithm demonstrates an evident superiority on efficiency and stability, which can be observed from the convergence graphs (Figures 2(a) and 4(a)) and boxplots (Figures 2(b) and 4(b)).Convergence graph and boxplot for sphere function (F10) on D=50.
(a)
(b)For 50-D problems, the convergence graphs and the boxplots are shown in Figures 2, 3, and 4 on 50-D for sphere unimodal function, griewank multimodal inseparable function, and hybrid function, Hybrid5, which is composed of Bohachevsky and Schwefel2.22 function, where Figures 2(b) and 4(b) plot the boxplots of best results in 30 independent runs. Figures 2(a) and 4(a) portray the convergence curves. It is evident from the convergence graphs that strongly uniform convergence can be maintained throughout the procedure of evolution. From the boxplots we can see that the HSTL algorithm has better convergence, stability, and robustness in most cases than HS, SGHS, and NGHS algorithms.Convergence graph and boxplot for Griewank function (F4) on D=50.
(a)
(b)Convergence graph and boxplot for hybrid 15 function (F27) on D=50.
(a)
(b)Figures5 and 6 show the boxplots and convergence graphs of 3 different problems for dimensions equal to 100 and 200, respectively, where HSTL algorithm demonstrates obvious superiority on efficiency and stability.Convergence graphs and boxplots for functions Rastrigin, Schwefel, and hybrid 19 new onD=100.
(a)
(b)
(c)
(d)
(e)
(f)Convergence graphs and boxplots for shift functions Ackley, fast fractal double, and hybrid 14 onD=200.
(a)
(b)
(c)
(d)
(e)
(f)


### 4.4. Comparison of the Convergence Speed and Success Rate

In order to give a fair chance to 4 HS algorithm (HS, SGHS, NGHS, and HSTL) compared. We run each algorithm on each benchmark test function and stop as soon as the minimum error value acquired by the algorithm falls below the predefined threshold or a maximum number of FEs is exceeded. For all test functions, the algorithms carry out 30 independent runs.The respective thresholds values of the error for 30 benchmark problems are in Table11.Table8 displays the statistics results about the success rate, average runtime, and average FEs of  F1–F30.Table 8
The success rate, mean runtime, and FEs for functionF1–F19, F21–F31.
Function
Algorithm
F
1
F
2
F
3
F
4
F
5
F
6
F
7
F
8
F
9
F
10
Success rate (SR)
HS
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
SGHS
0%
0%
0%
0%
60%
0%
0%
0%
0%
0%
NGHS
0%
0%
0%
0%
0%
0%
0%
45%
15%
0%
HSTL
100%
100%
95%
100%
100%
100%
100%
100%
100%
100%
Mean runtime (s)
HS
19
14
21
50
31
48
15
14
17
16
SGHS
39
34
41
73
40
72
36
35
39
37
NGHS
18
13
20
49
30
48
14
11
16
16
HSTL
20
10
21
48
26
46
18
4
14
19
Mean FEs
HS
500000
500000
500000
500000
500000
500000
500000
500000
500000
500000
SGHS
500000
500000
500000
500000
397181
500000
500000
500000
500000
500000
NGHS
500000
500000
500000
500000
500000
500000
500000
425302
497089
500000
HSTL
475167
291492
452830
450158
386120
443818
482502
105551
332693
483873
Function
Algorithm
F
11
F
12
F
13
F
14
F
15
F
16
F
17
F
18
F
19
F
2
1
Success rate (SR)
HS
70%
45%
0%
0%
0%
0%
0%
0%
0%
0%
SGHS
0%
0%
0%
0%
65%
0%
0%
0%
0%
0%
NGHS
75%
100%
0%
0%
90%
15%
0%
0%
0%
0%
HSTL
100%
100%
90%
100%
100%
85%
90%
100%
80%
100%
Mean runtime (s)
HS
8
13
32
32
38
34
55
38
88
527
SGHS
35
34
55
54
39
56
78
60
114
570
NGHS
9
3
31
31
8
32
54
36
92
525
HSTL
5
9
36
31
18
34
51
32
81
467
Mean Fes
HS
264713
471826
500000
500000
500000
500000
500000
500000
500000
500000
SGHS
500000
500000
500000
500000
323631
500000
500000
500000
500000
500000
NGHS
335021
107386
500000
500000
114380
485463
500000
500000
500000
500000
HSTL
122555
240403
494888
418223
206975
437342
488064
434498
415872
445225
Function
Algorithm
F
2
2
F
2
3
F
2
4
F
2
5
F
2
6
F
2
7
F
2
8
F
2
9
F
30
F
3
1
Success rate (SR)
HS
0%
0%
0%
0%
100%
0%
0%
0%
0%
0%
SGHS
0%
0%
0%
0%
95%
0%
100%
0%
0%
0%
NGHS
0%
0%
0%
0%
100%
0%
100%
25%
0%
0%
HSTL
100%
50%
0%
100%
100%
100%
100%
60%
100%
100%
Mean runtime (s)
HS
289
373
359
364
35
310
453
441
436
312
SGHS
329
416
400
406
133
351
337
476
477
351
NGHS
293
374
360
366
22
310
13
382
437
317
HSTL
273
375
363
271
46
311
104
363
364
273
Mean Fes
HS
500000
500000
500000
500000
54677
500000
500000
500000
500000
500000
SGHS
500000
500000
500000
500000
181162
500000
341216
500000
500000
500000
NGHS
500000
500000
500000
500000
33331
500000
14644
451443
500000
500000
HSTL
459671
497514
500000
367442
85659
500000
132414
432651
415004
429027As Table8 shows, for a high-dimensional problem (D=100), the HS, SGHS, and NGHS have great difficulty in finding the global optima on all problems. The HSTL yields 100% success rate for F1, F2, F4–F11, F14, F15, F18, F20, F21, F24, F26, F29, F30. The HSTL algorithm performs much better with success rates of 100% on most problems, and over 50% on F3, F13, F16, F17, F19, F22, and F28 where other algorithms fail in finding the global optima.Table9 illustrates the costing run of 4 HS algorithm for F1–F31. The runtime is equal to the average value of all functions mean runtime; the FEs is equal to the average value of all functions mean FEs; the Success Rate is equal to the mean value of the success rate of all functions. In Table 9, we intend to show how well the presented HSTL algorithm performs when compared to HS, SGHS and NGHS algorithm. From the statistics shown in Table 9 can be seen that HSTL uses the least runtime and FEs, and acquires the best success rate among these algorithms on over performances.Table 9
The average runtime, average FEs, average success rate, and costing run of all functions.
Algorithm
Average runtime (ART)
Average FEs (AFE)
Average success rate (ASR)
HS
145.1399
477136
0.069355
SGHS
169.5528
475586.8
0.103226
NGHS
127.2487
434324.5
0.182258
HSTL
120.8951
384181.3
0.919355
WhereART=∑i=131runtimei, AFE=∑i=131FEsi, ASR=∑i=131SRi.


### 4.5. Convergence Analysis

To investigate the convergence of proposed HSTL algorithm, we record the population variance of each algorithm. As Figure7 shows, for each type function, the fluctuation of population variance in HSTL is smaller than the fluctuation of population variance in SGHS and NGHS algorithm, and the population variance graphs fall steadily throughout the search process. As a consequence, the proposed HSTL algorithm has stronger robustness and convergence than other variants of HS.The population variance graphs.
(a)
(b)
(c)
(d)


### 4.6. Parameter HMS Study

In this section, the effect of HMS value on the performance of the HSTL method is investigated. The experimental results generated by using different HMS values (5, 10, 15, 20, 25, 30, 35, and 40) for dimensions equal to 50 are demonstrated in Table10, respectively.Table 10
The effect of HMS on the performance of the HSTL algorithm (D = 50, FEs = 25000).
HMS
F
1
F
2
F
3
F
4
F
5
F
6
F
7
F
8
F
9
F
10
5
7.02
E
-
06
1.28
E
+
00
5.30
E
-
03
1.12
E
-
06
-
4.82
E
+
01
3.23
E
-
03
4.97
E
-
02
7.23
E
+
01
1.36
E
-
03
1.36
E
-
03
10
2.10
E
-
05
8.84
E
-
01
2.71
E
-
03
1.26
E
-
06
-
4.82
E
+
01
4.83
E
-
03
7.11
E
-
10
4.39
E
+
01
1.14
E
-
03
4.92
E
-
08
15
6.98
E
-
05
7.11
E
-
01
4.94
E
-
04
1.29
E
-
06
-
4.83
E
+
01
6.93
E
-
03
7.66
E
-
09
4.35
E
+
01
1.06
E
-
03
2.19
E
-
07
20
1.03
E
-
04
7.07
E
-
01
8.64
E
-
04
1.58
E
-
06
-
4.85
E
+
01
9.06
E
-
03
4.44
E
-
08
4.16
E
+
01
1.16
E
-
03
3.70
E
-
07
25
1.40
E
-
04
7.23
E
-
01
2.23
E
-
03
1.47
E
-
06
-
4.80
E
+
01
1.17
E
-
02
7.97
E
-
08
4.55
E
+
01
1.27
E
-
03
8.60
E
-
07
30
2.05
E
-
04
7.72
E
-
01
1.82
E
-
06
1.90
E
-
06
-
4.81
E
+
01
1.46
E
-
02
3.07
E
-
07
4.39
E
+
01
1.14
E
-
03
1.78
E
-
06
35
2.85
E
-
04
7.03
E
-
01
2.21
E
-
06
1.69
E
-
06
-
4.82
E
+
01
1.61
E
-
02
4.45
E
-
07
4.37
E
+
01
1.09
E
-
03
2.54
E
-
06
40
3.81
E
-
04
7.49
E
-
01
3.34
E
-
06
2.00
E
-
06
-
4.85
E
+
01
1.97
E
-
02
6.64
E
-
07
4.46
E
+
01
1.22
E
-
03
3.88
E
-
06
HMS
F
11
F
12
F
13
F
14
F
15
F
16
F
17
F
18
F
19
F
20
05
7.97
E
+
03
3.57
E
+
00
-
4.50
E
+
02
-
4.50
E
+
02
6.45
E
+
02
-
3.24
E
+
02
-
1.80
E
+
02
-
1.39
E
+
02
-
8.04
E
+
02
9.41
E
+
00
10
2.13
E
+
04
2.72
E
+
01
-
4.50
E
+
02
-
4.50
E
+
02
5.21
E
+
02
-
3.24
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.03
E
+
02
5.08
E
+
00
15
1.80
E
+
04
3.40
E
+
01
-
4.50
E
+
02
-
4.50
E
+
02
6.78
E
+
02
-
3.24
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.08
E
+
02
4.10
E
+
00
20
1.82
E
+
04
3.93
E
+
01
-
4.50
E
+
02
-
4.49
E
+
02
5.96
E
+
02
-
3.25
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.10
E
+
02
4.20
E
+
00
25
9.80
E
+
03
5.43
E
+
01
-
4.50
E
+
02
-
4.48
E
+
02
5.19
E
+
02
-
3.24
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.10
E
+
02
4.27
E
+
00
30
2.18
E
+
04
6.84
E
+
01
-
4.50
E
+
02
-
4.47
E
+
02
5.33
E
+
02
-
3.25
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.11
E
+
02
4.33
E
+
00
35
1.46
E
+
04
9.77
E
+
01
-
4.50
E
+
02
-
4.46
E
+
02
8.04
E
+
02
-
3.26
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.11
E
+
02
4.24
E
+
00
40
1.24
E
+
04
1.18
E
+
02
-
4.50
E
+
02
-
4.44
E
+
02
8.18
E
+
02
-
3.26
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.10
E
+
02
4.29
E
+
00
HMS
F
21
F
22
F
23
F
24
F
25
F
26
F
27
F
28
F
29
F
3
0
05
2.02
E
-
01
9.64
E
+
00
-
4.50
E
+
02
4.74
E
+
02
-
3.26
E
+
02
5.05
E
-
03
-
4.50
E
+
02
6.01
E
+
02
-
3.29
E
+
02
1.50
E
-
03
10
6.50
E
-
02
5.27
E
+
00
-
4.50
E
+
02
4.71
E
+
02
-
3.26
E
+
02
4.96
E
-
03
-
4.50
E
+
02
7.29
E
+
02
-
3.28
E
+
02
1.41
E
-
03
15
7.34
E
-
02
4.40
E
+
00
-
4.50
E
+
02
4.70
E
+
02
-
3.27
E
+
02
4.86
E
-
03
-
4.50
E
+
02
4.19
E
+
02
-
3.29
E
+
02
2.21
E
-
02
20
5.28
E
-
02
4.27
E
+
00
-
4.50
E
+
02
4.96
E
+
02
-
3.26
E
+
02
5.08
E
-
03
-
4.50
E
+
02
4.26
E
+
02
-
3.29
E
+
02
1.25
E
-
03
25
3.54
E
-
04
4.06
E
+
00
-
4.50
E
+
02
4.93
E
+
02
-
3.26
E
+
02
5.37
E
-
03
-
4.50
E
+
02
9.77
E
+
02
-
3.29
E
+
02
1.53
E
-
03
30
3.34
E
-
04
3.80
E
+
00
-
4.50
E
+
02
4.91
E
+
02
-
3.27
E
+
02
5.22
E
-
03
-
4.50
E
+
02
6.57
E
+
02
-
3.29
E
+
02
1.39
E
-
03
35
4.41
E
-
04
4.06
E
+
00
-
4.50
E
+
02
4.93
E
+
02
-
3.27
E
+
02
5.16
E
-
03
-
4.50
E
+
02
5.06
E
+
02
-
3.29
E
+
02
1.61
E
-
03
40
3.65
E
-
04
4.06
E
+
00
-
4.50
E
+
02
4.86
E
+
02
-
3.27
E
+
02
5.40
E
-
03
-
4.50
E
+
02
8.34
E
+
02
-
3.29
E
+
02
1.45
E
-
03Table 11
F
1~F10:
1.0
E
-
05
1.0
E
+
00
1.0
E
-
05
1.0
E
-
05
5.0
E
+
00
1.0
E
-
02
1.0
E
-
10
2
D
1.0
E
+
00
1.0
E
-
10
F
11~F20:
2
D
E
+
04
D
1.0
E
-
04
1.0
E
-
01
50
D
1.0
E
+
00
1.0
E
-
04
1.0
E
-
02
1.0
E
+
00
1.0
E
+
01
F
21~F30:
1.0
E
-
03
1.0
E
+
01
1.0
E
-
04
2
D
2
D
1.0
E
-
02
1.0
E
-
05
D
1.0
E
+
00
1.0
E
-
02We can see from Table10, in which there are some unimodal functions (i.e., F10–F14, F23), a small value of HMS (i.e., 5 or 10) is superior to a large value. For other benchmark functions, there is no obvious indication that one setting value of HMS is superior to the other setting values. Therefore, we can think that, a small HMS is suitable for a simple problem. However, for some complex problems, we can set slightly more HMS that is not exceeding 50. It is reasonable and logical, for it is similar to the quickly memory of musician for a simple harmony improvisation and the depth memory of musician for an outstanding harmony improvisation.


## 4.1. Test Functions

The test functionsF1–F23 [27–29] are shown in Table 1, and F24–F31 are demonstrated. Table 2 in Functions F24–F31 [30] are hybrid composition functions. The hybrid composition functions are built combining a nonseparable (NS) function with other functions. The considered functions are as folows.(i)
Nonseparable functions:
(a)
F15: shifted Rosenbrock's function,(b)
F17: shifted Griewank's function,(c)
NS-F21: nonshifted Extended F10,(d)
NS-F22: nonshifted Bohachevsky.(ii)
Other component functions:
(a)
F13: shifted sphere function,(b)
F16: shifted Rastrigin function,(c)
F20: Schwefel2.22 function.Table 1
Benchmark test functions.
Function name
Benchmark functions expression
Search range
Optimum value
F
1: Ackley function
F
1
(
x
)
=
-
20
e
(
1
/
5
)
(
1
/
D
)
∑
i
=
1
D
x
i
2
-
e
(
1
/
D
)
∑
i
=
1
D
cos
(
2
π
x
i
)
+
20
-
e
[
-
15,30
]
D
x
*
=
(
0,0
,
…
,
0
), F1(x*)=0
F
2: Dixon and Price function
F
2
(
x
)
=
(
x
1
+
1
)
2
+
∑
i
=
2
D
i
(
2
x
i
2
-
x
i
-
1
)
2
[
-
10,10
]
D
F
2
(
x
*
)
=
0
F
3: Griewank function
F
3
=
(
1
/
4000
)
∑
i
=
1
D
x
i
2
-
∏
i
=
1
D
(
cos
(
x
i
/
i
)
)
+
1
[
-
600,600
]
D
x
*
=
(
0,0
,
…
,
0
), F3(x*)=0
F
4: Levy function
F
4
(
x
)
=
sin
2
(
π
y
1
)
+
∑
i
=
1
D
-
1
[
(
y
i
-
1
)
2
(
1
+
10
sin
2
(
π
y
i
+
1
)
)
]
[
-
10,10
]
D
x
*
=
(
1,1
,
…
,
1
), F4(x*)=0
+
(
y
D
-
1
)
2
(
1
+
10
sin
2
(
2
π
y
D
)
), where yi=1+((xi-1)/4), i=1,2,…,D
F
5: Michalewics function
F
5
(
x
)
=
-
∑
i
=
1
D
sin
(
x
i
)
(
sin
(
i
x
i
2
/
π
)
)
2
m
;
m
=
10
[
-
10
,
π
]
D
n
=
5
;
F
5
(
x
*
)
=
-
4.687658
F
6: Powell function
F
6
(
x
)
=
∑
i
=
1
D
/
4
[
(
x
4
i
-
3
+
10
x
4
i
-
2
)
2
+
5
(
x
4
i
-
1
-
x
4
i
)
2
+
(
x
4
i
-
2
-
x
4
i
-
1
)
2
+
10
(
x
4
i
-
3
-
x
4
i
)
4
]
[
-
4,5
]
D
x* =  (3, −1, 0, 1, …, 3, −1, 0, 1), F6(x*)=0
F
7: Rastrigin function
F
7
(
x
)
=
10
D
+
∑
i
=
1
D
(
x
i
2
-
10
cos
(
2
π
x
i
)
)
[
-
5.12,5.12
]
D
x
*
=
(
0,0
,
…
,
0
), F7(x*)=0
F
8: Rosenbrock function
F
8
(
x
)
=
∑
i
=
1
D
-
1
[
100
(
x
i
2
-
x
i
-
1
)
2
+
(
x
i
-
1
)
2
]
[
-
10,10
]
D
x
*
=
(
1,1
,
…
,
1
), F8(x*)=0
F
9: Schwefel2.26 function
F
9
(
x
)
=
418.9829
D
+
∑
i
=
1
D
x
i
2
sin
(
|
x
i
|
)
[
-
512,512
]
D
x
*
=
(
420.9687,420.9687
,
…, 420.9687), F9(x*)=0
F
10: Sphere function
F
10
(
x
)
=
∑
i
=
1
D
x
i
2
[
-
100,100
]
D
x
*
=
(
0,0
,
…
,
0
), F10(x*)=0
F
11: Trid function
F
11
(
x
)
=
∑
i
=
1
D
(
x
i
-
1
)
2
-
∑
i
=
2
D
x
i
x
i
-
1
[
-
D
2
,
D
2
]
D
D
=
5
;
F
11
(
x
*
)
=
-
30
F
12: Zakharov function
F
12
(
x
)
=
∑
i
=
1
D
x
i
2
+
(
∑
i
=
1
D
0.5
i
x
i
)
2
+
(
∑
i
=
1
D
0.5
i
x
i
)
4
[
-
5,10
]
D
x
*
=
(
0,0
,
…
,
0
), F12(x*)=0
F
13: Sphere shift function
F
13
(
x
)
=
∑
i
=
1
D
z
i
2
+
f
_
bia
s
13, f_bias13=-450, z=x-o; o=[o1,o2,...,oD]
[
-
100,100
]
D
x
*
=
o, F12(x*)=-450
F
14: Schwefel shift function
F
14
=
max
(
|
z
|
)
+
f
_
bia
s
14, f_bias14=-450, z=x-o; o=[o1,o2,...,oD]
[
-
100,100
]
D
x
*
=
o, F14(x*)=-450
F
15: Rosenbrock shift function
F
15
(
x
)
=
∑
i
=
1
D
-
1
[
100
(
z
i
2
-
z
i
-
1
)
2
+
(
z
i
-
1
)
2
]
+
f
_
bia
s
15, f_bias15=390, z=x-o; o=[o1,o2,...,oD]
[
-
100,100
]
D
x
*
=
o, F15(x*)=390
F
16: Griewank shift function
F
16
=
(
1
/
4000
)
∑
i
=
1
D
z
i
2
-
∏
i
=
1
D
(
cos
(
z
i
/
i
)
)
+
1
+
f
_
bia
s
16, f_bias16=-180, z=(x-o)×M, o=[o1,o2,...,oD]
[
-
600,600
]
D
x
*
=
o, F16(x*)=-180
F
17: Rastrigin shift function
F
17
(
x
)
=
10
D
+
∑
i
=
1
D
(
z
i
2
-
10
cos
(
2
π
z
i
)
)
+
f
_
bia
s
17, f_bias17=-330, z=x-o; o=[o1,o2,...,oD]
[
-
5.12,5.12
]
D
x
*
=
o, F17(x*)=-330
F
18: Ackley shift  function
F
18
(
x
)
=
-
20
e
(
1
/
5
)
(
1
/
D
)
∑
i
=
1
D
z
i
2
-
e
(
1
/
D
)
∑
i
=
1
D
cos
(
2
π
z
i
)
+
20
-
e, f_bias18=-140, z=x-o; o=[o1,o2,...,oD]
[
-
32,32
]
D
x
*
=
o, F18(x*)=-140
F
19: Fast Fractal “Double Dip” function
F
19
(
x
)
=
∑
i
=
1
D
fractal
1
D
(
x
i
+
twist
(
x
(
i
mod
D
)
+
1
)
)
Unknown
[-1,1]D
twist
(
y
)
=
4
(
y
4
-
2
y
3
+
y
2
)
fractal
1
D
(
x
)
≈
∑
k
=
1
3
∑
1
2
k
-
1
∑
1
ran2
(
o
)
doubledip
(
x
,
ran
1
(
o
)
,
1
2
k
-
1
(
2
-
ran
1
(
o
)
)
)
doubledip
(
x
,
c
,
s
)
=
{
(
-
6144
(
x
-
c
)
6
+
3088
(
x
-
c
)
4
-
392
(
x
-
c
)
2
+
1
)
s
0
,
otherwise
ran
1
(
o
): double, pseudo randomly chosen, with seed o, with equal probability from the interval [0,1]  ran2(o): integer, pseudo randomly chosen, with seed o, with equal probability from the set {0,1,2}  fractal1D(x) is an approximation to a recursive algorithm, it does not take account of wrapping at the boundaries, or local reseeding of the random generators.
F
20: Schwefel2.22 function
F
20
(
x
)
=
∑
i
=
1
D
|
x
i
|
+
∏
i
=
1
D
|
x
i
|
[
-
10,10
]
D
x
*
=
(
0,0
,
.
.
.
,
0
), F20(x*)=0
F
21: Extended_f10 shift function
F
21
(
x
)
=
(
∑
i
=
1
D
-
1
f
10
(
z
i
,
z
i
+
1
)
)
+
f
10
(
z
D
,
z
1
)
,
z
=
x
-
o
f
10
=
(
x
2
+
y
2
)
0.25
·
(
sin
2
(
50
·
(
x
2
+
y
2
)
0.1
)
+
1
)
[
-
100,100
]
D
x
*
=
o, F21(x*)=0
F
22: Bohachevsky function
F
22
(
x
)
=
∑
i
=
1
D
(
z
i
2
+
2
z
i
+
1
2
-
0.3
cos
(
3
π
z
i
)
-
0.4
cos
(
4
π
z
i
+
1
)
+
0.7
)
,
z
=
x
-
o
[
-
15,15
]
D
x
*
=
o, F22(x*)=0
F
23: Schaffer shift function
F
23
(
x
)
=
∑
i
=
1
D
-
1
(
z
i
2
+
z
i
+
1
2
)
0.25
(
sin
2
(
50
·
(
z
i
2
+
z
i
+
1
2
)
0.1
)
+
1
)
,
z
=
x
-
o
[
-
100,100
]
D
x
*
=
o, F23(x*)=0Table 2
The hybrid functions (F24–F31).
Function
F
ns
F
′
m
ns
Range
Fitness optimum
F
24
NS-F21
F
13
0.25
[
-
100,100
]
D
−450
F
25
NS-F22
F
15
0.25
[
-
100,100
]
D
390
F
26
NS-F23
F
16
0.25
[
-
5,5
]
D
−330
F
27
NS-F22
NS-F20
0.25
[
-
10,10
]
D
0
F
28
NS-F21
F
13
0.5
[
-
100,100
]
D
−450
F
29
NS-F21
F
15
0.75
[
-
100,100
]
D
390
F
30
NS-F21
F
16
0.75
[
-
5,5
]
D
−330
F
31
NS-F22
NS-F20
0.75
[
-
10,10
]
D
0Hybrid functionFns⊕F′(S) is composed of a nonseparable function Fns and other function F′. The hybrid procedure is shown as follows.  (1)  S is divided into two parts (part1 and part2) as followsIf  mns≤0.5 then
part1 is composed by the first D·mns even variables. (length (part1) = D·mns)part2 is composed by the remaining variables. (length (part2) = D-length (part1))Else
part2 is composed by the first D·(1-mns) odd variables. (length (part2) = D·(1-mns))part1 is composed by the remaining variables. (length (part1) = D-length (part2))End If(2) Return Fns(part1)⊕F′(part2).We have used 31 well-known unconstrained benchmark functions [27–30] as a testbed to evaluate the performance of the HSTL algorithm presented in this paper. These test functions are considered as particularly challenging for many existing meta-heuristic optimization algorithms except for F10. The composition of these test functions contains some characteristics, such as separable design variables, nonseparable design variables, strong unimodality, strong multimodality, and hybrid. Many of them blend different characteristics together. Table 3 shows the characteristics of all test functions.Table 3
The characteristics of all test functions.
Function
F
1
F
2
F
3
F
4
F
5
F
6
F
7
F
8
F
9
F
10
F
11
F
12
F
13
F
14
F
15
F
16
Unimodal (U)/multimodal (M)
M
M
M
M
M
M
M
M
M
U
U
U
U
U
M
M
Shifted (Y/N)
N
N
N
N
N
N
N
N
N
N
N
N
Y
Y
Y
Y
Separable (Y/N)
Y
N
N
Y
Y
N
Y
N
Y
Y
Y
Y
Y
N
N
Y
Hybrid (Y/N)
N
N
N
N
N
N
N
N
N
N
N
N
N
N
N
N
Function
F
17
F
18
F
19
F
20
F
21
F
22
F
23
F
24
F
25
F
26
F
27
F
28
F
29
F
30
F
31
Unimodal (U)/multimodal (M)
M
M
M
U
U
U
U
U
M
M
M
U
M
M
N
Shifted (Y/N)
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
N
Separable (Y/N)
N
N
N
N
N
N
N
N
N
N
N
N
N
N
N
Hybrid (Y/N)
N
N
N
N
N
N
Y
Y
Y
Y
Y
Y
Y
Y
Y


## 4.2. Experimental Setup

Simulation experiments are carried out to compare the optimization (minimization) capabilities of the presented method (HSTL) with respect to (a) classical HS [1, 2], (b) SGHS [16], and (c) NGHS [13, 14]. All the experiments were performed on Windows XP 32 system with Intel(R) Core(TM) i3-2120 CPU@3.30 GHz and 2 GB RAM, and all the program codes were written in MATLAB R2009a.In the experiments, the parameters settings for the compared HS algorithms are shown in Table4; the dimensions of the benchmark problems are set as 50, 100, and 200, respectively. To make the comparison fair, the populations for all the competitor algorithms (for all problems tested) were initialized using the same random seeds. The variants of HS algorithm were set at the same termination criteria: the number of improvisations (function evaluation times: FEs) FEs = 500D, respectively.Table 4
Parameter settings for the compared HS algorithms (HS, SGHS, NGHS, HSTL).
Algorithm
HMS
HMCR
PAR
BW
Others
HS
35
0.98
0.33
BW = (UB − LB)/1000
SGHS
35
HMCR
m = 0.9
PARmax = 0.99,PARmin = 0.01
BWmax = (UB − LB)/10BWmin = 0.0005
LP = 100
NGHS
35
/
/
/
P
m = 0.01
HSTL
35
HMCRmax = 0.99
PARmax = 0.8
BWmax = (UB − LB)/20
TLPmax = 0.5, TLPmin = 0.15
HMCRmin = 0.75
PARmin = 0.2
BWmin = (UB − LB)/3500
P
m = 0.15, k = 5The best and worst fitness values of each benchmark problem are recorded for 30 independent runs; the mean fitness, standard deviation (STD), and mean runtime of each function are calculated for 30 independent runs, and the Mean fitness, Standard Deviation (STD) and mean runtime of each function are calculated for 30 independent runs.


## 4.3. The Results Comparison between HSTL, HS, SGHS, and NGHS Algorithm

From Table5, it can be found that the mean optimal fitness values of HSTL are always less than those of other 3 HS algorithms for all test functions except for F12, F14, F16, and F29 when dimension are equal to 50 and maxFEs = 25000, and all these mean optimal fitness values are slightly larger than the NGHS algorithm for F12, F14, F16, and F29. According to criterions (best, mean, worst, and STD), the over performance of HSTL method outperforms the other three HS algorithms for 31 benchmark problems except F12, F14, and F29. Taken together, the beast, mean, and STD obtained by the HSTL method are better than those of other three methods for most test functions. In addition, the runtime is less than SGHS for all problems.Table 5
The optimization results of four harmony search algorithms forF1–F31 (D = 50, FEs = 500D).
Function
Algorithm
Best
Mean
Worst
STD
Runtime
F
1
HS
2.566680
E
+
00
3.302045
E
+
00
3.884725
E
+
00
3.248466
E
-
01
5.916126
E
-
01
SGHS
1.813356
E
+
00
2.557675
E
+
00
3.129460
E
+
00
3.608468
E
-
01
1.539694
E
+
00
NGHS
3.447238
E
-
02
5.592492
E
-
02
8.840852
E
-
02
1.464912
E
-
02
6.187550
E
-
01
HSTL
9.224783
E
-
04
1.775338
E
-
03
2.516676
E
-
03
3.736810
E
-
04
1.150359
E
+
00
F
2
HS
2.528891
E
+
01
1.303365
E
+
02
2.064702
E
+
02
4.764531
E
+
01
3.728292
E
-
01
SGHS
2.291379
E
+
01
5.454353
E
+
01
1.405853
E
+
02
2.704011
E
+
01
1.335320
E
+
00
NGHS
7.771989
E
-
01
5.744259
E
+
00
1.159369
E
+
01
3.130084
E
+
00
4.210442
E
-
01
HSTL
6.666789
E
-
01
7.870821
E
-
01
1.185710
E
+
00
1.526289
E
-
01
8.835301
E
-
01
F
3
HS
1.498964
E
+
00
1.663430
E
+
00
1.988965
E
+
00
1.398770
E
-
01
6.367849
E
-
01
SGHS
1.190177
E
+
00
1.475248
E
+
00
2.130067
E
+
00
2.263591
E
-
01
1.593317
E
+
00
NGHS
4.418931
E
-
02
7.146802
E
-
02
1.559262
E
-
01
2.679798
E
-
02
6.544169
E
-
01
HSTL
2.933239
E
-
05
8.315104
E
-
04
1.506785
E
-
02
3.351017
E
-
03
1.209138
E
+
00
F
4
HS
2.734048
E
-
01
3.341458
E
-
01
4.153356
E
-
01
3.844929
E
-
02
1.368443
E
+
00
SGHS
1.417380
E
-
01
1.714592
E
+
00
3.739141
E
+
00
1.116863
E
+
00
2.390772
E
+
00
NGHS
2.066964
E
-
04
3.193237
E
-
04
5.845768
E
-
04
9.202494
E
-
05
1.393585
E
+
00
HSTL
4.120272
E
-
06
6.258354
E
-
06
9.738134
E
-
06
1.414984
E
-
06
2.027401
E
+
00
F
5
HS
-
4.170235
E
+
01
-
4.036729
E
+
01
-
3.828157
E
+
01
9.770373
E
-
01
8.758810
E
-
01
SGHS
-
4.660214
E
+
01
-
4.506838
E
+
01
-
4.284438
E
+
01
9.381859
E
-
01
1.822759
E
+
00
NGHS
-
4.761973
E
+
01
-
4.653808
E
+
01
-
4.546623
E
+
01
5.188843
E
-
01
9.208168
E
-
01
HSTL
-
4.848365
E
+
01
-
4.783102
E
+
01
-
4.713305
E
+
01
3.899320
E
-
01
1.454742
E
+
00
F
6
HS
4.064420
E
+
00
1.023338
E
+
01
1.807872
E
+
01
4.174841
E
+
00
1.270949
E
+
00
SGHS
3.787277
E
+
00
2.168953
E
+
01
5.037661
E
+
01
1.367783
E
+
01
2.307965
E
+
00
NGHS
4.732459
E
-
02
9.566685
E
-
02
1.331749
E
-
01
2.187037
E
-
02
1.313182
E
+
00
HSTL
3.072186
E
-
02
7.276520
E
-
02
1.260607
E
-
01
2.847471
E
-
02
1.955321
E
+
00
F
7
HS
2.373168
E
+
01
3.076467
E
+
01
3.740304
E
+
01
3.698242
E
+
00
4.206309
E
-
01
SGHS
4.212332
E
+
01
5.047204
E
+
01
5.912495
E
+
01
5.715449
E
+
00
1.387887
E
+
00
NGHS
4.155143
E
+
00
8.088647
E
+
00
1.126315
E
+
01
1.970674
E
+
00
4.668058
E
-
01
HSTL
3.164383
E
-
05
3.450611
E
-
03
3.265254
E
-
02
8.899514
E
-
03
9.399841
E
-
01
F
8
HS
5.951376
E
+
01
4.482384
E
+
02
8.417699
E
+
02
2.411457
E
+
02
3.847198
E
-
01
SGHS
2.024308
E
+
02
4.029735
E
+
02
1.163300
E
+
03
2.088718
E
+
02
1.346647
E
+
00
NGHS
2.246655
E
+
01
1.232892
E
+
02
2.151188
E
+
02
5.247493
E
+
01
4.322725
E
-
01
HSTL
4.179333
E
+
01
7.883687
E
+
01
1.109876
E
+
02
3.016135
E
+
01
9.006008
E
-
01
F
9
HS
1.891514
E
+
02
2.441957
E
+
02
3.147589
E
+
02
3.822653
E
+
01
4.938682
E
-
01
SGHS
4.914947
E
+
02
1.155863
E
+
03
1.616206
E
+
03
3.125553
E
+
02
1.506911
E
+
00
NGHS
1.177227
E
+
00
1.939242
E
+
02
5.928832
E
+
02
1.437114
E
+
02
5.429397
E
-
01
HSTL
2.831025
E
-
03
4.800827
E
+
01
2.559129
E
+
02
8.324164
E
+
01
1.055470
E
+
00
F
1
0
HS
4.982674
E
+
01
7.634414
E
+
01
1.088877
E
+
02
1.384184
E
+
01
5.155853
E
-
01
SGHS
1.941824
E
+
01
5.712271
E
+
01
1.173837
E
+
02
2.463712
E
+
01
1.483779
E
+
00
NGHS
2.933452
E
-
02
5.495792
E
-
02
1.250118
E
-
01
2.413133
E
-
02
5.503947
E
-
01
HSTL
5.196982
E
-
05
1.156867
E
-
04
1.822736
E
-
04
3.949670
E
-
05
1.105805
E
+
00
F
1
1
HS
-
8.495269
E
+
03
2.112918
E
+
05
6.120867
E
+
05
1.507484
E
+
05
5.529535
E
-
01
SGHS
1.495650
E
+
05
2.926573
E
+
05
4.921806
E
+
05
8.867408
E
+
04
1.522435
E
+
00
NGHS
7.811770
E
+
02
6.724066
E
+
04
1.795737
E
+
05
4.051646
E
+
04
5.825563
E
-
01
HSTL
3.586693
E
+
03
3.982094
E
+
04
1.129715
E
+
05
3.077074
E
+
04
1.154489
E
+
00
F
1
2
HS
1.808763
E
+
02
2.922832
E
+
02
3.779931
E
+
02
5.595106
E
+
01
5.278572
E
-
01
SGHS
1.966065
E
+
02
2.939376
E
+
02
4.245442
E
+
02
6.167682
E
+
01
1.413886
E
+
00
NGHS
2.263637
E
+
01
5.379553
E
+
01
9.021302
E
+
01
1.550666
E
+
01
5.732848
E
-
01
HSTL
1.598764
E
+
02
2.741391
E
+
02
3.460420
E
+
02
5.654623
E
+
01
1.075394
E
+
00
F
1
3
HS
-
3.982491
E
+
02
-
3.703682
E
+
02
-
3.359549
E
+
02
1.639155
E
+
01
1.281255
E
+
00
SGHS
-
4.342564
E
+
02
-
4.020580
E
+
02
-
3.757443
E
+
02
1.465006
E
+
01
2.355018
E
+
00
NGHS
-
4.499802
E
+
02
-
4.499468
E
+
02
-
4.498976
E
+
02
2.171095
E
-
02
1.325362
E
+
00
HSTL
-
4.499992
E
+
02
-
4.499987
E
+
02
-
4.499983
E
+
02
2.372395
E
-
04
2.063549
E
+
00
F
1
4
HS
-
4.330907
E
+
02
-
4.272501
E
+
02
-
4.198265
E
+
02
3.339807
E
+
00
1.293516
E
+
00
SGHS
-
4.290403
E
+
02
-
4.161920
E
+
02
-
4.061673
E
+
02
6.869724
E
+
00
2.335600
E
+
00
NGHS
-
4.475734
E
+
02
-
4.467607
E
+
02
-
4.456620
E
+
02
5.729226
E
-
01
1.334976
E
+
00
HSTL
-
4.345355
E
+
02
-
4.303615
E
+
02
-
4.257539
E
+
02
2.813241
E
+
00
2.110056
E
+
00
F
1
5
HS
4.518000
E
+
04
1.178572
E
+
05
2.758509
E
+
05
5.318182
E
+
04
1.548986
E
+
00
SGHS
1.546908
E
+
04
1.439934
E
+
05
1.140938
E
+
06
2.428257
E
+
05
2.663552
E
+
00
NGHS
5.520145
E
+
02
1.096629
E
+
03
5.304441
E
+
03
1.408912
E
+
03
1.595152
E
+
00
HSTL
4.364245
E
+
02
8.663389
E
+
02
6.714816
E
+
03
1.380399
E
+
03
2.384685
E
+
00
F
1
6
HS
-
3.073606
E
+
02
-
2.979182
E
+
02
-
2.930230
E
+
02
3.428569
E
+
00
1.388468
E
+
00
SGHS
-
2.904807
E
+
02
-
2.795281
E
+
02
-
2.653651
E
+
02
7.917957
E
+
00
2.457957
E
+
00
NGHS
-
3.247746
E
+
02
-
3.221057
E
+
02
-
3.177697
E
+
02
2.003994
E
+
00
1.425334
E
+
00
HSTL
-
3.257734
E
+
02
-
3.194510
E
+
02
-
3.131576
E
+
02
3.257068
E
+
00
2.154368
E
+
00
F
1
7
HS
-
1.784876
E
+
02
-
1.782673
E
+
02
-
1.779930
E
+
02
1.484480
E
-
01
1.920537
E
+
00
SGHS
-
1.788319
E
+
02
-
1.785108
E
+
02
-
1.778547
E
+
02
2.823212
E
-
01
3.026930
E
+
00
NGHS
-
1.799673
E
+
02
-
1.799278
E
+
02
-
1.798487
E
+
02
2.657279
E
-
02
1.936843
E
+
00
HSTL
-
1.799993
E
+
02
-
1.799977
E
+
02
-
1.799891
E
+
02
2.941948
E
-
03
2.661228
E
+
00
F
1
8
HS
-
1.373170
E
+
02
-
1.367418
E
+
02
-
1.362105
E
+
02
3.320310
E
-
01
1.538989
E
+
00
SGHS
-
1.380207
E
+
02
-
1.373137
E
+
02
-
1.363707
E
+
02
3.842756
E
-
01
2.631186
E
+
00
NGHS
-
1.399544
E
+
02
-
1.399264
E
+
02
-
1.399026
E
+
02
1.478740
E
-
02
1.556766
E
+
00
HSTL
-
1.399944
E
+
02
-
1.399932
E
+
02
-
1.399923
E
+
02
4.802592
E
-
04
2.308382
E
+
00
F
1
9
HS
-
7.783258
E
+
02
-
7.574243
E
+
02
-
7.440193
E
+
02
9.549819
E
+
00
3.364700
E
+
00
SGHS
-
7.977925
E
+
02
-
7.830542
E
+
02
-
7.648281
E
+
02
8.315008
E
+
00
4.449306
E
+
00
NGHS
-
8.126267
E
+
02
-
7.983609
E
+
02
-
7.807750
E
+
02
7.476016
E
+
00
3.453860
E
+
00
HSTL
-
8.133893
E
+
02
-
8.054826
E
+
02
-
7.933937
E
+
02
5.255994
E
+
00
4.110440
E
+
00
F
20
HS
3.235346
E
+
01
4.619696
E
+
01
6.603604
E
+
01
9.209638
E
+
00
6.108355
E
-
01
SGHS
1.840610
E
+
01
2.931223
E
+
01
4.219485
E
+
01
6.705792
E
+
00
1.656616
E
+
00
NGHS
1.023646
E
+
00
1.326115
E
+
00
1.638720
E
+
00
1.801950
E
-
01
6.740073
E
-
01
HSTL
1.666479
E
-
02
2.377405
E
-
02
3.561417
E
-
02
3.989928
E
-
03
1.340302
E
+
00
F
21
HS
1.039417
E
+
02
1.371442
E
+
02
1.606956
E
+
02
1.457780
E
+
01
1.692515
E
+
01
SGHS
6.337241
E
+
01
8.847938
E
+
01
1.032481
E
+
02
9.606610
E
+
00
1.883071
E
+
01
NGHS
2.804776
E
+
01
3.706996
E
+
01
4.978956
E
+
01
6.433861
E
+
00
1.691865
E
+
01
HSTL
4.874162
E
+
00
5.839427
E
+
00
7.688011
E
+
00
8.479931
E
-
01
1.766882
E
+
01
F
22
HS
2.466530
E
+
01
3.127048
E
+
01
3.564485
E
+
01
3.212730
E
+
00
1.153501
E
+
01
SGHS
1.342097
E
+
01
2.030578
E
+
01
2.459678
E
+
01
3.326658
E
+
00
1.349578
E
+
01
NGHS
4.017501
E
-
02
7.928514
E
-
02
1.477305
E
-
01
3.097912
E
-
02
1.160670
E
+
01
HSTL
8.611143
E
-
04
2.201951
E
-
02
4.140857
E
-
01
9.228328
E
-
02
1.214935
E
+
01
F
23
HS
1.167773
E
+
02
1.315135
E
+
02
1.534918
E
+
02
1.135387
E
+
01
1.264720
E
+
01
SGHS
7.270431
E
+
01
8.324425
E
+
01
1.008921
E
+
02
6.879689
E
+
00
1.442205
E
+
01
NGHS
2.477052
E
+
01
3.758657
E
+
01
5.407804
E
+
01
7.976231
E
+
00
1.312881
E
+
01
HSTL
4.038784
E
+
00
6.052038
E
+
00
1.261065
E
+
01
1.761817
E
+
00
1.385192
E
+
01
F
24
HS
-
4.217519
E
+
02
-
4.046735
E
+
02
-
3.782667
E
+
02
1.257151
E
+
01
1.359617
E
+
01
SGHS
-
4.431356
E
+
02
-
4.312111
E
+
02
-
3.858681
E
+
02
1.369453
E
+
01
1.555383
E
+
01
NGHS
-
4.499996
E
+
02
-
4.499993
E
+
02
-
4.499982
E
+
02
3.724625
E
-
04
1.364959
E
+
01
HSTL
-
4.499996
E
+
02
-
4.499994
E
+
02
-
4.499991
E
+
02
1.730785
E
-
04
1.440449
E
+
01
F
25
HS
2.665579
E
+
04
6.003134
E
+
04
1.020993
E
+
05
2.295715
E
+
04
1.384424
E
+
01
SGHS
6.783432
E
+
03
3.423766
E
+
04
1.447178
E
+
05
3.728901
E
+
04
1.574535
E
+
01
NGHS
4.838503
E
+
02
5.491368
E
+
02
6.308092
E
+
02
4.002266
E
+
01
1.387828
E
+
01
HSTL
4.283814
E
+
02
5.425790
E
+
02
1.213942
E
+
03
1.982288
E
+
02
1.433272
E
+
01
F
26
HS
-
3.056734
E
+
02
-
3.005925
E
+
02
-
2.916669
E
+
02
3.782453
E
+
00
1.339199
E
+
01
SGHS
-
2.924154
E
+
02
-
2.838442
E
+
02
-
2.713927
E
+
02
6.793276
E
+
00
1.527401
E
+
01
NGHS
-
3.267093
E
+
02
-
3.228070
E
+
02
-
3.183256
E
+
02
2.244713
E
+
00
1.341534
E
+
01
HSTL
-
3.289412
E
+
02
-
3.236531
E
+
02
-
3.188403
E
+
02
2.872375
E
+
00
1.421595
E
+
01
F
27
HS
4.849375
E
+
00
6.498510
E
+
00
8.495851
E
+
00
1.017495
E
+
00
1.262153
E
+
01
SGHS
1.619215
E
+
00
4.090404
E
+
00
6.379225
E
+
00
1.193628
E
+
00
1.455011
E
+
01
NGHS
6.034321
E
-
02
8.531001
E
-
02
1.167611
E
-
01
1.717796
E
-
02
1.266599
E
+
01
HSTL
8.329468
E
-
03
9.918090
E
-
03
1.162367
E
-
02
1.094430
E
-
03
1.344353
E
+
01
F
28
HS
-
4.495086
E
+
02
-
4.478733
E
+
02
-
4.443561
E
+
02
1.460489
E
+
00
1.617566
E
+
01
SGHS
-
4.499731
E
+
02
-
4.498848
E
+
02
-
4.497073
E
+
02
8.308225
E
-
02
1.816665
E
+
01
NGHS
-
4.500000
E
+
02
-
4.500000
E
+
02
-
4.500000
E
+
02
5.050670
E
-
14
1.633242
E
+
01
HSTL
-
4.500000
E
+
02
-
4.500000
E
+
02
-
4.500000
E
+
02
3.894074
E
-
06
1.700242
E
+
01
F
29
HS
7.984189
E
+
02
5.231460
E
+
03
2.285396
E
+
04
5.423033
E
+
03
1.646778
E
+
01
SGHS
6.857379
E
+
02
2.714991
E
+
03
1.007518
E
+
04
2.839634
E
+
03
1.841738
E
+
01
NGHS
4.290961
E
+
02
5.562601
E
+
02
1.377085
E
+
03
2.419459
E
+
02
1.656795
E
+
01
HSTL
4.073724
E
+
02
1.159148
E
+
03
9.324027
E
+
03
2.181373
E
+
03
1.728557
E
+
01
F
30
HS
-
3.077579
E
+
02
-
3.023452
E
+
02
-
2.973287
E
+
02
3.007979
E
+
00
1.629385
E
+
01
SGHS
-
3.057815
E
+
02
-
2.971863
E
+
02
-
2.874010
E
+
02
4.692703
E
+
00
1.819898
E
+
01
NGHS
-
3.260430
E
+
02
-
3.234723
E
+
02
-
3.198728
E
+
02
1.579631
E
+
00
1.644573
E
+
01
HSTL
-
3.295820
E
+
02
-
3.280941
E
+
02
-
3.260903
E
+
02
1.159512
E
+
00
1.714851
E
+
01
F
31
HS
1.196768
E
+
01
1.679724
E
+
01
2.010432
E
+
01
2.439712
E
+
00
1.279175
E
+
01
SGHS
4.187297
E
+
00
9.601911
E
+
00
1.575427
E
+
01
3.206880
E
+
00
1.473686
E
+
01
NGHS
2.868378
E
-
02
4.841433
E
-
02
9.156237
E
-
02
1.566071
E
-
02
1.283577
E
+
01
HSTL
2.103222
E
-
03
2.808338
E
-
03
3.640376
E
-
03
4.063424
E
-
04
1.358129
E
+
01In Tables6 and 7, the results are shown for 100D and 200D problems, respectively. According to the results (best, mean, worst, and STD) of HSTL algorithm outperforms the other three harmony search algorithm. And it can be seen from Tables 6 and 7 that, compared with 50D problems, the HSTL method has more obvious advantages than other three HS algorithms (HS, SGHS, and NSGH).Table 6
The optimization results of four harmony search algorithms forF1–F31 (D = 100, FEs = 500D).
Function
Algorithm
Best
Mean
Worst
STD
Runtime
F
1
HS
3.472069
E
+
00
3.820833
E
+
00
4.047963
E
+
00
1.596325
E
-
01
1.769219
E
+
00
SGHS
3.132910
E
+
00
3.913786
E
+
00
5.083229
E
+
00
5.509827
E
-
01
4.010046
E
+
00
NGHS
1.444919
E
+
00
1.767520
E
+
00
2.084939
E
+
00
1.790358
E
-
01
1.750870
E
+
00
HSTL
2.287774
E
-
03
2.786403
E
-
03
3.224305
E
-
03
2.716016
E
-
04
3.008579
E
+
00
F
2
HS
3.167536
E
+
02
6.351839
E
+
02
1.255875
E
+
03
2.510796
E
+
02
1.193827
E
+
00
SGHS
3.589095
E
+
02
1.471320
E
+
03
3.982050
E
+
03
1.068029
E
+
03
3.400621
E
+
00
NGHS
3.974602
E
+
01
6.225108
E
+
01
8.429758
E
+
01
1.057944
E
+
01
1.243040
E
+
00
HSTL
6.668194
E
-
01
1.286474
E
+
00
7.749294
E
+
00
1.726882
E
+
00
2.346918
E
+
00
F
3
HS
2.603003
E
+
00
3.327735
E
+
00
3.759840
E
+
00
2.519202
E
-
01
1.920741
E
+
00
SGHS
2.174329
E
+
00
4.132405
E
+
00
6.281051
E
+
00
1.173173
E
+
00
4.125897
E
+
00
NGHS
1.188965
E
+
00
1.242508
E
+
00
1.340110
E
+
00
3.865128
E
-
02
1.920139
E
+
00
HSTL
1.376879
E
-
04
2.346120
E
-
04
5.029240
E
-
04
7.730570
E
-
05
3.209074
E
+
00
F
4
HS
8.948965
E
-
01
1.142211
E
+
00
1.519557
E
+
00
1.440158
E
-
01
5.019303
E
+
00
SGHS
5.690498
E
+
00
1.420662
E
+
01
2.458487
E
+
01
5.224712
E
+
00
7.419859
E
+
00
NGHS
9.494633
E
-
02
1.460202
E
-
01
2.463073
E
-
01
3.355741
E
-
02
5.010614
E
+
00
HSTL
1.635147
E
-
05
1.380600
E
-
04
2.370741
E
-
03
5.255262
E
-
04
6.668101
E
+
00
F
5
HS
-
6.672187
E
+
01
-
6.350148
E
+
01
-
6.043354
E
+
01
2.052348
E
+
00
2.969232
E
+
00
SGHS
-
8.968012
E
+
01
-
8.648817
E
+
01
-
8.264598
E
+
01
1.813756
E
+
00
5.086223
E
+
00
NGHS
-
8.313566
E
+
01
-
8.029515
E
+
01
-
7.690579
E
+
01
1.438337
E
+
00
2.968101
E
+
00
HSTL
-
9.585843
E
+
01
-
9.464151
E
+
01
-
9.352011
E
+
01
5.668992
E
-
01
4.289409
E
+
00
F
6
HS
2.275081
E
+
01
3.404998
E
+
01
4.701336
E
+
01
7.463806
E
+
00
4.601501
E
+
00
SGHS
6.202169
E
+
01
1.021203
E
+
02
1.576931
E
+
02
2.604590
E
+
01
7.029177
E
+
00
NGHS
2.559237
E
+
00
4.248504
E
+
00
7.194444
E
+
00
1.263185
E
+
00
4.571996
E
+
00
HSTL
1.159057
E
-
01
2.164533
E
-
01
3.013113
E
-
01
4.862855
E
-
02
6.357763
E
+
00
F
7
HS
8.761768
E
+
01
9.968145
E
+
01
1.095680
E
+
02
5.125492
E
+
00
1.397587
E
+
00
SGHS
1.204523
E
+
02
1.515871
E
+
02
1.806614
E
+
02
1.516934
E
+
01
3.643591
E
+
00
NGHS
5.302534
E
+
01
7.188578
E
+
01
8.426157
E
+
01
7.828465
E
+
00
1.433040
E
+
00
HSTL
1.577470
E
-
04
9.978969
E
-
02
9.954242
E
-
01
3.062646
E
-
01
2.611144
E
+
00
F
8
HS
5.880175
E
+
02
1.300531
E
+
03
2.082232
E
+
03
3.831144
E
+
02
1.223890
E
+
00
SGHS
8.999245
E
+
02
1.790814
E
+
03
2.911281
E
+
03
5.768125
E
+
02
3.494810
E
+
00
NGHS
3.079063
E
+
02
4.138027
E
+
02
5.638547
E
+
02
7.193641
E
+
01
1.255683
E
+
00
HSTL
9.318870
E
+
01
1.469698
E
+
02
2.571664
E
+
02
4.541752
E
+
01
2.443950
E
+
00
F
9
HS
7.122610
E
+
02
8.396009
E
+
02
9.466086
E
+
02
6.566372
E
+
01
1.529895
E
+
00
SGHS
3.806886
E
+
03
4.736018
E
+
03
6.005643
E
+
03
6.494470
E
+
02
3.877912
E
+
00
NGHS
6.828367
E
+
02
1.783404
E
+
03
2.842955
E
+
03
4.795603
E
+
02
1.569362
E
+
00
HSTL
7.968585
E
+
00
1.720210
E
+
02
3.973356
E
+
02
1.098869
E
+
02
2.854428
E
+
00
F
10
HS
2.129878
E
+
02
2.699577
E
+
02
3.362863
E
+
02
3.021370
E
+
01
1.482740
E
+
00
SGHS
1.475702
E
+
02
3.215163
E
+
02
5.256382
E
+
02
1.308856
E
+
02
3.719739
E
+
00
NGHS
1.599879
E
+
01
2.545197
E
+
01
3.908629
E
+
01
5.800758
E
+
00
1.488095
E
+
00
HSTL
2.404241
E
-
04
3.881772
E
-
04
5.946775
E
-
04
9.559413
E
-
05
2.861329
E
+
00
F
11
HS
3.939318
E
+
06
7.748172
E
+
06
1.544812
E
+
07
2.861829
E
+
06
1.567541
E
+
00
SGHS
1.156049
E
+
07
2.205330
E
+
07
3.666560
E
+
07
7.051009
E
+
06
3.787745
E
+
00
NGHS
3.799257
E
+
06
6.908533
E
+
06
9.606336
E
+
06
1.677867
E
+
06
1.569956
E
+
00
HSTL
3.921902
E
+
05
1.520828
E
+
06
3.598060
E
+
06
9.375356
E
+
05
2.978233
E
+
00
F
12
HS
7.150539
E
+
02
9.583770
E
+
02
1.225170
E
+
03
1.259891
E
+
02
1.530910
E
+
00
SGHS
7.715070
E
+
02
9.708888
E
+
02
1.242580
E
+
03
1.201418
E
+
02
3.590301
E
+
00
NGHS
2.108479
E
+
02
2.650550
E
+
02
3.204091
E
+
02
3.392485
E
+
01
1.553830
E
+
00
HSTL
6.766070
E
+
02
8.735240
E
+
02
1.063928
E
+
03
1.027158
E
+
02
2.874153
E
+
00
F
13
HS
-
2.375559
E
+
02
-
1.738990
E
+
02
-
1.079270
E
+
02
3.473333
E
+
01
3.058755
E
+
00
SGHS
-
3.131437
E
+
02
-
2.097408
E
+
02
-
8.276031
E
+
01
7.569102
E
+
01
5.492338
E
+
00
NGHS
-
4.332349
E
+
02
-
4.262997
E
+
02
-
4.192761
E
+
02
3.856018
E
+
00
3.064137
E
+
00
HSTL
-
4.499970
E
+
02
-
4.499959
E
+
02
-
4.499951
E
+
02
5.433935
E
-
04
4.894014
E
+
00
F
14
HS
-
4.232215
E
+
02
-
4.193171
E
+
02
-
4.108272
E
+
02
2.989275
E
+
00
3.133809
E
+
00
SGHS
-
3.977762
E
+
02
-
3.880149
E
+
02
-
3.766792
E
+
02
5.980155
E
+
00
5.474201
E
+
00
NGHS
-
4.402313
E
+
02
-
4.377563
E
+
02
-
4.360122
E
+
02
1.032261
E
+
00
3.189262
E
+
00
HSTL
-
4.245886
E
+
02
-
4.181521
E
+
02
-
4.133119
E
+
02
3.501804
E
+
00
4.858567
E
+
00
F
15
HS
3.297507
E
+
05
5.050010
E
+
05
7.154538
E
+
05
1.134203
E
+
05
3.715503
E
+
00
SGHS
2.141247
E
+
05
2.473414
E
+
06
9.215806
E
+
06
2.312600
E
+
06
6.170230
E
+
00
NGHS
6.173097
E
+
03
1.336579
E
+
04
2.527368
E
+
04
6.553278
E
+
03
3.722490
E
+
00
HSTL
6.679117
E
+
02
2.123307
E
+
03
6.663690
E
+
03
1.898390
E
+
03
5.447209
E
+
00
F
16
HS
-
2.417986
E
+
02
-
2.316766
E
+
02
-
2.243841
E
+
02
4.720329
E
+
00
3.407872
E
+
00
SGHS
-
1.978875
E
+
02
-
1.657988
E
+
02
-
1.304433
E
+
02
1.954773
E
+
01
5.825132
E
+
00
NGHS
-
2.700495
E
+
02
-
2.575340
E
+
02
-
2.441387
E
+
02
7.491290
E
+
00
3.388501
E
+
00
HSTL
-
3.134902
E
+
02
-
3.059890
E
+
02
-
2.968384
E
+
02
4.108868
E
+
00
5.092343
E
+
00
F
17
HS
-
1.769331
E
+
02
-
1.764810
E
+
02
-
1.760164
E
+
02
2.480479
E
-
01
5.401888
E
+
00
SGHS
-
1.779920
E
+
02
-
1.770352
E
+
02
-
1.750318
E
+
02
8.297157
E
-
01
7.875262
E
+
00
NGHS
-
1.788120
E
+
02
-
1.787740
E
+
02
-
1.787241
E
+
02
2.570359
E
-
02
5.350236
E
+
00
HSTL
-
1.799984
E
+
02
-
1.799963
E
+
02
-
1.799876
E
+
02
3.066164
E
-
03
7.034552
E
+
00
F
18
HS
-
1.365537
E
+
02
-
1.361589
E
+
02
-
1.357947
E
+
02
2.159838
E
-
01
3.742110
E
+
00
SGHS
-
1.369490
E
+
02
-
1.362044
E
+
02
-
1.344587
E
+
02
6.516864
E
-
01
6.201829
E
+
00
NGHS
-
1.385604
E
+
02
-
1.381231
E
+
02
-
1.377560
E
+
02
2.656460
E
-
01
3.702051
E
+
00
HSTL
-
1.399928
E
+
02
-
1.399894
E
+
02
-
1.399455
E
+
02
1.034768
E
-
02
5.419278
E
+
00
F
19
HS
-
1.397521
E
+
03
-
1.360864
E
+
03
-
1.328214
E
+
03
2.038863
E
+
01
1.091921
E
+
01
SGHS
-
1.452010
E
+
03
-
1.426324
E
+
03
-
1.397075
E
+
03
1.631505
E
+
01
1.335878
E
+
01
NGHS
-
1.451444
E
+
03
-
1.428229
E
+
03
-
1.393381
E
+
03
1.340884
E
+
01
1.124146
E
+
01
HSTL
-
1.513615
E
+
03
-
1.499926
E
+
03
-
1.485147
E
+
03
8.517545
E
+
00
1.261544
E
+
01
F
20
HS
1.193796
E
+
02
1.193796
E
+
02
1.193796
E
+
02
1.193796
E
+
02
1.193796
E
+
02
SGHS
9.824839
E
+
01
9.824839
E
+
01
9.824839
E
+
01
9.824839
E
+
01
9.824839
E
+
01
NGHS
3.473853
E
+
01
3.473853
E
+
01
3.473853
E
+
01
3.473853
E
+
01
3.473853
E
+
01
HSTL
6.151721
E
-
02
6.151721
E
-
02
6.151721
E
-
02
6.151721
E
-
02
6.151721
E
-
02
F
21
HS
2.731607
E
+
02
3.018028
E
+
02
3.309987
E
+
02
1.465698
E
+
01
5.400367
E
+
01
SGHS
2.061790
E
+
02
2.668907
E
+
02
3.219105
E
+
02
3.133660
E
+
01
5.782494
E
+
01
NGHS
1.520321
E
+
02
1.848391
E
+
02
2.324962
E
+
02
1.945112
E
+
01
5.352526
E
+
01
HSTL
1.216583
E
+
01
1.522370
E
+
01
1.868875
E
+
01
2.164395
E
+
00
5.544992
E
+
01
F
22
HS
7.035058
E
+
01
7.966205
E
+
01
8.675826
E
+
01
4.501205
E
+
00
3.134446
E
+
01
SGHS
4.845036
E
+
01
7.002079
E
+
01
1.031254
E
+
02
1.472650
E
+
01
3.551839
E
+
01
NGHS
1.890592
E
+
01
2.264589
E
+
01
2.708944
E
+
01
2.757052
E
+
00
3.129377
E
+
01
HSTL
3.312806
E
-
03
4.788330
E
-
01
2.104085
E
+
00
7.191299
E
-
01
3.285056
E
+
01
F
23
HS
2.474923
E
+
02
2.926433
E
+
02
3.154565
E
+
02
1.633700
E
+
01
3.787547
E
+
01
SGHS
2.077105
E
+
02
2.618490
E
+
02
3.486951
E
+
02
3.410635
E
+
01
4.192231
E
+
01
NGHS
1.600018
E
+
02
1.868942
E
+
02
2.193507
E
+
02
1.802714
E
+
01
3.742503
E
+
01
HSTL
1.226995
E
+
01
1.528464
E
+
01
2.013004
E
+
01
2.366879
E
+
00
3.842275
E
+
01
F
24
HS
-
3.539791
E
+
02
-
3.147048
E
+
02
-
2.647908
E
+
02
1.949672
E
+
01
3.449387
E
+
01
SGHS
-
4.095286
E
+
02
-
3.591410
E
+
02
-
2.333805
E
+
02
5.324971
E
+
01
3.871345
E
+
01
NGHS
-
4.493291
E
+
02
-
4.489227
E
+
02
-
4.485923
E
+
02
2.120875
E
-
01
3.486910
E
+
01
HSTL
-
4.499990
E
+
02
-
4.499985
E
+
02
-
4.499980
E
+
02
2.414762
E
-
04
3.688151
E
+
01
F
25
HS
1.051141
E
+
05
1.874186
E
+
05
2.937699
E
+
05
4.432322
E
+
04
3.544980
E
+
01
SGHS
5.004828
E
+
04
6.949195
E
+
05
3.958335
E
+
06
9.272106
E
+
05
3.953879
E
+
01
NGHS
1.111344
E
+
03
1.579429
E
+
03
4.609411
E
+
03
7.698066
E
+
02
3.568522
E
+
01
HSTL
4.768735
E
+
02
8.024700
E
+
02
2.168501
E
+
03
4.225175
E
+
02
3.736183
E
+
01
F
26
HS
-
2.598286
E
+
02
-
2.502187
E
+
02
-
2.401834
E
+
02
5.848484
E
+
00
3.371420
E
+
01
SGHS
-
2.231800
E
+
02
-
1.912732
E
+
02
-
1.659675
E
+
02
1.303039
E
+
01
3.722651
E
+
01
NGHS
-
2.870567
E
+
02
-
2.734730
E
+
02
-
2.629992
E
+
02
5.510929
E
+
00
3.296890
E
+
01
HSTL
-
3.207702
E
+
02
-
3.136777
E
+
02
-
3.092977
E
+
02
2.615418
E
+
00
3.492102
E
+
01
F
27
HS
1.761478
E
+
01
1.978397
E
+
01
2.313474
E
+
01
1.461489
E
+
00
3.122492
E
+
01
SGHS
1.215437
E
+
01
2.186805
E
+
01
3.511913
E
+
01
5.628417
E
+
00
3.560859
E
+
01
NGHS
2.810761
E
+
00
3.983730
E
+
00
4.655769
E
+
00
4.301760
E
-
01
3.140541
E
+
01
HSTL
2.089110
E
-
02
2.831916
E
-
02
5.808363
E
-
02
8.512059
E
-
03
3.310728
E
+
01
F
28
HS
-
4.469079
E
+
02
-
4.443488
E
+
02
-
4.405620
E
+
02
1.967662
E
+
00
4.318177
E
+
01
SGHS
-
4.494424
E
+
02
-
4.483361
E
+
02
-
4.463611
E
+
02
1.058420
E
+
00
4.732766
E
+
01
NGHS
-
4.500000
E
+
02
-
4.500000
E
+
02
-
4.500000
E
+
02
3.611281
E
-
10
4.326785
E
+
01
HSTL
-
4.500000
E
+
02
-
4.500000
E
+
02
-
4.500000
E
+
02
9.511311
E
-
06
4.509948
E
+
01
F
29
HS
6.093107
E
+
03
1.397065
E
+
04
2.184820
E
+
04
1.114053
E
+
04
4.387041
E
+
01
SGHS
8.168591
E
+
03
9.147798
E
+
03
1.012700
E
+
04
1.384807
E
+
03
4.815433
E
+
01
NGHS
6.891292
E
+
02
7.565447
E
+
02
8.239602
E
+
02
9.533993
E
+
01
4.375258
E
+
01
HSTL
4.954684
E
+
02
5.024741
E
+
02
5.094799
E
+
02
9.907604
E
+
00
4.518065
E
+
01
F
30
HS
-
2.708213
E
+
02
-
2.658142
E
+
02
-
2.553643
E
+
02
4.447667
E
+
00
4.291836
E
+
01
SGHS
-
2.498452
E
+
02
-
2.356727
E
+
02
-
2.214623
E
+
02
6.894224
E
+
00
4.714809
E
+
01
NGHS
-
2.967689
E
+
02
-
2.895710
E
+
02
-
2.794822
E
+
02
4.509198
E
+
00
4.315103
E
+
01
HSTL
-
3.281517
E
+
02
-
3.254159
E
+
02
-
3.216770
E
+
02
1.727024
E
+
00
4.476932
E
+
01
F
31
HS
3.744918
E
+
01
4.335719
E
+
01
4.893459
E
+
01
3.361402
E
+
00
3.044300
E
+
01
SGHS
2.842099
E
+
01
4.402938
E
+
01
6.465355
E
+
01
8.002441
E
+
00
3.374892
E
+
01
NGHS
5.436447
E
+
00
8.517679
E
+
00
1.110289
E
+
01
1.334154
E
+
00
2.980321
E
+
01
HSTL
7.377615
E
-
03
8.118152
E
-
02
4.421143
E
-
01
1.112750
E
-
01
3.135758
E
+
01Table 7
The optimization results of four harmony search algorithms forF1–F31 (D = 200, FEs = 500D).
Function
Algorithm
Best
Mean
Worst
STD
Runtime
F
1
HS
4.603726
E
+
00
4.929354
E
+
00
5.266226
E
+
00
1.613707
E
-
01
5.715312
E
+
00
SGHS
4.421737
E
+
00
5.637606
E
+
00
7.262746
E
+
00
8.839935
E
-
01
1.138709
E
+
01
NGHS
5.145771
E
+
00
5.521262
E
+
00
5.794585
E
+
00
1.715834
E
-
01
5.721544
E
+
00
HSTL
3.575306
E
-
03
4.026710
E
-
03
4.538061
E
-
03
2.396758
E
-
04
8.701444
E
+
00
F
2
HS
4.078042
E
+
03
6.153632
E
+
03
8.488061
E
+
03
1.312734
E
+
03
4.147045
E
+
00
SGHS
7.148166
E
+
03
3.459359
E
+
04
1.047654
E
+
05
2.687689
E
+
04
9.907156
E
+
00
NGHS
2.696362
E
+
03
4.466500
E
+
03
5.439083
E
+
03
6.579299
E
+
02
4.042910
E
+
00
HSTL
6.688204
E
-
01
9.705961
E
+
00
5.070641
E
+
01
1.456647
E
+
01
7.049820
E
+
00
F
3
HS
9.161714
E
+
00
1.244639
E
+
01
1.459380
E
+
01
1.320806
E
+
00
6.456437
E
+
00
SGHS
8.285825
E
+
00
1.792049
E
+
01
5.102385
E
+
01
9.342384
E
+
00
1.205154
E
+
01
NGHS
1.653665
E
+
01
1.945936
E
+
01
2.288375
E
+
01
1.916412
E
+
00
6.373141
E
+
00
HSTL
3.399743
E
-
04
1.932473
E
-
03
2.008061
E
-
02
4.825732
E
-
03
9.435844
E
+
00
F
4
HS
3.848564
E
+
00
4.708132
E
+
00
5.294488
E
+
00
3.531660
E
-
01
1.828390
E
+
01
SGHS
4.320375
E
+
01
6.698858
E
+
01
9.905690
E
+
01
1.803405
E
+
01
2.448338
E
+
01
NGHS
7.186447
E
+
00
8.321538
E
+
00
9.657602
E
+
00
6.923441
E
-
01
1.812159
E
+
01
HSTL
3.729585
E
-
02
1.541456
E
-
01
2.844556
E
-
01
7.373455
E
-
02
2.201131
E
+
01
F
5
HS
-
9.228155
E
+
01
-
8.912511
E
+
01
-
8.545813
E
+
01
2.196104
E
+
00
1.075750
E
+
01
SGHS
-
1.691553
E
+
02
-
1.632416
E
+
02
-
1.554168
E
+
02
4.230945
E
+
00
1.607256
E
+
01
NGHS
-
1.266981
E
+
02
-
1.212701
E
+
02
-
1.165799
E
+
02
2.487909
E
+
00
1.057139
E
+
01
HSTL
-
1.879057
E
+
02
-
1.859165
E
+
02
-
1.841057
E
+
02
9.032725
E
-
01
1.379854
E
+
01
F
6
HS
1.059685
E
+
02
1.605423
E
+
02
2.171595
E
+
02
3.043869
E
+
01
1.913746
E
+
01
SGHS
2.877414
E
+
02
5.597265
E
+
02
1.076033
E
+
03
1.825775
E
+
02
2.544270
E
+
01
NGHS
1.476215
E
+
02
1.815020
E
+
02
2.722819
E
+
02
2.829572
E
+
01
1.891687
E
+
01
HSTL
4.134323
E
-
01
8.303796
E
-
01
1.245398
E
+
00
1.952532
E
-
01
2.286965
E
+
01
F
7
HS
3.049237
E
+
02
3.272066
E
+
02
3.630817
E
+
02
1.403316
E
+
01
5.018255
E
+
00
SGHS
3.796419
E
+
02
4.822636
E
+
02
5.650928
E
+
02
4.455035
E
+
01
1.075236
E
+
01
NGHS
4.522705
E
+
02
5.209768
E
+
02
5.738802
E
+
02
3.656850
E
+
01
4.953818
E
+
00
HSTL
1.658281
E
-
03
1.295575
E
+
00
3.005119
E
+
00
1.058554
E
+
00
7.836046
E
+
00
F
8
HS
3.896266
E
+
03
5.289774
E
+
03
7.844040
E
+
03
1.015647
E
+
03
4.297905
E
+
00
SGHS
6.818663
E
+
03
1.570204
E
+
04
2.975647
E
+
04
8.010501
E
+
03
1.001014
E
+
01
NGHS
3.307225
E
+
03
4.050635
E
+
03
5.045072
E
+
03
4.439356
E
+
02
4.207027
E
+
00
HSTL
1.929455
E
+
02
2.304209
E
+
02
3.286657
E
+
02
4.180170
E
+
01
7.172235
E
+
00
F
9
HS
3.233837
E
+
03
3.714921
E
+
03
4.247033
E
+
03
2.604085
E
+
02
5.199977
E
+
00
SGHS
1.175294
E
+
04
1.460607
E
+
04
1.810298
E
+
04
1.831608
E
+
03
1.119387
E
+
01
NGHS
1.228090
E
+
04
1.400627
E
+
04
1.550115
E
+
04
8.852628
E
+
02
5.119688
E
+
00
HSTL
1.550538
E
+
03
1.951142
E
+
03
2.716798
E
+
03
3.492572
E
+
02
8.289662
E
+
00
F
10
HS
1.035974
E
+
03
1.224840
E
+
03
1.408721
E
+
03
9.946126
E
+
01
4.635011
E
+
00
SGHS
9.842122
E
+
02
1.758492
E
+
03
3.754911
E
+
03
7.377144
E
+
02
1.040168
E
+
01
NGHS
1.861439
E
+
03
2.058453
E
+
03
2.504462
E
+
03
1.837061
E
+
02
4.467012
E
+
00
HSTL
1.314733
E
-
03
1.760664
E
-
03
2.393748
E
-
03
2.837635
E
-
04
7.936856
E
+
00
F
11
HS
3.073770
E
+
08
5.529318
E
+
08
7.578658
E
+
08
1.318618
E
+
08
5.023786
E
+
00
SGHS
8.707673
E
+
08
1.161818
E
+
09
1.767454
E
+
09
2.629050
E
+
08
1.075328
E
+
01
NGHS
7.093037
E
+
08
9.105403
E
+
08
1.190901
E
+
09
1.208984
E
+
08
4.824641
E
+
00
HSTL
2.965758
E
+
07
8.970849
E
+
07
1.931661
E
+
08
3.740898
E
+
07
8.290714
E
+
00
F
12
HS
2.178914
E
+
03
2.482882
E
+
03
2.815688
E
+
03
1.988376
E
+
02
4.845730
E
+
00
SGHS
2.308245
E
+
03
2.584773
E
+
03
2.953531
E
+
03
2.051620
E
+
02
1.019302
E
+
01
NGHS
9.284727
E
+
02
1.072448
E
+
03
1.250569
E
+
03
9.258004
E
+
01
4.699592
E
+
00
HSTL
1.938323
E
+
03
2.308801
E
+
03
2.714633
E
+
03
1.905069
E
+
02
8.051031
E
+
00
F
13
HS
4.977364
E
+
02
8.339352
E
+
02
1.058941
E
+
03
1.248060
E
+
02
8.006508
E
+
00
SGHS
2.137557
E
+
02
1.083748
E
+
03
2.437995
E
+
03
5.816088
E
+
02
1.404649
E
+
01
NGHS
1.392416
E
+
03
1.708667
E
+
03
1.994529
E
+
03
1.697142
E
+
02
7.789651
E
+
00
HSTL
-
3.915048
E
+
02
-
3.394840
E
+
02
-
2.719662
E
+
02
2.748671
E
+
01
1.184497
E
+
01
F
14
HS
-
4.084859
E
+
02
-
4.048983
E
+
02
-
3.994353
E
+
02
2.724485
E
+
00
8.170102
E
+
00
SGHS
-
3.756669
E
+
02
-
3.637827
E
+
02
-
3.512079
E
+
02
6.398155
E
+
00
1.406004
E
+
01
NGHS
-
4.248494
E
+
02
-
4.217489
E
+
02
-
4.171032
E
+
02
1.942003
E
+
00
7.962233
E
+
00
HSTL
-
4.078666
E
+
02
-
4.041830
E
+
02
-
4.006726
E
+
02
1.886381
E
+
00
1.207676
E
+
01
F
15
HS
2.261680
E
+
06
4.109099
E
+
06
5.954376
E
+
06
9.167839
E
+
05
9.762151
E
+
00
SGHS
6.929055
E
+
06
5.330388
E
+
07
2.498381
E
+
08
5.898978
E
+
07
1.596695
E
+
01
NGHS
5.823986
E
+
06
7.816998
E
+
06
1.131635
E
+
07
1.505165
E
+
06
9.593909
E
+
00
HSTL
2.775018
E
+
05
5.853541
E
+
05
9.776046
E
+
05
2.019841
E
+
05
1.376301
E
+
01
F
16
HS
-
2.948123
E
+
01
-
5.791258
E
-
01
1.683795
E
+
01
1.195259
E
+
01
9.144801
E
+
00
SGHS
7.067304
E
+
01
1.786652
E
+
02
2.626093
E
+
02
5.419678
E
+
01
1.508770
E
+
01
NGHS
1.593170
E
+
02
1.986273
E
+
02
2.485464
E
+
02
2.374692
E
+
01
8.921733
E
+
00
HSTL
-
2.547415
E
+
02
-
2.353550
E
+
02
-
2.151499
E
+
02
9.688531
E
+
00
1.285946
E
+
01
F
17
HS
-
1.685846
E
+
02
-
1.671598
E
+
02
-
1.654225
E
+
02
8.709843
E
-
01
1.678058
E
+
01
SGHS
-
1.751726
E
+
02
-
1.626560
E
+
02
-
1.461760
E
+
02
7.197573
E
+
00
2.278318
E
+
01
NGHS
-
1.634951
E
+
02
-
1.604326
E
+
02
-
1.574177
E
+
02
1.704898
E
+
00
1.650759
E
+
01
HSTL
-
1.783495
E
+
02
-
1.781095
E
+
02
-
1.778417
E
+
02
1.456349
E
-
01
2.036008
E
+
01
F
18
HS
-
1.354532
E
+
02
-
1.350248
E
+
02
-
1.346804
E
+
02
1.775738
E
-
01
9.748667
E
+
00
SGHS
-
1.341637
E
+
02
-
1.319425
E
+
02
-
1.279421
E
+
02
1.937096
E
+
00
1.586162
E
+
01
NGHS
-
1.348232
E
+
02
-
1.344521
E
+
02
-
1.342897
E
+
02
1.505267
E
-
01
9.520511
E
+
00
HSTL
-
1.385641
E
+
02
-
1.382701
E
+
02
-
1.380733
E
+
02
1.368319
E
-
01
1.358972
E
+
01
F
19
HS
-
2.603380
E
+
03
-
2.531804
E
+
03
-
2.473751
E
+
03
3.179450
E
+
01
2.876496
E
+
01
SGHS
-
2.721608
E
+
03
-
2.665352
E
+
03
-
2.578190
E
+
03
3.671259
E
+
01
3.458217
E
+
01
NGHS
-
2.581654
E
+
03
-
2.492258
E
+
03
-
2.446278
E
+
03
3.258052
E
+
01
2.814525
E
+
01
HSTL
-
2.929585
E
+
03
-
2.904859
E
+
03
-
2.882272
E
+
03
1.460064
E
+
01
3.221904
E
+
01
F
20
HS
9.189454
E
+
02
5.077136
E
+
27
1.015427
E
+
29
2.270564
E
+
28
5.038898
E
+
00
SGHS
5.059004
E
+
02
8.779452
E
+
02
1.348477
E
+
03
1.953273
E
+
02
1.104361
E
+
01
NGHS
1.246908
E
+
03
2.028307
E
+
03
2.888645
E
+
03
4.719852
E
+
02
5.148672
E
+
00
HSTL
1.837030
E
-
01
2.280353
E
-
01
2.673117
E
-
01
2.164823
E
-
02
8.886787
E
+
00
F
21
HS
6.377972
E
+
02
6.978627
E
+
02
7.582129
E
+
02
3.386564
E
+
01
1.646089
E
+
02
SGHS
6.320206
E
+
02
7.707349
E
+
02
8.819430
E
+
02
5.316649
E
+
01
1.737214
E
+
02
NGHS
7.097658
E
+
02
7.856465
E
+
02
8.525136
E
+
02
4.013482
E
+
01
1.646784
E
+
02
HSTL
9.040644
E
+
01
9.986598
E
+
01
1.162748
E
+
02
6.666442
E
+
00
1.696227
E
+
02
F
22
HS
2.143132
E
+
02
2.280396
E
+
02
2.618505
E
+
02
1.143029
E
+
01
7.711841
E
+
01
SGHS
1.576182
E
+
02
2.361854
E
+
02
4.033144
E
+
02
5.873130
E
+
01
8.653562
E
+
01
NGHS
2.229408
E
+
02
2.658819
E
+
02
2.931895
E
+
02
1.367509
E
+
01
7.686817
E
+
01
HSTL
9.638521
E
+
00
1.807740
E
+
01
2.585962
E
+
01
3.506528
E
+
00
8.063761
E
+
01
F
23
HS
6.234643
E
+
02
6.947096
E
+
02
7.419847
E
+
02
3.350395
E
+
01
1.019985
E
+
02
SGHS
6.526572
E
+
02
7.693093
E
+
02
8.338596
E
+
02
4.956235
E
+
01
1.112867
E
+
02
NGHS
6.898719
E
+
02
7.661332
E
+
02
8.566126
E
+
02
4.173909
E
+
01
1.018226
E
+
02
HSTL
8.482421
E
+
01
9.938394
E
+
01
1.108417
E
+
02
8.042784
E
+
00
1.054352
E
+
02
F
24
HS
4.553252
E
+
01
2.076506
E
+
02
4.542336
E
+
02
1.063305
E
+
02
8.318836
E
+
01
SGHS
-
2.939057
E
+
02
7.490397
E
+
01
6.242859
E
+
02
3.186816
E
+
02
9.254373
E
+
01
NGHS
-
2.373270
E
+
02
-
1.728535
E
+
02
-
9.543890
E
+
01
4.073554
E
+
01
8.306743
E
+
01
HSTL
-
4.499950
E
+
02
-
4.499933
E
+
02
-
4.499913
E
+
02
9.985585
E
-
04
8.722270
E
+
01
F
25
HS
7.366636
E
+
05
1.041736
E
+
06
1.399154
E
+
06
1.825535
E
+
05
8.464179
E
+
01
SGHS
8.054915
E
+
05
1.228918
E
+
07
4.659116
E
+
07
1.341661
E
+
07
9.395835
E
+
01
NGHS
1.559065
E
+
05
2.605101
E
+
05
3.969066
E
+
05
6.581579
E
+
04
8.432677
E
+
01
HSTL
1.448330
E
+
03
4.054597
E
+
03
9.585072
E
+
03
2.811645
E
+
03
8.853785
E
+
01
F
26
HS
-
8.620111
E
+
01
-
6.877671
E
+
01
-
4.175610
E
+
01
1.198860
E
+
01
8.370164
E
+
01
SGHS
3.837488
E
+
01
9.840901
E
+
01
2.221608
E
+
02
5.104657
E
+
01
9.300928
E
+
01
NGHS
-
1.214266
E
+
01
7.757135
E
+
00
3.280678
E
+
01
1.408601
E
+
01
8.382478
E
+
01
HSTL
-
2.834421
E
+
02
-
2.731218
E
+
02
-
2.591557
E
+
02
6.993937
E
+
00
8.785385
E
+
01
F
27
HS
6.017485
E
+
01
6.526806
E
+
01
7.041752
E
+
01
2.646571
E
+
00
8.031504
E
+
01
SGHS
8.524694
E
+
01
1.156612
E
+
02
1.717014
E
+
02
2.490438
E
+
01
8.958076
E
+
01
NGHS
5.648135
E
+
01
6.439351
E
+
01
7.123722
E
+
01
4.693589
E
+
00
7.798441
E
+
01
HSTL
2.094078
E
+
00
2.833941
E
+
00
4.047095
E
+
00
5.585953
E
-
01
8.093007
E
+
01
F
28
HS
-
4.289935
E
+
02
-
4.211903
E
+
02
-
4.163227
E
+
02
3.623053
E
+
00
1.249831
E
+
02
SGHS
-
4.488077
E
+
02
-
4.432399
E
+
02
-
4.317460
E
+
02
4.446639
E
+
00
1.353388
E
+
02
NGHS
-
4.499999
E
+
02
-
4.499997
E
+
02
-
4.499995
E
+
02
9.834457
E
-
05
1.265239
E
+
02
HSTL
-
4.500000
E
+
02
-
4.499999
E
+
02
-
4.499999
E
+
02
2.351848
E
-
05
1.325924
E
+
02
F
29
HS
2.233712
E
+
04
3.892963
E
+
04
5.633712
E
+
04
9.226538
E
+
03
1.300818
E
+
02
SGHS
5.525834
E
+
03
2.751029
E
+
05
2.276536
E
+
06
5.361823
E
+
05
1.405805
E
+
02
NGHS
1.510576
E
+
03
2.042038
E
+
03
6.840093
E
+
03
1.160782
E
+
03
1.305521
E
+
02
HSTL
4.888426
E
+
02
1.232585
E
+
03
5.838617
E
+
03
1.452099
E
+
03
1.351203
E
+
02
F
30
HS
-
1.772284
E
+
02
-
1.610854
E
+
02
-
1.510294
E
+
02
6.803769
E
+
00
1.289660
E
+
02
SGHS
-
9.536516
E
+
01
-
6.623147
E
+
01
-
3.230639
E
+
01
1.639332
E
+
01
1.391979
E
+
02
NGHS
-
1.574155
E
+
02
-
1.463189
E
+
02
-
1.301902
E
+
02
7.514495
E
+
00
1.291356
E
+
02
HSTL
-
3.201694
E
+
02
-
3.156785
E
+
02
-
3.090753
E
+
02
3.220219
E
+
00
1.337009
E
+
02
F
31
HS
1.212613
E
+
02
1.318822
E
+
02
1.410318
E
+
02
5.212928
E
+
00
8.330888
E
+
01
SGHS
1.123687
E
+
02
1.636391
E
+
02
1.993816
E
+
02
2.540267
E
+
01
9.407166
E
+
01
NGHS
1.189049
E
+
02
1.313797
E
+
02
1.457549
E
+
02
6.404969
E
+
00
8.467554
E
+
01
HSTL
4.403576
E
+
00
7.020892
E
+
00
1.210083
E
+
01
1.807576
E
+
00
8.733987
E
+
01The convergence of HSTL method is compared with three other HS algorithms: HS, SGHS, and NGHS on 50-D functions F3, F10, and F27, where the HSTL algorithm demonstrates an evident superiority on efficiency and stability, which can be observed from the convergence graphs (Figures 2(a) and 4(a)) and boxplots (Figures 2(b) and 4(b)).Convergence graph and boxplot for sphere function (F10) on D=50.
(a)
(b)For 50-D problems, the convergence graphs and the boxplots are shown in Figures 2, 3, and 4 on 50-D for sphere unimodal function, griewank multimodal inseparable function, and hybrid function, Hybrid5, which is composed of Bohachevsky and Schwefel2.22 function, where Figures 2(b) and 4(b) plot the boxplots of best results in 30 independent runs. Figures 2(a) and 4(a) portray the convergence curves. It is evident from the convergence graphs that strongly uniform convergence can be maintained throughout the procedure of evolution. From the boxplots we can see that the HSTL algorithm has better convergence, stability, and robustness in most cases than HS, SGHS, and NGHS algorithms.Convergence graph and boxplot for Griewank function (F4) on D=50.
(a)
(b)Convergence graph and boxplot for hybrid 15 function (F27) on D=50.
(a)
(b)Figures5 and 6 show the boxplots and convergence graphs of 3 different problems for dimensions equal to 100 and 200, respectively, where HSTL algorithm demonstrates obvious superiority on efficiency and stability.Convergence graphs and boxplots for functions Rastrigin, Schwefel, and hybrid 19 new onD=100.
(a)
(b)
(c)
(d)
(e)
(f)Convergence graphs and boxplots for shift functions Ackley, fast fractal double, and hybrid 14 onD=200.
(a)
(b)
(c)
(d)
(e)
(f)


## 4.4. Comparison of the Convergence Speed and Success Rate

In order to give a fair chance to 4 HS algorithm (HS, SGHS, NGHS, and HSTL) compared. We run each algorithm on each benchmark test function and stop as soon as the minimum error value acquired by the algorithm falls below the predefined threshold or a maximum number of FEs is exceeded. For all test functions, the algorithms carry out 30 independent runs.The respective thresholds values of the error for 30 benchmark problems are in Table11.Table8 displays the statistics results about the success rate, average runtime, and average FEs of  F1–F30.Table 8
The success rate, mean runtime, and FEs for functionF1–F19, F21–F31.
Function
Algorithm
F
1
F
2
F
3
F
4
F
5
F
6
F
7
F
8
F
9
F
10
Success rate (SR)
HS
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
SGHS
0%
0%
0%
0%
60%
0%
0%
0%
0%
0%
NGHS
0%
0%
0%
0%
0%
0%
0%
45%
15%
0%
HSTL
100%
100%
95%
100%
100%
100%
100%
100%
100%
100%
Mean runtime (s)
HS
19
14
21
50
31
48
15
14
17
16
SGHS
39
34
41
73
40
72
36
35
39
37
NGHS
18
13
20
49
30
48
14
11
16
16
HSTL
20
10
21
48
26
46
18
4
14
19
Mean FEs
HS
500000
500000
500000
500000
500000
500000
500000
500000
500000
500000
SGHS
500000
500000
500000
500000
397181
500000
500000
500000
500000
500000
NGHS
500000
500000
500000
500000
500000
500000
500000
425302
497089
500000
HSTL
475167
291492
452830
450158
386120
443818
482502
105551
332693
483873
Function
Algorithm
F
11
F
12
F
13
F
14
F
15
F
16
F
17
F
18
F
19
F
2
1
Success rate (SR)
HS
70%
45%
0%
0%
0%
0%
0%
0%
0%
0%
SGHS
0%
0%
0%
0%
65%
0%
0%
0%
0%
0%
NGHS
75%
100%
0%
0%
90%
15%
0%
0%
0%
0%
HSTL
100%
100%
90%
100%
100%
85%
90%
100%
80%
100%
Mean runtime (s)
HS
8
13
32
32
38
34
55
38
88
527
SGHS
35
34
55
54
39
56
78
60
114
570
NGHS
9
3
31
31
8
32
54
36
92
525
HSTL
5
9
36
31
18
34
51
32
81
467
Mean Fes
HS
264713
471826
500000
500000
500000
500000
500000
500000
500000
500000
SGHS
500000
500000
500000
500000
323631
500000
500000
500000
500000
500000
NGHS
335021
107386
500000
500000
114380
485463
500000
500000
500000
500000
HSTL
122555
240403
494888
418223
206975
437342
488064
434498
415872
445225
Function
Algorithm
F
2
2
F
2
3
F
2
4
F
2
5
F
2
6
F
2
7
F
2
8
F
2
9
F
30
F
3
1
Success rate (SR)
HS
0%
0%
0%
0%
100%
0%
0%
0%
0%
0%
SGHS
0%
0%
0%
0%
95%
0%
100%
0%
0%
0%
NGHS
0%
0%
0%
0%
100%
0%
100%
25%
0%
0%
HSTL
100%
50%
0%
100%
100%
100%
100%
60%
100%
100%
Mean runtime (s)
HS
289
373
359
364
35
310
453
441
436
312
SGHS
329
416
400
406
133
351
337
476
477
351
NGHS
293
374
360
366
22
310
13
382
437
317
HSTL
273
375
363
271
46
311
104
363
364
273
Mean Fes
HS
500000
500000
500000
500000
54677
500000
500000
500000
500000
500000
SGHS
500000
500000
500000
500000
181162
500000
341216
500000
500000
500000
NGHS
500000
500000
500000
500000
33331
500000
14644
451443
500000
500000
HSTL
459671
497514
500000
367442
85659
500000
132414
432651
415004
429027As Table8 shows, for a high-dimensional problem (D=100), the HS, SGHS, and NGHS have great difficulty in finding the global optima on all problems. The HSTL yields 100% success rate for F1, F2, F4–F11, F14, F15, F18, F20, F21, F24, F26, F29, F30. The HSTL algorithm performs much better with success rates of 100% on most problems, and over 50% on F3, F13, F16, F17, F19, F22, and F28 where other algorithms fail in finding the global optima.Table9 illustrates the costing run of 4 HS algorithm for F1–F31. The runtime is equal to the average value of all functions mean runtime; the FEs is equal to the average value of all functions mean FEs; the Success Rate is equal to the mean value of the success rate of all functions. In Table 9, we intend to show how well the presented HSTL algorithm performs when compared to HS, SGHS and NGHS algorithm. From the statistics shown in Table 9 can be seen that HSTL uses the least runtime and FEs, and acquires the best success rate among these algorithms on over performances.Table 9
The average runtime, average FEs, average success rate, and costing run of all functions.
Algorithm
Average runtime (ART)
Average FEs (AFE)
Average success rate (ASR)
HS
145.1399
477136
0.069355
SGHS
169.5528
475586.8
0.103226
NGHS
127.2487
434324.5
0.182258
HSTL
120.8951
384181.3
0.919355
WhereART=∑i=131runtimei, AFE=∑i=131FEsi, ASR=∑i=131SRi.


## 4.5. Convergence Analysis

To investigate the convergence of proposed HSTL algorithm, we record the population variance of each algorithm. As Figure7 shows, for each type function, the fluctuation of population variance in HSTL is smaller than the fluctuation of population variance in SGHS and NGHS algorithm, and the population variance graphs fall steadily throughout the search process. As a consequence, the proposed HSTL algorithm has stronger robustness and convergence than other variants of HS.The population variance graphs.
(a)
(b)
(c)
(d)


## 4.6. Parameter HMS Study

In this section, the effect of HMS value on the performance of the HSTL method is investigated. The experimental results generated by using different HMS values (5, 10, 15, 20, 25, 30, 35, and 40) for dimensions equal to 50 are demonstrated in Table10, respectively.Table 10
The effect of HMS on the performance of the HSTL algorithm (D = 50, FEs = 25000).
HMS
F
1
F
2
F
3
F
4
F
5
F
6
F
7
F
8
F
9
F
10
5
7.02
E
-
06
1.28
E
+
00
5.30
E
-
03
1.12
E
-
06
-
4.82
E
+
01
3.23
E
-
03
4.97
E
-
02
7.23
E
+
01
1.36
E
-
03
1.36
E
-
03
10
2.10
E
-
05
8.84
E
-
01
2.71
E
-
03
1.26
E
-
06
-
4.82
E
+
01
4.83
E
-
03
7.11
E
-
10
4.39
E
+
01
1.14
E
-
03
4.92
E
-
08
15
6.98
E
-
05
7.11
E
-
01
4.94
E
-
04
1.29
E
-
06
-
4.83
E
+
01
6.93
E
-
03
7.66
E
-
09
4.35
E
+
01
1.06
E
-
03
2.19
E
-
07
20
1.03
E
-
04
7.07
E
-
01
8.64
E
-
04
1.58
E
-
06
-
4.85
E
+
01
9.06
E
-
03
4.44
E
-
08
4.16
E
+
01
1.16
E
-
03
3.70
E
-
07
25
1.40
E
-
04
7.23
E
-
01
2.23
E
-
03
1.47
E
-
06
-
4.80
E
+
01
1.17
E
-
02
7.97
E
-
08
4.55
E
+
01
1.27
E
-
03
8.60
E
-
07
30
2.05
E
-
04
7.72
E
-
01
1.82
E
-
06
1.90
E
-
06
-
4.81
E
+
01
1.46
E
-
02
3.07
E
-
07
4.39
E
+
01
1.14
E
-
03
1.78
E
-
06
35
2.85
E
-
04
7.03
E
-
01
2.21
E
-
06
1.69
E
-
06
-
4.82
E
+
01
1.61
E
-
02
4.45
E
-
07
4.37
E
+
01
1.09
E
-
03
2.54
E
-
06
40
3.81
E
-
04
7.49
E
-
01
3.34
E
-
06
2.00
E
-
06
-
4.85
E
+
01
1.97
E
-
02
6.64
E
-
07
4.46
E
+
01
1.22
E
-
03
3.88
E
-
06
HMS
F
11
F
12
F
13
F
14
F
15
F
16
F
17
F
18
F
19
F
20
05
7.97
E
+
03
3.57
E
+
00
-
4.50
E
+
02
-
4.50
E
+
02
6.45
E
+
02
-
3.24
E
+
02
-
1.80
E
+
02
-
1.39
E
+
02
-
8.04
E
+
02
9.41
E
+
00
10
2.13
E
+
04
2.72
E
+
01
-
4.50
E
+
02
-
4.50
E
+
02
5.21
E
+
02
-
3.24
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.03
E
+
02
5.08
E
+
00
15
1.80
E
+
04
3.40
E
+
01
-
4.50
E
+
02
-
4.50
E
+
02
6.78
E
+
02
-
3.24
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.08
E
+
02
4.10
E
+
00
20
1.82
E
+
04
3.93
E
+
01
-
4.50
E
+
02
-
4.49
E
+
02
5.96
E
+
02
-
3.25
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.10
E
+
02
4.20
E
+
00
25
9.80
E
+
03
5.43
E
+
01
-
4.50
E
+
02
-
4.48
E
+
02
5.19
E
+
02
-
3.24
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.10
E
+
02
4.27
E
+
00
30
2.18
E
+
04
6.84
E
+
01
-
4.50
E
+
02
-
4.47
E
+
02
5.33
E
+
02
-
3.25
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.11
E
+
02
4.33
E
+
00
35
1.46
E
+
04
9.77
E
+
01
-
4.50
E
+
02
-
4.46
E
+
02
8.04
E
+
02
-
3.26
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.11
E
+
02
4.24
E
+
00
40
1.24
E
+
04
1.18
E
+
02
-
4.50
E
+
02
-
4.44
E
+
02
8.18
E
+
02
-
3.26
E
+
02
-
1.80
E
+
02
-
1.40
E
+
02
-
8.10
E
+
02
4.29
E
+
00
HMS
F
21
F
22
F
23
F
24
F
25
F
26
F
27
F
28
F
29
F
3
0
05
2.02
E
-
01
9.64
E
+
00
-
4.50
E
+
02
4.74
E
+
02
-
3.26
E
+
02
5.05
E
-
03
-
4.50
E
+
02
6.01
E
+
02
-
3.29
E
+
02
1.50
E
-
03
10
6.50
E
-
02
5.27
E
+
00
-
4.50
E
+
02
4.71
E
+
02
-
3.26
E
+
02
4.96
E
-
03
-
4.50
E
+
02
7.29
E
+
02
-
3.28
E
+
02
1.41
E
-
03
15
7.34
E
-
02
4.40
E
+
00
-
4.50
E
+
02
4.70
E
+
02
-
3.27
E
+
02
4.86
E
-
03
-
4.50
E
+
02
4.19
E
+
02
-
3.29
E
+
02
2.21
E
-
02
20
5.28
E
-
02
4.27
E
+
00
-
4.50
E
+
02
4.96
E
+
02
-
3.26
E
+
02
5.08
E
-
03
-
4.50
E
+
02
4.26
E
+
02
-
3.29
E
+
02
1.25
E
-
03
25
3.54
E
-
04
4.06
E
+
00
-
4.50
E
+
02
4.93
E
+
02
-
3.26
E
+
02
5.37
E
-
03
-
4.50
E
+
02
9.77
E
+
02
-
3.29
E
+
02
1.53
E
-
03
30
3.34
E
-
04
3.80
E
+
00
-
4.50
E
+
02
4.91
E
+
02
-
3.27
E
+
02
5.22
E
-
03
-
4.50
E
+
02
6.57
E
+
02
-
3.29
E
+
02
1.39
E
-
03
35
4.41
E
-
04
4.06
E
+
00
-
4.50
E
+
02
4.93
E
+
02
-
3.27
E
+
02
5.16
E
-
03
-
4.50
E
+
02
5.06
E
+
02
-
3.29
E
+
02
1.61
E
-
03
40
3.65
E
-
04
4.06
E
+
00
-
4.50
E
+
02
4.86
E
+
02
-
3.27
E
+
02
5.40
E
-
03
-
4.50
E
+
02
8.34
E
+
02
-
3.29
E
+
02
1.45
E
-
03Table 11
F
1~F10:
1.0
E
-
05
1.0
E
+
00
1.0
E
-
05
1.0
E
-
05
5.0
E
+
00
1.0
E
-
02
1.0
E
-
10
2
D
1.0
E
+
00
1.0
E
-
10
F
11~F20:
2
D
E
+
04
D
1.0
E
-
04
1.0
E
-
01
50
D
1.0
E
+
00
1.0
E
-
04
1.0
E
-
02
1.0
E
+
00
1.0
E
+
01
F
21~F30:
1.0
E
-
03
1.0
E
+
01
1.0
E
-
04
2
D
2
D
1.0
E
-
02
1.0
E
-
05
D
1.0
E
+
00
1.0
E
-
02We can see from Table10, in which there are some unimodal functions (i.e., F10–F14, F23), a small value of HMS (i.e., 5 or 10) is superior to a large value. For other benchmark functions, there is no obvious indication that one setting value of HMS is superior to the other setting values. Therefore, we can think that, a small HMS is suitable for a simple problem. However, for some complex problems, we can set slightly more HMS that is not exceeding 50. It is reasonable and logical, for it is similar to the quickly memory of musician for a simple harmony improvisation and the depth memory of musician for an outstanding harmony improvisation.


## 5. Conclusion

In this paper, a novel harmony search combined teaching-learning (HSTL) algorithm is presented to improve the performance and efficiency of the harmony search algorithm. The proposed HSTL algorithm employs the idea of teaching and learning. Four strategies (harmony memory consideration, teaching-learning strategy, local pitch adjusting, and random mutation) are employed to maintain the proper balance between convergence and population diversity. With the process of evolution, the dynamic strategy is adopted to change the parameters HMCR, TLP, BW, and PAR. Numerical experiments show that the dynamic changes of parameters are especially effective in balance between the exploration power and the exploitation power. The population variance analysis indicated that the HSTL algorithm has strong convergence throughout evolution progresses. The sensitivity analysis of HMS parameter showed that it does not have significant influence on complex multimodal problems.We have compared the performance of proposed HSTL algorithm with the classical HS algorithm and two excellent variant algorithms over a suite of 31 unconstrained numerical optimization functions and evidently concluded that HSTL algorithm is more effective and stable in obtaining high quality solutions and has less FEs, less runtime, and higher success rates under the same conditions.



---

*Source: 413565-2013-03-21.xml*