# Modified Biogeography-Based Optimization with Local Search Mechanism

Authors: Quanxi Feng; Sanyang Liu; Qunying Wu; GuoQiang Tang; Haomin Zhang; Huazhou Chen
Journal: Journal of Applied Mathematics
 (2013)

---

## Abstract

Biogeography-based optimization (BBO) is a new effective population optimization algorithm based on the biogeography theory with inherently insufficient exploration capability. To address this limitation, we proposed a modified BBO with local search mechanism (denoted as MLBBO). In MLBBO, a modified migration operator is integrated into BBO, which can adopt more information from other habitats, to enhance the exploration ability. Then, a local search mechanism is used in BBO to supplement with modified migration operator. Extensive experimental tests are conducted on 27 benchmark functions to show the effectiveness of the proposed algorithm. The simulation results have been compared with original BBO, DE, improved BBO algorithms, and other evolutionary algorithms. Finally, the performance of the modified migration operator and local search mechanism are also discussed.


---

## Body

## 1. Introduction

In practical application, many problems are regarded as optimization problems. Several effective techniques have been developed for solving optimization problems. Traditional techniques [1, 2] are effective methods for solving these problems, but they need to know the property of problems, such as continuity or differentiability. In the past few decades, various evolutionary algorithms have been sprung up for solving complex optimization problems, for example, genetic algorithm (GA) [3], evolutionary programming (EP) [4], particle swarm optimization (PSO) [5], Ant Colony optimization (ACO) [6], differential evolution (DE) [7], and biogeography-based optimization (BBO) [8]. Compared with traditional techniques, evolutionary algorithms can solve optimization problems without using some information such as differentiability.Biogeography-based optimization (BBO), proposed by Simon [8], is a new entrant in the domain of global optimization based on the theory of biogeography. BBO is developed through simulating the emigration and immigration of species between habitats in the multidimensional solution space, where each habitat represents a candidate solution. Just as species, in biogeography, migrate back and forth between habitats, features in candidate solutions are shared between solutions through migration operator. Good solutions tend to share their features with poor solutions. However, these features, in the origin good solution, may exist in several solutions, both good and poor solutions, which may weaken exploration ability.Several scholars have been working for enhancing the exploration ability. To mention just a few examples, Gong et al. [9] presented a real-coded BBO (RCBBO) for continuous optimization problem through the use of real code to represent the candidate solution and integration mutation operator to improve the population diversity. Cai et al. [10] proposed hybrid BBO (BBO-EP) by combing evolutionary programming with BBO. Boussaïd et al. [11] used BBO and DE to update the population alternately and gave a two-stage algorithm (DBBO). Ergezer et al. [12] employed opposition-based learning alongside BBO and developed oppositional BBO (OBBO). Ma et al. [13] incorporated resampling technique into BBO for solving optimization problems under noisy environments. Lohokare et al. [14] proposed a new variant of BBO, called aBBOmDE. In the proposed algorithm, a modified mutation operator and clear duplicate operators are used to accelerate convergence speed, and the modified DE (mDE) is embeded as a neighborhood search operator to improve the fitness. Gong et al. [15] combined the exploration of DE with the exploitation of BBO effectively and presented a hybrid DE with BBO, namely, DE/BBO, for global numerical optimization problem. Li et al. [16] designed perturbing migration operator based on the sinusoidal migration model and advanced perturbing biogeography-based optimization (PBBO). Inspired by multiparent crossover in evolutionary algorithm [17], Li and Yin [18] generalized migration operation based on multiparent crossover and presented multioperator biogeography-based optimization (MOBBO). These algorithms have acquired excellent performance.It is well known that both exploration ability and exploitation ability are two bases for population-based optimization algorithm. However, the exploration and exploitation are contradictory to each other [19]. How to enhance the exploration ability is a key problem for improving the performance of BBO. For the sake of this, inspired of DE [7], in this paper, we modify the migration operator by applying a modified mutation strategy to enhance the exploration ability. Meanwhile, a local search mechanism is introduced in biogeography-based algorithm to supplement with the modified migration operator. We name this BBO algorithm as modified biogeography-based optimization with local search mechanism (denoted as MLBBO). Analysis and experimental results show that MLBBO with appropriate parameters can obtain excellent performance.The rest of this paper is organized as follows. In Section2, we will review the basic BBO algorithm. The modified BBO algorithm, called MLBBO, is presented and analyzed in Section 3, while experimental results are presented and discussed in Section 4. Finally, conclusions and future work are drawn in Section 5.


## 2. Review of BBO

Biogeography-based optimization (BBO) [8] is a new emerging population-based algorithm proposed through mimic species migration in natural biogeography. In BBO algorithm, each possible solution is a habitat, and their features that characterize suitability are called suitability index variables (SIVs) [10]. The goodness of each solution is named as habitat suitability index (HSI). In BBO, a habitat  H  is a vector of  N  values (SIVs) reaching global optima through migration step and mutation step. In original migration, information is shared among habitats based on the immigration rate λi and emigration rate μi which are linear functions of the number of species in the habitat. The linear model can be calculated as follows:
(1)λi=I(1-in),μi=Ein,
where E is the maximum possible emigration rate, I is the maximum possible immigration rate, n is the maximum number of species, and  i  is the number of species of the ith solution.The pseudocode of migration operator [8] can be loosely described in Algorithm 1. Where NP (=n) is the population size.Algorithm 1:Pseudocode of migration operator.
(1)Begin
(2)Fori = 1 to NP
(3)   SelectHi in the light of immigration rate λi
(4)If   Hi is selected
(5)Forj= 1 to NP
(6)     SelectHj  according to emigration rate μj
(7)If rand (0,1) < μj
(8)Hi(SIV)=Hj(SIV)
(9)EndIf
(10)EndFor
(11)EndIf
(12)EndFor
(13)EndBecause of ravenous predator or some other natural catastrophe [20], ecological equilibrium may be destroyed, which could lead to drastically changing the species count and HSI of habitats. This phenomenon can be modeled as SIV mutation, and species count probabilities are used to determine mutation rates. The mutation probability  mi is expressed as follows:
(2)mi=mmax·(1-pipmax),
Where  mmax is a user-defined parameter and pmax=argmaxpi,i=1,2,…,n.In the original mutation operator, the SIV in each solution is probabilistically replaced with a new feature, randomly generated in the whole solution space, which will tend to increase the diversity of the population. Gong et al. [9] modified this mutation operator and suggested three mutation operators, Gaussian mutation operator, Cauchy mutation operator, and Lévy mutation operator used in real space.


## 3. Modified Biogeography-Based Optimization with Local Search Mechanism

### 3.1. Modified Migration Operator

Migration operator is a key operator of original BBO, which can improve the performance of BBO. Meanwhile, a habitat is modified through migration operator by simply replacing one of the SIV of the similar habitat, which means that the new habitat absorbs less information from the others. Therefore, migration operator lacks exploration ability.In order to absorb more information from other habitats, inspired of DE [7], the migration operator is modified by using a DE mutation strategy. DE/best/two mutation formula is used in this paper:
(3)DE/best/2:Vi=Xbest+F·(Xr1-Xr2)+F·(Xr3-Xr4),
where Xbest is the best solution, F is scaling factor, Vii∈{1,2,…,NP} is the ith trial vector, and Xr1,Xr2,Xr3,andXr4 are for mutually different solutions.BBO has acquired excellent performance since original migration operator can reserve good features in the population which are avoided being loosed or destroyed in the evolution process. In order to keep the exploitation ability of BBO, we modified formula (3) as follows:
(4)BBO/best/2:Hi(SIV)=Hbest(SIV)+F·(Hr1(SIV)-Hr2(SIV))+F·(Hr3(SIV)-Hr4(SIV)),
where Hbest is the best habitat, Hi is the immigration habitat, and Hr1,Hr2,Hr3,andHr4 are four mutually different habitats. From this, we can see from formula (4) that two differences are added to the new habitat and more information from other habitats are adopted, which can enhance the exploration ability. Meanwhile, it should be noted that parameter F plays an important role in balancing the exploration ability and exploitation ability. When F takes 0, formula (4) absorbs information from best habitat, its exploitation ability enhanced. When Fincreases, formula (4) absorbs more information from other habitats, and its exploration ability will increase, but their exploitation ability will decrease a certain degree. Of course, this silver lining has its cloud. Therefore, F takes 0.5 in this paper.In natural biogeography, the migration model may be nonlinear. Hence, Ma [21] introduced six migration models. Comparison results show that sinusoidal migration model is the best one. The sinusoidal migration model can be calculated as follows:
(5)λi=I2(1+cos(iπn)),μi=E2(1-cos(iπn)).In order to enhance exploration ability, we modify migration operator, described in Algorithm1, by combining formula Hi(SIV)=Hj(SIV) and formula (4). The modified migration operator is described in Algorithm 2.Algorithm 2:Pseudocode of modified migration operator.
(1)Begin
(2)Fori = 1 to NP
(3)    SelectHi according to immigration rate λi using sinusoidal migration model
(4)IfHi is selected
(5)Forj= 1 to NP
(6)      Generate fourmutually different integersr1,r2,r3,andr4 in {1… NP}
(7)      Select according to emigration rateμj
(8)If rand(0,1)<μj
(9)Hi(SIV)=Hj(SIV)
(10)Else
(11)Hi(SIV)=Hbest(SIV)+F·(Hr1(SIV)-Hr2(SIV))+F·(Hr3(SIV)-Hr4(SIV))
(12)EndIf
(13)EndFor
(14)EndIf
(15)EndFor
(16)EndWe can see from Algorithm2 that immigration habitats not only accept information from best habitat, but also from BBO/best/2. On the one hand, information from HSI habitats make the operator maintain power exploitation ability. On the other hand, information from BBO/best/2 can enhance the exploration ability. From this, we know that this modified migration operator can preserve the exploitation ability and enhance the exploration ability simultaneously.


### 3.2. Mutation with Mutation Operator

Cataclysmic events can drastically change the HSI of a natural habitat and cause species count to differ from its equilibrium value. This phenomenon can be modeled in BBO as SIV mutation, and species count probabilities are used to determine mutation rates.In order to enhance the exploration ability of BBO, a modified mutation operator, Cauchy mutation operator, is integrated into BBO. The probability density function of Cauchy distribution [9] is
(6)ft(x)=1πtt2+x2,
where x∈R and t>0 is a scale parameter.The Cauchy mutation (t = 1) in this paper can be described as
(7)Hi(SIV)=Hi(SIV)+δ(1),
where δ(1) is a randomness Cauchy value when parameter t equals 1. In this paper, we use the Cauchy distribution to update the solution,which can be described in Algorithm 3.Algorithm 3:Pseudocode of Cauchy mutation operator.
(1)Begin
(2)Fori = 1 to NP
(3)Compute the mutation probability p
(4)Select variable Hi with probability p
(5)If   Hi is selected
(6) Hi(SIV)=Hi(SIV)+δ(1)
(7)Endif
(8)Endfor
(9)End


### 3.3. Local Search Mechanism

As Simon has pointed out, the convergence speed is an obstacle for real application. So, finding mechanisms to speed up BBO could be an important area for further research. Therefore, a local search mechanism is proposed to accelerate the convergence speed of BBO. In order to remedy the insufficiency of modified migration operator, which mainly updates worse habitats selected by immigration rate, the local search mechanism is designed mainly for better habitats in the first half population.For each habitatHi in the first half population, define
(8)Hi(SIV)={Hi(SIV)+alpha*(Hk(SIV)-Hi(SIV))Hi(SIV)+alpha(1SIV)rand(0,1)<pl,Hi(SIV)rand(0,1111)rand(0,1)else,
where Hk denotes a habitat randomly selected from population, pl denotes the local search probability, and alpha is the strength of local search.


### 3.4. Selection Operator

Selection operator is used to select better habitats preserving in next generation, which can impel the metabolism of population and retain good habitats. In this paper, greedy selection operator is used. In other words, the original habitatHi will be replaced by its corresponding trial habitat Mi if the HSI of the trial habitat Mi is better than that of its original habitat Hi:
(9)Hi={Hiiff(Hi)<f(Mi)Mielse.


### 3.5. Main Procedure of MLBBO

Exploration ability is mainly a contributory factor to step down the performance of BBO algorithm. In order to improve the performance of BBO, a modified BBO algorithm, called MLBBO, is proposed for global optimization problems in the continuous domain. In MLBBO, the original migration operator and mutation operator are modified to enhance the exploration ability. Moreover, local search mechanism and selection operator are integrated into MLBBO to supplement with migration operator. The pseudo-code of MLBBO is described in Algorithm4, where NPis the population size.Algorithm 4:Pseudocode of MLBBO.
(1)Begin
(2)  Initialize the populationPop with NP habitats randomly
(3)  Evaluate the fitness (HSI) for each HabitatHi  in Pop
(4)While the halting criteria are not satisfied do
(5)   Sort all the habitats from best to worst in line with their fitness values
(6)   Map the fitness to the number of species countS for each habitat
(7)   Calculate the immigration rate and emigration rate according to sinusoidal migration model
(8)Fori = 1 to NP    /*migration stage*/
(9)    SelectHi according to immigration rate λi using sinusoidal migration model
(10)IfHi is selected
(11)Forj= 1 to NP
(12)     Generate fourmutually different integersr1,r2,r3,andr4 in {1⋯NP}
(13)     SelectHj according to emigration rate μj
(14)If   rand(0,1) < μj
(15)Hi(SIV)=Hj(SIV)
(16)Else
(17)Hi(SIV)=Hbest(SIV)+F·(Hr1(SIV)-Hr2(SIV))+F·(Hr3(SIV)-Hr4(SIV))
(18)EndIf
(19)EndFor
(20)EndIf
(21)EndFor                        /*end ofmigration stage*/
(22)Fori = 1 to NP   /*mutation stage*/
(23)Compute the mutation probability pi
(24)Select variable Hi with probability pi
(25)IfHi is selected
(26)Hi(SIV)=Hi(SIV)+δ(1)
(27)Endif
(28)EndFor                            /*end ofmutation stage*/
(29)Fori = 1 to NP/2  /*local search stage*/
(30)If  rand(0,1) < pl
(31)     Select a habitatHk randomly
(32)Hi(SIV)=Hi(SIV)+alpha*(Hk(SIV)-Hi(SIV))
(33)EndIf
(34)EndFor                        /*end oflocal search stage*/
(35)  Make sure each habitat legal based on boundary constraints
(36)  Use new generated habitat to replace duplicate
(37)  Evaluate the fitness (HSI) for trial habitatMi in the new population Pop
(38)Fori = 1 to NP    /*selection stage*/
(39)Iff(Mi)<f(Hi)
(40)Hi=Mi
(41)EndIf
(42)EndFor                        /*end ofselection stage*/
(43)EndWhile
(44)End


## 3.1. Modified Migration Operator

Migration operator is a key operator of original BBO, which can improve the performance of BBO. Meanwhile, a habitat is modified through migration operator by simply replacing one of the SIV of the similar habitat, which means that the new habitat absorbs less information from the others. Therefore, migration operator lacks exploration ability.In order to absorb more information from other habitats, inspired of DE [7], the migration operator is modified by using a DE mutation strategy. DE/best/two mutation formula is used in this paper:
(3)DE/best/2:Vi=Xbest+F·(Xr1-Xr2)+F·(Xr3-Xr4),
where Xbest is the best solution, F is scaling factor, Vii∈{1,2,…,NP} is the ith trial vector, and Xr1,Xr2,Xr3,andXr4 are for mutually different solutions.BBO has acquired excellent performance since original migration operator can reserve good features in the population which are avoided being loosed or destroyed in the evolution process. In order to keep the exploitation ability of BBO, we modified formula (3) as follows:
(4)BBO/best/2:Hi(SIV)=Hbest(SIV)+F·(Hr1(SIV)-Hr2(SIV))+F·(Hr3(SIV)-Hr4(SIV)),
where Hbest is the best habitat, Hi is the immigration habitat, and Hr1,Hr2,Hr3,andHr4 are four mutually different habitats. From this, we can see from formula (4) that two differences are added to the new habitat and more information from other habitats are adopted, which can enhance the exploration ability. Meanwhile, it should be noted that parameter F plays an important role in balancing the exploration ability and exploitation ability. When F takes 0, formula (4) absorbs information from best habitat, its exploitation ability enhanced. When Fincreases, formula (4) absorbs more information from other habitats, and its exploration ability will increase, but their exploitation ability will decrease a certain degree. Of course, this silver lining has its cloud. Therefore, F takes 0.5 in this paper.In natural biogeography, the migration model may be nonlinear. Hence, Ma [21] introduced six migration models. Comparison results show that sinusoidal migration model is the best one. The sinusoidal migration model can be calculated as follows:
(5)λi=I2(1+cos(iπn)),μi=E2(1-cos(iπn)).In order to enhance exploration ability, we modify migration operator, described in Algorithm1, by combining formula Hi(SIV)=Hj(SIV) and formula (4). The modified migration operator is described in Algorithm 2.Algorithm 2:Pseudocode of modified migration operator.
(1)Begin
(2)Fori = 1 to NP
(3)    SelectHi according to immigration rate λi using sinusoidal migration model
(4)IfHi is selected
(5)Forj= 1 to NP
(6)      Generate fourmutually different integersr1,r2,r3,andr4 in {1… NP}
(7)      Select according to emigration rateμj
(8)If rand(0,1)<μj
(9)Hi(SIV)=Hj(SIV)
(10)Else
(11)Hi(SIV)=Hbest(SIV)+F·(Hr1(SIV)-Hr2(SIV))+F·(Hr3(SIV)-Hr4(SIV))
(12)EndIf
(13)EndFor
(14)EndIf
(15)EndFor
(16)EndWe can see from Algorithm2 that immigration habitats not only accept information from best habitat, but also from BBO/best/2. On the one hand, information from HSI habitats make the operator maintain power exploitation ability. On the other hand, information from BBO/best/2 can enhance the exploration ability. From this, we know that this modified migration operator can preserve the exploitation ability and enhance the exploration ability simultaneously.


## 3.2. Mutation with Mutation Operator

Cataclysmic events can drastically change the HSI of a natural habitat and cause species count to differ from its equilibrium value. This phenomenon can be modeled in BBO as SIV mutation, and species count probabilities are used to determine mutation rates.In order to enhance the exploration ability of BBO, a modified mutation operator, Cauchy mutation operator, is integrated into BBO. The probability density function of Cauchy distribution [9] is
(6)ft(x)=1πtt2+x2,
where x∈R and t>0 is a scale parameter.The Cauchy mutation (t = 1) in this paper can be described as
(7)Hi(SIV)=Hi(SIV)+δ(1),
where δ(1) is a randomness Cauchy value when parameter t equals 1. In this paper, we use the Cauchy distribution to update the solution,which can be described in Algorithm 3.Algorithm 3:Pseudocode of Cauchy mutation operator.
(1)Begin
(2)Fori = 1 to NP
(3)Compute the mutation probability p
(4)Select variable Hi with probability p
(5)If   Hi is selected
(6) Hi(SIV)=Hi(SIV)+δ(1)
(7)Endif
(8)Endfor
(9)End


## 3.3. Local Search Mechanism

As Simon has pointed out, the convergence speed is an obstacle for real application. So, finding mechanisms to speed up BBO could be an important area for further research. Therefore, a local search mechanism is proposed to accelerate the convergence speed of BBO. In order to remedy the insufficiency of modified migration operator, which mainly updates worse habitats selected by immigration rate, the local search mechanism is designed mainly for better habitats in the first half population.For each habitatHi in the first half population, define
(8)Hi(SIV)={Hi(SIV)+alpha*(Hk(SIV)-Hi(SIV))Hi(SIV)+alpha(1SIV)rand(0,1)<pl,Hi(SIV)rand(0,1111)rand(0,1)else,
where Hk denotes a habitat randomly selected from population, pl denotes the local search probability, and alpha is the strength of local search.


## 3.4. Selection Operator

Selection operator is used to select better habitats preserving in next generation, which can impel the metabolism of population and retain good habitats. In this paper, greedy selection operator is used. In other words, the original habitatHi will be replaced by its corresponding trial habitat Mi if the HSI of the trial habitat Mi is better than that of its original habitat Hi:
(9)Hi={Hiiff(Hi)<f(Mi)Mielse.


## 3.5. Main Procedure of MLBBO

Exploration ability is mainly a contributory factor to step down the performance of BBO algorithm. In order to improve the performance of BBO, a modified BBO algorithm, called MLBBO, is proposed for global optimization problems in the continuous domain. In MLBBO, the original migration operator and mutation operator are modified to enhance the exploration ability. Moreover, local search mechanism and selection operator are integrated into MLBBO to supplement with migration operator. The pseudo-code of MLBBO is described in Algorithm4, where NPis the population size.Algorithm 4:Pseudocode of MLBBO.
(1)Begin
(2)  Initialize the populationPop with NP habitats randomly
(3)  Evaluate the fitness (HSI) for each HabitatHi  in Pop
(4)While the halting criteria are not satisfied do
(5)   Sort all the habitats from best to worst in line with their fitness values
(6)   Map the fitness to the number of species countS for each habitat
(7)   Calculate the immigration rate and emigration rate according to sinusoidal migration model
(8)Fori = 1 to NP    /*migration stage*/
(9)    SelectHi according to immigration rate λi using sinusoidal migration model
(10)IfHi is selected
(11)Forj= 1 to NP
(12)     Generate fourmutually different integersr1,r2,r3,andr4 in {1⋯NP}
(13)     SelectHj according to emigration rate μj
(14)If   rand(0,1) < μj
(15)Hi(SIV)=Hj(SIV)
(16)Else
(17)Hi(SIV)=Hbest(SIV)+F·(Hr1(SIV)-Hr2(SIV))+F·(Hr3(SIV)-Hr4(SIV))
(18)EndIf
(19)EndFor
(20)EndIf
(21)EndFor                        /*end ofmigration stage*/
(22)Fori = 1 to NP   /*mutation stage*/
(23)Compute the mutation probability pi
(24)Select variable Hi with probability pi
(25)IfHi is selected
(26)Hi(SIV)=Hi(SIV)+δ(1)
(27)Endif
(28)EndFor                            /*end ofmutation stage*/
(29)Fori = 1 to NP/2  /*local search stage*/
(30)If  rand(0,1) < pl
(31)     Select a habitatHk randomly
(32)Hi(SIV)=Hi(SIV)+alpha*(Hk(SIV)-Hi(SIV))
(33)EndIf
(34)EndFor                        /*end oflocal search stage*/
(35)  Make sure each habitat legal based on boundary constraints
(36)  Use new generated habitat to replace duplicate
(37)  Evaluate the fitness (HSI) for trial habitatMi in the new population Pop
(38)Fori = 1 to NP    /*selection stage*/
(39)Iff(Mi)<f(Hi)
(40)Hi=Mi
(41)EndIf
(42)EndFor                        /*end ofselection stage*/
(43)EndWhile
(44)End


## 4. Experimental Study

### 4.1. Experimental Setting

In this section, several experimental tests are carried out on 27 benchmark functions for validating the performance of the proposed algorithm. These functions consist of 13 standard benchmark functions [22] (f1–f13) and 14 complex functions (F1–F14) from the set of test problems listed in IEEE CEC 2005 [23]. All the test functions used in our experiments are high-dimensional functions with changeable dimension, which are only briefly summarized in Table 1. A more detailed description of each function is given in Table 8 (see also [22, 23]).Table 1
Test unctions used in our experimental tests.
Function name
Dimension
Search Space
Optima
f1
Sphere
n
[−100, 100]
0
f2
Schwefel’s Problem 2.22
n
[10, 10]
0
f3
Schwefel’s Problem 1.2
n
[−100, 100]
0
f4
Schwefel’s Problem 2.21
n
[−100, 100]
0
f5
Rosenbrock function
n
[−30, 30]
0
f6
Step function
n
[−100, 100]
0
f7
Quartic function
n
[−1.28, 1.28]
0
f8
Schwefel function
n
[−512, 512]
−12569.5
f9
Rastrigin function
n
[−5.12, 5.12]
0
f10
Ackley function
n
[−32, 32]
0
f11
Griewank function
n
[−600, 600]
0
f12
Penalized function 1
n
[−50, 50]
0
f13
Penalized function 2
n
[−50, 50]
0
F1
Shifted sphere function
n
[−100, 100]
−450
F2
Shifted Schwefel’s Problem 1.2
n
[−100, 100]
−450
F3
Shifted rotated high conditioned elliptic function
n
[−100, 100]
−450
F4
Shifted Schwefel’s Problem 1.2 with noise in fitness
n
[−100, 100]
−450
F5
Schwefel’s Problem 2.6 with global optimum on bounds
n
[−30, 30]
−310
F6
Shifted Rosenbrock’s function
n
[−100, 100]
390
F7
Shifted rotated Griewank’s function without bounds
n
Initialize in[0, 600]
−180
F8
Shifted rotated Ackley’s function with global optimum on bounds
n
[−32, 32]
−140
F9
Shifted Rastrigin’s function
n
[−5.12, 5.12]
−330
F10
Shifted Rotated Rastrigin’s function
n
[−5.12, 5.12]
−330
F11
Shifted Rotated Weierstrass function
n
[−600, 600]
90
F12
Schwefel’s Problem 2.13
n
[−100, 100]
−460
F13
Expanded extended Griewank’s plus Rosenbrock’s function (F8F2)
n
[−50, 50]
−130
F14
Shifted rotated expanded scaffer’s F6
n
[−100, 100]
−300For fair comparison, we have chosen a reasonable set of parameter values. For all experimental simulations in this paper, we will use the following parameters setting unless a change is mentioned:(1)
population size:NP= 100;(2)
maximum immigration rate:I =1;(3)
maximum emigration rate:E =1;(4)
mutation probability:mmax = 0.001;(5)
value to reach (VTR) = 10−6, except for f7, F6–F14 of VTR = 10−2;(6)
maximum number of fitness function evaluations (MaxNFFEs): 150,000 for f1, f6, f10, f12, and f13, 200,000 for f2, and f11, 300,000 for f7, f8, f9, F1–F14, and 500,000 for f3, f4, and f5.In our experimental tests, all the functions are optimized over 30 independent runs. All experimental tests are carried out on a computer with 1.86 GHz Intel core Processor, 1 GB of RAM, and Window XP operation system in Matlab software 7.6.


### 4.2. Effect of the Strength Alpha and Ratepl  on the Performance of MLBBO

In this section, we investigate the impact of local search strengthalpha and search probability pl on the proposed algorithm. In order to analyze the performance more scientific, eight functions are chosen from Table 1. They are Sphere, Schwefel 1.2, Schwefel, Penalized2, F1, F3, F10, and F13, which belong to standard unimodal function, standard multimodal function, shifted function, shifted rotated function, and expanded function, respectively. Search strength alpha are 0.3, 0.5, 0.8, and 1.1. Search rates pl are 0, 0.2, 0.4, 0.6, 0.8, and 1. It is important to note that pl equal to 0 means that local search mechanism is not conducted. Hence, in our experiments, alpha and pl are tested according to 24 situations. MLBBO algorithm executes 30 independent runs on each function, and convergence figures of average fitness values (which are function error values) are plotted in Figure 1.Figure 1
Results of MLBBO on eight test functions with differentalpha and pl.From Figure1, we can observe that different search rate pl have different results. When pl is 0, the results are worse than the others, which means that local search mechanism can improve the performance of proposed algorithm. When pl is 0.4, we obtain a faster convergence speed and better results on the Sphere function. For the other seven test functions, better results are obtained when search rate pl is 0.2 and 0.4. Moreover, the performance of MLBBO is most sensitive to search rate pl on function F8.From Figure1, we can also see that search strength alpha has little effect on the results as a whole. By careful looking, search strength alpha has an effect on the results when search rate pl is large, especially, when pl equals 0.8 or 1.For considering opinions of both sides, the search strengthalpha and search rate pl are set as 0.8 and 0.2, respectively.


### 4.3. Comparisons with BBO and DE/Best/2/Bin

For evaluating the performance of algorithms, we first compare MLBBO with BBO [8], which is consistent with original BBO except solution representation (real code) and DE/best/2/bin [7] (abbreviation as DE). For fair comparison, three algorithms are conducted on 27 functions with the same parameters setting above. The average and standard deviation of fitness values (which are function error values) after completion of 30 Monte Carlo simulations are summarized in Table 2. The number of successful runs and average of the number of fitness function evaluations (MeanFEs), needed in each run when the VTR is reached within the MaxNFFEs, are also recorded in Table 2. Furthermore, results of MLBBO and BBO, MLBBO and DE are compared with statistical paired t-test [24, 25], which is used to determine whether two paired solution sets differ from each other in a significant way. Convergence curves of mean fitness values and boxplot figures under 30 independent runs are listed in Figures 2 and 3, respectively.Table 2
Comparisons with BBO and DE.
DE
BBO
MLBBO
Mean (std)
MeanFEs
SR
Mean (Std)
MeanFEs
SR
Mean (std)
MeanFEs
SR
f1
2.72
E
-
20
(
2.09
E
-
20
)
+
4.47
E
+
04
30
3.23
E
-
01
(
1.18
E
-
01
)
+
NaN
0
2.78
E
-
31
(
3.25
E
-
31
)
2.83
E
+
04
30
f2
2.56
E
-
12
(
3.09
E
-
12
)
+
1.06
E
+
05
30
4.84
E
-
01
(
9.06
E
-
02
)
+
NaN
0
1.43
E
-
21
(
7.11
E
-
22
)
5.74
E
+
04
30
f3
2.31
E
-
19
(
2.37
E
-
19
)
+
1.51
E
+
05
30
1.26
E
+
02
(
5.19
E
+
01
)
+
NaN
0
1.90
E
-
20
(
3.03
E
-
20
)
1.40
E
+
05
30
f4
1.92
E
-
10
(
3.44
E
-
10
)
~
2.61
E
+
05
30
1.62
E
+
00
(
4.71
E
-
01
)
+
NaN
0
4.49
E
-
08
(
1.25
E
-
07
)
3.49
E
+
05
30
f5
1.05
E
-
28
(
8.92
E
-
29
)
-
1.62
E
+
05
30
7.85
E
+
01
(
3.51
E
+
01
)
+
NaN
0
3.34
E
-
21
(
9.08
E
-
21
)
2.25
E
+
05
30
f6
8.67
E
-
01
(
1.20
E
+
00
)
+
2.51
E
+
04
14
1.77
E
+
00
(
1.17
E
+
00
)
+
1.19
E
+
05
3
0.00
E
+
00
(
0.00
E
+
00
)
1.14
E
+
04
30
f7
5.65
E
-
03
(
2.10
E
-
03
)
+
1.44
E
+
05
29
3.64
E
-
04
(
2.77
E
-
04
)
-
2.21
E
+
04
30
2.23
E
-
03
(
9.91
E
-
04
)
6.61
E
+
04
30
f8
7.29
E
+
03
(
2.32
E
+
02
)
+
NaN
0
2.53
E
-
01
(
8.82
E
-
02
)
+
NaN
0
0.00
E
+
00
(
0.00
E
+
00
)
5.53
E
+
04
30
f9
1.76
E
+
02
(
1.01
E
+
01
)
+
NaN
0
3.56
E
-
02
(
1.52
E
-
02
)
+
NaN
0
0.00
E
+
00
(
0.00
E
+
00
)
9.16
E
+
04
30
f10
5.77
E
-
07
(
3.16
E
-
06
)
~
7.87
E
+
04
29
2.06
E
-
01
(
4.94
E
-
02
)
+
NaN
0
6.10
E
-
15
(
1.14
E
-
15
)
5.05
E
+
04
30
f11
6.57
E
-
03
(
6.25
E
-
03
)
+
4.54
E
+
04
12
2.81
E
-
01
(
9.76
E
-
02
)
+
NaN
0
2.87
E
-
03
(
5.02
E
-
03
)
3.33
E
+
04
22
f12
1.38
E
-
02
(
4.50
E
-
02
)
~
5.37
E
+
04
26
1.98
E
-
03
(
2.04
E
-
03
)
+
NaN
0
5.88
E
-
28
(
3.22
E
-
27
)
2.57
E
+
04
30
f13
1.90
E
-
20
(
5.93
E
-
20
)
~
4.65
E
+
04
30
2.09
E
-
02
(
9.94
E
-
03
)
+
NaN
0
5.09
E
-
32
(
3.13
E
-
32
)
2.71
E
+
04
30
F1
5.59
E
-
28
(
2.06
E
-
28
)
+
4.58
E
+
04
30
7.23
E
-
02
(
3.27
E
-
02
)
+
NaN
0
3.03
E
-
29
(
6.97
E
-
29
)
2.90
E
+
04
30
F2
7.59
E
-
12
(
8.42
E
-
12
)
+
1.72
E
+
05
30
3.55
E
+
03
(
1.35
E
+
03
)
+
NaN
0
1.97
E
-
12
(
2.55
E
-
12
)
1.58
E
+
05
30
F3
1.39
E
+
05
(
1.06
E
+
05
)
+
NaN
0
1.14
E
+
07
(
4.90
E
+
06
)
+
NaN
0
9.26
E
+
04
(
4.90
E
+
04
)
NaN
0
F4
7.10
E
-
05
(
1.61
E
-
04
)
~
2.85
E
+
05
1
1.39
E
+
04
(
4.56
E
+
03
)
+
NaN
0
7.00
E
-
05
(
1.87
E
-
04
)
2.90
E
+
05
5
F5
5.31
E
+
01
(
1.37
E
+
02
)
-
NaN
0
5.81
E
+
03
(
9.97
E
+
02
)
+
NaN
0
8.34
E
+
02
(
3.81
E
+
02
)
NaN
0
F6
1.58
E
-
13
(
7.82
E
-
13
)
~
1.46
E
+
05
30
2.23
E
+
02
(
8.03
E
+
01
)
+
NaN
0
2.11
E
-
09
(
6.68
E
-
09
)
1.85
E
+
05
30
F7
1.26
E
-
02
(
1.26
E
-
02
)
~
4.93
E
+
04
15
1.13
E
+
00
(
7.73
E
-
02
)
+
NaN
0
1.59
E
-
02
(
1.16
E
-
02
)
4.80
E
+
04
12
F8
2.09
E
+
01
(
5.20
E
-
02
)
~
NaN
0
2.08
E
+
01
(
1.06
E
-
01
)
-
NaN
0
2.09
E
+
01
(
7.07
E
-
02
)
NaN
0
F9
1.85
E
+
02
(
1.75
E
+
01
)
+
NaN
0
3.97
E
-
02
(
2.04
E
-
02
)
+
NaN
0
5.92
E
-
17
(
3.24
E
-
16
)
7.71
E
+
04
30
F10
2.05
E
+
02
(
1.96
E
+
01
)
+
NaN
0
5.26
E
+
01
(
1.19
E
+
01
)
+
NaN
0
3.47
E
+
01
(
1.24
E
+
01
)
NaN
0
F11
3.95
E
+
01
(
1.03
E
+
00
)
+
NaN
0
3.09
E
+
01
(
3.05
E
+
00
)
+
NaN
0
1.72
E
+
01
(
6.58
E
+
00
)
NaN
0
F12
1.19
E
+
03
(
2.32
E
+
03
)
~
2.31
E
+
05
3
1.41
E
+
04
(
9.84
E
+
03
)
+
NaN
0
2.07
E
+
03
(
2.92
E
+
03
)
NaN
0
F13
1.59
E
+
01
(
1.12
E
+
00
)
+
NaN
0
1.09
E
+
00
(
2.34
E
-
01
)
-
NaN
0
3.03
E
+
00
(
1.44
E
-
01
)
NaN
0
F14
1.34
E
+
01
(
1.51
E
-
01
)
+
NaN
0
1.31
E
+
01
(
3.83
E
-
01
)
+
NaN
0
1.27
E
+
01
(
2.40
E
-
01
)
NaN
0
Better
16
24
Similar
9
0
Worse
2
3
Note: “+”, “−”, and “~” indicate that MLBBO is significantly better, worse, and indifferent, respectively, compared with other algorithms.Figure 2
Convergence curves of mean fitness values of MLBBO, BBO, and DE for functions f1, f2, f3, f5, f6, f7, f8, f13, F1, F3, F4, F5, F7, F8, F9, F11, F13, and F14.Figure 3
ANOVA tests of fitness values of MLBBO, BBO, and DE for functions f1, f2, f3, f5, f6, f7, f8, f13, F1, F3, F4, F5, F7, F8, F9, F11, F13, and F14.From Table2, it is seen that MLBBO is significantly better than BBO on 24 functions out of 27 test functions, and MLBBO is outperformed by BBO on the rest 3 functions. When compared with DE, MLBBO gives significantly better performance on 16 functions. On 9 functions, there are no significant differences between MLBBO and DE based on the two tail t-test. For the rest 2 functions, DE are better than MLBBO. Moreover, MLBBO can obtain the VTR over all 30 successful runs within the MaxNFFEs for 16 out of 27 functions. Especially, for the first 13 standard benchmark functions, MLBBO obtains 30 successful runs on 12 functions except Griewank function, where 22 successful runs are obtained by MLBBO. DE and BBO obtain 30 successful runs on 9 and 1 out of 27 functions, respectively. From Table 2, we can find that MLBBO needs less or similar NFFEs than DE and BBO on most of the successful runs, which means that MLBBO has faster convergence speed than DE and BBO. The convergence speed and the robustness can also show in Figures 2 and 3.From the above results, we know that the total performance of MLBBO is significantly better than DE and BBO, which indicates that MLBBO not only integrates the exploration ability of DE and the exploitation ability of BBO simply, but also can balance both search abilities very well.


### 4.4. Comparisons with Improved BBO Algorithms

In this section, the performance of MLBBO is compared with improved BBO algorithms: (a) oppositional BBO (OBBO) [12], which is proposed by employing opposition-based learning (OBL) alongside BBO’s migration rates; (b) multi-operator BBO (MOBBO) [18], which is another modified BBO with multi-operator migration operator; (c) perturb BBO (PBBO) [16], which is a modified BBO with perturb migration operator; and (d) real-code BBO (RCBBO) [9]. For fair comparison, five improved BBO algorithms are conducted on 27 functions with the same parameters setting above. The mean and standard deviation of fitness values are summarized in Table 3. Further, the results between MLBBO and OBBO, MLBBO and PBBO, MLBBO and MOBBO, and MLBBO and RCBBO are compared using statistical paired t-test. Convergence curves of mean fitness values under 30 independent runs are plotted in Figure 4.Table 3
Comparisons with improved BBO algorithms.
OBBO
PBBO
MOBBO
RCBBO
MLBBO
Mean (std)
Mean (Std)
Mean (std)
Mean (std)
Mean (std)
f1
6.88
E
-
05
(
2.58
E
-
05
)
+
2.23
E
-
11
(
2.77
E
-
12
)
+
1.70
E
-
09
(
9.30
E
-
09
)
~
2.26
E
-
03
(
1.06
E
-
03
)
+
2.11
E
-
31
(
1.25
E
-
31
)
f2
2.76
E
-
02
(
4.80
E
-
03
)
+
3.47
E
-
06
(
2.67
E
-
07
)
+
2.74
E
-
05
(
1.48
E
-
04
)
~
8.96
E
-
02
(
1.58
E
-
02
)
+
1.58
E
-
21
(
7.25
E
-
22
)
f3
6.29
E
-
01
(
4.23
E
-
01
)
+
2.06
E
-
02
(
1.70
E
-
02
)
+
3.25
E
-
02
(
4.50
E
-
02
)
+
2.19
E
+
01
(
9.34
E
+
00
)
+
1.42
E
-
20
(
1.70
E
-
20
)
f4
1.47
E
-
02
(
3.18
E
-
03
)
+
1.20
E
-
02
(
3.30
E
-
03
)
+
2.43
E
-
02
(
6.74
E
-
03
)
+
1.20
E
+
00
(
1.25
E
+
00
)
+
5.28
E
-
08
(
1.02
E
-
07
)
f5
3.65
E
+
01
(
2.20
E
+
01
)
+
3.60
E
+
01
(
3.40
E
+
01
)
+
6.32
E
+
01
(
8.33
E
+
01
)
+
4.25
E
+
01
(
3.74
E
+
01
)
+
5.34
E
-
21
(
1.10
E
-
20
)
f6
0.00
E
+
00
(
0.00
E
+
00
)
~
0.00
E
+
00
(
0.00
E
+
00
)
~
0.00
E
+
00
(
0.00
E
+
00
)
~
0.00
E
+
00
(
0.00
E
+
00
)
~
0.00
E
+
00
(
0.00
E
+
00
)
f7
4.02
E
-
04
(
3.48
E
-
04
)
-
2.86
E
-
04
(
2.68
E
-
04
)
-
9.79
E
-
04
(
8.00
E
-
04
)
-
4.21
E
-
04
(
3.81
E
-
04
)
-
2.33
E
-
03
(
1.04
E
-
03
)
f8
2.40
E
+
02
(
1.82
E
+
02
)
+
1.70
E
-
11
(
2.26
E
-
12
)
+
1.55
E
-
11
(
8.50
E
-
11
)
~
8.17
E
-
05
(
3.15
E
-
05
)
+
0.00
E
+
00
(
0.00
E
+
00
)
f9
5.59
E
-
03
(
2.07
E
-
03
)
+
2.80
E
-
07
(
1.37
E
-
06
)
~
5.45
E
-
05
(
2.99
E
-
04
)
~
1.38
E
-
02
(
5.11
E
-
03
)
+
0.00
E
+
00
(
0.00
E
+
00
)
f10
7.38
E
-
03
(
1.88
E
-
03
)
+
2.08
E
-
06
(
5.39
E
-
06
)
+
9.74
E
-
08
(
5.97
E
-
09
)
+
2.94
E
-
02
(
6.63
E
-
03
)
+
6.10
E
-
15
(
6.49
E
-
16
)
f11
2.68
E
-
02
(
2.49
E
-
02
)
+
4.98
E
-
03
(
1.29
E
-
02
)
~
5.08
E
-
03
(
1.05
E
-
02
)
~
7.92
E
-
02
(
4.36
E
-
02
)
+
1.73
E
-
03
(
4.00
E
-
03
)
f12
1.82
E
-
06
(
2.26
E
-
06
)
+
6.71
E
-
11
(
3.18
E
-
10
)
~
3.46
E
-
03
(
1.89
E
-
02
)
~
3.39
E
-
05
(
3.47
E
-
05
)
+
2.35
E
-
32
(
3.98
E
-
32
)
f13
2.04
E
-
05
(
1.99
E
-
05
)
+
1.65
E
-
09
(
7.99
E
-
09
)
~
6.33
E
-
13
(
3.44
E
-
12
)
~
6.43
E
-
04
(
9.66
E
-
04
)
+
5.64
E
-
32
(
3.38
E
-
32
)
F1
1.40
E
-
05
(
8.26
E
-
06
)
+
2.67
E
-
11
(
9.69
E
-
11
)
~
1.16
E
-
07
(
6.34
E
-
07
)
~
3.50
E
-
04
(
9.25
E
-
05
)
+
2.02
E
-
29
(
6.16
E
-
29
)
F2
4.70
E
+
01
(
8.64
E
+
00
)
+
2.92
E
+
00
(
2.02
E
+
00
)
+
2.66
E
+
00
(
2.16
E
+
00
)
+
8.72
E
+
02
(
4.43
E
+
02
)
+
1.37
E
-
12
(
1.53
E
-
12
)
F3
1.56
E
+
06
(
3.45
E
+
05
)
+
2.10
E
+
06
(
6.86
E
+
05
)
+
2.37
E
+
06
(
9.89
E
+
05
)
+
4.46
E
+
06
(
1.58
E
+
06
)
+
9.02
E
+
04
(
5.54
E
+
04
)
F4
3.18
E
+
03
(
9.94
E
+
02
)
+
7.74
E
+
02
(
3.86
E
+
02
)
+
1.46
E
+
01
(
1.83
E
+
01
)
+
2.17
E
+
04
(
8.50
E
+
03
)
+
1.75
E
-
05
(
2.92
E
-
05
)
F5
1.03
E
+
04
(
1.63
E
+
03
)
+
3.68
E
+
03
(
6.27
E
+
02
)
+
5.04
E
+
03
(
1.24
E
+
03
)
+
6.31
E
+
03
(
1.18
E
+
03
)
+
8.00
E
+
02
(
3.79
E
+
02
)
F6
3.20
E
+
02
(
9.64
E
+
02
)
~
8.71
E
+
02
(
2.12
E
+
03
)
+
2.76
E
+
02
(
8.46
E
+
02
)
~
8.45
E
+
02
(
2.69
E
+
03
)
~
3.55
E
-
09
(
1.40
E
-
08
)
F7
2.46
E
-
02
(
1.52
E
-
02
)
+
1.62
E
-
02
(
1.45
E
-
02
)
~
2.26
E
-
02
(
1.99
E
-
02
)
+
7.64
E
-
01
(
1.39
E
+
00
)
+
1.38
E
-
02
(
1.21
E
-
02
)
F8
2.08
E
+
01
(
8.04
E
-
02
)
-
2.09
E
+
01
(
1.69
E
-
01
)
-
2.07
E
+
01
(
1.71
E
-
01
)
-
2.07
E
+
01
(
8.51
E
-
02
)
-
2.09
E
+
01
(
5.48
E
-
02
)
F9
5.80
E
-
03
(
2.39
E
-
03
)
+
9.69
E
-
07
(
3.88
E
-
06
)
~
1.22
E
-
07
(
6.61
E
-
07
)
~
1.32
E
-
02
(
5.53
E
-
03
)
+
5.92
E
-
17
(
3.24
E
-
16
)
F10
6.43
E
+
01
(
2.81
E
+
01
)
+
3.29
E
+
01
(
8.80
E
+
00
)
~
7.14
E
+
01
(
2.06
E
+
01
)
+
4.80
E
+
01
(
1.62
E
+
01
)
+
3.69
E
+
01
(
1.45
E
+
01
)
F11
2.36
E
+
01
(
3.19
E
+
00
)
+
2.09
E
+
01
(
4.48
E
+
00
)
~
2.70
E
+
01
(
4.11
E
+
00
)
+
3.19
E
+
01
(
3.90
E
+
00
)
+
1.95
E
+
01
(
7.87
E
+
00
)
F12
1.18
E
+
04
(
8.66
E
+
03
)
+
4.68
E
+
03
(
4.44
E
+
03
)
+
5.04
E
+
03
(
4.10
E
+
03
)
+
1.29
E
+
04
(
8.94
E
+
03
)
+
2.43
E
+
03
(
2.97
E
+
03
)
F13
1.08
E
+
00
(
1.96
E
-
01
)
-
1.14
E
+
00
(
2.07
E
-
01
)
-
1.09
E
+
00
(
2.29
E
-
01
)
-
9.61
E
-
01
(
1.57
E
-
01
)
-
2.98
E
+
00
(
1.62
E
-
01
)
F14
1.25
E
+
01
(
3.61
E
-
01
)
~
1.19
E
+
01
(
6.17
E
-
01
)
-
1.33
E
+
01
(
3.44
E
-
01
)
+
1.31
E
+
01
(
3.39
E
-
01
)
+
1.27
E
+
01
(
2.39
E
-
01
)
Better
21
13
13
22
Similar
3
10
11
2
Worse
3
4
3
3
Note: “+”, “−”, and “~” indicate that MLBBO is significantly better, worse, and indifferent, respectively, compared with other algorithms.Figure 4
Convergence curves of mean fitness values of MLBBO, OBBO, PBBO, MOBBO, and RCBBO for functions f1, f4, f8, f9, f6, f7, f8, f9, f10, F1, F7, and F11.From Table3, we can see that MLBBO outperforms OBBO on 21 out of 27 test functions whereas OBBO surpasses MLBBO on 3 functions. MLBBO obtains similar fitness values with OBBO on 3 functions based on two tail t-test. Similar results can be obtained when making a comparison between MLBBO and RCBBO. When compared with PBBO and MOBBO, MLBBO is significantly better than both PBBO and MOBBO on 13 functions. MLBBO obtains similar results with PBBO and MOBBO on 10 and 11 functions, respectively. PBBO surpasses MLBBO only on 4 functions, which are Quartic function, shifted rotated Ackley’s function, expanded extended Griewank’s plus Rosenbrock’s Function, and shifted rotated expanded Scaffer’s F6. MOBBO outperforms MLBBO only on 3 functions, which are Quartic function, shifted rotated Ackley’s function, and expanded extended Griewank’s plus Rosenbrock’s function. Furthermore, the total performance of MLBBO is better than PBBO and MOBBO and much better than OBBO and RCBBO.Furthermore, Figure4 shows similar results with Table 3. We can see that the convergence speed of PBBO an MOBBO are faster than the others in preliminary stages owing to their powerful exploitation ability, but the convergence speed decreases in the next iteration. However, MLBBO can converge to satisfactory solutions at equilibrium rapidly speed. From the comparison, we know that operators used in MLBBO can enhance exploration ability.


### 4.5. Comparisons with Hybrid Algorithms

In order to validate the performance of the proposed algorithms (MLBBO) further, we compare the proposed algorithm with hybrid algorithms: OXDE [26] and DE/BBO [15]. The mean standard deviation of fitness values of 27 test functions are listed in Table 4. The average NFFEs and successful runs are also listed in Table 4. Convergence curves of mean fitness values under 30 independent runs are plotted in Figure 5.Table 4
Comparisons with hybrid algorithms.
OXDE
DE/BBO
MLBBO
Mean (std)
MeanFEs
SR
Mean (std)
MeanFEs
SR
Mean (std)
MeanFEs
SR
f1
2.60
E
-
03 (9.04E-04)+
NaN
0
1.53
E
-
30 (1.48E-30)+
4.7
E
+
04
30
2.30
E
-
31 (2.74E-31)
2.8
E
+
04
30
f2
1.82
E
-
02 (4.77E-03)+
NaN
0
2.52
E
-
24 (1.74E-24)−
6.7
E
+
04
30
1.61
E
-
21 (7.89E-22)
5.8
E
+
04
30
f3
5.43
E
-
01 (2.52E-01)+
NaN
0
2.60
E
-
03 (1.72E-03)+
NaN
0
2.16
E
-
20 (3.19E-20)
1.4
E
+
05
30
f4
4.80
E
-
02 (7.19E-02)+
NaN
0
6.50
E
-
02 (2.23E-01)~
2.5
E
+
05
18
7.99
E
-
08 (1.38E-07)
3.5
E
+
05
30
f5
3.73
E
-
01 (7.68E-01)+
NaN
0
2.33
E
+
01 (9.10E+00)+
NaN
0
2.56
E
-
21 (6.21E-21)
2.3
E
+
05
30
f6
0.00
E
+
00 (0.00E+00)~
9.3
E
+
04
30
0.00
E
+
00 (0.00E+00)~
2.2
E
+
04
30
0.00
E
+
00 (0.00E+00)
1.1
E
+
04
30
f7
6.64
E
-
03 (1.97E-03)+
2.0
E
+
05
30
4.69
E
-
03 (1.54E-03)+
1.4
E
+
05
30
2.13
E
-
03 (9.10E-04)
6.7
E
+
04
30
f8
1.33
E
-
05 (1.57E-05)+
NaN
0
0.00
E
+
00 (0.00E+00)~
1.0
E
+
05
30
6.06
E
-
14 (3.32E-13)
5.5
E
+
04
30
f9
5.32
E
+
01 (6.72E+00)+
NaN
0
0.00
E
+
00 (0.00E+00)~
1.8
E
+
05
30
0.00
E
+
00 (0.00E+00)
9.2
E
+
04
30
f10
1.45
E
-
02 (2.75E-03)+
NaN
0
6.10
E
-
15 (6.49E-16)~
6.7
E
+
04
30
6.10
E
-
15 (6.49E-16)
5.0
E
+
04
30
f11
1.17
E
-
04 (1.35E-04)−
NaN
0
0.00
E
+
00 (0.00E+00)−
5.0
E
+
04
30
3.37
E
-
03 (4.64E-03)
2.8
E
+
04
19
f12
6.97
E
-
05 (3.20E-05)+
NaN
0
1.68
E
-
31 (1.43E-31)~
4.3
E
+
04
30
1.63
E
-
25 (8.95E-25)
2.7
E
+
04
30
f13
5.10
E
-
04 (2.19E-04)+
NaN
0
2.37
E
-
30 (2.69E-30)+
4.7
E
+
04
30
4.98
E
-
32 (4.19E-32)
2.7
E
+
04
30
F1
1.57
E
-
09 (7.48E-10)+
2.4
E
+
05
30
0.00
E
+
00 (0.00E+00)−
4.8
E
+
04
30
2.69
E
-
29 (6.98E-29)
2.9
E
+
04
30
F2
6.08
E
+
02 (1.92E+02)+
NaN
0
1.08
E
+
01 (1.07E+01)+
NaN
0
1.60
E
-
12 (1.57E-12)
1.6
E
+
05
30
F3
8.26
E
+
06 (2.15E+06)+
NaN
0
2.91
E
+
06 (1.01E+06)+
NaN
0
9.00
E
+
04 (4.99E+04)
NaN
0
F4
2.28
E
+
03 (7.46E+02)+
NaN
0
1.49
E
+
02 (8.27E+01)+
NaN
0
6.70
E
-
05 (1.87E-04)
2.9
E
+
05
6
F5
3.56
E
+
02 (9.42E+01)−
NaN
0
1.17
E
+
03 (2.83E+02)+
NaN
0
8.28
E
+
02 (3.40E+02)
NaN
0
F6
2.03
E
+
01 (1.74E+00)+
NaN
0
2.89
E
+
01 (1.61E+01)+
NaN
0
1.76
E
-
09 (6.58E-09)
1.9
E
+
05
30
F7
3.52
E
-
03 (1.07E-02)−
2.5
E
+
05
27
7.64
E
-
03 (5.42E-03)−
1.3
E
+
05
29
1.47
E
-
02 (1.47E-02)
5.0
E
+
04
19
F8
2.09
E
+
01
(
5.72
E
-
02)~
NaN
0
2.09
E
+
01 (4.84E-02)~
NaN
0
2.10
E
+
01 (4.54E-02)
NaN
0
F9
7.46
E
+
01 (1.03E+01)+
NaN
0
0.00
E
+
00 (0.00E+00)~
1.5
E
+
05
30
0.00
E
+
00 (0.00E+00)
7.8
E
+
04
30
F10
1.87
E
+
02 (1.13E+01)+
NaN
0
7.95
E
+
01 (9.19E+00)+
NaN
0
3.37
E
+
01 (9.16E+00)
NaN
0
F11
3.96
E
+
01 (9.53E-01)+
NaN
0
3.09
E
+
01 (1.35E+00)+
NaN
0
1.83
E
+
01 (8.49E+00)
NaN
0
F12
4.78
E
+
03 (4.49E+03)+
NaN
0
4.25
E
+
03 (3.87E+03)+
NaN
0
1.57
E
+
03 (1.87E+03)
NaN
0
F13
1.08
E
+
01 (7.91E-01)+
NaN
0
2.78
E
+
00 (1.94E-01)−
NaN
0
3.05
E
+
00 (1.88E-01)
NaN
0
F14
1.34
E
+
01 (1.33E-01)+
NaN
0
1.29
E
+
01 (1.19E-01)+
NaN
0
1.28
E
+
01 (3.00E-01)
NaN
0
Better
22
14
Similar
2
8
Worse
3
5
Note: “+”, “−”, and “~” indicate that MLBBO is significantly better, worse, and indifferent, respectively, compared with other algorithms.Figure 5
Convergence curves of mean fitness values of MLBBO, OXDE, and DE/BBO for functions f3, f5, f6, f12, F3, F5, F9, F10, and F14.From Table4, we can see that results of MLBBO are significantly better than those of OXDE in 22 out of 27 high-dimensional functions, while the results of OXDE outperform those of MLBBO on only 3 functions. When compared with DE/BBO, MLBBO outperforms DE/BBO on 14 functions out of 27 test functions whereas DE/BBO surpasses MLBBO on 5 functions. For the rest 8 functions, there is no significant difference based on two tails t-test. MLBBO, DE/BBO, and OXDE obtain the VTR over all 30 successful runs within the MaxNFFEs for 16, 12, and 3 test functions, respectively. From this, we can come to a conclusion that MLBBO is more robust than DE/BBO and OXDE, which can be proved in Figure 5.Further more, the average NFFEs MLBBO needed for the successful run is less than DE/BBO on most functions, which can also be indicate in Figure5.


### 4.6. Effect of Dimensionality

In order to investigate the influence of scalability on the performance of MLBBO, we carry out a scalability study with DE, original BBO, DE/BBO [15], and aBBOmDE [14] for scalable functions. In the experimental study, the first 13 standard benchmark functions are studied at Dim = 10, 50, 100, and 200, and the other test functions are studied at Dim = 10, 50, and 100. For Dim = 10, the population size is equal to 50 and the population size is set to 100 for other dimensions in this paper. MaxNFFEs is set to Dim * 10000. All the functions are optimized over 30 independent runs in this paper. The average and standard deviation of fitness values of four compared algorithms are summarized in Table 5 for standard test functions f1–f13 and Table 6 for CEC 2005 test functions F1–F14. The convergence curves of mean fitness values under 30 independent runs are listed in Figure 6. Furthermore, the results of statistical paired t-test between MLBBO and others are also list in Tables 5 and 6.Table 5
Scalability study atDim = 10, 50, 100, and 200 a ter Dim * 10,000 NFFEs for standard functions f1–f13.
MLBBO
DE
BBO
DE/BBO
aBBOmDE
Mean (std)
Mean (std)
Mean (std)
Mean (std)
Mean (std)
dim= 10
f1
1.55
E
-
88 (6.53E-88)
8.83
E
-
76 (1.89E-75)+
2.14
E
-
02 (2.04E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
1.49
E
-
270
(
0.00
E
+
00
)
f2
2.82
E
-
46 (3.66E-46)
1.85
E
-
36 (1.75E-36)+
1.02
E
-
01 (3.41E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
—
f3
6.37
E
-
45 (2.80E-44)
8.54
E
-
53 (1.67E-52)−
3.29
E
+
00 (2.02E+00)+
6.07
E
-
14
(
9.60
E
-
14
)
—
f4
3.27
E
-
31 (4.18E-31)
4.02
E
-
29 (6.60E-29)+
5.77
E
-
01 (2.57E-01)−
1.58
E
-
16
(
9.88
E
-
17
)
—
f5
1.05
E
-
30 (4.30E-30)
0.00
E
+
00 (0.00E+00)−
1.43
E
+
01 (1.09E+01)+
3.40
E
+
00
(
8.03
E
-
01
)
8.26
E
+
00
(
1.69
E
+
01
)
f6
0.00
E
+
00 (0.00E+00)
6.67
E
-
02 (2.54E-01)−
0.00
E
+
00 (0.00E+00)~
0.00
E
+
00
(
0.00
E
+
00
)
—
f7
9.78
E
-
04 (7.39E-04)
1.20
E
-
03 (8.19E-04)−
6.52
E
-
04 (7.36E-04)~
1.11
E
-
03
(
3.96
E
-
04
)
—
f8
0.00
E
+
00 (0.00E+00)
5.92
E
+
01 (8.66E+01)+
5.99
E
-
02 (3.51E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
9.09
E
-
14
(
2.76
E
-
13
)
f9
0.00
E
+
00 (0.00E+00)
7.75
E
+
00 (6.62E+00)+
1.20
E
-
02 (1.26E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
0.00
E
+
00
(
0.00
E
+
00
)
f10
2.31
E
-
15 (1.08E-15)
2.66
E
-
15 (0.00E+00)−
6.60
E
-
02 (2.58E-02)+
5.89
E
-
16
(
0.00
E
+
00
)
2.88
E
-
15
(
8.52
E
-
16
)
f11
3.94
E
-
03 (6.86E-03)
7.43
E
-
02 (5.45E-02)+
9.48
E
-
02 (3.40E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
4.48
E
-
02
(
2.26
E
-
02
)
f12
4.71
E
-
32 (1.67E-47)
4.71
E
-
32 (1.67E-47)−
1.02
E
-
03 (1.34E-03)+
4.71
E
-
32
(
0.00
E
+
00
)
4.71
E
-
32
(
0.00
E
+
00
)
f13
1.35
E
-
32 (5.57E-48)
2.85
E
-
32 (8.23E-32)−
4.01
E
-
03 (4.29E-03)+
1.35
E
-
32
(
0.00
E
+
00
)
1.35
E
-
32
(
0.00
E
+
00
)
dim = 50
f1
2.47
E
-
63 (2.84E-63)
4.42
E
-
38 (6.97E-38)+
1.30
E
-
01 (3.46E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
3.3
E
-
154
(
1.4
E
-
153
)
f2
8.54
E
-
35 (8.90E-35)
6.66
E
-
19 (6.04E-19)+
5.54
E
-
01 (8.06E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
—
f3
1.23
E
-
07 (1.49E-07)
3.73
E
-
06 (6.23E-06)+
7.87
E
+
02 (1.76E+02)+
5.20
E
-
02
(
2.48
E
-
02
)
—
f4
2.08
E
-
02 (4.36E-03)
1.27
E
+
00 (7.82E-01)+
4.08
E
+
00 (4.88E-01)+
3.42
E
-
03
(
2.28
E
-
02
)
—
f5
2.25
E
-
02 (5.80E-02)
1.06
E
+
00 (1.79E+00)+
1.44
E
+
02 (4.15E+01)+
4.43
E
+
01
(
1.39
E
+
01
)
9.50
E
+
00
(
2.69
E
+
01
)
f6
0.00
E
+
00 (0.00E+00)
5.87
E
+
00 (4.56E+00)+
1.00
E
-
01 (3.05E-01)~
0.00
E
+
00
(
0.00
E
+
00
)
—
f7
5.07
E
-
03 (1.31E-03)
1.53
E
-
02 (5.01E-03)+
2.91
E
-
04 (2.60E-04)−
4.05
E
-
03
(
9.20
E
-
04
)
—
f8
1.82
E
-
11 (0.00E+00)
1.41
E
+
04 (3.44E+02)+
4.01
E
-
01 (1.38E-01)+
2.37
E
+
00
(
1.67
E
+
01
)
2.39
E
-
11
(
3.69
E
-
12
)
f9
0.00
E
+
00 (0.00E+00)
3.55
E
+
02 (1.98E+01)+
7.01
E
-
02 (2.29E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
4.43
E
-
14
(
4.78
E
-
14
)
f10
9.65
E
-
15 (3.55E-15)
5.97
E
-
11 (2.95E-10)−
7.78
E
-
02 (1.34E-02)+
5.92
E
-
15
(
1.79
E
-
15
)
2.56
E
-
14
(
6.06
E
-
15
)
f11
1.31
E
-
03 (4.51E-03)
5.01
E
-
03 (6.35E-03)+
1.55
E
-
01 (4.64E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
2.78
E
-
02
(
3.42
E
-
02
)
f12
9.63
E
-
33 (7.86E-34)
7.06
E
-
02 (1.22E-01)+
2.89
E
-
04 (2.03E-04)+
9.42
E
-
33
(
0.00
E
+
00
)
9.42
E
-
33
(
0.00
E
+
00
)
f13
1.37
E
-
32 (9.00E-34)
1.05
E
-
15 (5.77E-15)−
7.82
E
-
03 (5.78E-03)+
1.35
E
-
32
(
0.00
E
+
00
)
1.35
E
-
32
(
0.00
E
+
00
)
dim= 100
f1
6.53
E
-
51 (9.15E-51)
1.02
E
-
34 (1.06E-34)+
2.89
E
-
01 (6.31E-02)+
6.16
E
-
34
(
1.97
E
-
33
)
1.18
E
-
96
(
3.26
E
-
96
)
f2
1.02
E
-
25 (2.25E-25)
8.20
E
-
19 (1.40E-18)+
1.14
E
+
00 (1.18E-01)+
0.00
E
+
00
(
0.00
E
+
00
)
—
f3
1.37
E
-
01 (5.93E-02)
5.70
E
+
00 (1.93E+00)+
2.93
E
+
03 (4.86E+02)+
3.10
E
-
04
(
1.12
E
-
04
)
—
f4
4.52
E
-
01 (3.11E-01)
2.99
E
+
01 (3.74E+00)+
6.01
E
+
00 (5.71E-01)+
2.71
E
+
00
(
2.58
E
+
00
)
—
f5
3.89
E
+
01 (4.22E+01)
9.25
E
+
01 (4.78E+01)+
3.22
E
+
02 (6.74E+01)+
1.19
E
+
02
(
3.38
E
+
01
)
2.57
E
+
01
(
4.08
E
+
01
)
f6
0.00
E
+
00 (0.00E+00)
6.32
E
+
01 (2.38E+01)+
6.67
E
-
02 (2.54E-01)~
0.00
E
+
00
(
0.00
E
+
00
)
—
f7
1.80
E
-
02 (3.88E-03)
5.49
E
-
02 (1.35E-02)+
1.92
E
-
04 (2.20E-04)-
6.87
E
-
03
(
1.15
E
-
03
)
—
f8
1.18
E
-
10 (1.19E-11)
3.20
E
+
04 (5.23E+02)+
8.23
E
-
01 (2.07E-01)+
7.11
E
+
00
(
2.84
E
+
01
)
1.07
E
+
02
(
1.13
E
+
02
)
f9
2.61
E
-
13 (2.66E-13)
8.25
E
+
02 (4.72E+01)+
1.37
E
-
01 (3.12E-02)+
7.36
E
-
01
(
8.48
E
-
01
)
1.59
E
-
01
(
3.68
E
-
01
)
f10
4.22
E
-
14 (1.35E-14)
2.25
E
+
00 (4.92E-01)+
8.26
E
-
02 (1.08E-02)+
7.84
E
-
15
(
7.03
E
-
16
)
4.25
E
-
14
(
7.99
E
-
15
)
f11
5.40
E
-
03 (1.22E-02)
3.69
E
-
03 (5.92E-03)~
1.92
E
-
01 (4.99E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
5.10
E
-
02
(
8.89
E
-
02
)
f12
1.89
E
-
32 (2.43E-32)
5.80
E
-
01 (9.46E-01)+
2.70
E
-
04 (2.70E-04)+
4.71
E
-
33
(
0.00
E
+
00
)
4.71
E
-
33
(
0.00
E
+
00
)
f13
3.37
E
-
32 (2.21E-32)
1.15
E
+
02 (3.29E+01)+
1.08
E
-
02 (3.98E-03)+
1.76
E
-
32
(
2.68
E
-
32
)
1.55
E
-
32
(
5.98
E
-
33
)
dim= 200
f1
8.01
E
-
25 (1.23E-24)
8.65
E
-
27 (2.72E-26)−
7.98
E
-
01 (1.33E-01)+
3.07
E
-
32
(
2.48
E
-
32
)
5.70
E
-
50
(
7.34
E
-
50
)
f2
5.12
E
-
05 (1.08E-04)
3.58
E
-
14 (7.43E-14)−
2.55
E
+
00 (1.71E-01)+
5.83
E
-
17
(
8.11
E
-
17
)
—
f3
6.39
E
+
01 (1.05E+01)
8.28
E
+
02 (1.97E+02)+
9.04
E
+
03 (7.12E+02)+
2.22
E
+
05
(
5.90
E
+
04
)
—
f4
7.13
E
+
00 (1.63E+00)
4.27
E
+
01 (3.11E+00)+
8.84
E
+
00 (6.49E-01)+
1.59
E
+
01
(
3.43
E
+
00
)
—
f5
3.09
E
+
02 (6.35E+01)
3.23
E
+
02 (8.13E+01)~
6.29
E
+
02 (6.26E+01)+
2.95
E
+
02
(
4.48
E
+
01
)
2.16
E
+
02
(
9.98
E
+
01
)
f6
0.00
E
+
00 (0.00E+00)
9.36
E
+
02 (4.50E+02)+
0.00
E
+
00 (0.00E+00)~
0.00
E
+
00
(
0.00
E
+
00
)
—
f7
8.07
E
-
02 (1.24E-02)
2.11
E
-
01 (5.40E-02)+
1.46
E
-
04 (1.06E-04)−
1.56
E
-
02
(
2.82
E
-
03
)
—
f8
1.14
E
-
09 (1.55E-09)
6.96
E
+
04 (6.12E+02)+
2.13
E
+
00 (3.30E-01)+
2.01
E
+
02
(
1.68
E
+
02
)
3.08
E
+
02
(
2.22
E
+
02
)
f9
9.75
E
-
12 (1.66E-11)
3.38
E
+
02 (2.06E+02)+
3.25
E
-
01 (3.98E-02)+
1.76
E
+
01
(
2.89
E
+
00
)
1.19
E
+
00
(
7.52
E
-
01
)
f10
5.30
E
-
13 (1.11E-12)
6.00
E
+
00 (1.09E+00)+
9.92
E
-
02 (9.67E-03)+
1.09
E
-
14
(
1.12
E
-
15
)
1.09
E
-
13
(
1.85
E
-
14
)
f11
5.29
E
-
03 (1.73E-02)
2.83
E
-
02 (7.57E-02)~
2.88
E
-
01 (5.72E-02)+
1.11
E
-
16
(
0.00
E
+
00
)
5.54
E
-
02
(
1.10
E
-
01
)
f12
1.90
E
-
15 (5.83E-15)
2.36
E
+
00 (2.35E+00)+
3.09
E
-
04 (1.61E-04)+
2.36
E
-
33
(
0.00
E
+
00
)
2.36
E
-
33
(
0.00
E
+
00
)
f13
2.25
E
-
25 (2.56E-25)
4.01
E
+
02 (5.11E+01)+
3.17
E
-
02 (7.13E-03)+
8.36
E
-
32
(
1.44
E
-
31
)
1.35
E
-
32
(
0.00
E
+
00
)
Note: “+”, “−”, and “~” indicate that MLBBO is significantly better, worse, and indifferent, respectively, compared with other algorithms.Table 6
Scalability study atDim = 10, 50, and 100 after Dim *  10,000 NFFEsfor CEC 2005 test functions F1–F14.
MLBBO
DE
BBO
DE/BBO
aBBOmDE
Mean(std)
Mean(std)
Mean(std)
Mean(std)
Mean(std)
dim=10
F1
0.00
E
+
00
(
0.00
E
+
00
)
4.71
E
-
29
(
8.06
E
-
29
)
+
1.86
E
-
02
(
9.76
E
-
03
)
+
0.00
E
+
00
(
0.00
E
+
00
)
~
0.00
E
+
00
(
0.00
E
+
00
)
F2
7.11
E
-
29
(
7.42
E
-
29
)
6.31
E
-
29
(
7.57
E
-
29
)
~
3.73
E
+
01
(
3.75
E
+
01
)
+
8.50
E
-
25
(
2.82
E
-
24
)
~
3.65
E
-
23
(
2.58
E
-
22
)
F3
8.40
E
+
01
(
4.19
E
+
02
)
8.05
E
-
25
(
9.16
E
-
25)~
2.37
E
+
06
(
3.01
E
+
06
)
+
1.86
E
+
04
(
3.53
E
+
04
)
+
1.02
E
+
05
(
9.77
E
+
04
)
F4
7.28
E
-
29
(
9.57
E
-
29
)
3.91
E
-
29
(
7.05
E
-
29
)
~
3.01
E
+
02
(
3.31
E
+
02
)
+
2.27
E
-
21
(
3.78
E
-
21
)
+
1.96
E
-
02
(
6.19
E
-
02
)
F5
3.00
E
-
12
(
5.10
E
-
12
)
1.97
E
-
12
(
2.41
E
-
12
)
~
1.68
E
+
03
(
1.09
E
+
03
)
+
2.88
E
-
05
(
1.48
E
-
04
)
+
4.08
E
+
02
(
6.93
E
+
02
)
F6
4.98
E
-
26
(
1.94
E
-
25
)
1.32
E
-
26
(
1.78
E
-
26
)
~
1.26
E
+
02
(
1.35
E
+
02
)
+
4.10
E
+
00
(
2.20
E
+
00
)
+
1.40
E
+
02
(
8.22
E
+
02
)
F7
5.87
E
-
02
(
4.35
E
-
02
)
1.35
E
-
01
(
1.44
E
-
01
)
+
1.33
E
+
00
(
4.04
E
-
01
)
+
3.86
E
-
02
(
2.36
E
-
02
)
−
1.15
E
+
00
(
1.08
E
+
00
)
F8
2.04
E
+
01
(
7.80
E
-
02
)
2.03
E
+
01
(
7.32
E
-
02
)
~
2.04
E
+
01
(
1.25
E
-
01
)
~
2.04
E
+
01
(
5.13
E
-
02
)
~
2.03
E
+
01
(
8.35
E
-
02
)
F9
0.00
E
+
00
(
0.00
E
+
00
)
8.39
E
+
00
(
6.94
E
+
00
)
+
8.88
E
-
03
(
4.51
E
-
03
)
+
0.00
E
+
00
(
0.00
E
+
00
)
~
3.12
E
-
09
(
2.21
E
-
08
)
F10
6.16
E
+
00
(
2.97
E
+
00
)
2.29
E
+
01
(
5.74
E
+
00
)
+
1.82
E
+
01
(
8.69
E
+
00
)
+
5.98
E
+
00
(
2.42
E
+
00
)
~
1.57
E
+
01
(
6.04
E
+
00
)
F11
1.72
E
+
00
(
1.59
E
+
00
)
2.48
E
+
00
(
3.86
E
+
00
)
~
6.93
E
+
00
(
1.43
E
+
00
)
+
8.28
E
-
01
(
1.39
E
+
00
)
−
—
F12
3.47
E
+
02
(
6.08
E
+
02
)
2.55
E
+
02
(
5.30
E
+
02
)
~
7.23
E
+
02
(
7.48
E
+
02
)
+
1.04
E
+
02
(
3.40
E
+
02
)
~
—
F13
5.56
E
-
01
(
7.44
E
-
02
)
1.81
E
+
00
(
6.08
E
-
01
)
+
3.62
E
-
01
(
1.35
E
-
01
)
−
5.36
E
-
01
(
4.82
E
-
02
)
~
—
F14
2.42
E
+
00
(
4.92
E
-
01
)
2.54
E
+
00
(
3.02
E
-
01
)
~
3.59
E
+
00
(
3.82
E
-
01
)
+
3.09
E
+
00
(
1.76
E
-
01
)
+
—
dim=50
F1
8.25
E
-
29
(
9.41
E
-
29
)
1.77
E
-
27
(
5.83
E
-
28
)
+
1.18
E
-
01
(
3.22
E
-
02
)
+
0.00
E
+
00
(
0.00
E
+
00
)
−
0.00
E
+
00
(
0.00
E
+
00
)
F2
9.11
E
-
07
(
9.91
E
-
07
)
1.06
E
-
04
(
1.75
E
-
04
)
+
1.25
E
+
04
(
3.69
E
+
03
)
+
1.04
E
+
03
(
3.04
E
+
02
)
+
2.62
E
-
02
(
7.17
E
-
02
)
F3
1.86
E
+
05
(
6.84
E
+
04
)
5.49
E
+
05
(
2.01
E
+
05
)
+
1.93
E
+
07
(
5.90
E
+
06
)
+
7.20
E
+
06
(
2.38
E
+
06
)
+
1.33
E
+
06
(
4.89
E
+
05
)
F4
1.73
E
+
01
(
1.58
E
+
01
)
3.19
E
+
02
(
2.52
E
+
02
)
+
4.36
E
+
04
(
1.19
E
+
04
)
+
7.26
E
+
03
(
2.17
E
+
03
)
+
1.29
E
+
04
(
7.15
E
+
03
)
F5
4.18
E
+
03
(
6.24
E
+
02
)
2.66
E
+
03
(
5.09
E
+
02
)
−
1.16
E
+
04
(
1.63
E
+
03
)
+
2.88
E
+
03
(
4.22
E
+
02
)
−
1.40
E
+
04
(
2.67
E
+
03
)
F6
2.88
E
+
00
(
1.48
E
+
01
)
1.16
E
+
00
(
1.83
E
+
00
)
~
3.05
E
+
02
(
8.39
E
+
01
)
+
5.36
E
+
01
(
2.14
E
+
01
)
+
4.06
E
+
01
(
5.66
E
+
01
)
F7
1.41
E
-
02
(
1.45
E
-
02
)
8.45
E
-
03
(
1.06
E
-
02
)
~
1.23
E
+
00
(
9.07
E
-
02
)
+
2.79
E
-
03
(
6.55
E
-
03
)
−
1.15
E
-
02
(
1.55
E
-
02
)
F8
2.11
E
+
01
(
3.23
E
-
02
)
2.11
E
+
01
(
3.37
E
-
02
)
~
2.10
E
+
01
(
8.21
E
-
02
)
−
2.11
E
+
01
(
4.21
E
-
02
)
~
2.11
E
+
01
(
5.39
E
-
02
)
F9
4.74
E
-
16
(
1.14
E
-
15
)
3.83
E
+
02
(
3.57
E
+
01
)
+
6.67
E
-
02
(
2.01
E
-
02
)
+
3.32
E
-
02
(
1.82
E
-
01
)
~
2.22
E
-
08
(
1.57
E
-
07
)
F10
8.66
E
+
01
(
2.22
E
+
01
)
4.30
E
+
02
(
3.36
E
+
01
)
+
9.98
E
+
01
(
2.82
E
+
01
)
+
1.63
E
+
02
(
1.35
E
+
01
)
+
1.48
E
+
02
(
4.15
E
+
01
)
F11
3.60
E
+
01
(
8.40
E
+
00
)
7.28
E
+
01
(
1.86
E
+
00
)
+
5.85
E
+
01
(
4.62
E
+
00
)
+
5.92
E
+
01
(
1.44
E
+
00
)
+
—
F12
6.77
E
+
03
(
5.32
E
+
03
)
7.37
E
+
03
(
8.05
E
+
03
)
~
5.15
E
+
04
(
2.61
E
+
04
)
+
1.05
E
+
04
(
9.38
E
+
03
)
~
—
F13
5.56
E
+
00
(
2.76
E
-
01
)
3.25
E
+
01
(
2.06
E
+
00
)
+
1.86
E
+
00
(
2.58
E
-
01
)
−
5.23
E
+
00
(
2.88
E
-
01
)
−
—
F14
2.23
E
+
01
(
3.53
E
-
01
)
2.30
E
+
01
(
1.80
E
-
01
)
+
2.27
E
+
01
(
3.76
E
-
01
)
+
2.26
E
+
01
(
1.62
E
-
01
)
+
—
dim=100
F1
7.98
E
-
28
(
1.15
E
-
27
)
6.80
E
-
27
(
2.04
E
-
27
)
+
2.99
E
-
01
(
6.26
E
-
02
)
+
1.68
E
-
29
(
5.19
E
-
29
)
−
—
F2
5.61
E
-
01
(
2.38
E
-
01
)
1.05
E
+
02
(
4.54
E
+
01
)
+
3.98
E
+
04
(
7.34
E
+
03
)
+
2.42
E
+
04
(
5.08
E
+
03
)
+
—
F3
2.02
E
+
06
(
5.35
E
+
05
)
2.06
E
+
06
(
7.13
E
+
05
)
~
4.52
E
+
07
(
9.83
E
+
06
)
+
1.42
E
+
07
(
4.15
E
+
06
)
+
—
F4
1.63
E
+
04
(
8.27
E
+
03
)
4.31
E
+
04
(
1.13
E
+
04
)
+
1.48
E
+
05
(
2.52
E
+
04
)
+
8.47
E
+
04
(
1.16
E
+
04
)
+
—
F5
1.32
E
+
04
(
1.40
E
+
03
)
8.11
E
+
03
(
1.29
E
+
03
)
−
3.01
E
+
04
(
3.32
E
+
03
)
+
6.08
E
+
03
(
6.28
E
+
02
)
−
—
F6
3.98
E
+
01
(
3.59
E
+
01
)
1.24
E
+
02
(
5.05
E
+
01
)
+
4.74
E
+
02
(
5.32
E
+
01
)
+
1.15
E
+
02
(
2.81
E
+
01
)
+
—
F7
3.69
E
-
03
(
6.49
E
-
03
)
4.02
E
-
03
(
6.19
E
-
03
)
~
1.21
E
+
00
(
6.38
E
-
02
)
+
1.48
E
-
03
(
3.97
E
-
03
)
~
—
F8
2.13
E
+
01
(
2.16
E
-
02
)
2.13
E
+
01
(
2.32
E
-
02
)
~
2.11
E
+
01
(
5.63
E
-
02
)
−
2.13
E
+
01
(
2.05
E
-
02
)
~
—
F9
1.03
E
-
14
(
4.70
E
-
15
)
7.80
E
+
02
(
3.06
E
+
02
)
+
1.34
E
-
01
(
3.10
E
-
02
)
+
1.56
E
+
00
(
1.10
E
+
00
)
+
—
F10
2.96
E
+
02
(
5.14
E
+
01
)
1.10
E
+
03
(
4.50
E
+
01
)
+
2.74
E
+
02
(
3.77
E
+
01
)
~
3.97
E
+
02
(
2.50
E
+
01
)
+
—
Note: “+”, “−”, and “~” indicate that MLBBO is significantly better, worse, and indifferent, respectively, compared with other algorithms.Figure 6
Mean fitness curves to compare the scalability of MLBBO, DE, BBO, and DE/BBO for selected functions:(1) f2 (Dim = 100), (2) f8 (Dim = 100), (3) f12 (Dim = 100), (4) f3 (Dim = 200), (5) f10 (Dim = 200), (6) f13 (Dim = 200), (7) F1 (Dim = 10), (8) F5 (Dim = 10), (9) F8 (Dim = 10), (10) F13 (Dim = 10), (11) F3 (Dim = 50), (12) F10 (Dim = 50), (13) F11 (Dim = 50), (14) F12 (Dim = 50), (15) F2 (Dim= 100), (16) F3 (Dim = 100), (17) F4 (Dim = 100), and(18) F9 (Dim = 100).It is to note that the results of DE/BBO [15] for standard functions f1–f13 are taken from corresponding paper under 50 independent runs. The results of aBBOmDE [14] for all the functions are taken from the paper directly, which are carried out with different population size (for Dim = 10, the population size equals 30, and for other Dimensions, it sets to Dim) under 50 independently runs.For standard functions f1–f13, we can see from Table5 that the overall results are decreasing for five compared algorithms since increasing the problem dimensions leads to algorithms that are sometimes unable to find the global optima solution within limit MaxNFFEs. Similar to Dim = 30, MLBBO outperforms DE on the majority of functions and overcomes BBO on almost all the functions at every dimension; MLBBO is better than or similar to DE/BBO on most of the functions.When compared with aBBOmDE, we can see from Table5 that MLBBO is better than or similar to aBBOmDE on most of the functions too. By carefully looking at results, we can recognize that results of some functions of MLBBO are worse than those of aBBOmDE in precision, but robustness of MLBBO is clearly better than aBBOmDE. For example, MLBBO and aBBOmDE find better solution for functions f8 and f9 when Dim = 10 and 50; aBBOmDE fails to solve functions f8 and f9 when Dim increases to 100 and 200, but MLBBO can solve functions f8 and f9 as before. This may be due to modified DE mutation being used in aBBOmDE as local search to accelerate the convergence speed, but modified DE mutation is used in MLBBO as a formula to supplement with migration operator and enhance the exploration ability of MLBBO.For CEC 2005 test functions F1–F14, we can obtain similar results, from Table6, that MLBBO is better than or similar to DE, BBO, and DE/BBO on most of functions when comparing MLBBO with these algorithms. However, results of MLBBO outperform aBBOmDE on most of the functions wherever Dim = 10 or Dim = 50.From the comparison, we can arrive to a conclusion that the total performance of MLBBO is better than the others, especially, for CEC 2005 test functions.Figure7 shows the NFFEs required to reach VTR with different dimensions for 13 standard benchmark functions (f1–f13) and 6 CEC 2005 test functions (F1, F2, F4, F6, F7, and F9). From Figure 7, we can see that as dimension increases, the required NFFEs increases exponentially, which may be due to an exponentially increase in local minima with dimension. Meanwhile, if we compare Figures 7(a) and 7(b), we can find that CEC 2005 test functions need more NFFEs to reach VTR than standard benchmark functions do, which may be due to that CEC 2005 functions are more complicated than standard benchmark functions. For example, for function f3 (Schwefel 1.2), F2 (Shifted Schwefel 1.2), and F4 (Shifted Schwefel 1.2 with Noise in Fitness), F4, F2, and f3 need 140486.7, 157596.7, and 289960 MeanFEs to reach VTR (10−6), respectively. Obviously, F4 is more complicated than f3 and F2; so, F4 needs 289960 MeanFEs to reach VTR,which is large than 140486.7 and 157596.NFFEs versus dimensions for (a) standard functions and (b) CEC 2005 functions.
(a)
Dimension
(b)
Dimension


### 4.7. Analysis of the Performance of Operators in MLBBO

As the analysis above, the proposed variant of BBO algorithm has achieved excellent performance. In this section, we analyze the performance of modified migration operator and local search mechanism in MLBBO. In order to analyze the performance fairly and systematically, we compare the performance in four cases: MLBBO with both modified migration operator and local search leaning mechanism, MLBBO with the modified migration operator and without local search leaning mechanism, MLBBO without modified migration operator and with local search leaning mechanism, and MLBBO without both modified migration operator and local search leaning mechanism (it is actually BBO). Four algorithms are denoted as MLBBO, MLBBO2, MLBBO3, and MLBBO4. The experimental tests are conducted with 30 independent runs. The parameter settings are set in Section4.1. The mean, standard deviation of fitness values of experimental test are summarized in Table 7. The numbers of successful runs are also recorded in Table 7. The results between MLBBO and MLBBO2, MLBBO and MLBBO3, and MLBBO and MLBBO4 are compared using two tails t-test. Convergence curves of mean fitness values under 30 independent runs are listed in Figure 8.Table 7
Analysis of the performance of operators in MLBBO.
MLBBO
MLBBO2
MLBBO3
MLBBO4
Mean (std)
SR
Mean (std)
SR
Mean (std)
SR
Mean (std)
SR
f1
2.03
E
-
31
(
1.77
E
-
31
)
30
2.95
E
-
18
(
1.05
E
-
18
)
+
30
4.53
E
-
05
(
2.65
E
-
05
)
+
0
2.17
E
-
04
(
7.92
E
-
05
)
+
0
f2
1.60
E
-
21
(
8.48
E
-
22
)
30
4.40
E
-
13
(
1.13
E
-
13
)
+
30
7.52
E
-
03
(
2.74
E
-
03
)
+
0
3.64
E
-
02
(
7.00
E
-
03
)
+
0
f3
1.47
E
-
20
(
2.10
E
-
20
)
30
2.94
E
-
12
(
1.94
E
-
12
)
+
30
1.88
E
+
00
(
6.10
E
-
01
)
+
0
1.98
E
+
00
(
5.63
E
-
01
)
+
0
f4
5.04
E
-
08
(
9.88
E
-
08
)
30
3.04
E
-
09
(
1.22
E
-
09
)
−
30
1.96
E
-
02
(
4.67
E
-
03
)
+
0
2.32
E
-
02
(
6.47
E
-
03
)
+
0
f5
1.02
E
-
20
(
3.71
E
-
20
)
30
1.54
E
-
14
(
1.06
E
-
14
)
+
30
4.79
E
+
01
(
3.28
E
+
01
)
+
0
3.64
E
+
01
(
3.58
E
+
01
)
+
0
f6
0.00
E
+
00
(
0.00
E
+
00
)
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
f7
2.63
E
-
03
(
1.24
E
-
03
)
30
4.00
E
-
03
(
7.68
E
-
04
)
+
30
3.25
E
-
03
(
1.64
E
-
03
)
~
30
1.28
E
-
02
(
5.07
E
-
03
)
+
11
f8
0.00
E
+
00
(
0.00
E
+
00
)
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
1.63
E
-
06
(
1.25
E
-
06
)
+
6
7.92
E
-
06
(
2.84
E
-
06
)
+
0
f9
0.00
E
+
00
(
0.00
E
+
00
)
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
7.93
E
-
04
(
4.64
E
-
04
)
+
0
3.60
E
-
03
(
1.46
E
-
03
)
+
0
f10
5.98
E
-
15
(
9.01
E
-
16
)
30
4.48
E
-
10
(
1.16
E
-
10
)
+
30
4.32
E
-
03
(
1.24
E
-
03
)
+
0
9.72
E
-
03
(
1.50
E
-
03
)
+
0
f11
3.70
E
-
03
(
6.02
E
-
03
)
19
0.00
E
+
00
(
0.00
E
+
00
)
−
30
1.07
E
-
01
(
6.87
E
-
02
)
+
1
8.16
E
-
02
(
5.71
E
-
02
)
+
0
f12
5.69
E
-
27
(
3.07
E
-
26
)
30
4.41
E
-
20
(
2.49
E
-
20
)
+
30
1.66
E
-
06
(
5.43
E
-
06
)
~
26
7.68
E
-
06
(
1.28
E
-
05
)
+
1
f13
5.79
E
-
32
(
5.53
E
-
32
)
30
3.60
E
-
19
(
1.65
E
-
19
)
+
30
3.33
E
-
05
(
1.16
E
-
04
)
~
0
5.70
E
-
05
(
5.07
E
-
05
)
+
0
F1
0.00
E
+
00
(
0.00
E
+
00
)
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
9.48
E
-
06
(
8.28
E
-
06
)
+
2
4.66
E
-
05
(
1.91
E
-
05
)
+
0
F2
2.37
E
-
12
(
2.46
E
-
12
)
30
2.79
E
-
06
(
2.44
E
-
06
)
+
4
4.10
E
+
01
(
1.07
E
+
01
)
+
0
2.39
E
+
01
(
1.01
E
+
01
)
+
0
F3
9.48
E
+
04
(
5.14
E
+
04
)
0
1.86
E
+
05
(
9.84
E
+
04
)
+
0
1.86
E
+
06
(
5.75
E
+
05
)
+
0
9.51
E
+
06
(
7.57
E
+
06
)
+
0
F4
1.21
E
-
04
(
2.76
E
-
04
)
4
6.57
E
-
03
(
8.98
E
-
03
)
+
0
1.12
E
+
04
(
4.05
E
+
03
)
+
0
4.89
E
+
03
(
1.77
E
+
03
)
+
0
F5
8.18
E
+
02
(
3.25
E
+
02
)
0
1.27
E
+
02
(
6.59
E
+
01
)
−
0
6.09
E
+
03
(
1.12
E
+
03
)
+
0
4.47
E
+
03
(
7.00
E
+
02
)
+
0
F6
1.93
E
-
09
(
3.11
E
-
09
)
30
7.82
E
-
04
(
4.05
E
-
03
)
~
29
9.26
E
+
02
(
1.86
E
+
03
)
+
0
2.09
E
+
03
(
4.48
E
+
03
)
+
0
F7
1.89
E
-
02
(
1.73
E
-
02
)
13
1.56
E
-
03
(
4.41
E
-
03
)
−
29
1.67
E
-
01
(
2.06
E
-
01
)
+
0
7.76
E
-
01
(
1.39
E
+
00
)
+
0
F8
2.10
E
+
01
(
5.38
E
-
02
)
0
2.09
E
+
01
(
6.06
E
-
02
)
~
0
2.09
E
+
01
(
4.10
E
-
02
)
~
0
2.10
E
+
01
(
3.80
E
-
02
)
~
0
F9
5.92
E
-
17
(
3.24
E
-
16
)
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
1.06
E
-
03
(
6.71
E
-
04
)
+
30
3.44
E
-
03
(
1.45
E
-
03
)
+
30
F10
3.76
E
+
01
(
1.40
E
+
01
)
0
9.74
E
+
01
(
6.54
E
+
00
)
+
0
3.79
E
+
01
(
1.05
E
+
01
)
~
0
1.22
E
+
02
(
8.19
E
+
00
)
+
0
F11
2.10
E
+
01
(
7.37
E
+
00
)
0
3.21
E
+
01
(
1.05
E
+
00
)
+
0
2.63
E
+
01
(
4.96
E
+
00
)
+
0
3.34
E
+
01
(
1.07
E
+
00
)
+
0
F12
2.07
E
+
03
(
2.71
E
+
03
)
0
1.36
E
+
04
(
1.97
E
+
04
)
+
0
1.26
E
+
04
(
9.29
E
+
03
)
+
0
8.05
E
+
03
(
7.03
E
+
03
)
+
0
F13
3.08
E
+
00
(
1.60
E
-
01
)
0
2.77
E
+
00
(
1.38
E
-
01
)
−
0
1.04
E
+
00
(
1.64
E
-
01
)
−
0
9.82
E
-
01
(
1.74
E
-
01
)
−
0
F14
1.28
E
+
01
(
2.38
E
-
01
)
0
1.30
E
+
01
(
1.62
E
-
01
)
+
0
1.25
E
+
01
(
2.65
E
-
01
)
−
0
1.30
E
+
01
(
1.86
E
-
01
)
+
0
Better
15
19
24
Similar
7
6
2
Worse
5
2
1
Note: “+”, “−”, and “~” indicate that MLBBO is significantly better, worse, and indifferent, respectively, compared with other algorithms.Figure 8
Mean fitness curves to analyze operators of MLBBO for selected functions f1, f6, f9, F1, F3, and F11.From Table7, we can find that MLBBO is significantly better than MLBBO2 on 15 functions out of 27 tests functions, whereas MLBBO2 outperforms MLBBO on 5 functions. For the rest 7 functions, there are no significant differences based on two tails t-test. From this, we know that local search mechanism has played an important role in improving the search ability, especially, in improving the solution precision, which can be proved through careful looking at fitness values. For example, for function f1–f10, both algorithms MLBBO and MLBBO2 achieve the optima, but the fitness values obtained by MLBBO are better than those obtained by MLBBO2 by several orders of magnitudes on these functions. When compared with MLBBO3, we can see that MLBBO outperforms MLBBO3 on 19 functions out of 27 test functions, while MLBBO is outperformed by MLBBO3 on only 2 functions. From this, we know that the modified migration operator has played a key role in optimizing the process and is better than original migration operator. Similar conclusion can also be obtained if we compare MLBBO2 and MLBBO4, MLBBO3 and MLBBO4.Furthermore, if we compare four algorithms together, the results of MLBBO4 are worse than those of MLBBO, especially, on multimodal functions, which means that the MLBBO has more powerful exploration ability than MLBBO4.


## 4.1. Experimental Setting

In this section, several experimental tests are carried out on 27 benchmark functions for validating the performance of the proposed algorithm. These functions consist of 13 standard benchmark functions [22] (f1–f13) and 14 complex functions (F1–F14) from the set of test problems listed in IEEE CEC 2005 [23]. All the test functions used in our experiments are high-dimensional functions with changeable dimension, which are only briefly summarized in Table 1. A more detailed description of each function is given in Table 8 (see also [22, 23]).Table 1
Test unctions used in our experimental tests.
Function name
Dimension
Search Space
Optima
f1
Sphere
n
[−100, 100]
0
f2
Schwefel’s Problem 2.22
n
[10, 10]
0
f3
Schwefel’s Problem 1.2
n
[−100, 100]
0
f4
Schwefel’s Problem 2.21
n
[−100, 100]
0
f5
Rosenbrock function
n
[−30, 30]
0
f6
Step function
n
[−100, 100]
0
f7
Quartic function
n
[−1.28, 1.28]
0
f8
Schwefel function
n
[−512, 512]
−12569.5
f9
Rastrigin function
n
[−5.12, 5.12]
0
f10
Ackley function
n
[−32, 32]
0
f11
Griewank function
n
[−600, 600]
0
f12
Penalized function 1
n
[−50, 50]
0
f13
Penalized function 2
n
[−50, 50]
0
F1
Shifted sphere function
n
[−100, 100]
−450
F2
Shifted Schwefel’s Problem 1.2
n
[−100, 100]
−450
F3
Shifted rotated high conditioned elliptic function
n
[−100, 100]
−450
F4
Shifted Schwefel’s Problem 1.2 with noise in fitness
n
[−100, 100]
−450
F5
Schwefel’s Problem 2.6 with global optimum on bounds
n
[−30, 30]
−310
F6
Shifted Rosenbrock’s function
n
[−100, 100]
390
F7
Shifted rotated Griewank’s function without bounds
n
Initialize in[0, 600]
−180
F8
Shifted rotated Ackley’s function with global optimum on bounds
n
[−32, 32]
−140
F9
Shifted Rastrigin’s function
n
[−5.12, 5.12]
−330
F10
Shifted Rotated Rastrigin’s function
n
[−5.12, 5.12]
−330
F11
Shifted Rotated Weierstrass function
n
[−600, 600]
90
F12
Schwefel’s Problem 2.13
n
[−100, 100]
−460
F13
Expanded extended Griewank’s plus Rosenbrock’s function (F8F2)
n
[−50, 50]
−130
F14
Shifted rotated expanded scaffer’s F6
n
[−100, 100]
−300For fair comparison, we have chosen a reasonable set of parameter values. For all experimental simulations in this paper, we will use the following parameters setting unless a change is mentioned:(1)
population size:NP= 100;(2)
maximum immigration rate:I =1;(3)
maximum emigration rate:E =1;(4)
mutation probability:mmax = 0.001;(5)
value to reach (VTR) = 10−6, except for f7, F6–F14 of VTR = 10−2;(6)
maximum number of fitness function evaluations (MaxNFFEs): 150,000 for f1, f6, f10, f12, and f13, 200,000 for f2, and f11, 300,000 for f7, f8, f9, F1–F14, and 500,000 for f3, f4, and f5.In our experimental tests, all the functions are optimized over 30 independent runs. All experimental tests are carried out on a computer with 1.86 GHz Intel core Processor, 1 GB of RAM, and Window XP operation system in Matlab software 7.6.


## 4.2. Effect of the Strength Alpha and Ratepl  on the Performance of MLBBO

In this section, we investigate the impact of local search strengthalpha and search probability pl on the proposed algorithm. In order to analyze the performance more scientific, eight functions are chosen from Table 1. They are Sphere, Schwefel 1.2, Schwefel, Penalized2, F1, F3, F10, and F13, which belong to standard unimodal function, standard multimodal function, shifted function, shifted rotated function, and expanded function, respectively. Search strength alpha are 0.3, 0.5, 0.8, and 1.1. Search rates pl are 0, 0.2, 0.4, 0.6, 0.8, and 1. It is important to note that pl equal to 0 means that local search mechanism is not conducted. Hence, in our experiments, alpha and pl are tested according to 24 situations. MLBBO algorithm executes 30 independent runs on each function, and convergence figures of average fitness values (which are function error values) are plotted in Figure 1.Figure 1
Results of MLBBO on eight test functions with differentalpha and pl.From Figure1, we can observe that different search rate pl have different results. When pl is 0, the results are worse than the others, which means that local search mechanism can improve the performance of proposed algorithm. When pl is 0.4, we obtain a faster convergence speed and better results on the Sphere function. For the other seven test functions, better results are obtained when search rate pl is 0.2 and 0.4. Moreover, the performance of MLBBO is most sensitive to search rate pl on function F8.From Figure1, we can also see that search strength alpha has little effect on the results as a whole. By careful looking, search strength alpha has an effect on the results when search rate pl is large, especially, when pl equals 0.8 or 1.For considering opinions of both sides, the search strengthalpha and search rate pl are set as 0.8 and 0.2, respectively.


## 4.3. Comparisons with BBO and DE/Best/2/Bin

For evaluating the performance of algorithms, we first compare MLBBO with BBO [8], which is consistent with original BBO except solution representation (real code) and DE/best/2/bin [7] (abbreviation as DE). For fair comparison, three algorithms are conducted on 27 functions with the same parameters setting above. The average and standard deviation of fitness values (which are function error values) after completion of 30 Monte Carlo simulations are summarized in Table 2. The number of successful runs and average of the number of fitness function evaluations (MeanFEs), needed in each run when the VTR is reached within the MaxNFFEs, are also recorded in Table 2. Furthermore, results of MLBBO and BBO, MLBBO and DE are compared with statistical paired t-test [24, 25], which is used to determine whether two paired solution sets differ from each other in a significant way. Convergence curves of mean fitness values and boxplot figures under 30 independent runs are listed in Figures 2 and 3, respectively.Table 2
Comparisons with BBO and DE.
DE
BBO
MLBBO
Mean (std)
MeanFEs
SR
Mean (Std)
MeanFEs
SR
Mean (std)
MeanFEs
SR
f1
2.72
E
-
20
(
2.09
E
-
20
)
+
4.47
E
+
04
30
3.23
E
-
01
(
1.18
E
-
01
)
+
NaN
0
2.78
E
-
31
(
3.25
E
-
31
)
2.83
E
+
04
30
f2
2.56
E
-
12
(
3.09
E
-
12
)
+
1.06
E
+
05
30
4.84
E
-
01
(
9.06
E
-
02
)
+
NaN
0
1.43
E
-
21
(
7.11
E
-
22
)
5.74
E
+
04
30
f3
2.31
E
-
19
(
2.37
E
-
19
)
+
1.51
E
+
05
30
1.26
E
+
02
(
5.19
E
+
01
)
+
NaN
0
1.90
E
-
20
(
3.03
E
-
20
)
1.40
E
+
05
30
f4
1.92
E
-
10
(
3.44
E
-
10
)
~
2.61
E
+
05
30
1.62
E
+
00
(
4.71
E
-
01
)
+
NaN
0
4.49
E
-
08
(
1.25
E
-
07
)
3.49
E
+
05
30
f5
1.05
E
-
28
(
8.92
E
-
29
)
-
1.62
E
+
05
30
7.85
E
+
01
(
3.51
E
+
01
)
+
NaN
0
3.34
E
-
21
(
9.08
E
-
21
)
2.25
E
+
05
30
f6
8.67
E
-
01
(
1.20
E
+
00
)
+
2.51
E
+
04
14
1.77
E
+
00
(
1.17
E
+
00
)
+
1.19
E
+
05
3
0.00
E
+
00
(
0.00
E
+
00
)
1.14
E
+
04
30
f7
5.65
E
-
03
(
2.10
E
-
03
)
+
1.44
E
+
05
29
3.64
E
-
04
(
2.77
E
-
04
)
-
2.21
E
+
04
30
2.23
E
-
03
(
9.91
E
-
04
)
6.61
E
+
04
30
f8
7.29
E
+
03
(
2.32
E
+
02
)
+
NaN
0
2.53
E
-
01
(
8.82
E
-
02
)
+
NaN
0
0.00
E
+
00
(
0.00
E
+
00
)
5.53
E
+
04
30
f9
1.76
E
+
02
(
1.01
E
+
01
)
+
NaN
0
3.56
E
-
02
(
1.52
E
-
02
)
+
NaN
0
0.00
E
+
00
(
0.00
E
+
00
)
9.16
E
+
04
30
f10
5.77
E
-
07
(
3.16
E
-
06
)
~
7.87
E
+
04
29
2.06
E
-
01
(
4.94
E
-
02
)
+
NaN
0
6.10
E
-
15
(
1.14
E
-
15
)
5.05
E
+
04
30
f11
6.57
E
-
03
(
6.25
E
-
03
)
+
4.54
E
+
04
12
2.81
E
-
01
(
9.76
E
-
02
)
+
NaN
0
2.87
E
-
03
(
5.02
E
-
03
)
3.33
E
+
04
22
f12
1.38
E
-
02
(
4.50
E
-
02
)
~
5.37
E
+
04
26
1.98
E
-
03
(
2.04
E
-
03
)
+
NaN
0
5.88
E
-
28
(
3.22
E
-
27
)
2.57
E
+
04
30
f13
1.90
E
-
20
(
5.93
E
-
20
)
~
4.65
E
+
04
30
2.09
E
-
02
(
9.94
E
-
03
)
+
NaN
0
5.09
E
-
32
(
3.13
E
-
32
)
2.71
E
+
04
30
F1
5.59
E
-
28
(
2.06
E
-
28
)
+
4.58
E
+
04
30
7.23
E
-
02
(
3.27
E
-
02
)
+
NaN
0
3.03
E
-
29
(
6.97
E
-
29
)
2.90
E
+
04
30
F2
7.59
E
-
12
(
8.42
E
-
12
)
+
1.72
E
+
05
30
3.55
E
+
03
(
1.35
E
+
03
)
+
NaN
0
1.97
E
-
12
(
2.55
E
-
12
)
1.58
E
+
05
30
F3
1.39
E
+
05
(
1.06
E
+
05
)
+
NaN
0
1.14
E
+
07
(
4.90
E
+
06
)
+
NaN
0
9.26
E
+
04
(
4.90
E
+
04
)
NaN
0
F4
7.10
E
-
05
(
1.61
E
-
04
)
~
2.85
E
+
05
1
1.39
E
+
04
(
4.56
E
+
03
)
+
NaN
0
7.00
E
-
05
(
1.87
E
-
04
)
2.90
E
+
05
5
F5
5.31
E
+
01
(
1.37
E
+
02
)
-
NaN
0
5.81
E
+
03
(
9.97
E
+
02
)
+
NaN
0
8.34
E
+
02
(
3.81
E
+
02
)
NaN
0
F6
1.58
E
-
13
(
7.82
E
-
13
)
~
1.46
E
+
05
30
2.23
E
+
02
(
8.03
E
+
01
)
+
NaN
0
2.11
E
-
09
(
6.68
E
-
09
)
1.85
E
+
05
30
F7
1.26
E
-
02
(
1.26
E
-
02
)
~
4.93
E
+
04
15
1.13
E
+
00
(
7.73
E
-
02
)
+
NaN
0
1.59
E
-
02
(
1.16
E
-
02
)
4.80
E
+
04
12
F8
2.09
E
+
01
(
5.20
E
-
02
)
~
NaN
0
2.08
E
+
01
(
1.06
E
-
01
)
-
NaN
0
2.09
E
+
01
(
7.07
E
-
02
)
NaN
0
F9
1.85
E
+
02
(
1.75
E
+
01
)
+
NaN
0
3.97
E
-
02
(
2.04
E
-
02
)
+
NaN
0
5.92
E
-
17
(
3.24
E
-
16
)
7.71
E
+
04
30
F10
2.05
E
+
02
(
1.96
E
+
01
)
+
NaN
0
5.26
E
+
01
(
1.19
E
+
01
)
+
NaN
0
3.47
E
+
01
(
1.24
E
+
01
)
NaN
0
F11
3.95
E
+
01
(
1.03
E
+
00
)
+
NaN
0
3.09
E
+
01
(
3.05
E
+
00
)
+
NaN
0
1.72
E
+
01
(
6.58
E
+
00
)
NaN
0
F12
1.19
E
+
03
(
2.32
E
+
03
)
~
2.31
E
+
05
3
1.41
E
+
04
(
9.84
E
+
03
)
+
NaN
0
2.07
E
+
03
(
2.92
E
+
03
)
NaN
0
F13
1.59
E
+
01
(
1.12
E
+
00
)
+
NaN
0
1.09
E
+
00
(
2.34
E
-
01
)
-
NaN
0
3.03
E
+
00
(
1.44
E
-
01
)
NaN
0
F14
1.34
E
+
01
(
1.51
E
-
01
)
+
NaN
0
1.31
E
+
01
(
3.83
E
-
01
)
+
NaN
0
1.27
E
+
01
(
2.40
E
-
01
)
NaN
0
Better
16
24
Similar
9
0
Worse
2
3
Note: “+”, “−”, and “~” indicate that MLBBO is significantly better, worse, and indifferent, respectively, compared with other algorithms.Figure 2
Convergence curves of mean fitness values of MLBBO, BBO, and DE for functions f1, f2, f3, f5, f6, f7, f8, f13, F1, F3, F4, F5, F7, F8, F9, F11, F13, and F14.Figure 3
ANOVA tests of fitness values of MLBBO, BBO, and DE for functions f1, f2, f3, f5, f6, f7, f8, f13, F1, F3, F4, F5, F7, F8, F9, F11, F13, and F14.From Table2, it is seen that MLBBO is significantly better than BBO on 24 functions out of 27 test functions, and MLBBO is outperformed by BBO on the rest 3 functions. When compared with DE, MLBBO gives significantly better performance on 16 functions. On 9 functions, there are no significant differences between MLBBO and DE based on the two tail t-test. For the rest 2 functions, DE are better than MLBBO. Moreover, MLBBO can obtain the VTR over all 30 successful runs within the MaxNFFEs for 16 out of 27 functions. Especially, for the first 13 standard benchmark functions, MLBBO obtains 30 successful runs on 12 functions except Griewank function, where 22 successful runs are obtained by MLBBO. DE and BBO obtain 30 successful runs on 9 and 1 out of 27 functions, respectively. From Table 2, we can find that MLBBO needs less or similar NFFEs than DE and BBO on most of the successful runs, which means that MLBBO has faster convergence speed than DE and BBO. The convergence speed and the robustness can also show in Figures 2 and 3.From the above results, we know that the total performance of MLBBO is significantly better than DE and BBO, which indicates that MLBBO not only integrates the exploration ability of DE and the exploitation ability of BBO simply, but also can balance both search abilities very well.


## 4.4. Comparisons with Improved BBO Algorithms

In this section, the performance of MLBBO is compared with improved BBO algorithms: (a) oppositional BBO (OBBO) [12], which is proposed by employing opposition-based learning (OBL) alongside BBO’s migration rates; (b) multi-operator BBO (MOBBO) [18], which is another modified BBO with multi-operator migration operator; (c) perturb BBO (PBBO) [16], which is a modified BBO with perturb migration operator; and (d) real-code BBO (RCBBO) [9]. For fair comparison, five improved BBO algorithms are conducted on 27 functions with the same parameters setting above. The mean and standard deviation of fitness values are summarized in Table 3. Further, the results between MLBBO and OBBO, MLBBO and PBBO, MLBBO and MOBBO, and MLBBO and RCBBO are compared using statistical paired t-test. Convergence curves of mean fitness values under 30 independent runs are plotted in Figure 4.Table 3
Comparisons with improved BBO algorithms.
OBBO
PBBO
MOBBO
RCBBO
MLBBO
Mean (std)
Mean (Std)
Mean (std)
Mean (std)
Mean (std)
f1
6.88
E
-
05
(
2.58
E
-
05
)
+
2.23
E
-
11
(
2.77
E
-
12
)
+
1.70
E
-
09
(
9.30
E
-
09
)
~
2.26
E
-
03
(
1.06
E
-
03
)
+
2.11
E
-
31
(
1.25
E
-
31
)
f2
2.76
E
-
02
(
4.80
E
-
03
)
+
3.47
E
-
06
(
2.67
E
-
07
)
+
2.74
E
-
05
(
1.48
E
-
04
)
~
8.96
E
-
02
(
1.58
E
-
02
)
+
1.58
E
-
21
(
7.25
E
-
22
)
f3
6.29
E
-
01
(
4.23
E
-
01
)
+
2.06
E
-
02
(
1.70
E
-
02
)
+
3.25
E
-
02
(
4.50
E
-
02
)
+
2.19
E
+
01
(
9.34
E
+
00
)
+
1.42
E
-
20
(
1.70
E
-
20
)
f4
1.47
E
-
02
(
3.18
E
-
03
)
+
1.20
E
-
02
(
3.30
E
-
03
)
+
2.43
E
-
02
(
6.74
E
-
03
)
+
1.20
E
+
00
(
1.25
E
+
00
)
+
5.28
E
-
08
(
1.02
E
-
07
)
f5
3.65
E
+
01
(
2.20
E
+
01
)
+
3.60
E
+
01
(
3.40
E
+
01
)
+
6.32
E
+
01
(
8.33
E
+
01
)
+
4.25
E
+
01
(
3.74
E
+
01
)
+
5.34
E
-
21
(
1.10
E
-
20
)
f6
0.00
E
+
00
(
0.00
E
+
00
)
~
0.00
E
+
00
(
0.00
E
+
00
)
~
0.00
E
+
00
(
0.00
E
+
00
)
~
0.00
E
+
00
(
0.00
E
+
00
)
~
0.00
E
+
00
(
0.00
E
+
00
)
f7
4.02
E
-
04
(
3.48
E
-
04
)
-
2.86
E
-
04
(
2.68
E
-
04
)
-
9.79
E
-
04
(
8.00
E
-
04
)
-
4.21
E
-
04
(
3.81
E
-
04
)
-
2.33
E
-
03
(
1.04
E
-
03
)
f8
2.40
E
+
02
(
1.82
E
+
02
)
+
1.70
E
-
11
(
2.26
E
-
12
)
+
1.55
E
-
11
(
8.50
E
-
11
)
~
8.17
E
-
05
(
3.15
E
-
05
)
+
0.00
E
+
00
(
0.00
E
+
00
)
f9
5.59
E
-
03
(
2.07
E
-
03
)
+
2.80
E
-
07
(
1.37
E
-
06
)
~
5.45
E
-
05
(
2.99
E
-
04
)
~
1.38
E
-
02
(
5.11
E
-
03
)
+
0.00
E
+
00
(
0.00
E
+
00
)
f10
7.38
E
-
03
(
1.88
E
-
03
)
+
2.08
E
-
06
(
5.39
E
-
06
)
+
9.74
E
-
08
(
5.97
E
-
09
)
+
2.94
E
-
02
(
6.63
E
-
03
)
+
6.10
E
-
15
(
6.49
E
-
16
)
f11
2.68
E
-
02
(
2.49
E
-
02
)
+
4.98
E
-
03
(
1.29
E
-
02
)
~
5.08
E
-
03
(
1.05
E
-
02
)
~
7.92
E
-
02
(
4.36
E
-
02
)
+
1.73
E
-
03
(
4.00
E
-
03
)
f12
1.82
E
-
06
(
2.26
E
-
06
)
+
6.71
E
-
11
(
3.18
E
-
10
)
~
3.46
E
-
03
(
1.89
E
-
02
)
~
3.39
E
-
05
(
3.47
E
-
05
)
+
2.35
E
-
32
(
3.98
E
-
32
)
f13
2.04
E
-
05
(
1.99
E
-
05
)
+
1.65
E
-
09
(
7.99
E
-
09
)
~
6.33
E
-
13
(
3.44
E
-
12
)
~
6.43
E
-
04
(
9.66
E
-
04
)
+
5.64
E
-
32
(
3.38
E
-
32
)
F1
1.40
E
-
05
(
8.26
E
-
06
)
+
2.67
E
-
11
(
9.69
E
-
11
)
~
1.16
E
-
07
(
6.34
E
-
07
)
~
3.50
E
-
04
(
9.25
E
-
05
)
+
2.02
E
-
29
(
6.16
E
-
29
)
F2
4.70
E
+
01
(
8.64
E
+
00
)
+
2.92
E
+
00
(
2.02
E
+
00
)
+
2.66
E
+
00
(
2.16
E
+
00
)
+
8.72
E
+
02
(
4.43
E
+
02
)
+
1.37
E
-
12
(
1.53
E
-
12
)
F3
1.56
E
+
06
(
3.45
E
+
05
)
+
2.10
E
+
06
(
6.86
E
+
05
)
+
2.37
E
+
06
(
9.89
E
+
05
)
+
4.46
E
+
06
(
1.58
E
+
06
)
+
9.02
E
+
04
(
5.54
E
+
04
)
F4
3.18
E
+
03
(
9.94
E
+
02
)
+
7.74
E
+
02
(
3.86
E
+
02
)
+
1.46
E
+
01
(
1.83
E
+
01
)
+
2.17
E
+
04
(
8.50
E
+
03
)
+
1.75
E
-
05
(
2.92
E
-
05
)
F5
1.03
E
+
04
(
1.63
E
+
03
)
+
3.68
E
+
03
(
6.27
E
+
02
)
+
5.04
E
+
03
(
1.24
E
+
03
)
+
6.31
E
+
03
(
1.18
E
+
03
)
+
8.00
E
+
02
(
3.79
E
+
02
)
F6
3.20
E
+
02
(
9.64
E
+
02
)
~
8.71
E
+
02
(
2.12
E
+
03
)
+
2.76
E
+
02
(
8.46
E
+
02
)
~
8.45
E
+
02
(
2.69
E
+
03
)
~
3.55
E
-
09
(
1.40
E
-
08
)
F7
2.46
E
-
02
(
1.52
E
-
02
)
+
1.62
E
-
02
(
1.45
E
-
02
)
~
2.26
E
-
02
(
1.99
E
-
02
)
+
7.64
E
-
01
(
1.39
E
+
00
)
+
1.38
E
-
02
(
1.21
E
-
02
)
F8
2.08
E
+
01
(
8.04
E
-
02
)
-
2.09
E
+
01
(
1.69
E
-
01
)
-
2.07
E
+
01
(
1.71
E
-
01
)
-
2.07
E
+
01
(
8.51
E
-
02
)
-
2.09
E
+
01
(
5.48
E
-
02
)
F9
5.80
E
-
03
(
2.39
E
-
03
)
+
9.69
E
-
07
(
3.88
E
-
06
)
~
1.22
E
-
07
(
6.61
E
-
07
)
~
1.32
E
-
02
(
5.53
E
-
03
)
+
5.92
E
-
17
(
3.24
E
-
16
)
F10
6.43
E
+
01
(
2.81
E
+
01
)
+
3.29
E
+
01
(
8.80
E
+
00
)
~
7.14
E
+
01
(
2.06
E
+
01
)
+
4.80
E
+
01
(
1.62
E
+
01
)
+
3.69
E
+
01
(
1.45
E
+
01
)
F11
2.36
E
+
01
(
3.19
E
+
00
)
+
2.09
E
+
01
(
4.48
E
+
00
)
~
2.70
E
+
01
(
4.11
E
+
00
)
+
3.19
E
+
01
(
3.90
E
+
00
)
+
1.95
E
+
01
(
7.87
E
+
00
)
F12
1.18
E
+
04
(
8.66
E
+
03
)
+
4.68
E
+
03
(
4.44
E
+
03
)
+
5.04
E
+
03
(
4.10
E
+
03
)
+
1.29
E
+
04
(
8.94
E
+
03
)
+
2.43
E
+
03
(
2.97
E
+
03
)
F13
1.08
E
+
00
(
1.96
E
-
01
)
-
1.14
E
+
00
(
2.07
E
-
01
)
-
1.09
E
+
00
(
2.29
E
-
01
)
-
9.61
E
-
01
(
1.57
E
-
01
)
-
2.98
E
+
00
(
1.62
E
-
01
)
F14
1.25
E
+
01
(
3.61
E
-
01
)
~
1.19
E
+
01
(
6.17
E
-
01
)
-
1.33
E
+
01
(
3.44
E
-
01
)
+
1.31
E
+
01
(
3.39
E
-
01
)
+
1.27
E
+
01
(
2.39
E
-
01
)
Better
21
13
13
22
Similar
3
10
11
2
Worse
3
4
3
3
Note: “+”, “−”, and “~” indicate that MLBBO is significantly better, worse, and indifferent, respectively, compared with other algorithms.Figure 4
Convergence curves of mean fitness values of MLBBO, OBBO, PBBO, MOBBO, and RCBBO for functions f1, f4, f8, f9, f6, f7, f8, f9, f10, F1, F7, and F11.From Table3, we can see that MLBBO outperforms OBBO on 21 out of 27 test functions whereas OBBO surpasses MLBBO on 3 functions. MLBBO obtains similar fitness values with OBBO on 3 functions based on two tail t-test. Similar results can be obtained when making a comparison between MLBBO and RCBBO. When compared with PBBO and MOBBO, MLBBO is significantly better than both PBBO and MOBBO on 13 functions. MLBBO obtains similar results with PBBO and MOBBO on 10 and 11 functions, respectively. PBBO surpasses MLBBO only on 4 functions, which are Quartic function, shifted rotated Ackley’s function, expanded extended Griewank’s plus Rosenbrock’s Function, and shifted rotated expanded Scaffer’s F6. MOBBO outperforms MLBBO only on 3 functions, which are Quartic function, shifted rotated Ackley’s function, and expanded extended Griewank’s plus Rosenbrock’s function. Furthermore, the total performance of MLBBO is better than PBBO and MOBBO and much better than OBBO and RCBBO.Furthermore, Figure4 shows similar results with Table 3. We can see that the convergence speed of PBBO an MOBBO are faster than the others in preliminary stages owing to their powerful exploitation ability, but the convergence speed decreases in the next iteration. However, MLBBO can converge to satisfactory solutions at equilibrium rapidly speed. From the comparison, we know that operators used in MLBBO can enhance exploration ability.


## 4.5. Comparisons with Hybrid Algorithms

In order to validate the performance of the proposed algorithms (MLBBO) further, we compare the proposed algorithm with hybrid algorithms: OXDE [26] and DE/BBO [15]. The mean standard deviation of fitness values of 27 test functions are listed in Table 4. The average NFFEs and successful runs are also listed in Table 4. Convergence curves of mean fitness values under 30 independent runs are plotted in Figure 5.Table 4
Comparisons with hybrid algorithms.
OXDE
DE/BBO
MLBBO
Mean (std)
MeanFEs
SR
Mean (std)
MeanFEs
SR
Mean (std)
MeanFEs
SR
f1
2.60
E
-
03 (9.04E-04)+
NaN
0
1.53
E
-
30 (1.48E-30)+
4.7
E
+
04
30
2.30
E
-
31 (2.74E-31)
2.8
E
+
04
30
f2
1.82
E
-
02 (4.77E-03)+
NaN
0
2.52
E
-
24 (1.74E-24)−
6.7
E
+
04
30
1.61
E
-
21 (7.89E-22)
5.8
E
+
04
30
f3
5.43
E
-
01 (2.52E-01)+
NaN
0
2.60
E
-
03 (1.72E-03)+
NaN
0
2.16
E
-
20 (3.19E-20)
1.4
E
+
05
30
f4
4.80
E
-
02 (7.19E-02)+
NaN
0
6.50
E
-
02 (2.23E-01)~
2.5
E
+
05
18
7.99
E
-
08 (1.38E-07)
3.5
E
+
05
30
f5
3.73
E
-
01 (7.68E-01)+
NaN
0
2.33
E
+
01 (9.10E+00)+
NaN
0
2.56
E
-
21 (6.21E-21)
2.3
E
+
05
30
f6
0.00
E
+
00 (0.00E+00)~
9.3
E
+
04
30
0.00
E
+
00 (0.00E+00)~
2.2
E
+
04
30
0.00
E
+
00 (0.00E+00)
1.1
E
+
04
30
f7
6.64
E
-
03 (1.97E-03)+
2.0
E
+
05
30
4.69
E
-
03 (1.54E-03)+
1.4
E
+
05
30
2.13
E
-
03 (9.10E-04)
6.7
E
+
04
30
f8
1.33
E
-
05 (1.57E-05)+
NaN
0
0.00
E
+
00 (0.00E+00)~
1.0
E
+
05
30
6.06
E
-
14 (3.32E-13)
5.5
E
+
04
30
f9
5.32
E
+
01 (6.72E+00)+
NaN
0
0.00
E
+
00 (0.00E+00)~
1.8
E
+
05
30
0.00
E
+
00 (0.00E+00)
9.2
E
+
04
30
f10
1.45
E
-
02 (2.75E-03)+
NaN
0
6.10
E
-
15 (6.49E-16)~
6.7
E
+
04
30
6.10
E
-
15 (6.49E-16)
5.0
E
+
04
30
f11
1.17
E
-
04 (1.35E-04)−
NaN
0
0.00
E
+
00 (0.00E+00)−
5.0
E
+
04
30
3.37
E
-
03 (4.64E-03)
2.8
E
+
04
19
f12
6.97
E
-
05 (3.20E-05)+
NaN
0
1.68
E
-
31 (1.43E-31)~
4.3
E
+
04
30
1.63
E
-
25 (8.95E-25)
2.7
E
+
04
30
f13
5.10
E
-
04 (2.19E-04)+
NaN
0
2.37
E
-
30 (2.69E-30)+
4.7
E
+
04
30
4.98
E
-
32 (4.19E-32)
2.7
E
+
04
30
F1
1.57
E
-
09 (7.48E-10)+
2.4
E
+
05
30
0.00
E
+
00 (0.00E+00)−
4.8
E
+
04
30
2.69
E
-
29 (6.98E-29)
2.9
E
+
04
30
F2
6.08
E
+
02 (1.92E+02)+
NaN
0
1.08
E
+
01 (1.07E+01)+
NaN
0
1.60
E
-
12 (1.57E-12)
1.6
E
+
05
30
F3
8.26
E
+
06 (2.15E+06)+
NaN
0
2.91
E
+
06 (1.01E+06)+
NaN
0
9.00
E
+
04 (4.99E+04)
NaN
0
F4
2.28
E
+
03 (7.46E+02)+
NaN
0
1.49
E
+
02 (8.27E+01)+
NaN
0
6.70
E
-
05 (1.87E-04)
2.9
E
+
05
6
F5
3.56
E
+
02 (9.42E+01)−
NaN
0
1.17
E
+
03 (2.83E+02)+
NaN
0
8.28
E
+
02 (3.40E+02)
NaN
0
F6
2.03
E
+
01 (1.74E+00)+
NaN
0
2.89
E
+
01 (1.61E+01)+
NaN
0
1.76
E
-
09 (6.58E-09)
1.9
E
+
05
30
F7
3.52
E
-
03 (1.07E-02)−
2.5
E
+
05
27
7.64
E
-
03 (5.42E-03)−
1.3
E
+
05
29
1.47
E
-
02 (1.47E-02)
5.0
E
+
04
19
F8
2.09
E
+
01
(
5.72
E
-
02)~
NaN
0
2.09
E
+
01 (4.84E-02)~
NaN
0
2.10
E
+
01 (4.54E-02)
NaN
0
F9
7.46
E
+
01 (1.03E+01)+
NaN
0
0.00
E
+
00 (0.00E+00)~
1.5
E
+
05
30
0.00
E
+
00 (0.00E+00)
7.8
E
+
04
30
F10
1.87
E
+
02 (1.13E+01)+
NaN
0
7.95
E
+
01 (9.19E+00)+
NaN
0
3.37
E
+
01 (9.16E+00)
NaN
0
F11
3.96
E
+
01 (9.53E-01)+
NaN
0
3.09
E
+
01 (1.35E+00)+
NaN
0
1.83
E
+
01 (8.49E+00)
NaN
0
F12
4.78
E
+
03 (4.49E+03)+
NaN
0
4.25
E
+
03 (3.87E+03)+
NaN
0
1.57
E
+
03 (1.87E+03)
NaN
0
F13
1.08
E
+
01 (7.91E-01)+
NaN
0
2.78
E
+
00 (1.94E-01)−
NaN
0
3.05
E
+
00 (1.88E-01)
NaN
0
F14
1.34
E
+
01 (1.33E-01)+
NaN
0
1.29
E
+
01 (1.19E-01)+
NaN
0
1.28
E
+
01 (3.00E-01)
NaN
0
Better
22
14
Similar
2
8
Worse
3
5
Note: “+”, “−”, and “~” indicate that MLBBO is significantly better, worse, and indifferent, respectively, compared with other algorithms.Figure 5
Convergence curves of mean fitness values of MLBBO, OXDE, and DE/BBO for functions f3, f5, f6, f12, F3, F5, F9, F10, and F14.From Table4, we can see that results of MLBBO are significantly better than those of OXDE in 22 out of 27 high-dimensional functions, while the results of OXDE outperform those of MLBBO on only 3 functions. When compared with DE/BBO, MLBBO outperforms DE/BBO on 14 functions out of 27 test functions whereas DE/BBO surpasses MLBBO on 5 functions. For the rest 8 functions, there is no significant difference based on two tails t-test. MLBBO, DE/BBO, and OXDE obtain the VTR over all 30 successful runs within the MaxNFFEs for 16, 12, and 3 test functions, respectively. From this, we can come to a conclusion that MLBBO is more robust than DE/BBO and OXDE, which can be proved in Figure 5.Further more, the average NFFEs MLBBO needed for the successful run is less than DE/BBO on most functions, which can also be indicate in Figure5.


## 4.6. Effect of Dimensionality

In order to investigate the influence of scalability on the performance of MLBBO, we carry out a scalability study with DE, original BBO, DE/BBO [15], and aBBOmDE [14] for scalable functions. In the experimental study, the first 13 standard benchmark functions are studied at Dim = 10, 50, 100, and 200, and the other test functions are studied at Dim = 10, 50, and 100. For Dim = 10, the population size is equal to 50 and the population size is set to 100 for other dimensions in this paper. MaxNFFEs is set to Dim * 10000. All the functions are optimized over 30 independent runs in this paper. The average and standard deviation of fitness values of four compared algorithms are summarized in Table 5 for standard test functions f1–f13 and Table 6 for CEC 2005 test functions F1–F14. The convergence curves of mean fitness values under 30 independent runs are listed in Figure 6. Furthermore, the results of statistical paired t-test between MLBBO and others are also list in Tables 5 and 6.Table 5
Scalability study atDim = 10, 50, 100, and 200 a ter Dim * 10,000 NFFEs for standard functions f1–f13.
MLBBO
DE
BBO
DE/BBO
aBBOmDE
Mean (std)
Mean (std)
Mean (std)
Mean (std)
Mean (std)
dim= 10
f1
1.55
E
-
88 (6.53E-88)
8.83
E
-
76 (1.89E-75)+
2.14
E
-
02 (2.04E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
1.49
E
-
270
(
0.00
E
+
00
)
f2
2.82
E
-
46 (3.66E-46)
1.85
E
-
36 (1.75E-36)+
1.02
E
-
01 (3.41E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
—
f3
6.37
E
-
45 (2.80E-44)
8.54
E
-
53 (1.67E-52)−
3.29
E
+
00 (2.02E+00)+
6.07
E
-
14
(
9.60
E
-
14
)
—
f4
3.27
E
-
31 (4.18E-31)
4.02
E
-
29 (6.60E-29)+
5.77
E
-
01 (2.57E-01)−
1.58
E
-
16
(
9.88
E
-
17
)
—
f5
1.05
E
-
30 (4.30E-30)
0.00
E
+
00 (0.00E+00)−
1.43
E
+
01 (1.09E+01)+
3.40
E
+
00
(
8.03
E
-
01
)
8.26
E
+
00
(
1.69
E
+
01
)
f6
0.00
E
+
00 (0.00E+00)
6.67
E
-
02 (2.54E-01)−
0.00
E
+
00 (0.00E+00)~
0.00
E
+
00
(
0.00
E
+
00
)
—
f7
9.78
E
-
04 (7.39E-04)
1.20
E
-
03 (8.19E-04)−
6.52
E
-
04 (7.36E-04)~
1.11
E
-
03
(
3.96
E
-
04
)
—
f8
0.00
E
+
00 (0.00E+00)
5.92
E
+
01 (8.66E+01)+
5.99
E
-
02 (3.51E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
9.09
E
-
14
(
2.76
E
-
13
)
f9
0.00
E
+
00 (0.00E+00)
7.75
E
+
00 (6.62E+00)+
1.20
E
-
02 (1.26E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
0.00
E
+
00
(
0.00
E
+
00
)
f10
2.31
E
-
15 (1.08E-15)
2.66
E
-
15 (0.00E+00)−
6.60
E
-
02 (2.58E-02)+
5.89
E
-
16
(
0.00
E
+
00
)
2.88
E
-
15
(
8.52
E
-
16
)
f11
3.94
E
-
03 (6.86E-03)
7.43
E
-
02 (5.45E-02)+
9.48
E
-
02 (3.40E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
4.48
E
-
02
(
2.26
E
-
02
)
f12
4.71
E
-
32 (1.67E-47)
4.71
E
-
32 (1.67E-47)−
1.02
E
-
03 (1.34E-03)+
4.71
E
-
32
(
0.00
E
+
00
)
4.71
E
-
32
(
0.00
E
+
00
)
f13
1.35
E
-
32 (5.57E-48)
2.85
E
-
32 (8.23E-32)−
4.01
E
-
03 (4.29E-03)+
1.35
E
-
32
(
0.00
E
+
00
)
1.35
E
-
32
(
0.00
E
+
00
)
dim = 50
f1
2.47
E
-
63 (2.84E-63)
4.42
E
-
38 (6.97E-38)+
1.30
E
-
01 (3.46E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
3.3
E
-
154
(
1.4
E
-
153
)
f2
8.54
E
-
35 (8.90E-35)
6.66
E
-
19 (6.04E-19)+
5.54
E
-
01 (8.06E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
—
f3
1.23
E
-
07 (1.49E-07)
3.73
E
-
06 (6.23E-06)+
7.87
E
+
02 (1.76E+02)+
5.20
E
-
02
(
2.48
E
-
02
)
—
f4
2.08
E
-
02 (4.36E-03)
1.27
E
+
00 (7.82E-01)+
4.08
E
+
00 (4.88E-01)+
3.42
E
-
03
(
2.28
E
-
02
)
—
f5
2.25
E
-
02 (5.80E-02)
1.06
E
+
00 (1.79E+00)+
1.44
E
+
02 (4.15E+01)+
4.43
E
+
01
(
1.39
E
+
01
)
9.50
E
+
00
(
2.69
E
+
01
)
f6
0.00
E
+
00 (0.00E+00)
5.87
E
+
00 (4.56E+00)+
1.00
E
-
01 (3.05E-01)~
0.00
E
+
00
(
0.00
E
+
00
)
—
f7
5.07
E
-
03 (1.31E-03)
1.53
E
-
02 (5.01E-03)+
2.91
E
-
04 (2.60E-04)−
4.05
E
-
03
(
9.20
E
-
04
)
—
f8
1.82
E
-
11 (0.00E+00)
1.41
E
+
04 (3.44E+02)+
4.01
E
-
01 (1.38E-01)+
2.37
E
+
00
(
1.67
E
+
01
)
2.39
E
-
11
(
3.69
E
-
12
)
f9
0.00
E
+
00 (0.00E+00)
3.55
E
+
02 (1.98E+01)+
7.01
E
-
02 (2.29E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
4.43
E
-
14
(
4.78
E
-
14
)
f10
9.65
E
-
15 (3.55E-15)
5.97
E
-
11 (2.95E-10)−
7.78
E
-
02 (1.34E-02)+
5.92
E
-
15
(
1.79
E
-
15
)
2.56
E
-
14
(
6.06
E
-
15
)
f11
1.31
E
-
03 (4.51E-03)
5.01
E
-
03 (6.35E-03)+
1.55
E
-
01 (4.64E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
2.78
E
-
02
(
3.42
E
-
02
)
f12
9.63
E
-
33 (7.86E-34)
7.06
E
-
02 (1.22E-01)+
2.89
E
-
04 (2.03E-04)+
9.42
E
-
33
(
0.00
E
+
00
)
9.42
E
-
33
(
0.00
E
+
00
)
f13
1.37
E
-
32 (9.00E-34)
1.05
E
-
15 (5.77E-15)−
7.82
E
-
03 (5.78E-03)+
1.35
E
-
32
(
0.00
E
+
00
)
1.35
E
-
32
(
0.00
E
+
00
)
dim= 100
f1
6.53
E
-
51 (9.15E-51)
1.02
E
-
34 (1.06E-34)+
2.89
E
-
01 (6.31E-02)+
6.16
E
-
34
(
1.97
E
-
33
)
1.18
E
-
96
(
3.26
E
-
96
)
f2
1.02
E
-
25 (2.25E-25)
8.20
E
-
19 (1.40E-18)+
1.14
E
+
00 (1.18E-01)+
0.00
E
+
00
(
0.00
E
+
00
)
—
f3
1.37
E
-
01 (5.93E-02)
5.70
E
+
00 (1.93E+00)+
2.93
E
+
03 (4.86E+02)+
3.10
E
-
04
(
1.12
E
-
04
)
—
f4
4.52
E
-
01 (3.11E-01)
2.99
E
+
01 (3.74E+00)+
6.01
E
+
00 (5.71E-01)+
2.71
E
+
00
(
2.58
E
+
00
)
—
f5
3.89
E
+
01 (4.22E+01)
9.25
E
+
01 (4.78E+01)+
3.22
E
+
02 (6.74E+01)+
1.19
E
+
02
(
3.38
E
+
01
)
2.57
E
+
01
(
4.08
E
+
01
)
f6
0.00
E
+
00 (0.00E+00)
6.32
E
+
01 (2.38E+01)+
6.67
E
-
02 (2.54E-01)~
0.00
E
+
00
(
0.00
E
+
00
)
—
f7
1.80
E
-
02 (3.88E-03)
5.49
E
-
02 (1.35E-02)+
1.92
E
-
04 (2.20E-04)-
6.87
E
-
03
(
1.15
E
-
03
)
—
f8
1.18
E
-
10 (1.19E-11)
3.20
E
+
04 (5.23E+02)+
8.23
E
-
01 (2.07E-01)+
7.11
E
+
00
(
2.84
E
+
01
)
1.07
E
+
02
(
1.13
E
+
02
)
f9
2.61
E
-
13 (2.66E-13)
8.25
E
+
02 (4.72E+01)+
1.37
E
-
01 (3.12E-02)+
7.36
E
-
01
(
8.48
E
-
01
)
1.59
E
-
01
(
3.68
E
-
01
)
f10
4.22
E
-
14 (1.35E-14)
2.25
E
+
00 (4.92E-01)+
8.26
E
-
02 (1.08E-02)+
7.84
E
-
15
(
7.03
E
-
16
)
4.25
E
-
14
(
7.99
E
-
15
)
f11
5.40
E
-
03 (1.22E-02)
3.69
E
-
03 (5.92E-03)~
1.92
E
-
01 (4.99E-02)+
0.00
E
+
00
(
0.00
E
+
00
)
5.10
E
-
02
(
8.89
E
-
02
)
f12
1.89
E
-
32 (2.43E-32)
5.80
E
-
01 (9.46E-01)+
2.70
E
-
04 (2.70E-04)+
4.71
E
-
33
(
0.00
E
+
00
)
4.71
E
-
33
(
0.00
E
+
00
)
f13
3.37
E
-
32 (2.21E-32)
1.15
E
+
02 (3.29E+01)+
1.08
E
-
02 (3.98E-03)+
1.76
E
-
32
(
2.68
E
-
32
)
1.55
E
-
32
(
5.98
E
-
33
)
dim= 200
f1
8.01
E
-
25 (1.23E-24)
8.65
E
-
27 (2.72E-26)−
7.98
E
-
01 (1.33E-01)+
3.07
E
-
32
(
2.48
E
-
32
)
5.70
E
-
50
(
7.34
E
-
50
)
f2
5.12
E
-
05 (1.08E-04)
3.58
E
-
14 (7.43E-14)−
2.55
E
+
00 (1.71E-01)+
5.83
E
-
17
(
8.11
E
-
17
)
—
f3
6.39
E
+
01 (1.05E+01)
8.28
E
+
02 (1.97E+02)+
9.04
E
+
03 (7.12E+02)+
2.22
E
+
05
(
5.90
E
+
04
)
—
f4
7.13
E
+
00 (1.63E+00)
4.27
E
+
01 (3.11E+00)+
8.84
E
+
00 (6.49E-01)+
1.59
E
+
01
(
3.43
E
+
00
)
—
f5
3.09
E
+
02 (6.35E+01)
3.23
E
+
02 (8.13E+01)~
6.29
E
+
02 (6.26E+01)+
2.95
E
+
02
(
4.48
E
+
01
)
2.16
E
+
02
(
9.98
E
+
01
)
f6
0.00
E
+
00 (0.00E+00)
9.36
E
+
02 (4.50E+02)+
0.00
E
+
00 (0.00E+00)~
0.00
E
+
00
(
0.00
E
+
00
)
—
f7
8.07
E
-
02 (1.24E-02)
2.11
E
-
01 (5.40E-02)+
1.46
E
-
04 (1.06E-04)−
1.56
E
-
02
(
2.82
E
-
03
)
—
f8
1.14
E
-
09 (1.55E-09)
6.96
E
+
04 (6.12E+02)+
2.13
E
+
00 (3.30E-01)+
2.01
E
+
02
(
1.68
E
+
02
)
3.08
E
+
02
(
2.22
E
+
02
)
f9
9.75
E
-
12 (1.66E-11)
3.38
E
+
02 (2.06E+02)+
3.25
E
-
01 (3.98E-02)+
1.76
E
+
01
(
2.89
E
+
00
)
1.19
E
+
00
(
7.52
E
-
01
)
f10
5.30
E
-
13 (1.11E-12)
6.00
E
+
00 (1.09E+00)+
9.92
E
-
02 (9.67E-03)+
1.09
E
-
14
(
1.12
E
-
15
)
1.09
E
-
13
(
1.85
E
-
14
)
f11
5.29
E
-
03 (1.73E-02)
2.83
E
-
02 (7.57E-02)~
2.88
E
-
01 (5.72E-02)+
1.11
E
-
16
(
0.00
E
+
00
)
5.54
E
-
02
(
1.10
E
-
01
)
f12
1.90
E
-
15 (5.83E-15)
2.36
E
+
00 (2.35E+00)+
3.09
E
-
04 (1.61E-04)+
2.36
E
-
33
(
0.00
E
+
00
)
2.36
E
-
33
(
0.00
E
+
00
)
f13
2.25
E
-
25 (2.56E-25)
4.01
E
+
02 (5.11E+01)+
3.17
E
-
02 (7.13E-03)+
8.36
E
-
32
(
1.44
E
-
31
)
1.35
E
-
32
(
0.00
E
+
00
)
Note: “+”, “−”, and “~” indicate that MLBBO is significantly better, worse, and indifferent, respectively, compared with other algorithms.Table 6
Scalability study atDim = 10, 50, and 100 after Dim *  10,000 NFFEsfor CEC 2005 test functions F1–F14.
MLBBO
DE
BBO
DE/BBO
aBBOmDE
Mean(std)
Mean(std)
Mean(std)
Mean(std)
Mean(std)
dim=10
F1
0.00
E
+
00
(
0.00
E
+
00
)
4.71
E
-
29
(
8.06
E
-
29
)
+
1.86
E
-
02
(
9.76
E
-
03
)
+
0.00
E
+
00
(
0.00
E
+
00
)
~
0.00
E
+
00
(
0.00
E
+
00
)
F2
7.11
E
-
29
(
7.42
E
-
29
)
6.31
E
-
29
(
7.57
E
-
29
)
~
3.73
E
+
01
(
3.75
E
+
01
)
+
8.50
E
-
25
(
2.82
E
-
24
)
~
3.65
E
-
23
(
2.58
E
-
22
)
F3
8.40
E
+
01
(
4.19
E
+
02
)
8.05
E
-
25
(
9.16
E
-
25)~
2.37
E
+
06
(
3.01
E
+
06
)
+
1.86
E
+
04
(
3.53
E
+
04
)
+
1.02
E
+
05
(
9.77
E
+
04
)
F4
7.28
E
-
29
(
9.57
E
-
29
)
3.91
E
-
29
(
7.05
E
-
29
)
~
3.01
E
+
02
(
3.31
E
+
02
)
+
2.27
E
-
21
(
3.78
E
-
21
)
+
1.96
E
-
02
(
6.19
E
-
02
)
F5
3.00
E
-
12
(
5.10
E
-
12
)
1.97
E
-
12
(
2.41
E
-
12
)
~
1.68
E
+
03
(
1.09
E
+
03
)
+
2.88
E
-
05
(
1.48
E
-
04
)
+
4.08
E
+
02
(
6.93
E
+
02
)
F6
4.98
E
-
26
(
1.94
E
-
25
)
1.32
E
-
26
(
1.78
E
-
26
)
~
1.26
E
+
02
(
1.35
E
+
02
)
+
4.10
E
+
00
(
2.20
E
+
00
)
+
1.40
E
+
02
(
8.22
E
+
02
)
F7
5.87
E
-
02
(
4.35
E
-
02
)
1.35
E
-
01
(
1.44
E
-
01
)
+
1.33
E
+
00
(
4.04
E
-
01
)
+
3.86
E
-
02
(
2.36
E
-
02
)
−
1.15
E
+
00
(
1.08
E
+
00
)
F8
2.04
E
+
01
(
7.80
E
-
02
)
2.03
E
+
01
(
7.32
E
-
02
)
~
2.04
E
+
01
(
1.25
E
-
01
)
~
2.04
E
+
01
(
5.13
E
-
02
)
~
2.03
E
+
01
(
8.35
E
-
02
)
F9
0.00
E
+
00
(
0.00
E
+
00
)
8.39
E
+
00
(
6.94
E
+
00
)
+
8.88
E
-
03
(
4.51
E
-
03
)
+
0.00
E
+
00
(
0.00
E
+
00
)
~
3.12
E
-
09
(
2.21
E
-
08
)
F10
6.16
E
+
00
(
2.97
E
+
00
)
2.29
E
+
01
(
5.74
E
+
00
)
+
1.82
E
+
01
(
8.69
E
+
00
)
+
5.98
E
+
00
(
2.42
E
+
00
)
~
1.57
E
+
01
(
6.04
E
+
00
)
F11
1.72
E
+
00
(
1.59
E
+
00
)
2.48
E
+
00
(
3.86
E
+
00
)
~
6.93
E
+
00
(
1.43
E
+
00
)
+
8.28
E
-
01
(
1.39
E
+
00
)
−
—
F12
3.47
E
+
02
(
6.08
E
+
02
)
2.55
E
+
02
(
5.30
E
+
02
)
~
7.23
E
+
02
(
7.48
E
+
02
)
+
1.04
E
+
02
(
3.40
E
+
02
)
~
—
F13
5.56
E
-
01
(
7.44
E
-
02
)
1.81
E
+
00
(
6.08
E
-
01
)
+
3.62
E
-
01
(
1.35
E
-
01
)
−
5.36
E
-
01
(
4.82
E
-
02
)
~
—
F14
2.42
E
+
00
(
4.92
E
-
01
)
2.54
E
+
00
(
3.02
E
-
01
)
~
3.59
E
+
00
(
3.82
E
-
01
)
+
3.09
E
+
00
(
1.76
E
-
01
)
+
—
dim=50
F1
8.25
E
-
29
(
9.41
E
-
29
)
1.77
E
-
27
(
5.83
E
-
28
)
+
1.18
E
-
01
(
3.22
E
-
02
)
+
0.00
E
+
00
(
0.00
E
+
00
)
−
0.00
E
+
00
(
0.00
E
+
00
)
F2
9.11
E
-
07
(
9.91
E
-
07
)
1.06
E
-
04
(
1.75
E
-
04
)
+
1.25
E
+
04
(
3.69
E
+
03
)
+
1.04
E
+
03
(
3.04
E
+
02
)
+
2.62
E
-
02
(
7.17
E
-
02
)
F3
1.86
E
+
05
(
6.84
E
+
04
)
5.49
E
+
05
(
2.01
E
+
05
)
+
1.93
E
+
07
(
5.90
E
+
06
)
+
7.20
E
+
06
(
2.38
E
+
06
)
+
1.33
E
+
06
(
4.89
E
+
05
)
F4
1.73
E
+
01
(
1.58
E
+
01
)
3.19
E
+
02
(
2.52
E
+
02
)
+
4.36
E
+
04
(
1.19
E
+
04
)
+
7.26
E
+
03
(
2.17
E
+
03
)
+
1.29
E
+
04
(
7.15
E
+
03
)
F5
4.18
E
+
03
(
6.24
E
+
02
)
2.66
E
+
03
(
5.09
E
+
02
)
−
1.16
E
+
04
(
1.63
E
+
03
)
+
2.88
E
+
03
(
4.22
E
+
02
)
−
1.40
E
+
04
(
2.67
E
+
03
)
F6
2.88
E
+
00
(
1.48
E
+
01
)
1.16
E
+
00
(
1.83
E
+
00
)
~
3.05
E
+
02
(
8.39
E
+
01
)
+
5.36
E
+
01
(
2.14
E
+
01
)
+
4.06
E
+
01
(
5.66
E
+
01
)
F7
1.41
E
-
02
(
1.45
E
-
02
)
8.45
E
-
03
(
1.06
E
-
02
)
~
1.23
E
+
00
(
9.07
E
-
02
)
+
2.79
E
-
03
(
6.55
E
-
03
)
−
1.15
E
-
02
(
1.55
E
-
02
)
F8
2.11
E
+
01
(
3.23
E
-
02
)
2.11
E
+
01
(
3.37
E
-
02
)
~
2.10
E
+
01
(
8.21
E
-
02
)
−
2.11
E
+
01
(
4.21
E
-
02
)
~
2.11
E
+
01
(
5.39
E
-
02
)
F9
4.74
E
-
16
(
1.14
E
-
15
)
3.83
E
+
02
(
3.57
E
+
01
)
+
6.67
E
-
02
(
2.01
E
-
02
)
+
3.32
E
-
02
(
1.82
E
-
01
)
~
2.22
E
-
08
(
1.57
E
-
07
)
F10
8.66
E
+
01
(
2.22
E
+
01
)
4.30
E
+
02
(
3.36
E
+
01
)
+
9.98
E
+
01
(
2.82
E
+
01
)
+
1.63
E
+
02
(
1.35
E
+
01
)
+
1.48
E
+
02
(
4.15
E
+
01
)
F11
3.60
E
+
01
(
8.40
E
+
00
)
7.28
E
+
01
(
1.86
E
+
00
)
+
5.85
E
+
01
(
4.62
E
+
00
)
+
5.92
E
+
01
(
1.44
E
+
00
)
+
—
F12
6.77
E
+
03
(
5.32
E
+
03
)
7.37
E
+
03
(
8.05
E
+
03
)
~
5.15
E
+
04
(
2.61
E
+
04
)
+
1.05
E
+
04
(
9.38
E
+
03
)
~
—
F13
5.56
E
+
00
(
2.76
E
-
01
)
3.25
E
+
01
(
2.06
E
+
00
)
+
1.86
E
+
00
(
2.58
E
-
01
)
−
5.23
E
+
00
(
2.88
E
-
01
)
−
—
F14
2.23
E
+
01
(
3.53
E
-
01
)
2.30
E
+
01
(
1.80
E
-
01
)
+
2.27
E
+
01
(
3.76
E
-
01
)
+
2.26
E
+
01
(
1.62
E
-
01
)
+
—
dim=100
F1
7.98
E
-
28
(
1.15
E
-
27
)
6.80
E
-
27
(
2.04
E
-
27
)
+
2.99
E
-
01
(
6.26
E
-
02
)
+
1.68
E
-
29
(
5.19
E
-
29
)
−
—
F2
5.61
E
-
01
(
2.38
E
-
01
)
1.05
E
+
02
(
4.54
E
+
01
)
+
3.98
E
+
04
(
7.34
E
+
03
)
+
2.42
E
+
04
(
5.08
E
+
03
)
+
—
F3
2.02
E
+
06
(
5.35
E
+
05
)
2.06
E
+
06
(
7.13
E
+
05
)
~
4.52
E
+
07
(
9.83
E
+
06
)
+
1.42
E
+
07
(
4.15
E
+
06
)
+
—
F4
1.63
E
+
04
(
8.27
E
+
03
)
4.31
E
+
04
(
1.13
E
+
04
)
+
1.48
E
+
05
(
2.52
E
+
04
)
+
8.47
E
+
04
(
1.16
E
+
04
)
+
—
F5
1.32
E
+
04
(
1.40
E
+
03
)
8.11
E
+
03
(
1.29
E
+
03
)
−
3.01
E
+
04
(
3.32
E
+
03
)
+
6.08
E
+
03
(
6.28
E
+
02
)
−
—
F6
3.98
E
+
01
(
3.59
E
+
01
)
1.24
E
+
02
(
5.05
E
+
01
)
+
4.74
E
+
02
(
5.32
E
+
01
)
+
1.15
E
+
02
(
2.81
E
+
01
)
+
—
F7
3.69
E
-
03
(
6.49
E
-
03
)
4.02
E
-
03
(
6.19
E
-
03
)
~
1.21
E
+
00
(
6.38
E
-
02
)
+
1.48
E
-
03
(
3.97
E
-
03
)
~
—
F8
2.13
E
+
01
(
2.16
E
-
02
)
2.13
E
+
01
(
2.32
E
-
02
)
~
2.11
E
+
01
(
5.63
E
-
02
)
−
2.13
E
+
01
(
2.05
E
-
02
)
~
—
F9
1.03
E
-
14
(
4.70
E
-
15
)
7.80
E
+
02
(
3.06
E
+
02
)
+
1.34
E
-
01
(
3.10
E
-
02
)
+
1.56
E
+
00
(
1.10
E
+
00
)
+
—
F10
2.96
E
+
02
(
5.14
E
+
01
)
1.10
E
+
03
(
4.50
E
+
01
)
+
2.74
E
+
02
(
3.77
E
+
01
)
~
3.97
E
+
02
(
2.50
E
+
01
)
+
—
Note: “+”, “−”, and “~” indicate that MLBBO is significantly better, worse, and indifferent, respectively, compared with other algorithms.Figure 6
Mean fitness curves to compare the scalability of MLBBO, DE, BBO, and DE/BBO for selected functions:(1) f2 (Dim = 100), (2) f8 (Dim = 100), (3) f12 (Dim = 100), (4) f3 (Dim = 200), (5) f10 (Dim = 200), (6) f13 (Dim = 200), (7) F1 (Dim = 10), (8) F5 (Dim = 10), (9) F8 (Dim = 10), (10) F13 (Dim = 10), (11) F3 (Dim = 50), (12) F10 (Dim = 50), (13) F11 (Dim = 50), (14) F12 (Dim = 50), (15) F2 (Dim= 100), (16) F3 (Dim = 100), (17) F4 (Dim = 100), and(18) F9 (Dim = 100).It is to note that the results of DE/BBO [15] for standard functions f1–f13 are taken from corresponding paper under 50 independent runs. The results of aBBOmDE [14] for all the functions are taken from the paper directly, which are carried out with different population size (for Dim = 10, the population size equals 30, and for other Dimensions, it sets to Dim) under 50 independently runs.For standard functions f1–f13, we can see from Table5 that the overall results are decreasing for five compared algorithms since increasing the problem dimensions leads to algorithms that are sometimes unable to find the global optima solution within limit MaxNFFEs. Similar to Dim = 30, MLBBO outperforms DE on the majority of functions and overcomes BBO on almost all the functions at every dimension; MLBBO is better than or similar to DE/BBO on most of the functions.When compared with aBBOmDE, we can see from Table5 that MLBBO is better than or similar to aBBOmDE on most of the functions too. By carefully looking at results, we can recognize that results of some functions of MLBBO are worse than those of aBBOmDE in precision, but robustness of MLBBO is clearly better than aBBOmDE. For example, MLBBO and aBBOmDE find better solution for functions f8 and f9 when Dim = 10 and 50; aBBOmDE fails to solve functions f8 and f9 when Dim increases to 100 and 200, but MLBBO can solve functions f8 and f9 as before. This may be due to modified DE mutation being used in aBBOmDE as local search to accelerate the convergence speed, but modified DE mutation is used in MLBBO as a formula to supplement with migration operator and enhance the exploration ability of MLBBO.For CEC 2005 test functions F1–F14, we can obtain similar results, from Table6, that MLBBO is better than or similar to DE, BBO, and DE/BBO on most of functions when comparing MLBBO with these algorithms. However, results of MLBBO outperform aBBOmDE on most of the functions wherever Dim = 10 or Dim = 50.From the comparison, we can arrive to a conclusion that the total performance of MLBBO is better than the others, especially, for CEC 2005 test functions.Figure7 shows the NFFEs required to reach VTR with different dimensions for 13 standard benchmark functions (f1–f13) and 6 CEC 2005 test functions (F1, F2, F4, F6, F7, and F9). From Figure 7, we can see that as dimension increases, the required NFFEs increases exponentially, which may be due to an exponentially increase in local minima with dimension. Meanwhile, if we compare Figures 7(a) and 7(b), we can find that CEC 2005 test functions need more NFFEs to reach VTR than standard benchmark functions do, which may be due to that CEC 2005 functions are more complicated than standard benchmark functions. For example, for function f3 (Schwefel 1.2), F2 (Shifted Schwefel 1.2), and F4 (Shifted Schwefel 1.2 with Noise in Fitness), F4, F2, and f3 need 140486.7, 157596.7, and 289960 MeanFEs to reach VTR (10−6), respectively. Obviously, F4 is more complicated than f3 and F2; so, F4 needs 289960 MeanFEs to reach VTR,which is large than 140486.7 and 157596.NFFEs versus dimensions for (a) standard functions and (b) CEC 2005 functions.
(a)
Dimension
(b)
Dimension


## 4.7. Analysis of the Performance of Operators in MLBBO

As the analysis above, the proposed variant of BBO algorithm has achieved excellent performance. In this section, we analyze the performance of modified migration operator and local search mechanism in MLBBO. In order to analyze the performance fairly and systematically, we compare the performance in four cases: MLBBO with both modified migration operator and local search leaning mechanism, MLBBO with the modified migration operator and without local search leaning mechanism, MLBBO without modified migration operator and with local search leaning mechanism, and MLBBO without both modified migration operator and local search leaning mechanism (it is actually BBO). Four algorithms are denoted as MLBBO, MLBBO2, MLBBO3, and MLBBO4. The experimental tests are conducted with 30 independent runs. The parameter settings are set in Section4.1. The mean, standard deviation of fitness values of experimental test are summarized in Table 7. The numbers of successful runs are also recorded in Table 7. The results between MLBBO and MLBBO2, MLBBO and MLBBO3, and MLBBO and MLBBO4 are compared using two tails t-test. Convergence curves of mean fitness values under 30 independent runs are listed in Figure 8.Table 7
Analysis of the performance of operators in MLBBO.
MLBBO
MLBBO2
MLBBO3
MLBBO4
Mean (std)
SR
Mean (std)
SR
Mean (std)
SR
Mean (std)
SR
f1
2.03
E
-
31
(
1.77
E
-
31
)
30
2.95
E
-
18
(
1.05
E
-
18
)
+
30
4.53
E
-
05
(
2.65
E
-
05
)
+
0
2.17
E
-
04
(
7.92
E
-
05
)
+
0
f2
1.60
E
-
21
(
8.48
E
-
22
)
30
4.40
E
-
13
(
1.13
E
-
13
)
+
30
7.52
E
-
03
(
2.74
E
-
03
)
+
0
3.64
E
-
02
(
7.00
E
-
03
)
+
0
f3
1.47
E
-
20
(
2.10
E
-
20
)
30
2.94
E
-
12
(
1.94
E
-
12
)
+
30
1.88
E
+
00
(
6.10
E
-
01
)
+
0
1.98
E
+
00
(
5.63
E
-
01
)
+
0
f4
5.04
E
-
08
(
9.88
E
-
08
)
30
3.04
E
-
09
(
1.22
E
-
09
)
−
30
1.96
E
-
02
(
4.67
E
-
03
)
+
0
2.32
E
-
02
(
6.47
E
-
03
)
+
0
f5
1.02
E
-
20
(
3.71
E
-
20
)
30
1.54
E
-
14
(
1.06
E
-
14
)
+
30
4.79
E
+
01
(
3.28
E
+
01
)
+
0
3.64
E
+
01
(
3.58
E
+
01
)
+
0
f6
0.00
E
+
00
(
0.00
E
+
00
)
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
f7
2.63
E
-
03
(
1.24
E
-
03
)
30
4.00
E
-
03
(
7.68
E
-
04
)
+
30
3.25
E
-
03
(
1.64
E
-
03
)
~
30
1.28
E
-
02
(
5.07
E
-
03
)
+
11
f8
0.00
E
+
00
(
0.00
E
+
00
)
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
1.63
E
-
06
(
1.25
E
-
06
)
+
6
7.92
E
-
06
(
2.84
E
-
06
)
+
0
f9
0.00
E
+
00
(
0.00
E
+
00
)
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
7.93
E
-
04
(
4.64
E
-
04
)
+
0
3.60
E
-
03
(
1.46
E
-
03
)
+
0
f10
5.98
E
-
15
(
9.01
E
-
16
)
30
4.48
E
-
10
(
1.16
E
-
10
)
+
30
4.32
E
-
03
(
1.24
E
-
03
)
+
0
9.72
E
-
03
(
1.50
E
-
03
)
+
0
f11
3.70
E
-
03
(
6.02
E
-
03
)
19
0.00
E
+
00
(
0.00
E
+
00
)
−
30
1.07
E
-
01
(
6.87
E
-
02
)
+
1
8.16
E
-
02
(
5.71
E
-
02
)
+
0
f12
5.69
E
-
27
(
3.07
E
-
26
)
30
4.41
E
-
20
(
2.49
E
-
20
)
+
30
1.66
E
-
06
(
5.43
E
-
06
)
~
26
7.68
E
-
06
(
1.28
E
-
05
)
+
1
f13
5.79
E
-
32
(
5.53
E
-
32
)
30
3.60
E
-
19
(
1.65
E
-
19
)
+
30
3.33
E
-
05
(
1.16
E
-
04
)
~
0
5.70
E
-
05
(
5.07
E
-
05
)
+
0
F1
0.00
E
+
00
(
0.00
E
+
00
)
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
9.48
E
-
06
(
8.28
E
-
06
)
+
2
4.66
E
-
05
(
1.91
E
-
05
)
+
0
F2
2.37
E
-
12
(
2.46
E
-
12
)
30
2.79
E
-
06
(
2.44
E
-
06
)
+
4
4.10
E
+
01
(
1.07
E
+
01
)
+
0
2.39
E
+
01
(
1.01
E
+
01
)
+
0
F3
9.48
E
+
04
(
5.14
E
+
04
)
0
1.86
E
+
05
(
9.84
E
+
04
)
+
0
1.86
E
+
06
(
5.75
E
+
05
)
+
0
9.51
E
+
06
(
7.57
E
+
06
)
+
0
F4
1.21
E
-
04
(
2.76
E
-
04
)
4
6.57
E
-
03
(
8.98
E
-
03
)
+
0
1.12
E
+
04
(
4.05
E
+
03
)
+
0
4.89
E
+
03
(
1.77
E
+
03
)
+
0
F5
8.18
E
+
02
(
3.25
E
+
02
)
0
1.27
E
+
02
(
6.59
E
+
01
)
−
0
6.09
E
+
03
(
1.12
E
+
03
)
+
0
4.47
E
+
03
(
7.00
E
+
02
)
+
0
F6
1.93
E
-
09
(
3.11
E
-
09
)
30
7.82
E
-
04
(
4.05
E
-
03
)
~
29
9.26
E
+
02
(
1.86
E
+
03
)
+
0
2.09
E
+
03
(
4.48
E
+
03
)
+
0
F7
1.89
E
-
02
(
1.73
E
-
02
)
13
1.56
E
-
03
(
4.41
E
-
03
)
−
29
1.67
E
-
01
(
2.06
E
-
01
)
+
0
7.76
E
-
01
(
1.39
E
+
00
)
+
0
F8
2.10
E
+
01
(
5.38
E
-
02
)
0
2.09
E
+
01
(
6.06
E
-
02
)
~
0
2.09
E
+
01
(
4.10
E
-
02
)
~
0
2.10
E
+
01
(
3.80
E
-
02
)
~
0
F9
5.92
E
-
17
(
3.24
E
-
16
)
30
0.00
E
+
00
(
0.00
E
+
00
)
~
30
1.06
E
-
03
(
6.71
E
-
04
)
+
30
3.44
E
-
03
(
1.45
E
-
03
)
+
30
F10
3.76
E
+
01
(
1.40
E
+
01
)
0
9.74
E
+
01
(
6.54
E
+
00
)
+
0
3.79
E
+
01
(
1.05
E
+
01
)
~
0
1.22
E
+
02
(
8.19
E
+
00
)
+
0
F11
2.10
E
+
01
(
7.37
E
+
00
)
0
3.21
E
+
01
(
1.05
E
+
00
)
+
0
2.63
E
+
01
(
4.96
E
+
00
)
+
0
3.34
E
+
01
(
1.07
E
+
00
)
+
0
F12
2.07
E
+
03
(
2.71
E
+
03
)
0
1.36
E
+
04
(
1.97
E
+
04
)
+
0
1.26
E
+
04
(
9.29
E
+
03
)
+
0
8.05
E
+
03
(
7.03
E
+
03
)
+
0
F13
3.08
E
+
00
(
1.60
E
-
01
)
0
2.77
E
+
00
(
1.38
E
-
01
)
−
0
1.04
E
+
00
(
1.64
E
-
01
)
−
0
9.82
E
-
01
(
1.74
E
-
01
)
−
0
F14
1.28
E
+
01
(
2.38
E
-
01
)
0
1.30
E
+
01
(
1.62
E
-
01
)
+
0
1.25
E
+
01
(
2.65
E
-
01
)
−
0
1.30
E
+
01
(
1.86
E
-
01
)
+
0
Better
15
19
24
Similar
7
6
2
Worse
5
2
1
Note: “+”, “−”, and “~” indicate that MLBBO is significantly better, worse, and indifferent, respectively, compared with other algorithms.Figure 8
Mean fitness curves to analyze operators of MLBBO for selected functions f1, f6, f9, F1, F3, and F11.From Table7, we can find that MLBBO is significantly better than MLBBO2 on 15 functions out of 27 tests functions, whereas MLBBO2 outperforms MLBBO on 5 functions. For the rest 7 functions, there are no significant differences based on two tails t-test. From this, we know that local search mechanism has played an important role in improving the search ability, especially, in improving the solution precision, which can be proved through careful looking at fitness values. For example, for function f1–f10, both algorithms MLBBO and MLBBO2 achieve the optima, but the fitness values obtained by MLBBO are better than those obtained by MLBBO2 by several orders of magnitudes on these functions. When compared with MLBBO3, we can see that MLBBO outperforms MLBBO3 on 19 functions out of 27 test functions, while MLBBO is outperformed by MLBBO3 on only 2 functions. From this, we know that the modified migration operator has played a key role in optimizing the process and is better than original migration operator. Similar conclusion can also be obtained if we compare MLBBO2 and MLBBO4, MLBBO3 and MLBBO4.Furthermore, if we compare four algorithms together, the results of MLBBO4 are worse than those of MLBBO, especially, on multimodal functions, which means that the MLBBO has more powerful exploration ability than MLBBO4.


## 5.  Conclusions and Future Work

In this paper, we have proposed a variant of modified BBO algorithm, called MLBBO, for solving global optimization problems. For origin BBO algorithm, the exploration ability is a barrier of performance of BBO. We suggest a modified migration operator by combining the formula in migration operator with a new one, which can absorb more information from other habitats and then enhance the exploration ability. Moreover, a local search mechanism is designed and used in modified BBO to supplement with modified migration operator. The proposed algorithm is compared with other improved BBO algorithms and evolutionary algorithms, which show that the proposed algorithm is superior to or at least highly competitive with the others.During the analysis, we know that MLBBO possesses better performance, and we will investigate the performance of MLBBO in large-scale functions in the future work. We will also investigate the built-in relationship between the population diversity and exploration ability further.


## 6. Appendix

See Table8.Table 8
Benchmark functions used in our experimental tests.
Functions
Mathematical formula
Name
Dimension
Search space
Optima
f1
f
1
(
x
)
=
∑
i
=
1
n
x
i
2
Sphere
n
[−100, 100]
0
f2
f
2
(
x
)
=
∑
i
=
1
n
|
x
i
|
+
∏
i
=
1
n
|
x
i
|
Schwefel’s Problem 2.22
n
[10, 10]
0
f3
f
3
(
x
)
=
∑
i
=
1
n
(
∑
j
=
1
i
x
j
)
2
Schwefel’s Problem 1.2
n
[−100, 100]
0
f4
f
4
(
x
)
=
ma
x
i
{
|
x
i
|
,
1
≤
i
≤
n
}
Schwefel’s Problem 2.21
n
[−100, 100]
0
f5
f
5
(
x
)
=
∑
i
=
1
n
-
1
[
100
(
x
i
+
1
-
x
i
2
)
2
+
(
x
i
-
1
)
2
]
Rosenbrock function
n
[−30, 30]
0
f6
f
6
(
x
)
=
∑
i
=
1
n
(
⌊
x
i
+
0.5
⌋
)
2
Step function
n
[−100, 100]
0
f7
f
7
(
x
)
=
∑
i
=
1
n
i
x
i
4
+
random
[
0,1
)
Quartic function
n
[−1.28, 1.28]
0
f8
f
8
(
x
)
=
-
∑
i
=
1
n
x
i
sin
(
|
x
i
|
)
Schwefel function
n
[−512, 512]
−12569.5
f9
f
9
(
x
)
=
∑
i
=
1
n
[
x
i
2
-
10
cos
(
2
π
x
i
)
+
10
]
Rastrigin function
n
[−5.12, 5.12]
0
f10
f
10
(
x
)
=
-
20
exp
(
-
0.2
1
n
∑
i
=
1
n
x
i
2
)
-
exp
(
1
n
∑
i
=
1
n
cos
2
π
x
i
)
+
20
+
e
Ackley function
n
[−32, 32]
0
f11
f
11
(
x
)
=
1
4000
∑
i
=
1
n
x
i
2
-
∏
i
=
1
n
cos
(
x
i
i
)
+
1
Griewank function
n
[−600, 600]
0
f12
f
12
(
x
)
=
π
n
{
10
si
n
2
(
π
y
i
)
+
∑
i
=
1
n
-
1
(
y
i
-
1
)
2
[
1
+
10
si
n
2
(
π
y
i
+
1
)
]
+
(
y
n
-
1
)
2
}
+
∑
i
=
1
n
u
(
x
i
,
10,100,4
)
,
y
i
=
1
+
(
x
i
-
1
)
4
u
(
x
i
,
a
,
k
,
m
)
=
{
k
(
x
i
-
a
)
2
,
0
,
k
(
-
x
i
-
a
)
2
,
x
i
>
a
-
a
≤
x
i
≤
a
x
i
<
-
a
Penalized function 1
n
[−50, 50]
0
f13
f
13
(
x
)
=
0.1
{
si
n
2
(
3
π
x
1
)
+
∑
i
=
1
n
-
1
(
x
i
-
1
)
2
[
1
+
si
n
2
(
3
π
x
i
+
1
)
]
+
(
x
n
-
1
)
2
[
1
+
si
n
2
(
2
π
x
n
)
]
}
+
∑
i
=
1
n
u
(
x
i
,
5,100,4
)
,
Penalized function 2
n
[−50, 50]
0
F1
F
1
=
∑
i
=
1
n
z
i
2
+
f
_
bia
s
1
,
Z
=
X
-
O
Shifted  sphere  function
n
[−100, 100]
−450
F2
F
2
=
∑
i
=
1
n
(
∑
j
=
1
i
z
j
)
2
+
f
_
bia
s
2
,
Z
=
X
-
O
Shifted  Schwefel’s  Problem 1.2
n
[−100, 100]
−450
F3
F
3
=
∑
i
=
1
n
(
1
0
6
)
(
i
-
1
)
/
(
D
-
1
)
z
i
2
+
f
_
bia
s
3
,
Z
=
X
-
O
Shifted rotated high conditioned elliptic function
n
[−100, 100]
−450
F4
F
4
=
(
∑
i
=
1
n
(
∑
j
=
1
i
z
j
)
2
)
*
(
1
+
0.4
|
N
(
0,1
)
|
)
+
f
_
bia
s
4
,
Z
=
X
-
O
Shifted Schwefel’s Problem 1.2 with noise in fitness
n
[−100, 100]
−450
F5
F
5
=
max
{
|
A
i
x
-
B
i
|
}
+
f
_
bia
s
5
Schwefel’s Problem 2.6 with global optimum on bounds
n
[−30, 30]
−310
F6
F
6
=
∑
i
=
1
n
-
1
[
100
(
z
i
+
1
-
z
i
2
)
2
+
(
z
i
-
1
)
2
]
+
f
_
bia
s
6
,
Z
=
X
-
O
+
1
Shifted rosenbrock’s function
n
[−100, 100]
390
F7
F
7
=
1
4000
∑
i
=
1
n
z
i
2
-
∏
i
=
1
n
cos
(
z
i
i
)
+
1
+
f
_
bia
s
7
,
Z
=
(
X
-
O
)
*
M
Shifted rotated Griewank’s function without bounds
n
Outside of initialization range[0, 600]
−180
F8
F
8
=
-
20
exp
(
-
0.2
1
n
∑
i
=
1
n
z
i
2
)
-
exp
(
1
n
∑
i
=
1
n
cos
2
π
z
i
)
+
20
+
e
+
f
_
bia
s
8
,
Z
=
(
X
-
O
)
*
M
Shifted rotated Ackley’s function with global optimum on bounds
n
[−32, 32]
−140
F9
F
9
=
∑
i
=
1
n
[
z
i
2
-
10
cos
(
2
π
z
i
)
+
10
]
+
f
_
bia
s
8
,
Z
=
X
-
O
Shifted Rastrigin’s function
n
[−5.12, 5.12]
−330
F10
F
9
=
∑
i
=
1
n
[
z
i
2
-
10
cos
(
2
π
z
i
)
+
10
]
+
f
_
bia
s
8
,
Z
=
(
X
-
O
)
*
M
Shifted rotated Rastrigin’s function
n
[−5.12, 5.12]
−330
F11
F
11
=
∑
i
=
1
n
(
∑
k
=
0
k
max
[
a
k
cos
(
2
π
b
k
(
z
i
+
0.5
)
)
]
)
-
n
∑
k
=
0
k
max
[
a
k
cos
(
2
π
b
k
·
0.5
)
]
+
f
_
bia
s
11
a
=
0.5
,
b
=
3
,
k
max
=
20
,
Z
=
(
X
-
O
)
*
M
Shifted rotated weierstrass  Function
n
[−600, 600]
90
F12
F
12
=
∑
i
=
1
n
(
A
i
-
B
i
(
x
)
)
2
+
f
_
bia
s
12
A
i
=
∑
i
=
1
n
(
a
i
j
sin
α
j
+
b
i
j
cos
α
j
)
,
B
i
=
∑
i
=
1
n
(
a
i
j
sin
x
j
+
b
i
j
cos
x
j
)
Schwefel’s Problem 2.13
n
[−100, 100]
−460
F13
F
13
=
f
11
(
f
5
(
z
1
,
z
2
)
)
+
f
11
(
f
5
(
z
2
,
z
3
)
)
+
⋯
+
f
11
(
f
5
(
z
n
-
1
,
z
n
)
)
+
f
11
(
f
5
(
z
n
,
z
1
)
)
+
f
_
bia
s
13
Z
=
X
-
O
+
1
Expanded extended Griewank’s plus Rosenbrock’s function (F8F2)
n
[−50, 50]
−130
F14
F
(
x
,
y
)
=
0.5
+
si
n
2
(
x
2
+
y
2
)
-
0.5
(
1
+
0.001
(
x
2
+
y
2
)
)
2
F
14
=
F
(
z
1
,
z
2
)
+
F
(
z
2
,
z
3
)
+
⋯
+
F
(
z
n
-
1
,
z
n
)
+
F
(
z
n
,
z
1
)
+
f
_
bia
s
14
,
Z
=
(
X
-
O
)
*
M
Shifted rotated expanded Scaffer’s  F6
n
[−100, 100]
−300



---

*Source: 960524-2013-12-22.xml*