# A Multiobjective Brain Storm Optimization Algorithm Based on Decomposition

Authors: Cai Dai; Xiujuan Lei
Journal: Complexity
 (2019)

---

## Abstract

Brain storm optimization (BSO) algorithm is a simple and effective evolutionary algorithm. Some multiobjective brain storm optimization algorithms have low search efficiency. This paper combines the decomposition technology and multiobjective brain storm optimization algorithm (MBSO/D) to improve the search efficiency. Given weight vectors transform a multiobjective optimization problem into a series of subproblems. The decomposition technology determines the neighboring clusters of each cluster. Solutions of adjacent clusters generate new solutions to update population. An adaptive selection strategy is used to balance exploration and exploitation. Besides, MBSO/D compares with three efficient state-of-the-art algorithms, e.g., NSGAII and MOEA/D, on twenty-two test problems. The experimental results show that MBSO/D is more efficient than compared algorithms and can improve the search efficiency for most test problems.


---

## Body

## 1. Introduction

Multiobjective optimization problems (MOPs) [1–4] which have conflicting objectives exist widely in the real world. Different from single-objective optimization problems, there are a series of optimal solutions for a MOP. Since the number of optimal solutions may be infinite, which leads to achieving impractically all optimal solutions at once, the good diversity and convergence of got solutions are the main goals of a good algorithm for MOPs. Although metaheuristics [5–7] can deal with MOPs, the evolutionary algorithms (EAs) [8, 9] naturally make up the set of the objective vectors of Pareto optimal solutions [10] with a population of nondominated solutions.Multiobjective evolutionary algorithms (MOEAs) make use of the population evolution to achieve a set of nondominated solutions which are optimal solutions of the current population, which are effective methods of solving MOPs. In decades, many MOEAs [11–30] have been proposed, such as multiobjective genetic algorithms [11], multiobjective particle swarm optimization algorithms [12–14], multiobjective differential evolution algorithms [15, 16], multiobjective immune clone algorithms [17], group search optimizer [18], and evolutionary algorithms based on decomposition [19–22]. The MOEA based on decomposition (MOEA/D) [11] may be the most widely studied in recent years. In MOEA/D, a set of uniformly distributed weight vectors and aggregate functions decomposes a MOP into a series of single or multiobjective subproblems. All subproblems are simultaneously optimized in a population evolution. Moreover, MOEA/D uses the neighbor information to improve the search efficiency and maintains the diversity of got solutions by the uniformly distributed weight vectors and aggregate functions.In 2011, Shi proposes the brain storm optimization (BSO) [24] algorithm which is a simple and promising algorithm. It simulates the collective behavior of human being which is the brainstorming [24]. Since the invention of BSO algorithm in 2011, it had attracted many attentions in the evolutionary algorithms research community. Many works [25, 26] develop and apply the BSO algorithm. In BSO, the solutions are diverged into several clusters. One individual or more individuals are selected to generate new solutions by some genetic operators. Some multiobjective BSO algorithms [27–29] are proposed to solve MOPs. In these multiobjective BSO algorithms, population is updated by newly solutions after solutions are clustered, which may low the speed of convergence.In this paper, the decomposition technology is fused together with multiobjective brain storm optimization algorithm (MBSO/D) to solve MOPs. The main motivation of MBSO/D is improve the performance of multiobjective BSO algorithms (MOBSOs) by using the decomposition technology. The MBSO/D mainly includes three parts to solve effectively MOPs. First, the current solutions are automatically clustered as each subproblem is optimized and the size of each cluster is the same; second, the decomposition technology determines the neighboring clusters of each cluster, and parent solutions are selected from adjacent clusters to produce the new solutions, which can improve the search efficiency; third, an adaptive selection strategy is used to balance exploration and exploitation.We have done some work [31, 32] on evolutionary algorithms based on decomposition recently. In the paper [31], a crossover operator based on uniform design and a selection strategy based on decomposition are designed to improve the performance of decomposition-based multiobjective evolutionary algorithms. In the paper [32], we design an initialization method of weight vectors and a new adaptive weight vector adjustment strategy. Compared to our previous works [31, 32], the main highlight originality of this manuscript is that the decomposition technology is firstly used in multiobjective brain storm optimization algorithm to improve the performance of MBSOs; the main difference is that an adaptive selection strategy in which the selection probability is updated adaptively according to the success rate of the selection strategy is used to balance exploration and exploitation.The organization of the remaining paper is reproduced below. The related works about the MOP and BSO are briefly reviewed in Section2. Section 3 states and describes MBSO/D in detail. Experimental results and discussions are contained in Section 4. Section 5 gives the conclusions and some possible paths for the future work.


## 2. Related Work

The related definitions of MOP, BSO, and aggregation function are stated in this section.


### 2.1. Multiobjective Optimization

The description of a MOP by mathematic formulation is as follows [30]:(1)minFx=f1x,f2x,⋯,fmxs.t.x∈Ωwhere x=(x1,⋯,xn)∈X⊂Rn is a n-dimensional decision variable whose feasible region is Ω for (1); a MOP includes m objective functions fix(i=1,⋯,m). In the following, some important definitions of MOPs are displayed. For two solutions x,z∈Ω, if each fix≤fiz and Fx-Fz2≠0, x dominates z (or denoted x≺z). If the solution vector x is not dominated by any other solutions, x is called a Pareto optimal solution. The set of Pareto optimal solutions (PS) is formed by all Pareto optimal solutions. The Pareto optimal front (PF) is the set of the objective vectors of all Pareto optimal solutions.


### 2.2. Brain Storm Optimization Algorithm

Humans may work together to solve some problems which cannot be solved by one person. Shi proposes the brain storm optimization algorithm [24] based on this human idea generation process. This algorithm is presented as follows. In a BSO algorithm, a clustering algorithm clusters the solutions into several clusters. One or three cluster(s) is (or are) randomly selected to produce new offspring. The new offspring are only compared with the best solution of the population at the same cluster to update the population. When parents are chosen from one cluster or neighboring clusters, the local search ability is strengthened. When the new offspring are generated by parents that are selected from three random clusters, the global search ability is heightened. The pseudocode of the BSO algorithm is as shown in Pseudocode 1.Pseudocode 1:The pseudo code of the BSO algorithm.
(  1) Initialization: Generate an N solutions randomly or by a problem-specific method and evaluate these solutions While the stopping criterion is not met do Clustering: cluster N solutions into M clusters by a clustering algorithm; Generating new solutions: randomly select one or two cluster(s) to produce new solutions. Updating: compare the new solution with the existing solution with the same cluster; the better one is kept and recorded as the new solution.


## 2.1. Multiobjective Optimization

The description of a MOP by mathematic formulation is as follows [30]:(1)minFx=f1x,f2x,⋯,fmxs.t.x∈Ωwhere x=(x1,⋯,xn)∈X⊂Rn is a n-dimensional decision variable whose feasible region is Ω for (1); a MOP includes m objective functions fix(i=1,⋯,m). In the following, some important definitions of MOPs are displayed. For two solutions x,z∈Ω, if each fix≤fiz and Fx-Fz2≠0, x dominates z (or denoted x≺z). If the solution vector x is not dominated by any other solutions, x is called a Pareto optimal solution. The set of Pareto optimal solutions (PS) is formed by all Pareto optimal solutions. The Pareto optimal front (PF) is the set of the objective vectors of all Pareto optimal solutions.


## 2.2. Brain Storm Optimization Algorithm

Humans may work together to solve some problems which cannot be solved by one person. Shi proposes the brain storm optimization algorithm [24] based on this human idea generation process. This algorithm is presented as follows. In a BSO algorithm, a clustering algorithm clusters the solutions into several clusters. One or three cluster(s) is (or are) randomly selected to produce new offspring. The new offspring are only compared with the best solution of the population at the same cluster to update the population. When parents are chosen from one cluster or neighboring clusters, the local search ability is strengthened. When the new offspring are generated by parents that are selected from three random clusters, the global search ability is heightened. The pseudocode of the BSO algorithm is as shown in Pseudocode 1.Pseudocode 1:The pseudo code of the BSO algorithm.
(  1) Initialization: Generate an N solutions randomly or by a problem-specific method and evaluate these solutions While the stopping criterion is not met do Clustering: cluster N solutions into M clusters by a clustering algorithm; Generating new solutions: randomly select one or two cluster(s) to produce new solutions. Updating: compare the new solution with the existing solution with the same cluster; the better one is kept and recorded as the new solution.


## 3. The Proposed Algorithm

This paper combines the decomposition technology and multiobjective brain storm optimization algorithm (MBSO/D) to address MOPs. The major parts of this algorithm are that three strategies based on decomposition (cluster strategy, update strategy selection strategy) are developed. Three strategies will be pointed out in this section.


### 3.1. Motivation

The main motivation of this paper is to design a MOEA to achieve a set of solutions which evenly distribute on the true PF. BSO algorithm uses the group information to address the problems, which can help MOEAs to improve their performance. MOEAs use the neighboring information to optimal population, which can improve the performance of MOEAs. In this paper, this optimization idea is utilized to enhance the performance of multiobjective BSO algorithm. First, new solutions update the population by using the updated strategy of MOEA/D [21]; then, solutions are automatically clustered as each subproblem is optimized. Second, the decomposition technology determines the neighboring clusters of each cluster, and parent solutions are selected from adjacent clusters. Third, an adaptive selection strategy is used to balance exploration and exploitation.The MOEA/D decomposes a MOP into a series of subproblems by weight vectors and aggregate functions. For each solution, it and some of its neighbor solutions are selected as parents to generate a new solution. Then, some of its neighbor solutions are updated by aggregate functions and the new solution. So, all subproblems are simultaneously optimized in a population evolution. Each aggregate function makes some solutions converge to the corresponding weight vector, which can improve the convergence of the algorithm. In addition, the diversity of solutions is maintained by the uniformly distributed weight vectors. The main advantages of MOEA/D are that the diversity of obtained solutions can be determined by the given weight vectors; neighbor’s information is used to generate new offspring, which can improve the search efficiency.


### 3.2. Cluster and Update

In this work, each given weight vector fixes a cluster, and the size of each cluster is made the same. The best solution of each cluster is determined by corresponding weight vectorλi=(λ1i,⋯λmi) and the aggregation function [31]. The formula is as follows:(2)xbesti=min⁡gTEx∣λi,Z∗,x∈Piwhere gTEx∣λi,Z∗=max1≤j≤m⁡fjx-zj∗/λji is a aggregation function, Z∗=(z1∗,⋯,zm∗) is the reference point, and xbesti is the current best solution of i-th cluster Pi. After a new solution is produced by some cluster, one solution of neighboring clusters of this cluster may be replaced by this new solution. If the best solution is not better than the new solution, randomly select a solution (not the best solution) from the cluster, which is replaced by this new solution, and the current best solution of this cluster will be redefined by (2). This update strategy can reduce the computing effort. Moreover, in this paper, one new solution will replace two solutions at most, which can balance the convergence and diversity. One solution is replaced and the diversity of the population is maintained, but the rate of convergence may be lower. Many solutions are replaced and the rate of convergence can be enhanced, but the diversity of the population is reduced.


### 3.3. Selection Strategy and Crossover Operator

An effective selection strategy can help crossover operators to perform search work more effectively. In this BSO algorithm, according to an adaptive selection probability, a new solution will be produced by one cluster or three clusters. The adaptive selection probability is calculated by the following formulation:(3)pt=sonesone+sth+δ+0.1pt-1where t is the evolution generation; pt-1 is the selection probability of the t-1-generation; sone and sth are the number of kept new solutions which are generated by one cluster and three clusters, respectively; δ is to make the denominator not 0 and is set to a small number. If a random number is smaller than pt, parents are selected from one cluster to produce a new solution, which may enhance the exploitation; otherwise, parents are selected from three clusters to produce a new solution, which can strengthen the exploration.Based on the selection probabilitypt and the decomposition technology, a selection strategy is designed to balance local search and global search. For each weight vector, work out its T closet weight vectors according to the Euclidean distances of any two weight vectors. For each i=1,⋯N, set Bi=K∗i1,⋯,K∗iT where λi1,⋯λiT are the T closet weight vectors to λi and K is the size of each cluster. Then set(4)P=i-1∗K+1,⋯,i∗K,ifrand1<ptBi,ifrand2<JK∗1,⋯,K∗N,otherwise,otherwisewhere rand1∈[0,1] and rand2∈[0,1] are two random numbers; J is set to 0.9 as the same in [21]; xK∗i is the current best solution of i-th cluster. When the set P is set, randomly select two indexes r2 and r3 from P and generate one solution from xK∗i, xr2, and xr3 by the following formula:(5)xjnew=xjK∗i+Lxjr2-xjr3,ifrand0,1<CRxjK∗iotherwisewhere L∈[0,2] is a scale factor which controls the length of the exploration vector (xr2-xr3); CR is a constant value namely crossover rate; j=1,⋯,n and xjr2 indicates the j-th component of xr2; xnew=(x1new,x2new,⋯,xnnew). If the solution xK∗i dominates xnew, xnew is set as the following formula:(6)xjnew=xjK∗i-Lxjr2-xjr3ifxjnew≠xjK∗ixjK∗iotherwiseIf the new solution generated by (5) is dominated by xK∗i, the new solution generated by (6) may be better than xK∗i with big probability. Equation (6) serves to enhance the search efficiency. When two indexes r2 and r3 are randomly selected from i-1∗K+1,⋯,i∗K or Bi, the local search can be carried out to improve the convergence; when two indexes r2 and r3 are randomly selected from K∗1,⋯,K∗N, the global search can be carried out.


### 3.4. Pseudocode of the Proposed Algorithm

In this subsection, the pseudocode for the multiobjective brain storm optimization algorithm based on decomposition (MBSO/D) is displayed as shown in Pseudocode2.Pseudocode 2:The pseudo code of the algorithm MBSO/D.
Input: MOP (1) A stopping criterion N: the number of direction vectors (the clusters) K: the size of the cluster T: the number of the neighborhood, 0<T<N λ 1 , λ 2 , ⋯ , λ N: a set of N uniformly distributed weight vectors Output: Objective vectors: FxK,Fx2∗K,⋯,FxN∗K Initialization: Generate an initial population x1,x2,⋯xN∗K determine Z=(z1,⋯,zm); randomly cluster the initial population intoN clusters with size K and determine the best solution of each cluster; determineBi=i1,⋯,iT,(i=1,⋯,N), where λ i 1 , ⋯ , λ i T are the T closest weight vectors to λi; set pt=0.5 While the function evaluation times are less than the maximum function evaluation times do Set s o n e = 0 and sth=0 For i = 1 , ⋯ , N,do According to Eq. (4), randomly select two indexes r2 and r3, use xK∗i, xr2 and xr3 to generate offspring x n e w = ( x 1 n e w ,  x 2 n e w , ⋯ , x n n e w ) by Eq. (5). If xK∗i dominates xnew, xnew is regenerated by Eq. (6). Updateof Z: For j=1,⋯,m, if zj<fj(xnew), then set zj=fj(xnew) Update of Neighboring Solutions: set H=0 and Q=Bi While H ≤ 2 and Q≠∅ k = Q ( 1 ); If g T E ( x n e w ∣ λ k , z ) < g T E ( x k ∗ K ∣ λ k , z ) randomly select a number h from k-1∗K+1,⋯,k∗K-1, set xh=xk∗K, F ( x h ) = F ( x k ∗ K ), xk∗K=xnew and F(xk∗K)=F(xnew). H = H + 1. If x n e w generated by one cluster s o n e = s o n e + 1; Else s t h = s t h + 1; End if End if Q 1 =; End while End for Use Eq. (3) to update p t. end for end whileIn MBSO/D, firstly, solutions in initial population are randomly clustered into N clusters with size K and the best solution of each cluster is determine by (2); secondly, for the best solution of each cluster (the for loop in pseudocode), some solutions are selected according to (3)-(4), the best solution and selected solutions generate a new solution by (5) or (6), and these produce good offspring; thirdly, some neighboring solutions of the best solution are updated by the new solution and aggregation function (the while loop in pseudocode), to help the algorithm obtain a set of solutions with good diversity and convergence; finally, we update (3) to balance exploitation and exploration.In this MBSO/D, the MOPs are solved by updating the neighboring solutions of each solution. We use the aggregation functiongTEx∣λi,Z∗=max1≤j≤m⁡fjx-zj∗/λji to update the neighboring solutions of each solution, so the population is being updated at the same time. This updated strategy makes solution converge to subproblems gTEx∣λi,Z∗; this ensures the convergence of the algorithm. In addition, the weight vectors are uniformly distributed; this ensures the diversity of the algorithm. So, this update strategy can solve MOPs. Moreover, in original BSO, solutions are clustered by some clustering algorithms. But, in this MBSO, each subproblem is considered a class; the solutions are automatically clustered while the population is updated. The clustering in this MBSO does not require additional computation.This multiobjective BSO algorithm compares with other multiobjective BSO algorithms, e.g., MBSO-C [28] (MBSO with Cauchy mutation) and MBSO-DE [27] (MBSO with differential evolution); the major differences are as follows.In MBSO-C and MBSO-DE, after the solutions are cluttered by some clustering methods, some solutions of the population are replaced by the newly generated solutions. In these MBSOs, the population is firstly updated by the newly generated solutions; then, solutions are automatically clustered as each subproblem is optimized. In MBSO-C and MBSO-DE, the newly generated solutions compare with other solutions of the same cluster to update this cluster, which may reduce the pressure of convergence; in this algorithm, aggregate function is used to update the population, which may enhance pressure of convergence.


## 3.1. Motivation

The main motivation of this paper is to design a MOEA to achieve a set of solutions which evenly distribute on the true PF. BSO algorithm uses the group information to address the problems, which can help MOEAs to improve their performance. MOEAs use the neighboring information to optimal population, which can improve the performance of MOEAs. In this paper, this optimization idea is utilized to enhance the performance of multiobjective BSO algorithm. First, new solutions update the population by using the updated strategy of MOEA/D [21]; then, solutions are automatically clustered as each subproblem is optimized. Second, the decomposition technology determines the neighboring clusters of each cluster, and parent solutions are selected from adjacent clusters. Third, an adaptive selection strategy is used to balance exploration and exploitation.The MOEA/D decomposes a MOP into a series of subproblems by weight vectors and aggregate functions. For each solution, it and some of its neighbor solutions are selected as parents to generate a new solution. Then, some of its neighbor solutions are updated by aggregate functions and the new solution. So, all subproblems are simultaneously optimized in a population evolution. Each aggregate function makes some solutions converge to the corresponding weight vector, which can improve the convergence of the algorithm. In addition, the diversity of solutions is maintained by the uniformly distributed weight vectors. The main advantages of MOEA/D are that the diversity of obtained solutions can be determined by the given weight vectors; neighbor’s information is used to generate new offspring, which can improve the search efficiency.


## 3.2. Cluster and Update

In this work, each given weight vector fixes a cluster, and the size of each cluster is made the same. The best solution of each cluster is determined by corresponding weight vectorλi=(λ1i,⋯λmi) and the aggregation function [31]. The formula is as follows:(2)xbesti=min⁡gTEx∣λi,Z∗,x∈Piwhere gTEx∣λi,Z∗=max1≤j≤m⁡fjx-zj∗/λji is a aggregation function, Z∗=(z1∗,⋯,zm∗) is the reference point, and xbesti is the current best solution of i-th cluster Pi. After a new solution is produced by some cluster, one solution of neighboring clusters of this cluster may be replaced by this new solution. If the best solution is not better than the new solution, randomly select a solution (not the best solution) from the cluster, which is replaced by this new solution, and the current best solution of this cluster will be redefined by (2). This update strategy can reduce the computing effort. Moreover, in this paper, one new solution will replace two solutions at most, which can balance the convergence and diversity. One solution is replaced and the diversity of the population is maintained, but the rate of convergence may be lower. Many solutions are replaced and the rate of convergence can be enhanced, but the diversity of the population is reduced.


## 3.3. Selection Strategy and Crossover Operator

An effective selection strategy can help crossover operators to perform search work more effectively. In this BSO algorithm, according to an adaptive selection probability, a new solution will be produced by one cluster or three clusters. The adaptive selection probability is calculated by the following formulation:(3)pt=sonesone+sth+δ+0.1pt-1where t is the evolution generation; pt-1 is the selection probability of the t-1-generation; sone and sth are the number of kept new solutions which are generated by one cluster and three clusters, respectively; δ is to make the denominator not 0 and is set to a small number. If a random number is smaller than pt, parents are selected from one cluster to produce a new solution, which may enhance the exploitation; otherwise, parents are selected from three clusters to produce a new solution, which can strengthen the exploration.Based on the selection probabilitypt and the decomposition technology, a selection strategy is designed to balance local search and global search. For each weight vector, work out its T closet weight vectors according to the Euclidean distances of any two weight vectors. For each i=1,⋯N, set Bi=K∗i1,⋯,K∗iT where λi1,⋯λiT are the T closet weight vectors to λi and K is the size of each cluster. Then set(4)P=i-1∗K+1,⋯,i∗K,ifrand1<ptBi,ifrand2<JK∗1,⋯,K∗N,otherwise,otherwisewhere rand1∈[0,1] and rand2∈[0,1] are two random numbers; J is set to 0.9 as the same in [21]; xK∗i is the current best solution of i-th cluster. When the set P is set, randomly select two indexes r2 and r3 from P and generate one solution from xK∗i, xr2, and xr3 by the following formula:(5)xjnew=xjK∗i+Lxjr2-xjr3,ifrand0,1<CRxjK∗iotherwisewhere L∈[0,2] is a scale factor which controls the length of the exploration vector (xr2-xr3); CR is a constant value namely crossover rate; j=1,⋯,n and xjr2 indicates the j-th component of xr2; xnew=(x1new,x2new,⋯,xnnew). If the solution xK∗i dominates xnew, xnew is set as the following formula:(6)xjnew=xjK∗i-Lxjr2-xjr3ifxjnew≠xjK∗ixjK∗iotherwiseIf the new solution generated by (5) is dominated by xK∗i, the new solution generated by (6) may be better than xK∗i with big probability. Equation (6) serves to enhance the search efficiency. When two indexes r2 and r3 are randomly selected from i-1∗K+1,⋯,i∗K or Bi, the local search can be carried out to improve the convergence; when two indexes r2 and r3 are randomly selected from K∗1,⋯,K∗N, the global search can be carried out.


## 3.4. Pseudocode of the Proposed Algorithm

In this subsection, the pseudocode for the multiobjective brain storm optimization algorithm based on decomposition (MBSO/D) is displayed as shown in Pseudocode2.Pseudocode 2:The pseudo code of the algorithm MBSO/D.
Input: MOP (1) A stopping criterion N: the number of direction vectors (the clusters) K: the size of the cluster T: the number of the neighborhood, 0<T<N λ 1 , λ 2 , ⋯ , λ N: a set of N uniformly distributed weight vectors Output: Objective vectors: FxK,Fx2∗K,⋯,FxN∗K Initialization: Generate an initial population x1,x2,⋯xN∗K determine Z=(z1,⋯,zm); randomly cluster the initial population intoN clusters with size K and determine the best solution of each cluster; determineBi=i1,⋯,iT,(i=1,⋯,N), where λ i 1 , ⋯ , λ i T are the T closest weight vectors to λi; set pt=0.5 While the function evaluation times are less than the maximum function evaluation times do Set s o n e = 0 and sth=0 For i = 1 , ⋯ , N,do According to Eq. (4), randomly select two indexes r2 and r3, use xK∗i, xr2 and xr3 to generate offspring x n e w = ( x 1 n e w ,  x 2 n e w , ⋯ , x n n e w ) by Eq. (5). If xK∗i dominates xnew, xnew is regenerated by Eq. (6). Updateof Z: For j=1,⋯,m, if zj<fj(xnew), then set zj=fj(xnew) Update of Neighboring Solutions: set H=0 and Q=Bi While H ≤ 2 and Q≠∅ k = Q ( 1 ); If g T E ( x n e w ∣ λ k , z ) < g T E ( x k ∗ K ∣ λ k , z ) randomly select a number h from k-1∗K+1,⋯,k∗K-1, set xh=xk∗K, F ( x h ) = F ( x k ∗ K ), xk∗K=xnew and F(xk∗K)=F(xnew). H = H + 1. If x n e w generated by one cluster s o n e = s o n e + 1; Else s t h = s t h + 1; End if End if Q 1 =; End while End for Use Eq. (3) to update p t. end for end whileIn MBSO/D, firstly, solutions in initial population are randomly clustered into N clusters with size K and the best solution of each cluster is determine by (2); secondly, for the best solution of each cluster (the for loop in pseudocode), some solutions are selected according to (3)-(4), the best solution and selected solutions generate a new solution by (5) or (6), and these produce good offspring; thirdly, some neighboring solutions of the best solution are updated by the new solution and aggregation function (the while loop in pseudocode), to help the algorithm obtain a set of solutions with good diversity and convergence; finally, we update (3) to balance exploitation and exploration.In this MBSO/D, the MOPs are solved by updating the neighboring solutions of each solution. We use the aggregation functiongTEx∣λi,Z∗=max1≤j≤m⁡fjx-zj∗/λji to update the neighboring solutions of each solution, so the population is being updated at the same time. This updated strategy makes solution converge to subproblems gTEx∣λi,Z∗; this ensures the convergence of the algorithm. In addition, the weight vectors are uniformly distributed; this ensures the diversity of the algorithm. So, this update strategy can solve MOPs. Moreover, in original BSO, solutions are clustered by some clustering algorithms. But, in this MBSO, each subproblem is considered a class; the solutions are automatically clustered while the population is updated. The clustering in this MBSO does not require additional computation.This multiobjective BSO algorithm compares with other multiobjective BSO algorithms, e.g., MBSO-C [28] (MBSO with Cauchy mutation) and MBSO-DE [27] (MBSO with differential evolution); the major differences are as follows.In MBSO-C and MBSO-DE, after the solutions are cluttered by some clustering methods, some solutions of the population are replaced by the newly generated solutions. In these MBSOs, the population is firstly updated by the newly generated solutions; then, solutions are automatically clustered as each subproblem is optimized. In MBSO-C and MBSO-DE, the newly generated solutions compare with other solutions of the same cluster to update this cluster, which may reduce the pressure of convergence; in this algorithm, aggregate function is used to update the population, which may enhance pressure of convergence.


## 4. Experimental Studies

In this section, the performance of MBSO/D will be verified by comparing it with existing multiobjective optimization algorithms, e.g., NSGAII [11] and MOEA/D [21]. Two test suites are used in this experiment: ten test problems of the CEC 2009 competition [33] and seven DTLZ problems [34]. The number of decision variables is placed to 30, 7, 21, 12, and 22 for F1-F10, DTLZ1 and DTLZ3, DTLZ2 and DTLZ4-DTLZ6, DTLZ7, respectively.


### 4.1. Performance Metrics

Three performance metrics are adopted to quantify the performances of algorithms: generational distance (GD) [35], inverted generational distance (IGD) [35], and hypervolume indicator (HV) [36]. GD can evaluate the convergence performance of an algorithm. Both IGD and HV can evaluate the diversity and convergence of solutions obtained by an algorithm. Roughly 2000 points uniformly sampled on the Pareto fronts are used in the calculation of IGD and GD for each test problem. In the calculation of HV, the reference point Z∗=(Z1∗,⋯,Zm∗) is set to Zi∗=1.1∗max⁡fix∣x∈PS,i=1⋯,m. Moreover, the Wilcoxon Rank-Sum test [37] is employed at a significance level of 0.05. It tests whether the performance of MBSO/D is significantly better (“+”), statistically similar (“=”), or significantly worse (“-”) than/as that obtained by the compared algorithms.


### 4.2. Parameters Setting

All algorithms are implemented by using the MATLAB language and run independently for thirty times with the maximal number of function evaluations 100 000 on all test problems. For fair comparisons, the population size and the maximal number of function evaluations of the compared algorithms are the same as this work, and other parameters of NSGAII and MOEA/D are the same as the original literature. In MBSO/D,CR = 0.5 and L = 0.5; the size of each cluster is set to 5; the population size is set to 105 for all compared algorithms on each test problem; the size of neighborhood list T is set to 0.1N; the probability of choosing mate subproblem from its neighborhood J is set to 0.9.


### 4.3. Algorithm Performance Analyses

The statistical results of the GD, IGD, and HV metrics obtained by each MOEA are posted in Tables1 and 2. The performance of MBSO/D will be checked by these statistical results. In these tables, the highlighted bold results indicate the best results.Table 1
IGD, GD, and HV obtained by IMOEA/DA, MOEA/D, and NSGAII.
Problems IGD GD HV mean std mean std mean std F1 MBSO/D 0.0172 0.0068 0.0108 0.0020 0.8448 0.0073 MOEA/D 0.0750(+) 0.0513 0.0150(+) 0.0082 0.7622(+) 0.0515 NSGAII 0.0951(+) 0.0355 0.0135(+) 0.0028 0.7298(+) 0.0517  F2 MBSO/D 0.0050 0.0001 0.0025 0.0003 0.8679 0.0004 MOEA/D 0.0137(+) 0.0032 0.0050(+) 0.0006 0.8538(+) 0.0036 NSGAII 0.0095(+) 0.0005 0.0101(+) 0.0006 0.8614(+) 0.0007  F3 MBSO/D 0.0326 0.0101 0.0168 0.0043 0.8231 0.0123 MOEA/D 0.1194(+) 0.0939 0.0145(-) 0.0067 0.7538(+) 0.0604 NSGAII 0.0351(+) 0.0255 0.0130(-) 0.0015 0.8328(-) 0.0195  F4 MBSO/D 0.0038 0.0001 0.0004 0.0001 0.5382 0.0001 MOEA/D 0.0084(+) 0.0009 0.0040(+) 0.0002 0.5300(+) 0.0023 NSGAII 0.0056(+) 0.0003 0.0050(+) 0.0003 0.5348(+) 0.0004  F5 MBSO/D 0.4074 0.0718 0.4799 0.0896 0.0767 0.0599 MOEA/D 0.4342(+) 0.1547 0.3598(-) 0.1601 0.1199(-) 0.0926 NSGAII 0.4643(+) 0.1087 0.3094(-) 0.1325 0.0782(=) 0.0817  F6 MBSO/D 0.1334 0.0677 0.3879 0.9174 0.4485 0.0811 MOEA/D 0.2116(+) 0.1383 0.1467(-) 0.0554 0.3911(+) 0.0946 NSGAII 0.1935(+) 0.0897 0.0079(-) 0.0100 0.3900(+) 0.0889  F7 MBSO/D 0.0168 0.0024 0.0222 0.0097 0.6770 0.0048 MOEA/D 0.0794(+) 0.1676 0.0166(-) 0.0127 0.6165(+) 0.1386 NSGAII 0.0782(+) 0.1203 0.0067(-) 0.0016 0.6066(+) 0.1002  F8 MBSO/D 0.0903 0.0080 0.0443 0.0093 0.6444 0.0198 MOEA/D 0.0939(+) 0.0114 0.0136(-) 0.0025 0.6516(=) 0.0158 NSGAII 0.1482(+) 0.0242 0.7099(+) 0.6017 0.5616(+) 0.0427  F9 MBSO/D 0.0770 0.0135 0.1484 0.1113 0.9797 0.0276 MOEA/D 0.1039(+) 0.0448 0.0857(-) 0.0375 0.9067(+) 0.0638 NSGAII 0.1666(+) 0.0709 0.9917(+) 0.8967 0.7647(+) 0.1496  F10 MBSO/D 0.3442 0.0772 7.3988 3.3987 0.3175 0.1025 MOEA/D 0.3597(+) 0.2113 0.1555(-) 0.1425 0.3100(+) 0.1442 NSGAII 0.3505(+) 0.0682 3.4759(-) 3.5608 0.1811(+) 0.0624  DTLZ1 MBSO/D 0.0186 0.0001 0.0071 0.0001 0.1404 0.0001 MOEA/D 0.0314(+) 0.0016 0.0075(+) 0.0002 0.1295(+) 0.0011 NSGAII 0.0356(+) 0.0500 0.0183(+) 0.0611 0.1335(+) 0.0204  DTLZ2 MBSO/D 0.0522 0.0037 0.0184 0.0009 0.7380 0.0027 MOEA/D 0.0813(+) 0.0053 0.0209(+) 0.0010 0.6673(+) 0.0107 NSGAII 0.0692(+) 0.0021 0.0234(+) 0.0013 0.7011(+) 0.0057  DTLZ3 MBSO/D 0.0624 0.0515 0.0177 0.0017 0.7327 0.0577 MOEA/D 0.0807(+) 0.0048 0.0204(+) 0.0009 0.6709(+) 0.0115 NSGAII 0.0692(+) 0.0024 0.0231(+) 0.0146 0.7113(+) 0.0062  DTLZ4 MBSO/D 0.0530 0.0027 0.0174 0.0008 0.7421 0.0018 MOEA/D 0.0822(+) 0.0053 0.0202(+) 0.0010 0.6788(+) 0.0155 NSGAII 0.1299(+) 0.1628 0.0218(+) 0.0037 0.6748(+) 0.0853  DTLZ5 MBSO/D 0.0186 0.0015 0.0077 0.0047 0.4281 0.0012 MOEA/D 0.0121(-) 0.0030 0.0006(-) 0.0001 0.4174(+) 0.0083 NSGAII 0.0053(-) 0.0003 0.0011(-) 0.0002 0.4378(-) 0.0003  DTLZ6 MBSO/D 0.0207 0.0003 0.0035 0.0040 0.4260 0.0002 MOEA/D 0.0118(-) 0.0038 0.0004(+) 0.0001 0.4190(+) 0.0092 NSGAII 0.0555(+) 0.0260 0.0668(+) 0.0249 0.3745(+) 0.0291  DTLZ7 MBSO/D 0.0784 0.0005 0.0071 0.0005 1.2913 0.0013 MOEA/D 0.1558(+) 0.0239 0.0079(+) 0.0010 0.9319(+) 0.0031 NSGAII 0.1124(+) 0.0935 0.0157(+) 0.0132 1.0256(+) 0.0024 “+” means that MBSO/D outperforms its competitor algorithm, “-” means that MBSO/D is worse than its competitor algorithm, and “=” means that the competitor algorithm has the same performance as MBSO/D.Table 2
GD and∆ obtained by MBSO/D, MBSO-DE, and MBSO-C on five ZDT problems.
Problems GD ∆ best mean best mean ZDT1 MBSO/D 0.0009 0.0009 0.0563 0.0569 MBSO-DE 0.0010 0.0011 0.1008 0.1257 MBSO-C 0.0695 0.0912 0.5105 0.5529  ZDT2 MBSO/D 0.0007 0.0008 0.0270 0.0274 MBSO-DE 0.0007 0.0008 0.0997 0.1253 MBSO-C 0.0725 0.0905 0.4898 0.5588  ZDT3 MBSO/D 0.0010 0.0012 0.4126 0.4187 MBSO-DE 0.0011 0.0012 0.4126 0.4188 MBSO-C 0.0443 0.0589 0.5708 0.6364  ZDT4 MBSO/D 0.0022 0.0023 0.1405 0.1460 MBSO-DE 2.9322 13.8379 1.2958 1.3968 MBSO-C 6.4966 15.2905 0.8362 0.9699  ZDT6 MBSO/D 0.0008 0.0009 0.0062 0.0082 MBSO-DE 0.0037 0.0040 0.5322 0.5346 MBSO-C 0.0580 0.0813 0.6969 0.7425


#### 4.3.1. Comparisons of MBSO/D with NSGAII and MOEA/D

This subsection presents the comparison results on IGD, GD, and HV in seventeen problems. Table1 gives the mean and standard deviation values for three comparison algorithms. We can obtain from Table 1 that, in the form of the HV and IGD metrics, the results obtained by MBSO/D are better than those obtained by NSGAII and MOEA/D on more than fourteen problems, which indicates that the final solutions obtained by MBSO/D have a better diversity than those obtained by NSGAII and MOEA/D and have a good convergence; the mean values of GD metric contained by MBSO/D are bigger than those obtained by MOEA/D and NSGAII on more than nine problems; these imply that MBSO/D can obtain a set of solutions with better convergence than MOEA/D and NSGAII on most test problems.Moreover, MBSO/D outperforms NSGAII and MOEA/D in solving DTLZ1 and DTLZ3; this emphasizes that the selection strategy and crossover operators have the advantage in solving multiple local fronts problems. NSGAII is better at solving DTLZ5. The reason for the higher mean IGD value for MBSO/D is because the update strategy is not suitable for MOPs with degenerated PF. According to the median values of IGD metric, Figure1 plots the nondominated solutions obtained by MBSO/D. It is observed that the obtained objective vectors of nondominated solutions uniformly cover the full true PF on these seventeen test problems except for problems F5, F6, F9, and F10. MBSO/D cannot converge to the true PF on problems F5, F6, F9, and F10, because the maximal number of function evaluations is small and the sizes of decision variables are big.Figure 1
According to the median values of IGD metric, nondominated solutions obtained by MBSO/D on seven DTLZ problems and ten F1-F10 problems.The main goal of MOEAs is to obtain a set of solutions with good diversity and convergence. To test the algorithms' ability to accomplish this goal, Figure2 shows the evolution of the average IGD metric values of the current population with the number of function evaluations for F1, F2, DTLZ1, and DTLZ3. Figure 2 indicates that MBSO/D converges, in terms of the number of function evaluations, much faster than MOEA/D and NSGAII in minimizing the IGD metric value for these four test problems. In other words, for MOPs with many local PFs (DTLZ1 and DTLZ3), MBSO/D can quickly converge to true PF and maintain the diversity of obtained solutions; for two-objective problems (F1 and F2), MBSO/D can find a set of solutions better than MOEA/D and NSGAII. These comparisons suggest that the selection strategy of MBSO/D is good at balancing exploration and exploitation; the updated strategy can maintain the diversity.Figure 2
Evolution of the mean of IGD metric values for F1, F2, DTLZ1, and DTLZ3.


#### 4.3.2. Comparisons of MBSO/D with MBSO-C and MBSO-DE

In this subsection, we compare MBSO/D with two MBSOs (MBSO-C [28] and MBSO-DE [27]) to testify the performance of MBSO/D. MBSO/D compares with MBSO-C and MBSO-DE on five ZDT [23] problems (ZDT1-ZDT4 and ZDT6). The experimental results of MBSO-C and MBSO-DE are directly obtained from the original literatures. For fair comparisons, the population size of MBSO/D is set to 100 for five problems; the maximal number of function evaluations is set to 300 000 which is smaller than the number of MBSO-C and MBSO-DE; other parameters settings are adopted in Section 4.2.The mean and the best values of GD and∆ [11] metrics obtained by MBSO/D, MBSO-C, and MBSO-DE are displayed in Table 2. It can be obtained from this table that, in the form of these two metrics, the results obtained by MBSO/D are better than those obtained by MBSO-C and MBSO-DE, which illustrate that MBSO/D can achieve a set of solutions with better diversity and converge than MBSO-C and MBSO-DE on all these five problems. These comparisons imply that MBSO/D is better at balancing exploration and exploitation than MBSO-C and MBSO-DE on these problems. According to the median values of GD metric, the objective vectors of nondominated solutions obtained by MBSO/D on the five ZDT test problems are plotted in Figure 3, which can visually show the superior performance of MBSO/D. These indicate that MBSO/D can effectively approach the true PFs.Figure 3
According to the median values of GD metric, nondominated solutions obtained by MBSO/D on five ZDT problems.


#### 4.3.3. Comparisons of MBSO/D with MOHS/D

In this subsection, MOHS/D is used to compare with MBSO/D [38]. MOHS/D hybridizes MOEA/D with harmony search algorithm to solve MOPs. MBSO/D compares with MOHS/D on five ZDT problems and seven DTLZ problems. The experimental results of MOHS/D are directly got from the original literature to make a fair comparison, and the population sizes of MBSO/D are set to 100 and 200 for two-objective and three-objective problems, respectively. For each problem, the maximal number of function evaluations is the same as MOHS/D [38]; other parameters settings are the same as in Section 4.2.Table3 summarizes the best, median, and worst values of IGD metric obtained by MBSO/D and MOHS/D on these twelve test problems. It can be seen from this table that the median values of IGD metric obtained by MBSO/D are smaller than those obtained by MOHS/D on five ZDT problems, DTLZ3 and DTLZ6 and that the median values of IGD metric obtained by MBSO/D are bigger than those obtained by MOHS/D on other five DTLZ problems. Those indicate that we can obtain a set of solutions with better coverage and diversity than MOHS/D on most problems of these twelve test problems.Table 3
IGD obtained by MBSO/D and MOHS/D on five ZDT problems and seven DTLZ problems.
Problems IGD Best Median Worst ZDT1 MBSO/D 1.62e-3 1.71e-3 2.04e-3 MOHS/D 1.37e-3 1.86e-3 2.18e-3  ZDT2 MBSO/D 8.42e-4 1.02e-3 2.45e-3 MOHS/D 2.26e-3 2.26e-3 3.01e-3  ZDT3 MBSO/D 6.14e-4 9.52e-4 1.26e-3 MOHS/D 9.15e-4 1.19e-3 1.76e-3  ZDT4 MBSO/D 1.86e-4 1.62e-4 5.21e-3 MOHS/D 1.76e-4 1.64e-4 4.23e-3  ZDT6 MBSO/D 1.62e-4 1.87e-4 3.41e-4 MOHS/D 1.59e-4 1.91e-4 2.42e-4  DTLZ1 MBSO/D 1.77e-2 1.81e-2 1.92e-2 MOHS/D 4.69e-03 1.28e-02 4.16e-2  DTLZ2 MBSO/D 5.12e-2 5.22e-2 5.44e-2 MOHS/D 3.23e-3 4.08e-3 4.71e-3  DTLZ3 MBSO/D 6.13e-2 6.24e-2 8.26e-2 MOHS/D 8.62e-2 1.33e-1 2.00e-1  DTLZ4 MBSO/D 6.23e-3 5.30e-2 5.74e-2 MOHS/D 8.43e-3 9.76e-3 1.06e-2  DTLZ5 MBSO/D 5.49e-3 1.86e-2 2.61e-2 MOHS/D 1.34e-3 1.40e-3 1.45e-3  DTLZ6 MBSO/D 1.57e-2 2.07e-2 2.51e-2 MOHS/D 1.21e-2 2.21e-2 3.35e-2  DTLZ7 MBSO/D 6.25e-2 7.85e-2 9.21e-2 MOHS/D 2.89e-2 3.00e-2 3.07e-2


## 4.1. Performance Metrics

Three performance metrics are adopted to quantify the performances of algorithms: generational distance (GD) [35], inverted generational distance (IGD) [35], and hypervolume indicator (HV) [36]. GD can evaluate the convergence performance of an algorithm. Both IGD and HV can evaluate the diversity and convergence of solutions obtained by an algorithm. Roughly 2000 points uniformly sampled on the Pareto fronts are used in the calculation of IGD and GD for each test problem. In the calculation of HV, the reference point Z∗=(Z1∗,⋯,Zm∗) is set to Zi∗=1.1∗max⁡fix∣x∈PS,i=1⋯,m. Moreover, the Wilcoxon Rank-Sum test [37] is employed at a significance level of 0.05. It tests whether the performance of MBSO/D is significantly better (“+”), statistically similar (“=”), or significantly worse (“-”) than/as that obtained by the compared algorithms.


## 4.2. Parameters Setting

All algorithms are implemented by using the MATLAB language and run independently for thirty times with the maximal number of function evaluations 100 000 on all test problems. For fair comparisons, the population size and the maximal number of function evaluations of the compared algorithms are the same as this work, and other parameters of NSGAII and MOEA/D are the same as the original literature. In MBSO/D,CR = 0.5 and L = 0.5; the size of each cluster is set to 5; the population size is set to 105 for all compared algorithms on each test problem; the size of neighborhood list T is set to 0.1N; the probability of choosing mate subproblem from its neighborhood J is set to 0.9.


## 4.3. Algorithm Performance Analyses

The statistical results of the GD, IGD, and HV metrics obtained by each MOEA are posted in Tables1 and 2. The performance of MBSO/D will be checked by these statistical results. In these tables, the highlighted bold results indicate the best results.Table 1
IGD, GD, and HV obtained by IMOEA/DA, MOEA/D, and NSGAII.
Problems IGD GD HV mean std mean std mean std F1 MBSO/D 0.0172 0.0068 0.0108 0.0020 0.8448 0.0073 MOEA/D 0.0750(+) 0.0513 0.0150(+) 0.0082 0.7622(+) 0.0515 NSGAII 0.0951(+) 0.0355 0.0135(+) 0.0028 0.7298(+) 0.0517  F2 MBSO/D 0.0050 0.0001 0.0025 0.0003 0.8679 0.0004 MOEA/D 0.0137(+) 0.0032 0.0050(+) 0.0006 0.8538(+) 0.0036 NSGAII 0.0095(+) 0.0005 0.0101(+) 0.0006 0.8614(+) 0.0007  F3 MBSO/D 0.0326 0.0101 0.0168 0.0043 0.8231 0.0123 MOEA/D 0.1194(+) 0.0939 0.0145(-) 0.0067 0.7538(+) 0.0604 NSGAII 0.0351(+) 0.0255 0.0130(-) 0.0015 0.8328(-) 0.0195  F4 MBSO/D 0.0038 0.0001 0.0004 0.0001 0.5382 0.0001 MOEA/D 0.0084(+) 0.0009 0.0040(+) 0.0002 0.5300(+) 0.0023 NSGAII 0.0056(+) 0.0003 0.0050(+) 0.0003 0.5348(+) 0.0004  F5 MBSO/D 0.4074 0.0718 0.4799 0.0896 0.0767 0.0599 MOEA/D 0.4342(+) 0.1547 0.3598(-) 0.1601 0.1199(-) 0.0926 NSGAII 0.4643(+) 0.1087 0.3094(-) 0.1325 0.0782(=) 0.0817  F6 MBSO/D 0.1334 0.0677 0.3879 0.9174 0.4485 0.0811 MOEA/D 0.2116(+) 0.1383 0.1467(-) 0.0554 0.3911(+) 0.0946 NSGAII 0.1935(+) 0.0897 0.0079(-) 0.0100 0.3900(+) 0.0889  F7 MBSO/D 0.0168 0.0024 0.0222 0.0097 0.6770 0.0048 MOEA/D 0.0794(+) 0.1676 0.0166(-) 0.0127 0.6165(+) 0.1386 NSGAII 0.0782(+) 0.1203 0.0067(-) 0.0016 0.6066(+) 0.1002  F8 MBSO/D 0.0903 0.0080 0.0443 0.0093 0.6444 0.0198 MOEA/D 0.0939(+) 0.0114 0.0136(-) 0.0025 0.6516(=) 0.0158 NSGAII 0.1482(+) 0.0242 0.7099(+) 0.6017 0.5616(+) 0.0427  F9 MBSO/D 0.0770 0.0135 0.1484 0.1113 0.9797 0.0276 MOEA/D 0.1039(+) 0.0448 0.0857(-) 0.0375 0.9067(+) 0.0638 NSGAII 0.1666(+) 0.0709 0.9917(+) 0.8967 0.7647(+) 0.1496  F10 MBSO/D 0.3442 0.0772 7.3988 3.3987 0.3175 0.1025 MOEA/D 0.3597(+) 0.2113 0.1555(-) 0.1425 0.3100(+) 0.1442 NSGAII 0.3505(+) 0.0682 3.4759(-) 3.5608 0.1811(+) 0.0624  DTLZ1 MBSO/D 0.0186 0.0001 0.0071 0.0001 0.1404 0.0001 MOEA/D 0.0314(+) 0.0016 0.0075(+) 0.0002 0.1295(+) 0.0011 NSGAII 0.0356(+) 0.0500 0.0183(+) 0.0611 0.1335(+) 0.0204  DTLZ2 MBSO/D 0.0522 0.0037 0.0184 0.0009 0.7380 0.0027 MOEA/D 0.0813(+) 0.0053 0.0209(+) 0.0010 0.6673(+) 0.0107 NSGAII 0.0692(+) 0.0021 0.0234(+) 0.0013 0.7011(+) 0.0057  DTLZ3 MBSO/D 0.0624 0.0515 0.0177 0.0017 0.7327 0.0577 MOEA/D 0.0807(+) 0.0048 0.0204(+) 0.0009 0.6709(+) 0.0115 NSGAII 0.0692(+) 0.0024 0.0231(+) 0.0146 0.7113(+) 0.0062  DTLZ4 MBSO/D 0.0530 0.0027 0.0174 0.0008 0.7421 0.0018 MOEA/D 0.0822(+) 0.0053 0.0202(+) 0.0010 0.6788(+) 0.0155 NSGAII 0.1299(+) 0.1628 0.0218(+) 0.0037 0.6748(+) 0.0853  DTLZ5 MBSO/D 0.0186 0.0015 0.0077 0.0047 0.4281 0.0012 MOEA/D 0.0121(-) 0.0030 0.0006(-) 0.0001 0.4174(+) 0.0083 NSGAII 0.0053(-) 0.0003 0.0011(-) 0.0002 0.4378(-) 0.0003  DTLZ6 MBSO/D 0.0207 0.0003 0.0035 0.0040 0.4260 0.0002 MOEA/D 0.0118(-) 0.0038 0.0004(+) 0.0001 0.4190(+) 0.0092 NSGAII 0.0555(+) 0.0260 0.0668(+) 0.0249 0.3745(+) 0.0291  DTLZ7 MBSO/D 0.0784 0.0005 0.0071 0.0005 1.2913 0.0013 MOEA/D 0.1558(+) 0.0239 0.0079(+) 0.0010 0.9319(+) 0.0031 NSGAII 0.1124(+) 0.0935 0.0157(+) 0.0132 1.0256(+) 0.0024 “+” means that MBSO/D outperforms its competitor algorithm, “-” means that MBSO/D is worse than its competitor algorithm, and “=” means that the competitor algorithm has the same performance as MBSO/D.Table 2
GD and∆ obtained by MBSO/D, MBSO-DE, and MBSO-C on five ZDT problems.
Problems GD ∆ best mean best mean ZDT1 MBSO/D 0.0009 0.0009 0.0563 0.0569 MBSO-DE 0.0010 0.0011 0.1008 0.1257 MBSO-C 0.0695 0.0912 0.5105 0.5529  ZDT2 MBSO/D 0.0007 0.0008 0.0270 0.0274 MBSO-DE 0.0007 0.0008 0.0997 0.1253 MBSO-C 0.0725 0.0905 0.4898 0.5588  ZDT3 MBSO/D 0.0010 0.0012 0.4126 0.4187 MBSO-DE 0.0011 0.0012 0.4126 0.4188 MBSO-C 0.0443 0.0589 0.5708 0.6364  ZDT4 MBSO/D 0.0022 0.0023 0.1405 0.1460 MBSO-DE 2.9322 13.8379 1.2958 1.3968 MBSO-C 6.4966 15.2905 0.8362 0.9699  ZDT6 MBSO/D 0.0008 0.0009 0.0062 0.0082 MBSO-DE 0.0037 0.0040 0.5322 0.5346 MBSO-C 0.0580 0.0813 0.6969 0.7425


### 4.3.1. Comparisons of MBSO/D with NSGAII and MOEA/D

This subsection presents the comparison results on IGD, GD, and HV in seventeen problems. Table1 gives the mean and standard deviation values for three comparison algorithms. We can obtain from Table 1 that, in the form of the HV and IGD metrics, the results obtained by MBSO/D are better than those obtained by NSGAII and MOEA/D on more than fourteen problems, which indicates that the final solutions obtained by MBSO/D have a better diversity than those obtained by NSGAII and MOEA/D and have a good convergence; the mean values of GD metric contained by MBSO/D are bigger than those obtained by MOEA/D and NSGAII on more than nine problems; these imply that MBSO/D can obtain a set of solutions with better convergence than MOEA/D and NSGAII on most test problems.Moreover, MBSO/D outperforms NSGAII and MOEA/D in solving DTLZ1 and DTLZ3; this emphasizes that the selection strategy and crossover operators have the advantage in solving multiple local fronts problems. NSGAII is better at solving DTLZ5. The reason for the higher mean IGD value for MBSO/D is because the update strategy is not suitable for MOPs with degenerated PF. According to the median values of IGD metric, Figure1 plots the nondominated solutions obtained by MBSO/D. It is observed that the obtained objective vectors of nondominated solutions uniformly cover the full true PF on these seventeen test problems except for problems F5, F6, F9, and F10. MBSO/D cannot converge to the true PF on problems F5, F6, F9, and F10, because the maximal number of function evaluations is small and the sizes of decision variables are big.Figure 1
According to the median values of IGD metric, nondominated solutions obtained by MBSO/D on seven DTLZ problems and ten F1-F10 problems.The main goal of MOEAs is to obtain a set of solutions with good diversity and convergence. To test the algorithms' ability to accomplish this goal, Figure2 shows the evolution of the average IGD metric values of the current population with the number of function evaluations for F1, F2, DTLZ1, and DTLZ3. Figure 2 indicates that MBSO/D converges, in terms of the number of function evaluations, much faster than MOEA/D and NSGAII in minimizing the IGD metric value for these four test problems. In other words, for MOPs with many local PFs (DTLZ1 and DTLZ3), MBSO/D can quickly converge to true PF and maintain the diversity of obtained solutions; for two-objective problems (F1 and F2), MBSO/D can find a set of solutions better than MOEA/D and NSGAII. These comparisons suggest that the selection strategy of MBSO/D is good at balancing exploration and exploitation; the updated strategy can maintain the diversity.Figure 2
Evolution of the mean of IGD metric values for F1, F2, DTLZ1, and DTLZ3.


### 4.3.2. Comparisons of MBSO/D with MBSO-C and MBSO-DE

In this subsection, we compare MBSO/D with two MBSOs (MBSO-C [28] and MBSO-DE [27]) to testify the performance of MBSO/D. MBSO/D compares with MBSO-C and MBSO-DE on five ZDT [23] problems (ZDT1-ZDT4 and ZDT6). The experimental results of MBSO-C and MBSO-DE are directly obtained from the original literatures. For fair comparisons, the population size of MBSO/D is set to 100 for five problems; the maximal number of function evaluations is set to 300 000 which is smaller than the number of MBSO-C and MBSO-DE; other parameters settings are adopted in Section 4.2.The mean and the best values of GD and∆ [11] metrics obtained by MBSO/D, MBSO-C, and MBSO-DE are displayed in Table 2. It can be obtained from this table that, in the form of these two metrics, the results obtained by MBSO/D are better than those obtained by MBSO-C and MBSO-DE, which illustrate that MBSO/D can achieve a set of solutions with better diversity and converge than MBSO-C and MBSO-DE on all these five problems. These comparisons imply that MBSO/D is better at balancing exploration and exploitation than MBSO-C and MBSO-DE on these problems. According to the median values of GD metric, the objective vectors of nondominated solutions obtained by MBSO/D on the five ZDT test problems are plotted in Figure 3, which can visually show the superior performance of MBSO/D. These indicate that MBSO/D can effectively approach the true PFs.Figure 3
According to the median values of GD metric, nondominated solutions obtained by MBSO/D on five ZDT problems.


### 4.3.3. Comparisons of MBSO/D with MOHS/D

In this subsection, MOHS/D is used to compare with MBSO/D [38]. MOHS/D hybridizes MOEA/D with harmony search algorithm to solve MOPs. MBSO/D compares with MOHS/D on five ZDT problems and seven DTLZ problems. The experimental results of MOHS/D are directly got from the original literature to make a fair comparison, and the population sizes of MBSO/D are set to 100 and 200 for two-objective and three-objective problems, respectively. For each problem, the maximal number of function evaluations is the same as MOHS/D [38]; other parameters settings are the same as in Section 4.2.Table3 summarizes the best, median, and worst values of IGD metric obtained by MBSO/D and MOHS/D on these twelve test problems. It can be seen from this table that the median values of IGD metric obtained by MBSO/D are smaller than those obtained by MOHS/D on five ZDT problems, DTLZ3 and DTLZ6 and that the median values of IGD metric obtained by MBSO/D are bigger than those obtained by MOHS/D on other five DTLZ problems. Those indicate that we can obtain a set of solutions with better coverage and diversity than MOHS/D on most problems of these twelve test problems.Table 3
IGD obtained by MBSO/D and MOHS/D on five ZDT problems and seven DTLZ problems.
Problems IGD Best Median Worst ZDT1 MBSO/D 1.62e-3 1.71e-3 2.04e-3 MOHS/D 1.37e-3 1.86e-3 2.18e-3  ZDT2 MBSO/D 8.42e-4 1.02e-3 2.45e-3 MOHS/D 2.26e-3 2.26e-3 3.01e-3  ZDT3 MBSO/D 6.14e-4 9.52e-4 1.26e-3 MOHS/D 9.15e-4 1.19e-3 1.76e-3  ZDT4 MBSO/D 1.86e-4 1.62e-4 5.21e-3 MOHS/D 1.76e-4 1.64e-4 4.23e-3  ZDT6 MBSO/D 1.62e-4 1.87e-4 3.41e-4 MOHS/D 1.59e-4 1.91e-4 2.42e-4  DTLZ1 MBSO/D 1.77e-2 1.81e-2 1.92e-2 MOHS/D 4.69e-03 1.28e-02 4.16e-2  DTLZ2 MBSO/D 5.12e-2 5.22e-2 5.44e-2 MOHS/D 3.23e-3 4.08e-3 4.71e-3  DTLZ3 MBSO/D 6.13e-2 6.24e-2 8.26e-2 MOHS/D 8.62e-2 1.33e-1 2.00e-1  DTLZ4 MBSO/D 6.23e-3 5.30e-2 5.74e-2 MOHS/D 8.43e-3 9.76e-3 1.06e-2  DTLZ5 MBSO/D 5.49e-3 1.86e-2 2.61e-2 MOHS/D 1.34e-3 1.40e-3 1.45e-3  DTLZ6 MBSO/D 1.57e-2 2.07e-2 2.51e-2 MOHS/D 1.21e-2 2.21e-2 3.35e-2  DTLZ7 MBSO/D 6.25e-2 7.85e-2 9.21e-2 MOHS/D 2.89e-2 3.00e-2 3.07e-2


## 4.3.1. Comparisons of MBSO/D with NSGAII and MOEA/D

This subsection presents the comparison results on IGD, GD, and HV in seventeen problems. Table1 gives the mean and standard deviation values for three comparison algorithms. We can obtain from Table 1 that, in the form of the HV and IGD metrics, the results obtained by MBSO/D are better than those obtained by NSGAII and MOEA/D on more than fourteen problems, which indicates that the final solutions obtained by MBSO/D have a better diversity than those obtained by NSGAII and MOEA/D and have a good convergence; the mean values of GD metric contained by MBSO/D are bigger than those obtained by MOEA/D and NSGAII on more than nine problems; these imply that MBSO/D can obtain a set of solutions with better convergence than MOEA/D and NSGAII on most test problems.Moreover, MBSO/D outperforms NSGAII and MOEA/D in solving DTLZ1 and DTLZ3; this emphasizes that the selection strategy and crossover operators have the advantage in solving multiple local fronts problems. NSGAII is better at solving DTLZ5. The reason for the higher mean IGD value for MBSO/D is because the update strategy is not suitable for MOPs with degenerated PF. According to the median values of IGD metric, Figure1 plots the nondominated solutions obtained by MBSO/D. It is observed that the obtained objective vectors of nondominated solutions uniformly cover the full true PF on these seventeen test problems except for problems F5, F6, F9, and F10. MBSO/D cannot converge to the true PF on problems F5, F6, F9, and F10, because the maximal number of function evaluations is small and the sizes of decision variables are big.Figure 1
According to the median values of IGD metric, nondominated solutions obtained by MBSO/D on seven DTLZ problems and ten F1-F10 problems.The main goal of MOEAs is to obtain a set of solutions with good diversity and convergence. To test the algorithms' ability to accomplish this goal, Figure2 shows the evolution of the average IGD metric values of the current population with the number of function evaluations for F1, F2, DTLZ1, and DTLZ3. Figure 2 indicates that MBSO/D converges, in terms of the number of function evaluations, much faster than MOEA/D and NSGAII in minimizing the IGD metric value for these four test problems. In other words, for MOPs with many local PFs (DTLZ1 and DTLZ3), MBSO/D can quickly converge to true PF and maintain the diversity of obtained solutions; for two-objective problems (F1 and F2), MBSO/D can find a set of solutions better than MOEA/D and NSGAII. These comparisons suggest that the selection strategy of MBSO/D is good at balancing exploration and exploitation; the updated strategy can maintain the diversity.Figure 2
Evolution of the mean of IGD metric values for F1, F2, DTLZ1, and DTLZ3.


## 4.3.2. Comparisons of MBSO/D with MBSO-C and MBSO-DE

In this subsection, we compare MBSO/D with two MBSOs (MBSO-C [28] and MBSO-DE [27]) to testify the performance of MBSO/D. MBSO/D compares with MBSO-C and MBSO-DE on five ZDT [23] problems (ZDT1-ZDT4 and ZDT6). The experimental results of MBSO-C and MBSO-DE are directly obtained from the original literatures. For fair comparisons, the population size of MBSO/D is set to 100 for five problems; the maximal number of function evaluations is set to 300 000 which is smaller than the number of MBSO-C and MBSO-DE; other parameters settings are adopted in Section 4.2.The mean and the best values of GD and∆ [11] metrics obtained by MBSO/D, MBSO-C, and MBSO-DE are displayed in Table 2. It can be obtained from this table that, in the form of these two metrics, the results obtained by MBSO/D are better than those obtained by MBSO-C and MBSO-DE, which illustrate that MBSO/D can achieve a set of solutions with better diversity and converge than MBSO-C and MBSO-DE on all these five problems. These comparisons imply that MBSO/D is better at balancing exploration and exploitation than MBSO-C and MBSO-DE on these problems. According to the median values of GD metric, the objective vectors of nondominated solutions obtained by MBSO/D on the five ZDT test problems are plotted in Figure 3, which can visually show the superior performance of MBSO/D. These indicate that MBSO/D can effectively approach the true PFs.Figure 3
According to the median values of GD metric, nondominated solutions obtained by MBSO/D on five ZDT problems.


## 4.3.3. Comparisons of MBSO/D with MOHS/D

In this subsection, MOHS/D is used to compare with MBSO/D [38]. MOHS/D hybridizes MOEA/D with harmony search algorithm to solve MOPs. MBSO/D compares with MOHS/D on five ZDT problems and seven DTLZ problems. The experimental results of MOHS/D are directly got from the original literature to make a fair comparison, and the population sizes of MBSO/D are set to 100 and 200 for two-objective and three-objective problems, respectively. For each problem, the maximal number of function evaluations is the same as MOHS/D [38]; other parameters settings are the same as in Section 4.2.Table3 summarizes the best, median, and worst values of IGD metric obtained by MBSO/D and MOHS/D on these twelve test problems. It can be seen from this table that the median values of IGD metric obtained by MBSO/D are smaller than those obtained by MOHS/D on five ZDT problems, DTLZ3 and DTLZ6 and that the median values of IGD metric obtained by MBSO/D are bigger than those obtained by MOHS/D on other five DTLZ problems. Those indicate that we can obtain a set of solutions with better coverage and diversity than MOHS/D on most problems of these twelve test problems.Table 3
IGD obtained by MBSO/D and MOHS/D on five ZDT problems and seven DTLZ problems.
Problems IGD Best Median Worst ZDT1 MBSO/D 1.62e-3 1.71e-3 2.04e-3 MOHS/D 1.37e-3 1.86e-3 2.18e-3  ZDT2 MBSO/D 8.42e-4 1.02e-3 2.45e-3 MOHS/D 2.26e-3 2.26e-3 3.01e-3  ZDT3 MBSO/D 6.14e-4 9.52e-4 1.26e-3 MOHS/D 9.15e-4 1.19e-3 1.76e-3  ZDT4 MBSO/D 1.86e-4 1.62e-4 5.21e-3 MOHS/D 1.76e-4 1.64e-4 4.23e-3  ZDT6 MBSO/D 1.62e-4 1.87e-4 3.41e-4 MOHS/D 1.59e-4 1.91e-4 2.42e-4  DTLZ1 MBSO/D 1.77e-2 1.81e-2 1.92e-2 MOHS/D 4.69e-03 1.28e-02 4.16e-2  DTLZ2 MBSO/D 5.12e-2 5.22e-2 5.44e-2 MOHS/D 3.23e-3 4.08e-3 4.71e-3  DTLZ3 MBSO/D 6.13e-2 6.24e-2 8.26e-2 MOHS/D 8.62e-2 1.33e-1 2.00e-1  DTLZ4 MBSO/D 6.23e-3 5.30e-2 5.74e-2 MOHS/D 8.43e-3 9.76e-3 1.06e-2  DTLZ5 MBSO/D 5.49e-3 1.86e-2 2.61e-2 MOHS/D 1.34e-3 1.40e-3 1.45e-3  DTLZ6 MBSO/D 1.57e-2 2.07e-2 2.51e-2 MOHS/D 1.21e-2 2.21e-2 3.35e-2  DTLZ7 MBSO/D 6.25e-2 7.85e-2 9.21e-2 MOHS/D 2.89e-2 3.00e-2 3.07e-2


## 5. Conclusions

In this paper, we proposed a multiobjective brain storm optimization algorithm, called MBSO/D, based on the idea of decomposition. In this approach, the update strategy of MOEA/D [21] is used in the MBSO, which can well balance the diversity and convergence. Simultaneously, a selection strategy is adopted to improve the search efficiency of this algorithm. Moreover, MBSO/D compares with NSGAII, MOEA/D, MBSO-C, MBSO-DE, and MOHS/D on some test sets with complicated PS or many local PFs. According to the performance analyses, MBSO/D shows competitive performances on most test problems against for comparisons MOEAs. These results imply that the update strategy and selection strategy in MBSO/D can help MBSO to obtain a set of solutions with good diversity and convergence. However, for a few benchmark functions, the proposed algorithm shows shortcoming because the update strategy is not suitable for some MOPs with degenerated PF. In the future, we will study that this algorithm is used to solve real-world problems.



---

*Source: 5301284-2019-01-22.xml*