# A Novel Tournament Selection Based Differential Evolution Variant for Continuous Optimization Problems

Authors: Qamar Abbas; Jamil Ahmad; Hajira Jabeen
Journal: Mathematical Problems in Engineering
 (2015)

---

## Abstract

Differential evolution (DE) is a powerful global optimization algorithm which has been studied intensively by many researchers in the recent years. A number of variants have been established for the algorithm that makes DE more applicable. However, most of the variants are suffering from the problems of convergence speed and local optima. A novel tournament based parent selection variant of DE algorithm is proposed in this research. The proposed variant enhances searching capability and improves convergence speed of DE algorithm. This paper also presents a novel statistical comparison of existing DE mutation variants which categorizes these variants in terms of their overall performance.  Experimental results show that the proposed DE variant has significance performance over other DE mutation variants.


---

## Body

## 1. Introduction

Storn and Price [1] have proposed DE in 1995 which is a stochastic population based evolutionary algorithm to find global optima for any given function [2]. DE has been applied to variety of real life problems such as electrical power systems [3], control systems [4], electromagnetism [5], image processing [6], bioinformatics [7], signal processing [8], chemical engineering [9], and many more. Different state-of-the-art versions of DE algorithm like jDE [10], SaDE [11], JADE [12], EPSDE [13], and so forth are based on parameter selection, parameter adaption, strategy selection, and/or strategy adaption mechanisms. DE state-of-the-art proves to be very powerful and uses conventional DE strategies as a strategy selection pool/strategy adaption and/or uses parameter selection pool/parameter adaption. During the process of optimization, DE algorithm evolves population of potential solutions by exploring the entire search space overtime to locate the optima.The DE algorithm mutation strategies are formed by the linear combination of existing population members. The trial vector and target vector forms the mutant vector in DE. DE mutation strategies can be formed by any combinations of current vector, random vector(s), better vector, and best vector. In any mutation strategy, the order, number, and name of vector(s) are very important. The behavior of DE algorithm is influenced by the selection of mutation strategy and crossover scheme along with their control parameters: mutation probability “F” and crossover rate “CR.” As stated, there are many mutation strategies associated with DE algorithm but current literature does not show any concrete study where all of the popular mutation strategies are analyzed. It has been observed by the authors that some of the DE mutation strategies are more useful than the current dominating ones. Therefore, in this paper, a comparative analysis is also carried out to identify best performer DE mutation variants. Furthermore, this research also proposes a novel DE mutation variant. The proposed DE variant is based on the well known tournament selection criteria. The proposed DE mutation strategy is abbreviated as TSDE in this paper. To generate a mutant vector in DE algorithm, some parents will be selected through tournament selection criteria. The TSDE variant has the ability to increase the convergence speed since it uses the combination of best vectors and random vectors from the population. Tournament selection will be helpful to incorporate some diversity in TSDE since global best vector has less chance of selection as a parent. To generate a mutant vector, the proposed TSDE utilizes two best individuals instead of global best from the whole population which makes it more convenient to escape from the local optima problem. The most state-of-the-art DE algorithms focuses on basic DE mutation strategies and the incorporation of this proposed TSDE mutation variant will be helpful in improving the performance of DE algorithm.The rest of the paper is organized into the following sections. Section2 presents literature survey. In Section 3, the DE algorithm operators are discussed. In Section 4, the proposed TSDE variant is presented. Section 5 presents test functions and parameter setting details. In Section 6, experimental results along with discussion are given. Section 7 contains statistical analysis. Section 8 compares proposed TSDE with other well known heuristic algorithms. Finally, conclusion and future work are presented in Section 9.


## 2. Literature Survey

As stated above, many state-of-the-art versions of the DE algorithms are developed, for example, jDE, SaDE, JADE, and DEGL. Variations in the mutation strategies of DE algorithm have also been the result of intensive research in this area. Qu and Suganthan [29] have introduced the concept of ensemble restricted tournament selection in DE algorithm. They have selected a set of w population members and calculated the Euclidean distance of w population members from the current individual. The member having smallest distance from current individual is selected as a tournament winner and it became the current individual if its fitness is also better. Epitropakis et al. [30] have introduced two new mutation strategies that incorporate spatial information of neighbors to form new population individual. Their new mutation strategies“DE/nrand/1” and“DE/nrand/2” corresponding to two well known mutation strategies“DE/rand/1” and“DE/rand/2” are important part of the current literature. Qiu et al. [31] have introduced the concept of tournament selection criteria in DE algorithm. They have selected all individuals used in their mutation strategy by using the concept of tournament selection by taking a tournament of size 3. Their research work is applied on“DE/rand/1,” “DE/rand/2,” “DE/current to best/2,” and“DE/rand to best/2” DE mutation strategies which proved to be competitive to original DE algorithm and also enhanced jDE algorithm. Neighbourhood based mutation strategy for DE algorithm was introduced by Das et al. [32]. This strategy implements the concepts of local model that works on small neighbourhood of each individual while global model mutates each individual using the neighbourhood concept of entire population. The concept of neighbourhood is implemented on a commonly used DE mutation strategy“DE/target-to-best/1/bin.” Sutton et al. [33] have introduced the concept of focus search by imposing a selective pressure for DE mutation strategies. The selective pressure is implemented by using the concept of rank based selection of vectors used in generating donor vector in DE mutation. A bias is imposed on selecting a parent using rank based selection criteria that is based on the fitness of population members. Epitropakis et al. [34] have introduced the concept of proximity based mutation operator in DE algorithm. Their new framework utilizes the information of neighbours in evolving the population. Each population member is assigned a selection probability that is inversely proportional to the distance from mutated vector. Proximity based mutation is applied to “DE/rand/1,”“DE/best/1,” “DE/rand/2,” “DE/best/2,” “DE/rand-to-best/1,” and“DE/rand-to-best/2” mutation strategies. Research result shows the significance of proximity based mutation operator in DE algorithm.DE algorithm has a number of conventional mutation strategies where the performances of these strategies may differ from each other. Zaharie [35] has analyzed the influence of crossover variant on the choice of control parameters of the DE algorithm. He has used “DE/rand/1” for different parameter settings of population size, mutation probability, and the crossover rate by binomial and exponential schemes. Babu and Munawar [36] have applied various DE strategies for the optimal design of shell and tube heat problem which performed better than“DE/rand” for the same problem. They have used different DE variants for the selection of optimal design using various control parameter settings. They conclude that “DE/best” strategies have better performance than “DE/rand” for shell and tube heat problem. Jeyakumar and Velayutham [24] present empirical performance analysis of DE variants for unconstrained global optimization problems where they have shown that binomial variants have superior performance compared to the exponential variants. Mezura-Montes et al. [37] have performed comparative study of DE mutation variants for continuous function optimization application. They found through the empirical study that“DE/best/1/bin” has produced good results. Ali et al. [38] have compared Mixed Strategies Differential Evolution (MSDE) with the five different DE variants for function optimization. They have shown that performance of MSDE is better than five variants of DE algorithm. Mutation operators are also used in other well known algorithms like PSO [39].Qin et al. [11] introduced both control parameter adaption and strategy adaption mechanisms in DE algorithm (SaDE). In strategy adaption scheme, they used a strategy candidate pool of four conventional strategies:“DE/rand/1/bin,” “DE/rand/2/bin,” “DE/rand-to-best/2/bin,” and“DE/current-to-rand/1.” Each target vector generates a trial vector based on the learning period (LP) over previous generations based on the success rate. In parameter adaption, SaDE adjusts control parameter CR based on the median value of CR that is calculated based on previous CR values that have successfully generated trial vector. Zhang and Sanderson [12] introduced new parameter adaption method and have used“DE/current to pbest/1” conventional strategy that is based on“DE/current to best/1.” Mallipeddi et al. [13] introduced ensemble based crossover and mutation DE strategy (EPSDE) and their corresponding control parameter scheme. They have used a pool of different crossover and mutation strategies and a pool of values for each associated control parameter. Each target vector generates a trial vector based on the assigned strategy and the parameter values. Successful combination of the mutation and crossover strategy and associated parameters values are stored in the pool. EPSDE uses“DE/current-to-rand/1/bin” and JADE mutation strategy along with binomial and exponential crossover. Islam et al. [40] have introduced modified mutation strategy, a modification in conventional binomial crossover scheme, and a parameter adaption scheme in DE algorithm. They have used“DE/current-to-gr_best/1” and call it a less greedy version of“DE/current-to-best/1.” Their mutation strategy“DE/current-to-gr_best/1” uses best vector from q
% population of individuals to generate the trial vector for each target vector. In pbest crossover mutant vector can swap p-top ranked individuals of current generation instead of current parent using binomial crossover scheme. In parameter adaption scheme scale factor adaption is based on the Cauchy distribution and crossover probability adaption is based on the Gaussian distribution. Wang et al. [41] have introduced composite DE (CoDE) variant. In this scheme, they have used a pool of three trial vector generation strategies and a pool of three parameter setting combinations. The trial vector strategies used are“rand/1/bin,” “rand/2/bin,” and“current-to-rand/1” while the parameter setting combinations are [F
=
1.0, Cr
=
0.1], [F
=
1.0, Cr
=
0.9], and [F
=
0.8, Cr
=
0.2]. To generate a new solution in CoDE, each strategy is coupled with a randomly chosen parameter setting. Gong et al. [42] have introduced a new strategy adaptation mechanism (SaM) in their research work. They have combined SaM with JADE and named it as SaJADE. In this strategy, parameter η
i
∈
[
0,1
) is used to control the selection of any strategy from the strategy pool. They have chosen four various DE strategies“DE/current-to-pbest” without archive,“DE/rand-to-pbest” without archive,“DE/current-to-pbest” with archive, and“DE/rand-to-pbest” with archive to form a strategy pool.Table1 shows different binomial and exponential mutation strategies used with algorithm. Current literature shows variation in naming in these strategies, which is already indicated in Table 1; for example, Four different names are used in the literature for mutation strategy V
7. Throughout this paper, x
i denotes the target vector (or current vector), u
i represents the trial vector, and v
i as a mutant vector. In this paper, x
g
r
k states the r
kth random vector for gth generation, v
g
i will refer to ith component of donor vector at gth generation, x
g
best states the best vector at gth generation, and x
g
i refers to current vector at gth generation.Table 1
List of DE mutation strategies.
Mutation strategy number
Binomial/exponential
Variant name
Equation
V
1
DE/rand/1 [1]
v
g
i
=
x
g
r
1
+
F
x
g
r
2
-
x
g
r
3
V
2
DE/best/1 [14]
v
g
i
=
x
g
best
+
F
x
g
r
1
-
x
g
r
2
V
3
DE/rand/2 [14]
v
g
i
=
x
g
r
1
+
F
x
g
r
2
-
x
g
r
3
+
F
x
g
r
4
-
x
g
r
5
V
4
DE/best/2 [14]
v
g
i
=
x
g
best
+
F
x
g
r
1
-
x
g
r
2
+
F
x
g
r
3
-
x
g
r
4
V
5
DE/current to rand/1 [15]
v
g
i
=
x
g
i
+
F
x
g
r
1
-
x
g
i
+
F
x
g
r
2
-
x
g
r
3
V
6
DE/Current-to-rand/1 [16]
v
g
i
=
x
g
r
1
+
F
x
g
r
2
-
x
g
i
+
F
x
g
r
1
-
x
g
r
3
V
7
DE/current to best/1 [1] & DE/rand to best/1 [17] &
DE/current to best/2 [18] & DE/rand to best/2 [19]
v
g
i
=
x
g
i
+
F
x
g
best
-
x
g
i
+
F
x
g
r
1
-
x
g
r
2
V
8
DE/current to best/1 [20] & DE/rand to best/1 [21]
v
g
i
=
x
g
i
+
F
x
g
best
-
x
g
r
1
+
F
x
g
r
1
-
x
g
r
2
V
9
DE/rand to best/1 [22] & DE/rand to best/2 [20]
v
g
i
=
x
g
r
1
+
F
x
g
best
-
x
g
r
2
+
F
x
g
r
3
-
x
g
r
4
V
10
DE/rand to best/1 [23]
v
g
i
=
x
g
r
1
+
F
x
g
best
-
x
g
r
1
+
F
x
g
r
2
-
x
g
r
3
V
11
DE/rand to best/1 [24]
v
g
i
=
x
g
r
1
+
F
x
g
best
-
x
g
i
+
F
x
g
r
2
-
x
g
r
3
V
12
DE/current to best/2 [15] & DE/rand to best/2 [25]
v
g
i
=
x
g
i
+
F
x
g
best
-
x
g
i
+
F
x
g
r
1
-
x
g
r
2
+
F
x
g
r
3
-
x
g
r
4
V
13
DE/current to rand/2 [15]
v
g
i
=
x
g
i
+
F
x
g
r
1
-
x
g
i
+
F
x
g
r
2
-
x
g
r
3
+
F
x
g
r
4
-
x
g
r
5
V
14
DE/rand to best/2 [26]
v
g
i
=
x
g
r
1
+
F
x
g
best
-
x
g
i
+
F
x
g
r
2
-
x
g
r
3
+
F
x
g
r
4
-
x
g
r
5
V
15
DE/rand to best/2 [26]
v
g
i
=
x
g
r
1
+
F
x
g
best
-
x
g
r
1
+
F
x
g
r
2
-
x
g
r
3
+
F
x
g
r
4
-
x
g
r
5
V
16
DE/rand to current/2 [27]
v
g
i
=
x
g
r
1
+
F
x
g
r
2
-
x
g
i
+
F
x
g
r
3
-
x
g
r
4
V
17
DE/rand to best and current/2 [27]
v
g
i
=
x
g
r
1
+
F
x
g
best
-
x
g
r
2
+
F
x
g
r
3
-
x
g
i
V
18
DE/mid-to-better/1 [28]
v
g
i
=
F
x
g
better
+
x
g
i
/
2
+
F
x
g
better
-
x
g
i
+
F
x
g
r
1
-
x
g
r
2
V
19
DE/rand/3 [27]
v
g
i
=
x
g
r
1
+
F
x
g
r
2
-
x
g
r
3
+
F
x
g
r
4
-
x
g
r
5
+
F
x
g
r
6
-
x
g
r
7
V
20
DE/best/3 [27]
v
g
i
=
x
g
best
+
F
x
g
r
1
-
x
g
r
2
+
F
x
g
r
3
-
x
g
r
4
+
F
x
g
r
5
-
x
g
r
6


## 3. DE Algorithm

DE algorithm has three different parameters: a population of size NP, crossover control parameter CR, and difference vector amplification parameterF. Each population member in DE is represented as a D-dimensional parameter vector. In DE algorithm, population is initialized randomly which is supposed to cover the entire search space. Each vector in the DE is represented by x
i
,
G, where i
=
1,2
,
3
,
…
,
NP and G is generation number. New offspring in DE algorithm are generated by mutation, crossover, and selection operators. Three different terminologies of vectors donor vector, trial vector, and target vector are used in DE algorithm. Donor vector is a vector that is created in the mutation operation, trial vector is created in the crossover operation, and target vector is the current vector of population. The detail of these operators with index i
=
1,2
,
3
,
…
,
NP, j
=
1,2
,
3
,
…
,
D is as follows.Mutation. In mutation operation, mutant vector also called donor vector is created. Donor vector v
i
,
G
+
1 of ith population member is calculated by adding the weighted difference of two vectors to third vector:(1)
v
i
,
G
+
1
=
x
r
1
,
G
+
F
x
r
2
,
G
-
x
r
3
,
G
,where random indices r
1
,
r
2
,
r
3
∈
1,2
,
3
,
…
,
NP, i
≠
r
1
≠
r
2
≠
r
3, and F is mutation probability parameter.Crossover. DE crossover strategies control the number of inherited components from the mutant vector to form a target vector. Binomial and exponential are main crossover schemes. The DE crossover rate parameter (CR) influences the size of perturbation of the base (target) vector to ensure the population diversity [43]. Following are the binomial and exponential crossover schemes.Binomial Crossover. In crossover operation of DE algorithm, a trial vector is formed. In binomial crossover scheme, the trail vector u
i
,
G
=
(
u
i
,
1
,
g
,
u
i
,
2
,
g
,
…
,
u
i
,
D
,
g
) is generated by the following equation: (2)
u
i
,
G
=
v
i
,
j
,
G
if
rand
j
0,1
≤
CR
or
j
=
j
rand
x
i
,
j
otherwise
,where j
rand is a randomly chosen integer in the range [
1
,
D
], rand
j
(
0,1
) is a random number in (
0,1
), and v
i
,
j
,
G is the donor vector. CR is crossover control parameter in the range CR
∈
(
0,1
). Due to the range of j
rand, u
i
,
G is always different from x
i
,
j and index i
=
1,2
,
3
,
…
,
NP, j
=
1,2
,
3
,
…
,
D.Exponential Crossover. In exponential crossover scheme, the trail u
i
,
G
=
(
u
i
,
1
,
g
,
u
i
,
2
,
g
,
…
,
u
i
,
D
,
g
) is created as follows:(3)
u
i
,
G
=
v
i
,
j
,
G
for
j
=
l
D
+
l
+
1
D
+
⋯
+
l
+
L
-
1
D
x
i
,
j
otherwise
,where i
=
1,2
,
3
,
…
,
NP, j
=
1,2
,
3
,
…
,
D, and D denotes the modulo function with modulus D. The starting index l is chosen at random from [
1
,
D
]. L is also a randomly generated number from [
1
,
D
]. The parameters l and L are regenerated for each trial vector u
i
,
G.Selection. In DE algorithm, new population members are formed using selection operation. Selection operator uses the greedy approach by comparing fitness of trial vector u
i
,
G
+
1 with the fitness of target vector x
i
,
G; the vector having best fitness is selected as a member of new population. For selection, the following equation is used:(4)
x
i
,
G
+
1
=
u
i
,
G
+
1
if
fitness
u
i
,
G
+
1
<
fitness
x
i
,
G
x
i
,
G
otherwise
,where fitness (
) function calculates the fitness value of objective function.There are several DE algorithm mutation variants/strategies that are formed by the linear combination of existing population members. The trial vector and target vector form the mutant vector in DE. Throughout this paper,x
i denotes the target vector (or current vector), i is the running index, u
i represents the trial vector, and v
i is a mutant vector. In DE algorithm, different mutation schemes are used to create the trial vector by using any combination of current, best, and random vectors. The behavior of DE algorithm is influenced by the selection of mutation strategy and crossover scheme along with their control parameters: mutation probability “F” and crossover rate “CR” [44].Difference vector (DV) is the difference of two mutating vectors that is used to form offspring in the population [45]. To form the mutant vector in DE, some researcher uses a random value λ
∈
(
0,1
) as a coefficient multiplier with the first difference vector [1] and mutation probability “F” as a coefficient multiplier with the other difference vector(s) [17]. Some researchers have used only “F” as a coefficient multiplier with the difference vector(s) to form the mutant vector [44]. To reduce the number of control parameters of DE algorithm, we use λ
=
F [28]. A list of binomial and exponential mutation strategies that are used in this research is given in Table 1.


## 4. Proposed Tournament Selection Based DE (TSDE) Variant

Tournament selection is one of the famous selection approaches used in genetic algorithms [46]. The parameter associated with this scheme is the size of tournament that selects number of individuals to participate in the competition of tournament. To decrease the risk of premature convergence, the loss of diversity should be kept as low as possible in the population [47]. To enhance the performance of population based algorithms, various researches have used tournament selection in their research work [48, 49].The DE algorithm sometimes faces the problem of slow and/or premature convergence [32]. Exploration and exploitation are very important aspects that are helpful in improving the convergence acceleration and solution quality of evolutionary algorithms [50]. The mutation strategies“DE/rand/1” and“DE/rand/2” are helpful for exploration [11] and“DE/best/1,” “DE/rand-to-best,” and“DE/best/2” are more helpful for exploitation than exploration due to less population diversity [14]. To balance the exploration and exploitation ability of proposed TSDE variant, both random and best vectors are used.A novel DE mutation strategy based on the selection of parent is introduced in this research work. The new mutation strategy utilizes the knowledge of some best performing vectors and some random vectors in creating the mutant vector. Like mutation strategies“DE/rand/1” and“DE/rand/2,” the proposed mutation strategy uses random vector as a base vector along with two difference vectors. To generate a mutant vector in DE, each difference vector utilizes the knowledge of one distinct best vector that will be helpful in incorporating diversity and improving convergence in the proposed mutation strategy. The two difference vectors and two distinct best vectors selected through tournament selection criteria will be helpful in balancing the exploration and exploitation.To minimize the loss diversity, a tournament of small size is selected so that less fit individuals may have a chance of selection as a parent. TSDE generates two best vectors using tournament selection mechanism. The selection of parents is based on the tournament selection criteria by taking a tournament of size 3 of randomly selected population members. The equation of the proposed variant TSDE is as follows:(5)
v
g
i
=
x
g
r
1
+
F
x
g
best
1
-
x
g
r
1
+
F
x
g
best
2
-
x
g
r
2
.The equation of this variant uses two best vectors x
g
best
1 andx
g
best
2 and two random vectors x
g
r
1 and x
g
r
2 that are selected from the current population. Vectors x
g
best
1 and x
g
best
2 are selected by using tournament selection mechanism by taking tournament of any size, say k. Vector x
g
best
1 is the best individual from first tournament and vector x
g
best
2 is the second best individual from the second tournament. The vectors used in each tournament are selected randomly from the current population.The proposed TSDE variant has the ability to increase the convergence speed since it uses the combination of best vectors and random vectors from the population. Tournament selection may incorporate some diversity in TSDE since global best vector has less chance of selection as a parent because tournament of small size is used instead of whole population. Selection of two best individuals instead of global best from the whole population makes it more opportune to escape from the local optima problem that accordingly increases the solution quality and convergence speed of DE algorithm. The most state-of-the-art DE algorithm focuses on basic DE mutation strategies and the incorporation of this proposed mutation strategy will be helpful in improving the performance of DE algorithm.The proposed mutation strategy has the following features.(1)
A random number will be used as a base vector since mutation strategies“DE/rand/1” and“DE/rand/2” use random base vectors that maintain better exploration ability but have slow convergence speed [11].
(2)
Although DE mutation strategies“DE/best/1,” “DE/rand-to-best,” and“DE/best/2” have fast convergence [14], these are biased towards global best value that may have a chance to stick in local optima problem [11]. So to improve the convergence speed of proposed TSDE, two best vectors (best1, best2) are selected using tournament selection criteria.
(3)
The equation of proposed mutation strategy is(6)
v
g
i
=
x
g
r
1
+
F
x
g
best
1
-
x
g
r
1
+
F
x
g
best
2
-
x
g
r
2
,
whereF is scaling factor of each difference vector. The motivation of this mutation strategy is an existing DE variant“DE/rand to best/1” [23, 51] that places perturbation of random vector towards global best vector and contains two difference vectors with equation (7)
v
g
i
=
x
g
r
1
+
F
x
g
best
-
x
g
r
1
+
F
x
g
r
2
-
x
g
r
3
.
Two best vectors (best1, best2) in TSDE will be helpful in escaping local optima problem and will be helpful in improving the solution quality.
(4)
Two difference vectors are used where each difference vector utilizes one best vector selected through tournament criteria, since mutation strategies having two difference vectors (DV) produce better perturbation mode than one difference vector mutation strategies [41].The members of tournament are selected randomly which almost makes it equal chance of selection of higher or lower performing individuals from the population. This variant maintains randomness since members of the tournament are selected randomly and we select the best performing amongst the tournament to ignore the poor performing individuals. The proposed variation is simple since it uses two best individuals selected using the tournament selection technique and other random vector selected randomly from the current population. The performance of TSDE is compared with other DE variants in Section6.A graphical representation of proposed mutation strategy is shown in Figure1, where mutant vector v
g
i is generated using four vectors, x
g
t
best
1, x
g
t
best
2, x
g
r
1, and x
g
r
2, shown in filled circles and directed arrow shows difference vector.Figure 1
Graphical view of proposed TSDE.Algorithm1 shows the pseudocode of the proposed DE algorithm (TSDE). The proposed method is also implemented through computer simulation which will be discussed in a later part in the paper.Algorithm 1:Pseudocode of tournament selection based DE algorithm (TSDE).
(1) Generate the initial populationP
G
=
{
X
1
,
G
,
…
,
X
NP
,
G
} for generation G
=
0 and randomly initialize
each population memberX
i
,
G
=
{
x
i
,
G
1
,
…
,
x
i
,
G
D
} where i
=
1
,
…
,
NP
(2) FORi
=
1 to NP
Calculate fitness f
(
X
i
,
G
) for each population member X
i
,
G
END FOR
(3) WHILE the stopping criterion is not true
/*
Start of TSDE vectors selection
*/
Step  3.1.  TSDE vectors selection
FORn
=
1 to number of TSDE vectors
FORk
=
1 to Tournment_size
Select kth tournament member with its fitness randomly from current population
END FOR
Select best of best member from the current tournament asnth  t
b
e
s
t
Returnnth member index to be used as one of TSDE vectors in proposed mutation strategy
END FOR
/*
End of TSDE vectors selection
*/
Step  3.2.  Mutation Step
FORi
=
1 to NP
For theith target vector X
i
,
G generate a donor vector V
i
,
G
=
{
v
i
,
G
1
,
…
,
v
i
,
G
D
} with the
specified mutation strategy (From Table1 strategies or proposed TSDE strategy)
END FOR
Step  3.3.  Crossover Step
FORi
=
1 to NP
For theith target vector X
i
,
G generate a trial vector U
i
,
G
=
{
u
i
,
G
1
,
…
,
u
i
,
G
D
} with the
specified crossover scheme (Equation (2) or Equation (3))
END FOR
Step  3.4.  Selection Step
FORi
=
1 to NP
Evaluate the trial vector U
i
,
G against the target vector X
i
,
G with fitness function f
IF f
(
U
i
,
G
≤
f
(
X
i
,
G
), THEN X
i
,
G
+
1
=
U
i
,
G, f
(
X
i
,
G
)
=
f
(
U
i
,
G
)
IF f
(
U
i
,
G
≤
f
(
X
best
,
G
), THEN X
best
,
G
+
1
=
U
i
,
G, f
(
X
best
,
G
)
=
f
(
U
i
,
G
)
END IF
END IF
END FOR
Step  3.5.  increment generation number
G
=
G
+
1
END WHILE


## 5. Test Functions and Parameter Setting

In order to evaluative the performance of the proposed variant and existing variants of DE algorithm, a comprehensive set of 37N-dimensional benchmark functions is used. These benchmark functions are commonly used for multidimensional global optimization problems. These functions are given in Table 2 along with the equation, search space, dimension, and optimum value of each function. N-dimensional functions have been used for extensive comparison of DE algorithm variants for various dimensions.Table 2
Test benchmark function.
Function
Name of function (type)
Equation
Search space
Optima
f
1
Sphere model(separable, multimodal)
f
x
=
∑
i
=
0
n
x
i
2
-
5.12
≤
x
i
≤
5.12
0
f
2
Axis parallel hyperellipsoid(separable, unimodal)
f
x
=
∑
i
=
0
n
i
·
x
i
2
-
5.12
≤
x
i
≤
5.12
0
f
3
Schwefel’s problem 1.2(nonseparable, unimodal)
f
x
=
∑
i
=
0
n
∑
j
=
0
i
x
j
2
-
65
≤
x
j
≤
65
0
f
4
Rosenbrock’s valley(nonseparable, unimodal)
f
x
=
∑
i
=
1
n
-
1
100
x
i
+
1
-
x
i
2
2
+
1
-
x
i
2
-
30
≤
x
i
≤
30
0
f
5
Rastrigin’s function(Separable, Multimodal)
f
x
=
10
n
+
∑
i
=
1
n
x
i
2
-
10
cos
⁡
2
π
x
i
-
5.12
≤
x
i
≤
5.12
0
f
6
Griewank’s function(nonseparable, multimodal)
f
x
=
∑
i
=
1
n
x
i
2
4000
-
∏
i
=
1
n
cos
⁡
x
i
i
+
1
-
600
≤
x
i
≤
600
0
f
7
Sum of different power(nonseparable, multimodal)
f
x
=
∑
i
=
1
n
x
i
i
+
1
-
1
≤
x
i
≤
1
0
f
8
Ackley’s path function(nonseparable, multimodal)
f
x
=
-
20
exp
⁡
-
0.2
∑
i
=
1
n
x
i
2
n
-
exp
⁡
∑
i
=
i
n
cos
⁡
(
2
π
x
i
)
n
+
20
+
e
-
32
≤
x
i
≤
32
0
f
9
Levy function(separable, multimodal)
0.1
sin
⁡
2
⁡
3
π
x
1
+
∑
i
=
1
n
-
1
x
i
-
1
2
×
1
+
sin
⁡
2
⁡
3
π
x
i
+
1
+
x
n
-
1
1
+
sin
⁡
2
⁡
2
π
x
n
-
10
≤
x
i
≤
10
0
f
10
Zakharov function(nonseparable, multimodal)
f
x
=
∑
i
=
1
n
x
i
2
+
∑
i
=
i
n
0.5
i
x
i
2
+
∑
i
=
i
n
0.5
i
x
i
4
-
5
≤
x
i
≤
10
0
f
11
Schwefel’s problem 2.22(nonseparable, unimodal)
f
x
=
∑
i
=
1
n
x
i
+
∏
i
=
1
n
x
i
-
10
≤
x
i
≤
10
0
f
12
Step function(separable, unimodal)
f
x
=
∑
i
=
1
n
x
i
+
0.5
2
-
100
≤
x
i
≤
100
0
f
13
De Jong’s function-4 (no noise)(separable, unimodal)
f
x
=
∑
i
=
1
n
i
x
i
4
-
1.28
≤
x
i
≤
1.28
0
f
14
Alpine function(separable, multimodal)
f
x
=
∑
i
=
1
n
x
i
sin
⁡
⁡
x
i
+
0.1
x
i
-
10
≤
x
i
≤
10
0
f
15
Levy and Montalvo Problem(separable, multimodal)
f
x
=
π
n
10
sin
⁡
2
⁡
π
y
1
+
∑
i
=
1
n
-
1
y
i
-
1
2
1
+
10
sin
⁡
⁡
2
π
y
i
+
1
+
y
n
-
1
2
where
y
i
=
1
+
1
4
x
i
+
1
-
10
≤
x
i
≤
10
0
f
16
Neumaier 2 Problem(separable, unimodal)
f
x
=
∑
i
=
1
n
x
i
-
1
2
-
∑
i
=
2
n
x
i
x
i
-
1
-
n
2
≤
x
i
≤
n
2
0
f
17
Cosine Mixture(separable, multimodal)
f
x
=
-
0.1
∑
i
=
1
n
cos
⁡
(
5
π
x
i
)
+
∑
i
=
1
n
x
i
2
x
=
∑
i
=
1
n
x
i
2
-
1
≤
x
i
≤
1
-
0.1
x
(
n
)
f
18
Cigar(separable, multimodal)
f
x
=
x
1
2
+
100000
∑
i
=
1
n
x
i
2
-
10
≤
x
i
≤
10
0
f
19
Function “15”(separable, multimodal)
f
x
=
∑
i
=
1
n
-
1
0.2
x
i
2
+
0.1
x
i
2
sin
⁡
⁡
2
x
i
-
10
≤
x
i
≤
10
0
f
20
Ellipse Function(separable, unimodal)
f
x
=
∑
i
=
1
n
(
1
0
6
(
i
-
1
)
/
(
n
-
1
)
·
x
i
2
)
-
100
≤
x
i
≤
100
0
f
21
Tablet Function(separable, unimodal)
f
x
=
1
0
4
x
1
2
+
∑
i
=
2
n
x
i
2
-
100
≤
x
i
≤
100
0
f
22
Schewel(separable, multimodal)
f
x
=
∑
i
=
1
n
x
1
-
x
i
2
2
+
x
i
-
1
2
-
32
≤
x
i
≤
32
0
f
23
Deflected corrugated spring(separable, multimodal)
f
x
=
0.1
∑
i
=
1
n
x
i
-
α
2
-
cos
⁡
K
∑
i
=
1
n
(
x
i
-
α
)
2
0
≤
x
i
≤
10
K
=
5
α
=
5
x
i
∈
[
0,2
α
]
0
f
24
Mishra 1 global optimization problem(nonseparable, multimodal)
f
x
=
1
+
x
n
x
n
where
x
n
=
n
-
∑
i
=
1
n
-
1
x
i
0
≤
x
i
≤
1
2
f
25
Mishra 2 global optimization problem(nonseparable, multimodal)
f
(
x
)
=
1
+
x
n
x
n
where
x
n
=
n
-
∑
i
=
1
n
-
1
(
x
i
+
x
i
+
1
)
2
0
≤
x
i
≤
1
2
f
26
MultiModal global optimization problem(separable, multimodal)
f
(
x
)
=
∑
i
=
1
n
x
i
∏
i
=
1
n
x
i
-
10
≤
x
i
≤
10
0
f
27
Quintic global optimization problem(separable, multimodal)
f
(
x
)
=
∑
i
=
1
n
x
i
5
-
3
x
i
4
+
4
x
i
3
+
2
x
i
2
-
10
x
i
-
4
-
10
≤
x
i
≤
10
-
1
f
28
Stochastic global optimization problem(separable, multimodal)
f
(
x
)
=
∑
i
=
1
n
ε
i
x
i
-
1
i
-
5
≤
x
i
≤
5
0
f
29
Stretched V global optimization problem(nonseparable, multimodal)
f
(
x
)
=
∑
i
=
1
n
-
1
t
1
/
4
sin
⁡
⁡
50
t
0.1
+
1
2
where
t
=
x
i
+
1
2
+
x
i
2
-
10
≤
x
i
≤
10
0
f
30
XinSheYang(nonseparable, multimodal)
f
(
x
)
=
∑
i
=
1
n
x
i
e
∑
i
=
1
n
sin
⁡
⁡
x
i
2
-
2
π
≤
x
i
≤
2
π
0The control parameters of the DE algorithm areNp (population size), D (dimension), F (scaling factor), and CR (crossover control parameter). Different researchers have used different F and CR parameter values for function optimization of N-dimensional functions. Like Noman and Iba [52] have used F
=
0.9, CR
=
0.9, Brest et al. [10] have used F
=
0.5, CR
=
0.9; Ali and Torn [53] have used CR
=
0.5, F
∈
[
0.4,1
]; Piotrowski and Napiorkowski [54] have used CR
=
0.5 and F
=
0.5; Dong et al. [55] have used F
=
0.7 and CR
=
0.5 in their research work. In this research work, we have used control parameters F
=
0.7, CR
=
0.5 and population size Np
=
30. The dimensions size used is 10, 20, and 30 and the numbers of training iterations for average fitness value are 5000, 10000, and 15000 for 10D, 20D, and 30D, respectively. The DE algorithm iterates over 30 independent runs and the average fitness value of these 30 runs is used in the results. Same parameter values are used for all functions and all mutation strategies. Experimental results of number of function calls (NFC) are generated for maximum NFC 104
∗DIM [56]. To find out the number of function calls, VTR is set to 0.0001 and Max-NFC for 10D, 20D, and 30D is, respectively, 100,000, 200,000, and 300,000 for all functions and all mutation strategies.


## 6. Experimental Results and Discussion

This section presents simulation results and its comparative analysis for DE mutation strategies given in Table1 using parameter setting given in Section 5. In order to perform a fair comparison, all results are averaged over 30 independent runs. Both binomial and exponential crossover schemes are implemented for all benchmark functions given in Table 2 and DE mutation strategies given in Table 1 to obtain the results on a set of benchmark functions given in Table 2 for the DE mutation strategies given in Table 1. Both average fitness value and number of function calls (NFC) are used for performance evaluation of DE mutation strategies as used by most of the evolutionary computing algorithms [14]. First, average fitness values of the functions are considered over 30 independent runs for the performances evaluation of DE mutation strategies. For easy observation, best values of mutation strategies are given as bold face for every case. Experimental results of average fitness for all DE mutation strategies and benchmark functions are reported in Table 2. Because of space limitation, the results of binomial and exponential strategies of proposed TSDE, five most commonly used strategies [14], and one other best performing strategy are reported in Tables 3 and 4. Figures 2–9 show average fitness and NFC Dendrograms for the proposed DE mutation variant and existing DE mutation strategies. Figure 10 shows the convergence graph of binomial and exponential versions of the proposed TSDE and other selected mutation strategies. NFC experimental results for DE mutation strategies and benchmark functions are reported in Table 4.Table 3
Fitness results (mean ± SD) of DE variants for functions (f
1
–
f
30).
Fun
DIM
Iter.
V
1
V
2
V
3
V
4
V
7
V
10
V
41
V
42
f
1
10D
5000
1.76E − 145 ± 7.33E − 145
2.69e − 310 ± 0.00E + 00
1.53E − 69 ± 3.05E − 69
1.09E − 114 ± 3.68E − 114
2.47e − 315 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
2.94E − 255 ± 0.00E + 00
20D
10000
3.25E − 109 ± 7.70E − 109
2.22e − 315 ± 0.00E + 00
9.92E − 30 ± 1.71E − 29
1.64E − 63 ± 2.68E − 63
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
9.86E − 235 ± 0.00E + 00
30D
15000
2.10E − 80 ± 7.19E − 80
1.24e − 313 ± 0.00E + 00
1.95E − 12 ± 1.18E − 12
6.81E − 38 ± 9.97E − 38
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.71E − 227 ± 0.00E + 00
f
2
10D
5000
1.03E − 165 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
3.53E − 84 ± 6.08E − 84
9.30E − 135 ± 2.20E − 134
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
5.95E − 270 ± 0.00E + 00
20D
10000
6.33E − 118 ± 1.08E − 117
0.00E + 00 ± 0.00E + 00
1.85E − 33 ± 2.16E − 33
1.68E − 70 ± 3.09E − 70
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
2.28E − 240 ± 0.00E + 00
30D
15000
3.65E − 85 ± 6.96E − 85
9.88e − 324 ± 0.00E + 00
3.23E − 13 ± 2.21E − 13
4.26E − 40 ± 1.11E − 39
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.44E − 229 ± 0.00E + 00
f
3
10D
5000
2.01E − 29 ± 3.29E − 29
1.39E − 86 ± 4.53E − 86
3.33E − 11 ± 3.84E − 11
3.37E − 22 ± 5.88E − 22
2.70E − 94 ± 8.76E − 94
1.03E − 86 ± 5.42E − 86
9.92E – 120 ± 4.77E − 118
4.73E − 58 ± 3.59E − 58
20D
10000
4.71E − 01 ± 6.18E − 01
6.41E − 26 ± 1.32E − 25
8.11E + 02 ± 2.40E + 02
3.69E + 01 ± 2.20E + 01
4.88E − 34 ± 1.79E − 33
1.78E − 28 ± 3.51E − 28
1.36E – 47 ± 6.90E − 47
7.22E − 24 ± 1.15E − 23
30D
15000
2.19E + 03 ± 7.20E + 02
4.16E − 10 ± 6.03E − 10
7.93E + 03 ± 9.36E + 02
4.70E + 03 ± 1.04E + 03
4.45E − 16 ± 7.71E − 16
1.06E − 11 ± 1.79E − 11
4.00E – 26 ± 6.90E − 26
1.50E − 14 ± 1.67E − 14
f
4
10D
5000
4.07E − 11 ± 7.30E − 11
5.32E − 01 ± 1.36E + 00
8.29E − 04 ± 1.26E − 03
2.89E − 08 ± 4.09E − 08
4.51E − 01 ± 1.21E + 00
2.66E − 01 ± 9.94E − 01
2.66E − 01 ± 7.16E − 01
6.91E – 16 ± 7.16E − 01
20D
10000
5.89E – 06 ± 6.91E − 06
6.64E − 01 ± 1.49E + 00
7.63E + 00 ± 6.43E − 01
2.36E + 00 ± 1.24E + 01
1.33E − 01 ± 7.16E − 01
2.66E − 01 ± 9.94E − 01
1.33E − 01 ± 7.16E − 01
6.97E − 01 ± 1.21E + 00
30D
15000
2.66E − 02 ± 1.20E − 02
7.97E − 01 ± 1.59E + 00
3.45E + 01 ± 2.89E + 01
9.00E + 00 ± 7.07E − 01
3.99E − 01 ± 1.20E + 00
3.99E − 01 ± 1.20E + 00
3.99E − 01 ± 1.20E + 00
9.34E + 00 ± 3.05E + 00
f
5
10D
5000
6.63E − 02 ± 2.48E − 01
4.15E + 00 ± 1.74E + 00
2.67E + 00 ± 2.67E + 00
1.76E + 00 ± 1.14E + 00
2.18E + 00 ± 6.27E − 01
9.95E − 01 ± 1.06E + 00
1.53E + 00 ± 1.17E + 00
3.32E − 02 ± 0.00E + 00
20D
10000
3.24E + 01 ± 6.67E + 00
1.18E + 01 ± 3.55E + 00
6.01E + 01 ± 6.13E + 00
5.37E + 01 ± 5.16E + 00
2.50E + 01 ± 5.62E + 00
4.34E + 00 ± 1.35E + 00
6.33E + 00 ± 2.03E + 00
6.63E − 02 ± 2.48E − 01
30D
15000
1.02E + 02 ± 6.58E + 00
2.34E + 01 ± 6.93E + 00
1.48E + 02 ± 1.06E + 01
1.32E + 02 ± 6.88E + 00
7.02E + 01 ± 9.81E + 00
1.00E + 01 ± 2.93E + 00
1.34E + 01 ± 3.64E + 00
1.66E − 01 ± 3.71E − 01
f
6
10D
5000
3.20E − 03 ± 6.67E − 03
4.96E − 02 ± 2.41E − 02
1.68E − 01 ± 3.13E − 02
4.70E − 02 ± 3.52E − 02
1.76E − 02 ± 1.17E − 02
2.08E − 02 ± 1.59E − 02
1.44E − 02 ± 1.53E − 02
9.86E − 04 ± 5.95E − 03
20D
10000
1.07E − 03 ± 2.75E − 03
1.01E − 02 ± 1.53E − 02
3.53E − 02 ± 7.05E − 02
8.46E − 03 ± 8.64E − 03
2.87E − 03 ± 5.65E − 03
2.71E − 03 ± 4.51E − 03
2.96E − 03 ± 4.82E − 03
0.00E + 00 ± 0.00E + 00
30D
15000
4.93E − 04 ± 1.84E − 03
5.82E − 03 ± 9.68E − 03
8.32E − 02 ± 7.92E − 02
4.93E − 03 ± 5.36E − 03
1.07E − 03 ± 2.75E − 03
2.30E − 03 ± 4.71E − 03
4.93E − 04 ± 1.84E − 03
0.00E + 00 ± 0.00E + 00
f
7
10D
5000
2.59E − 195 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
7.97E − 92 ± 1.43E − 91
2.61E − 143 ± 1.06E − 142
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
8.00E − 294 ± 0.00E + 00
20D
10000
6.79E − 164 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.64E − 40 ± 6.56E − 40
4.66E − 84 ± 2.39E − 83
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.65E − 299 ± 0.00E + 00
30D
15000
2.01E − 111 ± 5.48E − 111
0.00E + 00 ± 0.00E + 00
7.97E − 17 ± 9.77E − 17
1.28E − 49 ± 4.28E − 49
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
2.10E − 300 ± 0.00E + 00
f
8
10D
5000
1.25E − 02 ± 3.76E − 02
2.56E − 01 ± 8.15E − 02
3.36E − 01 ± 8.74E − 02
1.26E − 01 ± 8.21E − 02
1.61E − 01 ± 4.84E − 02
7.33E − 02 ± 8.17E − 02
9.79E − 02 ± 1.01E − 01
4.18E − 03 ± 5.21E − 13
20D
10000
7.30E − 01 ± 7.45E − 02
3.51E − 01 ± 7.27E − 02
1.07E + 00 ± 7.52E − 02
9.67E − 01 ± 6.48E − 02
5.40E − 01 ± 9.69E − 02
1.55E − 01 ± 6.27E − 02
2.32E − 01 ± 6.28E − 02
8.85E − 03 ± 2.66E − 02
30D
15000
1.09E + 00 ± 7.43E − 02
3.52E − 01 ± 6.25E − 02
1.57E + 00 ± 6.60E − 02
1.34E + 00 ± 8.02E − 02
8.14E − 01 ± 1.04E − 01
2.26E − 01 ± 6.83E − 02
2.73E − 01 ± 5.21E − 02
7.22E − 03 ± 2.16E − 02
f
9
10D
5000
3.88E − 07 ± 4.11E − 07
2.66E − 07 ± 2.48E − 07
1.02E − 06 ± 8.02E − 07
7.74E − 07 ± 5.97E − 07
4.14E − 07 ± 3.93E − 07
3.49E − 07 ± 3.89E − 07
3.31E − 07 ± 3.83E − 07
1.97E − 08 ± 1.68E − 08
20D
10000
3.60E − 07 ± 3.74E − 07
1.39E − 07 ± 1.38E − 07
1.10E − 06 ± 7.89E − 07
5.86E − 07 ± 6.51E − 07
1.57E − 07 ± 1.46E − 07
1.55E − 07 ± 1.24E − 07
1.55E − 07 ± 1.44E − 07
4.36E − 09 ± 5.29E − 09
30D
15000
2.23E − 07 ± 1.98E − 07
1.03E − 07 ± 7.96E − 08
1.10E − 06 ± 8.75E − 07
5.59E − 07 ± 4.14E − 07
7.24E − 08 ± 6.20E − 08
3.16E − 02 ± 1.70E − 01
1.86E − 03 ± 1.00E − 02
1.42E − 09 ± 1.24E − 09
f
10
10D
5000
9.21E − 43 ± 2.10E − 42
9.04E − 114 ± 2.78E − 113
3.46E − 17 ± 3.08E − 17
1.10E − 31 ± 2.27E − 31
3.32E − 121 ± 1.75E − 120
1.16E − 117 ± 3.13E − 117
2.11E – 151 ± 5.43E − 151
1.71E − 37 ± 1.06E − 36
20D
10000
1.68E − 09 ± 1.15E − 09
7.49E − 44 ± 1.88E − 43
1.29E + 00 ± 3.74E − 01
2.46E − 04 ± 1.36E − 04
1.29E − 53 ± 3.18E − 53
3.71E − 50 ± 1.09E − 49
3.83E – 71 ± 6.60E − 71
5.69E − 02 ± 4.26E − 02
30D
15000
4.80E − 02 ± 2.97E − 02
2.26E − 24 ± 3.92E − 24
4.92E + 01 ± 6.73E + 00
8.27E + 00 ± 2.25E + 00
1.39E − 32 ± 2.11E − 32
5.45E − 30 ± 9.59E − 30
1.11E – 44 ± 4.40E − 44
2.08E + 00 ± 7.83E − 01
f
11
10D
5000
3.69E − 80 ± 8.46E − 80
2.82E − 165 ± 0.00E + 00
4.43E − 38 ± 3.82E − 38
1.26E − 61 ± 2.12E − 61
2.58E − 162 ± 1.48e − 323
3.46E − 171 ± 0.00E + 00
7.33E – 202 ± 0.00E + 00
5.07E − 134 ± 6.53E − 134
20D
10000
5.37E − 62 ± 7.70E − 62
5.49E − 170 ± 0.00E + 00
8.19E − 17 ± 5.19E − 17
3.89E − 35 ± 3.50E − 35
1.88E − 179 ± 0.00E + 00
3.80E − 190 ± 0.00E + 00
1.67E – 232 ± 0.00E + 00
1.94E − 124 ± 2.30E − 124
30D
15000
9.57E − 47 ± 1.12E − 46
2.46E − 171 ± 0.00E + 00
6.24E − 07 ± 2.38E − 07
5.79E − 21 ± 6.51E − 21
1.12E − 188 ± 0.00E + 00
2.16E − 202 ± 0.00E + 00
1.60E – 257 ± 0.00E + 00
3.84E − 120 ± 3.69E − 120
f
12
10D
5000
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
20D
10000
0.00E + 00 ± 0.00E + 00
1.00E − 01 ± 3.00E − 01
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
3.33E − 02 ± 1.80E − 01
3.33E − 02 ± 1.80E − 01
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
30D
15000
0.00E + 00 ± 0.00E + 00
6.67E − 01 ± 1.01E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
6.67E − 02 ± 2.49E − 01
3.33E − 02 ± 1.80E − 01
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
f
13
10D
5000
2.56E − 285 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
6.35E − 143 ± 1.79E − 142
5.39E − 231 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
20D
10000
7.71E − 177 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
9.82E − 49 ± 1.53E − 48
5.74E − 104 ± 1.53E − 103
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
30D
15000
4.51E − 114 ± 2.31E − 113
0.00E + 00 ± 0.00E + 00
4.50E − 17 ± 4.05E − 17
1.10E − 53 ± 3.40E − 53
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
f
14
10D
5000
4.65E − 05 ± 5.05E − 05
4.72E − 05 ± 4.27E − 05
5.14E − 05 ± 4.25E − 05
6.14E − 05 ± 5.44E − 05
5.24E − 05 ± 4.40E − 05
4.91E − 05 ± 4.00E − 05
3.39E − 05 ± 5.08E − 05
1.35E − 05 ± 1.52E − 05
20D
10000
3.07E − 05 ± 3.23E − 05
1.80E − 05 ± 1.35E − 05
2.77E − 05 ± 2.74E − 05
4.63E − 05 ± 4.66E − 05
2.59E − 05 ± 2.30E − 05
2.52E − 05 ± 1.89E − 05
3.05E − 05 ± 3.73E − 05
5.24E − 06 ± 5.41E − 06
30D
15000
3.44E − 05 ± 3.54E − 05
1.67E − 05 ± 1.50E − 05
4.24E − 05 ± 4.56E − 05
2.51E − 05 ± 3.07E − 05
2.44E − 05 ± 2.35E − 05
1.91E − 05 ± 1.74E − 05
1.79E − 05 ± 1.77E − 05
2.01E – 06 ± 1.29E – 06
f
15
10D
5000
3.27E – 31 ± 1.31E – 46
3.27E – 31 ± 1.31E – 46
3.27E – 31 ± 1.31E – 46
3.27E – 31 ± 1.31E – 46
3.27E – 31 ± 1.31E – 46
3.27E – 31 ± 1.31E – 46
3.27E – 31 ± 1.31E – 46
3.27E – 31 ± 1.31E – 46
20D
10000
1.63E – 31 ± 6.57E – 47
5.18E − 03 ± 2.79E − 02
1.17E − 28 ± 1.56E − 28
1.63E – 31 ± 6.57E – 47
1.63E – 31 ± 6.57E – 47
1.63E – 31 ± 6.57E – 47
1.63E – 31 ± 6.57E – 47
1.63E – 31 ± 6.57E – 47
30D
15000
1.09E – 31 ± 8.76E – 47
6.91E − 03 ± 2.59E − 02
3.43E − 10 ± 5.64E − 10
1.09E – 31 ± 8.76E – 47
1.09E – 31 ± 8.16E – 35
1.09E – 31 ± 1.38E – 34
3.46E − 03 ± 1.86E − 02
1.09E – 31 ± 8.76E – 47
f
16
10D
5000
8.53E + 01 ± 7.11E – 14
8.53E + 01 ± 6.23E – 14
8.53E + 01 ± 6.95E – 14
8.53E + 01 ± 7.03E – 14
8.53E + 01 ± 5.58E – 14
8.53E + 01 ± 5.82E – 14
8.53E + 01 ± 7.11E – 14
8.53E + 01 ± 7.11E – 14
20D
10000
1.21E − 04 ± 1.10E − 04
7.97E − 05 ± 8.70E − 05
1.94E − 04 ± 1.87E − 04
1.86E − 04 ± 1.92E − 04
4.77E − 05 ± 4.62E − 05
3.96E − 05 ± 2.79E − 05
6.73E − 05 ± 7.35E − 05
5.62E − 06 ± 6.26E − 06
30D
15000
1.49E − 04 ± 1.67E − 04
1.13E − 04 ± 1.14E − 04
4.53E − 04 ± 5.16E − 04
4.49E − 04 ± 4.36E − 04
6.63E − 05 ± 6.82E − 05
6.64E − 05 ± 6.02E − 05
7.43E − 05 ± 7.72E − 05
9.25E − 06 ± 8.13E − 06
f
17
10D
5000
0.00E + 00 ± 0.00E + 00
9.85E − 03 ± 3.69E − 02
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
3.70E − 18 ± 1.99E − 17
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
20D
10000
0.00E + 00 ± 0.00E + 00
5.91E − 02 ± 8.18E − 02
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
9.85E − 03 ± 3.69E − 02
2.22E − 17 ± 6.66E − 17
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
30D
15000
0.00E + 00 ± 0.00E + 00
1.38E − 01 ± 1.32E − 01
1.15E − 10 ± 1.18E − 10
0.00E + 00 ± 0.00E + 00
2.46E − 02 ± 5.51E − 02
1.97E − 02 ± 5.02E − 02
1.97E − 02 ± 5.02E − 02
0.00E + 00 ± 0.00E + 00
f
18
10D
5000
2.38E − 140 ± 7.10E − 140
0.00E + 00 ± 0.00E + 00
6.26E − 64 ± 9.94E − 64
8.59E − 109 ± 2.49E − 108
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
7.88E − 250 ± 0.00E + 00
20D
10000
6.90E − 104 ± 1.09E − 103
0.00E + 00 ± 0.00E + 00
4.09E − 24 ± 6.53E − 24
1.36E − 57 ± 3.99E − 57
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
2.86E − 230 ± 0.00E + 00
30D
15000
3.95E − 75 ± 7.03E − 75
0.00E + 00 ± 0.00E + 00
8.54E − 07 ± 6.45E − 07
1.61E − 32 ± 2.77E − 32
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.24E − 221 ± 0.00E + 00
f
19
10D
5000
3.99E − 146 ± 1.16E − 145
0.00E + 00 ± 0.00E + 00
9.32E − 70 ± 1.47E − 69
1.17E − 113 ± 5.13E − 113
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
3.12E − 255 ± 0.00E + 00
20D
10000
2.65E − 109 ± 8.16E − 109
0.00E + 00 ± 0.00E + 00
6.25E − 30 ± 7.38E − 30
1.53E − 63 ± 3.40E − 63
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
8.15E − 236 ± 0.00E + 00
30D
15000
8.28E − 81 ± 1.39E − 80
0.00E + 00 ± 0.00E + 00
1.76E − 12 ± 9.70E − 13
3.91E − 38 ± 5.30E − 38
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
3.37E − 227 ± 0.00E + 00
f
20
10D
5000
1.75E − 143 ± 4.10E − 143
0.00E + 00 ± 0.00E + 00
3.61E − 67 ± 6.53E − 67
3.89E − 112 ± 9.53E − 112
1.51e − 312 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
5.58E − 253 ± 0.00E + 00
20D
10000
1.13E − 106 ± 2.38E − 106
2.20e − 312 ± 0.00E + 00
5.06E − 27 ± 7.98E − 27
4.83E − 61 ± 9.92E − 61
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
3.88E − 233 ± 0.00E + 00
30D
15000
4.31E − 78 ± 6.35E − 78
5.90e − 311 ± 0.00E + 00
8.05E − 10 ± 5.01E − 10
1.89E − 35 ± 2.98E − 35
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
2.42E − 224 ± 0.00E + 00
f
21
10D
5000
1.79E − 143 ± 3.30E − 143
4.19E − 307 ± 0.00E + 00
1.75E − 66 ± 3.86E − 66
9.24E − 112 ± 1.79E − 111
3.31e − 320 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.18E − 252 ± 0.00E + 00
20D
10000
2.36E − 106 ± 5.82E − 106
3.94e − 313 ± 0.00E + 00
2.76E − 27 ± 2.93E − 27
5.25E − 61 ± 8.13E − 61
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
3.85E − 232 ± 0.00E + 00
30D
15000
2.55E − 77 ± 1.09E − 76
5.21e − 319 ± 0.00E + 00
8.43E − 10 ± 4.46E − 10
2.67E − 35 ± 3.14E − 35
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
5.27E − 224 ± 0.00E + 00
f
22
10D
5000
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
8.22E − 33 ± 4.43E − 32
0.00E + 00 ± 3.38E – 32
0.00E + 00 ± 0.00E + 00
20D
10000
8.63E − 33 ± 4.65E − 32
1.89E − 32 ± 6.35E − 32
5.70E − 18 ± 7.17E − 18
0.00E + 00 ± 0.00E + 00
2.34E − 31 ± 3.59E − 31
1.01E − 31 ± 1.32E − 31
1.51E − 31 ± 1.56E − 31
5.11E − 31 ± 5.29E − 31
30D
15000
1.40E − 31 ± 1.84E − 31
2.20E − 31 ± 3.06E − 31
5.37E − 05 ± 4.44E − 05
1.58E − 27 ± 2.62E − 27
1.29E − 30 ± 2.89E − 30
5.06E − 31 ± 3.40E − 31
6.86E − 31 ± 4.01E − 31
1.06E − 22 ± 3.32E − 22
f
23
10D
5000
2.53E − 06 ± 2.32E − 06
2.67E − 06 ± 2.58E − 06
5.26E − 06 ± 4.46E − 06
5.69E − 06 ± 6.10E − 06
1.24E − 06 ± 1.03E − 06
1.76E − 06 ± 2.20E − 06
1.56E − 06 ± 1.32E − 06
2.88E − 07 ± 1.91E − 07
20D
10000
2.94E − 06 ± 2.94E − 06
1.92E − 06 ± 1.80E − 06
7.99E − 06 ± 6.28E − 06
5.69E − 06 ± 5.00E − 06
1.34E − 06 ± 1.45E − 06
9.49E − 07 ± 1.16E − 06
1.57E − 06 ± 1.36E − 06
7.14E – 08 ± 7.03E – 08
30D
15000
3.23E − 06 ± 2.88E − 06
1.69E − 06 ± 1.71E − 06
1.48E − 05 ± 1.48E − 05
6.77E − 06 ± 5.84E − 06
1.24E − 06 ± 1.37E − 06
1.02E − 06 ± 1.04E − 06
1.36E − 06 ± 1.30E − 06
4.64E − 08 ± 5.37E − 08
f
24
10D
5000
0.00E + 00 ± 0.00E + 00
7.40E − 16 ± 1.66E − 15
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
2.96E − 16 ± 1.11E − 15
4.44E − 16 ± 1.33E − 15
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
20D
10000
0.00E + 00 ± 0.00E + 00
6.19E − 15 ± 5.31E − 15
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
5.34E − 15 ± 5.10E − 15
3.66E − 15 ± 4.71E − 15
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
30D
15000
0.00E + 00 ± 0.00E + 00
1.00E + 09 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.00E + 09 ± 0.00E + 00
1.00E + 09 ± 0.00E + 00
1.00E + 09 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
f
25
10D
5000
0.00E + 00 ± 0.00E + 00
2.22E − 15 ± 2.22E − 15
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.04E − 15 ± 1.88E − 15
1.63E − 15 ± 2.14E − 15
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
20D
10000
0.00E + 00 ± 0.00E + 00
6.19E − 15 ± 4.32E − 15
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
5.06E − 15 ± 4.13E − 15
5.63E − 15 ± 5.03E − 15
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
30D
15000
0.00E + 00 ± 0.00E + 00
1.00E + 09 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.00E + 09 ± 0.00E + 00
1.00E + 09 ± 0.00E + 00
1.00E + 09 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
f
26
10D
5000
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
5.73E − 224 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
20D
10000
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.36E − 94 ± 7.22E − 94
1.10E − 199 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
30D
15000
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
3.01E − 44 ± 7.05E − 44
5.18E − 118 ± 2.76E − 117
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
f
27
10D
5000
1.97E − 15 ± 1.58E − 16
1.30E – 15 ± 2.62E – 16
4.96E − 08 ± 2.66E − 07
1.65E − 15 ± 2.27E − 16
3.45E − 13 ± 1.85E − 12
1.57E − 15 ± 3.46E − 16
1.81E − 15 ± 1.98E − 16
1.89E − 15 ± 2.14E − 16
20D
10000
4.00E − 15 ± 1.93E − 16
2.53E – 15 ± 4.43E – 16
8.05E + 00 ± 1.15E + 00
3.41E − 07 ± 1.83E − 06
2.97E − 15 ± 4.67E − 16
3.03E − 15 ± 4.28E − 16
3.42E − 15 ± 3.81E − 16
3.89E − 15 ± 2.19E − 16
30D
15000
6.05E − 15 ± 1.49E − 16
3.65E – 15 ± 5.32E – 16
5.03E + 01 ± 1.37E + 01
2.13E + 00 ± 4.20E + 00
4.23E − 15 ± 5.43E − 16
4.46E − 15 ± 5.77E − 16
5.13E − 15 ± 2.20E − 15
5.86E − 15 ± 2.61E − 16
f
28
10D
5000
7.32E − 13 ± 1.08E − 12
2.66E − 02 ± 7.93E − 02
8.10E − 01 ± 1.54E − 01
8.45E − 02 ± 1.30E − 01
5.31E − 53 ± 2.86E − 52
1.98E − 28 ± 1.05E − 27
7.35E – 118 ± 1.46E – 117
6.82E − 49 ± 2.60E − 48
20D
10000
3.80E + 00 ± 4.43E − 01
9.35E − 01 ± 1.26E + 00
4.86E + 00 ± 5.78E − 01
5.48E + 00 ± 1.00E + 00
1.30E − 01 ± 3.36E − 01
3.21E − 02 ± 1.67E − 01
4.98E – 118 ± 1.94E – 117
4.74E − 22 ± 5.37E − 22
30D
15000
9.50E + 00 ± 7.40E − 01
4.88E + 00 ± 3.39E + 00
1.08E + 01 ± 7.54E − 01
1.28E + 01 ± 1.33E + 00
7.84E − 01 ± 1.10E + 00
6.29E − 01 ± 1.46E + 00
1.74E – 120 ± 7.93E – 120
3.87E − 10 ± 4.29E − 10
f
29
10D
5000
1.07E − 08 ± 2.98E − 08
3.12E − 07 ± 8.42E − 07
8.20E − 10 ± 2.05E − 09
9.20E − 10 ± 1.49E − 09
8.71E − 10 ± 1.67E − 09
9.37E − 10 ± 2.28E − 09
9.43E − 08 ± 7.09E − 07
4.86E − 08 ± 2.13E − 07
20D
10000
1.58E − 08 ± 5.52E − 08
1.96E − 07 ± 4.95E − 07
2.32E − 10 ± 3.77E − 10
2.08E − 10 ± 3.87E − 10
8.01E – 11 ± 1.80E – 10
7.44E − 10 ± 2.08E − 09
1.11E − 07 ± 4.98E − 07
4.63E − 08 ± 8.04E − 08
30D
15000
1.73E − 08 ± 7.00E − 08
3.01E − 07 ± 5.49E − 07
5.40E − 11 ± 8.01E − 11
4.47E − 11 ± 5.97E − 11
6.90E − 11 ± 1.97E − 10
2.75E − 10 ± 1.03E − 09
2.04E − 07 ± 9.92E − 07
6.45E − 08 ± 1.30E − 07
f
30
10D
5000
2.08E – 04 ± 1.09E – 19
2.18E − 04 ± 1.60E − 05
3.02E − 04 ± 3.11E − 05
2.26E − 04 ± 2.49E − 05
2.13E − 04 ± 4.52E − 06
2.10E − 04 ± 9.85E − 06
2.10E − 04 ± 4.68E − 06
2.08E – 04 ± 2.21E – 20
20D
10000
1.74E − 07 ± 3.77E − 08
3.06E − 08 ± 5.82E − 09
2.67E − 07 ± 5.91E − 08
2.71E − 07 ± 6.91E − 08
1.75E − 07 ± 4.85E − 08
1.04E − 07 ± 5.80E − 08
2.64E − 08 ± 4.35E − 09
1.90E – 08 ± 1.48E – 24
30D
15000
3.34E − 10 ± 1.37E − 10
5.38E − 11 ± 1.00E − 10
4.68E − 10 ± 2.38E − 10
5.80E − 10 ± 3.10E − 10
3.96E − 10 ± 1.40E − 10
2.80E − 10 ± 1.94E − 10
2.54E − 12 ± 6.83E − 13
1.29E – 12 ± 4.09E – 28Table 4
Number of function calls (mean ± SD) of DE variants for functions (f
1
–
f
30).
Fun
DIM
Iter.
V
1
V
2
V
3
V
4
V
7
V
10
V
41
V
42
f
1
10D
105
2.17E + 02 ± 1.02E + 01
1.05E + 02 ± 5.36E + 00
4.40E + 02 ± 1.20E + 01
2.73E + 02 ± 1.31E + 01
1.03E + 02 ± 3.88E + 00
9.68E + 01 ± 3.77E + 00
8.38E + 01 ± 4.86E + 00
1.29E + 02 ± 5.97E + 00
20D
2 × 105
6.22E + 02 ± 1.84E + 01
2.18E + 02 ± 9.01E + 00
2.19E + 03 ± 7.94E + 01
1.04E + 03 ± 3.78E + 01
2.01E + 02 ± 5.41E + 00
1.91E + 02 ± 6.81E + 00
1.56E + 02 ± 5.21E + 00
2.97E + 02 ± 9.27E + 00
30D
3 × 105
1.28E + 03 ± 3.04E + 01
3.42E + 02 ± 1.21E + 01
7.56E + 03 ± 1.95E + 02
2.63E + 03 ± 9.07E + 01
2.91E + 02 ± 7.50E + 00
2.77E + 02 ± 9.53E + 00
2.21E + 02 ± 7.02E + 00
4.80E + 02 ± 1.09E + 01
f
2
10D
105
2.07E + 02 ± 9.44E + 00
1.04E + 02 ± 5.47E + 00
4.01E + 02 ± 1.95E + 01
2.55E + 02 ± 1.02E + 01
1.03E + 02 ± 3.46E + 00
9.81E + 01 ± 4.21E + 00
8.47E + 01 ± 3.34E + 00
1.30E + 02 ± 5.28E + 00
20D
2 × 105
6.33E + 02 ± 1.53E + 01
2.35E + 02 ± 1.03E + 01
2.10E + 03 ± 4.47E + 01
1.03E + 03 ± 3.19E + 01
2.12E + 02 ± 4.52E + 00
2.03E + 02 ± 6.60E + 00
1.69E + 02 ± 5.48E + 00
3.29E + 02 ± 7.92E + 00
30D
3 × 105
1.36E + 03 ± 3.12E + 01
3.78E + 02 ± 1.32E + 01
7.55E + 03 ± 2.18E + 02
2.76E + 03 ± 9.85E + 01
3.26E + 02 ± 8.83E + 00
3.09E + 02 ± 8.87E + 00
2.46E + 02 ± 7.61E + 00
5.40E + 02 ± 1.19E + 01
f
3
10D
105
1.28E + 03 ± 7.67E + 01
4.55E + 02 ± 3.15E + 01
2.97E + 03 ± 1.24E + 02
1.67E + 03 ± 9.23E + 01
4.22E + 02 ± 3.13E + 01
4.56E + 02 ± 3.00E + 01
3.30E + 02 ± 1.91E + 01
6.73E + 02 ± 3.11E + 01
20D
2 × 105
2.00E + 04 ± 1.10E + 03
3.04E + 03 ± 1.60E + 02
1.06E + 05 ± 5.17E + 03
3.74E + 04 ± 2.03E + 03
2.35E + 03 ± 1.28E + 02
2.75E + 03 ± 1.88E + 02
1.72E + 03 ± 1.05E + 02
3.22E + 03 ± 1.38E + 02
30D
3 × 105
1.82E + 05 ± 1.06E + 04
9.64E + 03 ± 8.13E + 02
—
—
6.96E + 03 ± 4.12E + 02
8.81E + 03 ± 6.54E + 02
4.57E + 03 ± 2.43E + 02
7.31E + 03 ± 2.20E + 02
f
4
10D
105
3.08E + 03 ± 1.36E + 02
1.31E + 03 ± 2.23E + 02
6.46E + 03 ± 3.24E + 02
3.67E + 03 ± 2.24E + 02
2.83E + 03 ± 7.80E + 03
1.43E + 03 ± 6.87E + 01
1.23E + 03 ± 5.85E + 01
2.59E + 03 ± 3.02E + 02
20D
2 × 105
9.58E + 03 ± 2.89E + 02
3.17E + 03 ± 6.65E + 02
3.74E + 04 ± 1.53E + 03
1.61E + 04 ± 7.13E + 02
3.24E + 03 ± 5.66E + 02
3.38E + 03 ± 3.04E + 02
2.84E + 03 ± 4.03E + 02
1.47E + 04 ± 2.95E + 03
30D
3 × 105
2.11E + 04 ± 5.34E + 02
5.72E + 03 ± 8.36E + 02
1.54E + 05 ± 7.14E + 03
4.23E + 04 ± 2.36E + 03
4.87E + 03 ± 1.17E + 03
5.59E + 03 ± 2.73E + 02
4.78E + 03 ± 5.89E + 02
3.87E + 04 ± 7.47E + 03
f
5
10D
105
1.43E + 03 ± 2.46E + 02
—
5.97E + 03 ± 7.61E + 02
2.33E + 03 ± 2.28E + 02
1.93E + 04 ± 0.00E + 00
7.29E + 02 ± 2.13E + 02
5.21E + 02 ± 1.85E + 02
2.88E + 02 ± 1.37E + 01
20D
2 × 105
2.09E + 04 ± 5.74E + 03
—
—
—
—
2.70E + 03 ± 0.00E + 00
—
6.33E + 02 ± 3.50E + 01
30D
3 × 105
1.52E + 05 ± 3.90E + 04
—
—
—
—
—
—
1.00E + 03 ± 4.41E + 01
f
6
10D
105
1.96E + 03 ± 4.08E + 02
3.57E + 02 ± 9.12E + 01
1.29E + 04 ± 2.58E + 03
1.99E + 03 ± 0.00E + 00
2.96E + 03 ± 1.48E + 03
1.19E + 03 ± 0.00E + 00
3.92E + 02 ± 2.44E + 02
5.62E + 02 ± 1.01E + 02
20D
2 × 105
1.32E + 03 ± 3.11E + 02
3.30E + 02 ± 1.24E + 01
1.12E + 04 ± 2.59E + 03
2.37E + 03 ± 3.45E + 02
5.19E + 02 ± 2.21E + 02
2.88E + 02 ± 1.76E + 01
2.36E + 02 ± 1.67E + 01
6.02E + 02 ± 1.37E + 02
30D
3 × 105
2.09E + 03 ± 3.06E + 02
4.81E + 02 ± 2.38E + 01
1.94E + 04 ± 3.12E + 03
4.37E + 03 ± 5.69E + 02
5.21E + 02 ± 1.85E + 02
3.95E + 02 ± 2.10E + 01
3.17E + 02 ± 1.14E + 01
7.40E + 02 ± 5.74E + 01
f
7
10D
105
1.13E + 02 ± 8.69E + 00
5.74E + 01 ± 4.95E + 00
2.28E + 02 ± 1.90E + 01
1.45E + 02 ± 1.23E + 01
5.59E + 01 ± 3.92E + 00
5.46E + 01 ± 3.73E + 00
4.50E + 01 ± 3.38E + 00
7.39E + 01 ± 6.10E + 00
20D
2 × 105
2.62E + 02 ± 2.15E + 01
9.43E + 01 ± 1.01E + 01
8.84E + 02 ± 6.55E + 01
4.39E + 02 ± 3.89E + 01
8.02E + 01 ± 6.20E + 00
7.62E + 01 ± 4.87E + 00
6.14E + 01 ± 4.93E + 00
1.44E + 02 ± 1.29E + 01
30D
3 × 105
5.20E + 02 ± 4.12E + 01
1.24E + 02 ± 1.20E + 01
2.70E + 03 ± 2.99E + 02
1.01E + 03 ± 9.80E + 01
1.03E + 02 ± 9.07E + 00
9.56E + 01 ± 8.35E + 00
7.06E + 01 ± 5.21E + 00
2.15E + 02 ± 2.95E + 01
f
8
10D
105
1.93E + 03 ± 3.42E + 02
—
7.25E + 03 ± 1.02E + 03
3.31E + 03 ± 4.53E + 02
2.38E + 04 ± 1.11E + 04
8.50E + 02 ± 1.38E + 02
5.53E + 02 ± 1.32E + 02
3.60E + 02 ± 2.12E + 01
20D
2 × 105
2.65E + 04 ± 6.98E + 03
—
—
1.21E + 05 ± 4.57E + 04
—
3.69E + 03 ± 2.17E + 03
—
7.98E + 02 ± 2.34E + 01
30D
3 × 105
1.96E + 05 ± 4.43E + 04
—
—
—
—
—
—
1.26E + 03 ± 3.37E + 01
f
9
10D
105
4.60E + 02 ± 4.40E + 02
2.28E + 02 ± 1.52E + 02
9.09E + 02 ± 6.08E + 02
6.01E + 02 ± 4.11E + 02
2.24E + 02 ± 1.38E + 02
2.64E + 02 ± 2.25E + 02
2.40E + 02 ± 1.66E + 02
1.07E + 02 ± 3.17E + 01
20D
2 × 105
5.91E + 02 ± 2.58E + 02
2.49E + 02 ± 1.21E + 02
2.22E + 03 ± 7.05E + 02
1.07E + 03 ± 4.29E + 02
3.13E + 02 ± 1.34E + 02
2.62E + 02 ± 1.56E + 02
2.24E + 02 ± 1.17E + 02
1.77E + 02 ± 1.68E + 01
30D
3 × 105
9.93E + 02 ± 3.39E + 02
3.06E + 02 ± 9.95E + 01
5.29E + 03 ± 1.24E + 03
2.16E + 03 ± 1.05E + 03
2.98E + 02 ± 1.07E + 02
2.57E + 02 ± 1.15E + 02
2.53E + 02 ± 1.22E + 02
2.64E + 02 ± 1.79E + 01
f
10
10D
105
9.25E + 02 ± 4.04E + 01
3.63E + 02 ± 1.99E + 01
2.05E + 03 ± 1.08E + 02
1.17E + 03 ± 6.41E + 01
3.38E + 02 ± 1.41E + 01
3.54E + 02 ± 2.02E + 01
2.68E + 02 ± 1.31E + 01
9.56E + 02 ± 6.02E + 01
20D
2 × 105
7.02E + 03 ± 2.73E + 02
1.92E + 03 ± 1.04E + 02
2.67E + 04 ± 1.01E + 03
1.17E + 04 ± 5.27E + 02
1.61E + 03 ± 5.94E + 01
1.69E + 03 ± 8.28E + 01
1.26E + 03 ± 5.44E + 01
4.06E + 04 ± 6.37E + 03
30D
3 × 105
2.55E + 04 ± 8.58E + 02
5.02E + 03 ± 2.14E + 02
1.66E + 05 ± 5.05E + 03
5.18E + 04 ± 1.75E + 03
3.92E + 03 ± 1.71E + 02
4.25E + 03 ± 2.40E + 02
2.96E + 03 ± 1.28E + 02
—
f
11
10D
105
3.97E + 02 ± 9.40E + 00
1.95E + 02 ± 5.49E + 00
8.19E + 02 ± 2.16E + 01
5.20E + 02 ± 1.53E + 01
2.00E + 02 ± 5.59E + 00
1.90E + 02 ± 5.08E + 00
1.61E + 02 ± 4.08E + 00
2.40E + 02 ± 6.35E + 00
20D
2 × 105
1.09E + 03 ± 2.38E + 01
4.03E + 02 ± 1.17E + 01
3.79E + 03 ± 9.29E + 01
1.92E + 03 ± 6.53E + 01
3.88E + 02 ± 8.09E + 00
3.63E + 02 ± 8.34E + 00
2.96E + 02 ± 6.82E + 00
5.48E + 02 ± 1.18E + 01
30D
3 × 105
2.22E + 03 ± 4.22E + 01
6.15E + 02 ± 1.91E + 01
1.27E + 04 ± 2.45E + 02
4.73E + 03 ± 1.08E + 02
5.68E + 02 ± 1.50E + 01
5.28E + 02 ± 1.43E + 01
4.17E + 02 ± 1.15E + 01
8.78E + 02 ± 1.37E + 01
f
12
10D
105
1.48E + 02 ± 7.39E + 00
7.12E + 01 ± 4.46E + 00
3.04E + 02 ± 2.03E + 01
1.87E + 02 ± 1.42E + 01
6.92E + 01 ± 4.36E + 00
6.62E + 01 ± 3.75E + 00
5.66E + 01 ± 5.33E + 00
8.46E + 01 ± 5.40E + 00
20D
2 × 105
4.16E + 02 ± 1.84E + 01
1.51E + 02 ± 9.34E + 00
1.49E + 03 ± 6.56E + 01
7.40E + 02 ± 4.56E + 01
1.44E + 02 ± 3.95E + 01
1.31E + 02 ± 1.32E + 01
1.07E + 02 ± 5.02E + 00
1.99E + 02 ± 8.18E + 00
30D
3 × 105
8.74E + 02 ± 3.96E + 01
2.35E + 02 ± 1.89E + 01
5.56E + 03 ± 3.45E + 02
1.93E + 03 ± 1.33E + 02
2.07E + 02 ± 1.26E + 01
3.80E + 02 ± 9.15E + 02
1.50E + 02 ± 7.71E + 00
3.24E + 02 ± 1.03E + 01
f
13
10D
105
9.34E + 01 ± 8.06E + 00
4.56E + 01 ± 4.36E + 00
1.78E + 02 ± 1.42E + 01
1.13E + 02 ± 6.94E + 00
4.55E + 01 ± 4.43E + 00
4.34E + 01 ± 2.92E + 00
3.69E + 01 ± 4.15E + 00
5.51E + 01 ± 3.91E + 00
20D
2 × 105
3.43E + 02 ± 1.89E + 01
1.18E + 02 ± 7.10E + 00
1.19E + 03 ± 7.86E + 01
5.58E + 02 ± 4.07E + 01
1.05E + 02 ± 7.79E + 00
9.95E + 01 ± 5.08E + 00
8.27E + 01 ± 4.63E + 00
1.46E + 02 ± 7.33E + 00
30D
3 × 105
8.31E + 02 ± 3.93E + 01
2.00E + 02 ± 1.27E + 01
5.18E + 03 ± 1.82E + 02
1.70E + 03 ± 9.52E + 01
1.72E + 02 ± 7.38E + 00
1.60E + 02 ± 6.86E + 00
1.29E + 02 ± 6.28E + 00
2.49E + 02 ± 1.06E + 01
f
14
10D
105
1.82E + 04 ± 1.68E + 04
1.60E + 04 ± 1.27E + 04
3.08E + 04 ± 2.53E + 04
2.39E + 04 ± 2.16E + 04
1.99E + 04 ± 2.03E + 04
2.00E + 04 ± 1.56E + 04
1.80E + 04 ± 1.58E + 04
5.47E + 03 ± 5.38E + 03
20D
2 × 105
3.13E + 04 ± 3.06E + 04
2.09E + 04 ± 1.96E + 04
3.54E + 04 ± 3.32E + 04
4.86E + 04 ± 4.94E + 04
3.06E + 04 ± 2.85E + 04
2.85E + 04 ± 2.88E + 04
1.91E + 04 ± 1.98E + 04
6.36E + 03 ± 6.04E + 03
30D
3 × 105
3.81E + 04 ± 3.36E + 04
1.88E + 04 ± 1.80E + 04
4.59E + 04 ± 5.15E + 04
5.65E + 04 ± 5.63E + 04
3.03E + 04 ± 2.24E + 04
2.51E + 04 ± 2.15E + 04
3.93E + 04 ± 2.82E + 04
5.28E + 03 ± 4.19E + 03
f
15
10D
105
2.22E + 02 ± 1.46E + 01
1.02E + 02 ± 6.34E + 00
4.78E + 02 ± 2.98E + 01
2.90E + 02 ± 2.02E + 01
1.11E + 02 ± 1.25E + 01
9.44E + 01 ± 5.42E + 00
8.10E + 01 ± 5.75E + 00
1.20E + 02 ± 6.15E + 00
20D
2 × 105
6.30E + 02 ± 2.72E + 01
2.08E + 02 ± 1.18E + 01
2.49E + 03 ± 1.37E + 02
1.16E + 03 ± 8.24E + 01
2.02E + 02 ± 1.43E + 01
1.80E + 02 ± 7.48E + 00
1.44E + 02 ± 6.32E + 00
2.62E + 02 ± 8.76E + 00
30D
3 × 105
1.33E + 03 ± 6.54E + 01
3.21E + 02 ± 2.03E + 01
9.71E + 03 ± 7.84E + 02
3.03E + 03 ± 1.97E + 02
2.93E + 02 ± 2.48E + 01
2.57E + 02 ± 1.06E + 01
1.98E + 02 ± 1.01E + 01
4.04E + 02 ± 8.80E + 00
f
16
10D
105
—
—
—
—
—
—
—
—
20D
2 × 105
7.01E + 04 ± 5.68E + 04
4.68E + 04 ± 4.65E + 04
6.64E + 04 ± 5.01E + 04
8.44E + 04 ± 5.47E + 04
4.21E + 04 ± 3.51E + 04
5.45E + 04 ± 5.36E + 04
4.42E + 04 ± 4.67E + 04
5.05E + 03 ± 6.35E + 03
30D
3 × 105
1.13E + 05 ± 8.24E + 04
1.00E + 05 ± 8.88E + 04
1.22E + 05 ± 8.32E + 04
1.05E + 05 ± 7.06E + 04
1.06E + 05 ± 7.77E + 04
9.72E + 04 ± 6.93E + 04
1.18E + 05 ± 7.21E + 04
7.72E + 03 ± 6.50E + 03
f
17
10D
105
2.19E + 02 ± 1.04E + 01
1.06E + 02 ± 5.23E + 00
4.82E + 02 ± 2.43E + 01
2.92E + 02 ± 1.62E + 01
1.05E + 02 ± 6.10E + 00
9.91E + 01 ± 4.34E + 00
8.36E + 01 ± 3.87E + 00
1.25E + 02 ± 6.82E + 00
20D
2 × 105
6.44E + 02 ± 2.46E + 01
2.20E + 02 ± 8.57E + 00
2.52E + 03 ± 1.11E + 02
1.17E + 03 ± 6.68E + 01
2.12E + 02 ± 8.93E + 00
1.93E + 02 ± 8.35E + 00
1.58E + 02 ± 7.40E + 00
2.92E + 02 ± 8.07E + 00
30D
3 × 105
1.38E + 03 ± 6.13E + 01
3.52E + 02 ± 1.24E + 01
9.38E + 03 ± 4.04E + 02
3.06E + 03 ± 1.86E + 02
3.12E + 02 ± 1.24E + 01
2.84E + 02 ± 1.12E + 01
2.18E + 02 ± 7.89E + 00
4.68E + 02 ± 1.02E + 01
f
18
10D
105
4.08E + 02 ± 1.14E + 01
1.93E + 02 ± 6.80E + 00
8.45E + 02 ± 1.82E + 01
5.12E + 02 ± 1.68E + 01
1.90E + 02 ± 5.31E + 00
1.83E + 02 ± 4.36E + 00
1.57E + 02 ± 4.75E + 00
2.35E + 02 ± 5.47E + 00
20D
2 × 105
1.11E + 03 ± 2.26E + 01
3.93E + 02 ± 1.11E + 01
3.97E + 03 ± 8.17E + 01
1.89E + 03 ± 5.70E + 01
3.57E + 02 ± 8.23E + 00
3.39E + 02 ± 8.29E + 00
2.80E + 02 ± 7.64E + 00
5.33E + 02 ± 8.07E + 00
30D
3 × 105
2.31E + 03 ± 4.39E + 01
6.02E + 02 ± 1.59E + 01
1.37E + 04 ± 2.86E + 02
4.77E + 03 ± 1.30E + 02
5.22E + 02 ± 1.37E + 01
4.93E + 02 ± 1.10E + 01
3.94E + 02 ± 9.44E + 00
8.39E + 02 ± 8.88E + 00
f
19
10D
105
2.17E + 02 ± 1.03E + 01
1.04E + 02 ± 4.55E + 00
4.40E + 02 ± 1.61E + 01
2.69E + 02 ± 1.37E + 01
1.01E + 02 ± 4.82E + 00
9.74E + 01 ± 4.45E + 00
8.26E + 01 ± 4.92E + 00
1.24E + 02 ± 6.16E + 00
20D
2 × 105
6.07E + 02 ± 1.66E + 01
2.16E + 02 ± 7.38E + 00
2.12E + 03 ± 5.58E + 01
1.03E + 03 ± 4.26E + 01
1.94E + 02 ± 7.15E + 00
1.87E + 02 ± 6.10E + 00
1.54E + 02 ± 5.76E + 00
2.95E + 02 ± 6.46E + 00
30D
3 × 105
1.25E + 03 ± 4.71E + 01
3.33E + 02 ± 1.19E + 01
7.44E + 03 ± 2.42E + 02
2.59E + 03 ± 5.35E + 01
2.89E + 02 ± 9.29E + 00
2.73E + 02 ± 7.16E + 00
2.18E + 02 ± 6.55E + 00
4.76E + 02 ± 1.06E + 01
f
20
10D
105
3.07E + 02 ± 8.64E + 00
1.45E + 02 ± 5.27E + 00
6.34E + 02 ± 1.88E + 01
3.84E + 02 ± 1.49E + 01
1.44E + 02 ± 5.10E + 00
1.38E + 02 ± 5.36E + 00
1.16E + 02 ± 5.17E + 00
1.78E + 02 ± 6.31E + 00
20D
2 × 105
8.41E + 02 ± 2.20E + 01
2.99E + 02 ± 1.23E + 01
3.00E + 03 ± 7.25E + 01
1.43E + 03 ± 4.08E + 01
2.70E + 02 ± 7.63E + 00
2.62E + 02 ± 6.50E + 00
2.12E + 02 ± 7.97E + 00
4.07E + 02 ± 1.02E + 01
30D
3 × 105
1.74E + 03 ± 5.34E + 01
4.61E + 02 ± 1.76E + 01
1.05E + 04 ± 1.87E + 02
3.59E + 03 ± 8.78E + 01
4.00E + 02 ± 1.09E + 01
3.77E + 02 ± 7.68E + 00
3.02E + 02 ± 7.37E + 00
6.48E + 02 ± 1.06E + 01
f
21
10D
105
3.21E + 02 ± 1.14E + 01
1.54E + 02 ± 5.74E + 00
6.54E + 02 ± 1.50E + 01
4.07E + 02 ± 1.78E + 01
1.54E + 02 ± 5.77E + 00
1.47E + 02 ± 5.88E + 00
1.25E + 02 ± 4.85E + 00
1.89E + 02 ± 4.21E + 00
20D
2 × 105
8.62E + 02 ± 1.85E + 01
3.10E + 02 ± 1.07E + 01
3.02E + 03 ± 7.26E + 01
1.46E + 03 ± 4.60E + 01
2.80E + 02 ± 7.51E + 00
2.69E + 02 ± 8.40E + 00
2.20E + 02 ± 6.22E + 00
4.23E + 02 ± 6.09E + 00
30D
3 × 105
1.77E + 03 ± 2.94E + 01
4.75E + 02 ± 1.38E + 01
1.04E + 04 ± 2.29E + 02
3.64E + 03 ± 1.04E + 02
4.11E + 02 ± 1.07E + 01
3.87E + 02 ± 9.58E + 00
3.05E + 02 ± 8.38E + 00
6.68E + 02 ± 9.36E + 00
f
22
10D
105
3.84E + 02 ± 1.48E + 01
1.70E + 02 ± 7.68E + 00
8.29E + 02 ± 3.64E + 01
4.92E + 02 ± 2.60E + 01
1.65E + 02 ± 5.94E + 00
1.63E + 02 ± 5.52E + 00
1.37E + 02 ± 6.72E + 00
2.43E + 02 ± 1.45E + 01
20D
2 × 105
1.09E + 03 ± 3.17E + 01
3.65E + 02 ± 1.83E + 01
4.29E + 03 ± 1.70E + 02
1.93E + 03 ± 5.76E + 01
3.40E + 02 ± 1.83E + 01
3.33E + 02 ± 2.85E + 01
2.98E + 02 ± 2.05E + 01
6.37E + 02 ± 6.63E + 01
30D
3 × 105
2.37E + 03 ± 8.71E + 01
6.07E + 02 ± 3.64E + 01
1.60E + 04 ± 6.60E + 02
4.99E + 03 ± 1.97E + 02
5.81E + 02 ± 4.08E + 01
5.49E + 02 ± 4.04E + 01
5.07E + 02 ± 3.02E + 01
1.10E + 03 ± 1.93E + 02
f
23
10D
105
1.54E + 03 ± 1.17E + 03
1.03E + 03 ± 8.73E + 02
2.63E + 03 ± 2.38E + 03
2.13E + 03 ± 1.98E + 03
9.50E + 02 ± 9.39E + 02
8.58E + 02 ± 1.05E + 03
1.27E + 03 ± 1.25E + 03
2.19E + 02 ± 1.61E + 02
20D
2 × 105
2.41E + 03 ± 1.94E + 03
1.97E + 03 ± 2.01E + 03
8.50E + 03 ± 8.82E + 03
5.67E + 03 ± 4.37E + 03
1.64E + 03 ± 1.48E + 03
1.40E + 03 ± 1.53E + 03
1.42E + 03 ± 1.59E + 03
2.28E + 02 ± 1.45E + 02
30D
3 × 105
3.83E + 03 ± 3.61E + 03
2.84E + 03 ± 2.76E + 03
2.62E + 04 ± 3.69E + 04
1.12E + 04 ± 1.11E + 04
2.53E + 03 ± 2.72E + 03
2.34E + 03 ± 2.06E + 03
2.34E + 03 ± 1.89E + 03
2.80E + 02 ± 1.54E + 02
f
24
10D
105
1.94E + 02 ± 6.83E + 00
8.57E + 01 ± 3.27E + 00
2.83E + 02 ± 8.09E + 00
1.44E + 02 ± 5.16E + 00
1.14E + 02 ± 3.75E + 00
1.03E + 02 ± 5.04E + 00
9.76E + 01 ± 4.62E + 00
1.76E + 02 ± 4.43E + 00
20D
2 × 105
4.04E + 02 ± 9.17E + 00
1.60E + 02 ± 4.81E + 00
7.69E + 02 ± 2.16E + 01
3.33E + 02 ± 1.02E + 01
2.11E + 02 ± 8.69E + 00
1.90E + 02 ± 7.16E + 00
1.83E + 02 ± 4.67E + 00
4.37E + 02 ± 8.56E + 00
30D
3 × 105
6.39E + 02 ± 1.56E + 01
2.27E + 02 ± 6.36E + 00
1.57E + 03 ± 3.05E + 01
5.74E + 02 ± 1.97E + 01
2.97E + 02 ± 7.23E + 00
2.64E + 02 ± 7.03E + 00
2.60E + 02 ± 7.35E + 00
7.17E + 02 ± 1.31E + 01
f
25
10D
105
2.11E + 02 ± 7.63E + 00
9.13E + 01 ± 4.25E + 00
3.19E + 02 ± 8.31E + 00
1.57E + 02 ± 6.62E + 00
1.22E + 02 ± 5.43E + 00
1.11E + 02 ± 3.99E + 00
1.04E + 02 ± 3.15E + 00
1.86E + 02 ± 5.67E + 00
20D
2 × 105
4.27E + 02 ± 1.29E + 01
1.67E + 02 ± 6.41E + 00
8.39E + 02 ± 2.20E + 01
3.48E + 02 ± 1.24E + 01
2.20E + 02 ± 6.27E + 00
1.98E + 02 ± 5.03E + 00
1.89E + 02 ± 4.89E + 00
4.47E + 02 ± 9.85E + 00
30D
3 × 105
6.67E + 02 ± 1.29E + 01
2.31E + 02 ± 6.24E + 00
1.65E + 03 ± 4.70E + 01
6.01E + 02 ± 2.29E + 01
3.03E + 02 ± 8.41E + 00
2.68E + 02 ± 6.62E + 00
2.68E + 02 ± 6.37E + 00
7.28E + 02 ± 9.54E + 00
f
26
10D
105
4.15E + 01 ± 7.49E + 00
2.65E + 01 ± 6.34E + 00
8.84E + 01 ± 2.53E + 01
6.42E + 01 ± 1.25E + 01
2.84E + 01 ± 5.12E + 00
2.65E + 01 ± 3.68E + 00
2.12E + 01 ± 4.78E + 00
2.90E + 01 ± 4.75E + 00
20D
2 × 105
8.44E + 01 ± 1.75E + 01
4.05E + 01 ± 9.54E + 00
2.09E + 02 ± 6.96E + 01
1.39E + 02 ± 3.52E + 01
5.31E + 01 ± 5.60E + 01
4.26E + 01 ± 2.76E + 01
3.12E + 01 ± 1.33E + 01
4.66E + 01 ± 7.03E + 00
30D
3 × 105
1.46E + 02 ± 2.78E + 01
5.32E + 01 ± 1.02E + 01
5.57E + 02 ± 1.46E + 02
3.45E + 02 ± 7.42E + 01
5.37E + 01 ± 1.13E + 01
4.65E + 01 ± 7.45E + 00
3.65E + 01 ± 5.91E + 00
6.69E + 01 ± 6.10E + 00
f
27
10D
105
7.74E + 02 ± 7.73E + 01
2.63E + 02 ± 1.45E + 01
3.42E + 03 ± 6.64E + 02
1.01E + 03 ± 1.36E + 02
6.25E + 02 ± 2.29E + 02
2.72E + 02 ± 2.20E + 01
2.31E + 02 ± 2.05E + 01
3.45E + 02 ± 2.14E + 01
20D
2 × 105
3.10E + 03 ± 4.42E + 02
5.39E + 02 ± 2.74E + 01
4.25E + 04 ± 1.16E + 04
5.26E + 03 ± 8.10E + 02
8.94E + 02 ± 2.79E + 02
5.05E + 02 ± 2.77E + 01
4.09E + 02 ± 2.27E + 01
7.92E + 02 ± 4.47E + 01
30D
3 × 105
7.68E + 03 ± 1.37E + 03
8.10E + 02 ± 3.98E + 01
2.71E + 05 ± 3.28E + 04
1.53E + 04 ± 2.16E + 03
1.08E + 03 ± 3.03E + 02
7.16E + 02 ± 3.18E + 01
5.49E + 02 ± 2.28E + 01
1.25E + 03 ± 5.70E + 01
f
28
10D
105
2.02E + 03 ± 1.97E + 02
4.01E + 02 ± 5.92E + 01
—
2.43E + 04 ± 1.39E + 04
4.14E + 02 ± 3.95E + 01
9.85E + 02 ± 1.94E + 03
2.53E + 02 ± 1.42E + 01
5.94E + 02 ± 2.49E + 01
20D
2 × 105
—
9.21E + 02 ± 1.05E + 02
—
—
1.62E + 03 ± 1.45E + 03
8.08E + 03 ± 2.38E + 04
5.12E + 02 ± 1.81E + 01
2.68E + 03 ± 1.19E + 02
30D
3 × 105
—
—
—
—
9.55E + 03 ± 2.29E + 04
2.55E + 04 ± 6.30E + 04
7.79E + 02 ± 2.87E + 01
8.54E + 03 ± 5.10E + 02
f
29
10D
105
3.16E + 01 ± 3.55E + 01
2.60E + 01 ± 1.96E + 01
4.70E + 01 ± 4.33E + 01
3.81E + 01 ± 4.75E + 01
3.27E + 01 ± 3.60E + 01
3.93E + 01 ± 4.95E + 01
3.42E + 01 ± 3.39E + 01
7.96E + 01 ± 9.05E + 01
20D
2 × 105
2.01E + 01 ± 1.80E + 01
3.34E + 01 ± 3.89E + 01
3.43E + 01 ± 3.33E + 01
3.09E + 01 ± 3.12E + 01
3.14E + 01 ± 2.40E + 01
3.12E + 01 ± 3.38E + 01
3.45E + 01 ± 3.05E + 01
1.80E + 02 ± 2.73E + 02
30D
3 × 105
3.46E + 01 ± 2.25E + 01
1.86E + 01 ± 1.66E + 01
2.84E + 01 ± 2.43E + 01
2.61E + 01 ± 2.97E + 01
4.05E + 01 ± 3.80E + 01
2.87E + 01 ± 2.63E + 01
3.05E + 01 ± 2.44E + 01
2.24E + 02 ± 2.44E + 02
f
30
10D
105
—
—
—
—
—
—
—
—
20D
2 × 105
1.08E + 02 ± 6.26E + 01
7.48E + 01 ± 5.54E + 01
9.94E + 01 ± 6.90E + 01
1.47E + 02 ± 6.36E + 01
9.35E + 01 ± 5.22E + 01
7.79E + 01 ± 3.93E + 01
6.68E + 01 ± 2.77E + 01
3.11E + 01 ± 8.45E + 00
30D
3 × 105
1.12E + 01 ± 5.90E + 00
1.06E + 01 ± 4.91E + 00
1.41E + 01 ± 6.35E + 00
1.08E + 01 ± 5.40E + 00
1.09E + 01 ± 5.38E + 00
1.17E + 01 ± 6.30E + 00
1.12E + 01 ± 6.17E + 00
1.34E + 01 ± 5.17E + 00Figure 2
10D: average fitness value Dendrogram of 42 variants.Figure 3
20D: average fitness value Dendrogram of 42 variants.Figure 4
30D: average fitness value Dendrogram of 42 variants.Figure 5
Average of average fitness value for 10D, 20D, and 30D Dendrogram of 42-DE variants.Figure 6
10D: average number of function call values Dendrogram of 42-DE variants.Figure 7
20D: average number of function call values Dendrogram of 42 variants.Figure 8
30D: average number of function call values Dendrogram of 42-DE variants.Figure 9
Average of average number of function call values for 10D, 20D, and 30D Dendrogram of 42-DE variants.Figure 10
10D: logarithmic convergence graphs of average fitness for some functions showing number of iterations horizontally and average fitness vertically.The results of average fitness value and NFC are used to evaluate the performance of DE mutation strategies. Commonly used mutation strategies, proposed mutation variant and, one other better performing mutation strategy results are included in this section since results are large enough to manage in the tabular form for all variants in the paper. Experimental results are obtained for 40 DE mutation strategies given in Table1 and the proposed TSDE mutation variant (V
41 and V
42) but reported for selected mutation strategies only due to space issue. Experimental results are analyzed on the basis of commonly used performance parameters average fitness and NFC. The benchmark functions are N-dimensional functions having varying nature. From average fitness results, it can be observed that proposed binomial TSDE(V
41) version has dominating performance among all strategies; the mutation strategy V
10 that has never announced to be one of the best performing mutation strategies in DE has the second best performance; proposed exponential TSDE(V
42) and two other well known DE mutation strategies V
7 and V
2 have subsequent best performance. Although in most of the cases proposed V
41 shares its best performance with other mutation strategies like V
10, V
7, V
2, and so forth, convergence graphs show that V
41 has better convergence speed than these mutation strategies. Research result shows that proposed mutation strategies perform better for the functions having various characteristics like unimodal/multimodal and separable/nonseparable. The proposed mutation strategy (V
41) has better average fitness performance for separable functions f
1, f
2, f
12, f
13, f
19 (10D, 20D), f
16 (10D), f
22 (10D, 20D), f
18, f
19, f
20, f
21, f
22 (10D), f
26, and f
28; nonseparable functions f
3, f
7, f
10, f
11, f
18, f
24, and f
25; unimodal functions f
2, f
3, f
11, f
12, f
13, f
16 (10D), f
26, and f
21; and multimodal functions f
1, f
7, f
10, f
18, f
19 (10D, 20D), f
22 (10D, 20D), f
18, f
19, f
22 (10D), f
24, f
25, f
26, and f
28. One of the rarely used DE mutation strategies V
10 has second best average fitness performance for separable functions f
1, f
2, f
12 (10D), f
14, f
19, f
16 (10D), f
18, f
24, f
20, f
21, and f
26; nonseparable functions f
7, f
18, and f
21 (10D, 30D); unimodal functions f
2, f
12 (10D), f
14, f
16 (10D), f
20, and f
21; and multimodal functions f
1, f
7, f
18, f
19, f
21 (10D, 30D), f
18, f
24, and f
26. The proposed exponential mutation strategy (V
42) has better average fitness performance for separable functions f
5 (10D, 30D), f
12, f
14, f
22, f
22 (10D), and f
26; nonseparable functions f
6 (30D), f
24, f
25, and f
30; unimodal functions f
12 and f
14; and multimodal functions f
5 (10D, 30D), f
6 (30D), f
22, f
22 (10D), f
24, f
25, f
26, and f
30. Average fitness result shows that V
41 has dominating performance among all strategies and although it shares its best performance with other mutation strategies like V
2, V
7, and V
10 in most of the cases, the convergence graphs show that the proposed TSDE has fast convergence than other mutation strategies like V
2, V
7, and V
10 and vice versa.Results of number of function calls show that TSDE(V
41) has clearly leading performance among all other DE mutation strategies in most of the cases. The binomial TSDE mutation variant V
41 has best performance in most of the functions having various characteristics like separable, nonseparable, unimodal, and multimodal. V
41 outperforms other strategies forSphere model,Axis parallel hyperellipsoid,Schwefel’s problem 1.2,Rosenbrock’s valley,Griewank’s function (20D, 30D),Sum of different power,Levy function (30D),Zakharov function,Schwefel’s problem 2.22,Step function,De Jong’s function-4,Levy and Montalvo Problem,Cosine Mixture,Cigar,Function“15,”Ellipse Function,Tablet Function,Schwefel,MultiModal global optimization problem,Quintic global optimization problem, andStochastic global optimization problem. The exponential version of TSDE mutation variant V
42 has better performance forAckley’s path function (30D), Levy function (20D), andAlpine function (20D). One of the commonly used mutation strategies of DE algorithm V
2 has better performance forGriewank’s function (10D),Mishra-1 global optimization problem,Mishra-2 global optimization problem,Stretched-V global optimization problem (30D), andXinSheYang (30D) functions. The mutation strategies that fail to reach VTR for any function with specified parameter contain dashed values in Table 4 for the NFC results. It can be noted from the results that the proposed TSDE performs better than all others including V
10. Proposed TSDE can be one of the powerful mutation strategies in DE algorithm.Experimental result can be summarized that the proposed binomial“TSDE(
V
41
)” has the dominating performance among all DE mutation strategies for both average fitness values and number of function call values. The strategy V
10
(“DE/rand repeated to best/1/bin”) is the second best performing mutation strategy in average fitness value and is runner-up in most of the cases of number of function call values. One interesting aspect of this variant (
V
10
) is that the performance of this strategy is never announced to be one the best strategies of the DE algorithm. The mutation strategies V
7 and V
2
(“DE/best/1/bin”) that are already known to be best performing DE variant have subsequent best performance along with exponential“TSDE(
V
42
)” and vice versa. It can also be summarized that the worst performing mutation strategies among the considered strategies are V
6
(“DE/rand repeating & current to rand/1/bin”),
V
8, V
11
(DE/rand to best/1),
V
14
(“DE/rand to best/2”)
V
16
(“DE/rand to current/2”),
V
19
(“DE/rand/3”), and V
20
(“DE/best/3”) and vice versa.


## 7. Statistical Analysis

The results of DE mutation strategies are analyzed statistically by calculating the rank correlation and by generated Dendrograms. To find the rank correlation, rank of each DE mutation strategy is calculated to find the correlation between DE strategies. The performance of mutation strategies will be observed during the analysis for various dimensions with the help of Dendrogram. Similarity/dissimilarity matrix is used to generate the Dendrogram. Similarity matrixes are obtained using “Statistical Package for the Social Sciences” (SPSS). After similarity matrix, pairwise distances between DE strategies are calculated. Pairwise distance is used to create hierarchical cluster tree linkage that is used to create the Dendrogram. Dendrogram actually generates the clusters from the dissimilarity matrix using agglomerative clustering. Dendrograms of DE mutation strategy for test suit of benchmark functions are shown in Figures1–3 and Algorithm 1 for different dimensions.Pairwise dissimilarities between objects can be easily depicted using Dendrograms. Dendrograms are considered to be an effective way of cluster analysis that specifies the level of similarity joining of any two clusters. The leaf of clusters in Dendrograms contains the DE mutation strategy’s number andy-axis contains the dissimilarity scale that shows the joining distance between clusters. The height of each branch in Dendrograms shows that which DE strategies are similar or different from each other. The greater height of DE strategies branches means that strategies are more different from each other. Consider the Dendrograms generated from average fitness values and number of function call values given in Figures 2–9, respectively. A similarity measure among the DE strategies is explored by generating Dendrograms from the average fitness values and number of function call performance parameters. The best performing mutation strategies are contained in the similar performing cluster shown in transparent circles and most worst performing strategies are contained in the dotted circle in each Dendrogram. The Dendrograms are generated for 10D, 20D, 30D and the average of all (10D, 20D, and 30D) is generated for both performance metrics of fitness value and number of function calls. The best performing and worst performing strategies among all mutation strategies are contained in the corresponding groups in most of the cases. The best performing strategies“TSDE(
V
41
),” “DE/rand repeated to best/1/bin (
V
10
),” “DE/best/1/bin (
V
2
),” and“(
V
7
)” are contained in the same group in most of the cases that can be considered as best performing mutation strategies that are group shown in the transparent circle in Figures 2–9. The worst performing group of mutation strategies is encircled dashed line and it contains“DE/rand repeating & current to rand/1/bin (
V
6
),” “DE/rand & current to best/2/bin (
V
14
),” “DE/rand & current to rand/1/bin (
V
16
),” “DE/rand/3/bin (
V
19
),” and“DE/best/3 (
V
20
)” and vice versa.It is important to discuss that a number of DE mutation strategies are considered in this research work and all these strategies perform different from each other. Dendrograms are also considered to be an effective tool to determine the clusters number. For DE strategies, more number of clusters in the Dendrogram indicates that DE mutation strategies have varying performance from one another, which shows the diverse nature of these strategies in DE algorithm. The diverse nature of DE variants will be helpful to make this algorithm more broadly applicable in various optimization problems of distinct characteristics.The convergence graphs of selected benchmark functions for 10 dimensions (10D) are given in Figure10. Logarithmic convergence graphs of average fitness show number of iterations horizontally and performance vertically. Horizontal iterations are shown as a multiple of 100. Figure 10 contains the convergence graphs of five commonly used DE mutation strategies (V
1, V
2, V
3, V
4, and V
7), the proposed mutation variants (V
41 and V
42), and one other better performing variant V
10. Convergence graphs of few selected functions are given in the paper. Convergence graph shows that the proposed“TSDE(
V
41
)” mutation variant has better performance in most of the cases and proposed that“TSDE(
V
42
)” has better performance in few cases. The mutation strategy V
10
(“DE/rand to best/1/bin”) proves itself to be another better performing DE strategy; it is following“TSDE (
V
41
)” in most cases of convergence graphs. It is important to mention here that V
10
(“DE/rand to best/1/bin”) strategy has never been declared to be one of the best performing variants or among top performing variants of DE algorithm. The convergence graph clearly shows the dominating performance of the proposed DE mutation variant“TSDE(
V
41
).” Most of the researchers have concentrated on very few basic DE strategies like“DE/rand/1/bin (
V
1
),” “DE/best/1/bin (
V
2
),” “DE/rand/2/bin (
V
3
),” “DE/best/2/bin (
V
4
),” and so forth, and some key performing mutation strategies remained unnoticed in the DE research. This study will prove to be fruitful for DE researchers having choice of different variants for scientific and real time applications.


## 8. Comparison of TSDE with PSO and GA

PSO and GA are two well known metaheuristics that are applied on variety of real world problems [57]. The simulation results of proposed “TSDE
(
V
41
)” is compared with two other well known metaheuristics: particle swarm optimization and genetic algorithm. In order to compare TSDE with PSO and GA, the parameter setting for GA is crossover rate CR
=
0.5 and mutation rate F
=
0.05 [58] while for PSO inertia weight ω
∈
0.4
,
0.7, C
1
=
1.49618, and C
2
=
1.49618 are used [59].For fair comparison between PSO, GA, and TSDE, the population size, dimensions, number of iterations, and standard benchmark functions are kept the same. Results of average fitness value and NFC are presented in Tables5 and 6, respectively. Proposed strategy TSDE has dominating performance than evolutionary metaheuristics PSO and GA in most of the cases of 10D, 20D, and 30D for average fitness value and NFC. TSDE proves itself to be one of the powerful variants of DE algorithm that can be a significant addition in DE research.Table 5
Fitness results (mean ± SD) ofTSDE(
V
41
), PSO, and GA for functions (f
1
–
f
30).
Fun
10D
20D
30D
TSDE(
V
41
)
PSO
GA
TSDE(
V
41
)
PSO
GA
TSDE(
V
41
)
PSO
GA
f
1
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
3.95E − 09 ± 1.90E − 08
0.00E + 00 ± 0.00E + 00
6.63E − 176 ± 0.00E + 00
1.17E − 04 ± 2.77E − 04
0.00E + 00 ± 0.00E + 00
5.24E − 01 ± 3.67E + 00
2.48E − 05 ± 9.55E − 05
f
2
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
3.55E − 06 ± 8.35E − 06
0.00E + 00 ± 0.00E + 00
4.19E + 00 ± 1.32E + 01
1.05E − 03 ± 2.25E − 03
0.00E + 00 ± 0.00E + 00
3.15E + 01 ± 6.14E + 01
1.98E − 04 ± 6.17E − 04
f
3
9.92E − 120 ± 4.77E − 118
1.01E − 186 ± 0.00E + 00
1.99E − 01 ± 3.35E − 01
1.36E − 47 ± 6.90E − 47
4.23E + 01 ± 2.96E + 02
2.23E + 00 ± 2.56E + 00
4.00E − 26 ± 6.90E − 26
2.96E + 02 ± 8.46E + 02
7.18E + 00 ± 7.83E + 00
f
4
2.66E − 01 ± 7.16E − 01
2.86E + 01 ± 6.47E + 01
7.25E + 00 ± 1.43E + 01
1.33E − 01 ± 7.16E − 01
8.18E + 05 ± 7.48E + 05
3.82E + 01 ± 6.52E + 01
3.99E − 01 ± 1.20E + 00
4.13E + 06 ± 3.62E + 06
3.16E + 01 ± 5.14E + 01
f
5
1.53E + 00 ± 1.17E + 00
5.61E + 00 ± 6.35E + 00
3.98E − 08 ± 2.62E − 07
6.33E + 00 ± 2.03E + 00
2.98E + 01 ± 2.81E + 01
4.17E − 05 ± 8.59E − 05
1.34E + 01 ± 3.64E + 00
6.09E + 01 ± 5.48E + 01
6.11E − 06 ± 3.31E − 05
f
6
1.44E − 02 ± 1.53E − 02
4.54E − 02 ± 4.41E − 02
4.40E − 02 ± 5.85E − 02
2.96E − 03 ± 4.82E − 03
2.46E − 02 ± 3.46E − 02
1.41E − 01 ± 1.57E − 01
4.93E − 04 ± 1.84E − 03
3.71E + 00 ± 1.78E + 01
1.64E − 01 ± 2.07E − 01
f
7
0.00E + 00 ± 0.00E + 00
1.32E − 295 ± 0.00E + 00
4.40E − 06 ± 6.35E − 06
0.00E + 00 ± 0.00E + 00
6.35E − 82 ± 4.45E − 81
2.29E − 06 ± 2.95E − 06
0.00E + 00 ± 0.00E + 00
6.29E − 61 ± 4.40E − 60
8.24E − 07 ± 1.23E − 06
f
8
9.79E − 02 ± 1.01E − 01
3.36E − 01 ± 3.30E − 01
2.44E − 07 ± 4.00E − 07
2.32E − 01 ± 6.28E − 02
6.48E − 01 ± 5.75E − 01
1.98E − 05 ± 4.47E − 05
2.73E − 01 ± 5.21E − 02
1.06E + 00 ± 9.64E − 01
4.34E − 06 ± 1.43E − 05
f
9
3.31E − 07 ± 3.83E − 07
6.09E − 18 ± 2.23E − 17
2.50E − 04 ± 5.86E − 04
1.55E − 07 ± 1.44E − 07
1.27E − 02 ± 3.84E − 02
5.14E − 02 ± 7.54E − 02
1.86E − 03 ± 1.00E − 02
6.33E − 01 ± 1.99E + 00
2.62E − 01 ± 2.85E − 01
f
10
2.11E − 151 ± 5.43E − 151
2.82E − 220 ± 0.00E + 00
6.17E − 03 ± 1.64E − 02
3.83E − 71 ± 6.60E − 71
2.10E − 94 ± 1.43E − 93
2.96E − 01 ± 4.39E − 01
1.11E − 44 ± 4.40E − 44
4.69E − 30 ± 3.13E − 29
2.78E − 01 ± 3.35E − 01
f
11
7.33E − 202 ± 0.00E + 00
1.73E − 60 ± 1.21E − 59
5.54E − 30 ± 3.36E − 29
1.67E − 232 ± 0.00E + 00
4.00E − 01 ± 1.96E + 00
1.33E − 03 ± 4.88E − 03
1.60E − 257 ± 0.00E + 00
9.05E − 01 ± 2.99E + 00
8.61E − 06 ± 5.45E − 05
f
12
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
6.00E − 02 ± 2.37E − 01
0.00E + 00 ± 0.00E + 00
3.14E + 00 ± 1.01E + 01
9.60E − 01 ± 1.51E + 00
0.00E + 00 ± 0.00E + 00
3.21E + 01 ± 7.21E + 01
4.46E + 00 ± 4.50E + 00
f
13
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
2.39E − 12 ± 7.46E − 12
0.00E + 00 ± 0.00E + 00
5.37E − 02 ± 3.76E − 01
5.08E − 09 ± 1.60E − 08
0.00E + 00 ± 0.00E + 00
5.37E − 01 ± 2.01E + 00
2.61E − 10 ± 1.00E − 09
f
14
3.39E − 05 ± 5.08E − 05
6.74E − 16 ± 1.36E − 15
4.78E − 05 ± 1.03E − 04
3.05E − 05 ± 3.73E − 05
4.74E − 15 ± 2.00E − 14
5.82E − 05 ± 1.13E − 04
1.79E − 05 ± 1.77E − 05
2.88E − 12 ± 2.02E − 11
3.60E − 05 ± 1.26E − 04
f
15
3.27E − 31 ± 1.31E − 46
1.24E − 02 ± 6.09E − 02
5.33E − 03 ± 6.89E − 03
1.63E − 31 ± 6.57E − 47
6.88E − 02 ± 2.70E − 01
1.23E − 02 ± 1.24E − 02
3.46E − 03 ± 1.86E − 02
1.88E − 01 ± 4.06E − 01
4.24E − 02 ± 5.34E − 02
f
16
8.53E + 01 ± 7.11E − 14
4.48E + 01 ± 2.24E + 02
5.55E + 01 ± 4.70E + 01
6.73E − 05 ± 7.35E − 05
2.19E + 01 ± 1.15E + 02
5.26E + 01 ± 6.25E + 01
7.43E − 05 ± 7.72E − 05
3.94E + 05 ± 3.32E + 05
2.32E + 02 ± 3.02E + 02
f
17
0.00E + 00 ± 0.00E + 00
2.36E − 02 ± 6.17E − 02
5.72E − 12 ± 1.49E − 11
0.00E + 00 ± 0.00E + 00
2.42E − 01 ± 2.57E − 01
2.08E − 06 ± 9.39E − 06
1.97E − 02 ± 5.02E − 02
6.59E − 01 ± 6.66E − 01
1.67E − 07 ± 5.35E − 07
f
18
0.00E + 00 ± 0.00E + 00
2.63E + 05 ± 2.37E + 05
8.44E − 03 ± 4.42E − 02
0.00E + 00 ± 0.00E + 00
2.62E + 06 ± 2.24E + 06
1.99E + 01 ± 4.60E + 01
0.00E + 00 ± 0.00E + 00
5.62E + 06 ± 4.63E + 06
1.78E + 00 ± 4.46E + 00
f
19
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.84E − 08 ± 1.10E − 07
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
4.70E − 05 ± 9.73E − 05
0.00E + 00 ± 0.00E + 00
7.27E − 01 ± 3.56E + 00
2.36E − 05 ± 1.53E − 04
f
20
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
9.51E − 06 ± 4.62E − 05
0.00E + 00 ± 0.00E + 00
3.74E − 202 ± 0.00E + 00
1.96E − 02 ± 4.10E − 02
0.00E + 00 ± 0.00E + 00
9.98E − 05 ± 6.86E − 04
7.45E − 03 ± 3.35E − 02
f
21
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.20E − 03 ± 5.65E − 03
0.00E + 00 ± 0.00E + 00
3.85E − 134 ± 2.70E − 133
1.24E − 01 ± 2.93E − 01
0.00E + 00 ± 0.00E + 00
7.66E − 09 ± 3.70E − 08
1.03E − 01 ± 6.10E − 01
f
22
0.00E + 00 ± 3.38E − 32
0.00E + 00 ± 0.00E + 00
5.05E − 01 ± 5.19E − 01
1.51E − 31 ± 1.56E − 31
1.19E − 07 ± 7.97E − 07
2.93E + 00 ± 2.84E + 00
6.86E − 31 ± 4.01E − 31
4.79E + 04 ± 5.51E + 04
5.45E + 00 ± 4.63E + 00
f
23
1.56E − 06 ± 1.32E − 06
1.92E + 00 ± 1.66E + 00
7.67E − 03 ± 1.90E − 02
1.57E − 06 ± 1.36E − 06
5.64E + 00 ± 4.69E + 00
6.95E − 02 ± 1.17E − 01
1.36E − 06 ± 1.30E − 06
9.25E + 00 ± 7.67E + 00
1.71E + 00 ± 1.55E + 00
f
24
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
7.15E − 01 ± 1.64E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.21E + 02 ± 4.28E + 02
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
2.95E + 04 ± 1.43E + 05
f
25
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
1.16E + 00 ± 1.68E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
5.86E + 01 ± 1.54E + 02
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
5.10E + 04 ± 1.61E + 05
f
26
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
0.00E + 00 ± 0.00E + 00
f
27
1.81E − 15 ± 1.98E − 16
6.31E − 16 ± 5.72E − 16
1.63E + 00 ± 1.48E + 00
3.42E − 15 ± 3.81E − 16
2.07E − 01 ± 1.39E + 00
5.35E + 00 ± 4.52E + 00
5.13E − 15 ± 2.20E − 15
1.62E + 00 ± 3.02E + 00
1.50E + 01 ± 1.25E + 01
f
28
7.35E − 118 ± 1.46E − 117
8.31E − 02 ± 1.41E − 01
1.42E − 66 ± 9.95E − 66
4.98E − 118 ± 1.94E − 117
9.70E − 01 ± 1.04E + 00
4.70E − 19 ± 3.29E − 18
1.74E − 120 ± 7.93E − 120
3.43E + 00 ± 3.27E + 00
4.27E − 235 ± 0.00E + 00
f
29
9.43E − 08 ± 7.09E − 07
1.87E − 29 ± 3.05E − 29
8.32E − 10 ± 2.89E − 09
1.11E − 07 ± 4.98E − 07
1.65E − 29 ± 2.73E − 29
3.25E − 09 ± 9.17E − 09
2.04E − 07 ± 9.92E − 07
2.94E − 29 ± 4.86E − 29
2.43E − 10 ± 6.39E − 10
f
30
2.10E − 04 ± 4.68E − 06
4.02E − 04 ± 3.78E − 04
1.68E − 03 ± 3.62E − 03
2.64E − 08 ± 4.35E − 09
5.36E − 08 ± 4.59E − 08
1.13E − 04 ± 2.58E − 04
2.54E − 12 ± 6.83E − 13
4.83E − 12 ± 4.22E − 12
2.39E − 05 ± 7.86E − 05Table 6
Number of function calls (mean ± SD) ofTSDE(
V
41
), PSO, and GA for functions (f
1
–
f
30).
Fun
10D
20D
30D
TSDE(
V
41
)
PSO
GA
TSDE(
V
41
)
PSO
GA
TSDE(
V
41
)
PSO
GA
f
1
8.38E + 01 ± 4.86E + 00
8.70E + 01 ± 6.98E + 00
1.94E + 03 ± 7.64E + 02
1.56E + 02 ± 5.21E + 00
1.78E + 02 ± 2.56E + 01
1.22E + 04 ± 3.35E + 03
2.21E + 02 ± 7.02E + 00
3.74E + 02 ± 9.70E + 01
1.23E + 04 ± 2.88E + 03
f
2
8.47E + 01 ± 3.34E + 00
8.86E + 01 ± 6.04E + 00
4.47E + 03 ± 2.31E + 03
1.69E + 02 ± 5.48E + 00
2.00E + 02 ± 3.74E + 01
2.54E + 04 ± 8.90E + 03
2.46E + 02 ± 7.61E + 00
4.81E + 02 ± 1.64E + 02
1.81E + 04 ± 5.80E + 03
f
3
3.30E + 02 ± 1.91E + 01
2.18E + 02 ± 2.01E + 01
5.64E + 04 ± 1.68E + 04
1.72E + 03 ± 1.05E + 02
9.45E + 02 ± 1.15E + 02
—
4.57E + 03 ± 2.43E + 02
2.80E + 03 ± 3.27E + 02
2.11E + 05 ± 3.81E + 04
f
4
1.23E + 03 ± 5.85E + 01
3.39E + 04 ± 1.33E + 04
—
2.84E + 03 ± 4.03E + 02
—
—
4.78E + 03 ± 5.89E + 02
—
—
f
5
5.21E + 02 ± 1.85E + 02
—
2.04E + 03 ± 6.31E + 02
—
—
9.05E + 03 ± 2.46E + 03
—
—
1.27E + 04 ± 4.54E + 03
f
6
3.92E + 02 ± 2.44E + 02
—
1.90E + 04 ± 2.19E + 04
2.36E + 02 ± 1.67E + 01
2.53E + 02 ± 3.29E + 01
7.26E + 04 ± 4.95E + 04
3.17E + 02 ± 1.14E + 01
5.63E + 02 ± 4.44E + 01
4.48E + 04 ± 2.83E + 04
f
7
4.50E + 01 ± 3.38E + 00
5.85E + 01 ± 7.33E + 00
3.59E + 03 ± 2.77E + 03
6.14E + 01 ± 4.93E + 00
7.21E + 01 ± 8.89E + 00
3.70E + 03 ± 4.44E + 03
7.06E + 01 ± 5.21E + 00
8.74E + 01 ± 1.23E + 01
2.05E + 03 ± 3.22E + 03
f
8
5.53E + 02 ± 1.32E + 02
—
2.36E + 03 ± 7.19E + 02
—
—
1.11E + 04 ± 3.32E + 03
—
—
1.20E + 04 ± 4.23E + 03
f
9
2.40E + 02 ± 1.66E + 02
8.11E + 01 ± 2.11E + 01
3.97E + 04 ± 2.96E + 04
2.24E + 02 ± 1.17E + 02
1.13E + 02 ± 2.21E + 01
1.08E + 05 ± 4.20E + 04
2.53E + 02 ± 1.22E + 02
1.47E + 02 ± 0.00E + 00
—
f
10
2.68E + 02 ± 1.31E + 01
1.77E + 02 ± 1.61E + 01
3.24E + 04 ± 1.94E + 04
1.26E + 03 ± 5.44E + 01
8.96E + 02 ± 4.40E + 02
—
2.96E + 03 ± 1.28E + 02
2.98E + 03 ± 7.84E + 02
2.72E + 05 ± 3.36E + 03
f
11
1.61E + 02 ± 4.08E + 00
1.77E + 02 ± 1.49E + 01
6.93E + 02 ± 6.42E + 02
2.96E + 02 ± 6.82E + 00
7.51E + 02 ± 4.64E + 02
1.30E + 04 ± 9.92E + 03
4.17E + 02 ± 1.15E + 01
—
4.72E + 03 ± 7.16E + 03
f
12
5.66E + 01 ± 5.33E + 00
8.13E + 01 ± 9.73E + 01
2.52E + 03 ± 1.36E + 03
1.07E + 02 ± 5.02E + 00
2.44E + 04 ± 4.54E + 04
2.00E + 04 ± 9.05E + 03
1.50E + 02 ± 7.71E + 00
1.08E + 05 ± 1.40E + 05
8.14E + 04 ± 4.37E + 04
f
13
3.69E + 01 ± 4.15E + 00
3.50E + 01 ± 3.94E + 00
1.28E + 02 ± 6.27E + 01
8.27E + 01 ± 4.63E + 00
8.68E + 01 ± 8.17E + 00
7.40E + 02 ± 3.59E + 02
1.29E + 02 ± 6.28E + 00
1.70E + 02 ± 2.21E + 01
2.00E + 03 ± 9.29E + 02
f
14
1.80E + 04 ± 1.58E + 04
1.34E + 02 ± 3.92E + 01
2.12E + 04 ± 2.55E + 04
1.91E + 04 ± 1.98E + 04
1.53E + 02 ± 5.99E + 01
4.70E + 04 ± 4.92E + 04
3.93E + 04 ± 2.82E + 04
2.11E + 02 ± 2.94E + 02
4.33E + 04 ± 6.18E + 04
f
15
8.10E + 01 ± 5.75E + 00
8.20E + 01 ± 7.37E + 00
—
1.44E + 02 ± 6.32E + 00
2.05E + 02 ± 7.46E + 01
—
1.98E + 02 ± 1.01E + 01
7.29E + 02 ± 6.37E + 02
—
f
16
—
3.83E + 02 ± 5.45E + 01
—
4.42E + 04 ± 4.67E + 04
2.62E + 03 ± 1.89E + 03
—
1.18E + 05 ± 7.21E + 04
—
—
f
17
8.36E + 01 ± 3.87E + 00
8.82E + 01 ± 8.18E + 00
7.28E + 02 ± 3.00E + 02
1.58E + 02 ± 7.40E + 00
1.54E + 02 ± 7.07E − 01
7.18E + 03 ± 2.89E + 03
2.18E + 02 ± 7.89E + 00
—
8.88E + 03 ± 3.05E + 03
f
18
1.57E + 02 ± 4.75E + 00
—
5.59E + 03 ± 1.05E + 03
2.80E + 02 ± 7.64E + 00
—
2.89E + 04 ± 3.68E + 03
3.94E + 02 ± 9.44E + 00
—
3.14E + 04 ± 5.82E + 03
f
19
8.26E + 01 ± 4.92E + 00
8.38E + 01 ± 5.33E + 00
1.87E + 03 ± 5.35E + 02
1.54E + 02 ± 5.76E + 00
1.76E + 02 ± 2.02E + 01
1.10E + 04 ± 3.49E + 03
2.18E + 02 ± 6.55E + 00
4.70E + 02 ± 3.24E + 02
1.25E + 04 ± 2.75E + 03
f
20
1.16E + 02 ± 5.17E + 00
1.21E + 02 ± 5.81E + 00
3.38E + 03 ± 1.00E + 03
2.12E + 02 ± 7.97E + 00
2.49E + 02 ± 2.46E + 01
2.05E + 04 ± 4.16E + 03
3.02E + 02 ± 7.37E + 00
6.98E + 02 ± 3.67E + 02
2.11E + 04 ± 4.24E + 03
f
21
1.25E + 02 ± 4.85E + 00
1.51E + 02 ± 8.11E + 00
4.88E + 03 ± 1.05E + 03
2.20E + 02 ± 6.22E + 00
2.74E + 02 ± 2.99E + 01
2.53E + 04 ± 5.45E + 03
3.05E + 02 ± 8.38E + 00
8.12E + 02 ± 4.91E + 02
2.59E + 04 ± 6.54E + 03
f
22
1.37E + 02 ± 6.72E + 00
1.64E + 02 ± 1.14E + 01
—
2.98E + 02 ± 2.05E + 01
3.01E + 03 ± 1.52E + 03
—
5.07E + 02 ± 3.02E + 01
2.81E + 05 ± 0.00E + 00
—
f
23
1.27E + 03 ± 1.25E + 03
—
6.54E + 04 ± 1.43E + 04
1.42E + 03 ± 1.59E + 03
—
9.50E + 04 ± 0.00E + 00
2.34E + 03 ± 1.89E + 03
—
—
f
24
9.76E + 01 ± 4.62E + 00
3.03E + 00 ± 3.20E − 01
8.16E + 03 ± 3.32E + 03
1.83E + 02 ± 4.67E + 00
3.27E + 00 ± 5.21E − 01
3.26E + 04 ± 1.31E + 04
2.60E + 02 ± 7.35E + 00
3.40E + 00 ± 4.98E − 01
6.19E + 04 ± 1.94E + 04
f
25
1.04E + 02 ± 3.15E + 00
3.13E + 00 ± 3.46E − 01
1.03E + 04 ± 4.17E + 03
1.89E + 02 ± 4.89E + 00
3.37E + 00 ± 5.56E − 01
3.21E + 04 ± 6.75E + 03
2.68E + 02 ± 6.37E + 00
3.57E + 00 ± 5.04E − 01
7.08E + 04 ± 2.16E + 04
f
26
2.12E + 01 ± 4.78E + 00
3.03E + 00 ± 1.83E − 01
2.74E + 01 ± 9.37E + 00
3.12E + 01 ± 1.33E + 01
3.00E + 00 ± 0.00E + 00
3.24E + 01 ± 1.60E + 01
3.65E + 01 ± 5.91E + 00
2.87E + 00 ± 3.46E − 01
1.57E + 01 ± 6.78E + 00
f
27
2.31E + 02 ± 2.05E + 01
2.18E + 02 ± 2.38E + 01
—
4.09E + 02 ± 2.27E + 01
9.27E + 02 ± 2.96E + 02
—
5.49E + 02 ± 2.28E + 01
—
—
f
28
2.53E + 02 ± 1.42E + 01
—
1.31E + 03 ± 9.83E + 02
5.12E + 02 ± 1.81E + 01
—
1.59E + 03 ± 8.26E + 02
7.79E + 02 ± 2.87E + 01
—
1.30E + 03 ± 8.97E + 02
f
29
3.42E + 01 ± 3.39E + 01
2.23E + 01 ± 1.53E + 01
4.80E + 01 ± 5.54E + 01
3.45E + 01 ± 3.05E + 01
2.38E + 01 ± 1.36E + 01
2.19E + 02 ± 5.88E + 02
3.05E + 01 ± 2.44E + 01
1.61E + 01 ± 1.33E + 01
8.63E + 01 ± 1.19E + 02
f
30
—
—
—
6.68E + 01 ± 2.77E + 01
1.16E + 01 ± 8.32E + 00
3.41E + 04 ± 5.31E + 04
1.12E + 01 ± 6.17E + 00
3.03E + 00 ± 1.03E + 00
2.85E + 03 ± 8.15E + 03


## 9. Conclusion

In this paper, a novel technique TSDE mutation variant based on the selection of parent vectors to generate the new population is proposed. The proposed variants“TSDE(
V
41
)” and“TSDE(
V
42
)” are compared with the existing DE mutation strategies.TSDE(
V
41
) mutation variant has dominating performance among the DE mutation strategies. This new mutation variantTSDE will prove to be a valuable addition in DE literature. A comprehensive set of well known N-dimensional benchmark functions have been used to evaluative the performance of the proposedTSDE as well as existing mutation strategies of DE algorithm. In literature, such an extensive comparison performed with many number of mutation strategies is lacking. This comparison unveils some very beneficial facts related to the DE research improvements. The other important aspect of this research is the statistical comparison of the DE mutation strategies; such a comparison is also not available in the literature. Experimental results consist of average fitness value and number of function call parameters of DE algorithm that are reported in Tables 3 and 4. Since total strategies are 42 and it is not possible to report all the mutation strategies in few tables, so proposed TSDE mutation variant, five commonly used mutation strategies, and one better performing mutation strategy are reported in the results. It can be concluded that there is a deviation in the performance of DE algorithm variants and the selection of DE variant affects the performance result of DE algorithm. Better results can be obtained by choosing the better performing strategies. The proposed binomial“TSDE(
V
41
)” has the leading performance among the DE mutation strategies for both fitness value and number of function call performance parameters, the proposed exponential“TSDE(
V
42
),” mutation strategy“DE/rand to best/1/bin (
V
10
),” “
V
7
” and“DE/best/1/bin (
V
2
)” are the other better performance mutation strategies. This research work also reveals one of the best performing mutation strategies“DE/rand to best/1/bin (
V
10
)” that has been rarely brought into play. This research work will prove to be a significant addition in DE literature. The results of TSDE are also compared with two well known heuristics, GA and PSO, that show dominating performance of TSDE. The further studies are still required to explore the limitations, advantages, and flaws in this direction. The main focus in this work is not the overwhelming and existing DE variants but new tracks to work on the DE variants in optimization. One possible direction of future work of this paper is to develop a mathematical model for the DE mutation strategies.



---

*Source: 205709-2015-10-04.xml*