# Improved Cross Entropy Algorithm for the Optimum of Charge Planning Problem

Authors: Fan Yang; Qiqiang Li
Journal: Abstract and Applied Analysis
 (2014)

---

## Abstract

To solve the charge planning problem involving charges and the orders in each charge, a traveling salesman problem based charge planning model and the improved cross entropy algorithm are proposed. Firstly, the charge planning problem with unknown charge number is modeled as a traveling salesman problem. The objective of the model is to minimize the dissimilarity costs between each order and its charge center order, the open order costs, and the unselected order costs. Secondly, the improved cross entropy algorithm is proposed with the improved initial state transition probability matrix which is constructed according to the differences of steel grades and order widths between orders. Finally, an actual numerical example shows the effectiveness of the model and the algorithm.


---

## Body

## 1. Introduction

Primary steel making is a main stage of steel production process [1], in which oxygen furnaces or electric furnaces convert molten iron into batches of molten steel. The batch, which is made to satisfy a group of orders requiring identical charge widths and steel grades, is called charge in steel production terms. Charge plan converts the primary order requirements into various charges subject to the process constraints of steel production. Reasonable design of charges can improve the productivity and cut down the resource and energy consumption. So, charge planning is a key element of the production operation management in the steel making industry and has been discussed a lot in the present literature. For example, Tang et al. [2] established a mixed integer programming model and a genetic algorithm for the problem. In another paper, Tang and Jiang [3] presented a novel mixed-integer programming model for the charge planning problem, and two kinds of Lagrangian relaxation methods are proposed to solve the problem by using different relaxation methods. The number of charges in these articles is known previously, while it is better to be determined by the planner in the steel production process in order to raise productivity. Dong et al. [4] transformed the objective of minimizing the number of charges into a constraint of minimum and maximum number of charges. However, when we derive a charge plan, the number of charges also needs to be settled according to the constraint firstly. Xue et al. [5] modeled the charge planning problem with unknown charge number and transformed the model into pseudo-traveling salesman model. In this model, the dissimilarity costs in a charge are calculated as total differences among orders in the same charge, while it is better to be calculated as differences between orders in each charge and the charge center order according to the practical steel production process. Wang et al. [6] developed a new charge plan model and a modified parthenogenetic algorithm for billet continuous cast process, but the penalties for the contract products’ widths and steel grades were removed from the model. Based on the analysis of the papers mentioned above, a precise charge planning model, especially with the optimum charge number and minimum of the dissimilarity costs between each order and its charge center order, needs further research.Charge planning problem is a NP-hard combinatorial optimization problem, so how to improve the speed and accuracy of the algorithm for this problem is a key point. As mentioned above, the charge plan is made under some production constraints, which can be used to improve the speed and accuracy of the charge planning algorithm. The existing algorithms only consider these constraints as variables in the charge planning models while the proposed improved cross entropy (ICE) algorithm in this study could use the constraints efficiently. Cross entropy (CE) method [7] is a simple, efficient, and general method for solving NP-hard combinatorial optimization problems. It has been used to solve the traveling salesman problem [8], the vehicle routing problem [9], the buffer allocation problem [10], and the max-cut problem [11]. These applications demonstrate the power of the CE method as a generic and practical tool for solving NP-hard problems.In this research, the improved cross entropy algorithm is proposed to solve the charge planning problem with unknown charge numbers and its objective is to minimize the dissimilarity costs between each order and its charge center order. The rest of the paper is organized as follows. Section2 states the charge planning model based on the traveling salesman problem. Section 3 introduces the improved cross entropy algorithm in detail. The proposed approach is applied to an example, and the result is compared with cross entropy method in Section 4. This study is summarized and concluded in Section 5.


## 2. Charge Planning Model Based on Traveling Salesman Problem

### 2.1. Problem Description

Charge is the basic unit for the steel making process, and the problem in this study is to establish the optimum charge plan including the charge center orders and the orders merged into them. Each order has its own requirement on steel grade, specification, and due date. The requirement differences may cause some costs when an order merged into a charge center order. Therefore, minimize the requirement differences between charge center orders and the orders merged into them are one of three objectives of charge planning problem. The other two objectives are to minimize the costs of unselected orders and the amount of open orders which are used to fill in the furnace but do not belong to any current orders. The requirements for establishing a charge plan are listed as follows.(1)
The steel grades of the orders in a charge should be in the same steel grade class.
(2)
The widths differences of the orders in a charge should not be larger than the allowed maximum adjustment widthE.
(3)
The thicknesses of orders in a charge should be the same. In this study, the thicknesses of orders are supposed all same according to the actual production process.
(4)
The total weight of the contract products in a charge should not surpass the maximum furnace capacity.
(5)
The due dates of the contract products in a charge should be similar.


### 2.2. Charge Planning Model

Givenn orders, assume that each single order is less than furnace capacity and cannot be split. The charge planning problem is modeled as follows.Minimize(1)
∑
i
=
1
n
‍
∑
j
=
1
n
‍
c
i
,
j
X
i
j
X
j
j
+
∑
j
=
1
n
‍
p
j
X
j
j
(
T
-
∑
i
=
1
n
‍
g
i
X
i
j
)
+
∑
i
=
1
n
‍
(
1
-
∑
j
=
1
n
‍
X
i
j
X
j
j
)
h
isubject to(2)
∑
j
=
1
n
‍
X
i
j
⩽
1
,
i
=
1
,
…
,
n
,
∑
i
=
1
n
‍
g
i
X
i
j
⩽
T
,
j
=
1
,
…
,
n
,
X
i
j
∈
{
0,1
}
,
X
j
j
∈
{
0,1
}
,
i
=
1
,
…
,
n
,
j
=
1
,
…
,
n
,
where p
j is a penalty coefficient for open order in the charge of center order j, g
i is the weight of charge i, h
i is the unselected penalty of charge i, c
i
,
j, which can be calculated via c
i
,
j
=
c
i
j
1
+
c
i
j
2
+
c
i
j
3, is the dissimilarity cost for the differences between order i and the charge center order j that i merged in, c
i
j
1, c
i
j
2, and c
i
j
3 are the costs caused by the differences of steel grades, widths, and due dates, respectively, between i and j, which can be calculated as follows:
(3)
c
i
j
1
=
{
F
1
(
S
T
i
-
S
T
j
)
,
if
0
⩽
S
T
i
-
S
T
j
⩽
T
H
1
,
+
∞
,
otherwise
,
c
i
j
2
=
{
F
2
|
W
i
-
W
j
|
,
if
|
W
i
-
W
j
|
⩽
E
,
+
∞
,
otherwise
,
c
i
j
3
=
{
F
3
(
d
i
-
d
j
)
,
if
0
⩽
d
i
-
d
j
⩽
D
,
F
4
(
d
i
-
d
j
)
,
if
-
D
⩽
d
i
-
d
j
⩽
0
.
S
T
i, W
i, and d
i are the steel grade value, width, and due date of order i, respectively. F
1 is the unit cost coefficient with the difference of steel grade. F
2 is the unit width dissimilarity penalty cost coefficient. F
3 is the earliness penalty coefficient and F
4 is the tardiness penalty coefficient. D is the due date piecewise parameter.X
i
j and X
j
j are decision variables, where
(4)
X
i
j
=
{
1
,
if
order
i
is
merged
into
order
j
,
0
,
otherwise
.
X
j
j
=
{
1
,
if
order
j
is
charge
center
,
0
,
otherwise
.In the charge planning model mentioned above, objective function (1) minimizes the sum of dissimilarity costs caused by each order and its charge center order, and the costs resulted from open order and the penalty costs for unselected orders. The first part of constraint formula (2) represents that each order can be assigned to only one charge center at most, the second part of constraint formula (2) represents that total charge weight is less than furnace capacity T, and the third part of constraint formula (2) expresses that variables X
i
j and X
j
j have two possible values: 0 or 1.


### 2.3. Traveling Salesman Problem Model for Charge Planning

Regarding the orders as cities, the sum of dissimilarity costs caused by orders merged into charge centers, the costs resulted from open order and the penalties for unselected orders as distances, furnace capacity as the maximum distance a salesman travels, the charge planning problem can be regarded as a traveling salesman problem. The objective of the problem is to find an optimum order sequence minimum the penalty costs that calculated by formula(5)
min
⁡
r
∈
χ
⁡
S
(
r
)
=
min
⁡
r
∈
χ
⁡
∑
k
‍
C
k
r
,
where C
k
r is the penalty cost of charge k, which can be calculated as follows:(6)
C
k
r
=
{
∑
i
=
1
n
‍
I
r
i
k
h
r
i
,
if
∑
i
=
1
n
‍
[
I
r
i
k
c
r
i
,
r
j
k
r
+
p
j
k
r
(
T
-
I
r
i
k
g
r
i
)
]
>
∑
i
=
1
n
‍
I
r
i
k
h
r
i
,
∑
i
=
1
n
‍
[
I
r
i
k
c
r
i
,
r
j
k
r
+
p
j
k
r
(
T
-
I
r
i
k
g
r
i
)
]
,
otherwise
.The piecewise function (6) means if the sum of dissimilarity costs caused by the orders merged into the kth charge and the open order costs in this charge is larger than the total unselected penalties, the orders in this charge are canceled, and then the total penalty of the kth charge is set to the total unselected penalties. j
k
r means the kth charge center order:
(7)
j
k
r
=
{
0
,
if
0
⩽
S
T
r
i
-
S
T
j
k
r
⩽
T
H
1
and
∑
i
=
j
k
-
1
r
r
i
‍
g
i
⩽
T
,
r
i
,
otherwise
.I
r
i
k is the indicator function that indicates whether r
i is merged into charge k:
(8)
I
r
i
k
=
{
1
,
if
j
k
r
⩽
r
i
⩽
j
k
+
1
r
,
0
,
otherwise
.


## 2.1. Problem Description

Charge is the basic unit for the steel making process, and the problem in this study is to establish the optimum charge plan including the charge center orders and the orders merged into them. Each order has its own requirement on steel grade, specification, and due date. The requirement differences may cause some costs when an order merged into a charge center order. Therefore, minimize the requirement differences between charge center orders and the orders merged into them are one of three objectives of charge planning problem. The other two objectives are to minimize the costs of unselected orders and the amount of open orders which are used to fill in the furnace but do not belong to any current orders. The requirements for establishing a charge plan are listed as follows.(1)
The steel grades of the orders in a charge should be in the same steel grade class.
(2)
The widths differences of the orders in a charge should not be larger than the allowed maximum adjustment widthE.
(3)
The thicknesses of orders in a charge should be the same. In this study, the thicknesses of orders are supposed all same according to the actual production process.
(4)
The total weight of the contract products in a charge should not surpass the maximum furnace capacity.
(5)
The due dates of the contract products in a charge should be similar.


## 2.2. Charge Planning Model

Givenn orders, assume that each single order is less than furnace capacity and cannot be split. The charge planning problem is modeled as follows.Minimize(1)
∑
i
=
1
n
‍
∑
j
=
1
n
‍
c
i
,
j
X
i
j
X
j
j
+
∑
j
=
1
n
‍
p
j
X
j
j
(
T
-
∑
i
=
1
n
‍
g
i
X
i
j
)
+
∑
i
=
1
n
‍
(
1
-
∑
j
=
1
n
‍
X
i
j
X
j
j
)
h
isubject to(2)
∑
j
=
1
n
‍
X
i
j
⩽
1
,
i
=
1
,
…
,
n
,
∑
i
=
1
n
‍
g
i
X
i
j
⩽
T
,
j
=
1
,
…
,
n
,
X
i
j
∈
{
0,1
}
,
X
j
j
∈
{
0,1
}
,
i
=
1
,
…
,
n
,
j
=
1
,
…
,
n
,
where p
j is a penalty coefficient for open order in the charge of center order j, g
i is the weight of charge i, h
i is the unselected penalty of charge i, c
i
,
j, which can be calculated via c
i
,
j
=
c
i
j
1
+
c
i
j
2
+
c
i
j
3, is the dissimilarity cost for the differences between order i and the charge center order j that i merged in, c
i
j
1, c
i
j
2, and c
i
j
3 are the costs caused by the differences of steel grades, widths, and due dates, respectively, between i and j, which can be calculated as follows:
(3)
c
i
j
1
=
{
F
1
(
S
T
i
-
S
T
j
)
,
if
0
⩽
S
T
i
-
S
T
j
⩽
T
H
1
,
+
∞
,
otherwise
,
c
i
j
2
=
{
F
2
|
W
i
-
W
j
|
,
if
|
W
i
-
W
j
|
⩽
E
,
+
∞
,
otherwise
,
c
i
j
3
=
{
F
3
(
d
i
-
d
j
)
,
if
0
⩽
d
i
-
d
j
⩽
D
,
F
4
(
d
i
-
d
j
)
,
if
-
D
⩽
d
i
-
d
j
⩽
0
.
S
T
i, W
i, and d
i are the steel grade value, width, and due date of order i, respectively. F
1 is the unit cost coefficient with the difference of steel grade. F
2 is the unit width dissimilarity penalty cost coefficient. F
3 is the earliness penalty coefficient and F
4 is the tardiness penalty coefficient. D is the due date piecewise parameter.X
i
j and X
j
j are decision variables, where
(4)
X
i
j
=
{
1
,
if
order
i
is
merged
into
order
j
,
0
,
otherwise
.
X
j
j
=
{
1
,
if
order
j
is
charge
center
,
0
,
otherwise
.In the charge planning model mentioned above, objective function (1) minimizes the sum of dissimilarity costs caused by each order and its charge center order, and the costs resulted from open order and the penalty costs for unselected orders. The first part of constraint formula (2) represents that each order can be assigned to only one charge center at most, the second part of constraint formula (2) represents that total charge weight is less than furnace capacity T, and the third part of constraint formula (2) expresses that variables X
i
j and X
j
j have two possible values: 0 or 1.


## 2.3. Traveling Salesman Problem Model for Charge Planning

Regarding the orders as cities, the sum of dissimilarity costs caused by orders merged into charge centers, the costs resulted from open order and the penalties for unselected orders as distances, furnace capacity as the maximum distance a salesman travels, the charge planning problem can be regarded as a traveling salesman problem. The objective of the problem is to find an optimum order sequence minimum the penalty costs that calculated by formula(5)
min
⁡
r
∈
χ
⁡
S
(
r
)
=
min
⁡
r
∈
χ
⁡
∑
k
‍
C
k
r
,
where C
k
r is the penalty cost of charge k, which can be calculated as follows:(6)
C
k
r
=
{
∑
i
=
1
n
‍
I
r
i
k
h
r
i
,
if
∑
i
=
1
n
‍
[
I
r
i
k
c
r
i
,
r
j
k
r
+
p
j
k
r
(
T
-
I
r
i
k
g
r
i
)
]
>
∑
i
=
1
n
‍
I
r
i
k
h
r
i
,
∑
i
=
1
n
‍
[
I
r
i
k
c
r
i
,
r
j
k
r
+
p
j
k
r
(
T
-
I
r
i
k
g
r
i
)
]
,
otherwise
.The piecewise function (6) means if the sum of dissimilarity costs caused by the orders merged into the kth charge and the open order costs in this charge is larger than the total unselected penalties, the orders in this charge are canceled, and then the total penalty of the kth charge is set to the total unselected penalties. j
k
r means the kth charge center order:
(7)
j
k
r
=
{
0
,
if
0
⩽
S
T
r
i
-
S
T
j
k
r
⩽
T
H
1
and
∑
i
=
j
k
-
1
r
r
i
‍
g
i
⩽
T
,
r
i
,
otherwise
.I
r
i
k is the indicator function that indicates whether r
i is merged into charge k:
(8)
I
r
i
k
=
{
1
,
if
j
k
r
⩽
r
i
⩽
j
k
+
1
r
,
0
,
otherwise
.


## 3. Improved Cross Entropy Algorithm

In the last section, the traveling salesman problem based model of charge planning problem is constructed. We can use cross entropy method, which has been proven as an efficient method for solving the traveling salesman problem, to solve the charge planning problem as the method. The result did not meet performance expectation when we use the method directly, so we need to improve it. The key point in using cross entropy method to solve a combinatorial optimization problem is the state transition probability matrix, which can be improved according to the characteristics of the problem. In the charge planning problem, two orders with different steel grades or widths have different dissimilarity costs when merged into a same charge center, so the matrix elements can be settled according to the dissimilarity costs as follows.(1)
Assign values to matrix elements according to the process constraints of the problem:(9)
p
i
j
′
=
{
0
,
if
i
=
j
,
1
n
,
if
i
=
1
,
j
≠
1
,
1
N
,
if
S
T
i
-
S
T
j
<
0
iiii
or
S
T
i
-
S
T
j
>
T
H
1
or
|
W
i
-
W
j
|
>
E
,
iii
i
i
i
1
1
-
∑
i
=
1
n
+
1
p
i
j
,
if
j
=
1
,
j
≠
i
,
1
2
,
if
S
T
i
=
S
T
j
and
W
i
=
W
j
,
1
4
,
if
S
T
i
=
S
T
j
,
|
W
i
-
W
j
|
=
50
or
W
i
=
W
j
,
1
⩽
S
T
i
-
S
T
j
⩽
2
,
1
8
,
otherwise
.
(2)
NormalizeP:
(10)
p
i
j
=
p
i
j
′
∑
j
=
1
n
+
1
p
i
j
′
,
i
=
1
,
…
,
n
+
1
.Based on the state transition probability matrix above, we proceed the improved cross entropy algorithm as follows.Step 1.
GenerateN order paths {
(
r
0
,
r
1
,
…
,
r
n
)
,
r
}, r
=
1
,
…
,
N via a Markov process with the initial state transition probability matrix P described by (10), where r
0 is the virtual starting order.Step 2.
CalculateS
(
r
) for every order path using formula (5).Step 3.
OrderS
(
r
) from the smallest to the biggest: S
~
(
1
)
⩽
S
~
(
2
)
⩽
⋯
⩽
S
~
(
N
), and evaluate the ρ sample quantile as γ
t
=
S
~
⌈
ρ
·
N
⌉, where S
~
(
i
), i
=
1
,
…
,
N is called the ith order statistic of the sequence S
~
(
1
)
⩽
S
~
(
2
)
⩽
⋯
⩽
S
~
(
N
) and ⌈
⌉ means round up to the nearest integer.Step 4.
UpdateP by taking only those paths that have a total length less than or equal to γ
t into account, and the updated value for p
i
j can be estimated as p
i
j
=
∑
r
=
1
N
‍
I
{
S
(
r
)
⩽
γ
t
}
I
{
r
∈
χ
i
j
}
/
∑
r
=
1
N
‍
I
{
S
(
r
)
⩽
γ
t
}, where χ
i
j is the set of tours in which the transition from v
i to v
j is made and I is indicator function.Step 5.
IfS
^
t
,
(
1
)
=
S
^
t
+
1
,
(
1
)
=
⋯ = S
^
t
+
5
,
(
1
) for every t
≥
1, calculate S
(
r
) and then stop; otherwise, reiterate from Step 1, S
^
t
,
(
1
) denotes the value of smallest cost in iteration t.To avoid local optimum, instead of updating the transition matrixP directly via Step 4, we use a smoothed updating procedure in which P
i
j
t
=
α
p
i
j
+
(
1
-
α
)
p
i
j
t
-
1, where α is smoothing parameter.


## 4. Computational Results and Discussion

We test our algorithm on the practical production data shown in [5] with 30 orders to be arranged. The basic model parameters are T
H
1
=
5, E
=
100, T
=
100, D
=
30, F
1
=
5, F
2
=
0.1, and F
3
=
F
4
=
2.To verify the efficiency of the proposed algorithm, we compare the results obtained by ICE and CE. The algorithms are run on Matlab 7.0 and a personal computer of Pentium R, 2 GB RAM. There are three parameters in the proposed improved cross entropy algorithm and cross entropy method: sample sizeN, rarity parameter ρ, and smoothing parameter α. Different values of the parameters may result in different solution results. We test {
100
,
300
,
500
,
700
,
1000
} for N, {
0.01,0.02,0.05,0.1,0.2
} for ρ, and {
0.5
,
0.6
,
0.7
,
0.8
,
0.9
} for α. The parameters maintain the same when they are not the tested parameter. Ten computational tests have been conducted for each of different values of each parameter. Mean deviations between the results of the ten tests and the best result as well as the mean running times are regarded as performance criteria of the algorithms. According to the results of the tests, we choose N
=
500, ρ
=
0.02 and α
=
0.8 in this study. The results of the charge planning problem mentioned above are shown in Table 1.Table 1
Comparison of results by ICE and CE.
ICE
CE
Optimum value
2352
2354
Mean running time
26.06
28.98
Mean deviation
8.6
55.3The optimum values are the best values obtained by the two algorithms in 10 times, the mean times are the average times that the two algorithms run 10 times, and the mean deviations are the average distances between the 10 values and the optimum values of the two algorithms in 10 times. The details of the optimum charge plan obtained by ICE and CE are shown in Table2.Table 2
Optimum charge plans obtained by ICE and CE.
Charges
ICE
CE
Slabs
Weights
Slabs
Weights
1
12, 13, 17, 15
98
4, 8, 15, 21
99
2
14, 21, 20, 19
95
2, 1, 5, 3
100
3
26, 23, 25, 24
96
26, 24, 23, 25
96
4
4, 9, 16, 18
99
14, 18, 12, 20
98
5
5, 3, 1, 2
100
13, 16, 19, 17
95
6
6, 8, 11, 10, 7
100
11, 10, 7, 9, 6
100
7
29, 30
20
29, 30
20
Unselected
22, 27, 28
63
22, 27, 28
63From Tables1 and 2, we can observe that ICE makes several improvements compared to the CE method: (
1
) the optimum value is decreased; (
2
) the average run time is decreased by about 11.2%; (
3
) the mean deviations are decreased significantly. These observations prove that the proposed ICE algorithm is better than CE method when solving the charge planning problems, which means better productivity and less resource consumption in the actual production process.


## 5. Conclusion

In this paper, we described the charge planning problem that focuses on the unknown charge number and the dissimilarity costs between orders and those charge center orders in iron and steel production process. The charge planning model, which is based on traveling salesman problem, is formulated and the improved cross entropy algorithm is proposed. Through the improvement of state transition probability matrix, the proposed ICE algorithm could take advantage of the problem’s characteristics. As a result, the speed and accuracy of the algorithm are improved, which are proved by an actual production example. Future work will focus on improving the stability and accuracy of ICE and extending the model and algorithm to the actual charge planning systems.



---

*Source: 857521-2014-07-01.xml*