# Probabilistic Analysis of Steady-State Temperature and Maximum Frequency of Multicore Processors considering Workload Variation

Authors: Biying Zhang; Zhongchuan Fu; Hongsong Chen; Gang Cui
Journal: Mathematical Problems in Engineering
 (2016)

---

## Abstract

A probabilistic method is presented to analyze the temperature and the maximum frequency for multicore processors based on consideration of workload variation, in this paper. Firstly, at the microarchitecture level, dynamic powers are modeled as the linear function of IPCs (instructions per cycle), and leakage powers are approximated as the linear function of temperature. Secondly, the microarchitecture-level hotspot temperatures of both active cores and inactive cores are derived as the linear functions of IPCs. The normal probabilistic distribution of hotspot temperatures is derived based on the assumption that IPCs of all cores follow the same normal distribution. Thirdly and lastly, the probabilistic distribution of the set of discrete frequencies is determined. It can be seen from the experimental results that hotspot temperatures of multicore processors are not deterministic and have significant variations, and the number of active cores and running frequency simultaneously determine the probabilistic distribution of hotspot temperatures. The number of active cores not only results in different probabilistic distribution of frequencies, but also leads to different probabilities for triggering DFS (dynamic frequency scaling).


---

## Body

## 1. Introduction

Continuous technology scaling and miniaturization have escalated the power density and temperature of multicore processors. In order to decrease manufacturing costs, the packages of multicore processors are mostly designed based on average power dissipation instead of the maximum, and temperature is controlled with dynamic thermal management (DTM) techniques such as dynamic voltage and frequency scaling (DVFS) and dynamic frequency scaling (DFS) [1]. When temperature of processor reaches or approaches the critical point, DVFS or DFS are invoked to ensure the thermal constraint at the cost of sacrificing the speed of processors. Therefore, it is crucial for design space exploration to analyze temperature and running frequency accurately and fast at the early stage.


### 1.1. Motivation

To explore the design space of thermal-aware multicore processors at the early stage, some thermal models have been proposed to estimate the temperature and performance of processors [2–5], and most of estimation approaches are based on transient analysis [6–14]. For transient analysis, temporal variations of temperature and performance depending on workloads are traced, contributing to high estimation accuracy. However, transient analysis is time-consuming, and in particular for multicore processors time complexity is unacceptable at the early design stage. Accordingly, to speed up the estimation of temperature and performance of multicore processors, researchers resort to steady-state analysis [15, 16]. Nevertheless, to the best of our knowledge, all previous work related to steady-state analysis is based on the assumption that every workload has the same thermal contribution, which greatly hinders the estimation accuracy. In fact, temperature of multicore processors has great variations between different workloads [10, 17]. Our preliminary work has demonstrated that the dynamic power of processors is highly correlated with IPCs (instructions per cycle) and that within a small temperature range, leakage power linearly depends on temperature [18]. According to the HotSpot thermal model, temperature can be derived given the power of processors [3]. Thus processor temperature has higher correlation with IPC. According to CLT (central limit theorem), when a large number of instructions are executed in the processor, the probabilistic distribution of IPC tends to follow the normal distribution. Accordingly, given both the probabilistic distribution of IPC and the relationship between the temperature and IPC, the probabilistic distribution of processor temperature can be derived and analyzed. Subsequently, the probabilistic distribution of the maximum running frequency can be inferred given that the zero-slack DTM policy is used by the processor, which means that the speed of the processor is set to a value which makes the temperature of the hotspot be the maximum threshold allowed by the processor [7].


### 1.2. Contributions

In this paper, a probabilistic method is proposed to analyze the steady-state temperature and frequency of multicore processors taking into account the variation of workloads. In order to simplify the analyzing processes, DFS technique rather than DVFS technique is adopted to manage the temperatures of processor, where the voltage is constant and only frequency is adjusted. And the dynamic power can be modeled as the linear function of the frequency [12, 16]. The main contributions of this work are as follows:(i)
At the microarchitecture level, the dynamic power of processors is modeled as the linear function of IPC and running frequency, and the leakage power of processor is approximated as the linear model of temperature.
(ii)
The microarchitecture-level hotspot temperatures of both active cores and inactive cores are derived as the linear functions of IPCs of all active cores.
(iii)
It is inferred that the hotspot temperatures of both active cores and inactive cores follow the normal probabilistic distribution, based on the assumption that IPCs of all active cores follow the same normal distribution.
(iv)
The probabilistic distribution of the set of frequencies is determined given the zero-slack DTM policy [7].The remainder of this paper is organized as follows. In Section2, related work is overviewed. In Section 3, the microarchitecture-level steady-state temperature of a core is formulated as the linear function of its powers based on the Hotspot thermal model. In Section 4, at the microarchitecture level, the dynamic powers of processors are modeled as the linear function of IPC and the running frequency, and the leakage powers are approximated as the linear model of temperature. In Section 5, the microarchitecture-level hotspot temperatures of both active cores and inactive cores are derived as the linear function of IPCs of all active cores. It is inferred that the hotspot temperatures of both active cores and inactive cores follow the normal probabilistic distribution, based on the assumption that the IPCs of all active cores follow the same normal probabilistic distribution. In Section 6, the probabilistic distribution of the set of frequencies is determined given the zero-slack DTM policy. In Section 7, experimental results are presented. This paper is concluded in Section 8.


## 1.1. Motivation

To explore the design space of thermal-aware multicore processors at the early stage, some thermal models have been proposed to estimate the temperature and performance of processors [2–5], and most of estimation approaches are based on transient analysis [6–14]. For transient analysis, temporal variations of temperature and performance depending on workloads are traced, contributing to high estimation accuracy. However, transient analysis is time-consuming, and in particular for multicore processors time complexity is unacceptable at the early design stage. Accordingly, to speed up the estimation of temperature and performance of multicore processors, researchers resort to steady-state analysis [15, 16]. Nevertheless, to the best of our knowledge, all previous work related to steady-state analysis is based on the assumption that every workload has the same thermal contribution, which greatly hinders the estimation accuracy. In fact, temperature of multicore processors has great variations between different workloads [10, 17]. Our preliminary work has demonstrated that the dynamic power of processors is highly correlated with IPCs (instructions per cycle) and that within a small temperature range, leakage power linearly depends on temperature [18]. According to the HotSpot thermal model, temperature can be derived given the power of processors [3]. Thus processor temperature has higher correlation with IPC. According to CLT (central limit theorem), when a large number of instructions are executed in the processor, the probabilistic distribution of IPC tends to follow the normal distribution. Accordingly, given both the probabilistic distribution of IPC and the relationship between the temperature and IPC, the probabilistic distribution of processor temperature can be derived and analyzed. Subsequently, the probabilistic distribution of the maximum running frequency can be inferred given that the zero-slack DTM policy is used by the processor, which means that the speed of the processor is set to a value which makes the temperature of the hotspot be the maximum threshold allowed by the processor [7].


## 1.2. Contributions

In this paper, a probabilistic method is proposed to analyze the steady-state temperature and frequency of multicore processors taking into account the variation of workloads. In order to simplify the analyzing processes, DFS technique rather than DVFS technique is adopted to manage the temperatures of processor, where the voltage is constant and only frequency is adjusted. And the dynamic power can be modeled as the linear function of the frequency [12, 16]. The main contributions of this work are as follows:(i)
At the microarchitecture level, the dynamic power of processors is modeled as the linear function of IPC and running frequency, and the leakage power of processor is approximated as the linear model of temperature.
(ii)
The microarchitecture-level hotspot temperatures of both active cores and inactive cores are derived as the linear functions of IPCs of all active cores.
(iii)
It is inferred that the hotspot temperatures of both active cores and inactive cores follow the normal probabilistic distribution, based on the assumption that IPCs of all active cores follow the same normal distribution.
(iv)
The probabilistic distribution of the set of frequencies is determined given the zero-slack DTM policy [7].The remainder of this paper is organized as follows. In Section2, related work is overviewed. In Section 3, the microarchitecture-level steady-state temperature of a core is formulated as the linear function of its powers based on the Hotspot thermal model. In Section 4, at the microarchitecture level, the dynamic powers of processors are modeled as the linear function of IPC and the running frequency, and the leakage powers are approximated as the linear model of temperature. In Section 5, the microarchitecture-level hotspot temperatures of both active cores and inactive cores are derived as the linear function of IPCs of all active cores. It is inferred that the hotspot temperatures of both active cores and inactive cores follow the normal probabilistic distribution, based on the assumption that the IPCs of all active cores follow the same normal probabilistic distribution. In Section 6, the probabilistic distribution of the set of frequencies is determined given the zero-slack DTM policy. In Section 7, experimental results are presented. This paper is concluded in Section 8.


## 2. Related Work

The estimation approach of temperature and performance of processors can be classified into transient analysis and steady-state analysis, and so far most researches have been based on transient analysis.


### 2.1. Transient Analysis

In order to transiently analyze the temperature and explore the design space of processors at the early stage, several thermal models for processors have been proposed. Skadron et al. and Huang et al. [2, 3] presented a compact thermal modeling methodology based on the analogy between thermal and electrical phenomena, namely, HotSpot. Using HotSpot, the spatial and temporal variations of processor temperature can be obtained through transient analysis. To improve the accuracy of thermal simulation, Jang et al. [11] made an extension to the thermal model for HotSpot by taking into account the different ambient temperature owing to workload variations. To accelerate thermal analysis of multicore processors at the architecture level, Wang et al. [5] presented a composite thermal model, termed ThermComp, to optimize the model for different large processors. Li et al. [4] proposed a parameterized architecture-level dynamic thermal model, namely, ParThermPOF, in which many parameters can be set such as the location of thermal sensors and the conductivity of different components.In order to improve the performance of thermal-aware multicore processors, various DTM techniques have been investigated based on thermal models such as Hotspot and analyzed transiently for the estimation of performance. Hanumaiah et al. [7, 19] presented an online thermal management algorithm for thermal-aware multicore processors, in which DVFS and task allocation techniques are simultaneously adopted. In the context of hard real-time systems, the time-varying voltage and frequency of multicores are computed to satisfy not only the thermal constraint but also the deadline constraint [6]. Shi et al. [12] presented a DTM policy under soft thermal constraint, in which the temperature constraint can be exceeded sometimes.In order to simulate the thermal behavior fast and accurately for multicore processors, several researches have been performed. Wojciechowski et al. [10, 20] analyzed the transient characteristics of workloads based on a finite Fourier series expansion to accurately predict the thermal behavior of multicore processors, and a new DVFS approach is presented. Liu et al. [13] proposed a transient analysis method of temperature of multicore processors based on moment matching, and it is used to guide the migration processes of tasks. To account for the nondeterministic behavior of tasks in terms of executing times and decision branches, Das et al. [14] formulated thermal analysis as a hybrid automata reachability verification problem and an algorithm for constructing the automata was provided.For transient analysis, temporal variations of temperature and performance depending on workload are traced and then high estimation accuracy is obtained. However, transient analysis is time-consuming, and in particular for multicore processors time complexity is unacceptable at the early design stage.


### 2.2. Steady-State Analysis

In order to speed up the estimation of temperature and performance at the early design stage of multicore processors, researchers resort to steady-state analysis and have carried out a lot of work. Based on Amdahl’s Law, Lee and Kim [15, 21] introduced variations of process and workload parallelism into the analyzing model and optimized the throughput of thermal-aware multicore processors by exploiting DVFS and the per-core power-gating (PCPG). Based on HotSpot, Rao et al. [16, 22] described an approximate thermal model for homogeneous multicore processors to fast and accurately predict the maximum steady-state throughput under thermal constraints. In the context of a hard real-time system of a single-core processor, Mohaqeqi et al. [23] studied stochastic behavior of the system, for example, performance, temperature, and reliability, based on Markovian view.To the best of our knowledge, all previous work of steady-state analysis is based on the assumption that every workload has the same thermal contribution to processors, resulting in inaccuracy of temperature and performance estimation. This is the focus of our work. In this paper, the variation of workloads is taken into account to model the thermal and frequency more accurately.


## 2.1. Transient Analysis

In order to transiently analyze the temperature and explore the design space of processors at the early stage, several thermal models for processors have been proposed. Skadron et al. and Huang et al. [2, 3] presented a compact thermal modeling methodology based on the analogy between thermal and electrical phenomena, namely, HotSpot. Using HotSpot, the spatial and temporal variations of processor temperature can be obtained through transient analysis. To improve the accuracy of thermal simulation, Jang et al. [11] made an extension to the thermal model for HotSpot by taking into account the different ambient temperature owing to workload variations. To accelerate thermal analysis of multicore processors at the architecture level, Wang et al. [5] presented a composite thermal model, termed ThermComp, to optimize the model for different large processors. Li et al. [4] proposed a parameterized architecture-level dynamic thermal model, namely, ParThermPOF, in which many parameters can be set such as the location of thermal sensors and the conductivity of different components.In order to improve the performance of thermal-aware multicore processors, various DTM techniques have been investigated based on thermal models such as Hotspot and analyzed transiently for the estimation of performance. Hanumaiah et al. [7, 19] presented an online thermal management algorithm for thermal-aware multicore processors, in which DVFS and task allocation techniques are simultaneously adopted. In the context of hard real-time systems, the time-varying voltage and frequency of multicores are computed to satisfy not only the thermal constraint but also the deadline constraint [6]. Shi et al. [12] presented a DTM policy under soft thermal constraint, in which the temperature constraint can be exceeded sometimes.In order to simulate the thermal behavior fast and accurately for multicore processors, several researches have been performed. Wojciechowski et al. [10, 20] analyzed the transient characteristics of workloads based on a finite Fourier series expansion to accurately predict the thermal behavior of multicore processors, and a new DVFS approach is presented. Liu et al. [13] proposed a transient analysis method of temperature of multicore processors based on moment matching, and it is used to guide the migration processes of tasks. To account for the nondeterministic behavior of tasks in terms of executing times and decision branches, Das et al. [14] formulated thermal analysis as a hybrid automata reachability verification problem and an algorithm for constructing the automata was provided.For transient analysis, temporal variations of temperature and performance depending on workload are traced and then high estimation accuracy is obtained. However, transient analysis is time-consuming, and in particular for multicore processors time complexity is unacceptable at the early design stage.


## 2.2. Steady-State Analysis

In order to speed up the estimation of temperature and performance at the early design stage of multicore processors, researchers resort to steady-state analysis and have carried out a lot of work. Based on Amdahl’s Law, Lee and Kim [15, 21] introduced variations of process and workload parallelism into the analyzing model and optimized the throughput of thermal-aware multicore processors by exploiting DVFS and the per-core power-gating (PCPG). Based on HotSpot, Rao et al. [16, 22] described an approximate thermal model for homogeneous multicore processors to fast and accurately predict the maximum steady-state throughput under thermal constraints. In the context of a hard real-time system of a single-core processor, Mohaqeqi et al. [23] studied stochastic behavior of the system, for example, performance, temperature, and reliability, based on Markovian view.To the best of our knowledge, all previous work of steady-state analysis is based on the assumption that every workload has the same thermal contribution to processors, resulting in inaccuracy of temperature and performance estimation. This is the focus of our work. In this paper, the variation of workloads is taken into account to model the thermal and frequency more accurately.


## 3. Thermal Model

In this paper, a microarchitecture-level thermal model for a multicore processor is created by replication of a single-core processor based on HotSpot [3]. The multicore processor is divided into four layers, that is, chip, thermal interface material (TIM), heat spreader, and heat sink. There are m thermal blocks in the chip and TIM, and there are five and nine thermal blocks in the heat spreader and heat sink, respectively. Totally, there are N
=
n
m
+
14 thermal blocks in the multicore processor, where n is the number of cores.The microarchitecture-level thermal model can be represented by the state-space differential equation as follows [16]:(1)
d
T
d
t
=
A
T
+
B
P
,where T and P are N-dimension vectors, respectively, denoting the temperature and power of the multicore processor, and A and B are constant matrices of N
×
N dimension depending on the thermal conduction and capacitance of the processor.When the temperature of the processor is in the steady-state,d
T
/
d
t
=
0, then (2)
G
T
=
P
,where G
=
-
B
-
1
A isthe thermal conductance matrix of HotSpot model.The thermal conductance matrixG can be obtained from the HotSpot simulation tool. The thermal conductance matrix of a dual-core processor is as shown in Figure 1, where the submatrices G
d
i
e, G
i
n
t
, and G
p
k
g along the diagonal are lateral thermal conductance of the chip, TIM, and package, respectively, the submatrices G
d
i
e
-
i
n
t and G
i
n
t
-
d
i
e are the vertical conductance between die and TIM, and the vectors G
i
n
t
-
s
p
r and G
s
p
r
-
i
n
t
′ are the vertical conductance between the TIM and the spreader. G
d
i
e
-
i
n
t is equal to G
i
n
t
-
d
i
e, and G
i
n
t
-
s
p
r is equal to G
s
p
r
-
i
n
t
′. The detailed conductance matrix of G
p
k
g is as shown in Figure 2.Figure 1
Thermal conduction matrixG of dual-core processor [16].Figure 2
Thermal conduction matrix of the package [16].Lemma 1.
According to HotSpot thermal model, when the temperature of the multicore processor is in the steady-state, there existm-dimension matrices R, Q, and Z, such that (3)
T
i
=
R
P
i
+
Q
∑
j
=
1
n
P
j
+
Z
,where T
i and P
i are m-dimension vectors, representing, respectively, temperature and power of the ith core of the processor.Proof.
According to the arrangement of elements in the conductance matrixG in HotSpot thermal model, (2) can be decomposed into the following equations:(4)
G
d
i
e
T
i
+
G
d
i
e
-
i
n
t
T
i
n
t
,
i
=
P
i
,
(5)
G
d
i
e
-
i
n
t
T
i
+
G
i
n
t
T
i
n
t
,
i
+
G
i
n
t
-
s
p
r
T
s
p
r
=
0
,
(6)
G
i
n
t
-
s
p
r
′
∑
j
=
1
n
T
i
n
t
,
j
+
G
s
p
r
T
s
p
r
+
G
s
p
r
-
o
t
h
e
r
′
T
o
t
h
e
r
=
0
,
(7)
G
s
p
r
-
o
t
h
e
r
T
s
p
r
+
G
o
t
h
e
r
-
o
t
h
e
r
T
o
t
h
e
r
=
P
a
m
b
i
e
n
t
,where T
i
n
t
,
i is m-dimension vector representing the temperature of TIM layer of the ith core, T
s
p
r is a scalar representing the temperature of the central block of the spreader, and T
o
t
h
e
r is 13-dimension vector representing the temperature of other blocks of the spreader and the sink.
According to (6) and (7), (8)
T
s
p
r
=
G
s
p
r
-
o
t
h
e
r
′
G
o
t
h
e
r
-
o
t
h
e
r
-
1
G
s
p
r
-
o
t
h
e
r
-
G
s
p
r
-
1
G
i
n
t
-
s
p
r
′
∑
i
=
1
n
T
i
n
t
,
i
+
G
s
p
r
-
o
t
h
e
r
′
G
o
t
h
e
r
-
o
t
h
e
r
-
1
P
a
m
b
i
e
n
t
.
Set(9)
G
S
P
R
O
=
G
s
p
r
-
o
t
h
e
r
′
G
o
t
h
e
r
-
1
G
s
p
r
-
o
t
h
e
r
-
G
s
p
r
-
1
G
i
n
t
-
s
p
r
,
G
s
p
a
m
b
=
G
s
p
r
-
o
t
h
e
r
′
G
o
t
h
e
r
-
o
t
h
e
r
-
1
G
s
p
r
-
o
t
h
e
r
-
G
s
p
r
-
1
G
s
p
r
-
o
t
h
e
r
′
G
o
t
h
e
r
-
o
t
h
e
r
-
1
P
a
m
b
i
e
n
t
.
Equation (8) can be converted into(10)
T
s
p
r
=
G
S
P
R
O
′
∑
i
=
1
n
T
i
n
t
,
i
+
G
s
p
a
m
b
.
Substitute (10) into (5) and get(11)
G
d
i
e
-
i
n
t
T
i
+
G
i
n
t
T
i
n
t
,
i
+
G
i
n
t
-
s
p
r
G
S
P
R
O
′
∑
i
=
1
n
T
i
n
t
,
i
+
G
s
p
a
m
b
=
0
.
According to (4) and (11), get(12)
G
d
i
e
-
i
n
t
-
G
i
n
t
G
d
i
e
-
i
n
t
-
1
G
d
i
e
T
i
-
G
i
n
t
-
s
p
r
G
S
P
R
O
′
G
d
i
e
-
i
n
t
-
1
G
d
i
e
∑
j
=
1
n
T
j
+
G
i
n
t
G
d
i
e
-
i
n
t
-
1
P
i
+
G
i
n
t
-
s
p
r
G
S
P
R
O
′
G
d
i
e
-
i
n
t
-
1
∑
j
=
1
n
P
j
+
G
i
n
t
-
s
p
r
G
s
p
a
m
b
=
0
.
Set(13)
G
1
=
G
d
i
e
-
i
n
t
-
G
i
n
t
G
d
i
e
-
i
n
t
-
1
G
d
i
e
,
G
2
=
G
i
n
t
-
s
p
r
G
S
P
R
O
′
G
d
i
e
-
i
n
t
-
1
G
d
i
e
,
G
3
=
G
i
n
t
G
d
i
e
-
i
n
t
-
1
,
G
4
=
G
i
n
t
-
s
p
r
G
S
P
R
O
′
G
d
i
e
-
i
n
t
-
1
,
G
5
=
G
i
n
t
-
s
p
r
G
s
p
a
m
b
.
Then, (12) can be transformed into(14)
G
1
T
i
-
G
2
∑
j
=
1
n
T
j
+
G
3
P
i
+
G
4
∑
j
=
1
n
P
j
+
G
5
=
0
.
According to (14), get(15)
G
1
∑
j
=
1
n
T
j
-
n
G
2
∑
j
=
1
n
T
j
+
G
3
∑
j
=
1
n
P
j
+
n
G
4
∑
j
=
1
n
P
j
+
n
G
5
=
0
.
According to (15), get(16)
∑
j
=
1
n
T
j
=
n
G
2
-
G
1
-
1
G
3
+
n
G
4
∑
j
=
1
n
P
j
+
n
n
G
2
-
G
1
-
1
G
5
.
Substitute (16) into (14) and get(17)
T
d
i
e
,
i
=
G
1
-
1
G
2
n
G
2
-
G
1
-
1
G
3
+
n
G
4
-
G
4
∑
j
=
1
n
P
j
-
G
1
-
1
G
3
P
i
+
G
1
-
1
n
G
2
n
G
2
-
G
1
-
1
-
E
G
5
.
Set(18)
R
=
-
G
1
-
1
G
3
,
Q
=
G
1
-
1
G
2
n
G
2
-
G
1
-
1
G
3
+
n
G
4
-
G
4
,
Z
=
G
1
-
1
n
G
2
n
G
2
-
G
1
-
1
-
E
G
5
.
Get(19)
T
i
=
R
P
i
+
Q
∑
j
=
1
n
P
j
+
Z
.This means that in the steady-state of temperature of a multicore processor, given the powers of all cores, the temperature of any core can be calculated according to Lemma1 at the microarchitecture level.


## 4. Power Model

It is assumed that multicore processors have two power states, active mode and inactive mode, and the power state of each core can be set separately. And global dynamic frequency scaling (DFS) technique is used where frequencies of all cores are scaled uniformly.


### 4.1. Active Mode

When a core is in the active mode, workloads are executed and the core dissipates both dynamic power and leakage power. At the microarchitecture level, the power of the active core is defined as(20)
P
a
,
i
=
P
d
y
n
,
a
,
i
+
P
l
e
a
,
a
,
i
,where P
a
,
i, P
d
y
n
,
a
,
i, and P
l
e
a
,
a
,
i are, respectively, the total power, dynamic power, and leakage power of the ith active core of size m
×
1.For the processor using DVFS technique, the dynamic power is proportional to the product of the square of the voltage and the frequency [7]; that is, P
d
y
n
∝
v
o
l
t
a
g
e
2
×
f
r
e
q
u
e
n
c
y. In this paper, the primary purpose is to analyze the impact of workload variation on the temperatures of processors. So, in order to simplify the analyzing processes, DFS technique rather than DVFS technique is used to manage the temperatures of processor, where the voltage is constant and only frequency is adjusted. Hence, the dynamic power can be modeled as the linear function of the frequency [12, 16]. In addition, the dynamic power caused by workload execution has a close linear relationship with IPCs.LetX
a
,
i be the IPC of the ith core when workloads are running on it and let f be the normalized frequency between 0 and 1, and then the microarchitecture-level dynamic power P
d
y
n
,
a
,
i of the ith active core is defined as (21)
P
d
y
n
,
a
,
i
=
G
d
y
n
X
a
,
i
+
G
d
0
+
E
d
y
n
f
,where G
d
y
n and G
d
0 are the linear regression coefficients when f is set to maximum 1 and E
d
y
n is the regression residual which follows the normal distribution with mean of zero: namely, E
d
y
n
~
N
(
0
,
σ
E
d
2
). G
d
y
n, G
d
0, E
d
y
n, and σ
E
d are vectors of size m
×
1, and σ
E
d
2 is the element-by-element squares of σ
E
d.At the microarchitecture level, in order to simplify the analyzing procedure, the relationship between the leakage powerP
l
e
a
,
a
,
i and the temperature T
a
,
i of the ith active core is approximated by the linear model as follows: (22)
P
l
e
a
,
a
,
i
=
G
l
e
a
,
a
T
a
,
i
+
G
l
0
,
a
+
E
l
e
a
,
a
,where G
l
e
a
,
a and G
l
0
,
a are the regression coefficients and E
l
e
a
,
a is the regression residual which follows the normal distribution with mean of zero: namely, E
l
e
a
,
a
~
N
0
,
σ
E
a
2. G
l
e
a
,
a is a diagonal matrix of size m
×
m. G
l
0
,
a, E
l
e
a
,
a, μ
E
a, and σ
E
a are vectors of size m
×
1. σ
E
a
2 is the element-by-element squares of σ
E
a.According to (20), (21), and (22), the power of the active core P
a
,
i is represented by(23)
P
a
,
i
=
G
d
y
n
X
i
+
G
d
0
f
+
E
d
y
n
+
G
l
e
a
,
a
T
a
,
i
+
G
l
0
,
a
+
E
l
e
a
,
a
.


### 4.2. Inactive Mode

When a core is in the inactive mode, it is powered off using power-gating technique. The inactive core only dissipates leakage power, which is much lower than that of the active core. Hence, the power of theith inactive core P
i
n
a
,
i is the leakage power P
l
e
a
,
i
n
a
,
i, which depends on the core’s temperature T
i
n
a
,
i and it can be approximated by the linear model at the microarchitecture level as follows:(24)
P
i
n
a
,
i
=
P
l
e
a
,
i
n
a
,
i
=
G
l
e
a
,
i
n
a
T
i
n
a
,
i
+
G
l
0
,
i
n
a
+
E
l
e
a
,
i
n
a
,where G
l
e
a
,
i
n
a and G
l
0
,
i
n
a are regression coefficients and E
l
e
a
,
i
n
a is the regression residuals which follow normal distribution with mean of zero: namely, E
l
e
a
,
i
n
a
~
N
(
0
,
σ
E
i
n
a
2
). G
l
e
a
,
i
n
a is a diagonal matrix of size m
×
m. G
l
0
,
i
n
a, E
l
e
a
,
i
n
a, and σ
E
i
n
a are vectors of size m
×
1. σ
E
i
n
a
2 is the element-by-element squares of σ
E
i
n
a.


## 4.1. Active Mode

When a core is in the active mode, workloads are executed and the core dissipates both dynamic power and leakage power. At the microarchitecture level, the power of the active core is defined as(20)
P
a
,
i
=
P
d
y
n
,
a
,
i
+
P
l
e
a
,
a
,
i
,where P
a
,
i, P
d
y
n
,
a
,
i, and P
l
e
a
,
a
,
i are, respectively, the total power, dynamic power, and leakage power of the ith active core of size m
×
1.For the processor using DVFS technique, the dynamic power is proportional to the product of the square of the voltage and the frequency [7]; that is, P
d
y
n
∝
v
o
l
t
a
g
e
2
×
f
r
e
q
u
e
n
c
y. In this paper, the primary purpose is to analyze the impact of workload variation on the temperatures of processors. So, in order to simplify the analyzing processes, DFS technique rather than DVFS technique is used to manage the temperatures of processor, where the voltage is constant and only frequency is adjusted. Hence, the dynamic power can be modeled as the linear function of the frequency [12, 16]. In addition, the dynamic power caused by workload execution has a close linear relationship with IPCs.LetX
a
,
i be the IPC of the ith core when workloads are running on it and let f be the normalized frequency between 0 and 1, and then the microarchitecture-level dynamic power P
d
y
n
,
a
,
i of the ith active core is defined as (21)
P
d
y
n
,
a
,
i
=
G
d
y
n
X
a
,
i
+
G
d
0
+
E
d
y
n
f
,where G
d
y
n and G
d
0 are the linear regression coefficients when f is set to maximum 1 and E
d
y
n is the regression residual which follows the normal distribution with mean of zero: namely, E
d
y
n
~
N
(
0
,
σ
E
d
2
). G
d
y
n, G
d
0, E
d
y
n, and σ
E
d are vectors of size m
×
1, and σ
E
d
2 is the element-by-element squares of σ
E
d.At the microarchitecture level, in order to simplify the analyzing procedure, the relationship between the leakage powerP
l
e
a
,
a
,
i and the temperature T
a
,
i of the ith active core is approximated by the linear model as follows: (22)
P
l
e
a
,
a
,
i
=
G
l
e
a
,
a
T
a
,
i
+
G
l
0
,
a
+
E
l
e
a
,
a
,where G
l
e
a
,
a and G
l
0
,
a are the regression coefficients and E
l
e
a
,
a is the regression residual which follows the normal distribution with mean of zero: namely, E
l
e
a
,
a
~
N
0
,
σ
E
a
2. G
l
e
a
,
a is a diagonal matrix of size m
×
m. G
l
0
,
a, E
l
e
a
,
a, μ
E
a, and σ
E
a are vectors of size m
×
1. σ
E
a
2 is the element-by-element squares of σ
E
a.According to (20), (21), and (22), the power of the active core P
a
,
i is represented by(23)
P
a
,
i
=
G
d
y
n
X
i
+
G
d
0
f
+
E
d
y
n
+
G
l
e
a
,
a
T
a
,
i
+
G
l
0
,
a
+
E
l
e
a
,
a
.


## 4.2. Inactive Mode

When a core is in the inactive mode, it is powered off using power-gating technique. The inactive core only dissipates leakage power, which is much lower than that of the active core. Hence, the power of theith inactive core P
i
n
a
,
i is the leakage power P
l
e
a
,
i
n
a
,
i, which depends on the core’s temperature T
i
n
a
,
i and it can be approximated by the linear model at the microarchitecture level as follows:(24)
P
i
n
a
,
i
=
P
l
e
a
,
i
n
a
,
i
=
G
l
e
a
,
i
n
a
T
i
n
a
,
i
+
G
l
0
,
i
n
a
+
E
l
e
a
,
i
n
a
,where G
l
e
a
,
i
n
a and G
l
0
,
i
n
a are regression coefficients and E
l
e
a
,
i
n
a is the regression residuals which follow normal distribution with mean of zero: namely, E
l
e
a
,
i
n
a
~
N
(
0
,
σ
E
i
n
a
2
). G
l
e
a
,
i
n
a is a diagonal matrix of size m
×
m. G
l
0
,
i
n
a, E
l
e
a
,
i
n
a, and σ
E
i
n
a are vectors of size m
×
1. σ
E
i
n
a
2 is the element-by-element squares of σ
E
i
n
a.


## 5. Thermal Analysis

Lemma 2.
When the temperature of a multicore processor is in the steady-state, the temperatures and the powers of different inactive cores are same; that is,T
i
n
a
,
i
=
T
i
n
a
,
j and P
i
n
a
,
i
=
P
i
n
a
,
j for ∀
i
,
j
(
i
≠
j
), where T
i
n
a
,
i and P
i
n
a
,
i are the temperatures and the powers of the ith inactive core, respectively.Proof.
According to (3), for any inactive cores i and j, (25)
T
i
n
a
,
i
-
T
i
n
a
,
j
=
R
P
i
n
a
,
i
-
P
i
n
a
,
j
.
Substitute (24) into (25), and get(26)
T
i
n
a
,
i
-
T
i
n
a
,
j
=
R
G
l
e
a
,
i
n
a
T
i
n
a
,
i
-
T
i
n
a
,
j
.
According to (26), get(27)
E
-
R
G
l
e
a
,
i
n
a
T
i
n
a
,
i
-
T
i
n
a
,
j
=
0
.The parametersR and G
l
e
a
,
i
n
a are invertible matrices, so E
-
R
G
l
e
a
,
i
n
a is an invertible matrix. Therefore, T
i
n
a
,
i
-
T
i
n
a
,
j
=
0
; that is, T
i
n
a
,
i
=
T
i
n
a
,
j. And P
i
n
a
,
i
=
P
i
n
a
,
j can also be obtained according to (24).To be convenient, setT
i
n
a
,
i
=
T
i
n
a and P
i
n
a
,
i
=
P
i
n
a; (24) can be simplified into (28)
P
i
n
a
=
G
l
e
a
,
i
n
a
T
i
n
a
+
G
l
0
,
i
n
a
+
E
l
e
a
,
i
n
a
.Theorem 3.
Assume that all cores of a processor have the same hotspot. LetH
=
[
h
1
,
h
2
,
…
,
h
m
] be the selection vector of the hotspot, where only one element of H can be set to 1 and the others are 0 s, indicating that the corresponding functional unit is hotspot. There exist functions ψ
1
(
H
,
n
,
n
a
,
f
), ψ
2
(
H
,
n
,
n
a
,
f
), ψ
3
(
H
,
n
,
n
a
,
f
), ψ
4
(
H
,
n
,
n
a
,
f
), ψ
5
(
H
,
n
,
n
a
,
f
), and ψ
6
(
H
,
n
,
n
a
,
f
), such that the hotspot T
h
o
t
,
a
,
i of the ith active core can be formulated by(29)
T
hot
,
a
,
i
=
ψ
1
H
,
n
,
n
a
,
f
X
a
,
i
+
ψ
2
H
,
n
,
n
a
,
f
∑
k
=
1
n
a
X
a
,
k
+
ψ
3
H
,
n
,
n
a
,
f
E
d
y
n
+
ψ
4
H
,
n
,
n
a
,
f
E
l
e
a
,
a
+
ψ
5
H
,
n
,
n
a
,
f
E
l
e
a
,
i
n
a
+
ψ
6
H
,
n
,
n
a
,
f
.
There exist functionsξ
1
(
H
,
n
,
n
a
,
f
), ξ
2
(
H
,
n
,
n
a
,
f
), ξ
3
(
H
,
n
,
n
a
,
f
), ξ
4
(
H
,
n
,
n
a
,
f
), and ξ
5
(
H
,
n
,
n
a
,
f
), such that the hotspot T
h
o
t
,
i
n
a of the inactive core can be formulated by (30)
T
h
o
t
,
s
=
ξ
1
H
,
n
,
n
a
,
f
∑
k
=
1
n
a
X
a
,
k
+
ξ
2
H
,
n
,
n
a
,
f
E
d
y
n
+
ξ
3
H
,
n
,
n
a
,
f
E
l
e
a
,
a
+
ξ
4
H
,
n
,
n
a
,
f
E
l
e
a
,
i
n
a
+
ξ
5
H
,
n
,
n
a
,
f
.Proof.
According to (3), (23), and (28), the temperature of the inactive core T
i
n
a can be derived as (31)
T
i
n
a
=
E
-
R
+
n
-
n
a
Q
G
l
e
a
,
i
n
a
-
1
Q
G
l
e
a
,
a
∑
k
=
1
n
a
T
a
,
k
+
f
E
-
R
+
n
-
n
a
Q
G
l
e
a
,
i
n
a
-
1
Q
G
d
y
n
∑
k
=
1
n
a
X
a
,
k
+
f
n
a
E
-
R
+
n
-
n
a
Q
G
l
e
a
,
i
n
a
-
1
Q
E
d
y
n
+
n
a
E
-
R
+
n
-
n
a
Q
G
l
e
a
,
i
n
a
-
1
Q
E
l
e
a
,
a
+
E
-
R
+
n
-
n
a
Q
G
l
e
a
,
i
n
a
-
1
R
+
n
-
n
a
Q
E
l
e
a
,
i
n
a
+
E
-
R
+
n
-
n
a
Q
G
l
e
a
,
i
n
a
-
1
R
+
n
-
n
a
Q
G
l
0
,
i
n
a
+
f
n
a
Q
G
d
0
+
n
a
Q
G
l
0
,
a
+
Z
.
Let(32)
Φ
1
n
,
n
a
,
f
=
R
+
n
-
n
a
Q
G
l
0
,
i
n
a
+
f
n
a
Q
G
d
0
+
n
a
Q
G
l
0
,
a
+
Z
,
Φ
2
n
,
n
a
=
E
-
R
+
n
-
n
a
Q
G
l
e
a
,
i
n
a
-
1
.
Then, (31) can be transformed into(33)
T
i
n
a
=
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
∑
k
=
1
n
a
T
a
,
k
+
f
Φ
2
n
,
n
a
Q
G
d
y
n
∑
k
=
1
n
a
X
a
,
k
+
f
n
a
Φ
2
n
,
n
a
Q
E
d
y
n
+
n
a
Φ
2
n
,
n
a
Q
E
l
e
a
,
a
+
Φ
2
n
,
n
a
R
+
n
-
n
a
Q
E
l
e
a
,
i
n
a
+
Φ
2
n
,
n
a
Φ
1
n
,
n
a
,
f
.
According to (3), (23), and (28), the temperature of the ith active core T
a
,
i can be derived as(34)
T
a
,
i
=
E
-
R
G
l
e
a
,
a
-
1
Q
G
l
e
a
,
a
∑
k
=
1
n
a
T
a
,
k
+
f
E
-
R
G
l
e
a
,
a
-
1
Q
G
d
y
n
∑
k
=
1
n
a
X
a
,
k
+
f
E
-
R
G
l
e
a
,
a
-
1
R
G
d
y
n
X
a
,
i
+
n
-
n
a
E
-
R
G
l
e
a
,
a
-
1
Q
G
l
e
a
,
i
n
a
T
i
n
a
+
f
E
-
R
G
l
e
a
,
a
-
1
R
+
n
a
Q
E
d
y
n
+
E
-
R
G
l
e
a
,
a
-
1
R
+
n
a
Q
E
l
e
a
,
a
+
n
-
n
a
E
-
R
G
l
e
a
,
a
-
1
Q
E
l
e
a
,
i
n
a
+
E
-
R
G
l
e
a
,
a
-
1
f
R
G
d
0
+
n
a
f
Q
G
d
0
+
R
G
l
0
,
a
+
n
a
Q
G
l
0
,
a
+
n
-
n
a
Q
G
l
0
,
i
n
a
+
Z
.
Let(35)
Φ
3
n
,
n
a
,
f
=
f
R
G
d
0
+
n
a
f
Q
G
d
0
+
R
G
l
0
,
a
+
n
a
Q
G
l
0
,
a
+
n
-
n
a
Q
G
l
0
,
i
n
a
+
Z
,
Φ
4
=
E
-
R
G
l
e
a
,
a
-
1
.
Then, (34) can be transformed into(36)
T
a
,
i
=
Φ
4
Q
G
l
e
a
,
a
∑
k
=
1
n
a
T
a
,
k
+
f
Φ
4
Q
G
d
y
n
∑
k
=
1
n
a
X
a
,
k
+
f
Φ
4
R
G
d
y
n
X
a
,
i
+
n
-
n
a
Φ
4
Q
G
l
e
a
,
i
n
a
T
i
n
a
+
f
Φ
4
R
+
n
a
Q
E
d
y
n
+
Φ
4
R
+
n
a
Q
E
l
e
a
,
a
+
n
-
n
a
Φ
4
Q
E
l
e
a
,
i
n
a
+
Φ
4
Φ
3
n
,
n
a
,
f
.
Substitute (33) into (36), and get(37)
T
a
,
i
=
Φ
4
Q
G
l
e
a
,
a
+
n
-
n
a
Φ
4
Q
G
l
e
a
,
i
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
∑
k
=
1
n
a
T
a
,
k
+
f
Φ
4
Q
G
d
y
n
+
n
-
n
a
Φ
4
Q
G
l
e
a
,
i
n
a
Φ
2
n
,
n
a
Q
G
d
y
n
∑
k
=
1
n
a
X
a
,
k
+
f
Φ
4
R
G
d
y
n
X
a
,
i
+
f
Φ
4
R
+
n
a
Q
+
n
a
n
-
n
a
Φ
4
Q
G
l
e
a
,
i
n
a
Φ
2
n
,
n
a
Q
E
d
y
n
+
Φ
4
R
+
n
a
Q
+
n
a
n
-
n
a
Φ
4
Q
G
l
e
a
,
i
n
a
Φ
2
n
,
n
a
Q
E
l
e
a
,
a
+
n
-
n
a
Φ
4
Q
+
n
-
n
a
Φ
4
Q
G
l
e
a
,
i
n
a
Φ
2
n
,
n
a
R
+
n
-
n
a
Q
E
l
e
a
,
i
n
a
+
n
-
n
a
Φ
4
Q
G
l
e
a
,
i
n
a
Φ
2
n
,
n
a
Φ
1
n
,
n
a
,
f
+
Φ
4
Φ
3
n
,
n
a
,
f
.
Let(38)
Φ
5
n
,
n
a
=
Φ
4
Q
G
l
e
a
,
a
+
n
-
n
a
Φ
4
Q
G
l
e
a
,
i
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
,
Φ
6
n
,
n
a
,
f
=
f
Φ
4
Q
G
d
y
n
+
n
-
n
a
Φ
4
Q
G
l
e
a
,
i
n
a
Φ
2
n
,
n
a
Q
G
d
y
n
Φ
7
f
=
f
Φ
4
R
G
d
y
n
,
Φ
7
f
=
f
Φ
4
R
G
d
y
n
,
Φ
8
n
,
n
a
,
f
=
f
Φ
4
R
+
n
a
Q
+
n
a
n
-
n
a
Φ
4
Q
G
l
e
a
,
i
n
a
Φ
2
n
,
n
a
Q
,
Φ
9
n
,
n
a
=
Φ
4
R
+
n
a
Q
+
n
a
n
-
n
a
Φ
4
Q
G
l
e
a
,
i
n
a
Φ
2
n
,
n
a
Q
,
Φ
10
n
,
n
a
=
n
-
n
a
Φ
4
Q
+
n
-
n
a
Φ
4
Q
G
l
e
a
,
i
n
a
Φ
2
n
,
n
a
R
+
n
-
n
a
Q
,
Φ
11
n
,
n
a
,
f
=
n
-
n
a
Φ
4
Q
G
l
e
a
,
i
n
a
Φ
2
n
,
n
a
Φ
1
n
,
n
a
,
f
+
Φ
4
Φ
3
n
,
n
a
,
f
.
Then, (37) is transformed into (39)
T
a
,
i
=
Φ
5
n
,
n
a
∑
k
=
1
n
a
T
a
,
k
+
Φ
6
n
,
n
a
,
f
∑
k
=
1
n
a
X
a
,
k
+
Φ
7
f
X
a
,
i
+
Φ
8
n
,
n
a
,
f
E
d
y
n
+
Φ
9
n
,
n
a
E
l
e
a
,
a
+
Φ
10
n
,
n
a
E
l
e
a
,
i
n
a
+
Φ
11
n
,
n
a
,
f
.
According to (39), get(40)
∑
k
=
1
n
a
T
a
,
k
=
E
-
n
a
Φ
5
n
,
n
a
-
1
n
a
Φ
6
n
,
n
a
,
f
+
Φ
7
f
∑
k
=
1
n
a
X
a
,
k
+
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
8
n
,
n
a
,
f
E
d
y
n
+
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
9
n
,
n
a
E
l
e
a
,
a
+
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
10
n
,
n
a
E
l
e
a
,
i
n
a
+
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
11
n
,
n
a
,
f
.
Substitute (40) into (39), and get(41)
T
a
,
i
=
Φ
7
f
X
a
,
i
+
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
n
a
Φ
6
n
,
n
a
,
f
+
Φ
7
f
+
Φ
6
n
,
n
a
,
f
∑
k
=
1
n
a
X
a
,
k
+
n
a
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
8
n
,
n
a
,
f
+
Φ
8
n
,
n
a
,
f
E
d
y
n
+
n
a
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
9
n
,
n
a
+
Φ
9
n
,
n
a
E
l
e
a
,
a
+
n
a
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
10
n
,
n
a
+
Φ
10
n
,
n
a
E
l
e
a
,
i
n
a
+
n
a
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
11
n
,
n
a
,
f
+
Φ
11
n
,
n
a
,
f
.
The hotspot temperatureT
h
o
t
,
a
,
i of the active core can be given by (42)
T
h
o
t
,
a
,
i
=
H
T
a
,
i
=
H
Φ
7
f
X
a
,
i
+
H
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
n
a
Φ
6
n
,
n
a
,
f
+
Φ
7
f
+
Φ
6
n
,
n
a
,
f
∑
k
=
1
n
a
X
a
,
k
+
H
n
a
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
8
n
,
n
a
,
f
+
Φ
8
n
,
n
a
,
f
E
d
y
n
+
H
n
a
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
9
n
,
n
a
+
Φ
9
n
,
n
a
E
l
e
a
,
a
+
H
n
a
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
10
n
,
n
a
+
Φ
10
n
,
n
a
E
l
e
a
,
i
n
a
+
H
n
a
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
11
n
,
n
a
,
f
+
Φ
11
n
,
n
a
,
f
.
Let(43)
ψ
1
H
,
f
=
H
Φ
7
f
,
ψ
2
H
,
n
,
n
a
,
f
=
H
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
n
a
Φ
6
n
,
n
a
,
f
+
Φ
7
f
+
Φ
6
n
,
n
a
,
f
,
ψ
3
H
,
n
,
n
a
,
f
=
H
n
a
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
8
n
,
n
a
,
f
+
Φ
8
n
,
n
a
,
f
,
ψ
4
H
,
n
,
n
a
=
H
n
a
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
9
n
,
n
a
+
Φ
9
n
,
n
a
,
ψ
5
H
,
n
,
n
a
,
f
=
H
n
a
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
10
n
,
n
a
+
Φ
10
n
,
n
a
,
ψ
6
H
,
n
,
n
a
,
f
=
H
n
a
Φ
5
n
,
n
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
11
n
,
n
a
,
f
+
Φ
11
n
,
n
a
,
f
.
Then, (42) is transformed into(44)
T
h
o
t
,
a
,
i
=
ψ
1
H
,
f
X
a
,
i
+
ψ
2
H
,
n
,
n
a
,
f
∑
k
=
1
n
a
X
a
,
k
+
ψ
3
H
,
n
,
n
a
,
f
E
d
y
n
+
ψ
4
H
,
n
,
n
a
E
l
e
a
,
a
+
ψ
5
H
,
n
,
n
a
,
f
E
l
e
a
,
i
n
a
+
ψ
6
H
,
n
,
n
a
,
f
.
Substitute (40) into (33), and get(45)
T
i
n
a
=
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
n
a
Φ
6
n
,
n
a
,
f
+
Φ
7
f
+
f
Φ
2
n
,
n
a
Q
G
d
y
n
∑
k
=
1
n
a
X
a
,
k
+
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
8
n
,
n
a
,
f
+
f
n
a
Φ
2
n
,
n
a
Q
E
d
y
n
+
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
9
n
,
n
a
+
n
a
Φ
2
n
,
n
a
Q
E
l
e
a
,
a
+
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
10
n
,
n
a
+
Φ
2
n
,
n
a
R
+
n
-
n
a
Q
E
l
e
a
,
i
n
a
+
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
11
n
,
n
a
,
f
+
Φ
2
n
,
n
a
Φ
1
n
,
n
a
,
f
.
The hotspot temperatureT
h
o
t
,
i
n
a of the inactive core is given by (46)
T
h
o
t
,
i
n
a
=
H
T
i
n
a
=
H
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
n
a
Φ
6
n
,
n
a
,
f
+
Φ
7
f
+
f
Φ
2
n
,
n
a
Q
G
d
y
n
∑
k
=
1
n
a
X
a
,
k
+
H
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
8
n
,
n
a
,
f
+
f
n
a
Φ
2
n
,
n
a
Q
E
d
y
n
+
H
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
9
n
,
n
a
+
n
a
Φ
2
n
,
n
a
Q
E
l
e
a
,
a
+
H
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
10
n
,
n
a
+
Φ
2
n
,
n
a
R
+
n
-
n
a
Q
E
l
e
a
,
i
n
a
+
H
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
11
n
,
n
a
,
f
+
Φ
2
n
,
n
a
Φ
1
n
,
n
a
,
f
.
Let(47)
ξ
1
H
,
n
,
n
a
,
f
=
H
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
n
a
Φ
6
n
,
n
a
,
f
+
Φ
7
f
+
f
Φ
2
n
,
n
a
Q
G
d
y
n
,
ξ
2
H
,
n
,
n
a
,
f
=
H
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
8
n
,
n
a
,
f
+
f
n
a
Φ
2
n
,
n
a
Q
,
ξ
3
H
,
n
,
n
a
=
H
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
9
n
,
n
a
+
n
a
Φ
2
n
,
n
a
Q
,
ξ
4
H
,
n
,
n
a
,
f
=
H
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
10
n
,
n
a
+
Φ
2
n
,
n
a
R
+
n
-
n
a
Q
,
ξ
5
H
,
n
,
n
a
,
f
=
H
n
a
Φ
2
n
,
n
a
Q
G
l
e
a
,
a
E
-
n
a
Φ
5
n
,
n
a
-
1
Φ
11
n
,
n
a
,
f
+
Φ
2
n
,
n
a
Φ
1
n
,
n
a
,
f
.
Then, (46) is transformed into (48)
T
h
o
t
,
s
=
ξ
1
H
,
n
,
n
a
,
f
∑
k
=
1
n
a
X
a
,
k
+
ξ
2
H
,
n
,
n
a
,
f
E
d
y
n
+
ξ
3
H
,
n
,
n
a
,
f
E
l
e
a
,
a
+
ξ
4
H
,
n
,
n
a
,
f
E
l
e
a
,
i
n
a
+
ξ
5
H
,
n
,
n
a
,
f
.According to Theorem3, it can be known that the hotspot temperature of any core can be expressed as the linear function of IPCs of all cores.Theorem 4.
Suppose that (a) the random variableX
a
,
i for the IPC follows normal distribution with the mean μ
X and the variance σ
X
2, that is, X
a
,
i
~
N
(
μ
X
,
σ
X
2
); (b) the tasks running on different cores are mutually independent; that is, X
a
,
i and X
a
,
j are independent for 1
≤
∀
i
,
j
≤
m; and (c) workload balancing techniques are used in the processor, such that X
a
,
i and X
a
,
j follow the same normal distribution. Then there exist functions μ
T
,
a
(
H
,
n
,
n
a
,
f
) and σ
T
,
a
2
(
H
,
n
,
n
a
,
f
), such that the hotspot temperature T
h
o
t
,
a
,
i of the active core follows the normal distribution with mean μ
T
,
a
(
H
,
n
,
n
a
,
f
) and variance σ
T
,
a
2
(
H
,
n
,
n
a
,
f
); that is, (49)
T
h
o
t
,
a
,
i
~
N
μ
T
,
a
H
,
n
,
n
a
,
f
,
σ
T
,
a
2
H
,
n
,
n
a
,
f
.There exist functions μ
T
,
i
n
a
(
H
,
n
,
n
a
,
f
) and σ
T
,
i
n
a
2
(
H
,
n
,
n
a
,
f
), such that the hotspot temperature T
h
o
t
,
i
n
a of the inactive core follows the normal distribution with mean μ
T
,
i
n
a
(
H
,
n
,
n
a
,
f
) and variance σ
T
,
i
n
a
2
(
H
,
n
,
n
a
,
f
); that is, (50)
T
h
o
t
,
i
n
a
~
N
μ
T
,
i
n
a
H
,
n
,
n
a
,
f
,
σ
T
,
i
n
a
2
H
,
n
,
n
a
,
f
.Proof.
According to (29), get(51)
T
h
o
t
,
a
,
i
=
ψ
1
H
,
n
,
n
a
,
f
+
ψ
2
H
,
n
,
n
a
,
f
X
a
,
i
+
ψ
2
H
,
n
,
n
a
,
f
∑
k
=
1
k
≠
i
n
a
X
a
,
k
+
ψ
3
H
,
n
,
n
a
,
f
E
d
y
n
+
ψ
4
H
,
n
,
n
a
,
f
E
l
e
a
,
a
+
ψ
5
H
,
n
,
n
a
,
f
E
l
e
a
,
i
n
a
+
ψ
6
H
,
n
,
n
a
,
f
.
The norm-distributed random variablesX
a
,
i and X
a
,
j are independent in the case of 1
≤
∀
i
,
j
≤
m, so that the linear combination (
ψ
1
(
H
,
n
,
n
a
,
f
)
+
ψ
2
(
H
,
n
,
n
a
,
f
)
)
X
a
,
i
+
ψ
2
(
H
,
n
,
n
a
,
f
)
∑
k
=
1
,
k
≠
i
n
a
X
a
,
k of X
a
,
i still follows the normal distribution.
All elementsE
d
y
n
,
k in the random vector E
d
y
n follow normal distribution and are independent, so that the linear combination ψ
3
(
H
,
n
,
n
a
,
f
)
E
d
y
n of all elements in E
d
y
n follows normal distribution. In the same way, ψ
4
(
H
,
n
,
n
a
,
f
)
E
l
e
a
,
a and ψ
5
(
H
,
n
,
n
a
,
f
)
E
l
e
a
,
i
n
a also follow normal distribution.
ψ
1
H
,
n
,
n
a
,
f
+
ψ
2
H
,
n
,
n
a
,
f
X
a
,
i, ψ
2
H
,
n
,
n
a
,
f
∑
k
=
1
,
k
≠
i
n
a
X
a
,
k, ψ
3
(
H
,
n
,
n
a
,
f
)
E
d
y
n, ψ
4
H
,
n
,
n
a
,
f
E
l
e
a
,
a, and ψ
5
H
,
n
,
n
a
,
f
E
l
e
a
,
i
n
a all follow normal distribution and are mutually independent, so that T
h
o
t
,
a
,
i follows normal distribution, where the mean μ
T
,
i
n
a
(
H
,
n
,
n
a
,
f
) is calculated by (52)
μ
T
,
a
H
,
n
,
n
a
,
f
=
ψ
1
H
,
f
+
n
a
ψ
2
H
,
n
,
n
a
,
f
μ
X
+
ψ
3
H
,
n
,
n
a
,
f
μ
E
d
+
ψ
4
H
,
n
,
n
a
μ
E
a
+
ψ
5
H
,
n
,
n
a
,
f
μ
E
i
n
a
+
ψ
6
H
,
n
,
n
a
,
fand the variance σ
T
,
i
n
a
2
(
H
,
n
,
n
a
,
f
) is calculated by(53)
σ
T
,
a
2
H
,
n
,
n
a
,
f
=
ψ
1
H
,
f
+
ψ
2
H
,
n
,
n
a
,
f
2
σ
X
2
+
n
a
-
1
ψ
2
2
H
,
n
,
n
a
,
f
σ
X
2
+
ψ
3
2
H
,
n
,
n
a
,
f
σ
E
d
2
+
ψ
4
2
H
,
n
,
n
a
σ
E
a
2
+
ψ
5
2
H
,
n
,
n
a
,
f
σ
E
i
n
a
2
.
In the same way,ξ
1
(
H
,
n
,
n
a
,
f
)
∑
k
=
1
n
a
X
a
,
k, ξ
2
(
H
,
n
,
n
a
,
f
)
E
d
y
n, ξ
3
(
H
,
n
,
n
a
,
f
)
E
l
e
a
,
a, and ξ
4
(
H
,
n
,
n
a
,
f
)
E
l
e
a
,
i
n
a in (30) all follow the normal distribution and are mutually independent, so that T
h
o
t
,
s follows the normal distribution, where the mean μ
T
,
s
(
H
,
n
,
n
a
,
f
) is calculated by (54)
μ
T
,
s
H
,
n
,
n
a
,
f
=
n
a
ξ
1
H
,
n
,
n
a
,
f
μ
X
+
ξ
2
H
,
n
,
n
a
,
f
μ
E
d
+
ξ
3
H
,
n
,
n
a
μ
E
a
+
ξ
4
H
,
n
,
n
a
,
f
μ
E
i
n
a
+
ξ
5
H
,
n
,
n
a
,
fand the variation σ
T
,
s
2
(
H
,
n
,
n
a
,
f
) is calculated by(55)
σ
T
,
s
2
H
,
n
,
n
a
,
f
=
n
a
ξ
1
2
H
,
n
,
n
a
,
f
σ
X
2
+
ξ
2
2
H
,
n
,
n
a
,
f
σ
E
d
2
+
ξ
3
2
H
,
n
,
n
a
σ
E
a
2
+
ξ
4
2
H
,
n
,
n
a
,
f
σ
E
i
n
a
2
.According to Theorem4, it can be known that the hotspot temperature of any core follows the normal probabilistic distribution.


## 6. Frequency Analysis

The zero-slack policy is used as the DTM strategy of processors, that is, the speed of processor is set to a value which makes the temperature of the hotspot be the threshold [7]. However, the frequencies are discrete in this work. Therefore, in most cases, there is no frequency in the set of frequencies making the hotspot temperature be the threshold exactly.Theorem 5.
LetF
S
e
t
=
{
f
1
,
…
,
f
π
,
f
π
+
1
,
…
,
f
f
c
o
u
n
t
} be the set of frequencies of multicore processors, where f
1
<
⋯
<
f
π
<
f
π
+
1
<
⋯
<
f
f
c
o
u
n
t; then the probabilistic distribution of the frequencyf follows (56)
P
f
=
f
π
=
P
T
h
o
t
,
a
n
a
,
f
π
<
T
v
a
l
v
e
,
f
π
=
f
c
o
u
n
t
P
T
h
o
t
,
a
n
a
,
f
π
≤
T
v
a
l
v
e
-
P
T
h
o
t
,
a
n
a
,
f
π
+
1
≤
T
v
a
l
v
e
,
f
π
<
f
c
o
u
n
t
,where T
h
o
t
,
a
(
n
a
,
f
π
) is the function of the number of active cores n
a and the frequency f
π, representing the hotspot temperature of the active core, and T
v
a
l
v
e is the temperature threshold of the processor.Proof.
Whenf
π
=
f
c
o
u
n
t, according to the zero-slack DTM policy, obviously, (57)
P
f
=
f
π
=
P
T
h
o
t
,
a
n
a
,
f
π
≤
T
v
a
l
v
e
.
Whenf
π
<
f
c
o
u
n
t, then the probabilities of f
=
f
π can be broken into two cases:(a)
ifT
h
o
t
,
a
(
n
a
,
f
π
)
>
T
h
o
t
,
a
(
n
a
,
f
π
+
1
), according to the zero-slack DTM strategy, the probability of f
=
f
π is 0; that is, (58)
P
f
=
f
π
∣
T
h
o
t
,
a
n
a
,
f
π
>
T
h
o
t
,
a
n
a
,
f
π
+
1
=
0
;
(b)
ifT
h
o
t
,
a
(
n
a
,
f
π
)
≤
T
h
o
t
,
a
(
n
a
,
f
π
+
1
), the probability of f
=
f
π is given by(59)
P
f
=
f
π
∣
T
h
o
t
,
a
n
a
,
f
π
≤
T
h
o
t
,
a
n
a
,
f
π
+
1
=
P
T
h
o
t
,
a
n
a
,
f
π
≤
T
v
a
l
v
e
,
T
h
o
t
,
a
n
a
,
f
π
+
1
>
T
v
a
l
v
e
∣
T
h
o
t
,
a
n
a
,
f
π
≤
T
h
o
t
,
a
n
a
,
f
π
+
1
.
The right-hand side of (59) can be derived by(60)
P
T
h
o
t
,
a
n
a
,
f
π
≤
T
v
a
l
v
e
,
T
h
o
t
,
a
n
a
,
f
π
+
1
>
T
v
a
l
v
e
∣
T
h
o
t
,
a
n
a
,
f
π
≤
T
h
o
t
,
a
n
a
,
f
π
+
1
=
P
T
h
o
t
,
a
n
a
,
f
π
≤
T
v
a
l
v
e
-
P
T
h
o
t
,
a
n
a
,
f
π
≤
T
v
a
l
v
e
,
T
h
o
t
,
a
n
a
,
f
π
+
1
≤
T
v
a
l
v
e
∣
T
h
o
t
,
a
n
a
,
f
π
≤
T
h
o
t
,
a
n
a
,
f
π
+
1
,
P
T
h
o
t
,
a
n
a
,
f
π
≤
T
v
a
l
v
e
,
T
h
o
t
,
a
n
a
,
f
π
+
1
≤
T
v
a
l
v
e
∣
T
h
o
t
,
a
n
a
,
f
π
≤
T
h
o
t
,
a
n
a
,
f
π
+
1
=
P
T
h
o
t
,
a
n
a
,
f
π
+
1
≤
T
v
a
l
v
e
.
According to (59) and (60), get(61)
P
f
=
f
π
T
h
o
t
,
a
n
a
,
f
π
≤
T
h
o
t
,
a
n
a
,
f
π
+
1
=
P
T
h
o
t
,
a
n
a
,
f
π
≤
T
v
a
l
v
e
-
P
T
h
o
t
,
a
n
a
,
f
π
+
1
≤
T
v
a
l
v
e
.
Hence, whenf
π
<
f
c
o
u
n
t, according to (58) and (61), get(62)
P
f
=
f
π
=
P
T
h
o
t
,
a
n
a
,
f
π
≤
T
v
a
l
v
e
-
P
T
h
o
t
,
a
n
a
,
f
π
+
1
≤
T
v
a
l
v
e
.Therefore, according to Theorem5 the probabilistic distribution of the set of frequencies can be obtained based on the assumption that the zero-slack policy is used.Given the probabilistic distribution of the frequency and the mean of hotspot temperature of the active core for a certain frequency, the average hotspot temperature of the active coreT
h
o
t
,
a
a
v
e
r can be obtained by (63)
T
h
o
t
,
a
a
v
e
r
=
∑
f
∈
F
S
e
t
μ
T
,
a
H
,
n
,
n
a
,
f
·
P
f
,where F
S
e
t
=
{
f
1
,
…
,
f
π
,
f
π
+
1
,
…
,
f
f
c
o
u
n
t
} denotes the set of frequencies of multicore processors and P
(
f
) denotes the probability that the frequency is f; μ
T
,
a
(
H
,
n
,
n
a
,
f
) denotes the mean of hotspot temperature of the active core given the frequency f.


## 7. Experimental Results

### 7.1. Experimental Methodology

A multicore version of Alpha 21264 processor is used as the processor model in our experiment [24], and there are eight cores in the processor. The cores have two working states, active state and inactive state, and the working state of each core can be set separately. The processor employs a global DFS technique, which means that frequencies of all cores in the processor are scaled uniformly. There are four discrete frequencies used by the processor, that is, 1.5 GHz, 2 GHz, 2.5 GHz, and 3 GHz. To facilitate analysis, the frequencies are normalized into the interval [
0,1
], so that the maximum frequency is normalized to 1. After normalization, the set of frequencies is {
0.5
,
0.67
,
0.83
,
1
}. According to our previous work, the hotspot of Alpha 21264 processor is the branch predictor [18]. So the second element of the hotspot selection vector H, corresponding to the branch predictor, is set to 1, and the other elements are set to 0 s. The thermal threshold, that is, the maximum temperature allowed by processor, is set to 100°C.The HotSpot is used as the thermal model of the multicore processor, and the parameters such as thermal conductance and capacitance are set to default values of HotSpot simulation tool [3]. In order to construct the linear model of dynamic power, PTScalar is modified to obtain both the dynamic power profiles of each functional unit in Alpha 21264 processor and the IPC profiles [25]. The parameters of PTScalar are set to default values as well. The mean μ
X and variance σ
X
2 of norm-distributed X
a
,
i are determined using IPC profiles based on the maximum likelihood estimation. Some representative tasks such as mesa, ammp, quake, bzip, mcf, math, and qsort from MiBench [26] and SPEC CPU2000 [27] are selected as the benchmarks. These selected tasks are mutually independent; that is, no task takes precedence over the others, so the tasks can be parallel executed at the task level. In addition, workload balancing techniques are used in the processor. A task is not fixed on a core, and the tasks can be migrated among all cores such that the IPCs of different cores are equal. The simple linear regression analysis is used to determine the coefficients G
d
y
n and G
d
0 in (21), and the variance σ
E
d
2 of regression residuals E
d
y
n is obtained.The leakage power is the nonlinear monotonic increasing function of temperature, which is given by [25](64)
P
l
=
α
·
T
2
·
e
γ
/
T
+
β
,where α, β, and γ are parameters which depend on topology, size, technology, and design of processors. In order to construct the linear model of leakage power, (64) is regressed linearly to determine the coefficients G
l
e
a
,
a and G
l
0
,
a in (22) and the coefficients G
l
e
a
,
i
n
a and G
l
0
,
i
n
a in (24), as well as the variance σ
E
a
2 and σ
E
i
n
a
2 of regression residuals E
l
e
a
,
a and E
l
e
a
,
i
n
a. The parameters α, β, and γ are set to the default values of PTScalar. The smaller the range of temperature, the higher the linear correlation between leakage power and temperature [7]. The temperature of a processor using DTM techniques does not exceed the maximum value, and the lower temperature has no impact on the design optimization of thermal-aware processors. Therefore, the linear regression analysis of leakage powers is performed at the temperature interval between 60°C and 100°C, and the regression results are used to estimate the leakage power at the whole temperature interval.


### 7.2. Estimated Accuracy

For the hotspot of the processor, that is, the branch predictor, Figure3 shows the comparison between the actual value and the estimated value of leakage power for active cores, and Figure 4 shows that for inactive cores. A higher estimation accuracy of leakage power is obtained at the temperature interval between 60°C and 100°C at the cost of lower accuracy at the other intervals.Figure 3
Leakage power estimation of hotspot for active cores.Figure 4
Leakage power estimation of hotspot for inactive cores.After regression analysis, the dynamic and leakage power can be estimated with the linear model in (21), (22), and (24). Figure 5 shows the estimation error rate of the dynamic power and that of the leakage power for active cores and inactive cores in thermal range between 60°C and 100°C. It can be seen that the error rates of the dynamic powers for different functional units have significant variations. For the decoder, the estimation error rate of dynamic power is only 2.62% but 10.14% for the floating point register (FPReg). The reason for this fact is that the linear correlations between the IPC and the dynamic powers for various functional units are different. Lower error rate results from higher correlation. Obviously, the IPC and the dynamic power of the decoder have the highest linear correlation, while the IPC and that of FPReg have the lowest linear correlation. It can also be seen from Figure 5 that the estimation error rates of leakage power for both active cores and inactive cores are similar. The estimation error rates of leakage power for active cores are between 3.15% and 3.26%, and those for inactive cores are between 3.06% and 5.91%. This is because the temperature and the leakage power of various functional units have similar linear correlations. In order to consider the impact of estimation errors on the analysis of temperature and frequency, the error terms E
d
y
n, E
l
e
a
,
a, and E
l
e
a
,
i
n
a are introduced into the linear models of dynamic power and leakage power as expressed in (21), (22), and (24).Figure 5
Error rate of the power estimation.


### 7.3. Probabilistic Distribution of Temperature

Based on the assumption that no DTM techniques are used to control the temperature of processors, according to Theorem4, the probabilistic distribution of the hotspot temperatures for both active cores and inactive cores can be obtained. Table 1 presents the means and the standard deviations of the probabilistic distribution of the hotspot temperature for active cores, and the corresponding probabilistic density curves are as shown in Figure 6. It can be seen that the hotspot temperature of processors is not deterministic and has significant variations for a certain number of active cores and a certain frequency. The number of active cores and the running frequency simultaneously determine the range in which the temperature lies and the probabilistic distribution of the hotspot temperature. For the same running frequency, more active cores will yield higher temperature, and vice versa. For the same number of active cores, higher frequency will bring higher temperature, and vice versa. According to the characteristics of normal distribution curve, it can be known that the shape of probabilistic density curve corresponds to the variations of data distribution depending on the standard deviation of random variables. The curve with a higher peak implies a smaller standard deviation, that is, a lower variation of data distribution, whereas the curve with a lower peak implies a bigger standard deviation, that is, a larger variation; it can be seen from Figure 6 that the probabilistic density curves corresponding to various frequencies have different peaks. This observation implies that the degree of temperature variation has close correlation with working frequency, and higher frequency will yield higher variation of temperature.Table 1
Means (μ) and standard deviations (σ) of hotspot temperature distribution for active cores.
Number of active cores
Frequency of 0.5
Frequency of 0.67
Frequency of 0.83
Frequency of 1
μ (°C)
σ
μ (°C)
σ
μ (°C)
σ
μ (°C)
σ
6
51.93
4.03
61.25
5.40
70.02
6.69
79.35
8.06
7
59.20
4.25
69.73
5.69
79.64
7.05
90.17
8.50
8
66.69
4.48
78.46
6.00
89.54
7.43
101.31
8.95Figure 6
The probability density of the hotspot temperature for active cores. (a) The number of active cores is six. (b) The number of active cores is seven. (c) The number of active cores is eight.
(a)
(b)
(c)Table2 presents the means and standard deviations of the probabilistic distribution of the hotspot temperature for inactive cores, and the corresponding probabilistic density curves are as shown in Figure 7. When the number of active cores is eight, inactive core does not exist, so there is no case where the number of active cores is eight in Table 2 and Figure 7. The effect of the frequency and the number of active cores at the hotspot temperature for inactive cores is the same as that for active cores, except that the mean value and variation of hotspot temperature of inactive cores are lower than those of active cores under the same frequency and the number of active cores.Table 2
Means (μ) and standard deviations (σ) of hotspot temperature distribution for inactive cores.
Number of active cores
Frequency of 0.5
Frequency of 0.67
Frequency of 0.83
Frequency of 1
μ (°C)
σ
μ (°C)
σ
μ (°C)
σ
μ (°C)
σ
6
40.59
1.71
47.08
2.29
53.19
2.84
59.68
3.42
7
47.78
1.95
55.46
2.61
62.69
3.23
70.37
3.89Figure 7
The probability density of the hotspot temperature for inactive cores. (a) The number of active cores is six. (b) The number of active cores is seven.
(a)
(b)


### 7.4. Probabilistic Distribution of Frequencies

If the power-gating and the DFS techniques are simultaneously used to manage the temperature of a processor, according to Theorem5, the probabilistic distribution of working frequencies can be determined. Figure 8 presents the probabilistic distribution of frequencies when the number of active cores is six, seven, and eight, respectively. When the frequency is less than 1, it is implied that the hotspot temperature surpasses the threshold, and the DFS technique is triggered to reduce the frequency of the processor. So the probability for triggering DFS can be obtained from the probabilistic distribution of frequencies. Figure 9 presents the probability for triggering DFS when the number of active cores is six, seven, and eight, respectively.Figure 8
Probabilistic distribution of frequencies.Figure 9
Probability for triggering DFS.If a core is powered off and made inactive using the power-gating technique, it only dissipates the leakage power which is much less than that of an active core, so the power dissipated by the processor is reduced significantly. When the number of active cores is less than six, that is, more than two cores are powered off, the decreased power makes it enough for the rest of active cores of a processor to execute at the full speed, and the DFS is not necessary to be triggered. Therefore, when the number of active cores is less than six, the frequency of the processor is constantly 1, and the probability for triggering DFS is constantly 0. This situation is not given in Figures8 and 9.It can be seen that various numbers of active cores result in different probabilistic distributions of frequencies and different probabilities for triggering DFS. When all cores are powered on, the probability that the processor runs at the maximum frequency is only 44.16%, and the probability for triggering DFS is 55.84%. This means that all cores will run at the full speed only when the IPCs of tasks are less. If the IPCs increase to an extent, the running frequency will be scaled down to control the temperature under the threshold. As the number of active cores decreases, the probability that the processor runs at the maximum frequency increases, and the probability for triggering DFS decreases. When the number of active cores is less than six, no matter what the IPCs are, the saved power by shutting off more than two cores makes it deterministic for the active cores to run at the full speed, so the probability that the processor runs at the maximum frequency is 100%, and the probability for triggering DFS is 0%.


### 7.5. Comparisons of Temperatures with and without DFS

If the DFS technique is not used, then the processor always runs at the full speed, that is, the running frequency is constantly 1. So the average hotspot temperature of the active core without the DFS can be obtained according to (52). If both the power-gating and DFS techniques are used simultaneously for the dynamic thermal management, then the running frequency can be scaled to control the temperature of the processor under the thermal threshold. According to (63), the average hotspot temperature of the active core with the DFS can be obtained. In terms of the average hotspot temperature and the probability that the hotspot temperature exceeds the threshold, Table 3 presents the comparative results between the active cores with and without the DFS when the number of active cores is 6, 7, and 8.Table 3
Comparisons of temperatures between active cores with and without DFS.
Number of active cores
Average hotspot temperature (°C)
Probability for exceeding temperature threshold (%)
With DFS
Without DFS
With DFS
Without DFS
6
79.30
79.35
0
0.52
7
88.85
90.17
0
12.37
8
93.85
101.31
0
55.84If the DFS technique is used by the processor, the running frequency will be scaled down to reduce the temperature once the hotspot temperature reaches the threshold. So the hotspot temperature will not exceed the threshold; that is, the probability that the hotspot temperature exceeds the threshold is 0%. If the DFS technique is not used by the processor, the running frequency is always the maximum, and the hotspot temperature is possible to exceed the threshold; that is, the probability that the hotspot temperature exceeds the threshold is larger than 0%. Therefore, the average hotspot temperature of the processor with the DFS is lower than that without the DFS.As the number of active cores decreases, the saved power by shutting off cores makes it more possible for the active cores to execute at the full speed, and the effect of the DFS on cooling down the processor weakens until it disappears. Therefore, for the processors with and without the DFS, the average hotspot temperatures become closer as the number of active cores decreases, as shown in Table3. Even though the DFS is not used, the probability that the hotspot temperature exceeds the threshold will reduce until 0% when more cores are powered off.When the number of active cores is lower than 6, that is, more than 2 cores are powered off, no matter what speed the processor runs at, the hotspot temperature will not exceed the threshold, so all active cores are not necessary to trigger the DFS for managing the temperature of the processor and can run at the maximum frequency. Therefore, when the number of active cores is lower than 6, the probability that the hotspot temperature exceeds the threshold is 0%, and the average hotspot temperatures of the processor with and without the DFS are same. There is no difference with the DFS and without the DFS when the number of active cores is lower than 6, so the comparisons in this situation are not given in Table3.


## 7.1. Experimental Methodology

A multicore version of Alpha 21264 processor is used as the processor model in our experiment [24], and there are eight cores in the processor. The cores have two working states, active state and inactive state, and the working state of each core can be set separately. The processor employs a global DFS technique, which means that frequencies of all cores in the processor are scaled uniformly. There are four discrete frequencies used by the processor, that is, 1.5 GHz, 2 GHz, 2.5 GHz, and 3 GHz. To facilitate analysis, the frequencies are normalized into the interval [
0,1
], so that the maximum frequency is normalized to 1. After normalization, the set of frequencies is {
0.5
,
0.67
,
0.83
,
1
}. According to our previous work, the hotspot of Alpha 21264 processor is the branch predictor [18]. So the second element of the hotspot selection vector H, corresponding to the branch predictor, is set to 1, and the other elements are set to 0 s. The thermal threshold, that is, the maximum temperature allowed by processor, is set to 100°C.The HotSpot is used as the thermal model of the multicore processor, and the parameters such as thermal conductance and capacitance are set to default values of HotSpot simulation tool [3]. In order to construct the linear model of dynamic power, PTScalar is modified to obtain both the dynamic power profiles of each functional unit in Alpha 21264 processor and the IPC profiles [25]. The parameters of PTScalar are set to default values as well. The mean μ
X and variance σ
X
2 of norm-distributed X
a
,
i are determined using IPC profiles based on the maximum likelihood estimation. Some representative tasks such as mesa, ammp, quake, bzip, mcf, math, and qsort from MiBench [26] and SPEC CPU2000 [27] are selected as the benchmarks. These selected tasks are mutually independent; that is, no task takes precedence over the others, so the tasks can be parallel executed at the task level. In addition, workload balancing techniques are used in the processor. A task is not fixed on a core, and the tasks can be migrated among all cores such that the IPCs of different cores are equal. The simple linear regression analysis is used to determine the coefficients G
d
y
n and G
d
0 in (21), and the variance σ
E
d
2 of regression residuals E
d
y
n is obtained.The leakage power is the nonlinear monotonic increasing function of temperature, which is given by [25](64)
P
l
=
α
·
T
2
·
e
γ
/
T
+
β
,where α, β, and γ are parameters which depend on topology, size, technology, and design of processors. In order to construct the linear model of leakage power, (64) is regressed linearly to determine the coefficients G
l
e
a
,
a and G
l
0
,
a in (22) and the coefficients G
l
e
a
,
i
n
a and G
l
0
,
i
n
a in (24), as well as the variance σ
E
a
2 and σ
E
i
n
a
2 of regression residuals E
l
e
a
,
a and E
l
e
a
,
i
n
a. The parameters α, β, and γ are set to the default values of PTScalar. The smaller the range of temperature, the higher the linear correlation between leakage power and temperature [7]. The temperature of a processor using DTM techniques does not exceed the maximum value, and the lower temperature has no impact on the design optimization of thermal-aware processors. Therefore, the linear regression analysis of leakage powers is performed at the temperature interval between 60°C and 100°C, and the regression results are used to estimate the leakage power at the whole temperature interval.


## 7.2. Estimated Accuracy

For the hotspot of the processor, that is, the branch predictor, Figure3 shows the comparison between the actual value and the estimated value of leakage power for active cores, and Figure 4 shows that for inactive cores. A higher estimation accuracy of leakage power is obtained at the temperature interval between 60°C and 100°C at the cost of lower accuracy at the other intervals.Figure 3
Leakage power estimation of hotspot for active cores.Figure 4
Leakage power estimation of hotspot for inactive cores.After regression analysis, the dynamic and leakage power can be estimated with the linear model in (21), (22), and (24). Figure 5 shows the estimation error rate of the dynamic power and that of the leakage power for active cores and inactive cores in thermal range between 60°C and 100°C. It can be seen that the error rates of the dynamic powers for different functional units have significant variations. For the decoder, the estimation error rate of dynamic power is only 2.62% but 10.14% for the floating point register (FPReg). The reason for this fact is that the linear correlations between the IPC and the dynamic powers for various functional units are different. Lower error rate results from higher correlation. Obviously, the IPC and the dynamic power of the decoder have the highest linear correlation, while the IPC and that of FPReg have the lowest linear correlation. It can also be seen from Figure 5 that the estimation error rates of leakage power for both active cores and inactive cores are similar. The estimation error rates of leakage power for active cores are between 3.15% and 3.26%, and those for inactive cores are between 3.06% and 5.91%. This is because the temperature and the leakage power of various functional units have similar linear correlations. In order to consider the impact of estimation errors on the analysis of temperature and frequency, the error terms E
d
y
n, E
l
e
a
,
a, and E
l
e
a
,
i
n
a are introduced into the linear models of dynamic power and leakage power as expressed in (21), (22), and (24).Figure 5
Error rate of the power estimation.


## 7.3. Probabilistic Distribution of Temperature

Based on the assumption that no DTM techniques are used to control the temperature of processors, according to Theorem4, the probabilistic distribution of the hotspot temperatures for both active cores and inactive cores can be obtained. Table 1 presents the means and the standard deviations of the probabilistic distribution of the hotspot temperature for active cores, and the corresponding probabilistic density curves are as shown in Figure 6. It can be seen that the hotspot temperature of processors is not deterministic and has significant variations for a certain number of active cores and a certain frequency. The number of active cores and the running frequency simultaneously determine the range in which the temperature lies and the probabilistic distribution of the hotspot temperature. For the same running frequency, more active cores will yield higher temperature, and vice versa. For the same number of active cores, higher frequency will bring higher temperature, and vice versa. According to the characteristics of normal distribution curve, it can be known that the shape of probabilistic density curve corresponds to the variations of data distribution depending on the standard deviation of random variables. The curve with a higher peak implies a smaller standard deviation, that is, a lower variation of data distribution, whereas the curve with a lower peak implies a bigger standard deviation, that is, a larger variation; it can be seen from Figure 6 that the probabilistic density curves corresponding to various frequencies have different peaks. This observation implies that the degree of temperature variation has close correlation with working frequency, and higher frequency will yield higher variation of temperature.Table 1
Means (μ) and standard deviations (σ) of hotspot temperature distribution for active cores.
Number of active cores
Frequency of 0.5
Frequency of 0.67
Frequency of 0.83
Frequency of 1
μ (°C)
σ
μ (°C)
σ
μ (°C)
σ
μ (°C)
σ
6
51.93
4.03
61.25
5.40
70.02
6.69
79.35
8.06
7
59.20
4.25
69.73
5.69
79.64
7.05
90.17
8.50
8
66.69
4.48
78.46
6.00
89.54
7.43
101.31
8.95Figure 6
The probability density of the hotspot temperature for active cores. (a) The number of active cores is six. (b) The number of active cores is seven. (c) The number of active cores is eight.
(a)
(b)
(c)Table2 presents the means and standard deviations of the probabilistic distribution of the hotspot temperature for inactive cores, and the corresponding probabilistic density curves are as shown in Figure 7. When the number of active cores is eight, inactive core does not exist, so there is no case where the number of active cores is eight in Table 2 and Figure 7. The effect of the frequency and the number of active cores at the hotspot temperature for inactive cores is the same as that for active cores, except that the mean value and variation of hotspot temperature of inactive cores are lower than those of active cores under the same frequency and the number of active cores.Table 2
Means (μ) and standard deviations (σ) of hotspot temperature distribution for inactive cores.
Number of active cores
Frequency of 0.5
Frequency of 0.67
Frequency of 0.83
Frequency of 1
μ (°C)
σ
μ (°C)
σ
μ (°C)
σ
μ (°C)
σ
6
40.59
1.71
47.08
2.29
53.19
2.84
59.68
3.42
7
47.78
1.95
55.46
2.61
62.69
3.23
70.37
3.89Figure 7
The probability density of the hotspot temperature for inactive cores. (a) The number of active cores is six. (b) The number of active cores is seven.
(a)
(b)


## 7.4. Probabilistic Distribution of Frequencies

If the power-gating and the DFS techniques are simultaneously used to manage the temperature of a processor, according to Theorem5, the probabilistic distribution of working frequencies can be determined. Figure 8 presents the probabilistic distribution of frequencies when the number of active cores is six, seven, and eight, respectively. When the frequency is less than 1, it is implied that the hotspot temperature surpasses the threshold, and the DFS technique is triggered to reduce the frequency of the processor. So the probability for triggering DFS can be obtained from the probabilistic distribution of frequencies. Figure 9 presents the probability for triggering DFS when the number of active cores is six, seven, and eight, respectively.Figure 8
Probabilistic distribution of frequencies.Figure 9
Probability for triggering DFS.If a core is powered off and made inactive using the power-gating technique, it only dissipates the leakage power which is much less than that of an active core, so the power dissipated by the processor is reduced significantly. When the number of active cores is less than six, that is, more than two cores are powered off, the decreased power makes it enough for the rest of active cores of a processor to execute at the full speed, and the DFS is not necessary to be triggered. Therefore, when the number of active cores is less than six, the frequency of the processor is constantly 1, and the probability for triggering DFS is constantly 0. This situation is not given in Figures8 and 9.It can be seen that various numbers of active cores result in different probabilistic distributions of frequencies and different probabilities for triggering DFS. When all cores are powered on, the probability that the processor runs at the maximum frequency is only 44.16%, and the probability for triggering DFS is 55.84%. This means that all cores will run at the full speed only when the IPCs of tasks are less. If the IPCs increase to an extent, the running frequency will be scaled down to control the temperature under the threshold. As the number of active cores decreases, the probability that the processor runs at the maximum frequency increases, and the probability for triggering DFS decreases. When the number of active cores is less than six, no matter what the IPCs are, the saved power by shutting off more than two cores makes it deterministic for the active cores to run at the full speed, so the probability that the processor runs at the maximum frequency is 100%, and the probability for triggering DFS is 0%.


## 7.5. Comparisons of Temperatures with and without DFS

If the DFS technique is not used, then the processor always runs at the full speed, that is, the running frequency is constantly 1. So the average hotspot temperature of the active core without the DFS can be obtained according to (52). If both the power-gating and DFS techniques are used simultaneously for the dynamic thermal management, then the running frequency can be scaled to control the temperature of the processor under the thermal threshold. According to (63), the average hotspot temperature of the active core with the DFS can be obtained. In terms of the average hotspot temperature and the probability that the hotspot temperature exceeds the threshold, Table 3 presents the comparative results between the active cores with and without the DFS when the number of active cores is 6, 7, and 8.Table 3
Comparisons of temperatures between active cores with and without DFS.
Number of active cores
Average hotspot temperature (°C)
Probability for exceeding temperature threshold (%)
With DFS
Without DFS
With DFS
Without DFS
6
79.30
79.35
0
0.52
7
88.85
90.17
0
12.37
8
93.85
101.31
0
55.84If the DFS technique is used by the processor, the running frequency will be scaled down to reduce the temperature once the hotspot temperature reaches the threshold. So the hotspot temperature will not exceed the threshold; that is, the probability that the hotspot temperature exceeds the threshold is 0%. If the DFS technique is not used by the processor, the running frequency is always the maximum, and the hotspot temperature is possible to exceed the threshold; that is, the probability that the hotspot temperature exceeds the threshold is larger than 0%. Therefore, the average hotspot temperature of the processor with the DFS is lower than that without the DFS.As the number of active cores decreases, the saved power by shutting off cores makes it more possible for the active cores to execute at the full speed, and the effect of the DFS on cooling down the processor weakens until it disappears. Therefore, for the processors with and without the DFS, the average hotspot temperatures become closer as the number of active cores decreases, as shown in Table3. Even though the DFS is not used, the probability that the hotspot temperature exceeds the threshold will reduce until 0% when more cores are powered off.When the number of active cores is lower than 6, that is, more than 2 cores are powered off, no matter what speed the processor runs at, the hotspot temperature will not exceed the threshold, so all active cores are not necessary to trigger the DFS for managing the temperature of the processor and can run at the maximum frequency. Therefore, when the number of active cores is lower than 6, the probability that the hotspot temperature exceeds the threshold is 0%, and the average hotspot temperatures of the processor with and without the DFS are same. There is no difference with the DFS and without the DFS when the number of active cores is lower than 6, so the comparisons in this situation are not given in Table3.


## 8. Conclusions

In this paper, a probabilistic analysis method of the temperature and frequency of multicore processors is presented taking the variation of workloads into account. It is proved theoretically in this paper that (1) the hotspot temperatures of both active cores and inactive cores are the linear functions of the IPC; (2) the hotspot temperature follows the normal probabilistic distribution based on the assumption that IPCs of all cores follow the same normal distribution; and (3) the running frequency follows a probabilistic distribution.From the experimental results, it can be seen that(
1
) the estimation error rates of the dynamic powers for different functional units have significant variations, indicating that the linear correlations between the IPC and the dynamic powers for various functional units are different; (
2
) the estimation error rates of leakage powers for both active cores and inactive cores are similar, showing similar linear correlations between temperature and leakage power across various functional units; (
3
) a higher estimation accuracy of leakage powers can be obtained at the temperature interval between 60°C and 100°C at the cost of lower accuracy at other intervals; (
4
) the hotspot temperature of the processor is not deterministic and has significant variation for a certain number of active cores and a certain frequency, and the number of active cores and the running frequency determine simultaneously the probabilistic distribution of hotspot temperature; and (
5
) various numbers of active cores result in different probabilistic distributions of frequencies and different probabilities for triggering DFS.



---

*Source: 2462504-2016-05-22.xml*