arXiv:1705.05440v1 [] 15 May 2017

Toward Intelligent Traffic Light Control with
Quality-of-Service Provisioning
Lei Miao a,1 , Lijian Xu b
a Mechatronics Engineering, Middle Tennessee State University
b Dept. of Electrical and Computer Engineering Technology, Farmingdale State College
Abstract. Todays fixed-cycle traffic signaling is highly suboptimal and aggravates traffic congestion and waste of energy in urban areas. In addition, it offers
no quality-of-service guarantee and makes travel time prediction extremely hard.
While existing traffic light control research primarily focuses on improving the average wait time of cars, we study in this paper how traffic light scheduling affects
the worst-case wait time. In particular, we derive the time a car spends at an intersection in the best-case and the worst-case, respectively. Using the theoretical
results, we propose a simple but effective controller and run simulation to verify
its performance. The result shows that it works much better than fixed-cycle controllers in both light and heavy traffic scenarios.
Keywords. Intelligent transportation systems, traffic light control, real-time
systems

1. Introduction
Traffic congestion is a serious problem in many urban areas all over the world and has
become a severe challenge to the sustainability of economic grow and urbanization. A
report from the Texas Transportation Institute says that in 2011, traffic congestion costs
drivers $121 billion in the U.S. Americans also spent 5.5 billion additional hours sitting
in traffic in the same year. That comes down to $818 per commuter in lost time and
wasted fuel. Traffic congestion, to a large extent, is caused by the inefficiency of todays
traffic signal systems, which primarily use fixed-cycle scheduling algorithms. Fixedcycle approaches are derived off-line based on historical traffic data. The major drawback
of fixed-cycle approaches is that they cannot adapt to traffic fluctuation in real-time and
may aggravate the congestion when the traffic pattern changes. Therefore, fixed-cycle
traffic signaling is highly suboptimal and needs to be replaced with a better approach.
Another problem of today’s traffic control system is that it does not provide any
quality-of-service (QoS) guarantee. For example, it cannot ensure that each car only
spends up to certain amount of time at an intersection. As a result, it is hard to estimate
how long it would take a car to travel from point A to point B; this is especially true in
case of traffic jam.
1 Corresponding Author: Box 19, Middle Tennessee State University, 1301 E Main St, Murfreesboro, TN
37132, USA, E-mail: lei.miao@mtsu.edu .

Transportation systems are analogous to communication networks in many aspects:
cars travel from one place to another whereas packets are sent from one device to another; roads are like communication links where packets are transmitted in a first-comefirst-served fashion; and intersections are very much similar to routers and switches. A
question then naturally arises: why is QoS readily available in communication networks
but very lacking in transportation systems? The answers to it are multi-fold, but the major reason is that historically, transportation systems simply do not have the necessary
information of the cars, such as where and how fast they are and where they are headed.
Fortunately, things have changed dramatically in the past ten years or so: most
drivers now have smart phones which are capable of reporting the GPS locations and
velocities of the vehicles; inexpensive and embedded electronics with similar functionalities are also being built into automobiles; and cars are becoming autonomous and have
started to have wireless communication capabilities. All these evidences indicate that
transportation systems are ready to be smarter and provide QoS provisioning to travelers. Yet, another complication is that traffic systems contain both time-driven and eventdriven dynamics: cars continuously accelerate and decelerate and have to obey Newton’s law; and traffic lights switch between green and red at discrete time instances. The
hybrid nature makes it hard to model and control in applications related to intelligent
transportation systems.
In this paper, we present some preliminary work regarding how a traffic intersection
can provide QoS to the cars using it. The contributions of the paper include: (i) Different
from existing work in the literature, we incorporate car dynamics into our analysis and
derive the best-case and worst-case deadline information for a simple two-way intersection; (ii) We propose a simple but effective open-loop controller that utilizes the vehicle
information to perform control; and (iii) we run simulation to verify the effectiveness
and improvement of our approach over the existing fixed-cycle traffic signaling.
The organization of the paper is as follows: in Section II, we summarize related
work; in Section III, we introduce our system model; in Section IV, we present the main
results; in Section V, we show simulation results; finally, we conclude and discuss future
work in Section VI.

2. Related Work
Perturbation Analysis (PA) and stochastic fluid models [1] [2] [3] [4] are used to find
the performance sensitivity with respect to certain parameters of traffic light scheduling. Combined with gradient-based algorithms, such approaches are able to iteratively
converge to the optimal solution in an on-line setting. Its powerfulness lies in the fact
that it does not rely on the stochastic assumptions of the vehicles’ arrival and departure
process; in addition, the PA estimator requires very light computation such as counting
the number of traffic light switching between certain events. Fuzzy logic controllers are
proposed in [5] [6] [7], in which the theory of fuzzy sets and linguistic control are used
to model traffic intersections where analytical methods are in general lacking. Li et al.
formulate a traffic light control problem that reduces the stop-and-go time and co2 emissions [8]. They achieve this goal by using a three-tier structure as well as a branch-andbound based real-time algorithm. Ahmad et al. [9] considered a scenario that each vehicle has its specific deadline that needs to be satisfied. The performance of two algo-

rithms: Earliest Deadline First (EDF) and Fixed Priority (FP), in terms of the average
delay, is compared with that of fixed-cycle scheduling. Reinforcement learning are used
in [10] and [11] to adaptively reduce the average cost. Mixed integer linear programming
is used in [12] to perform adaptive control on an isolated intersection. In [13], Khamis
et al. use Bayesian probability interpretation and the Intelligent Driver Model (IDM) to
reduce the average trip waiting time. In [14], the authors use thresholds of the vehicle
waiting queues to adjust the traffic light scheduling; specifically, they use stochastic optimization and Q-learning to dynamically change the thresholds. Protschky et al. use the
Kalman filter and a generic statistical prediction model to perform traffic light control
[15].

3. System Model
We consider an isolated intersection of two one-way streets in this paper. Nonetheless, the
results can be easily extended to more complex intersections. Fig. 1 shows an illustration
of the system model. In particular, we denote:
LC : the length of the car. We assume that all the cars have equal length.
LI : the length of the intersection. We assume that the intersection has equal length
in both directions.
LQ : the length of the vehicle queue. Assuming that each car is capable of communicating with the traffic light controller via wireless technologies, this is essentially the
maximum distance of reliable wireless transmission.
Vmax : the speed limit of the roads near the intersection. It is the maximum speed each
car can have.
v(t): velocity of a vehicle as a function of time.
dS : the safe distance between two adjacent cars when they are both static. It is obvious that the safe distance depends on the velocities of the cars. Here, we are only concerned with the safe distance when both cars are static.
VS : the safe velocity. When two adjacent cars are both initially static, dS meters away,
and the first one starts to accelerate, it is the velocity of the first car at which the second
one starts to accelerate. Here, we assume that the two cars are able to learn each other’s
information, including velocity, via wireless communications. Note that VS ≤ Vmax . We
also would like to emphasize that this safe velocity can be translated into another safe
distance by doing an integral, as shown later in the paper.
N: the maximum number of cars in each queue. For notation easy, we assume that
LQ
N = LC +d
is an integer. This can be satisfied by simply choosing Lq to be the integer
S
multiple of LC + dS .
TY : the duration of yellow light. We assume that TY is greater than one second.
Dij : the amount of time the i-th car spends in the j-th queue.
After introducing the system model of the intersection, we now discuss the car
model. Since we are interested in providing QoS provisioning to the cars using the intersection, we need a simple model which can estimate the time it takes for the cars to
travel through the intersection. We adopt a model used in [16]. Specifically, we assume
that each car has the same mass m and identical driving force F. The road friction F1 (t)
and wind dragging force F2 (t) can be calculated as:
F1 (t) = c1 v(t) and F2 (t) = c2 v2 (t),

dS

LC

LI

…

LI
LQ

…

LQ

Figure 1. System Model Illustration

respectively, where c1 and c2 are constant coefficients. Applying Newton’s Law, we obtain
mv̇(t) + c1 v(t) + c2 v2 (t) = F

(1)

Because the vehicles are subject to Vmax near an intersection and are typically operated
at low speed, we omit the wind’s dragging force, which is only large when the velocity
is high. (1) can then be reduced to:
mv̇(t) + c1 v(t) = F
Taking Laplace transform on both sides and assuming zero initial condition, we get the
transfer function, which is first-order:
G(s) =

V (s)
1
=
F(s) ms + c1

The velocity V (s) is:
V (s) =

F
1
m s(s + cm1 )

Let K = F/c1 and a = c1 /m, the inverse Laplace Transform yields:
v(t) = K(1 − e−at )

(2)

4. Main Results
Our long term goal is to design an adaptive traffic light controller which is capable of
providing QoS provisioning. In this paper, we first answer the following question: once
a car enters a queue, what is the best and worst-case time that it will spend at the intersection? We use Dmin and Dmax to denote these two time, respectively. Only after they

are determined, we can choose the right vehicle deadline D. Dmin corresponds to the best
case scenario where a car enters a queue and travels through the intersection at velocity
Vmax . Therefore,
Dmin =

LQ + LI
.
Vmax

Note that Dmax depends on the traffic light control algorithm. We emphasize that we are
looking for the maximum delay introduced by the best scheduling algorithm. i.e.,
Dmax =

min

max

All traffic controllers All traffic conditions

max(Dij ).

Note that max(Dij ) is the worst-case delay among all vehicles, and it depends on both
the traffic condition and the traffic light controller. Obviously, it is maximized when the
the traffic is extremely heavy in both directions so that even if the green light is constant
on in one direction, the intersection will never idle. To obtain Dmax , we first establish the
following result.
Lemma 4.1 Suppose that N cars are sitting in a queue and waiting for the green light.
Assume that LI is wide enough for the first car to accelerate to Vmax before leaving the
intersection. If the green light is turned on and stays on, it takes Ti seconds for the i-th
car to leave the intersection, i ∈ {1, . . . , N}:
Ti = Ti,w + Ti,a + Ti,t , where
i−1
[lnK − ln(K −VS )] is the time for the i-th car to reach the safe velocity VS ;
a
1
Ti,a = [lnK − ln(K −Vmax )] is the time for the i-th car to accelerate to Vmax ; and
a

Ti,w =

Ti,t =

(i − 1)(LC + dS ) LI − (KT1,a − Vmax
a )
+
is the time for it to travel through the rest
Vmax
Vmax

of the intersection at maximum speed.
Proof: We use induction to prove it.
Step 1: We first focus on T1 , the time it takes the first car to depart. Because T1,w = 0,
T1 = T1,a + T1,t . T1,a can be calculated using (2):
1
T1,a = [lnK − ln(K −Vmax )]
a

(3)

The distance the first car travels during the transient period is:
Z t
0

v(τ)dτ = Kt −

K
(1 − e−at )
a

Using (3) and (4), the distance the first car travels from 0 to T1,a is:

(4)

Z T1,a
0

v(τ)dτ = KT1,a −

Vmax
a

(5)

Then, we calculate T1,t :
T1,t =

LI − (KT1,a − Vmax
a )
Vmax

(6)

Step 2: Assuming that Ti−1 , i ∈ {1, . . . , N}, is known, we now figure out Ti . The
difference between Ti and Ti−1 has two parts. The first part is the time the i-th car has to
wait for the (i − 1)-th car’s velocity to reach VS . Let ∆Tw = Ti,w − Ti−1,w , and using (2),
we get
1
∆Tw = [lnK − ln(K −VS )]
a

(7)

The second part is the time it takes to travel through the extra distance LC + dS at velocity
Vmax . Let us use ∆Tt to denote this difference, and we have
∆Tt =

LC + dS
Vmax

(8)

Combining all the results above, we get:
Ti,w = (i − 1)∆Tw =

i−1
[lnK − ln(K −VS )]
a

1
Ti,a = T1,a = [lnK − ln(K −Vmax )]
a
Ti,t = (i − 1)∆Tt + T1,t
=

(i − 1)(LC + dS ) LI − (KT1,a − Vmax
a )
+

Vmax
Vmax

We now use the results established in Lemma 4.1 to find Dmax . It is obvious that Dmax
is achieved when the traffic is heavy in both directions. Next, we will not give a precise
definition of “heavy”; instead, we give one scenario that will be guaranteed to yield Dmax .
Let us assume that the maximum service rate the intersection provides to the cars is µmax ;
this is obtained when cars in one queue are traveling through the intersection at velocity
Vmax with the right safe distance between adjacent ones. Then, the traffic condition can
be considered as heavy or congested when the vehicle arrival rate to each queue is at
least µmax at all times. This traffic condition will lead to the maximum delay Dmax .
Lemma 4.2 In heavily congested conditions, the optimal traffic control policy that yields
Dmax is to let all N cars in each queue pass the intersection during a single green light
period.
Proof: Because the traffic in both queues are heavy, there are N static cars sitting in each
queue when the traffic light is turned green for that queue. Suppose that M ∈ Z + is the
number of green light periods that are used to service i cars, i ∈ {1, . . . , N}, i.e., there

M
exists n j ∈ Z + and j ∈ {1, . . . , M} s.t. ∑M
j=1 n j = i. We need to show that Ti ≤ ∑ j=1 Tn j .
Using the results in Lemma 4.1, we get:

Ti = (i − 1)∆Tw + T1,a + (i − 1)∆Tt + T1,t
M

∑ Tn j = (i − M)∆Tw + MT1,a + (i − M)∆Tt + MT1,t + (M − 1)TY

j=1

Subtracting Ti from ∑M
j=1 Tn j yields:
M

∑ Tn j − Ti = −(M − 1)∆Tw + (M − 1)T1,a − (M − 1)∆Tt + (M − 1)T1,t + (M − 1)TY

(9)

j=1

From (3), (7), and Vmax ≥ VS , we get
T1,a ≥ ∆Tw

(10)

Because ∆Tt typically is less than 1s and by assumption TY is greater than 1s, we have:
∆Tt ≤ TY

(11)

Combining (9), (10), and (11), we obtain: Ti ≤ ∑M
j=1 Tn j 
Lemma 4.3 Suppose that in heavily congested conditions, the optimal traffic control
policy is used, i.e., N cars in each queue are allowed to pass the intersection during a
single green light period. In the N cars sitting in the queue and waiting for the green
light to be turned on, the cars closer to the intersection spend not less time than those
further away from the intersection.
Proof: To prove this, we need to investigate when a car moves into a queue and when
it leaves an intersection. In particular, we examine the behavior of a car outside of the
queue when the green light is turned on for this queue. At that moment, there are N
cars sitting in the queue and N cars sitting out of the queue. Invoking Lemma 4.2, the N
cars in the queue will be serviced and then after the yellow light interval, and N cars in
the other queue will be serviced. Therefore, the N cars outside of the queue will not be
serviced until 2TN + TY seconds later. Now, consider the i-th car outside of the queue. It
takes (N + i − 1)∆Tw seconds for all the cars in front of it to accelerate to VS . Let Ti,q be
the time it takes for the i-th car outside of the queue to enter the queue after it starts to
accelerate. The total time for the i-th car to enter the queue after the green light is turned
on is:
(N + i − 1)∆Tw + Ti,q

(12)

The amount of time the car spends in the queue before the next green cycle arrives is:
2TN + 2TY − (N + i − 1)∆Tw − Ti,q
The total time this car spends in the queue is:

(13)

2TN + 2TY − (N + i − 1)∆Tw − Ti,q + Ti

(14)

The difference of the time the (i + 1)-th and the i-th car spend in the queue is:
∆i+1,i = −∆Tw + Ti,q − Ti+1,q + Ti+1 − Ti
= −∆Tw + Ti,q − Ti+1,q + ∆Tw + ∆Tt
= −(Ti+1,q − Ti,q ) + ∆Tt
Because Ti+1,q − Ti,q is the time it takes to travel distance LC + dS at average speed less
or equal to Vmax and ∆Tt is the time it takes to travel the same distance at velocity Vmax ,
we get: ∆i+1,i ≤ 0 
Lemma 4.3 actually shows something very intuitive: in a queue packed with cars
waiting for the traffic light to turn green, the cars closer to the intersection tend to be the
unlucky ones that spend longer time in the queue. They would be luckier if they passed
the intersection in the previous green light interval.
Corollary 4.1 Dmax = 2TN + 2TY − N∆Tw + T1 .
Proof: Dmax can be obtained using Lemma 4.3, i.e., the maximum delay occurs to the
first car in the queue waiting for the traffic light to turn green. Specifically, we let i = 1
in (14) and get the closed form expression of Dmax shown above. 
Since we now have Dmin and Dmax , adaptive traffic light controllers can be built.
Intuitively, the traffic controller should use the state of the system (number of existing
cars in the queues), arrival rate, etc., to intelligently assign the deadline for each queue,
based on which, the traffic lights are toggled between green and red. In this paper, we
present a simple open-loop controller, which uses the theoretical results above to perform
traffic light scheduling:
Algorithm 1 Adaptive open-loop traffic light controller
1:
2:
3:
4:
5:
6:
7:
8:
9:
10:

Deadline ← Dmax
while True do
if Intersection is not busy then
Turn on green light for the closest car
else
if The deadline of any car waiting for the green light is about to be missed
then
Toggle the traffic lights
end if
end if
end while

5. Simulation Results
We run simulation to verify the theoretical results and the performance of the above
adaptive traffic controller. In our experiments, we let the numbers of vehicles in the two

queues be M1 and M2 , respectively. Initially, all vehicles are at least LQ meters away
from the intersection, and the distance between two adjacent cars in queue 2 is uniformly
distributed between an interval [d1 , d2 ]. The M1 cars in queue 1 are uniformly distributed
between the locations of the first and the last cars in queue 2. The initial velocities of all
cars are uniformly distributed between 0 and Vmax , which is set to 13.3m/s, i.e., 30 miles
per hour. Other parameters’ values are: m = 1500kg, F = 44444N, c1 = 1000, LC = 4m,
LI = 25m, N = 20, dS = 1, LQ = 100m, and TY = 3s. Using these values, we calculate
that Dmin = 9.40s and Dmax = 31.05s.
Traffic congestion depends on the vehicle arrival rate or car density in each queue:
if one queue has zero or very few cars, then it is likely that there is no traffic jam at
the intersection, provided that an adaptive traffic control mechanism is in place. For
this reason, we define R, the ratio between the numbers of cars: R = M1 /M2 . In our
simulation, M1 ≤ M2 and M2 is fixed at 200. Therefore, R ≤ 1. Note that traffic congestion
depends on not only R, but also the values of d1 and d2 .
We compare the performance of the adaptive controller specified in Algorithm 1
with two other controllers:
Fixed-cycle controller 1: the green light and the red light cycles of both queues are TN
seconds.
Fixed-cycle controller 2: the green and the red light cycles of queue 2 are TN and R × TN ,
respectively.

20

Simulation results: average time (4m-40m inter-car distance)

18
16

Time (s)

14
12
10
Average time of fixed-cycle controller 1
Average time of fixed-cycle controller 2
Average time of the adaptive controller

8
6
4
2
0
0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

Ratio between the numbers of cars

Figure 2. Average time a car spends at the intersection (4m-40m inter-car distance)

Fig. 2 and Fig. 3 show the results when d1 = 4m and d2 = 40m. In this case, the
traffic is light, and the adaptive controller we propose reduces the average time by a large
percentage (around 40% when R = 0.25 in Fig. 2). The reason why the large deadline
(31.05s) does not affect things is that when the traffic is light, the intersection tends to
become idle long before a waiting car’s system time reaches this deadline. This will turn
on the green light for the cars waiting in the queue. Another observation is that fixedcycle controller 2 is better than controller 1. However, it is not as good as the adaptive
controller.

Simulation results: average worst time (4m-40m inter-car distance)
30

25

Time (s)

20

15

Average worst time of fixed-cycle controller 1
Average worst time of fixed-cycle controller 2
Average worst time of the adaptive controller

10

5

0
0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

Ratio between the numbers of cars

Figure 3. Average of the worst time in each queue (4m-40m inter-car distance)

Simulation results: average time (4m-20m inter-car distance)
25

Time (s)

20

15

Average time of fixed-cycle controller 1
Average time of fixed-cycle controller 2
Average time of the adaptive controller

10

5

0
0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

Ratio between the numbers of cars

Figure 4. Average time a car spends at the intersection (4m-20m inter-car distance)

Nonetheless, the large deadline does help in the heavy traffic scenario, as shown
in Fig. 4 and Fig. 5, where d1 = 4m and d2 = 20m. In this case, it is less likly for the
intersection to be idle, as R gets closer to 1. As a result, the large deadline used in the
adaptive controller prevents the traffic light from toggling too often; this, in turn, helps
with lowering the averge time. We also point out that when R approaches 1, there is not
much optimization to be done since the optimal scheduling is simply divide the green
light time equally between the two queues, as indicated in Lemma 4.2. In addition, when
the traffic is moderate (R ≤ 0.75), fixed-cycle controller 2 is worse than controller 1,
indicating that simply modifying the cycle length of fixed-cycle scheduling does not
always help.
Overall, the adaptive controller significantly outperforms the other two fixed-cycle
ones when the traffic is not very heavy and maintains roughly the same performance

Simulation results: average worst time (4m-20m inter-car distance)

40
35
30

Time (s)

25
Average worst time of fixed-cycle controller 1
Average worst time of fixed-cycle controller 2
Average worst time of the adaptive controller

20
15
10
5
0
0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

Ratio between the numbers of cars

Figure 5. Average of the worst time in each queue (4m-20m inter-car distance)

when the traffic is extremely heavy.

6. Conclusions and Future Work
In this paper, we model the process of cars passing through an intersection and come
up with the shortest and the longest time they could possibly spend at the intersection.
The results are significant because they help people better understand how traffic light
controllers can be designed in order to provide quality-of-service (QoS) to travellers in
intelligent transportation systems. We also propose a very simple adaptive controller,
which is shown to be much better than two other fixed-cycle ones in most scenarios.
Our future work involves improving the adaptive controller and providing QoS guarantee (e.g., the worst-case waiting time at an intersection) to each individual car. It has
been shown in our simulation that when the traffic is light and the controller is adaptive,
it is possible to improve the the average time and worst time of both queues. However,
we have also seen that when the traffic is no longer light, the improvement of wait time
over one queue actually hurts the wait time of the other. We are interested in studying
how the social aspects affect the decision making in adaptive traffic light control.

References
[1]

C. G. Panayiotou, W. C. Howell, and M. Fu, “Online traffic light control through gradient estimation
using stochastic fluid models,” IFAC Proceedings Volumes, vol. 38, no. 1, pp. 90–95, 2005.
[2] Y. Geng and C. G. Cassandras, “Traffic light control using infinitesimal perturbation analysis,” in Decision and Control (CDC), 2012 IEEE 51st Annual Conference on. IEEE, 2012, pp. 7001–7006.
[3] ——, “Quasi-dynamic traffic light control for a single intersection,” in Decision and Control (CDC),
2013 IEEE 52nd Annual Conference on. IEEE, 2013, pp. 880–885.
[4] ——, “Multi-intersection two-way traffic light control with blocking using infinitesimal perturbation
analysis,” in Control Applications (CCA), 2013 IEEE International Conference on. IEEE, 2013, pp.
382–387.

[5]
[6]
[7]

[8]
[9]

[10]

[11]

[12]

[13]

[14]
[15]
[16]

C. P. Pappis and E. H. Mamdani, “A fuzzy logic controller for a trafc junction,” IEEE Transactions on
Systems, Man, and Cybernetics, vol. 7, no. 10, pp. 707–717, 1977.
Y. S. Murat and E. Gedizlioglu, “A fuzzy logic multi-phased signal control model for isolated junctions,”
Transportation Research Part C: Emerging Technologies, vol. 13, no. 1, pp. 19–36, 2005.
M. Collotta, L. L. Bello, and G. Pau, “A novel approach for dynamic traffic lights management based
on wireless sensor networks and multiple fuzzy logic controllers,” Expert Systems with Applications,
vol. 42, no. 13, pp. 5403–5415, 2015.
C. Li and S. Shimamoto, “An open traffic light control model for reducing vehicles’ co2 emissions based
on etc vehicles,” IEEE Transactions on Vehicular Technology, vol. 61, no. 1, pp. 97–110, 2012.
A. Ahmad, R. Arshad, S. A. Mahmud, G. M. Khan, and H. S. Al-Raweshidy, “Earliest-deadline-based
scheduling to reduce urban traffic congestion,” IEEE Transactions on Intelligent Transportation Systems,
vol. 15, no. 4, pp. 1510–1526, 2014.
L. Prashanth and S. Bhatnagar, “Reinforcement learning with average cost for adaptive control of traffic lights at intersections,” in Intelligent Transportation Systems (ITSC), 2011 14th International IEEE
Conference on. IEEE, 2011, pp. 1640–1645.
S. El-Tantawy, B. Abdulhai, and H. Abdelgawad, “Multiagent reinforcement learning for integrated
network of adaptive traffic signal controllers (marlin-atsc): methodology and large-scale application on
downtown toronto,” IEEE Transactions on Intelligent Transportation Systems, vol. 14, no. 3, pp. 1140–
1150, 2013.
Y. Dujardin, F. Boillot, D. Vanderpooten, and P. Vinant, “Multiobjective and multimodal adaptive traffic
light control on single junctions,” in Intelligent Transportation Systems (ITSC), 2011 14th International
IEEE Conference on. IEEE, 2011, pp. 1361–1368.
M. A. Khamis, W. Gomaa, A. El-Mahdy, and A. Shoukry, “Adaptive traffic control system based on
bayesian probability interpretation,” in Electronics, Communications and Computers (JEC-ECC), 2012
Japan-Egypt Conference on. IEEE, 2012, pp. 151–156.
L. Prashanth and S. Bhatnagar, “Threshold tuning using stochastic optimization for graded signal control,” IEEE Transactions on Vehicular Technology, vol. 61, no. 9, pp. 3865–3880, 2012.
V. Protschky, K. Wiesner, and S. Feit, “Adaptive traffic light prediction via kalman filtering,” in Intelligent Vehicles Symposium Proceedings, 2014 IEEE. IEEE, 2014, pp. 151–157.
L. Xu, L. Y. Wang, G. Yin, and H. Zhang, “Communication information structures and contents for
enhanced safety of highway vehicle platoons,” IEEE Transactions on vehicular Technology, vol. 63,
no. 9, pp. 4206–4220, 2014.

