Counting Passengers from Images of Drive Recorder Inside Buses-  by Using Background Subtraction and OpenPose!"#"$% &"'"()*+", , Ismail Arai, , Kazutoshi Fujikawa,1 Nara Institute of Science and Technology

Background

Problems and purposeu Bus company's management crisis

u Past: Manually counting by investigators

u The motorization mainly in local cities→Only investigate several times a year
u Recent: Automatically counting system→Need to install equipment for counting→Costly: 300,000 Yen/bus
Propose automatically counting at low costu The declining birthrate and aging population
u The progress of depopulation Bus stops

1 tripu Optimal route planningex) EAGLE BUS (Saitama, Japan)
Deficit sectionu Count passengers at each bus stopu Find out which section on routes is deficitu Change bus stop / routes for revenue
Need to know the number of passengers at each bus stop

The bus company in Japan can install equipment withsubsidies from the government.
u Drive recorderu Verification of accidents and in-vehicle troubleu Digital tachographu Verification of accidents and in-vehicle trouble
u Operation managementu Vehicle data (e.g. vehicle speedengine speedGPSetc...) can be stored on memory card or cloudCounting method
u Implementation counting passengers
u From drive recorder

Update the route planning

u From sensor data

Number of passengers(3G/LTE)
Numberof passengers Operation
Database

Digital

TachographSensor
dataSensor

Managers

Congestion
informationVideos

Drive Recorder

Equipment on buses

Passangers

Estimate a number ofpassengers from sensor
data videos using imageprocessing.

BusAnalysis data

Image analysis method of drive recorder
INOUTCorrect Estimated Precision Recall FCorrect Estimated Precision Recall FPeoples People
Rate
Rate measure Peoples People
Rate
Rate measureu Try 2 methodsu Background Subtractor (KNN)

Backgroundu Using OpenPose
Substraction
OpenPose
multi-person keypoint detection library for bodyu Background Subtractor (KNN)

1. Detection of count target personu Calculate rectangular outline and the center of gravity

2069

13520.64
0.32

1969

8430.875 0.37
0.84 0.52

u Using OpenPose
1.

Detection of count target person
u Using OpenPoseӡߦtheB: 2018
೥ 5 ݄ 12 ೔ 09:50ʙ10:35
u Use the position• ofneck• ӡߦ C: 2018 ೥ 5 ݄ 12 ೔ 11:50ʙ12:36

後フレーム間の同一人物探索ー·ͨɺͦΕͧΕͷӡߦͷ֤ఀཹॴͰͷ৐߱٬਺Λද 1 ʹFuture Workࣔ͢ɻ͜ΕΒͷө૾Λ‫ʹݩ‬ఏҊγεςϜͰਪఆਓ਺Λө૾" とユークリッド距離が1番近い点#$ を選択্ʹඳը͠ɺਪఆਓ਺Λਫ਼౓͕ਖ਼͍͔͠Λ໨ࢹͰ֬ೝΛ$ が点!" 点の属する長方形輪郭の範囲内
Last frame
Current frame者(a) લϑϨʔϜ(a) લϑϨʔϜ

1 0.650.75 0.56

BS adaptedframe(a) લϑϨʔϜ(b) ‫ݱ‬ϑϨʔϜ(b) ‫ݱ‬ϑϨʔϜߦͬͨɻ‫ݱ‬ϑϨʔϜu(b)Usingother sensor data点!" と点#ਤ 6:എ‫ࠩܠ‬෼๏Λద༻ͨ͠ϑϨʔϜྫ
3:searchϑϨʔϜྫbetween last & currentਤ 3: ਤϑϨʔϜྫ
4.2 ධՁ݁Ռ
$ は同一人物の重心点とする
2. Identicalpeople
framesu There is a correlation
the door opening time for3. Counting

passenger get on/off
thebusandthenumberof޲ͱͯ͠࠶‫཰ݱ‬͸ߴΊʹͰ͍ͯΔ͕ɺద߹཰͕௿͘ͳͬͯ
passengers. ͠·͍ͬͯΔɻ͜ͷ‫ݪ‬Ҽͱͯ͠ɺϘʔμʔϥΠϯ෇ۙͰཱ!"The number of passengers#$ਪఆਓ਺ɺద߹཰ɺ࠶‫཰ݱ‬ɺF ஋Λද 2 ʹࣔ͢ɻશମͷ܏

ͪࢭ·Δ৐٬͕ଟ͔ͬͨͨΊͰ͋Δɻਤ 10 ͷΑ͏ʹ൶͔Βӡ௞ശͷ‫͕ۙ͘཭ڑ‬ɺ݁Ռͱͯ͠ϘʔμʔϥΠϯͱӡ௞ശͷ‫ͨͨͬ·ͯͬ͠ͳ͕ۙ͘཭ڑ‬Ίɺ1 ਓʹରͯ͠ෳ਺ճ
Χ΢ϯτͯ͠͠·ͬͯద߹཰͕௿͘ͳͬͨͱߟ͑ΒΕΔɻ(a) લϑϨʔϜ(a) લϑϨʔϜάʔϜͷάͷ 5ͷʹਤ͔Ξϯ΅͔(a) લϑϨʔϜ(b) ‫ݱ‬ϑϨʔϜ(b) ‫ݱ‬ϑϨʔϜਤ 7: 2 ஋ԽϑΟϧλΛద༻ͨ͠ϑϨʔϜྫਤ 4: ਤάϨʔεέʔϧԽͷϑϨʔϜྫ
4: άϨʔεέʔϧԽͷϑϨʔϜྫ

2. Identical people search17

3. Counting

Graduate School of Information Science
Nara Institute of Science and Technologyಈ෼๏Ͱಈ(b) ‫ݱ‬ϑϨʔϜ·ͨɺӡߦ A ΑΓ΋ B ΍ C ͷํ͕ F ஋͕௿͘ͳͬͯ͠·͏ͷ͕໨ཱͭɻ͜Ε͸೔ࣹྔ͕ؔ܎͍ͯ͠Δ͜ͱ͕෼͔ͬͨɻӡߦ B ΍ C Ͱ͸ɺόεͷ൶Λ։͚ͨͱ͖ʹࠩ͠ࠐThe door opening time[second]ΉޫͷมԽΛೝࣝͯ͠͠·͏͜ͱ͕ଟ͔ͬͨɻҰํͰӡߦA ͸ேํͷ࣌ؒଳͰ͋ΔͨΊɺ೔͕ࠩ͠‫͘ͳ͘ڧ‬ɺυΞΛ։ดͯ͠΋ޫͷมԽͷ‫ޡ‬ೝࣝ͸গͳ͔ͬͨɻͦΕ͚ͩͰ͸

http://inet-lab.naist.jp/ͳ͘υϥΠϒϨίʔμͷ࢓༷ͱͯ͠ඃࣸମͷ໌Δ͞ʹΑͬ

0.64
0.64