Multiple Sensor Fusion Technology for Non-contact Measurement ofVital Signs and its Application for Infection Screening
2021/03/04

Guanghao Sun
The University of Electro-Communications

Agenda• Recent studies on non-contact bio-measurement

Non-contact measurement of vital signs (heart rate, respiration
rate, body temperature) and its medical applications• Current Projects in SUN LAB@UEC
Infection Screening System for Prevention of Pandemic
Elderly Bedridden Hospitalized Patients Monitoring System
Sleep Monitoring (Sleep Apnea Syndrome)
Mental Stress Monitoring (Major Depressive Disorder)
Mobile Robot for Home Healthcare• Future Plans

MedicineElectrical&MechanicalEngineeringBME

Information
ScienceNon-contact Measurement of Vital Signs
Using Microwave Radar and Its Applications

MY RESEARCH INTERESTS

Remote Sensing of Vital Sign with Microwave Radar and Imaging Sensors

RGB and thermal image
Measuring HR, RR, body TEMP

PPG sensor measuring HR

Ballistocardiography

Measuring HR and RR

Microwave radarmeasuring HR and RR

Non-contact, without attaching electrodes, long-term monitoringMedical Applications• Public Healthcare: Infection Screening System

CURRENT PROJECTSFever-based Screening at Airport during Covid-19 PandemicDennis Normile: Airport screening is largely futile, research shows. Science, (2020)

Fever-based Screening at a Hospital Entrance during Covid-19 Pandemic

Cornelius Dzien, et al.: Covid-19 screening: are forehead temperature measurements during cold outdoor temperatures really helpful?. Wiener
klinische Wochenschrift, (2020)

Background --- Infectious Disease and Vital Signs
Included in the diagnostic criteria for theSystemic Inflammatory Response Syndrome (SIRS)Infection type

Temp (℃)

HR (bpm)

RR (bpm)

TyphusInfluenza
Bloody flux
Malaria
Measles

40～4140～4138～3940～4140～41
39～40

110～120110～120120～130
Above 100bpm
120～140100～110

30～40
30～35
――Tetanus

35～4025～30

Associated with inflammation

As a results of being Infected, not only body temperate,
heart rate and Respiration
respiration rate increase.
but also HeartOur Vital-signs based Infection Screening System
Non-contact vital-signs measurement

Diagnosis

Screening within 10 s

Sun G: An infectious disease/fever screening radar system which stratifies higher-risk patients within ten seconds using a neural network and the fuzzy
grouping method. Journal of Infection, (2015)

System design: Non-contact vital-sign based infection screening system
2009

2013

2011

2015

2018

9

Multiple Sensor Fusion Technology for Non-contact Measurement of Vital Signs

10Image Processing to Extract Respiration and Heart beat11

Schematic representation of the image processing method

Sun G: Remote sensing of multiple vital signs using a CMOS camera-equipped infrared thermography system and its clinical application in rapidly screening
12
patients with suspected infectious diseases. International Journal of Infectious Diseases, (2017)

13

14

Classification algorithm and clinical test

Classification algorithm

InfectionBT[℃]Linear Discriminate Analysis (LDA)

Z(X1,X2,X3) ＝Z>＝0Z<035.5-0.21X1 -0.48X2-0.36X3

InfectionHealthy

NeuralNetwork Determines Optimal Screening Condition(SOM)＋k-means法
SOM

Input layer

0: Healthy

Vital sign data

INF1
INF2
NOR1
NOR2.
.
.
INFn
NORn

SOM 2D-map

HRHRRRRR

FTFT

1: Infection

Self-organizing Map (SOM) with k-means clustering method
・Competitive Learning Neural Network (unsupervised)・Clustering method: Data of a similar property constitute a cluster

Sun G, Matsui T, et al. A novel infection screening method using a neural network and k-means clustering algorithm which
can be applied for screening of unknown or unexpected infectious diseases. Journal of Infection. 2012.

Clinical Tests on Seasonal Influenza and Dengue Fever

Narita International Airport Clinic(2013)

Japan Self-Defense Forces Central Hospital(2009, 2012, 2013)

Okinawa International
Airport (2009)
National Hospital of Tropical Diseases(2017)

Seasonal influenza screening

SUBJECTS
57 patients diagnosed to have A-type influenza by QuickVue Rapid SP influ kits
(Quidel Corp., USA), (19-40 years old).
Treated with an Oseltamivir or a Zanamivir hydrate
35.7 ℃ ≦Body Temperature≦ 38.3 ℃
35 Normal control subjects No symptoms of fever, (10-35 years old).
35.5 ℃ ≦ Body temperature ≦ 36.9 ℃

20Vital-signs based infection screening V. S. Fever screening

Vital-signs based infection screening V. S. Fever screening
Normal Control

Influenza

Body
Heart
Respiratory Average FacialZ(X , X , X )Temperature(X3) 1 2 3Temperature Rate(X1) Rate(X2)

BodyHeartRespiratory
Temperature Rate(X1) Rate(X2)

Average Facial
Z(X1 , X2 , X3 )Temperature(X3)

35.5

50

13

32.6

7.1

35.7

78

20

32.6

-2.5

36.2

63

15

33.1

3.3

36.7

105

18

32.9

-6.9

36.4

66

14

32.8

3.0

36.8

97

15

33.3

-4.0

36.5

54

13

33.2

6.0

36.9

82

16

33.6

-1.4

36.7

72

15

32.0

1.7

37.9

106

13

34.9

-5.6

36.8

60

13

33.2

4.8

38.2

93

15

34.4

-3.7

36.9

54

11

33.4

6.9

38.3

108

15

34.4

-6.9

Contact

Non-contact

Contact

22

Non-contact

Comparing and Optimizing Classification Algorithms

Yao Y & Sun G: Multiple Vital-sign Based Infection Screening Outperforms Thermography Independent of the Classification
Algorithm. IEEE Transactions on Biomedical Engineering, 2016.

Future Plans --- Networked System for Infection Surveillance

Sun G: Visualisation of epidemiological map using an Internet of Things infectious disease surveillance platform. CriticalCare, 2020.

24

Related publications
Guanghao Sun, Nguyen Vu Trung, Takemi Matsui, Koichiro Ishibashi, Tetsuo Kirimoto, Hiroki Furukawa,
Le Thi Hoi, Nguyen Nguyen Huyen, Quynh Nguyen, Shigeto Abe, Yukiya Hakozaki, Nguyen Van Kinh
Field evaluation of an infectious disease/fever screening radar system during the 2017 dengue fever
outbreak in Hanoi, Vietnam: A preliminary report.
Journal of Infection, 75(6), 590-593, 2017.
Guanghao Sun, Yosuke Nakayama, Sumiyakhand Dagdanpurev, Shigeto Abe, Hidekazu Nishimura, Tetsuo
Kirimoto, Takemi Matsui
Remote sensing of multiple vital signs using a CMOS camera-equipped infrared thermography system
and its clinical application in rapidly screening patients with suspected infectious diseases.
International Journal of Infectious Diseases, 55, 113-117, 2017.
Yu Yao, Guanghao Sun, Takemi Matsui, Yukiya Hakozaki, Stefan van Waasen, Michael Schiek
Multiple Vital-sign Based Infection Screening Outperforms Thermography Independent of theClassification Algorithm.
IEEE Transactions on Biomedical Engineering, 63(5), 1025-1033, 2016.
Guanghao Sun, Takemi Matsui, Yukiya Hakozaki, Shigeto Abe
An infectious disease/fever screening radar system which stratifies higher-risk patients within ten
seconds using a neural network and the fuzzy grouping method.
Journal of Infection, 70(3), 230-236, 2015.
25

Thank You!

More Information
https://sun-melab.com/Guanghao.Sun@uec.ac.jp