# Deep-cARe: Projection-Based Home Care Augmented Reality System with Deep Learning for Elderly
## 3 Material and Methods  
This study proposes an elderly care system by applying deep-learning technology that can build a PAR environment for every space in which users are present (Figure 1). The proposed system aims to dynamically provide appropriate information to the elderly using pan-tilt mechanism PAR hardware (Section 3.1.1), constructed PAR environment (Section 3.1.3), and designed UIs (Section 5.2). As shown in Figure 1--upper part, deep learning-based pose estimation technology was applied to enable detecting abnormal conditions. To support long-term memory, deep learning is applied to the face recognition module. Furthermore, daily-life scenarios can be provided to patients exhibiting memory-related problems through the real-time object detection based on deep-learning framework. The technologies in each deep-learning module are described in detail in Section 3.1.4.  
\begin{table}
\begin{tabular}{c c c c c c} \hline \hline
**Research Authors** & **Display** & **Purpose** & **Application** & **UI** & **Characteristic** \\ \hline [PERSON] et al. (2018) & \multirow{4}{*}{Daily support} & \multirow{4}{*}{Cooking} & -Hand & -3D space \\  & & & gesture & reconstruction \\  & & & -Host PC & - Spatial mapping \\ \hline [PERSON] et al. (2019) & \multirow{4}{*}{HMD (Wearable)} & \multirow{4}{*}{Mental care} & \multirow{4}{*}{Game} & -Hand & -3D space \\  & & & gesture & - 3D space \\  & & & & - Voice & - \\  & & & & - Controller & - \\ \hline [PERSON] et al. (2014) & \multirow{4}{*}{Mental care} & \multirow{4}{*}{Game} & Hand & -3D space \\  & & & gesture & reconstruction \\  & & & & - Spatial mapping \\ \hline [PERSON] et al. (2015) & \multirow{4}{*}{Memory assistant} & Medication & None & Cloud-based \\  & & management & & image recognition \\ \hline [PERSON] et al. (2017) & \multirow{4}{*}{Memory assistant} & Medication & Mobile UI & Feature-matching-based \\  & & & management & (MUI) & image recognition \\ \hline [PERSON] et al. (2016) & \multirow{4}{*}{Mobile device (Hand-held)} & \multirow{4}{*}{Physical care} & Medication & MUI & Feature-matching-based \\  & & & management & MUI & image recognition \\ \hline [PERSON] et al. (2019) & \multirow{4}{*}{Safety} & \multirow{4}{*}{Home control} & \multirow{4}{*}{Home control} & \multirow{4}{*}{Suli UI} & \multirow{4}{*}{Spatial touch detection} \\  & & & safety bar & & \\ \hline [PERSON] et al. (2015) & \multirow{4}{*}{Projector} & \multirow{4}{*}{Daily support} & \multirow{4}{*}{Home control} & Spatial UI & -Cloud-based \\  & & & & & image recognition \\ \cline{1-1} [PERSON] et al. (2021) & \multirow{4}{*}{Table-top} & \multirow{4}{*}{Daily support} & \multirow{4}{*}{Home control} & \multirow{4}{*}{Suli} & -Cloud-based \\  & & & & & image recognition \\  & & & & & - Spatial touch detection \\ \hline [PERSON] et al. (2019) & \multirow{4}{*}{Projector} & Mental and \multirow{4}{*}{Physical care} & \multirow{4}{*}{Game} & -Voice & - EMG sensing \\  & & & & gesture & - Body movement \\  & & & & - Host PC & recognition \\ \hline [PERSON] et al. (2014) & \multirow{4}{*}{Projector} & Mental and \multirow{4}{*}{Physical care} & \multirow{4}{*}{Tele-stretching} & -Voice & - Body movement \\  & & & & - Body gesture & - Body recognition \\ \hline Our propose & \multirow{4}{*}{Projector} & - Safety & - Monitoring & - 3D space \\ [PERSON] et al. (2019) & \multirow{4}{*}{(Portable)} & - Daily support & - Home control & - MUI & - Deep learning-based \\  & & - Memory assistant & - Medication & - SUI & Pose estimation, \\  & & & management & & face recognition, \\  & & & & and object detection \\  & & & & - Spatial touch detection \\ \hline \hline \end{tabular}
\end{table}
Table 1: Related work for elderly using AR system.