# Deep Learning for Intelligent Human-Computer Interaction
## 7 Summary of the Application Status of Deep Learning in HCI
\begin{table}
\begin{tabular}{c c c c} \hline \hline
**Author and Year** & **Research Scope** & **Algorithm (Model)** & **Dataset** \\ \hline \multirow{2}{*}{[PERSON] et al. (2020)} & \multirow{2}{*}{Emotional computing} & Affective computing and & \multirow{2}{*}{uulmMAC} \\  & & multimodal data analysis & \\  & & methods & \\ \hline \multirow{2}{*}{[PERSON] et al. (2020)} & \multirow{2}{*}{Social robot} & The & \multirow{2}{*}{A collection of conversations} \\  & & question–answer–response & from the nursing home site \\ \hline \multirow{2}{*}{[PERSON] (2021)} & \multirow{2}{*}{Gesture recognition} & HCI model of manipulator & \multirow{2}{*}{Subject site collection} \\  & & operated by manipulator & \\ \hline \multirow{2}{*}{[PERSON] et al. (2021)} & Speech recognition and & Mobile and personal voice & Questionnaire survey results \\  & & assistant platforms & and on-site evaluation \\ \hline \multirow{2}{*}{[PERSON] and [PERSON] (2020)} & \multirow{2}{*}{Speech recognition and  interaction} & Multitask learning and & \multirow{2}{*}{An audio–visual corpus} \\  & & automatic audiovisual speech & recognition systems \\ \hline \multirow{2}{*}{[PERSON] et al. (2021)} & \multirow{2}{*}{Gesture recognition} & Weight adaptive algorithm & \multirow{2}{*}{Gesture image dataset} \\  & & combining different features & \\ \hline \multirow{2}{*}{[PERSON] et al. (2020)} & \multirow{2}{*}{Context awareness} & Context-aware citation & \multirow{2}{*}{Three real datasets} \\  & & recommendation model based & \\  & & on end-to-end memory & \\  & & network & \\ \hline \multirow{2}{*}{[PERSON] et al. (2020)} & \multirow{2}{*}{Speech recognition} & Online hybrid based on & \multirow{2}{*}{LibriSpeech} \\  & & connectionist temporal & \\  & & classification/attention & \\  & & end-to-end automatic speech & \\  & & recognition architecture & \\ \hline \multirow{2}{*}{[PERSON] et al. (2020)} & \multirow{2}{*}{Speech emotion recognition} & Multimodal speech emotion & \multirow{2}{*}{CMU-MOSEI, IEMOCA and \multirow{2}{*}{MELD}} \\  & & recognition method based on & \\  & & multilevel multi-head fusion & \\  & & attention mechanism and & \\  & & recurrent neural network & \\ \hline \multirow{2}{*}{[PERSON] et al. (2020)} & \multirow{2}{*}{Motion recognition} & A novel graph convolution & \multirow{2}{*}{NTU-RGB+D, Kinetics-M, and \multirow{2}{*}{SYSU-3D}} \\  & & network based on structure & \multirow{2}{*}{NTU RGB+D, SBU Interaction} \\  & & graph pooling scheme and & \\  & & joint channel attention module & \\ \hline \multirow{2}{*}{[PERSON] et al. (2020)} & \multirow{2}{*}{Motion recognition} & A new spatiotemporal model & \multirow{2}{*}{NTU RGB+D, SBU Interaction} \\  & & of end-to-end bidirectional & \multirow{2}{*}{and UTD-MHAD (BiLSTM-CNN)} \\  & & Low-frequency modulation & & \\  & & (BiLSTM-CNN) & \\ \hline \multirow{2}{*}{[PERSON] et al. (2020)} & \multirow{2}{*}{Motion recognition} & Spatiotemporal concern & \multirow{2}{*}{UCF-101 (95.8\%) and \multirow{2}{*}{HMDB-51 (71.5\%)}} \\  & & convolutional neural network & \\  & & model & \\ \hline \multirow{2}{*}{[PERSON] and [PERSON] (2020)} & \multirow{2}{*}{Gesture recognition} & Hidden Markov model and & \multirow{2}{*}{Hand graphics collection} \\  & & Color-based hand & \multirow{2}{*}{based on DeepLabv3} \\  & & segmentation algorithm & \\ \hline \multirow{2}{*}{[PERSON] et al. (2019)} & \multirow{2}{*}{Man–machine dialog} & An algorithm that combines & \multirow{2}{*}{A survey of the subject’s} \\  & & prosody valence with text & \\ \multirow{2}{*}{[PERSON] et al. (2019)} & \multirow{2}{*}{Man–machine dialog} & emotion through & \multirow{2}{*}{experience} \\  & & decision-level fusion & \\ \hline \hline \end{tabular}
\end{table} 
Table 4: Summary of algorithms and datasets used by deep learning technology in intelligent HCI systems.