# Emotion Analysis in Hospital Bedside Infotainment Platforms Using Speeded up Robust Features

A. Kallipolitis, M. Galliakis, A. Menychtas, I. Maglogiannis

► To cite this version:

A. Kallipolitis, M. Galliakis, A. Menychtas, I. Maglogiannis. Emotion Analysis in Hospital Bedside Infotainment Platforms Using Speeded up Robust Features. 15th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), May 2019, Heraklion, Greece. pp.127-138, 10.1007/978-3-030-19823-7_10. http://hal-02331332

HAL Id: hal-02331332

https://inria.hal.science/hal-02331332

Submitted on 24 Oct 2019

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
Emotion Analysis in Hospital Bedside Infotainment
Platforms using Speeded up Robust Features

A. Kallipolitis¹, ²[0000-0001-9234-0069], M. Galliakis¹, ²[0000-0002-5457-876X], A. Menychtas², ³[0000-0002-4510-5522] and I. Maglogiannis¹[0000-0003-2860-399X]

¹ Department of Computer Science and Biomedical Informatics, University of Thessaly, Greece

². Department of Digital Systems, University of Piraeus, Greece

³. BioAssist S.A, Kastritsiou 4, Rion 26504, Greece

nasskall@unipi.gr

michaelgalliakis@unipi.gr

amenychtas@bioassist.gr

imaglo@unipi.gr

**Abstract.** Far from the heartless aspect of bytes and bites, the field of affective computing investigates the emotional condition of human beings interacting with computers by means of sophisticated algorithms. Systems that integrate this technology in healthcare platforms allow doctors and medical staff to monitor the sentiments of their patients, while they are being treated in their private spaces. It is common knowledge that the emotional condition of patients is strongly connected to the healing process and their health. Therefore, being aware of the psychological peaks and troughs of a patient, provides the advantage of timely intervention by specialists or closely related kinsfolk. In this context, the developed approach describes an emotion analysis scheme which exploits the fast and consistent properties of the Speeded-Up Robust Features (SURF) algorithm in order to identify the existence of seven different sentiments in human faces. The whole functionality is provided as a web service for the healthcare platform during regular Web RTC video teleconference sessions between authorized medical personnel and patients. The paper discusses the technical details of the implementation and the incorporation of the proposed scheme and provides initial results of its accuracy and operation in practice.

**Keywords:** Healthcare, Platforms. Affective, Computing. Hospital Bedside Infotainment Systems, WebRTC, Speeded Up Robust Features (SURF), Emotion Analysis
# 1. Introduction

While the relation between the psychological status of human beings and their health was acknowledged in numerous studies [5-7] in the past years, conventional medicine failed to exploit this notion. In practice, it is only recently that medical experts, in parallel with the routine treatment, are investing in the improvement of the emotional status of their patients to reinforce the effects of provided therapy. Towards the same direction, bioinformatics researchers are investigating methods to better interpret, distinguish, process and quantify sentiments from various human expressions (body posture [4], speech [1], facial expression [3]), all summarized in what is called Affective Computing (AC) or Artificial Emotional Intelligence. Depending on the source of the human expression, affective computing is divided in three main categories: a. Facial Emotion Recognition (FER), b. Speech Emotion Recognition (SER), c. Posture Emotion Recognition (PER).

The importance of affective computing systems is highlighted by the engagement of many IT colossi (Google [8], IBM [10], Microsoft [9]) to implement systems of real-time affective analysis of multimedia data depicting human faces and silhouettes. As far as healthcare platforms are concerned, integrating equivalent schemes in systems which bear the responsibility of monitoring and managing patients’ biosignals is of great significance to the healing procedure, especially in the case of chronic diseases. In brief, the generation of positive emotions assists in keeping the patient in a stable psychological condition, which is the basis for fast and efficient treatment [33], whereas negative ones have the opposite effect. Apart from the integration of affective systems in healthcare platforms, rapid development of emotional AI techniques has been reported in a wide range of areas, namely Virtual Reality, Augmented Reality, Advanced Driver Assistance and Smart Infotainment as part of a general trend leading towards the alignment with human-centered computing.

In this paper, we describe the design and deployment of a FER system, incorporated in a healthcare management system as a web service to provide functionalities through the entire lifecycle of the Medical Staff - Kinsfolk - Patient interaction. Motivated by the improved results that a treatment can have when combined with the psychological management of the patient, this system will provide the ability of real time measurement and quantification of the patient’s emotions for the medical staff to assess and act upon. Moreover, correlating the emotion measurements with health-related markers collected by the system may lead to important newly discovered knowledge.

The remainder of this paper is structured in 6 sections, as follows: Section 2 presents the related research works, while Section 3 describes the proposed emotion analysis system architecture. Section 4 describes the system in practice and Section 5 reports the experiments conducted and the corresponding results. Finally, Section 6 concludes the paper.
## 2 Related Work

As stated earlier, the analysis, recognition and evaluation of human sentiment via pattern recognition techniques does not rely solely in the processing of facial expressions, but in the quantification of body posture and speech as well. Focusing on SER, several approaches have been proposed in the literature for the extraction of vocal features and their exploitation in forming appropriate classifying models. Methods based on the extraction of low-level features like raw pitch and energy contour [12, 13] are outperformed by high level features utilizing Deep Neural Network [14] to an extend of 20% better accuracy. PER is the least examined territory related to the field of AC. The interpretation of human emotions from body posture in an attempt to assist individuals that suffer from autism spectrum disorder is described in [15], while an approach based on theoretical frameworks investigates the correlation between patterns of body movement and emotions [16]. On the other hand, FER methodologies vary from the exploitation of Deep Belief Networks combined with Machine Learning Data Pipeline features [17], the utilization of a Hierarchical Bayesian Theme Model based on the extraction of Scale Invariant Feature Transform features [18], the capitalization of Online Sequential Extreme Learning Machine method [19] to Stepwise Linear Discriminative Analysis with Hidden Conditional Random Fields [20]. In addition, hybrid implementations of all the above-mentioned approaches that combine FER and SER are available in the literature to complete the puzzle of Affective computing methodologies [21].

In general, affective computing has been widely deployed in the blooming field of electronic healthcare. As examples of such applications, patients' breathe is managed via emotion recognition carried out by Microsoft Kinect sensor in [22], while in [23] sentiments are analyzed via a facial landmark detecting algorithm from patients suffering from Alzheimer. Another application in electronic healthcare systems is the detection of potential Parkinson patients by recognizing facial impairment when certain expressions are formed with the generation of specific emotions [24].

An innovative notion concerning healthcare solutions is the hospital bedside infotainment systems (HBIS). These systems are designed to enhance medical staff - patient communication and promote patients' clinical experience. Comprising internet, video, movies, radio, music, video or telephone chatting with authorized personnel or kinsfolk and biosignals monitoring in one device and connected to the Electronic Health Record (EHR), it can be proven a productive tool for healthcare ecosystems [11]. Furthermore, constant monitoring of patients can assist in the improvement of their health status and lead to early detection of potential setbacks like detection of outliers [34], poor medication adherence, changes in sleep habits.

Despite the fact that HBIS and emotion analysis services exist as stand-alone cloud-based applications, the combination of the aforementioned advances in a platform is a newly breed idea with positive effects concerning the timely intervention of specialists and kinsfolk when negative emotions or depression is detected.
# 3 System Architecture

## 3.1 Overview

The FER Restful web service is built to provide functionality as an additional feature of an existing hospital bedside infotainment system and assisted living solution [25]. The target group of this system are patients who suffer from chronic diseases or are obliged to stay in rehabilitation centers for long periods due to the reduced mobility. Another group of people affected are the elders who live independently or in far regions and conduct routine medical teleconsultations with doctors and caregivers [26]. Although the existing system provides numerous features like the monitoring of patients' biosignals through a mobile application while conducting measurements via wearables and Bluetooth enabled devices as illustrated in Figure 1, the contribution of this paper is focused on the real-time video communication functionality through which the ability of communication with their medical experts and kinsfolk in a 24/7 basis is rendered. The FER service operates in parallel with the video communication functionality and is called upon request of the doctor. As mentioned earlier, the importance of automated analysis of facial emotion expression is high, especially to patients and elderly people whose health status is strongly connected to their psychological condition and emotion management. In reference to the FER service, it is divided in two modules: a) the face extraction module, b) the emotion recognition module. The face extraction module takes place in the web browser of the client side, while the emotion recognition module occurs on the cloud platform (server side).

<figure><img src="image_2.png" /><figcaption>Fig 1. Overview of the homecare platform after the integration of the FER service</figcaption></figure>

## 3.2 The Emotion Analysis Process

In general, the basic skeleton of methodologies related to FER consists of five steps: a) Preprocessing of images, b) Face's acquisition, c) Landmarks acquisition (if necessary) d) Facial Feature extraction, e) Facial Expression classification. The proposed method, specifically, comprises six steps as described in the pseudocode in Fig. 2 and as follows: a) frame extraction from the real-time streaming video, b) face detection, c) cropping of
picture to the dimensions of the detected face (Fig. 4), d) resizing the face picture to 256x256 pixels (if needed), e) analysis of the face picture for emotions, f) presentation of the emotions to the medical expert during the video conference, g) storage of generated results to the patient's personal health record. The analysis of facial images and their classification in seven different sentiments (anger, disgust, happiness, neutral, sadness, surprise, fear) is accomplished by the extraction of Speed Up Robust Features (SURF) which form a k-dimensional vector as a result of the Bag of Words technique to the extracted features. Given a collection of r images, an algorithm that extracts local features is utilized to create the visual vocabulary (Visual Vocabulary). In our case the Speeded Up Robust Features (SURF) algorithm [29] extracts n 64-dimensional vectors where n is the interest points which are automatically detected by the algorithm and, in turn, described by using a Fast Hessian Matrix (SURF Descriptor) in each one of the r images (Fig.4). Upon completion of the feature extraction process from the r images, a collection of r x n 64-dimensional vectors is formed, which represent corresponding points in a 64-dimensional space. This collection is grouped using a clustering algorithm (Kmeans++ is utilized) in k groups. The centroid of each group represents the visual word, resulting in the formation of a visual vocabulary of k visual words. The process of extracting SURF features is implemented utilizing ImageJ [27], face detection is based on the OpenCV library [28], while the processes of clustering and classification are using the WEKA tool [30].

<figure><img src="image_3.png" /><figcaption>**Fig 2.** Emotion Analysis Process as pseudocode. Green color is indicative of the functions performed client-side, red color shows the operations performed server-side</figcaption></figure>

The emotion recognition service is called during a video call (Fig.5). A sequence of image frames (1 frame per second) is captured during the WebRTC video conference. In order to avoid additional overload on the network, the Face detection module is executed locally on the web browser. Cropping the image to a face bounding box reduces the amount of data being sent from client to server which in turn results to overall improved performance of the system. This is accomplished by the utilization of the recent implementation of OpenCV library in JavaScript, which provides the functionality of OpenCV models in the JavaScript runtime environment of web browsers.
<figure><img src="image_4.png" /><figcaption>Fig 3. Jaffe Image Dataset depicting seven different emotion expressions</figcaption></figure>

<figure><img src="image_5.png" /><figcaption>Fig. 4 (left) Interest Points detected in dataset image utilizing Speeded Up Robust Features-imageJ, (right) Cropped image utilizing haar cascade classifier-opencv</figcaption></figure>

<figure><img src="image_6.png" /><figcaption>Fig.5. Emotion Analysis Operational Scenario</figcaption></figure>
## 4 The System in Practice

The functionality of the proposed solution takes place transparently as far as the users are concerned and upon selection of the medical experts. This provides the discreet capability of monitoring and registering emotional status of the patients while performing a regular video conference ‘visit’ (Fig. 6).

<figure><img src="image_7.png" /><figcaption>**Fig. 6.** Medical expert interface showing the FER results of the patient during a video conference</figcaption></figure>

The results of FER are returned from the cloud service in JSON format (Figure 7) and consequently, visualized in the user interface.

<figure><img src="image_8.png" /><figcaption>**Fig. 7.** Sample response of the FER Service</figcaption></figure>

Testing the system in practice was performed by conducting 50 video sessions of 1-minute duration. In these sessions, the client-side burden was handled by a PC with Quad core Intel Core i5-7400, while the server-side (cloud services) was deployed to an IaaS Cloud environment with two cores of Intel Xeon CPU E5-2650. Necessary internet connection for the communication along the two sides was provided by a typical 24Mbps ADSL connection. The images that are captured by the camera had a resolution was set to 640x480 pixels. Average time in milliseconds for basic operations conducted in client side and server side are measured and depicted in Table 1 and 2 respectively.
Average time allotment for the uploading of the cropped image file from client to server is 70ms. Observation of the measurements in both sides demonstrates that the most time-consuming operation is the feature extraction from the cropped image (server side), followed by the uploading of the image file in the client side. In addition, operations performed in the server side are far more expensive in time than those in client side, which was expected and strategically planned for the discharge of all the computationally demanding tasks from the web browser.

<table><caption>**Table 1** Average time allotment for performing operations in the client side</caption><thead><tr><th colspan="6">FER Operations (Client Side)</th></tr><tr><th>Frame Extraction</th><th>Face Detection</th><th>Face bounding box generation</th><th>Face cropping</th><th>Image file creation</th><th>Time (sum)</th></tr></thead><tbody><tr><td>10ms</td><td>105ms</td><td>3ms</td><td>5ms</td><td>6ms</td><td>129ms</td></tr></tbody></table>

<table><caption>**Table 2** Time allotment for performing operations in the server side</caption><thead><tr><th rowspan="2">Web service invocation</th><th colspan="6">FER Operations (Server Side)</th></tr><tr><th>Feature Extraction</th><th>Visual Vocabulary Loading (only once)</th><th>Image to Vector Transformation</th><th>Prediction Model Loading (only once)</th><th>Image Classification</th><th>Time (sum)</th></tr></thead><tbody><tr><td>Beginning of session</td><td>200ms</td><td>178ms</td><td>142ms</td><td>157ms</td><td>1ms</td><td>678ms</td></tr><tr><td>All other calls</td><td>200ms</td><td>-</td><td>142ms</td><td>-</td><td>1ms</td><td>243ms</td></tr></tbody></table>

Further experimentation on the requirement of running face detection on the front end is presented in Table 3. The Table illustrates the produced overhead for network, browser's memory and CPU for the two scenarios, one for the image size set to 320x240 indicated as s (s for small) and the other set to 640x480 accordingly indicated with (l).

<table><caption>**Table 3.** Resources allotment for face detection on the web browser.</caption><thead><tr><th rowspan="2"></th><th colspan="5">Face detection Specs (Front End)</th></tr><tr><th>Idle (l)</th><th>Frame (l)</th><th>Face (l)</th><th>Frame (s)</th><th>Face (s)</th></tr></thead><tbody><tr><th>Memory</th><td>3.9GB</td><td>4.1GB</td><td>4.1GB</td><td>4.0GB</td><td>4.0GB</td></tr><tr><th>CPU</th><td>~30%</td><td>~33%</td><td>~45%</td><td>~33%</td><td>~45%</td></tr><tr><th>Data</th><td>-</td><td>~400KB</td><td>~65KB</td><td>~122KB</td><td>~18KB</td></tr></tbody></table>
When idle, image is processed in 640x480; therefore, idle for (s) scenario does not exist. The experiment was conducted using the Mozilla Firefox browser (version 0.66), but the module also operates in Opera 58.0.3135.117 (64bit) and Google Chrome 73.0.3683.86 (64-bit) without any issues. The experiments demonstrated that memory consumption is insignificantly influenced in all scenarios, whereas large variations are evidenced in data length as expected.

# 5 Experimental Results

While the main objective of this paper is the presentation of integration of a FER web service into a homecare platform, initial results for two scenarios of the classification of the JAFFE [31] dataset are provided. The first scenario splits the dataset into two emotional categories (positive and negative emotions, an assumption is made that anger, fear, disgust, sadness are negative emotions) and the second scenario seven emotional categories (anger, fear, disgust, neutral, happiness, surprise, sadness-Fig.3) are provided with the utilization of various classifiers. The procedure is conducted following the 10-fold cross-validation of the whole JAFFE dataset (214 images, 256x256 pixels, grayscale). In order to discover the more efficient space representation of the training dataset, extensive testing of the Bag of Visual Word scheme was conducted. Kmeans++ method (350 clusters, 70 seeds) was selected among Kmeans, Canopy and Farthest First WEKA's implementations for its ability to better distinguish inter-class and intra-class relationships. Kmeans++ improves the initialization phase of the Kmeans clustering algorithm by selecting strategically the initial seeds [32].

<table><caption>**Table 4.** Classification accuracy results for JAFFE dataset</caption><thead><tr><th rowspan="2">Classifier</th><th colspan="2">Experiments</th></tr><tr><th>Scenario 1 (Two emotional categories)</th><th>Scenario 2 (Seven emotional categories)</th></tr></thead><tbody><tr><td>Random Forest</td><td>92,01%</td><td>77,46%</td></tr><tr><td>Naïve Bayes</td><td>87,79%</td><td>54,92%</td></tr><tr><td>MLP</td><td>93,48%</td><td>73,23%</td></tr><tr><td>Sequential Minimum Optimization</td><td>93,42%</td><td>74,64%</td></tr><tr><td>Logistic</td><td>92,01%</td><td>71%</td></tr><tr><td>K Star</td><td><strong>93,42%</strong></td><td><strong>84,03%</strong></td></tr><tr><td>LMT</td><td>89,67%</td><td>67,43%</td></tr></tbody></table>
The accuracy of the emotion detection module is provided in Table 4. A Multilayer Perceptron (learning rate:0.3, momentum rate: 0.2, epoch number: 500, threshold for number of consecutive errors: 20) reaches a 93.48% classification accuracy for the first scenario while the selection of K Star classifier (manual blend:20%, value missing replaced with average) from the Weka library, achieves the best accuracy (84.03%) for the second scenario.

# 6 Conclusion

Whereas other affective computing systems operate as stand-alone applications, this paper presents an innovative facial emotion recognition web service, integrated in a healthcare information system for monitoring and timely management of emotional fluctuations of elders and patients with chronic diseases as part of a human-centric treatment. The value of the provided functionality to classify faces into corresponding sentiments real-time during video communication sessions is of great significance especially in cases of patients with diseases related to their psychosomatic condition. Future work will be focused in the realization of a service that can execute emotion recognition in the web browser. This feature will liberate the application from its cloud based imposed restrictions. Concerning the classification performance towards the improvement of accuracy of the current prediction model, other schemes of Bag of Words techniques will be tested in an effort to provide weighted and localized information of the Visual words. Although results are promising, further testing with the utilization of larger and Caucasian oriented labeled dataset should be performed towards more thorough evaluation of the system. Correlating emotion recognition results along with information related to the biosignals and everyday routine activities of individual patients can lead to the discovery of specific patterns and valuable knowledge to the medical community.

# Acknowledgment

This research has been co-financed by the European Union and Greek national funds through the Operational Program Competitiveness, Entrepreneurship and Innovation, under the call RESEARCH – CREATE – INNOVATE (SISEI: Smart Infotainment System with Emotional Intelligence, project code: T1EDK-01046).

# 7 References

1. Gunawan, Teddy & Alghifari, M.F. & Morshidi, M.A. & Kartiwi, Mira. (2018). A review on emotion recognition algorithms using speech analysis. Indonesian Journal of Electrical Engineering and Informatics. 6. 12-20.

2. Chen, M.; Yang, J.; Hao, Y.; Mao, S.; Hwang, K. A 5G Cognitive System for Healthcare. *Big Data Cogn. Comput.* 2017, **1**, 2.
3. Ko B. C. (2018). A Brief Review of Facial Emotion Recognition Based on Visual Information. Sensors (Basel, Switzerland), 18(2), 401.

4. Dael, Nele & Mortillaro, Marcello & Scherer, Klaus. (2011). Emotion Expression in Body Action and Posture. Emotion (Washington, D.C.). 12. 1085-101. 10.1037/a0025737.

5. Christina M. DuBois, Oriana Vesga Lopez, Eleanor E. Beale, Brian C. Healy, Julia K. Boehm, Jeff C. Huffman, Relationships between positive psychological constructs and health outcomes in patients with cardiovascular disease: A systematic review, International Journal of Cardiology, Volume 195, 2015, Pages 265-280, ISSN 0167-5273, https://doi.org/10.1016/j.ijcard.2015.05.121

6. Amanda J. Burger, Mark A. Lumley, Jennifer N. Carty, Deborah V. Latsch, Elyse R. Thakur, Maren E. Hyde-Nolan, Alaa M. Hijazi, Howard Schubiner, The effects of a novel psychological attribution and emotional awareness and expression therapy for chronic musculoskeletal pain: A preliminary, uncontrolled trial, Journal of Psychosomatic Research, Volume 81, 2016, Pages 1-8.

7. Huffman, J.C., Millstein, R.A., Mastromauro, C.A. et al. J Happiness Stud (2016) 17: 1985.

8. Google Cloud Vision API Homepage: https://cloud.google.com/vision/

9. Microsoft Cognitive Services Homepage: https://azure.microsoft.com/en-us/services/cognitive-services/

10. IBM Watson Visual Recognition Homepage: https://www.ibm.com/watson/services/visual-recognition/

11. Ø. Dale, E. Sundby Boysen and I. Svagård, One Size Does Not Fit all: Design and implementation considerations when introducing touch-based infotainment systems to nursing home residents, computers helping people with special needs: 15th International Conference, ICCHP 2016, Linz, Austria, July 13-15, 2016, proceedings. Part I

12. B. Schuller, G. Rigoll, and M. Lang, "Hidden markov model-based speech emotion recognition," in Proceedings of IEEE ICASSP 2003, vol. 2. IEEE, 2003, pp. II-1.

13. T. L. Nwe, N. T. Hieu, and D. K. Limbu, "Bhattacharyya distance based emotional dissimilarity measure for emotion classification," in Proceedings of IEEE ICASSP 2013. IEEE, 2013, pp. 7512-7516.

14. K. Han, D. Yu and I. Tashev, "Speech Emotion Recognition Using Deep Neural Network and Extreme Learning Machine," Interspeech 2014, pp.223-227, 2014.

15. Libero, L. E., Stevens, C. E. and Kana, R. K. (2014), Attribution of emotions to body postures: An independent component analysis study of functional connectivity in autism. Hum. Brain Mapp., 35: 5204-5218.

16. Dael, N.; Mortillaro, M.; Scherer, K.R. Emotion expression in body action and posture. Emotion 2012, 12, 1085-1101.

17. M. Z. Uddin, M. M. Hassan, A. Almogren, M. Zuair, G. Fortino, and J. Torresen, "A facial expression recognition system using robust face features from depth videos and deep learning," Comput. Electr. Eng., vol. 63, pp. 114-125, 2017.

18. Q. Mao, Q. Rao, Y. Yu, and M. Dong, "Hierarchical Bayesian Theme Models for Multipose Facial Expression Recognition," IEEE Trans. Multimed., vol. 19, no. 4, pp. 861-873, 2017.

19. Cossetin, Marcelo J. and Nievola, Julio C. and L. Koerich, Alessandro. 2016. « Facial expression recognition using a pairwise feature selection and classification approach ». In 2016 International Joint Conference on Neural Networks (IJCNN) (Vancouver, BC, Canada, July 24-29, 2016), pp. 5149-5155. IEEE.
20. M. H. Siddiqi, R. Ali, A. M. Khan, Y. Park and S. Lee, "Human Facial Expression Recognition Using Stepwise Linear Discriminant Analysis and Hidden Conditional Random Fields," in *IEEE Transactions on Image Processing*, vol. 24, no. 4, pp. 1386-1398, April 2015.

21. Ekman, P. (1993). Facial expression and emotion. American psychologist, 48(4), 384.

22. Dantcheva, A., Bilinski, P., Broutart, J. C., Robert, P., & Bremond, F. (2016). Emotion facial recognition by the means of automatic video analysis. *Gerontechnology Journal*, *International Society for Gerontechnology*, 2016.

23. Tivatansakul, S., Chalumporn, G., Puangpontip, S., Kankanokkul, Y., Achalaku, T., & Ohkura, M. (2014). Healthcare system focusing on emotional aspect using augmented reality: Emotion detection by facial expression. *Advances in Human Aspects of Healthcare*, 3, 375.

24. Almutiry R., Couth S., Poliakoff E., Kotz S., Silverdale M., Cootes T. (2016) Facial Behaviour Analysis in Parkinson's Disease. In: Zheng G., Liao H., Jannin P., Cattin P., Lee SL. (eds) Medical Imaging and Augmented Reality. MIAR 2016. Lecture Notes in Computer Science, vol 9805. Springer, Cham

25. Menychtas, A., Tsanakas, P., & Maglogiannis, I. (2016). Automated integration of wireless biosignal collection devices for patient-centred decision-making in point-of-care systems. *Healthcare technology letters*, 3(1), 34-40.

26. Panagopoulos, C., et al. (2017). Utilizing a homecare platform for remote monitoring of patients with idiopathic pulmonary fibrosis. In GeNeDis 2016 (pp. 177-187). Springer, Cham.

27. ImageJ Homepage: https://imagej.net.

28. Bradski, G., & Kaehler, A. (2008). Learning OpenCV: Computer vision with the OpenCV library. " O'Reilly Media, Inc.".

29. Bay, H., Tuytelaars, T., Gool, V.G.: Speeded Up Robust Features. Computer Vision and Image Understanding, Volume 110, Issue 3, June 2008, pp. 346-359.

30. Weka 3, Data Mining Software in Java Homepage: https://cs.waikato.ac.nz/ml/weka

31. Lyons M. J., Akemastu S., Kamachi M., Gyoba J., Coding Facial Expressions with Gabor Wavelets, 3rd IEEE International Conference on Automatic Face and Gesture Recognition, pp. 200-205 (1998).

32. Arthur D, Vassilvitskii S. Proceedings of the eighteenth annual ACM-SIAM symposium on Discrete algorithms. Philadelphia, PA, USA: Society for Industrial and Applied Mathematics, SODA '07; 2007. k-means++: The advantages of careful seeding; pp. 1027-1035.

33. Chakhssi F, Kraiss JT, Sommers-Spijkerman M, Bohlmeijer ET. The effect of positive psychology interventions on well-being and distress in clinical samples with psychiatric or somatic disorders: a systematic review and meta-analysis. BMC Psychiatry. 2018;18(1):211.

34. Fouad, Hafez & Sci Eg, Hafez@eri. (2014). Continuous Health-monitoring for early Detection of Patient by Web Telemedicine System. In International Conference on Circuits, Systems and Signal Processing, Saint Petersburg State Politechnical University, Russia, Sep,23-25, 2014.