Sensor-Based Detection and Objective Measurement of Physical and Social Exertional Activities: State of the Art Review (Preprint)
Authors: Mahmood Arafat , Sridevi Parama , Ahamed Sheikh Iqbal 
Published: November 2022

BACKGROUND

Human Activity Recognition is a widely researched topic. Researchers have recently put significant effort into detecting and measuring different types of physical activity. Due to their low cost, sensors are one of the most used components to recognize activities performed by humans. With the recent emergence of machine learning techniques, real-time activity monitoring is possible with raw sensor data. Estimation of energy expenditure while performing activities is also essential in healthcare research. Detection of performed physical and social activities and the exertion related to these activities are beneficial for patients with limited physical ability. Elderly patients with Chronic Fatigue Syndrome / Myalgic Encephalomyelitis (CFS/ME) become fatigued with little effort and later suffer from malaise and poor and unrefreshing sleep. They need to know their daily energy expenditure with their activities at any time to avoid fatigue. Therefore, a comprehensive study of physical and social activity detection and analysis of the existing methods of energy expenditure calculation in the healthcare domain is required.

OBJECTIVE

The first objective of this paper is to explore existing activity recognition methods and find out the best practices in processing sensor data, machine learning techniques and their challenges, and the approaches to detect social exertion. Secondly, we want to compare existing energy expenditure measurement techniques mentioned in the literature.

METHODS

We searched for articles related to physical and social activity recognition and methods of calculating energy expenditure. We compared the sensors used in the research to find the best possible combination and configuration for different activity types. We also explored the literature’s pre-processing, feature extraction, and machine-learning techniques applied to raw sensor data.

RESULTS

Accelerometers are the most used sensor to get important information about leg and hand activities. Gyroscopes and gravity sensors are the following choices of sensors combined with the accelerometer. Sensors are set at a frequency range of 20-50 Hz. Smartphones are the most popular choice for data collection. Many sensor-based healthcare researchers use smartphones as a point-of-care solution to collect data and provide feedback based on the data. Wrist-worn sensor devices provide better context than smartphones for hand-performed activities. The microphone of smartphones and smartwatches can detect social exertion and stress levels from contextual information about the surrounding. Objective measures are the best way to get a proper and unbiased energy expenditure. Metabolic Equivalent of Task (MET) is the most popular unit for intensity measurement.

CONCLUSIONS

This literature comprehensively reviews recent sensor-based research to detect and measure physical activities. There are very few systems that detect and measure physical activities by using sensors. With the outgrowing number of patients with limited capability of performing day-to-day life activities, we need improved methods to develop such a system.