Quantitative Contact-Less Estimation of Energy Expenditure from Video and 3D Imagery

Accessibility and use of novel methods for predicting physical activity and energy expenditure using accelerometry: a scoping review

Use of raw acceleration data and/or "novel" analytic approaches like machine learning for physical activity measurement will not be widely implemented if methods are not accessible to researchers.

OBJECTIVE

This scoping review characterizes the validation approach, accessibility and use of novel analytic techniques for classifying energy expenditure and/or physical activity intensity using raw or count-based accelerometer data.

APPROACH

Three databases were searched for articles published between January 2000 and February 2021. Use of each method was coded from a list of citing articles compiled from Google Scholar. Authors' provision of access to the model (e.g., by request, sample code) was recorded.

MAIN RESULTS

Studies (N=168) included adults (n=143), and/or children (n=38). Model use ranged from 0 to 27 uses/year (average 0.83) with 101 models that have never been used. Approximately half of uses occurred in a free-living setting (52%) and/or by other authors (56%). Over half of included articles (n=107) did not provide complete access to their model. Sixty-one articles provided access to their method by including equations, coefficients, cut-points, or decision trees in the paper (n=48) and/or by providing access to code (n=13).

SIGNIFICANCE

The proliferation of approaches for analyzing accelerometer data outpaces the use of these models in practice. As less than half of the developed models are made accessible, it is unsurprising that so many models are not used by other researchers. We encourage researchers to make their models available and accessible for better harmonization of methods and improved capabilities for device-based physical activity measurement.

Ambient and Wearable Sensor Technologies for Energy Expenditure Quantification of Ageing Adults

COVID-19 has affected daily life in unprecedented ways, with dramatic changes in mental health, sleep time and level of physical activity. These changes have been especially relevant in the elderly population, with important health-related consequences. In this work, two different sensor technologies were used to quantify the energy expenditure of ageing adults. To this end, a technological platform based on Raspberry Pi 4, as an elaboration unit, was designed and implemented. It integrates an ambient sensor node, a wearable sensor node and a coordinator node that uses the information provided by the two sensor technologies in a combined manner. Ambient and wearable sensors are used for the real-time recognition of four human postures (standing, sitting, bending and lying down), walking activity and for energy expenditure quantification. An important first aim of this work was to realize a platform with a high level of user acceptability. In fact, through the use of two unobtrusive sensors and a low-cost processing unit, the solution is easily accessible and usable in the domestic environment; moreover, it is versatile since it can be used by end-users who accept being monitored by a specific sensor. Another added value of the platform is the ability to abstract from sensing technologies, as the use of human posture and walking activity for energy expenditure quantification enables the integration of a wide set of devices, provided that they can reproduce the same set of features. The obtained results showed the ability of the proposed platform to automatically quantify energy expenditure, both with each sensing technology and with the combined version. Specifically, for posture and walking activity classification, an average accuracy of 93.8% and 93.3% was obtained, respectively, with the wearable and ambient sensor, whereas an improvement of approximately 4% was reached using data fusion. Consequently, the estimated energy expenditure quantification always had a relative error of less than 3.2% for each end-user involved in the experimentation stage, classifying the high level information (postures and walking activities) with the combined version of the platform, justifying the proposed overall architecture from a hardware and software point of view.

Depth-Camera Based Energy Expenditure Estimation System for Physical Activity Using Posture Classification Algorithm

Insufficient physical activity is common in modern society. By estimating the energy expenditure (EE) of different physical activities, people can develop suitable exercise plans to improve their lifestyle quality. However, several limitations still exist in the related works. Therefore, the aim of this study is to propose an accurate EE estimation model based on depth camera data with physical activity classification to solve the limitations in the previous research. To decide the best location and amount of cameras of the EE estimation, three depth cameras were set at three locations, namely the side, rear side, and rear views, to obtain the kinematic data and EE estimation. Support vector machine was used for physical activity classification. Three EE estimation models, namely linear regression, multilayer perceptron (MLP), and convolutional neural network (CNN) models, were compared and determined the model with optimal performance in different experimental settings. The results have shown that if only one depth camera is available, optimal EE estimation can be obtained using the side view and MLP model. The mean absolute error (MAE), mean square error (MSE), and root MSE (RMSE) of the classification results under the aforementioned settings were 0.55, 0.66, and 0.81, respectively. If higher accuracy is required, two depth cameras can be set at the side and rear views, the CNN model can be used for light-to-moderate activities, and the MLP model can be used for vigorous activities. The RMSEs for estimating the EEs of standing, walking, and running were 0.19, 0.57, and 0.96, respectively. By applying the different models on different amounts of cameras, the optimal performance can be obtained, and this is also the first study to discuss the issue.

Quantifying Physical Activity in Young Children Using a Three-Dimensional Camera

The purpose of this study was to determine the feasibility and validity of using three-dimensional (3D) video data and computer vision to estimate physical activity intensities in young children. Families with children (2–5-years-old) were invited to participate in semi-structured 20-minute play sessions that included a range of indoor play activities. During the play session, children’s physical activity (PA) was recorded using a 3D camera. PA video data were analyzed via direct observation, and 3D PA video data were processed and converted into triaxial PA accelerations using computer vision. PA video data from children (n = 10) were analyzed using direct observation as the ground truth, and the Receiver Operating Characteristic Area Under the Curve (AUC) was calculated in order to determine the classification accuracy of a Classification and Regression Tree (CART) algorithm for estimating PA intensity from video data. A CART algorithm accurately estimated the proportion of time that children spent sedentary (AUC = 0.89) in light PA (AUC = 0.87) and moderate-vigorous PA (AUC = 0.92) during the play session, and there were no significant differences (p > 0.05) between the directly observed and CART-determined proportions of time spent in each activity intensity. A computer vision algorithm and 3D camera can be used to estimate the proportion of time that children spend in all activity intensities indoors.