Comparative validity of energy expenditure prediction algorithms using wearable devices for people with spinal cord injury

Predicting physical activity intensity using raw accelerometer signals in manual wheelchair users with spinal cord injury

STUDY DESIGN

Cross-sectional validation study.

OBJECTIVES

The performance of previously published physical activity (PA) intensity cutoff thresholds based on proprietary ActiGraph counts for manual wheelchair users (MWUs) with spinal cord injury (SCI) was initially evaluated using an out-of-sample dataset of 60 individuals with SCI. Two types of PA intensity classification models based on raw accelerometer signals were developed and evaluated.

SETTING

Research institutions in Pittsburgh PA, Birmingham AL, and Bronx NY.

METHODS

Data were collected from 60 MWUs with SCI who followed a structured activity protocol while wearing an ActiGraph activity monitor on their dominant wrist and portable metabolic cart which measured criterion PA intensity. Data was used to assess published models as well as develop and assess custom models using recall, specificity, precision, as well as normalized Mathew's correlation coefficient (nMCC).

RESULTS

All the models performed well for predicting sedentary vs non-sedentary activity, yielding an nMCC of 0.87-0.90. However, all models demonstrated inadequate performance for predicting moderate to vigorous PA (MVPA) with an nMCC of 0.76-0.82.

CONCLUSIONS

The mean absolute deviation (MAD) cutoff threshold yielded the best performance for predicting sedentary vs non-sedentary PA and may be used for tracking daily sedentary activity. None of the models displayed strong performance for MVPA vs non-MVPA. Future studies should investigate combining physiological measures with accelerometry to yield better prediction accuracies for MVPA.

Validation of Using Smartphone Built-In Accelerometers to Estimate the Active Energy Expenditures of Full-Time Manual Wheelchair Users with Spinal Cord Injury

This study aimed to investigate the validity of using built-in smartphone accelerometers to estimate the active energy expenditures of full-time manual wheelchair users with spinal cord injury (SCI). Twenty participants with complete SCI completed 10 5-min daily activities that involved the upper limbs, during which their oxygen consumption and upper limb activity were registered using a portable gas analyzer and a smartphone (placed on the non-dominant arm), respectively. Time series of 1-min averaged oxygen consumption and 55 accelerometer variables (13 variables for each of the four axes and three additional variables for the correlations between axes) were used to estimate three multiple linear models, using a 10-fold cross-validation method. The results showed that models that included either all variables and models or that only included the linear variables showed comparable performance, with a correlation of 0.72. Slightly worse general performance was demonstrated by the model that only included non-linear variables, although it proved to be more accurate at estimating the energy expenditures (EE) during specific tasks. These results suggest that smartphones could be a promising low-cost alternative to laboratory-grade accelerometers to estimate the energy expenditure of wheelchair users with spinal cord injury during daily activities.

The Validity of MotionSense HRV in Estimating Sedentary Behavior and Physical Activity under Free-Living and Simulated Activity Settings

MotionSense HRV is a wrist-worn accelerometery-based sensor that is paired with a smartphone and is thus capable of measuring the intensity, duration, and frequency of physical activity (PA). However, little information is available on the validity of the MotionSense HRV. Therefore, the purpose of this study was to assess the concurrent validity of the MotionSense HRV in estimating sedentary behavior (SED) and PA. A total of 20 healthy adults (age: 32.5 ± 15.1 years) wore the MotionSense HRV and ActiGraph GT9X accelerometer (GT9X) on their non-dominant wrist for seven consecutive days during free-living conditions. Raw acceleration data from the devices were summarized into average time (min/day) spent in SED and moderate-to-vigorous PA (MVPA). Additionally, using the Cosemed K5 indirect calorimetry system (K5) as a criterion measure, the validity of the MotionSense HRV was examined in simulated free-living conditions. Pearson correlations, mean absolute percent errors (MAPE), Bland–Altman (BA) plots, and equivalence tests were used to examine the validity of the MotionSense HRV against criterion measures. The correlations between the MotionSense HRV and GT9X were high and the MAPE were low for both the SED (r = 0.99, MAPE = 2.4%) and MVPA (r = 0.97, MAPE = 9.1%) estimates under free-living conditions. BA plots illustrated that there was no systematic bias between the MotionSense HRV and criterion measures. The estimates of SED and MVPA from the MotionSense HRV were significantly equivalent to those from the GT9X; the equivalence zones were set at 16.5% for SED and 29% for MVPA. The estimates of SED and PA from the MotionSense HRV were less comparable when compared with those from the K5. The MotionSense HRV yielded comparable estimates for SED and PA when compared with the GT9X accelerometer under free-living conditions. We confirmed the promising application of the MotionSense HRV for monitoring PA patterns for practical and research purposes.