A Framework to Evaluate Devices That Assess Physical Behavior

Monitoring of child-specific activities in ambulatory children with and without developmental disabilities

BACKGROUND

Pediatric healthcare professionals facilitate children to enhance and maintain a physically active lifestyle. Activity monitors (AM) can help pediatric healthcare professionals assess physical activity in everyday life. However, validation research of activity monitors has often been conducted in laboratories and insight into physical activity of children in their own everyday environment is lacking. Our goal was to study the criterion validity of a prototype AM (AM-p) model in a natural setting.

METHODS

Cross-sectional community-based study with ambulatory children (2-19 years) with and without developmental disability. Children wore the AM-p on the ankle and were filmed (gold standard) while performing an activity protocol in a natural setting. We labelled all videos per 5-second epoch with individual activity labels. Raw AM-p data were synchronized with activity labels. Using machine learning techniques, activity labels were subdivided in three pre-defined categories. Accuracy, recall, precision, and F1 score were calculated per category.

RESULTS

We analyzed data of 93 children, of which 28 had a developmental disability. Mean age was 11 years (SD 4.5) with 55% girls. The AM-p model differentiated between 'stationary', 'cycling' and 'locomotion' activities with an accuracy of 82%, recall of 78%, precision of 75%, and F1 score of 75%, respectively. Children older than 13 years with typical development can be assessed more accurately than younger children (2-12 years) with and without developmental disabilities.

CONCLUSION

The single ankle-worn AM-p model can differentiate between three activity categories in children with and without developmental disabilities with good accuracy (82%). Because the AM-p can be used for a heterogenous group of ambulatory children with and without developmental disabilities, it may support the clinical assessment for pediatric healthcare professionals in the future.

Jerks are useful: extracting pulse rate from wrist-placed accelerometry jerk during sleep in children

STUDY OBJECTIVES

Evaluate wrist-placed accelerometry predicted heartrate compared to electrocardiogram (ECG) heartrate in children during sleep.

METHODS

Children (n = 82, 61% male, 43.9% black) wore a wrist-placed Apple Watch Series 7 (AWS7) and ActiGraph GT9X during a polysomnogram. Three-Axis accelerometry data was extracted from AWS7 and the GT9X. Accelerometry heartrate estimates were derived from jerk (the rate of acceleration change), computed using the peak magnitude frequency in short time Fourier Transforms of Hilbert transformed jerk computed from acceleration magnitude. Heartrates from ECG traces were estimated from R-R intervals using R-pulse detection. Lin's concordance correlation coefficient (CCC), mean absolute error (MAE), and mean absolute percent error (MAPE) assessed agreement with ECG estimated heart rate. Secondary analyses explored agreement by polysomnography sleep stage and a signal quality metric.

RESULTS

The developed scripts are available on Github. For the GT9X, CCC was poor at -0.11 and MAE and MAPE were high at 16.8 (SD = 14.2) beats/minute and 20.4% (SD = 18.5%). For AWS7, CCC was moderate at 0.61 while MAE and MAPE were lower at 6.4 (SD = 9.9) beats/minute and 7.3% (SD = 10.3%). Accelerometry estimated heartrate for AWS7 was more closely related to ECG heartrate during N2, N3 and REM sleep than lights on, wake, and N1 and when signal quality was high. These patterns were not evident for the GT9X.

CONCLUSIONS

Raw accelerometry data extracted from AWS7, but not the GT9X, can be used to estimate heartrate in children while they sleep. Future work is needed to explore the sources (i.e. hardware, software, etc.) of the GT9X's poor performance.

Assessing the Accuracy of Activity Classification Using Thigh-Worn Accelerometry: A Validation Study of ActiPASS in School-Aged Children

BACKGROUND

The ActiPASS software was developed from the open-source Acti4 activity classification algorithm for thigh-worn accelerometry. However, the original algorithm has not been validated in children or compared with a child-specific set of algorithm thresholds. This study aims to evaluate the accuracy of ActiPASS in classifying activity types in children using 2 published sets of Acti4 thresholds.

METHODS

Laboratory and free-living data from 2 previous studies were used. The laboratory condition included 41 school-aged children (11.0 [4.8] y; 46.5% male), and the free-living condition included 15 children (10.0 [2.6] y; 66.6% male). Participants wore a single accelerometer on the dominant thigh, and annotated video recordings were used as a reference. Postures and activity types were classified with ActiPASS using the original adult thresholds and a child-specific set of thresholds.

RESULTS

Using the original adult thresholds, the mean balanced accuracy (95% CI) for the laboratory condition ranged from 0.62 (0.56-0.67) for lying to 0.97 (0.94-0.99) for running. For the free-living condition, accuracy ranged from 0.61 (0.48-0.75) for lying to 0.96 (0.92-0.99) for cycling. Mean balanced accuracy for overall sedentary behavior (sitting and lying) was ≥0.97 (0.95-0.99) across all thresholds and conditions. No meaningful differences were found between the 2 sets of thresholds, except for superior balanced accuracy of the adult thresholds for walking under laboratory conditions.

CONCLUSIONS

The results indicate that ActiPASS can accurately classify different basic types of physical activity and sedentary behavior in children using thigh-worn accelerometer data.

Accelerometer techniques for capturing human movement validated against direct observation: a scoping review

Objective.Accelerometers are devices commonly used to measure human physical activity and sedentary time. Accelerometer capabilities and analytical techniques have evolved rapidly, making it difficult for researchers to keep track of advances and best practices for data processing and analysis. The objective of this scoping review is to determine the existing methods for analyzing accelerometer data for capturing human movement which have been validated against the criterion measure of direct observation.Approach.This scoping review searched 14 academic and 5 grey databases. Two independent raters screened by title and abstract, then full text. Data were extracted using Microsoft Excel and checked by an independent reviewer.Mainresults.The search yielded 1039 papers and the final analysis included 115 papers. A total of 71 unique accelerometer models were used across a total of 4217 participants. While all studies underwent validation from direct observation, most direct observation occurred live (55%) or using recordings (42%). Analysis techniques included machine learning (ML) approaches (22%), the use of existing cut-points (18%), receiver operating characteristic curves to determine cut-points (14%), and other strategies including regressions and non-ML algorithms (8%).Significance.ML techniques are becoming more prevalent and are often used for activity identification. Cut-point methods are still frequently used. Activity intensity is the most assessed activity outcome; however, both the analyses and outcomes assessed vary by wear location. This scoping review provides a comprehensive overview of accelerometer analysis and validation techniques using direct observation and is a useful tool for researchers using accelerometers.

Thigh-worn accelerometry: a comparative study of two no-code classification methods for identifying physical activity types

BACKGROUND

The more accurate we can assess human physical behaviour in free-living conditions the better we can understand its relationship with health and wellbeing. Thigh-worn accelerometry can be used to identify basic activity types as well as different postures with high accuracy. User-friendly software without the need for specialized programming may support the adoption of this method. This study aims to evaluate the classification accuracy of two novel no-code classification methods, namely SENS motion and ActiPASS.

METHODS

A sample of 38 healthy adults (30.8 ± 9.6 years; 53% female) wore the SENS motion accelerometer (12.5 Hz; ±4 g) on their thigh during various physical activities. Participants completed standardized activities with varying intensities in the laboratory. Activities included walking, running, cycling, sitting, standing, and lying down. Subsequently, participants performed unrestricted free-living activities outside of the laboratory while being video-recorded with a chest-mounted camera. Videos were annotated using a predefined labelling scheme and annotations served as a reference for the free-living condition. Classification output from the SENS motion software and ActiPASS software was compared to reference labels.

RESULTS

A total of 63.6 h of activity data were analysed. We observed a high level of agreement between the two classification algorithms and their respective references in both conditions. In the free-living condition, Cohen's kappa coefficients were 0.86 for SENS and 0.92 for ActiPASS. The mean balanced accuracy ranged from 0.81 (cycling) to 0.99 (running) for SENS and from 0.92 (walking) to 0.99 (sedentary) for ActiPASS across all activity types.

CONCLUSIONS

The study shows that two available no-code classification methods can be used to accurately identify basic physical activity types and postures. Our results highlight the accuracy of both methods based on relatively low sampling frequency data. The classification methods showed differences in performance, with lower sensitivity observed in free-living cycling (SENS) and slow treadmill walking (ActiPASS). Both methods use different sets of activity classes with varying definitions, which may explain the observed differences. Our results support the use of the SENS motion system and both no-code classification methods.

Energy expenditure estimation during activities of daily living in middle-aged and older adults using an accelerometer integrated into a hearing aid

Background

Accelerometers were traditionally worn on the hip to estimate energy expenditure (EE) during physical activity but are increasingly replaced by products worn on the wrist to enhance wear compliance, despite potential compromises in EE estimation accuracy. In the older population, where the prevalence of hearing loss is higher, a new, integrated option may arise. Thus, this study aimed to investigate the accuracy and precision of EE estimates using an accelerometer integrated into a hearing aid and compare its performance with sensors simultaneously worn on the wrist and hip.

Methods

Sixty middle-aged to older adults (average age 64.0 ± 8.0 years, 48% female) participated. They performed a 20-min resting energy expenditure measurement (after overnight fast) followed by a standardized breakfast and 13 different activities of daily living, 12 of them were individually selected from a set of 35 activities, ranging from sedentary and low intensity to more dynamic and physically demanding activities. Using indirect calorimetry as a reference for the metabolic equivalent of task (MET), we compared the EE estimations made using a hearing aid integrated device (Audéo) against those of a research device worn on the hip (ZurichMove) and consumer devices positioned on the wrist (Garmin and Fitbit). Class-estimated and class-known models were used to evaluate the accuracy and precision of EE estimates via Bland-Altman analyses.

Results

The findings reveal a mean bias and 95% limit of agreement for Audéo (class-estimated model) of -0.23 ± 3.33 METs, indicating a slight advantage over wrist-worn consumer devices (Garmin: -0.64 ± 3.53 METs and Fitbit: -0.67 ± 3.40 METs). Class-know models reveal a comparable performance between Audéo (-0.21 ± 2.51 METs) and ZurichMove (-0.13 ± 2.49 METs). Sub-analyses show substantial variability in accuracy for different activities and good accuracy when activities are averaged over a typical day's usage of 10 h (+61 ± 302 kcal).

Discussion

This study shows the potential of hearing aid-integrated accelerometers in accurately estimating EE across a wide range of activities in the target demographic, while also highlighting the necessity for ongoing optimization efforts considering precision limitations observed across both consumer and research devices.

Breaking down the Digital Fortress: The Unseen Challenges in Healthcare Technology-Lessons Learned from 10 Years of Research

Healthcare is undergoing a fundamental shift in which digital health tools are becoming ubiquitous, with the promise of improved outcomes, reduced costs, and greater efficiency. Healthcare professionals, patients, and the wider public are faced with a paradox of choice regarding technologies across multiple domains. Research is continuing to look for methods and tools to further revolutionise all aspects of health from prediction, diagnosis, treatment, and monitoring. However, despite its promise, the reality of implementing digital health tools in practice, and the scalability of innovations, remains stunted. Digital health is approaching a crossroads where we need to shift our focus away from simply looking at developing new innovations to seriously considering how we overcome the barriers that currently limit its impact. This paper summarises over 10 years of digital health experiences from a group of researchers with backgrounds in physical therapy-in order to highlight and discuss some of these key lessons-in the areas of validity, patient and public involvement, privacy, reimbursement, and interoperability. Practical learnings from this collective experience across patient cohorts are leveraged to propose a list of recommendations to enable researchers to bridge the gap between the development and implementation of digital health tools.

Development and Calibration of a PATCH Device for Monitoring Children's Heart Rate and Acceleration

INTRODUCTION

Current wearables that collect heart rate and acceleration were not designed for children and/or do not allow access to raw signals, making them fundamentally unverifiable. This study describes the creation and calibration of an open-source multichannel platform (PATCH) designed to measure heart rate and acceleration in children ages 3-8 yr.

METHODS

Children (N = 63; mean age, 6.3 yr) participated in a 45-min protocol ranging in intensities from sedentary to vigorous activity. Actiheart-5 was used as a comparison measure. We calculated mean bias, mean absolute error (MAE) mean absolute percent error (MA%E), Pearson correlations, and Lin's concordance correlation coefficient (CCC).

RESULTS

Mean bias between PATCH and Actiheart heart rate was 2.26 bpm, MAE was 6.67 bpm, and M%E was 5.99%. The correlation between PATCH and Actiheart heart rate was 0.89, and CCC was 0.88. For acceleration, mean bias was 1.16 mg and MAE was 12.24 mg. The correlation between PATCH and Actiheart was 0.96, and CCC was 0.95.

CONCLUSIONS

The PATCH demonstrated clinically acceptable accuracies to measure heart rate and acceleration compared with a research-grade device.

The Within-Subject Association of Physical Behavior and Affective Well-Being in Everyday Life: A Systematic Literature Review

BACKGROUND

The interplay of physical activity (PA) with affective well-being (AWB) is highly critical to both health behaviors and health outcomes. Current prominent theories presume AWB to be crucial for PA maintenance, and PA is evidenced to foster mental health. However, thus far, PA-AWB associations have mainly been researched in laboratory settings and with interventional designs, but the everyday life perspective had not been focused on, mostly due to technological limitations. In the course of digitization, the number of studies using device-based methods to research the within-subject association of physical activity and affective well-being (PA-AWB) under ecological valid conditions increased rapidly, but a recent comprehensive systematic review of evidence across populations, age groups, and distinct AWB components remained inconclusive.

OBJECTIVES

Therefore, we aimed to firstly review daily-life studies that assessed intensive longitudinal device-based (e.g., electronic smartphone diaries and accelerometry) and real-time PA-AWB data, secondly to develop and apply a quality assessment tool applicable to those studies, and thirdly to discuss findings and draw implications for research and practice.

METHODS

To this end, the literature was searched in three databases (Web of Science, PubMed, Scopus) up to November 2022. The systematic review followed the PRISMA guidelines and had been pre-registered (PROSPERO id: CRD42021277327). A modified quality assessment tool was developed to illustrate the risk of bias of included studies.

RESULTS

The review of findings showed that, in general, already short PA bouts in everyday life, which clearly differ from structured exercise sessions, are positively associated with AWB. In particular, feelings of energy relate to incidental (non-exercise and unstructured) activity, and PA-AWB associations depend on population characteristics. The quality assessment revealed overall moderate study quality; however, the methods applied were largely heterogeneous between investigations. Overall, the reviewed evidence on PA-AWB associations in everyday life is ambiguous; for example, no clear patterns of directions and strengths of PA-AWB relationships depending on PA and AWB components (such as intensity, emotions, affect, mood) emerged.

CONCLUSIONS

The reviewed evidence can fuel discussions on whether the World Health Organization's notion "every move counts" may be extended to everyday life AWB. Concurrently, the PA-AWB relationship findings endorse prominent theories highlighting the critical role of AWB in everyday PA engagement and maintenance. However, the review also clearly highlights the need to advance and harmonize methodological approaches for more fine-grained investigations on which specific PA/AWB characteristics, contextual factors, and biological determinants underly PA-AWB associations in everyday life. This will enable the field to tackle pressing challenges such as the issue of causality of PA-AWB associations, which will help to shape and refine existing theories to ultimately predict and improve health behavior, thereby feeding into precision medicine approaches.

Using Computer Vision to Annotate Video-Recoded Direct Observation of Physical Behavior

Direct observation is a ground-truth measure for physical behavior, but the high cost limits widespread use. The purpose of this study was to develop and test machine learning methods to recognize aspects of physical behavior and location from videos of human movement: Adults (N = 26, aged 18-59 y) were recorded in their natural environment for two, 2- to 3-h sessions. Trained research assistants annotated videos using commercially available software including the following taxonomies: (1) sedentary versus non-sedentary (two classes); (2) activity type (four classes: sedentary, walking, running, and mixed movement); and (3) activity intensity (four classes: sedentary, light, moderate, and vigorous). Four machine learning approaches were trained and evaluated for each taxonomy. Models were trained on 80% of the videos, validated on 10%, and final accuracy is reported on the remaining 10% of the videos not used in training. Overall accuracy was as follows: 87.4% for Taxonomy 1, 63.1% for Taxonomy 2, and 68.6% for Taxonomy 3. This study shows it is possible to use computer vision to annotate aspects of physical behavior, speeding up the time and reducing labor required for direct observation. Future research should test these machine learning models on larger, independent datasets and take advantage of analysis of video fragments, rather than individual still images.

Comparison of raw accelerometry data from ActiGraph, Apple Watch, Garmin, and Fitbit using a mechanical shaker table

The purpose of this study was to evaluate the reliability and validity of the raw accelerometry output from research-grade and consumer wearable devices compared to accelerations produced by a mechanical shaker table. Raw accelerometry data from a total of 40 devices (i.e., n = 10 ActiGraph wGT3X-BT, n = 10 Apple Watch Series 7, n = 10 Garmin Vivoactive 4S, and n = 10 Fitbit Sense) were compared to reference accelerations produced by an orbital shaker table at speeds ranging from 0.6 Hz (4.4 milligravity-mg) to 3.2 Hz (124.7mg). Two-way random effects absolute intraclass correlation coefficients (ICC) tested inter-device reliability. Pearson product moment, Lin's concordance correlation coefficient (CCC), absolute error, mean bias, and equivalence testing were calculated to assess the validity between the raw estimates from the devices and the reference metric. Estimates from Apple, ActiGraph, Garmin, and Fitbit were reliable, with ICCs = 0.99, 0.97, 0.88, and 0.88, respectively. Estimates from ActiGraph, Apple, and Fitbit devices exhibited excellent concordance with the reference CCCs = 0.88, 0.83, and 0.85, respectively, while estimates from Garmin exhibited moderate concordance CCC = 0.59 based on the mean aggregation method. ActiGraph, Apple, and Fitbit produced similar absolute errors = 16.9mg, 21.6mg, and 22.0mg, respectively, while Garmin produced higher absolute error = 32.5mg compared to the reference. ActiGraph produced the lowest mean bias 0.0mg (95%CI = -40.0, 41.0). Equivalence testing revealed raw accelerometry data from all devices were not statistically significantly within the equivalence bounds of the shaker speed. Findings from this study provide evidence that raw accelerometry data from Apple, Garmin, and Fitbit devices can be used to reliably estimate movement; however, no estimates were statistically significantly equivalent to the reference. Future studies could explore device-agnostic and harmonization methods for estimating physical activity using the raw accelerometry signals from the consumer wearables studied herein.

Fitbit's accuracy to measure short bouts of stepping and sedentary behaviour: validation, sensitivity and specificity study

Objective

This study aims to assess the suitability of Fitbit devices for real-time physical activity (PA) and sedentary behaviour (SB) monitoring in the context of just-in-time adaptive interventions (JITAIs) and event-based ecological momentary assessment (EMA) studies.

Methods

Thirty-seven adults (18-65 years) and 32 older adults (65+) from Belgium and the Czech Republic wore four devices simultaneously for 3 days: two Fitbit models on the wrist, an ActiGraph GT3X+ at the hip and an ActivPAL at the thigh. Accuracy measures included mean (absolute) error and mean (absolute) percentage error. Concurrent validity was assessed using Lin's concordance correlation coefficient and Bland-Altman analyses. Fitbit's sensitivity and specificity for detecting stepping events across different thresholds and durations were calculated compared to ActiGraph, while ROC curve analyses identified optimal Fitbit thresholds for detecting sedentary events according to ActivPAL.

Results

Fitbits demonstrated validity in measuring steps on a short time scale compared to ActiGraph. Except for stepping above 120 steps/min in older adults, both Fitbit models detected stepping bouts in adults and older adults with sensitivities and specificities exceeding 87% and 97%, respectively. Optimal cut-off values for identifying prolonged sitting bouts achieved sensitivities and specificities greater than 93% and 89%, respectively.

Conclusions

This study provides practical insights into using Fitbit devices in JITAIs and event-based EMA studies among adults and older adults. Fitbits' reasonable accuracy in detecting short bouts of stepping and SB makes them suitable for triggering JITAI prompts or EMA questionnaires following a PA or SB event of interest.

Validation of the Activ8 Activity Monitor for Monitoring Postures, Motions, Transfers, and Steps of Hospitalized Patients

Sedentary behaviors and low physical activity among hospitalized patients have detrimental effects on health and recovery. Wearable activity monitors are a promising tool to promote mobilization and physical activity. However, existing devices have limitations in terms of their outcomes and validity. The Activ8 device was optimized for the hospital setting. This study assessed the concurrent validity of the modified Activ8. Hospital patients performed an activity protocol that included basic (e.g., walking) and functional activities (e.g., room activities), with video recordings serving as the criterion method. The assessed outcomes were time spent walking, standing, upright, sedentary, and newly added elements of steps and transfers. Absolute and relative time differences were calculated, and Wilcoxon and Bland-Altman analyses were conducted. Overall, the observed relative time differences were lower than 2.9% for the basic protocol and 9.6% for the functional protocol. Statistically significant differences were detected in specific categories, including basic standing (p < 0.05), upright time (p < 0.01), and sedentary time (p < 0.01), but they did not exceed the predetermined 10% acceptable threshold. The modified Activ8 device is a valid tool for assessing body postures, motions, steps, and transfer counts in hospitalized patients. This study highlights the potential of wearable activity monitors to accurately monitor and promote PA among hospital patients.

Floating Epoch Length Improves the Accuracy of Accelerometry-Based Estimation of Coincident Oxygen Consumption

Estimation of oxygen consumption (VO2) from accelerometer data is typically based on prediction equations developed in laboratory settings using steadily paced and controlled test activities. These equations may not capture the temporary changes in VO2 occurring in sporadic real-life physical activity. In this study, we introduced a novel floating epoch for accelerometer data analysis and hypothesized that an adaptive epoch length provides a more consistent estimation of VO2 in irregular activity conditions than a 6 s constant epoch. Two different activity tests were conducted: a progressive constant-speed test (CS) performed on a track and a 6 min back-and-forth walk test including accelerations and decelerations (AC/DC) performed as fast as possible. Twenty-nine adults performed the CS test, and sixty-one performed the AC/DC test. The data were collected using hip-worn accelerometers and a portable metabolic gas analyzer. General linear models were employed to create the prediction models for VO2 that were cross-validated using both data sets and epoch types as training and validation sets. The prediction equations based on the CS test or AC/DC test and 6 s epoch had excellent performance (R2 = 89%) for the CS test but poor performance for the AC/DC test (31%). Only the VO2 prediction equation based on the AC/DC test and the floating epoch had good performance (78%) for both tests. The overall accuracy of VO2 prediction is compromised with the constant length epoch, whereas the prediction model based on irregular acceleration data analyzed with a floating epoch provided consistent performance for both activities.

Accuracy and Reliability of a Suite of Digital Measures of Walking Generated Using a Wrist-Worn Sensor in Healthy Individuals: Performance Characterization Study

BACKGROUND

Mobility is a meaningful aspect of an individual's health whose quantification can provide clinical insights. Wearable sensor technology can quantify walking behaviors (a key aspect of mobility) through continuous passive monitoring.

OBJECTIVE

Our objective was to characterize the analytical performance (accuracy and reliability) of a suite of digital measures of walking behaviors as critical aspects in the practical implementation of digital measures into clinical studies.

METHODS

We collected data from a wrist-worn device (the Verily Study Watch) worn for multiple days by a cohort of volunteer participants without a history of gait or walking impairment in a real-world setting. On the basis of step measurements computed in 10-second epochs from sensor data, we generated individual daily aggregates (participant-days) to derive a suite of measures of walking: step count, walking bout duration, number of total walking bouts, number of long walking bouts, number of short walking bouts, peak 30-minute walking cadence, and peak 30-minute walking pace. To characterize the accuracy of the measures, we examined agreement with truth labels generated by a concurrent, ankle-worn, reference device (Modus StepWatch 4) with known low error, calculating the following metrics: intraclass correlation coefficient (ICC), Pearson r coefficient, mean error, and mean absolute error. To characterize the reliability, we developed a novel approach to identify the time to reach a reliable readout (time to reliability) for each measure. This was accomplished by computing mean values over aggregation scopes ranging from 1 to 30 days and analyzing test-retest reliability based on ICCs between adjacent (nonoverlapping) time windows for each measure.

RESULTS

In the accuracy characterization, we collected data for a total of 162 participant-days from a testing cohort (n=35 participants; median observation time 5 days). Agreement with the reference device-based readouts in the testing subcohort (n=35) for the 8 measurements under evaluation, as reflected by ICCs, ranged between 0.7 and 0.9; Pearson r values were all greater than 0.75, and all reached statistical significance (P<.001). For the time-to-reliability characterization, we collected data for a total of 15,120 participant-days (overall cohort N=234; median observation time 119 days). All digital measures achieved an ICC between adjacent readouts of >0.75 by 16 days of wear time.

CONCLUSIONS

We characterized the accuracy and reliability of a suite of digital measures that provides comprehensive information about walking behaviors in real-world settings. These results, which report the level of agreement with high-accuracy reference labels and the time duration required to establish reliable measure readouts, can guide the practical implementation of these measures into clinical studies. Well-characterized tools to quantify walking behaviors in research contexts can provide valuable clinical information about general population cohorts and patients with specific conditions.

Assessment of 24-hour physical behaviour in adults via wearables: a systematic review of validation studies under laboratory conditions

BACKGROUND

Wearable technology is used by consumers and researchers worldwide for continuous activity monitoring in daily life. Results of high-quality laboratory-based validation studies enable us to make a guided decision on which study to rely on and which device to use. However, reviews in adults that focus on the quality of existing laboratory studies are missing.

METHODS

We conducted a systematic review of wearable validation studies with adults. Eligibility criteria were: (i) study under laboratory conditions with humans (age ≥ 18 years); (ii) validated device outcome must belong to one dimension of the 24-hour physical behavior construct (i.e., intensity, posture/activity type, and biological state); (iii) study protocol must include a criterion measure; (iv) study had to be published in a peer-reviewed English language journal. Studies were identified via a systematic search in five electronic databases as well as back- and forward citation searches. The risk of bias was assessed based on the QUADAS-2 tool with eight signaling questions.

RESULTS

Out of 13,285 unique search results, 545 published articles between 1994 and 2022 were included. Most studies (73.8% (N = 420)) validated an intensity measure outcome such as energy expenditure; only 14% (N = 80) and 12.2% (N = 70) of studies validated biological state or posture/activity type outcomes, respectively. Most protocols validated wearables in healthy adults between 18 and 65 years. Most wearables were only validated once. Further, we identified six wearables (i.e., ActiGraph GT3X+, ActiGraph GT9X, Apple Watch 2, Axivity AX3, Fitbit Charge 2, Fitbit, and GENEActiv) that had been used to validate outcomes from all three dimensions, but none of them were consistently ranked with moderate to high validity. Risk of bias assessment resulted in 4.4% (N = 24) of all studies being classified as "low risk", while 16.5% (N = 90) were classified as "some concerns" and 79.1% (N = 431) as "high risk".

CONCLUSION

Laboratory validation studies of wearables assessing physical behaviour in adults are characterized by low methodological quality, large variability in design, and a focus on intensity. Future research should more strongly aim at all components of the 24-hour physical behaviour construct, and strive for standardized protocols embedded in a validation framework.

The impact of selected methodological factors on data collection outcomes in observational studies of device-measured physical behaviour in adults: A systematic review

BACKGROUND

Accelerometer measures of physical behaviours (physical activity, sedentary behaviour and sleep) in observational studies offer detailed insight into associations with health and disease. Maximising recruitment and accelerometer wear, and minimising data loss remain key challenges. How varying methods used to collect accelerometer data influence data collection outcomes is poorly understood. We examined the influence of accelerometer placement and other methodological factors on participant recruitment, adherence and data loss in observational studies of adult physical behaviours.

METHODS

The review was in accordance with the Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA). Observational studies of adults including accelerometer measurement of physical behaviours were identified using database (MEDLINE (Ovid), Embase, PsychINFO, Health Management Information Consortium, Web of Science, SPORTDiscus and Cumulative Index to Nursing & Allied Health Literature) and supplementary searches to May 2022. Information regarding study design, accelerometer data collection methods and outcomes were extracted for each accelerometer measurement (study wave). Random effects meta-analyses and narrative syntheses were used to examine associations of methodological factors with participant recruitment, adherence and data loss.

RESULTS

123 accelerometer data collection waves were identified from 95 studies (92.5% from high-income countries). In-person distribution of accelerometers was associated with a greater proportion of invited participants consenting to wear an accelerometer (+ 30% [95% CI 18%, 42%] compared to postal distribution), and adhering to minimum wear criteria (+ 15% [4%, 25%]). The proportion of participants meeting minimum wear criteria was higher when accelerometers were worn at the wrist (+ 14% [ 5%, 23%]) compared to waist. Daily wear-time tended to be higher in studies using wrist-worn accelerometers compared to other wear locations. Reporting of information regarding data collection was inconsistent.

CONCLUSION

Methodological decisions including accelerometer wear-location and method of distribution may influence important data collection outcomes including recruitment and accelerometer wear-time. Consistent and comprehensive reporting of accelerometer data collection methods and outcomes is needed to support development of future studies and international consortia. Review supported by the British Heart Foundation (SP/F/20/150002) and registered (Prospero CRD42020213465).

Characterization of Detailed Sedentary Postures Using a Tri-Monitor ActivPAL Configuration in Free-Living Conditions

Objective monitors such as the activPAL characterize time when the thigh is horizontal as sedentary time. However, there are physiological differences between lying, bent-legged sitting, and straight-legged sitting. We introduce a three-monitor configuration to assess detailed sedentary postures and demonstrate its use in characterizing such positions in free-living conditions. We explored time spent in each sedentary posture between prolonged (>1 h) versus non-prolonged (<1 h) sedentary bouts. In total, 35 healthy adults (16♀, 24 ± 3 years; 24 h/day for 6.8 ± 1.0 days) wore an activPAL accelerometer on their thigh, torso, and shin. Hip and knee joint flexion angle estimates were determined during sedentary bouts using the dot-product method between the torso−thigh and thigh−shin, respectively. Compared to lying (69 ± 60 min/day) or straight-legged sitting (113 ± 100 min/day), most time was spent in bent-legged sitting (439 ± 101 min/day, p < 0.001). Most of the bent-legged sitting time was accumulated in non-prolonged bouts (328 ± 83 vs. 112 ± 63 min/day, p < 0.001). In contrast, similar time was spent in straight-legged sitting and lying between prolonged/non-prolonged bouts (both, p > 0.26). We document that a considerable amount of waking time is accumulated in lying or straight-legged sitting. This methodological approach equips researchers with a means of characterizing detailed sedentary postures in uncontrolled conditions and may help answer novel research questions on sedentariness.

A consensus method for estimating physical activity levels in adults using accelerometry

Identifying the best analytical approach for capturing moderate-to-vigorous physical activity (MVPA) using accelerometry is complex but inconsistent approaches employed in research and surveillance limits comparability. We illustrate the use of a consensus method that pools estimates from multiple approaches for characterising MVPA using accelerometry. Participants (n = 30) wore an accelerometer on their right hip during two laboratory visits. Ten individual classification methods estimated minutes of MVPA, including cut-point, two-regression, and machine learning approaches, using open-source count and raw inputs and several epoch lengths. Results were averaged to derive the consensus estimate. Mean MVPA ranged from 33.9-50.4 min across individual methods, but only one (38.9 min) was statistically equivalent to the criterion of direct observation (38.2 min). The consensus estimate (39.2 min) was equivalent to the criterion (even after removal of the one individual method that was equivalent to the criterion), had a smaller mean absolute error (4.2 min) compared to individual methods (4.9-12.3 min), and enabled the estimation of participant-level variance (mean standard deviation: 7.7 min). The consensus method allows for addition/removal of methods depending on data availability or field progression and may improve accuracy and comparability of device-based MVPA estimates while limiting variability due to convergence between estimates.

Accessibility and use of novel methods for predicting physical activity and energy expenditure using accelerometry: a scoping review

Use of raw acceleration data and/or 'novel' analytic approaches like machine learning for physical activity measurement will not be widely implemented if methods are not accessible to researchers.Objective: This scoping review characterizes the validation approach, accessibility and use of novel analytic techniques for classifying energy expenditure and/or physical activity intensity using raw or count-based accelerometer data.Approach: Three databases were searched for articles published between January 2000 and February 2021. Use of each method was coded from a list of citing articles compiled from Google Scholar. Authors' provision of access to the model (e.g., by request, sample code) was recorded.Main Results: Studies (N = 168) included adults (n = 143), and/or children (n = 38). Model use ranged from 0 to 27 uses/year (average 0.83) with 101 models that have never been used. Approximately half of uses occurred in a free-living setting (52%) and/or by other authors (56%). Over half of included articles (n = 107) did not provide complete access to their model. Sixty-one articles provided access to their method by including equations, coefficients, cut-points, or decision trees in the paper (n = 48) and/or by providing access to code (n = 13).Significance: The proliferation of approaches for analyzing accelerometer data outpaces the use of these models in practice. As less than half of the developed models are made accessible, it is unsurprising that so many models are not used by other researchers. We encourage researchers to make their models available and accessible for better harmonization of methods and improved capabilities for device-based physical activity measurement.

Methods for estimating physical activity and energy expenditure using raw accelerometry data or novel analytical approaches: a repository, framework, and reporting guidelines

The proliferation of approaches for analyzing accelerometer data using raw acceleration or novel analytic approaches like machine learning ('novel methods') outpaces their implementation in practice. This may be due to lack of accessibility, either because authors do not provide their developed models or because these models are difficult to find when included as supplementary material. Additionally, when access to a model is provided, authors may not include example data or instructions on how to use the model. This further hinders use by other researchers, particularly those who are not experts in statistics or writing computer code.

OBJECTIVE

We created a repository of novel methods of analyzing accelerometer data for the estimation of energy expenditure and/or physical activity intensity and a framework and reporting guidelines to guide future work.

APPROACH

Methods were identified from a recent scoping review. Available code, models, sample data, and instructions were compiled or created.

MAIN RESULTS

Sixty-three methods are hosted in the repository, in preschoolers (n=6), children/adolescents (n=20), and adults (n=42), using hip (n=45), wrist (n=25), thigh (n=4), chest (n=4), ankle (n=6), other (n=4), or a combination of monitor wear locations (n=9). Fifteen models are implemented in R, while 48 are provided as cut-points, equations, or decision trees.

SIGNIFICANCE

The developed tools should facilitate the use and development of novel methods for analyzing accelerometer data, thus improving data harmonization and consistency across studies. Future advances may involve including models that authors did not link to the original published article or those which identify activity type.

Quality Evaluation of Free-living Validation Studies for the Assessment of 24-Hour Physical Behavior in Adults via Wearables: Systematic Review

Background

Wearable technology is a leading fitness trend in the growing commercial industry and an established method for collecting 24-hour physical behavior data in research studies. High-quality free-living validation studies are required to enable both researchers and consumers to make guided decisions on which study to rely on and which device to use. However, reviews focusing on the quality of free-living validation studies in adults are lacking.

Objective

This study aimed to raise researchers’ and consumers’ attention to the quality of published validation protocols while aiming to identify and compare specific consistencies or inconsistencies between protocols. We aimed to provide a comprehensive and historical overview of which wearable devices have been validated for which purpose and whether they show promise for use in further studies.

Methods

Peer-reviewed validation studies from electronic databases, as well as backward and forward citation searches (1970 to July 2021), with the following, required indicators were included: protocol must include real-life conditions, outcome must belong to one dimension of the 24-hour physical behavior construct (intensity, posture or activity type, and biological state), the protocol must include a criterion measure, and study results must be published in English-language journals. The risk of bias was evaluated using the Quality Assessment of Diagnostic Accuracy Studies-2 tool with 9 questions separated into 4 domains (patient selection or study design, index measure, criterion measure, and flow and time).

Results

Of the 13,285 unique search results, 222 (1.67%) articles were included. Most studies (153/237, 64.6%) validated an intensity measure outcome such as energy expenditure. However, only 19.8% (47/237) validated biological state and 15.6% (37/237) validated posture or activity-type outcomes. Across all studies, 163 different wearables were identified. Of these, 58.9% (96/163) were validated only once. ActiGraph GT3X/GT3X+ (36/163, 22.1%), Fitbit Flex (20/163, 12.3%), and ActivPAL (12/163, 7.4%) were used most often in the included studies. The percentage of participants meeting the quality criteria ranged from 38.8% (92/237) to 92.4% (219/237). On the basis of our classification tree to evaluate the overall study quality, 4.6% (11/237) of studies were classified as low risk. Furthermore, 16% (38/237) of studies were classified as having some concerns, and 72.9% (173/237) of studies were classified as high risk.

Conclusions

Overall, free-living validation studies of wearables are characterized by low methodological quality, large variability in design, and focus on intensity. Future research should strongly aim at biological state and posture or activity outcomes and strive for standardized protocols embedded in a validation framework. Standardized protocols for free-living validation embedded in a framework are urgently needed to inform and guide stakeholders (eg, manufacturers, scientists, and consumers) in selecting wearables for self-tracking purposes, applying wearables in health studies, and fostering innovation to achieve improved validity.

Assessment of 24-hour physical behaviour in children and adolescents via wearables: a systematic review of free-living validation studies

Objectives

Studies that assess all three dimensions of the integrative 24-hour physical behaviour (PB) construct, namely, intensity, posture/activity type and biological state, are on the rise. However, reviews on validation studies that cover intensity, posture/activity type and biological state assessed via wearables are missing.

Design

Systematic review. The risk of bias was evaluated by using the QUADAS-2 tool with nine signalling questions separated into four domains (ie, patient selection/study design, index measure, criterion measure, flow and time).

Data sources

Peer-reviewed validation studies from electronic databases as well as backward and forward citation searches (1970–July 2021).

Eligibility criteria for selecting studies

Wearable validation studies with children and adolescents (age <18 years). Required indicators: (1) study protocol must include real-life conditions; (2) validated device outcome must belong to one dimension of the 24-hour PB construct; (3) the study protocol must include a criterion measure; (4) study results must be published in peer-reviewed English language journals.

Results

Out of 13 285 unique search results, 76 articles with 51 different wearables were included and reviewed. Most studies (68.4%) validated an intensity measure outcome such as energy expenditure, but only 15.9% of studies validated biological state outcomes, while 15.8% of studies validated posture/activity type outcomes. We identified six wearables that had been used to validate outcomes from two different dimensions and only two wearables (ie, ActiGraph GT1M and ActiGraph GT3X+) that validated outcomes from all three dimensions. The percentage of studies meeting a given quality criterion ranged from 44.7% to 92.1%. Only 18 studies were classified as ‘low risk’ or ‘some concerns’.

Summary

Validation studies on biological state and posture/activity outcomes are rare in children and adolescents. Most studies did not meet published quality principles. Standardised protocols embedded in a validation framework are needed.

PROSPERO registration number

CRD42021230894.

Validation of an open-source ambulatory assessment system in support of replicable activity studies

Purpose: Inertial-based trackers have become a common tool in data capture for ambulatory studies that aim at characterizing physical activity. Many systems that perform remote recording of accelerometer data use commercial trackers and black-box aggregation algorithms, often resulting in data that are locked into proprietary formats and metrics that make later replication or comparison difficult.

Methods: The primary purpose of this manuscript is to validate an open-source ambulatory assessment system that consists of hardware devices, algorithms, and software components of our approach. We report on two validation experiments, one lab-based treadmill study on a convenience sample of 16 volunteers and one ’in vivo’ study with 28 volunteers suffering from diabetes or cardiovascular disease.

Results: A comparison between data from ActiGraph GT9X trackers and our proposed system reveals that the original inertial sensor signals at the wrist strongly correlate (Pearson correlation coefficients for raw inertial sensor signals of 0.97 in the controlled treadmill-walking setting) and that estimated steps from an open-source wrist-based detection approach correlate with the hip-worn ActiGraph output (average Pearson correlation coefficients of 0.81 for minute-wise comparisons of detected steps) in day-long ambulatory data.

Conclusion: Recording inertial sensor data in a standardized form and relying on open-source algorithms on these data form a promising methodology that ensures that datasets can be replicated or enriched long after the wearable trackers have been decommissioned.

Are Machine Learning Models on Wrist Accelerometry Robust against Differences in Physical Performance among Older Adults?

Sufficient physical activity (PA) reduces the risk of a myriad of diseases and preserves physical capabilities in later life. While there have been significant achievements in mapping accelerations to real-life movements using machine learning (ML), errors continue to be common, particularly for wrist-worn devices. It remains unknown whether ML models are robust for estimating age-related loss of physical function. In this study, we evaluated the performance of ML models (XGBoost and LASSO) to estimate the hallmark measures of PA in low physical performance (LPP) and high physical performance (HPP) groups. Our models were built to recognize PA types and intensities, identify each individual activity, and estimate energy expenditure (EE) using wrist-worn accelerometer data (33 activities per participant) from a large sample of participants (n = 247, 57% females, aged 60+ years). Results indicated that the ML models were accurate in recognizing PA by type and intensity while also estimating EE accurately. However, the models built to recognize individual activities were less robust. Across all tasks, XGBoost outperformed LASSO. XGBoost obtained F1-Scores for sedentary (0.932 ± 0.005), locomotion (0.946 ± 0.003), lifestyle (0.927 ± 0.006), and strength flexibility exercise (0.915 ± 0.017) activity type recognition tasks. The F1-Scores for recognizing low, light, and moderate activity intensity were (0.932 ± 0.005), (0.840 ± 0.004), and (0.869 ± 0.005), respectively. The root mean square error for EE estimation was 0.836 ± 0.059 METs. There was no evidence showing that splitting the participants into the LPP and HPP groups improved the models’ performance on estimating the hallmark measures of physical activities. In conclusion, using features derived from wrist-worn accelerometer data, machine learning models can accurately recognize PA types and intensities and estimate EE for older adults with high and low physical function.

Perspective: Opportunities and Challenges of Technology Tools in Dietary and Activity Assessment: Bridging Stakeholder Viewpoints

The science and tools of measuring energy intake and output in humans have rapidly advanced in the last decade. Engineered devices such as wearables and sensors, software applications, and Web-based tools are now ubiquitous in both research and consumer environments. The assessment of energy expenditure in particular has progressed from reliance on self-report instruments to advanced technologies requiring collaboration across multiple disciplines, from optics to accelerometry. In contrast, assessing energy intake still heavily relies on self-report mechanisms. Although these tools have improved, moving from paper-based to online reporting, considerable room for refinement remains in existing tools, and great opportunities exist for novel, transformational tools, including those using spectroscopy and chemo-sensing. This report reviews the state of the science, and the opportunities and challenges in existing and emerging technologies, from the perspectives of 3 key stakeholders: researchers, users, and developers. Each stakeholder approaches these tools with unique requirements: researchers are concerned with validity, accuracy, data detail and abundance, and ethical use; users with ease of use and privacy; and developers with high adherence and utilization, intellectual property, licensing rights, and monetization. Cross-cutting concerns include frequent updating and integration of the food and nutrient databases on which assessments rely, improving accessibility and reducing disparities in use, and maintaining reliable technical assistance. These contextual challenges are discussed in terms of opportunities and further steps in the direction of personalized health.

Validity of Estimating the Maximal Oxygen Consumption by Consumer Wearables: A Systematic Review with Meta-analysis and Expert Statement of the INTERLIVE Network

Background

Technological advances have recently made possible the estimation of maximal oxygen consumption (VO_2max) by consumer wearables. However, the validity of such estimations has not been systematically summarized using meta-analytic methods and there are no standards guiding the validation protocols.

Objective

The aim was to (1) quantitatively summarize previous studies investigating the validity of the VO_2max estimated by consumer wearables and (2) provide best-practice recommendations for future validation studies.

Methods

First, we conducted a systematic review and meta-analysis of studies validating the estimation of VO_2max by wearables. Second, based on the state of knowledge (derived from the systematic review) combined with the expert discussion between the members of the Towards Intelligent Health and Well-Being Network of Physical Activity Assessment (INTERLIVE) consortium, we provided a set of best-practice recommendations for validation protocols.

Results

Fourteen validation studies were included in the systematic review and meta-analysis. Meta-analysis results revealed that wearables using resting condition information in their algorithms significantly overestimated VO_2max (bias 2.17 ml·kg⁻¹·min⁻¹; limits of agreement − 13.07 to 17.41 ml·kg⁻¹·min⁻¹), while devices using exercise-based information in their algorithms showed a lower systematic and random error (bias − 0.09 ml·kg⁻¹·min⁻¹; limits of agreement − 9.92 to 9.74 ml·kg⁻¹·min⁻¹). The INTERLIVE consortium proposed six key domains to be considered for validating wearable devices estimating VO_2max, concerning the following: the target population, reference standard, index measure, testing conditions, data processing, and statistical analysis.

Conclusions

Our meta-analysis suggests that the estimations of VO_2max by wearables that use exercise-based algorithms provide higher accuracy than those based on resting conditions. The exercise-based estimation seems to be optimal for measuring VO_2max at the population level, yet the estimation error at the individual level is large, and, therefore, for sport/clinical purposes these methods still need improvement. The INTERLIVE network hereby provides best-practice recommendations to be used in future protocols to move towards a more accurate, transparent and comparable validation of VO_2max derived from wearables.

PROSPERO ID

CRD42021246192.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40279-021-01639-y.

Recommendations for Determining the Validity of Consumer Wearables and Smartphones for the Estimation of Energy Expenditure: Expert Statement and Checklist of the INTERLIVE Network

BACKGROUND

Consumer wearables and smartphone devices commonly offer an estimate of energy expenditure (EE) to assist in the objective monitoring of physical activity to the general population. Alongside consumers, healthcare professionals and researchers are seeking to utilise these devices for the monitoring of training and improving human health. However, the methods of validation and reporting of EE estimation in these devices lacks rigour, negatively impacting on the ability to make comparisons between devices and provide transparent accuracy.

OBJECTIVES

The Towards Intelligent Health and Well-Being Network of Physical Activity Assessment (INTERLIVE) is a joint European initiative of six universities and one industrial partner. The network was founded in 2019 and strives towards developing best-practice recommendations for evaluating the validity of consumer wearables and smartphones. This expert statement presents a best-practice validation protocol for consumer wearables and smartphones in the estimation of EE.

METHODS

The recommendations were developed through (1) a systematic literature review; (2) an unstructured review of the wider literature discussing the potential factors that may introduce bias during validation studies; and (3) evidence-informed expert opinions from members of the INTERLIVE network.

RESULTS

The systematic literature review process identified 1645 potential articles, of which 62 were deemed eligible for the final dataset. Based on these studies and the wider literature search, a validation framework is proposed encompassing six key domains for validation: the target population, criterion measure, index measure, testing conditions, data processing and the statistical analysis.

CONCLUSIONS

The INTERLIVE network recommends that the proposed protocol, and checklists provided, are used to standardise the testing and reporting of the validation of any consumer wearable or smartphone device to estimate EE. This in turn will maximise the potential utility of these technologies for clinicians, researchers, consumers, and manufacturers/developers, while ensuring transparency, comparability, and replicability in validation.

TRIAL REGISTRATION

PROSPERO ID: CRD42021223508.

Wearable biosensors have the potential to monitor physiological changes associated with opioid overdose among people who use drugs: A proof-of-concept study in a real-world setting

INTRODUCTION

Wearable biosensors have the potential to monitor physiological change associated with opioid overdose among people who use drugs.

METHODS

We enrolled 16 individuals who reported ≥ 4 daily opioid use events within the previous 30 day. Each was assigned a wearable biosensor that measured respiratory rate (RR) and actigraphy every 15 s for 5 days and also completed a daily interview assessing drug use. We describe the volume of RR data collected, how it varied by participant characteristics and drug use over time using repeated measures one-way ANOVA, episodes of acute respiratory depression (≤5 breaths/minute), and self-reported overdose experiences.

RESULTS

We captured 1626.4 h of RR data, an average of 21.7 daily hours/participant over follow-up. Individuals with longer injection careers and those engaging in polydrug use captured significantly fewer total hours of respiratory data over follow-up compared to those with shorter injections careers (94.7 vs. 119.9 h, p = 0.04) and injecting fentanyl exclusively (98.7 vs. 119.5 h, p = 0.008), respectively. There were 385 drug use events reported over follow-up. There were no episodes of acute respiratory depression which corresponded with participant reports of overdose experiences.

DISCUSSION

Our preliminary findings suggest that using a wearable biosensor to monitor physiological changes associated with opioid use was feasible. However, more sensitive biosensors that facilitate triangulation of multiple physiological data points and larger studies of longer duration are needed.

Establishing a Global Standard for Wearable Devices in Sport and Exercise Medicine: Perspectives from Academic and Industry Stakeholders

Millions of consumer sport and fitness wearables (CSFWs) are used worldwide, and millions of datapoints are generated by each device. Moreover, these numbers are rapidly growing, and they contain a heterogeneity of devices, data types, and contexts for data collection. Companies and consumers would benefit from guiding standards on device quality and data formats. To address this growing need, we convened a virtual panel of industry and academic stakeholders, and this manuscript summarizes the outcomes of the discussion. Our objectives were to identify (1) key facilitators of and barriers to participation by CSFW manufacturers in guiding standards and (2) stakeholder priorities. The venues were the Yale Center for Biomedical Data Science Digital Health Monthly Seminar Series (62 participants) and the New England Chapter of the American College of Sports Medicine Annual Meeting (59 participants). In the discussion, stakeholders outlined both facilitators of (e.g., commercial return on investment in device quality, lucrative research partnerships, and transparent and multilevel evaluation of device quality) and barriers (e.g., competitive advantage conflict, lack of flexibility in previously developed devices) to participation in guiding standards. There was general agreement to adopt Keadle et al.'s standard pathway for testing devices (i.e., benchtop, laboratory, field-based, implementation) without consensus on the prioritization of these steps. Overall, there was enthusiasm not to add prescriptive or regulatory steps, but instead create a networking hub that connects companies to consumers and researchers for flexible guidance navigating the heterogeneity, multi-tiered development, dynamicity, and nebulousness of the CSFW field.

Using Smartwatches to Detect Face Touching

Frequent spontaneous facial self-touches, predominantly during outbreaks, have the theoretical potential to be a mechanism of contracting and transmitting diseases. Despite the recent advent of vaccines, behavioral approaches remain an integral part of reducing the spread of COVID-19 and other respiratory illnesses. The aim of this study was to utilize the functionality and the spread of smartwatches to develop a smartwatch application to identify motion signatures that are mapped accurately to face touching. Participants (n = 10, five women, aged 20–83) performed 10 physical activities classified into face touching (FT) and non-face touching (NFT) categories in a standardized laboratory setting. We developed a smartwatch application on Samsung Galaxy Watch to collect raw accelerometer data from participants. Data features were extracted from consecutive non-overlapping windows varying from 2 to 16 s. We examined the performance of state-of-the-art machine learning methods on face-touching movement recognition (FT vs. NFT) and individual activity recognition (IAR): logistic regression, support vector machine, decision trees, and random forest. While all machine learning models were accurate in recognizing FT categories, logistic regression achieved the best performance across all metrics (accuracy: 0.93 ± 0.08, recall: 0.89 ± 0.16, precision: 0.93 ± 0.08, F1-score: 0.90 ± 0.11, AUC: 0.95 ± 0.07) at the window size of 5 s. IAR models resulted in lower performance, where the random forest classifier achieved the best performance across all metrics (accuracy: 0.70 ± 0.14, recall: 0.70 ± 0.14, precision: 0.70 ± 0.16, F1-score: 0.67 ± 0.15) at the window size of 9 s. In conclusion, wearable devices, powered by machine learning, are effective in detecting facial touches. This is highly significant during respiratory infection outbreaks as it has the potential to limit face touching as a transmission vector.

Calibration of the Online Youth Activity Profile Assessment for School-Based Applications

A balance between the feasibility and validity of measures is an important consideration for physical activity research - particularly in school-based research with youth. The present study extends previously tested calibration methods to develop and test new equations for an online version of the Youth Activity Profile (YAP) tool, a self-report tool designed for school applications. Data were collected across different regions and seasons to develop more robust, generalizable equations. The study involved a total of 717 youth from 33 schools (374 elementary (ages 9-11), 224 middle (ages 11-14), and 119 high school (ages 14-18)) in two different states in the U.S. Participants wore a Sensewear monitor for a full week and then completed the online YAP at school to report physical activity (PA) and sedentary behaviors (SB) in school and at home. Accelerometer data were processed using an R-based segmentation program to compute PA and SB levels. Quantile regression models were used with half of the sample to develop item-specific YAP calibration equations and these were cross validated with the remaining half of the sample. Computed values of Mean Absolute Percent Error (MAPE) ranged from 15-25% with slightly lower error observed for the middle school sample. The new equations had improved precision compared to the previous versions when tested on the same sample. The online version of the YAP provides an efficient and effective way to capture school level estimates of PA and SB in youth.

Application of Convolutional Neural Network Algorithms for Advancing Sedentary and Activity Bout Classification

Background

Machine learning has been used for classification of physical behavior bouts from hip-worn accelerometers; however, this research has been limited due to the challenges of directly observing and coding human behavior "in the wild." Deep learning algorithms, such as convolutional neural networks (CNNs), may offer better representation of data than other machine learning algorithms without the need for engineered features and may be better suited to dealing with free-living data. The purpose of this study was to develop a modeling pipeline for evaluation of a CNN model on a free-living data set and compare CNN inputs and results with the commonly used machine learning random forest and logistic regression algorithms.

Method

Twenty-eight free-living women wore an ActiGraph GT3X+accelerometer on their right hip for 7 days. A concurrently worn thigh-mounted activPAL device captured ground truth activity labels. The authors evaluated logistic regression, random forest, and CNN models for classifying sitting, standing, and stepping bouts. The authors also assessed the benefit of performing feature engineering for this task.

Results

The CNN classifier performed best (average balanced accuracy for bout classification of sitting, standing, and stepping was 84%) compared with the other methods (56% for logistic regression and 76% for random forest), even without performing any feature engineering.

Conclusion

Using the recent advancements in deep neural networks, the authors showed that a CNN model can outperform other methods even without feature engineering. This has important implications for both the model's ability to deal with the complexity of free-living data and its potential transferability to new populations.

Criterion Validity of iOS and Android Applications to Measure Steps and Distance in Adults

The growing popularity of physical activity (PA) applications (apps) in recent years and the vast amounts of data that they generate present attractive possibilities for surveillance. However, measurement accuracy is indispensable when tracking PA variables to provide meaningful measures of PA. The purpose of this study was to examine the steps and distance criterion validity of freeware accelerometer-based PA smartphone apps, during incremental-intensity treadmill walking and jogging. Thirty healthy adults (25.9 ± 5.7 years) participated in this cross-sectional study. They were fitted with two smartphones (one with Android and one with iOS operating systems), each one simultaneously running four different apps (i.e., Runtastic Pedometer, Accupedo, Pacer, and Argus). They walked and jogged for 5 min at each of the predefined speeds of 4.8, 6.0, and 8.4 km/h on a treadmill, and two researchers counted every step taken during trials with a digital tally counter. Validity was evaluated by comparing each app with the criterion measure using repeated-measures analysis of variance (ANOVA), mean absolute percentage errors (MAPEs), and Bland–Altman plots. For step count, Android apps performed slightly more accurately that iOS apps; nevertheless, MAPEs were generally low for all apps (<5%) and accuracy increased at higher speeds. On the other hand, errors were significantly higher for distance estimation (>10%). The findings suggest that accelerometer-based apps are accurate tools for counting steps during treadmill walking and jogging and could be considered suitable for use as an outcome measure within a clinical trial. However, none of the examined apps was suitable for measuring distance.

Individual versus Group Calibration of Machine Learning Models for Physical Activity Assessment Using Body-Worn Accelerometers

Modeling approaches for translating accelerometer data into physical activity metrics are often developed using a group calibration approach. However, it is unknown if models developed for specific individuals will improve measurement accuracy.

PURPOSE

We sought to determine if individually calibrated machine learning models yielded higher accuracy than a group calibration approach for physical activity intensity assessment.

METHODS

Participants (n = 48) wore accelerometers on the right hip and non-dominant wrist while performing activities of daily living in a semi-structured laboratory and/or free-living setting. Criterion measures of activity intensity (sedentary, light, moderate, vigorous) were determined using direct observation. Data were reintegrated into 30-second epochs, and eight random forest models were created to determine physical activity intensity by using all possible conditions of training data (individual vs. group), protocol (laboratory vs. free-living), and placement (hip vs. wrist). A 2x2x2 repeated-measures analysis of variance was used to compare epoch-level accuracy statistics (% accuracy, kappa [k]) of the models when used to determine activity intensity in an independent sample of free-living participants.

RESULTS

Main effects were significant for the type of training data (group: accuracy = 80%, k = 0.59; individual: accuracy = 74% [p = 0.02], k = 0.50 [p = 0.01]) and protocol (free-living: accuracy = 81%, k = 0.63; laboratory: accuracy = 74% [p = 0.04], k = 0.47 [p < 0.01]). Main effects were not significant for placement (hip: accuracy = 79%, k = 0.58; wrist: accuracy = 75% [p = 0.18]; k = 0.52 [p = 0.18]). Point estimates for mean absolute error were generally lowest for the group training, free-living protocol, and hip placement.

CONCLUSION

Contrary to expectations, individually calibrated machine learning models yielded poorer accuracy than a traditional group approach. Additionally, models should be developed in free-living settings when possible to optimize predictive accuracy.

Age Differences in Estimating Physical Activity by Wrist Accelerometry Using Machine Learning

Accelerometer-based fitness trackers and smartwatches are proliferating with incessant attention towards health tracking. Despite their growing popularity, accurately measuring hallmark measures of physical activities has yet to be accomplished in adults of all ages. In this work, we evaluated the performance of four machine learning models: decision tree, random forest, extreme gradient boosting (XGBoost) and least absolute shrinkage and selection operator (LASSO), to estimate the hallmark measures of physical activities in young (20-50 years), middle-aged (50-70 years], and older adults (70-89 years]. Our models were built to recognize physical activity types, recognize physical activity intensities, estimate energy expenditure (EE) and recognize individual physical activities using wrist-worn tri-axial accelerometer data (33 activities per participant) from a large sample of participants (n = 253, 62% women, aged 20-89 years old). Results showed that the machine learning models were quite accurate at recognizing physical activity type and intensity and estimating energy expenditure. However, models performed less optimally when recognizing individual physical activities. F1-Scores derived from XGBoost's models were high for sedentary (0.955-0.973), locomotion (0.942-0.964) and lifestyle (0.913-0.949) activity types with no apparent difference across age groups. Low (0.919-0.947), light (0.813-0.828) and moderate (0.846-0.875) physical activity intensities were also recognized accurately. The root mean square error range for EE was approximately 1 equivalent of resting EE [0.835-1.009 METs]. Generally, random forest and XGBoost models outperformed other models. In conclusion, machine learning models to label physical activity types, activity intensity and energy expenditure are accurate and there are minimal differences in their performance across young, middle-aged and older adults.

The Effect of Sensor Placement and Number on Physical Activity Recognition and Energy Expenditure Estimation in Older Adults: Validation Study

BACKGROUND

Research has shown the feasibility of human activity recognition using wearable accelerometer devices. Different studies have used varying numbers and placements for data collection using sensors.

OBJECTIVE

This study aims to compare accuracy performance between multiple and variable placements of accelerometer devices in categorizing the type of physical activity and corresponding energy expenditure in older adults.

METHODS

In total, 93 participants (mean age 72.2 years, SD 7.1) completed a total of 32 activities of daily life in a laboratory setting. Activities were classified as sedentary versus nonsedentary, locomotion versus nonlocomotion, and lifestyle versus nonlifestyle activities (eg, leisure walk vs computer work). A portable metabolic unit was worn during each activity to measure metabolic equivalents (METs). Accelerometers were placed on 5 different body positions: wrist, hip, ankle, upper arm, and thigh. Accelerometer data from each body position and combinations of positions were used to develop random forest models to assess activity category recognition accuracy and MET estimation.

RESULTS

Model performance for both MET estimation and activity category recognition were strengthened with the use of additional accelerometer devices. However, a single accelerometer on the ankle, upper arm, hip, thigh, or wrist had only a 0.03-0.09 MET increase in prediction error compared with wearing all 5 devices. Balanced accuracy showed similar trends with slight decreases in balanced accuracy for the detection of locomotion (balanced accuracy decrease range 0-0.01), sedentary (balanced accuracy decrease range 0.05-0.13), and lifestyle activities (balanced accuracy decrease range 0.04-0.08) compared with all 5 placements. The accuracy of recognizing activity categories increased with additional placements (accuracy decrease range 0.15-0.29). Notably, the hip was the best single body position for MET estimation and activity category recognition.

CONCLUSIONS

Additional accelerometer devices slightly enhance activity recognition accuracy and MET estimation in older adults. However, given the extra burden of wearing additional devices, single accelerometers with appropriate placement appear to be sufficient for estimating energy expenditure and activity category recognition in older adults.

Reliability, Validity and Responsiveness of Physical Activity Monitors in Patients with Inflammatory Myopathy

OBJECTIVE

Idiopathic inflammatory myopathies (IIM) cause proximal muscle weakness, which affect activities of daily living. Wearable physical activity monitors (PAMs) objectively assess continuous activity with potential clinical usefulness in IIM assessment. We examined the psychometric characteristics for PAM outcomes in IIM.

METHODS

Adult IIM patients were prospectively evaluated (baseline, 3 and 6-months) in an observational study. A waist-worn PAM (ActiGraph GT3X-BT) assessed average step counts/min, peak 1-min cadence, and vector magnitude/min. Validated myositis core set measures (CSM) including manual muscle testing (MMT), physician global disease activity (MD global), patient global disease activity (Pt global), extra-muscular disease activity (Ex-muscular global), HAQ-DI, muscle enzymes, and patient-reported physical function were evaluated. Test-retest reliability, construct validity, and responsiveness were determined for PAM measures and CSM using Pearson correlations and other appropriate analyses.

RESULTS

50 adult IIM patients enrolled [mean (SD) age, 53.6 (±14.6); 60% female, 94% Caucasian]. PAM measures showed strong test-retest reliability, moderate-to-strong correlations at baseline with MD global (r=-0.37- -0.48), Pt-global (r=-0.43- -0.61), HAQ-DI (r=-0.47- -0.59) and MMT (r = 0.37-0.52), and strong discriminant validity for categorical MMT and HAQ-DI. Longitudinal association with MD global (r=-0.38- -0.44), MMT (r = 0.50-0.57), HAQ-DI (r=-0.45- -0.55), and functional tests (r = 0.30-0.65) were moderate-to-strong. PAM measures were responsive to MMT improvement (≥10%) and moderate-to-major improvement on ACR/EULAR myositis response criteria. Peak 1-min cadence had the largest effect size and Standardized Response Means (SRMs).

CONCLUSION

PAM measures showed promising construct validity, reliability, and longitudinal responsiveness; especially peak 1-min cadence. PAMs provide valid outcome measures for future use in IIM clinical trials.

Accelerometer Calibration: The Importance of Considering Functionality

Purpose

To compare the accuracy and precision of a hip-worn accelerometer to predict energy cost during structured activities across motor performance and disease conditions.

Methods

118 adults self-identifying as healthy (n = 44) and those with arthritis (n = 23), multiple sclerosis (n = 18), Parkinson's disease (n = 17), and stroke (n =18) underwent measures of motor performance and were categorized into groups: Group 1, usual; Group 2, moderate impairment; and Group 3, severe impairment. The participants completed structured activities while wearing an accelerometer and a portable metabolic measurement system. Accelerometer-predicted energy cost (metabolic equivalent of tasks [METs]) were compared with measured METs and evaluated across functional impairment and disease conditions. Statistical significance was assessed using linear mixed effect models and Bayesian information criteria to assess model fit.

Results

All activities' accelerometer counts per minute (CPM) were 29.5-72.6% less for those with disease compared with those who were healthy. The predicted MET bias was similar across disease, -0.49 (-0.71, -0.27) for arthritis, -0.38 (-0.53, -0.22) for healthy, -0.44 (-0.68, -0.20) for MS, -0.34 (-0.58, -0.09) for Parkinson's, and -0.30 (-0.54, -0.06) for stroke. For functional impairment, there was a graded reduction in CPM for all activities: Group 1, 1,215 CPM (1,129, 1,301); Group 2, 789 CPM (695, 884); and Group 3, 343 CPM (220, 466). The predicted MET bias revealed similar results across the Group 1, -0.37 METs (-0.52, -0.23); Group 2, -0.44 METs (-0.60, -0.28); and Group 3, -0.33 METs (-0.55, -0.13). The Bayesian information criteria showed a better model fit for functional impairment compared with disease condition.

Conclusion

Using functionality to improve accelerometer calibration could decrease variability and warrants further exploration to improve accelerometer prediction of physical activity.

Wrist-Worn Activity Trackers in Laboratory and Free-Living Settings for Patients With Chronic Pain: Criterion Validity Study

BACKGROUND

Physical activity is evidently a crucial part of the rehabilitation process for patients with chronic pain. Modern wrist-worn activity tracking devices seemingly have a great potential to provide objective feedback and assist in the adoption of healthy physical activity behavior by supplying data of energy expenditure expressed as metabolic equivalent of task units (MET). However, no studies of any wrist-worn activity tracking devices' have examined criterion validity in estimating energy expenditure, heart rate, or step count in patients with chronic pain.

OBJECTIVE

The aim was to determine the criterion validity of wrist-worn activity tracking devices for estimations of energy expenditure, heart rate, and step count in a controlled laboratory setting and free-living settings for patients with chronic pain.

METHODS

In this combined laboratory and field validation study, energy expenditure, heart rate, and step count were simultaneously estimated by a wrist-worn activity tracker (Fitbit Versa), indirect calorimetry (Jaeger Oxycon Pro), and a research-grade hip-worn accelerometer (ActiGraph GT3X) during treadmill walking at 3 speeds (3.0 km/h, 4.5 km/h, and 6.0 km/h) in the laboratory setting. Energy expenditure and step count were also estimated by the wrist-worn activity tracker in free-living settings for 72 hours. The criterion validity of each measure was determined using intraclass and Spearman correlation, Bland-Altman plots, and mean absolute percentage error. An analysis of variance was used to determine whether there were any significant systematic differences between estimations.

RESULTS

A total of 42 patients (age: 25-66 years; male: 10/42, 24%; female: 32/42, 76%), living with chronic pain (duration, in years: mean 9, SD 6.72) were included. At baseline, their mean pain intensity was 3.5 (SD 1.1) out of 6 (Multidimensional Pain Inventory, Swedish version). Results showed that the wrist-worn activity tracking device (Fitbit Versa) systematically overestimated energy expenditure when compared to the criterion standard (Jaeger Oxycon Pro) and the relative criterion standard (ActiGraph GT3X). Poor agreement and poor correlation were shown between Fitbit Versa and both Jaeger Oxycon Pro and ActiGraph GT3X for estimated energy expenditure at all treadmill speeds. Estimations of heart rate demonstrated poor to fair agreement during laboratory-based treadmill walks. For step count, the wrist-worn devices showed fair agreement and fair correlation at most treadmill speeds. In free-living settings; however, the agreement for step count between the wrist-worn device and waist-worn accelerometer was good, and the correlation was excellent.

CONCLUSIONS

The wrist-worn device systematically overestimated energy expenditure and showed poor agreement and correlation compared to the criterion standard (Jaeger Oxycon Pro) and the relative criterion standard (ActiGraph GT3X), which needs to be considered when used clinically. Step count measured with a wrist-worn device, however, seemed to be a valid estimation, suggesting that future guidelines could include such variables in this group with chronic pain.

Recommendations for determining the validity of consumer wearable heart rate devices: expert statement and checklist of the INTERLIVE Network

Assessing vital signs such as heart rate (HR) by wearable devices in a lifestyle-related environment provides widespread opportunities for public health related research and applications. Commonly, consumer wearable devices assessing HR are based on photoplethysmography (PPG), where HR is determined by absorption and reflection of emitted light by the blood. However, methodological differences and shortcomings in the validation process hamper the comparability of the validity of various wearable devices assessing HR. Towards Intelligent Health and Well-Being: Network of Physical Activity Assessment (INTERLIVE) is a joint European initiative of six universities and one industrial partner. The consortium was founded in 2019 and strives towards developing best-practice recommendations for evaluating the validity of consumer wearables and smartphones. This expert statement presents a best-practice validation protocol for consumer wearables assessing HR by PPG. The recommendations were developed through the following multi-stage process: (1) a systematic literature review based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses, (2) an unstructured review of the wider literature pertaining to factors that may introduce bias during the validation of these devices and (3) evidence-informed expert opinions of the INTERLIVE Network. A total of 44 articles were deemed eligible and retrieved through our systematic literature review. Based on these studies, a wider literature review and our evidence-informed expert opinions, we propose a validation framework with standardised recommendations using six domains: considerations for the target population, criterion measure, index measure, testing conditions, data processing and the statistical analysis. As such, this paper presents recommendations to standardise the validity testing and reporting of PPG-based HR wearables used by consumers. Moreover, checklists are provided to guide the validation protocol development and reporting. This will ensure that manufacturers, consumers, healthcare providers and researchers use wearables safely and to its full potential.

Recommendations for determining the validity of consumer wearable and smartphone step count: expert statement and checklist of the INTERLIVE network

Consumer wearable and smartphone devices provide an accessible means to objectively measure physical activity (PA) through step counts. With the increasing proliferation of this technology, consumers, practitioners and researchers are interested in leveraging these devices as a means to track and facilitate PA behavioural change. However, while the acceptance of these devices is increasing, the validity of many consumer devices have not been rigorously and transparently evaluated. The Towards Intelligent Health and Well-Being Network of Physical Activity Assessment (INTERLIVE) is a joint European initiative of six universities and one industrial partner. The consortium was founded in 2019 and strives to develop best-practice recommendations for evaluating the validity of consumer wearables and smartphones. This expert statement presents a best-practice consumer wearable and smartphone step counter validation protocol. A two-step process was used to aggregate data and form a scientific foundation for the development of an optimal and feasible validation protocol: (1) a systematic literature review and (2) additional searches of the wider literature pertaining to factors that may introduce bias during the validation of these devices. The systematic literature review process identified 2897 potential articles, with 85 articles deemed eligible for the final dataset. From the synthesised data, we identified a set of six key domains to be considered during design and reporting of validation studies: target population, criterion measure, index measure, validation conditions, data processing and statistical analysis. Based on these six domains, a set of key variables of interest were identified and a 'basic' and 'advanced' multistage protocol for the validation of consumer wearable and smartphone step counters was developed. The INTERLIVE consortium recommends that the proposed protocol is used when considering the validation of any consumer wearable or smartphone step counter. Checklists have been provided to guide validation protocol development and reporting. The network also provide guidance for future research activities, highlighting the imminent need for the development of feasible alternative 'gold-standard' criterion measures for free-living validation. Adherence to these validation and reporting standards will help ensure methodological and reporting consistency, facilitating comparison between consumer devices. Ultimately, this will ensure that as these devices are integrated into standard medical care, consumers, practitioners, industry and researchers can use this technology safely and to its full potential.

Validating Accelerometers for the Assessment of Body Position and Sedentary Behavior

There is growing evidence that sedentary behavior is a risk factor for somatic and mental health. However, there is still a lack of objective field methods, which can assess both components of sedentary behavior: the postural (sitting/lying) and the movement intensity part. The purpose of the study was to compare the validity of different accelerometers (ActivPAL [thigh], ActiGraph [hip], move [hip], and move [thigh]). 20 adults (10 females; age 25.68 ± 4.55 years) participated in a structured protocol with a series of full- and semistandardized sessions under laboratory conditions. Direct observation via video recording was used as a criterion measure of body positions (sitting/lying vs. nonsitting/lying). By combining direct observation with metabolic equivalent tables, protocol activities were also categorized as sedentary or nonsedentary. Cohen’s kappa was calculated as an overall validity measure to compare accelerometer and video recordings. Across all conditions, for the measurement of sitting/lying body positions, the ActivPAL ([thigh], ĸ = .85) and Move 4 ([thigh], ĸ = .97) showed almost perfect agreement, whereas the Move 4 ([hip], ĸ = .78) and ActiGraph ([hip], ĸ = .67) showed substantial agreement. For the sedentary behavior part, across all conditions, the ActivPAL ([thigh], ĸ = .90), Move 4 ([thigh], ĸ = .95) and Move 4 ([hip], ĸ = .84) revealed almost perfect agreement, whereas the ActiGraph ([hip], ĸ = .69) showed substantial agreement. In particular, thigh-worn devices, namely the Move and the ActivPAL, achieved up to excellent validity in measuring sitting/lying body positions and sedentary behavior and are recommended for future studies.

Establishing a Global Standard for Wearable Devices in Sport and Fitness: Perspectives from the New England Chapter of the American College of Sports Medicine Members

The recent explosion of wearable technology and the associated concerns prompted the International Federation of Sports Medicine (FIMS) to create a quality assurance standard for wearable devices, which provides commissioned testing of marketing claims and endorsement of commercial wearables that test favorably. An open forum as announced in the conference advertising was held at the Annual Meeting of the New England Regional Chapter of the American College of Sports Medicine (NEACSM) November 7 to 8, 2019, in Providence, Rhode Island, USA for attending NEACSM members to voice their input on the process. Herein, we report the proceedings. The round table participants perceived the quality assurance standard to be important, but identified some practical process challenges that included the broad scope and complexity of the device universe, the need for a multiphase testing pathway, and the associated fees for product evaluation. The participants also supported the evaluation of device data analysis, behavioral influences, and user experience in the overall evaluation. Looking forward, the FIMS quality assurance standard faces the challenge of balancing these broader perspectives with practical constraints of budget, facilities, time, and human resources.

Construct Validity of the Chilean-Spanish Version of the Functional Status Score for the Intensive Care Unit: A Prospective Observational Study Using Actigraphy in Mechanically Ventilated Patients

OBJECTIVE

To evaluate the construct validity (hypotheses testing) of the Chilean-Spanish version of the Functional Status Score for the Intensive Care Unit (FSS-ICU) using continuous actigraphy from intensive care unit (ICU) admission to ICU discharge.

DESIGN

The Chilean-Spanish version of the FSS-ICU was used in a prospective observational study to mainly evaluate its correlation with actigraphy variables. The FSS-ICU was assessed on awakening and at ICU discharge, while actigraphy variables were recorded from ICU admission to ICU discharge.

SETTING

A 12-bed academic medical-surgical ICU.

PARTICIPANTS

Mechanically ventilated patients (N=30), of 92 patients screened.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Construct validity of the FSS-ICU Chilean-Spanish version was assessed by testing 12 hypotheses, including the correlation with activity counts, activity time (>99 counts/min), inactivity time (0-99 counts/min), muscle strength, ICU length of stay, and duration of mechanical ventilation.

RESULTS

The median FSS-ICU was 19 points (interquartile range [IQR], 10-26 points) on awakening and 28.5 points (IQR, 22-32 points) at ICU discharge. There was no floor/ceiling effect of the FSS-ICU at awakening (0%/0%) and only a ceiling effect at ICU discharge that was acceptable (0%/10%). Less activity time was associated with better mobility on the FSS-ICU at both awakening (ρ=-0.62, P<.001) and ICU discharge (ρ=-0.79, P<.001). Activity counts and activity time were not correlated as expected with the FSS-ICU.

CONCLUSIONS

The Chilean-Spanish FSS-ICU had a strong correlation with inactivity time during the ICU stay. These findings enhance the available clinimetric properties of the FSS-ICU.