Assessment of Accuracy of Overall Energy Expenditure Measurements for the Fitbit Charge HR 2 and Apple Watch

Wearable Sensors to Monitor Physical Activity in Heart Failure Clinical Trials: State-of-the-Art Review

BACKGROUND

Estimation of the effects that drugs or other interventions have on patients' symptoms and functions is crucial in heart failure trials. Traditional symptoms and functions clinical outcome assessments have important limitations. Actigraphy may help to overcome these limitations due to its objective nature and the potential for continuous recording of data. However, actigraphy is not currently accepted as clinically relevant by key stakeholders.

METHODS AND RESULTS

In this state-of-the-art study, the key aspects to consider when implementing actigraphy in heart failure trials are discussed. They include which actigraphy-derived measures should be considered, how to build endpoints using them, how to measure and analyze them, and how to handle the patients' and sites' logistics of integrating devices into trials. A comprehensive recommendation based on the current evidence is provided.

CONCLUSION

Actigraphy is technically feasible in clinical trials involving heart failure, but successful implementation and use to demonstrate clinically important differences in physical functioning with drug or other interventions require careful consideration of many design choices.

Development of SkinTracker, an integrated dermatology mobile app and web portal enabling remote clinical research studies

Introduction

In-person dermatology clinical research studies often face recruitment and participation challenges due to travel-, time-, and cost-associated barriers. Studies incorporating virtual/asynchronous formats can potentially enhance research subject participation and satisfaction, but few mobile health tools are available to enable remote study conduct. We developed SkinTracker, a patient-facing mobile app and researcher-facing web platform, that enables longitudinal collection of skin photos, patient reported outcomes, and biometric health and environmental data.

Methods

Eight design thinking sessions including dermatologists, clinical research staff, software engineers, and graphic designers were held to create the components of SkinTracker. Following iterative prototyping, SkinTracker was piloted across six adult and four pediatric subjects with atopic dermatitis (AD) of varying severity levels to test and provide feedback on SkinTracker for six months.

Results

The SkinTracker app enables collection of informed consent for study participation, baseline medical history, standardized skin photographs, patient-reported outcomes (e.g., Patient Oriented Eczema Measure (POEM), Pruritus Numerical Rating Scale (NRS), Dermatology Life Quality Index (DLQI)), medication use, adverse events, voice diary to document qualitative experiences, chat function for communication with research team, environmental and biometric data such as exercise and sleep metrics through integration with an Apple Watch. The researcher web portal allows for management and visualization of subject enrollment, skin photographs for examination and severity scoring, survey completion, and other patient modules. The pilot study requested that subjects complete surveys and photographs on a weekly to monthly basis via the SkinTracker app. Afterwards, participants rated their experience in a 7-item user experience survey covering app function, design, and desire for participation in future studies using SkinTracker. Almost all subjects agreed or strongly agreed that SkinTracker enabled more convenient participation in skin research studies compared to an in-person format.

Discussion

To our knowledge, SkinTracker is one of the first integrated app- and web-based platforms allowing collection and management of data commonly obtained in clinical research studies. SkinTracker enables detailed, frequent capture of data that may better reflect the fluctuating course of conditions such as AD, and can be modularly customized for different skin conditions to improve dermatologic research participation and patient access.

A Text Messaging Intervention for Priming the Affective Rewards of Exercise in Adults: Protocol for a Microrandomized Trial

BACKGROUND

Physical activity is a critical target for health interventions, but effective interventions remain elusive. A growing body of work suggests that interventions targeting affective attitudes toward physical activity may be more effective for sustaining activity long term than those that rely on cognitive constructs alone, such as goal setting and self-monitoring. Anticipated affective response in particular is a promising target for intervention.

OBJECTIVE

We will evaluate the efficacy of an SMS text messaging intervention that manipulates anticipated affective response to exercise to promote physical activity. We hypothesize that reminding users of a positive postexercise affective state before their planned exercise sessions will increase their calories burned during this exercise session. We will deploy 2 forms of affective SMS text messages to explore the design space: low-reflection messages written by participants for themselves and high-reflection prompts that require users to reflect and respond. We will also explore the effect of the intervention on affective attitudes toward exercise.

METHODS

A total of 120 individuals will be enrolled in a 9-week microrandomized trial testing affective messages that remind users about feeling good after exercise (40% probability), control reminders (30% probability), or no message (30% probability). Two types of affective SMS text messages will be deployed: one requiring a response and the other in a read-only format. Participants will write the read-only messages themselves to ensure that the messages accurately reflect the participants' anticipated postexercise affective state. Affective attitudes toward exercise and intrinsic motivation for exercise will be measured at the beginning and end of the study. The weighted and centered least squares method will be used to analyze the effect of delivering the intervention versus not on calories burned over 4 hours around the time of the planned activity, measured by the Apple Watch. Secondary analyses will include the effect of the intervention on step count and active minutes, as well as an investigation of the effects of the intervention on affective attitudes toward exercise and intrinsic motivation for exercise. Participants will be interviewed to gain qualitative insights into intervention impact and acceptability.

RESULTS

Enrollment began in May 2023, with 57 participants enrolled at the end of July 2023. We anticipate enrolling 120 participants.

CONCLUSIONS

This study will provide early evidence about the effect of a repeated manipulation of anticipated affective response to exercise. The use of 2 different types of messages will yield insight into optimal design strategies for improving affective attitudes toward exercise.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05582369; https://classic.clinicaltrials.gov/ct2/show/NCT05582369.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/46560.

The Energy a Plastic Surgeon Expends during Liposuction

It is generally accepted that liposuction requires a significant amount of energy from surgeons. This procedure involves the use of specialized equipment and techniques to remove fat cells from the body, which can be physically demanding for surgeons. The amount of effort required for liposuction must be evaluated in terms of energy consumption. Our goal was to conduct a study to record the energy that the surgeon uses during liposuction and correlate these results with the volume of fat obtained as well as other variables.

Methods

A series of cases was carried out from April 2022 to November 1, 2022, in three different plastic surgery centers. Three plastic surgeons recorded the procedures using an Apple Watch, choosing from among Apple Watch training options and free indoor walking. The surgeon then concluded the registration at the time of finishing the surgery and removed the surgical gloves and gowns.

Results

Complete data were obtained for 63 patients. The average fat obtained per 1 kcal of energy was 6.14 cm³ of fat, and 160 cal to obtain 1 cm³ of fat by liposuction. Other data that demonstrated statistically significant correlations were fat volume versus average pace (km), total fat volume versus average heart rate, fat volume versus surgical time, and fat volume versus distance.

Conclusions

Liposuction is a surgical procedure that requires considerable effort. This study demonstrates the amount of energy required for regular liposuction. Compared with other single procedures, three times more energy is required to complete liposuction.

The Apple Watch for Monitoring Mental Health-Related Physiological Symptoms: Literature Review

BACKGROUND

An anticipated surge in mental health service demand related to COVID-19 has motivated the use of novel methods of care to meet demand, given workforce limitations. Digital health technologies in the form of self-tracking technology have been identified as a potential avenue, provided sufficient evidence exists to support their effectiveness in mental health contexts.

OBJECTIVE

This literature review aims to identify current and potential physiological or physiologically related monitoring capabilities of the Apple Watch relevant to mental health monitoring and examine the accuracy and validation status of these measures and their implications for mental health treatment.

METHODS

A literature review was conducted from June 2021 to July 2021 of both published and gray literature pertaining to the Apple Watch, mental health, and physiology. The literature review identified studies validating the sensor capabilities of the Apple Watch.

RESULTS

A total of 5583 paper titles were identified, with 115 (2.06%) reviewed in full. Of these 115 papers, 19 (16.5%) were related to Apple Watch validation or comparison studies. Most studies showed that the Apple Watch could measure heart rate acceptably with increased errors in case of movement. Accurate energy expenditure measurements are difficult for most wearables, with the Apple Watch generally providing the best results compared with peers, despite overestimation. Heart rate variability measurements were found to have gaps in data but were able to detect mild mental stress. Activity monitoring with step counting showed good agreement, although wheelchair use was found to be prone to overestimation and poor performance on overground tasks. Atrial fibrillation detection showed mixed results, in part because of a high inconclusive result rate, but may be useful for ongoing monitoring. No studies recorded validation of the Sleep app feature; however, accelerometer-based sleep monitoring showed high accuracy and sensitivity in detecting sleep.

CONCLUSIONS

The results are encouraging regarding the application of the Apple Watch in mental health, particularly as heart rate variability is a key indicator of changes in both physical and emotional states. Particular benefits may be derived through avoidance of recall bias and collection of supporting ecological context data. However, a lack of methodologically robust and replicated evidence of user benefit, a supportive health economic analysis, and concerns about personal health information remain key factors that must be addressed to enable broader uptake.

Accuracy and Precision of Energy Expenditure, Heart Rate, and Steps Measured by Combined-Sensing Fitbits Against Reference Measures: Systematic Review and Meta-analysis

BACKGROUND

Although it is widely recognized that physical activity is an important determinant of health, assessing this complex behavior is a considerable challenge.

OBJECTIVE

The purpose of this systematic review and meta-analysis is to examine, quantify, and report the current state of evidence for the validity of energy expenditure, heart rate, and steps measured by recent combined-sensing Fitbits.

METHODS

We conducted a systematic review and Bland-Altman meta-analysis of validation studies of combined-sensing Fitbits against reference measures of energy expenditure, heart rate, and steps.

RESULTS

A total of 52 studies were included in the systematic review. Among the 52 studies, 41 (79%) were included in the meta-analysis, representing 203 individual comparisons between Fitbit devices and a criterion measure (ie, n=117, 57.6% for heart rate; n=49, 24.1% for energy expenditure; and n=37, 18.2% for steps). Overall, most authors of the included studies concluded that recent Fitbit models underestimate heart rate, energy expenditure, and steps compared with criterion measures. These independent conclusions aligned with the results of the pooled meta-analyses showing an average underestimation of -2.99 beats per minute (k comparison=74), -2.77 kcal per minute (k comparison=29), and -3.11 steps per minute (k comparison=19), respectively, of the Fitbit compared with the criterion measure (results obtained after removing the high risk of bias studies; population limit of agreements for heart rate, energy expenditure, and steps: -23.99 to 18.01, -12.75 to 7.41, and -13.07 to 6.86, respectively).

CONCLUSIONS

Fitbit devices are likely to underestimate heart rate, energy expenditure, and steps. The estimation of these measurements varied by the quality of the study, age of the participants, type of activities, and the model of Fitbit. The qualitative conclusions of most studies aligned with the results of the meta-analysis. Although the expected level of accuracy might vary from one context to another, this underestimation can be acceptable, on average, for steps and heart rate. However, the measurement of energy expenditure may be inaccurate for some research purposes.

Digital health tools for the passive monitoring of depression: a systematic review of methods

The use of digital tools to measure physiological and behavioural variables of potential relevance to mental health is a growing field sitting at the intersection between computer science, engineering, and clinical science. We summarised the literature on remote measuring technologies, mapping methodological challenges and threats to reproducibility, and identified leading digital signals for depression. Medical and computer science databases were searched between January 2007 and November 2019. Published studies linking depression and objective behavioural data obtained from smartphone and wearable device sensors in adults with unipolar depression and healthy subjects were included. A descriptive approach was taken to synthesise study methodologies. We included 51 studies and found threats to reproducibility and transparency arising from failure to provide comprehensive descriptions of recruitment strategies, sample information, feature construction and the determination and handling of missing data. The literature is characterised by small sample sizes, short follow-up duration and great variability in the quality of reporting, limiting the interpretability of pooled results. Bivariate analyses show consistency in statistically significant associations between depression and digital features from sleep, physical activity, location, and phone use data. Machine learning models found the predictive value of aggregated features. Given the pitfalls in the combined literature, these results should be taken purely as a starting point for hypothesis generation. Since this research is ultimately aimed at informing clinical practice, we recommend improvements in reporting standards including consideration of generalisability and reproducibility, such as wider diversity of samples, thorough reporting methodology and the reporting of potential bias in studies with numerous features.

A meta-analysis of Fitbit devices: same company, different models, different validity evidence

Fitbit devices are among the most commonly used physical activity devices used by the general public. Multiple studies have examined the validity evidence of Fitbit devices of estimating energy expenditure during physical activity compared to criterion references. However, the literature lacks objective, summary validity evidence that supports the use of various models of Fitbit devices. Therefore, this study aims (a) to examine the validity evidence among the various models of Fitbit devices and (b) to investigate the influence of several device factors on the validity evidence of Fitbit models using meta-analysis. A total of 402 articles were identified through five databases. Upon review of the articles, 29 studies were included in the meta-analysis. Seven different moderator variables, including Fitbit model, device placement, type of device, heart rate capability, release year of devices, activity types and sedentary activity, were identified and included in the meta-analysis to examine their impact on the validity evidence of Fitbit devices. The summarised validity coefficient of energy expenditure during physical activity estimated by Fitbit devices and measured by criterion references was r=.64 (k = 29, 95% CI [.59, .69], p<.001). Fitbit model was not found to be a significant factor impacting validity evidence of Fitbit devices, but heart rate capability, activity types and sedentary activity were found to be significant factors impacting validity evidence. This study found that not all Fitbit models have a similar ability in estimating energy expenditure during physical activity. Continued research is needed in examining the validity evidence of Fitbit devices, especially considering some factors may affect the validity evidence in measuring energy expenditure during physical activity.

Validation of the Apple Watch for Estimating Moderate-to-Vigorous Physical Activity and Activity Energy Expenditure in School-Aged Children

The Apple Watch is one of the most popular wearable devices designed to monitor physical activity (PA). However, it is currently unknown whether the Apple Watch accurately estimates children’s free-living PA. Therefore, this study assessed the concurrent validity of the Apple Watch 3 in estimating moderate-to-vigorous physical activity (MVPA) time and active energy expenditure (AEE) for school-aged children under a simulated and a free-living condition. Twenty elementary school students (Girls: 45%, age: 9.7 ± 2.0 years) wore an Apple Watch 3 device on their wrist and performed prescribed free-living activities in a lab setting. A subgroup of participants (N = 5) wore the Apple Watch for seven consecutive days in order to assess the validity in free-living condition. The K5 indirect calorimetry (K5) and GT3X+ were used as the criterion measure under simulated free-living and free-living conditions, respectively. Mean absolute percent errors (MAPE) and Bland-Altman (BA) plots were conducted to assess the validity of the Apple Watch 3 compared to those from the criterion measures. Equivalence testing determined the statistical equivalence between the Apple Watch and K5 for MVPA time and AEE. The Apple Watch provided comparable estimates for MVPA time (mean bias: 0.3 min, p = 0.91, MAPE: 1%) and for AEE (mean bias: 3.8 kcal min, p = 0.75, MAPE: 4%) during the simulated free-living condition. The BA plots indicated no systematic bias for the agreement in MVPA and AEE estimates between the K5 and Apple Watch 3. However, the Apple Watch had a relatively large variability in estimating AEE in children. The Apple Watch was statistically equivalent to the K5 within ±17.7% and ±20.8% for MVPA time and AEE estimates, respectively. Our findings suggest that the Apple Watch 3 has the potential to be used as a PA assessment tool to estimate MVPA in school-aged children.

Comparing Methods to Identify Wear-Time Intervals for Physical Activity With the Fitbit Charge 2

There is no established method for processing data from commercially available physical activity trackers. This study aims to develop a standardized approach to defining valid wear time for use in future interventions and analyses. Sixteen African American women (mean age = 62.1 years and mean body mass index = 35.5 kg/m2) wore the Fitbit Charge 2 for 20 days. Method 1 defined a valid day as ≥10-hr wear time with heart rate data. Method 2 removed minutes without heart rate data, minutes with heart rate ≤ mean - 2 SDs below mean and ≤2 steps, and nighttime. Linear regression modeled steps per day per week change. Using Method 1 (n = 292 person-days), participants had 20.5 (SD = 4.3) hr wear time per day compared with 16.3 (SD = 2.2) hr using Method 2 (n = 282) (p < .0001). With Method 1, participants took 7,436 (SD = 3,543) steps per day compared with 7,298 (SD = 3,501) steps per day with Method 2 (p = .64). The proposed algorithm represents a novel approach to standardizing data generated by physical activity trackers. Future studies are needed to improve the accuracy of physical activity data sets.

Factors associated with validity of consumer-oriented wearable physical activity trackers: a meta-analysis

The purposes of this study were to examine (1) the strength of the criterion validity evidence of various consumer-oriented wearable physical activity trackers, (2) the influence of brands of consumer-oriented wearable physical activity on validity evidence and (3) factors that may contribute to differences in the strength of the criterion validity evidence. A total of 589 articles were identified through four databases. Pairs of researchers reviewed the articles to determine eligibility. A total of 29 studies with 96 validity coefficients were included in the meta-analysis. Five different moderators, including the brands of physical activity trackers, placement of devices, type of activities (ambulatory vs. lifestyle activities), population, and release year, were analysed to examine which factors impact the validity evidence. The summarised validity coefficient between activity trackers and energy expenditure ranged from r = .41 to r = .91. Moderator analyses revealed that the brand, placement of the device, and population significantly impact the magnitude of the validity evidence, while the type of activity and release year of the devices do not. Device brand, population, andplacement are each factor that significantly affects the validity coefficientsbetween consumer-oriented wearable physical activity trackers. Efforts should be made to improve the accuracy of these devices to maintain the credibility of the research and the trust of consumers.

Reliability and Validity of Commercially Available Wearable Devices for Measuring Steps, Energy Expenditure, and Heart Rate: Systematic Review

Background

Consumer-wearable activity trackers are small electronic devices that record fitness and health-related measures.

Objective

The purpose of this systematic review was to examine the validity and reliability of commercial wearables in measuring step count, heart rate, and energy expenditure.

Methods

We identified devices to be included in the review. Database searches were conducted in PubMed, Embase, and SPORTDiscus, and only articles published in the English language up to May 2019 were considered. Studies were excluded if they did not identify the device used and if they did not examine the validity or reliability of the device. Studies involving the general population and all special populations were included. We operationalized validity as criterion validity (as compared with other measures) and construct validity (degree to which the device is measuring what it claims). Reliability measures focused on intradevice and interdevice reliability.

Results

We included 158 publications examining nine different commercial wearable device brands. Fitbit was by far the most studied brand. In laboratory-based settings, Fitbit, Apple Watch, and Samsung appeared to measure steps accurately. Heart rate measurement was more variable, with Apple Watch and Garmin being the most accurate and Fitbit tending toward underestimation. For energy expenditure, no brand was accurate. We also examined validity between devices within a specific brand.

Conclusions

Commercial wearable devices are accurate for measuring steps and heart rate in laboratory-based settings, but this varies by the manufacturer and device type. Devices are constantly being upgraded and redesigned to new models, suggesting the need for more current reviews and research.

Real-time feedback by wearables in running: Current approaches, challenges and suggestions for improvements

Injuries and lack of motivation are common reasons for discontinuation of running. Real-time feedback from wearables can reduce discontinuation by reducing injury risk and improving performance and motivation. There are however several limitations and challenges with current real-time feedback approaches. We discuss these limitations and challenges and provide a framework to optimise real-time feedback for reducing injury risk and improving performance and motivation. We first discuss the reasons why individuals run and propose that feedback targeted to these reasons can improve motivation and compliance. Secondly, we review the association of running technique and running workload with injuries and performance and we elaborate how real-time feedback on running technique and workload can be applied to reduce injury risk and improve performance and motivation. We also review different feedback modalities and motor learning feedback strategies and their application to real-time feedback. Briefly, the most effective feedback modality and frequency differ between variables and individuals, but a combination of modalities and mixture of real-time and delayed feedback is most effective. Moreover, feedback promoting perceived competence, autonomy and an external focus can improve motivation, learning and performance. Although the focus is on wearables, the challenges and practical applications are also relevant for laboratory-based gait retraining.