Sample size calculations for micro-randomized trials in mHealth

Optimizing an adaptive digital oral health intervention for promoting oral self-care behaviors: Micro-randomized trial protocol

Dental disease continues to be one of the most prevalent chronic diseases in the United States. Although oral self-care behaviors (OSCB), involving systematic twice-a-day tooth brushing, can prevent dental disease, this basic behavior is not sufficiently practiced. Recent advances in digital technology offer tremendous potential for promoting OSCB by delivering Just-In-Time Adaptive Interventions (JITAIs)- interventions that leverage dynamic information about the person's state and context to effectively prompt them to engage in a desired behavior in real-time, real-world settings. However, limited research attention has been given to systematically investigating how to best prompt individuals to engage in OSCB in daily life, and under what conditions prompting would be most beneficial. This paper describes the protocol for a Micro-Randomized Trial (MRT) to inform the development of a JITAI for promoting ideal OSCB, namely, brushing twice daily, for two minutes each time, in all four dental quadrants (i.e., 2x2x4). Sensors within an electric toothbrush (eBrush) will be used to track OSCB and a matching mobile app (Oralytics) will deliver on-demand feedback and educational information. The MRT will micro-randomize participants twice daily (morning and evening) to either (a) a prompt (push notification) containing one of several theoretically grounded engagement strategies or (b) no prompt. The goal is to investigate whether, what type of, and under what conditions prompting increases engagement in ideal OSCB. The results will build the empirical foundation necessary to develop an optimized JITAI that will be evaluated relative to a suitable control in a future randomized controlled trial.

Design of experiments with sequential randomizations on multiple timescales: the hybrid experimental design

Psychological interventions, especially those leveraging mobile and wireless technologies, often include multiple components that are delivered and adapted on multiple timescales (e.g., coaching sessions adapted monthly based on clinical progress, combined with motivational messages from a mobile device adapted daily based on the person's daily emotional state). The hybrid experimental design (HED) is a new experimental approach that enables researchers to answer scientific questions about the construction of psychological interventions in which components are delivered and adapted on different timescales. These designs involve sequential randomizations of study participants to intervention components, each at an appropriate timescale (e.g., monthly randomization to different intensities of coaching sessions and daily randomization to different forms of motivational messages). The goal of the current manuscript is twofold. The first is to highlight the flexibility of the HED by conceptualizing this experimental approach as a special form of a factorial design in which different factors are introduced at multiple timescales. We also discuss how the structure of the HED can vary depending on the scientific question(s) motivating the study. The second goal is to explain how data from various types of HEDs can be analyzed to answer a variety of scientific questions about the development of multicomponent psychological interventions. For illustration, we use a completed HED to inform the development of a technology-based weight loss intervention that integrates components that are delivered and adapted on multiple timescales.

Developing Message Strategies to Engage Racial and Ethnic Minority Groups in Digital Oral Self-Care Interventions: Participatory Co-Design Approach

BACKGROUND

The prevention of oral health diseases is a key public health issue and a major challenge for racial and ethnic minority groups, who often face barriers in accessing dental care. Daily toothbrushing is an important self-care behavior necessary for sustaining good oral health, yet engagement in regular brushing remains a challenge. Identifying strategies to promote engagement in regular oral self-care behaviors among populations at risk of poor oral health is critical.

OBJECTIVE

The formative research described here focused on creating messages for a digital oral self-care intervention targeting a racially and ethnically diverse population. Theoretically grounded strategies (reciprocity, reciprocity-by-proxy, and curiosity) were used to promote engagement in 3 aspects: oral self-care behaviors, an oral care smartphone app, and digital messages. A web-based participatory co-design approach was used to develop messages that are resource efficient, appealing, and novel; this approach involved dental experts, individuals from the general population, and individuals from the target population-dental patients from predominantly low-income racial and ethnic minority groups. Given that many individuals from racially and ethnically diverse populations face anonymity and confidentiality concerns when participating in research, we used an approach to message development that aimed to mitigate these concerns.

METHODS

Messages were initially developed with feedback from dental experts and Amazon Mechanical Turk workers. Dental patients were then recruited for 2 facilitator-mediated group webinar sessions held over Zoom (Zoom Video Communications; session 1: n=13; session 2: n=7), in which they provided both quantitative ratings and qualitative feedback on the messages. Participants interacted with the facilitator through Zoom polls and a chat window that was anonymous to other participants. Participants did not directly interact with each other, and the facilitator mediated sessions by verbally asking for message feedback and sharing key suggestions with the group for additional feedback. This approach plausibly enhanced participant anonymity and confidentiality during the sessions.

RESULTS

Participants rated messages highly in terms of liking (overall rating: mean 2.63, SD 0.58; reciprocity: mean 2.65, SD 0.52; reciprocity-by-proxy: mean 2.58, SD 0.53; curiosity involving interactive oral health questions and answers: mean 2.45, SD 0.69; curiosity involving tailored brushing feedback: mean 2.77, SD 0.48) on a scale ranging from 1 (do not like it) to 3 (like it). Qualitative feedback indicated that the participants preferred messages that were straightforward, enthusiastic, conversational, relatable, and authentic.

CONCLUSIONS

This formative research has the potential to guide the design of messages for future digital health behavioral interventions targeting individuals from diverse racial and ethnic populations. Insights emphasize the importance of identifying key stimuli and tasks that require engagement, gathering multiple perspectives during message development, and using new approaches for collecting both quantitative and qualitative data while mitigating anonymity and confidentiality concerns.

Digital Adaptive Behavioral Interventions to Improve HIV Prevention and Care: Innovations in Intervention Approach and Experimental Design

PURPOSE OF REVIEW

Recent advances in digital technologies can be leveraged to adapt HIV prevention and treatment services to the rapidly changing needs of individuals in everyday life. However, to fully take advantage of these technologies, it is critical to effectively integrate them with human-delivered components. Here, we introduce a new experimental approach for optimizing the integration and adaptation of digital and human-delivered behavioral intervention components for HIV prevention and treatment.

RECENT FINDINGS

Typically, human-delivered components can be adapted on a relatively slow timescale (e.g., every few months or weeks), while digital components can be adapted much faster (e.g., every few days or hours). Thus, the systematic integration of these components requires an experimental approach that involves sequential randomizations on multiple timescales. Selecting an experimental approach should be motivated by the type of adaptive intervention investigators would like to develop, and the scientific questions they have about its construction.

Optimization of a Transdiagnostic Mobile Emotion Regulation Intervention for University Students: Protocol for a Microrandomized Trial

BACKGROUND

Many university students experience mental health problems such as anxiety and depression. To support their mental health, a transdiagnostic mobile app intervention has been developed. The intervention provides short exercises rooted in various approaches (eg, positive psychology, mindfulness, self-compassion, and acceptance and commitment therapy) that aim to facilitate adaptive emotion regulation (ER) to help students cope with the various stressors they encounter during their time at university.

OBJECTIVE

The goals of this study are to investigate whether the intervention and its components function as intended and how participants engage with them. In addition, this study aims to monitor changes in distress symptoms and ER skills and identify relevant contextual factors that may moderate the intervention's impact.

METHODS

A sequential explanatory mixed methods design combining a microrandomized trial and semistructured interviews will be used. During the microrandomized trial, students (N=200) will be prompted via the mobile app twice a day for 3 weeks to evaluate their emotional states and complete a randomly assigned intervention (ie, an exercise supporting ER) or a control intervention (ie, a health information snippet). A subsample of participants (21/200, 10.5%) will participate in interviews exploring their user experience with the app and the completed exercises. The primary outcomes will be changes in emotional states and engagement with the intervention (ie, objective and subjective engagement). Objective engagement will be evaluated through log data (eg, exercise completion time). Subjective engagement will be evaluated through exercise likability and helpfulness ratings as well as user experience interviews. The secondary outcomes will include the distal outcomes of the intervention (ie, ER skills and distress symptoms). Finally, the contextual moderators of intervention effectiveness will be explored (eg, the time of day and momentary emotional states).

RESULTS

The study commenced on February 9, 2023, and the data collection was concluded on June 13, 2023. Of the 172 eligible participants, 161 (93.6%) decided to participate. Of these 161 participants, 137 (85.1%) completed the first phase of the study. A subsample of participants (18/172, 10.5%) participated in the user experience interviews. Currently, the data processing and analyses are being conducted.

CONCLUSIONS

This study will provide insight into the functioning of the intervention and identify areas for improvement. Furthermore, the findings will shed light on potential changes in the distal outcomes of the intervention (ie, ER skills and distress symptoms), which will be considered when designing a follow-up randomized controlled trial evaluating the full-scale effectiveness of this intervention. Finally, the results and data gathered will be used to design and train a recommendation algorithm that will be integrated into the app linking students to relevant content.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05576883; https://www.clinicaltrials.gov/study/NCT05576883.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/46603.

Testing the Effects of App-Based Motivational Messages on Physical Activity and Resting Heart Rate Through Smartphone App Compliance in Patients With Vulnerable Coronary Artery Plaques: Protocol for a Microrandomized Trial

BACKGROUND

Achieving the weekly physical activity recommendations of at least 150-300 minutes of moderate-intensity or 75-150 minutes of vigorous-intensity aerobic exercise is important for reducing cardiometabolic risk, but evidence shows that most people struggle to meet these goals, particularly in the mid to long term.

OBJECTIVE

The Messages Improving Resting Heart Health (MIRTH) study aims to determine if (1) sending daily motivational messages through a research app is effective in improving motivation and in promoting adherence to physical activity recommendations in men and women with coronary heart disease randomized to a 12-month intensive lifestyle intervention, and (2) the time of the day when the message is delivered impacts compliance with exercise training.

METHODS

We will conduct a single-center, microrandomized trial. Participants will be randomized daily to either receive or not receive motivational messages over two 90-day periods at the beginning (phase 1: months 4-6) and at the end (phase 2: months 10-12) of the Lifestyle Vulnerable Plaque Study. Wrist-worn devices (Fitbit Inspire 2) and Bluetooth pairing with smartphones will be used to passively collect data for proximal (ie, physical activity duration, steps walked, and heart rate within 180 minutes of receiving messages) and distal (ie, change values for resting heart rate and total steps walked within and across both phases 1 and 2 of the trial) outcomes. Participants will be recruited from a large academic cardiology office practice (Central Sydney Cardiology) and the Royal Prince Alfred Hospital Departments of Cardiology and Radiology. All clinical investigations will be undertaken at the Charles Perkins Centre Royal Prince Alfred clinic. Individuals aged 18-80 years (n=58) with stable coronary heart disease who have low attenuation plaques based on a coronary computed tomography angiography within the past 3 months and have been randomized to an intensive lifestyle intervention program will be included in MIRTH.

RESULTS

The Lifestyle Vulnerable Plaque Study was funded in 2020 and started enrolling participants in February 2022. Recruitment for MIRTH commenced in November 2022. As of September 2023, 2 participants were enrolled in the MIRTH study and provided baseline data.

CONCLUSIONS

This MIRTH microrandomized trial will represent the single most detailed and integrated analysis of the effects of a comprehensive lifestyle intervention delivered through a customized mobile health app on smart devices on time-based motivational messaging for patients with coronary heart disease. This study will also help inform future studies optimizing for just-in-time adaptive interventions.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN12622000731796; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=382861.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/46082.

Refocusing of Attention on Positive Events Using Monitoring-Based Feedback and Microinterventions for Patients With Chronic Musculoskeletal Pain in the PerPAIN Randomized Controlled Trial: Protocol for a Microrandomized Trial

BACKGROUND

Chronic musculoskeletal pain (CMSP) affects between 13% and 47% of the population, with a global growth rate of 20.3% within the last 15 years, suggesting that there is a high need for effective treatments. Pain diaries have long been a common tool in nonpharmacological pain treatment for monitoring and providing feedback on patients' symptoms in daily life. More recently, positive refocusing techniques have come to be used, promoting pain-free episodes and positive outcomes rather than focusing on managing the pain.

OBJECTIVE

This study aims to evaluate the feasibility (ie, acceptability, intervention adherence, and fidelity) and initial signals of efficacy of the PerPAIN app, an ecological momentary intervention for patients with CMSP. The app comprises digitalized monitoring using the experience sampling method (ESM) and feedback. In addition, the patients receive 3 microinterventions targeted at refocusing of attention on positive events.

METHODS

In a microrandomized trial, we will recruit 35 patients with CMSP who will be offered the app for 12 weeks. Participants will be prompted to fill out 4 ESM monitoring questionnaires a day assessing information on their current context and the proximal outcome variables: absence of pain, positive mood, and subjective activity. Participants will be randomized daily and weekly to receive no feedback, verbal feedback, or visual feedback on proximal outcomes assessed by the ESM. In addition, the app will encourage participants to complete 3 microinterventions based on positive psychology and cognitive behavioral therapy techniques. These microinterventions are prompts to report joyful moments and everyday successes or to plan pleasant activities. After familiarizing themselves with each microintervention individually, participants will be randomized daily to receive 1 of the 3 exercises or none. We will assess whether the 2 feedback types and the 3 microinterventions increase proximal outcomes at the following time point. The microrandomized trial is part of the PerPAIN randomized controlled trial (German Clinical Trials Register DRKS00022792) investigating a personalized treatment approach to enhance treatment outcomes in CMSP.

RESULTS

Approval was granted by the Ethics Committee II of the University of Heidelberg on August 4, 2020. Recruitment for the microrandomized trial began in May 2021 and is ongoing at the time of submission. By October 10, 2022, a total of 24 participants had been enrolled in the microrandomized trial.

CONCLUSIONS

This trial will provide evidence on the feasibility of the PerPAIN app and the initial signals of efficacy of the different intervention components. In the next step, the intervention would need to be further refined and investigated in a definitive trial. This ecological momentary intervention presents a potential method for offering low-level accessible treatment to a wide range of people, which could have substantial implications for public health by reducing disease burden of chronic pain in the population.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/43376.

A flexible micro-randomized trial design and sample size considerations

Technological advancements have made it possible to deliver mobile health interventions to individuals. A novel framework that has emerged from such advancements is the just-in-time adaptive intervention, which aims to suggest the right support to the individuals when their needs arise. The micro-randomized trial design has been proposed recently to test the proximal effects of the components of these just-in-time adaptive interventions. However, the extant micro-randomized trial framework only considers components with a fixed number of categories added at the beginning of the study. We propose a more flexible micro-randomized trial design which allows addition of more categories to the components during the study. Note that the number and timing of the categories added during the study need to be fixed initially. The proposed design is motivated by collaboration on the Diabetes and Mental Health Adaptive Notification Tracking and Evaluation study, which learns to deliver effective text messages to encourage physical activity among patients with diabetes and depression. We developed a new test statistic and the corresponding sample size calculator for the flexible micro-randomized trial using an approach similar to the generalized estimating equation for longitudinal data. Simulation studies were conducted to evaluate the sample size calculators and an R shiny application for the calculators was developed.

A Text Messaging Intervention for Priming the Affective Rewards of Exercise in Adults: Protocol for a Microrandomized Trial

BACKGROUND

Physical activity is a critical target for health interventions, but effective interventions remain elusive. A growing body of work suggests that interventions targeting affective attitudes toward physical activity may be more effective for sustaining activity long term than those that rely on cognitive constructs alone, such as goal setting and self-monitoring. Anticipated affective response in particular is a promising target for intervention.

OBJECTIVE

We will evaluate the efficacy of an SMS text messaging intervention that manipulates anticipated affective response to exercise to promote physical activity. We hypothesize that reminding users of a positive postexercise affective state before their planned exercise sessions will increase their calories burned during this exercise session. We will deploy 2 forms of affective SMS text messages to explore the design space: low-reflection messages written by participants for themselves and high-reflection prompts that require users to reflect and respond. We will also explore the effect of the intervention on affective attitudes toward exercise.

METHODS

A total of 120 individuals will be enrolled in a 9-week microrandomized trial testing affective messages that remind users about feeling good after exercise (40% probability), control reminders (30% probability), or no message (30% probability). Two types of affective SMS text messages will be deployed: one requiring a response and the other in a read-only format. Participants will write the read-only messages themselves to ensure that the messages accurately reflect the participants' anticipated postexercise affective state. Affective attitudes toward exercise and intrinsic motivation for exercise will be measured at the beginning and end of the study. The weighted and centered least squares method will be used to analyze the effect of delivering the intervention versus not on calories burned over 4 hours around the time of the planned activity, measured by the Apple Watch. Secondary analyses will include the effect of the intervention on step count and active minutes, as well as an investigation of the effects of the intervention on affective attitudes toward exercise and intrinsic motivation for exercise. Participants will be interviewed to gain qualitative insights into intervention impact and acceptability.

RESULTS

Enrollment began in May 2023, with 57 participants enrolled at the end of July 2023. We anticipate enrolling 120 participants.

CONCLUSIONS

This study will provide early evidence about the effect of a repeated manipulation of anticipated affective response to exercise. The use of 2 different types of messages will yield insight into optimal design strategies for improving affective attitudes toward exercise.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05582369; https://classic.clinicaltrials.gov/ct2/show/NCT05582369.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/46560.

Sample size considerations for micro-randomized trials with binary proximal outcomes

Micro-randomized trials (MRTs) are a novel experimental design for developing mobile health interventions. Participants are repeatedly randomized in an MRT, resulting in longitudinal data with time-varying treatments. Causal excursion effects are the main quantities of interest in MRT primary and secondary analyses. We consider MRTs where the proximal outcome is binary and the randomization probability is constant or time-varying but not data-dependent. We develop a sample size formula for detecting a nonzero marginal excursion effect. We prove that the formula guarantees power under a set of working assumptions. We demonstrate via simulation that violations of certain working assumptions do not affect the power, and for those that do, we point out the direction in which the power changes. We then propose practical guidelines for using the sample size formula. As an illustration, the formula is used to size an MRT on interventions for excessive drinking. The sample size calculator is implemented in R package MRTSampleSizeBinary and an interactive R Shiny app. This work can be used in trial planning for a wide range of MRTs with binary proximal outcomes.

Self-relevant appeals to engage in self-monitoring of alcohol use: A microrandomized trial

OBJECTIVE

While self-monitoring can help mitigate alcohol misuse in young adults, engagement with digital self-monitoring is suboptimal. The present study investigates the utility of two types of digital prompts (reminders) to encourage young adults to self-monitor their alcohol use. These prompts leverage information that is self-relevant (i.e., represents and is valuable) to the person.

METHOD

Five hundred ninety-one college students (Mage = 18; 61% = female, 76% = White) were enrolled in an 8-week intervention study involving biweekly digital self-monitoring of their alcohol use. At baseline, participants selected an item they would like to purchase for themselves and their preferred charitable organization. Then, biweekly, participants were microrandomized to a prompt highlighting the opportunity to either (a) win their preferred item (self-interest prompt); or (b) donate to their preferred charity (prosocial prompt). Following self-monitoring completion, participants allocated reward points toward lottery drawings for their preferred item or charity.

RESULTS

The self-interest (vs. prosocial) prompt was significantly more effective in promoting proximal self-monitoring at the beginning of the study, Est = exp(.14) = 1.15; 95% confidence interval (CI) [1.01, 1.29], whereas the prosocial (vs. self-interest) prompt was significantly more effective at the end, Est = exp(-.17) = 0.84; 95% CI [0.70, 0.98]. Further, the prosocial (vs. self-interest) prompt was significantly more effective among participants who previously allocated all their reward points to drawings for their preferred item, Est = exp(-.15) = 0.86; 95% CI [.75, .97].

CONCLUSIONS

These results suggest that the advantage of prompts that appeal to a person's self-interest (vs. prosocial) motives varies over time and based on what reward options participants prioritized in previous decisions. Theoretical and practical implications for intervention design are discussed. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Microrandomized Trials: Developing Just-in-Time Adaptive Interventions for Better Public Health

Just-in-time adaptive interventions (JITAIs) represent an intervention design that adapts the provision and type of support over time to an individual's changing status and contexts, intending to deliver the right support on the right occasion. As a novel strategy for delivering mobile health interventions, JITAIs have the potential to improve access to quality care in underserved communities and, thus, alleviate health disparities, a significant public health concern. Valid experimental designs and analysis methods are required to inform the development of JITAIs. Here, we briefly review the cutting-edge design of microrandomized trials (MRTs), covering both the classical MRT design and its outcome-adaptive counterpart. Associated statistical challenges related to the design and analysis of MRTs are also discussed. Two case studies are provided to illustrate the aforementioned concepts and designs throughout the article. We hope our work leads to better design and application of JITAIs, advancing public health research and practice. (Am J Public Health. 2023;113(1):60-69. https://doi.org/10.2105/AJPH.2022.307150).

Batch policy learning in average reward Markov decision processes

We consider the batch (off-line) policy learning problem in the infinite horizon Markov Decision Process. Motivated by mobile health applications, we focus on learning a policy that maximizes the long-term average reward. We propose a doubly robust estimator for the average reward and show that it achieves semiparametric efficiency. Further we develop an optimization algorithm to compute the optimal policy in a parameterized stochastic policy class. The performance of the estimated policy is measured by the difference between the optimal average reward in the policy class and the average reward of the estimated policy and we establish a finite-sample regret guarantee. The performance of the method is illustrated by simulation studies and an analysis of a mobile health study promoting physical activity.

White Paper: Open Digital Health - accelerating transparent and scalable health promotion and treatment

In this White Paper, we outline recommendations from the perspective of health psychology and behavioural science, addressing three research gaps: (1) What methods in the health psychology research toolkit can be best used for developing and evaluating digital health tools? (2) What are the most feasible strategies to reuse digital health tools across populations and settings? (3) What are the main advantages and challenges of sharing (openly publishing) data, code, intervention content and design features of digital health tools? We provide actionable suggestions for researchers joining the continuously growing Open Digital Health movement, poised to revolutionise health psychology research and practice in the coming years. This White Paper is positioned in the current context of the COVID-19 pandemic, exploring how digital health tools have rapidly gained popularity in 2020-2022, when world-wide health promotion and treatment efforts rapidly shifted from face-to-face to remote delivery. This statement is written by the Directors of the not-for-profit Open Digital Health initiative (n = 6), Experts attending the European Health Psychology Society Synergy Expert Meeting (n = 17), and the initiative consultant, following a two-day meeting (19-20th August 2021).

MCMTC: A Pragmatic Framework for Selecting an Experimental Design to Inform the Development of Digital Interventions

Advances in digital technologies have created unprecedented opportunities to deliver effective and scalable behavior change interventions. Many digital interventions include multiple components, namely several aspects of the intervention that can be differentiated for systematic investigation. Various types of experimental approaches have been developed in recent years to enable researchers to obtain the empirical evidence necessary for the development of effective multiple-component interventions. These include factorial designs, Sequential Multiple Assignment Randomized Trials (SMARTs), and Micro-Randomized Trials (MRTs). An important challenge facing researchers concerns selecting the right type of design to match their scientific questions. Here, we propose MCMTC – a pragmatic framework that can be used to guide investigators interested in developing digital interventions in deciding which experimental approach to select. This framework includes five questions that investigators are encouraged to answer in the process of selecting the most suitable design: (1) Multiple-component intervention: Is the goal to develop an intervention that includes multiple components; (2) Component selection: Are there open scientific questions about the selection of specific components for inclusion in the intervention; (3) More than a single component: Are there open scientific questions about the inclusion of more than a single component in the intervention; (4) Timing: Are there open scientific questions about the timing of component delivery, that is when to deliver specific components; and (5) Change: Are the components in question designed to address conditions that change relatively slowly (e.g., over months or weeks) or rapidly (e.g., every day, hours, minutes). Throughout we use examples of tobacco cessation digital interventions to illustrate the process of selecting a design by answering these questions. For simplicity we focus exclusively on four experimental approaches—standard two- or multi-arm randomized trials, classic factorial designs, SMARTs, and MRTs—acknowledging that the array of possible experimental approaches for developing digital interventions is not limited to these designs.

Using Health Concept Surveying to Elicit Usable Evidence: Case Studies of a Novel Evaluation Methodology

BACKGROUND

Developers, designers, and researchers use rapid prototyping methods to project the adoption and acceptability of their health intervention technology (HIT) before the technology becomes mature enough to be deployed. Although these methods are useful for gathering feedback that advances the development of HITs, they rarely provide usable evidence that can contribute to our broader understanding of HITs.

OBJECTIVE

In this research, we aim to develop and demonstrate a variation of vignette testing that supports developers and designers in evaluating early-stage HIT designs while generating usable evidence for the broader research community.

METHODS

We proposed a method called health concept surveying for untangling the causal relationships that people develop around conceptual HITs. In health concept surveying, investigators gather reactions to design concepts through a scenario-based survey instrument. As the investigator manipulates characteristics related to their HIT, the survey instrument also measures proximal cognitive factors according to a health behavior change model to project how HIT design decisions may affect the adoption and acceptability of an HIT. Responses to the survey instrument were analyzed using path analysis to untangle the causal effects of these factors on the outcome variables.

RESULTS

We demonstrated health concept surveying in 3 case studies of sensor-based health-screening apps. Our first study (N=54) showed that a wait time incentive could influence more people to go see a dermatologist after a positive test for skin cancer. Our second study (N=54), evaluating a similar application design, showed that although visual explanations of algorithmic decisions could increase participant trust in negative test results, the trust would not have been enough to affect people's decision-making. Our third study (N=263) showed that people might prioritize test specificity or sensitivity depending on the nature of the medical condition.

CONCLUSIONS

Beyond the findings from our 3 case studies, our research uses the framing of the Health Belief Model to elicit and understand the intrinsic and extrinsic factors that may affect the adoption and acceptability of an HIT without having to build a working prototype. We have made our survey instrument publicly available so that others can leverage it for their own investigations.

Optimizing a Just-in-Time Adaptive Intervention to Improve Dietary Adherence in Behavioral Obesity Treatment: Protocol for a Microrandomized Trial

BACKGROUND

Behavioral obesity treatment (BOT) is a gold standard approach to weight loss and reduces the risk of cardiovascular disease. However, frequent lapses from the recommended diet stymie weight loss and prevent individuals from actualizing the health benefits of BOT. There is a need for innovative treatment solutions to improve adherence to the prescribed diet in BOT.

OBJECTIVE

The aim of this study is to optimize a smartphone-based just-in-time adaptive intervention (JITAI) that uses daily surveys to assess triggers for dietary lapses and deliver interventions when the risk of lapse is high. A microrandomized trial design will evaluate the efficacy of any interventions (ie, theory-driven or a generic alert to risk) on the proximal outcome of lapses during BOT, compare the effects of theory-driven interventions with generic risk alerts on the proximal outcome of lapse, and examine contextual moderators of interventions.

METHODS

Adults with overweight or obesity and cardiovascular disease risk (n=159) will participate in a 6-month web-based BOT while using the JITAI to prevent dietary lapses. Each time the JITAI detects elevated lapse risk, the participant will be randomized to no intervention, a generic risk alert, or 1 of 4 theory-driven interventions (ie, enhanced education, building self-efficacy, fostering motivation, and improving self-regulation). The primary outcome will be the occurrence of lapse in the 2.5 hours following randomization. Contextual moderators of intervention efficacy will also be explored (eg, location and time of day). The data will inform an optimized JITAI that selects the theory-driven approach most likely to prevent lapses in a given moment.

RESULTS

The recruitment for the microrandomized trial began on April 19, 2021, and is ongoing.

CONCLUSIONS

This study will optimize a JITAI for dietary lapses so that it empirically tailors the provision of evidence-based intervention to the individual and context. The finalized JITAI will be evaluated for efficacy in a future randomized controlled trial of distal health outcomes (eg, weight loss).

TRIAL REGISTRATION

ClinicalTrials.gov NCT04784585; http://clinicaltrials.gov/ct2/show/NCT04784585.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/33568.

The mobile assistance for regulating smoking (MARS) micro-randomized trial design protocol

Smoking is the leading preventable cause of death and disability in the U.S. Empirical evidence suggests that engaging in evidence-based self-regulatory strategies (e.g., behavioral substitution, mindful attention) can improve smokers' ability to resist craving and build self-regulatory skills. However, poor engagement represents a major barrier to maximizing the impact of self-regulatory strategies. This paper describes the protocol for Mobile Assistance for Regulating Smoking (MARS) - a research study designed to inform the development of a mobile health (mHealth) intervention for promoting real-time, real-world engagement in evidence-based self-regulatory strategies. The study will employ a 10-day Micro-Randomized Trial (MRT) enrolling 112 smokers attempting to quit. Utilizing a mobile smoking cessation app, the MRT will randomize each individual multiple times per day to either: (a) no intervention prompt; (b) a prompt recommending brief (low effort) cognitive and/or behavioral self-regulatory strategies; or (c) a prompt recommending more effortful cognitive or mindfulness-based strategies. Prompts will be delivered via push notifications from the MARS mobile app. The goal is to investigate whether, what type of, and under what conditions prompting the individual to engage in self-regulatory strategies increases engagement. The results will build the empirical foundation necessary to develop a mHealth intervention that effectively utilizes intensive longitudinal self-report and sensor-based assessments of emotions, context and other factors to engage an individual in the type of self-regulatory activity that would be most beneficial given their real-time, real-world circumstances. This type of mHealth intervention holds enormous potential to expand the reach and impact of smoking cessation treatments.

Estimating time-varying causal excursion effect in mobile health with binary outcomes

Advances in wearables and digital technology now make it possible to deliver behavioral mobile health interventions to individuals in their everyday life. The micro-randomized trial is increasingly used to provide data to inform the construction of these interventions. In a micro-randomized trial, each individual is repeatedly randomized among multiple intervention options, often hundreds or even thousands of times, over the course of the trial. This work is motivated by multiple micro-randomized trials that have been conducted or are currently in the field, in which the primary outcome is a longitudinal binary outcome. The primary aim of such micro-randomized trials is to examine whether a particular time-varying intervention has an effect on the longitudinal binary outcome, often marginally over all but a small subset of the individual's data. We propose the definition of causal excursion effect that can be used in such primary aim analysis for micro-randomized trials with binary outcomes. Under rather restrictive assumptions one can, based on existing literature, derive a semiparametric, locally efficient estimator of the causal effect. Starting from this estimator, we develop an estimator that can be used as the basis of a primary aim analysis under more plausible assumptions. Simulation studies are conducted to compare the estimators. We illustrate the developed methods using data from the micro-randomized trial, BariFit. In BariFit, the goal is to support weight maintenance for individuals who received bariatric surgery.

IntelligentPooling: Practical Thompson Sampling for mHealth

In mobile health (mHealth) smart devices deliver behavioral treatments repeatedly over time to a user with the goal of helping the user adopt and maintain healthy behaviors. Reinforcement learning appears ideal for learning how to optimally make these sequential treatment decisions. However, significant challenges must be overcome before reinforcement learning can be effectively deployed in a mobile healthcare setting. In this work we are concerned with the following challenges: 1) individuals who are in the same context can exhibit differential response to treatments 2) only a limited amount of data is available for learning on any one individual, and 3) non-stationary responses to treatment. To address these challenges we generalize Thompson-Sampling bandit algorithms to develop IntelligentPooling. IntelligentPooling learns personalized treatment policies thus addressing challenge one. To address the second challenge, IntelligentPooling updates each user's degree of personalization while making use of available data on other users to speed up learning. Lastly, IntelligentPooling allows responsivity to vary as a function of a user's time since beginning treatment, thus addressing challenge three.

A quality-improvement optimization pilot of BariFit, a mobile health intervention to promote physical activity after bariatric surgery

Bariatric surgery is the most effective treatment for severe obesity (body mass index >40), helping individuals lose, on average, 25%-29% of their body weight over the first year. However, many patients begin to plateau and regain weight within 12-24 months, and 20% of patients begin to regain weight within 6 months postsurgery. As physical activity (PA) is an important predictor of weight loss and maintenance postsurgery, there is a need for scalable, effective lifestyle interventions to help bariatric patients increase PA in order to maximize their weight loss and maintenance. To assess feasibility of using mobile health (mHealth) tools to support PA postsurgery, we conducted a quality-improvement optimization pilot of BariFit, an mHealth intervention that combines commercial devices and custom text messages. Fifty-one bariatric patients enrolled in a 16-week optimization pilot of BariFit. To assess feasibility, pre-post changes in PA were assessed using activPAL. In addition, the pilot randomized, using a 2 × 2 factorial design, two adaptive approaches to daily step goals (variable and 60th percentile goals) and provision of rest days (yes/no), and microrandomized provision of SMS-delivered activity suggestions five times a day for each participant. Adherence to using study equipment was over 95% at 16 weeks. Participants increased PA by 1,866 steps from baseline to end-of-study (p < .007). Participants who received variable step goals averaged 1,141 more steps per day (p = .096) than those who received 60th percentile goals. Activity suggestions had no effect. mHealth interventions are feasible for supporting PA postbariatric surgery.

Power Constrained Bandits

Contextual bandits often provide simple and effective personalization in decision making problems, making them popular tools to deliver personalized interventions in mobile health as well as other health applications. However, when bandits are deployed in the context of a scientific study-e.g. a clinical trial to test if a mobile health intervention is effective-the aim is not only to personalize for an individual, but also to determine, with sufficient statistical power, whether or not the system's intervention is effective. It is essential to assess the effectiveness of the intervention before broader deployment for better resource allocation. The two objectives are often deployed under different model assumptions, making it hard to determine how achieving the personalization and statistical power affect each other. In this work, we develop general meta-algorithms to modify existing algorithms such that sufficient power is guaranteed while still improving each user's well-being. We also demonstrate that our meta-algorithms are robust to various model mis-specifications possibly appearing in statistical studies, thus providing a valuable tool to study designers.

Optimizing Implementation in Cancer Control (OPTICC): protocol for an implementation science center

BACKGROUND

Evidence-based interventions (EBIs) could reduce cervical cancer deaths by 90%, colorectal cancer deaths by 70%, and lung cancer deaths by 95% if widely and effectively implemented in the USA. Yet, EBI implementation, when it occurs, is often suboptimal. This manuscript outlines the protocol for Optimizing Implementation in Cancer Control (OPTICC), a new implementation science center funded as part of the National Cancer Institute Implementation Science Consortium. OPTICC is designed to address three aims. Aim 1 is to develop a research program that supports developing, testing, and refining of innovative, efficient methods for optimizing EBI implementation in cancer control. Aim 2 is to support a diverse implementation laboratory of clinical and community partners to conduct rapid, implementation studies anywhere along the cancer care continuum for a wide range of cancers. Aim 3 is to build implementation science capacity in cancer control by training new investigators, engaging established investigators in cancer-focused implementation science, and contributing to the Implementation Science Consortium in Cancer.

METHODS

Three cores serve as OPTICC's foundation. The Administrative Core plans coordinates and evaluates the Center's activities and leads its capacity-building efforts. The Implementation Laboratory Core (I-Lab) coordinates a network of diverse clinical and community sites, wherein studies are conducted to optimize EBI implementation, implement cancer control EBIs, and shape the Center's agenda. The Research Program Core conducts innovative implementation studies, measurement and methods studies, and pilot studies that advance the Center's theme. A three-stage approach to optimizing EBI implementation is taken-(I) identify and prioritize determinants, (II) match strategies, and (III) optimize strategies-that is informed by a transdisciplinary team of experts leveraging multiphase optimization strategies and criteria, user-centered design, and agile science.

DISCUSSION

OPTICC will develop, test, and refine efficient and economical methods for optimizing EBI implementation by building implementation science capacity in cancer researchers through applications with our I-Lab partners. Once refined, OPTICC will disseminate its methods as toolkits accompanied by massive open online courses, and an interactive website, the latter of which seeks to simultaneously accumulate knowledge across OPTICC studies.

Digital Therapeutics for Obesity and Eating-Related Problems

In recent years, digital technologies have rapidly advanced and are being applied to remedy medical problems. These technologies allow us to monitor and manage our physical and mental health in our daily lives. Since lifestyle modification is the cornerstone of the management of obesity and eating behavior problems, digital therapeutics (DTx) represent a powerful and easily accessible treatment modality. This review discusses the critical issues to consider for enhancing the efficacy of DTx in future development initiatives. To competently adapt and expand public access to DTx, it is important for various stakeholders, including health professionals, patients, and guardians, to collaborate with other industry partners and policy-makers in the ecosystem.

Microrandomized Trial Design for Evaluating Just-in-Time Adaptive Interventions Through Mobile Health Technologies for Cardiovascular Disease

Smartphone and wearable device use is rising broadly and can be leveraged for chronic disease management. Just-in-time adaptive interventions promise to deliver personalized, dynamic interventions directly to patients through use of push notifications from mobile devices. Although just-in-time adaptive interventions are a powerful tool for shaping health behavior, their application to cardiovascular disease management has been limited as they can be challenging to design. Herein, we provide a general overview and conceptual framework for microrandomized trials, a novel experimental study design that can be used to optimize just-in-time adaptive interventions. Microrandomized trials leverage mobile devices to sequentially randomize participants to types or levels of an intervention to determine the effectiveness of an intervention and time-varying moderators of those effects. Microrandomized trials are an efficient study design that can be used to determine which intervention components to include in just-in-time adaptive interventions and to optimize their decision rules while maintaining the strength of causal inference associated with traditional randomized controlled trials.

Precision Health: The Role of the Social and Behavioral Sciences in Advancing the Vision

BACKGROUND

In 2015, Collins and Varmus articulated a vision for precision medicine emphasizing molecular characterization of illness to identify actionable biomarkers to support individualized treatment. Researchers have argued for a broader conceptualization, precision health. Precision health is an ambitious conceptualization of health, which includes dynamic linkages between research and practice as well as medicine, population health, and public health. The goal is a unified approach to match a full range of promotion, prevention, diagnostic, and treatment interventions to fundamental and actionable determinants of health; to not just address symptoms, but to directly target genetic, biological, environmental, and social and behavioral determinants of health.

PURPOSE

The purpose of this paper is to elucidate the role of social and behavioral sciences within precision health.

MAIN BODY

Recent technologies, research frameworks, and methods are enabling new approaches to measure, intervene, and conduct social and behavioral science research. These approaches support three opportunities in precision health that the social and behavioral sciences could colead including: (a) developing interventions that continuously "tune" to each person's evolving needs; (b) enhancing and accelerating links between research and practice; and (c) studying mechanisms of change in real-world contexts. There are three challenges for precision health: (a) methods of knowledge organization and curation; (b) ethical conduct of research; and (c) equitable implementation of precision health.

CONCLUSIONS

Precision health requires active coleadership from social and behavioral scientists. Prior work and evidence firmly demonstrate why the social and behavioral sciences should colead with regard to three opportunity and three challenge areas.

Off-Policy Estimation of Long-Term Average Outcomes with Applications to Mobile Health

Due to the recent advancements in wearables and sensing technology, health scientists are increasingly developing mobile health (mHealth) interventions. In mHealth interventions, mobile devices are used to deliver treatment to individuals as they go about their daily lives. These treatments are generally designed to impact a near time, proximal outcome such as stress or physical activity. The mHealth intervention policies, often called just-in-time adaptive interventions, are decision rules that map a individual's current state (e.g., individual's past behaviors as well as current observations of time, location, social activity, stress and urges to smoke) to a particular treatment at each of many time points. The vast majority of current mHealth interventions deploy expert-derived policies. In this paper, we provide an approach for conducting inference about the performance of one or more such policies using historical data collected under a possibly different policy. Our measure of performance is the average of proximal outcomes over a long time period should the particular mHealth policy be followed. We provide an estimator as well as confidence intervals. This work is motivated by HeartSteps, an mHealth physical activity intervention.

Optimizing an Acceptance and Commitment Therapy Microintervention Via a Mobile App With Two Cohorts: Protocol for Micro-Randomized Trials

BACKGROUND

Given gaps in the treatment of mental health, brief adaptive interventions have become a public health imperative. Transdiagnostic interventions may be particularly appropriate given high rates of medical comorbidity and the broader reach of transdiagnostic therapies. One such approach utilized herein is acceptance and commitment therapy (ACT), which is focused on increasing engagement with values, awareness, and openness to internal experiences. ACT theory posits that experiential avoidance is at the center of human suffering, regardless of diagnosis, and, as such, seeks to reduce unworkable experiential avoidance.

OBJECTIVE

Our objective is to provide the rationale and protocol for examining the safety, feasibility, and effectiveness of optimizing an ACT-based intervention via a mobile app among two disparate samples, which differ in sociodemographic characteristics and symptom profiles.

METHODS

Twice each day, participants are prompted via a mobile app to complete assessments of mood and activity and are then randomly assigned to an ACT-based intervention or not. These interventions are questions regarding engagement with values, awareness, and openness to internal experiences. Participant responses are recorded. Analyses will examine completion of assessments, change in symptoms from baseline assessment, and proximal change in mood and activity. A primary outcome of interest is proximal change in activity (eg, form and function of behavior and energy consumed by avoidance and values-based behavior) following interventions as a function of time, symptoms, and behavior, where we hypothesize that participants will focus more energy on values-based behaviors. Analyses will be conducted using a weighted and centered least squares approach. Two samples will run concurrently to assess the capacity of optimizing mobile ACT in populations that differ widely in their clinical presentation and sociodemographic characteristics: individuals with bipolar disorder (n=30) and distressed first-generation college students (n=50).

RESULTS

Recruitment began on September 10, 2019, for the bipolar sample and on October 5, 2019, for the college sample. Participation in the study began on October 18, 2019.

CONCLUSIONS

This study examines an ACT-based intervention among two disparate samples. Should ACT demonstrate feasibility and preliminary effectiveness in each sample, a large randomized controlled trial applying ACT across diagnoses and demographics would be indicated. The public health implications of such an approach may be far-reaching.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04098497; https://clinicaltrials.gov/ct2/show/NCT04098497; ClinicalTrials.gov NCT04081662; https://clinicaltrials.gov/ct2/show/NCT04081662.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/17086.

Linear mixed models with endogenous covariates: modeling sequential treatment effects with application to a mobile health study

Mobile health is a rapidly developing field in which behavioral treatments are delivered to individuals via wearables or smartphones to facilitate health-related behavior change. Micro-randomized trials (MRT) are an experimental design for developing mobile health interventions. In an MRT the treatments are randomized numerous times for each individual over course of the trial. Along with assessing treatment effects, behavioral scientists aim to understand between-person heterogeneity in the treatment effect. A natural approach is the familiar linear mixed model. However, directly applying linear mixed models is problematic because potential moderators of the treatment effect are frequently endogenous-that is, may depend on prior treatment. We discuss model interpretation and biases that arise in the absence of additional assumptions when endogenous covariates are included in a linear mixed model. In particular, when there are endogenous covariates, the coefficients no longer have the customary marginal interpretation. However, these coefficients still have a conditional-on-the-random-effect interpretation. We provide an additional assumption that, if true, allows scientists to use standard software to fit linear mixed model with endogenous covariates, and person-specific predictions of effects can be provided. As an illustration, we assess the effect of activity suggestion in the HeartSteps MRT and analyze the between-person treatment effect heterogeneity.

Developments in Mobile Health Just-in-Time Adaptive Interventions for Addiction Science

PURPOSE OF REVIEW

Addiction is a serious and prevalent problem across the globe. An important challenge facing intervention science is how to support addiction treatment and recovery while mitigating the associated cost and stigma. A promising solution is the use of mobile health (mHealth) just-in-time adaptive interventions (JITAIs), in which intervention options are delivered in situ via a mobile device when individuals are most in need.

RECENT FINDINGS

The present review describes the use of mHealth JITAIs to support addiction treatment and recovery, and provides guidance on when and how the micro-randomized trial (MRT) can be used to optimize a JITAI. We describe the design of five mHealth JITAIs in addiction and three MRT studies, and discuss challenges and future directions.

SUMMARY

This review aims to provide guidance for constructing effective JITAIs to support addiction treatment and recovery.

Digitizing clinical trials

Clinical trials are a fundamental tool used to evaluate the efficacy and safety of new drugs and medical devices and other health system interventions. The traditional clinical trials system acts as a quality funnel for the development and implementation of new drugs, devices and health system interventions. The concept of a "digital clinical trial" involves leveraging digital technology to improve participant access, engagement, trial-related measurements, and/or interventions, enable concealed randomized intervention allocation, and has the potential to transform clinical trials and to lower their cost. In April 2019, the US National Institutes of Health (NIH) and the National Science Foundation (NSF) held a workshop bringing together experts in clinical trials, digital technology, and digital analytics to discuss strategies to implement the use of digital technologies in clinical trials while considering potential challenges. This position paper builds on this workshop to describe the current state of the art for digital clinical trials including (1) defining and outlining the composition and elements of digital trials; (2) describing recruitment and retention using digital technology; (3) outlining data collection elements including mobile health, wearable technologies, application programming interfaces (APIs), digital transmission of data, and consideration of regulatory oversight and guidance for data security, privacy, and remotely provided informed consent; (4) elucidating digital analytics and data science approaches leveraging artificial intelligence and machine learning algorithms; and (5) setting future priorities and strategies that should be addressed to successfully harness digital methods and the myriad benefits of such technologies for clinical research.

Designing m-Health interventions for precision mental health support

Mobile health (m-Health) resources are emerging as a significant tool to overcome mental health support access barriers due to their ability to rapidly reach and provide support to individuals in need of mental health support. m-Health provides an approach to adapt and initiate mental health support at precise moments, when they are most likely to be effective for the individual. However, poor adoption of mental health apps in the real world suggests that new approaches to optimising the quality of m-Health interventions are critically needed in order to realise the potential translational benefits for mental health support. The micro-randomised trial is an experimental approach for optimising and adapting m-Health resources. This trial design provides data to construct and optimise m-Health interventions. The data can be used to inform when and what type of m-Health interventions should be initiated, and thus serve to integrate interventions into daily routines with precision. Here, we illustrate this approach in a case study, review implementation issues that need to be considered while conducting an MRT, and provide a checklist for mental health m-Health intervention developers.

Efficacy of Contextually Tailored Suggestions for Physical Activity: A Micro-randomized Optimization Trial of HeartSteps

BACKGROUND

HeartSteps is an mHealth intervention that encourages regular walking via activity suggestions tailored to the individuals' current context.

PURPOSE

We conducted a micro-randomized trial (MRT) to evaluate the efficacy of HeartSteps' activity suggestions to optimize the intervention.

METHODS

We conducted a 6-week MRT with 44 adults. Contextually tailored suggestions could be delivered up to five times per day at user-selected times. At each of these five times, for each participant on each day of the study, HeartSteps randomized whether to provide an activity suggestion, and, if so, whether to provide a walking or an antisedentary suggestion. We used a centered and weighted least squares method to analyze the effect of suggestions on the 30-min step count following suggestion randomization.

RESULTS

Averaging over study days and types of activity suggestions, delivering a suggestion versus no suggestion increased the 30-min step count by 14% (p = .06), 35 additional steps over the 253-step average. The effect was not evenly distributed in time. Providing any type of suggestion versus no suggestion initially increased the step count by 66% (167 steps; p < .01), but this effect diminished over time. Averaging over study days, delivering a walking suggestion versus no suggestion increased the average step count by 24% (59 steps; p = .02). This increase was greater at the start of study (107% or 271 additional steps; p < .01), but decreased over time. Antisedentary suggestions had no detectable effect on the 30-min step count.

CONCLUSION

Contextually tailored walking suggestions are a promising way of initiating bouts of walking throughout the day.

CLINICAL TRIAL INFORMATION

This study was registered on ClinicalTrials.gov number NCT03225521.

THE STRATIFIED MICRO-RANDOMIZED TRIAL DESIGN: SAMPLE SIZE CONSIDERATIONS FOR TESTING NESTED CAUSAL EFFECTS OF TIME-VARYING TREATMENTS

Technological advancements in the field of mobile devices and wearable sensors have helped overcome obstacles in the delivery of care, making it possible to deliver behavioral treatments anytime and anywhere. Here, we discuss our work on the design of a mobile health smoking cessation intervention study with the goal of assessing whether reminders, delivered at times of stress, result in a reduction/prevention of stress in the near-term, and whether this effect changes with time in study. Multiple statistical challenges arose in this effort, leading to the development of the stratified micro-randomized trial design. In these designs, each individual is randomized to treatment repeatedly at times determined by predictions of risk. These risk times may be impacted by prior treatment. We describe the statistical challenges and detail how they can be met.

Microrandomized trials for promoting engagement in mobile health data collection: Adolescent/young adult oral chemotherapy adherence as an example

Long-term engagement with mobile health (mHealth) apps can provide critical data for improving empirical models for real-time health behaviors. To learn how to improve and maintain mHealth engagement, micro-randomized trials (MRTs) can be used to optimize different engagement strategies. In MRTs, participants are sequentially randomized, often hundreds or thousands of times, to different engagement strategies or treatments. The data gathered are then used to decide which treatment is optimal in which context. In this paper, we discuss an example MRT for youth with cancer, where we randomize different engagement strategies to improve self-reports on factors related to medication adherence. MRTs, moreover, can go beyond improving engagement, and we reference other MRTs to address substance abuse, sedentary behavior, and so on.

Assessment of the Efficacy of a Mobile Phone-Delivered Just-in-Time Planning Intervention to Reduce Alcohol Use in Adolescents: Randomized Controlled Crossover Trial

Background

Interventions to reduce alcohol use typically include several elements, such as information on the risks of alcohol consumption, planning for sensible drinking, and training of protective behavioral strategies. However, the effectiveness of these individual intervention elements within comprehensive programs has not been addressed so far, but it could provide valuable insights for the development of future interventions. Just-in-time interventions provided via mobile devices are intended to help people make healthy decisions in the moment and thus could influence health behavior.

Objective

The aim of this study was to test the proximal effects of a mobile phone–delivered, just-in-time planning intervention to reduce alcohol use in adolescents who reported recent binge drinking. The efficacy of this individual intervention element was tested within a comprehensive intervention program to reduce problem drinking in adolescents.

Methods

The study had an AB/BA crossover design, in which participants were randomly allocated to (1) a group receiving the planning intervention (A) in period 1 and assessment only (B) in period 2 or (2) a group receiving assessment only (B) in period 1 and the planning intervention (A) in period 2. The planning intervention included a text message to choose one of two predetermined if-then plans to practice sensible drinking with friends or when going out and a prompt to visualize the chosen plan. There was a washout period of at least 1 week between period 1 and period 2.

Results

Out of 633 program participants who recently binge drank, 136 (21.5%) were receptive in both periods of time and provided data on the proximal outcome, which was the number of alcoholic drinks consumed with friends or when going out. After the planning intervention, the number of alcoholic drinks consumed was approximately one standard drink lower compared with the finding without the intervention (P=.01).

Conclusions

A mobile phone–delivered, just-in-time, if-then planning intervention to practice sensible drinking with friends or when going out is effective in reducing alcohol consumption among adolescents who report recent binge drinking. Based on the relatively low percentage of participants with self-reported receptivity for the planning intervention, measures to increase the population impact of similar planning interventions should be implemented and tested in future trials.

Trial Registration

ISRCTN Registry ISRCTN52150713; http://www.isrctn.com/ISRCTN52150713

Personalized HeartSteps: A Reinforcement Learning Algorithm for Optimizing Physical Activity

With the recent proliferation of mobile health technologies, health scientists are increasingly interested in developing just-in-time adaptive interventions (JITAIs), typically delivered via notifications on mobile devices and designed to help users prevent negative health outcomes and to promote the adoption and maintenance of healthy behaviors. A JITAI involves a sequence of decision rules (i.e., treatment policies) that take the user's current context as input and specify whether and what type of intervention should be provided at the moment. In this work, we describe a reinforcement learning (RL) algorithm that continuously learns and improves the treatment policy embedded in the JITAI as data is being collected from the user. This work is motivated by our collaboration on designing an RL algorithm for HeartSteps V2 based on data collected HeartSteps V1. HeartSteps is a physical activity mobile health application. The RL algorithm developed in this work is being used in HeartSteps V2 to decide, five times per day, whether to deliver a context-tailored activity suggestion.

Standardized Effect Sizes for Preventive Mobile Health Interventions in Micro-randomized Trials

Mobile Health (mHealth) interventions are behavioral interventions that are accessible to individuals in their daily lives via a mobile device. Most mHealth interventions consist of multiple intervention components. Some of the components are "pull" components, which require individuals to access the component on their mobile device at moments when they decide they need help. Other intervention components are "push" components, which are initiated by the intervention, not the individual, and are delivered via notifications or text messages. Micro-randomized trials (MRTs) have been developed to provide data to assess the effects of push intervention components on subsequent emotions and behavior. In this paper, we review the micro-randomized trial design and provide an approach to computing a standardized effect size for these intervention components. This effect size can be used to compare different push intervention components that may be included in an mHealth intervention. In addition, a standardized effect size can be used to inform sample size calculations for future MRTs. Here, the standardized effect size is a function of time because the push notifications can occur repeatedly over time. We illustrate this methodology using data from an MRT involving HeartSteps, an mHealth intervention for physical activity as part of the secondary prevention of heart disease.

Just-in-Time Adaptive Interventions (JITAIs) in Mobile Health: Key Components and Design Principles for Ongoing Health Behavior Support

Background

The just-in-time adaptive intervention (JITAI) is an intervention design aiming to provide the right type/amount of support, at the right time, by adapting to an individual's changing internal and contextual state. The availability of increasingly powerful mobile and sensing technologies underpins the use of JITAIs to support health behavior, as in such a setting an individual's state can change rapidly, unexpectedly, and in his/her natural environment.

Purpose

Despite the increasing use and appeal of JITAIs, a major gap exists between the growing technological capabilities for delivering JITAIs and research on the development and evaluation of these interventions. Many JITAIs have been developed with minimal use of empirical evidence, theory, or accepted treatment guidelines. Here, we take an essential first step towards bridging this gap.

Methods

Building on health behavior theories and the extant literature on JITAIs, we clarify the scientific motivation for JITAIs, define their fundamental components, and highlight design principles related to these components. Examples of JITAIs from various domains of health behavior research are used for illustration.

Conclusions

As we enter a new era of technological capacity for delivering JITAIs, it is critical that researchers develop sophisticated and nuanced health behavior theories capable of guiding the construction of such interventions. Particular attention has to be given to better understanding the implications of providing timely and ecologically sound support for intervention adherence and retention.

Mobile health-based physical activity intervention for individuals with spinal cord injury in the community: A pilot study

Low levels of physical activity (PA) and high levels of sedentary behavior in individuals with spinal cord injury (SCI) have been associated with secondary conditions such as pain, fatigue, weight gain, and deconditioning. One strategy for promoting regular PA is to provide people with an accurate estimate of everyday PA level. The objective of this research was to use a mobile health-based PA measurement system to track PA levels of individuals with SCI in the community and provide them with a behavior-sensitive, just-in-time-adaptive intervention (JITAI) to improve their PA levels. The first, second, and third phases of the study, each with a duration of one month, involved collecting baseline PA levels, providing near-real-time feedback on PA level (PA Feedback), and providing PA Feedback with JITAI, respectively. PA levels in terms of energy expenditure in kilocalories, and minutes of light- and moderate- or vigorous-intensity PA were assessed by an activity monitor during the study. Twenty participants with SCI took part in this research study with a mean (SD) age of 39.4 (12.8) years and 12.4 (12.5) years since injury. Sixteen participants completed the study. Sixteen were male, 16 had paraplegia, and 12 had complete injury. Within-participant comparisons indicated that only two participants had higher energy expenditure (>10%) or lower energy expenditure (<-10%) during PA Feedback with JITAI compared to the baseline. However, eleven participants (69.0%) had higher light- and/or moderate-intensity PA during PA Feedback with JITAI compared to the baseline. To our knowledge, this is the first study to test a PA JITAI for individuals with SCI that responds automatically to monitored PA levels. The results of this pilot study suggest that a sensor-enabled mobile JITAI has potential to improve PA levels of individuals with SCI. Future research should investigate the efficacy of JITAI through a clinical trial.

Potential benefits of integrating ecological momentary assessment data into mHealth care systems

The advancement of wearable/ambulatory technologies has brought a huge change to data collection frameworks in recent decades. Mobile health (mHealth) care platforms, which utilize ambulatory devices to collect naturalistic and often intensively sampled data, produce innovative information of potential clinical relevance. For example, such data can inform clinical study design, recruitment approach, data analysis, and delivery of both "traditional" and novel (e.g., mHealth) interventions. We provide a conceptual overview of how data measured continuously or repeatedly via mobile devices (e.g., smartphone and body sensors) in daily life could be fruitfully used within a mHealth care system. We highlight the potential benefits of integrating ecological momentary assessment (EMA) into mHealth platforms for collecting, processing, and modeling data, and delivering and evaluating novel interventions in everyday life. Although the data obtained from EMA and related approaches may hold great potential benefits for mHealth care system, there are also implementation challenges; we briefly discuss the challenges to integrating EMA into mHealth care system.

Practical Considerations for Data Collection and Management in Mobile Health Micro-randomized Trials

There is a growing interest in leveraging the prevalence of mobile technology to improve health by delivering momentary, contextualized interventions to individuals' smartphones. A just-in-time adaptive intervention (JITAI) adjusts to an individual's changing state and/or context to provide the right treatment, at the right time, in the right place. Micro-randomized trials (MRTs) allow for the collection of data which aid in the construction of an optimized JITAI by sequentially randomizing participants to different treatment options at each of many decision points throughout the study. Often, this data is collected passively using a mobile phone. To assess the causal effect of treatment on a near-term outcome, care must be taken when designing the data collection system to ensure it is of appropriately high quality. Here, we make several recommendations for collecting and managing data from an MRT. We provide advice on selecting which features to collect and when, choosing between "agents" to implement randomization, identifying sources of missing data, and overcoming other novel challenges. The recommendations are informed by our experience with HeartSteps, an MRT designed to test the effects of an intervention aimed at increasing physical activity in sedentary adults. We also provide a checklist which can be used in designing a data collection system so that scientists can focus more on their questions of interest, and less on cleaning data.

Estimating Dynamic Treatment Regimes in Mobile Health Using V-learning

The vision for precision medicine is to use individual patient characteristics to inform a personalized treatment plan that leads to the best possible health-care for each patient. Mobile technologies have an important role to play in this vision as they offer a means to monitor a patient's health status in real-time and subsequently to deliver interventions if, when, and in the dose that they are needed. Dynamic treatment regimes formalize individualized treatment plans as sequences of decision rules, one per stage of clinical intervention, that map current patient information to a recommended treatment. However, most existing methods for estimating optimal dynamic treatment regimes are designed for a small number of fixed decision points occurring on a coarse time-scale. We propose a new reinforcement learning method for estimating an optimal treatment regime that is applicable to data collected using mobile technologies in an out-patient setting. The proposed method accommodates an indefinite time horizon and minute-by-minute decision making that are common in mobile health applications. We show that the proposed estimators are consistent and asymptotically normal under mild conditions. The proposed methods are applied to estimate an optimal dynamic treatment regime for controlling blood glucose levels in patients with type 1 diabetes.

The history and future of digital health in the field of behavioral medicine

Since its earliest days, the field of behavioral medicine has leveraged technology to increase the reach and effectiveness of its interventions. Here, we highlight key areas of opportunity and recommend next steps to further advance intervention development, evaluation, and commercialization with a focus on three technologies: mobile applications (apps), social media, and wearable devices. Ultimately, we argue that future of digital health behavioral science research lies in finding ways to advance more robust academic-industry partnerships. These include academics consciously working towards preparing and training the work force of the twenty first century for digital health, actively working towards advancing methods that can balance the needs for efficiency in industry with the desire for rigor and reproducibility in academia, and the need to advance common practices and procedures that support more ethical practices for promoting healthy behavior.

Toward Increasing Engagement in Substance Use Data Collection: Development of the Substance Abuse Research Assistant App and Protocol for a Microrandomized Trial Using Adolescents and Emerging Adults

Background

Substance use is an alarming public health issue associated with significant morbidity and mortality. Adolescents and emerging adults are at particularly high risk because substance use typically initiates and peaks during this developmental period. Mobile health apps are a promising data collection and intervention delivery tool for substance-using youth as most teens and young adults own a mobile phone. However, engagement with data collection for most mobile health applications is low, and often, large fractions of users stop providing data after a week of use.

Objective

Substance Abuse Research Assistant (SARA) is a mobile application to increase or sustain engagement of substance data collection overtime. SARA provides a variety of engagement strategies to incentivize data collection: a virtual aquarium in the app grows with fish and aquatic resources; occasionally, funny or inspirational contents (eg, memes or text messages) are provided to generate positive emotions. We plan to assess the efficacy of SARA’s engagement strategies over time by conducting a micro-randomized trial, where the engagement strategies will be sequentially manipulated.

Methods

We aim to recruit participants (aged 14-24 years), who report any binge drinking or marijuana use in the past month. Participants are instructed to use SARA for 1 month. During this period, participants are asked to complete one survey and two active tasks every day between 6 pm and midnight. Through the survey, we assess participants’ daily mood, stress levels, loneliness, and hopefulness, while through the active tasks, we measure reaction time and spatial memory. To incentivize and support the data collection, a variety of engagement strategies are used. First, predata collection strategies include the following: (1) at 4 pm, a push notification may be issued with an inspirational message from a contemporary celebrity; or (2) at 6 pm, a push notification may be issued reminding about data collection and incentives. Second, postdata collection strategies include various rewards such as points which can be used to grow a virtual aquarium with fishes and other treasures and modest monetary rewards (up to US $12; US $1 for each 3-day streak); also, participants may receive funny or inspirational content as memes or gifs or visualizations of prior data. During the study, the participants will be randomized every day to receive different engagement strategies. In the primary analysis, we will assess whether issuing 4 pm push-notifications or memes or gifs, respectively, increases self-reporting on the current or the following day.

Results

The microrandomized trial started on August 21, 2017 and the trial ended on February 28, 2018. Seventy-three participants were recruited. Data analysis is currently underway.

Conclusions

To the best of our knowledge, SARA is the first mobile phone app that systematically manipulates engagement strategies in order to identify the best sequence of strategies that keep participants engaged in data collection. Once the optimal strategies to collect data are identified, future versions of SARA will use this data to provide just-in-time adaptive interventions to reduce substance use among youth.

Trial Registration

ClinicalTrials.gov NCT03255317; https://clinicaltrials.gov/show/NCT03255317 (Archived by WebCite at http://www.webcitation.org/70raGWV0e)

Registered Report Identifier

RR1-10.2196/9850

Optimizing Digital Integrated Care via Micro-Randomized Trials

Mobile health (mHealth) interventions are a promising tool in providing digitally mediated integrative care. They can extend care outside of the clinic by providing reminders to take medications, assisting in managing symptoms, and supporting healthy behaviors including physical activity, healthy eating, and stress management. mHealth interventions can adapt the delivery of care across time in order to optimize treatment effectiveness. Yet there exists limited empirical evidence useful to the development of adaptive mHealth interventions. This article describes a new randomized trial design, the Micro-Randomized Trial (MRT), for informing the development of mHealth interventions. We provide examples of scientific questions important to the development of an mHealth intervention, and describe how these questions can be answered using an MRT.

Engagement Strategies for Self-Monitoring Symptoms of Bipolar Disorder With Mobile and Wearable Technology: Protocol for a Randomized Controlled Trial

Background

Monitoring signs and symptoms in bipolar disorder (BP) is typically based on regular assessments from patient-clinician interactions. Mobile and wearable technology promises to make monitoring symptoms in BP easier, but little is known about how best to engage individuals with BP in monitoring symptoms.

Objective

The objective of this study was to provide the rationale and protocol for a randomized controlled trial that investigates engagement strategies for monitoring symptoms of BP, including the strategies of using activity trackers compared with self-reports and reviewing recorded symptoms weekly with an interviewer.

Methods

A total of 50 individuals with BP will be recruited from the Prechter Longitudinal Study of Bipolar Disorder at the University of Michigan to participate in a 6-week study. Participants will monitor their symptoms through an activity tracker (Fitbit Alta HR) and a mobile phone app designed for this study. In addition to monitoring symptoms, participants have a 50-50 chance of being assigned to an arm that reviews self-reports and activity information weekly. Statistical tests will be performed to test hypotheses that participants adhere to activity tracking significantly more than self-reporting, prefer activity tracking significantly more than self-reporting, and better adhere to both activity tracking and self-reporting when reviewing collected information weekly.

Results

Recruitment commenced in November 2017. The first group of participants began the study in January 2018.

Conclusions

This study aims to establish strategies to engage individuals with BP in monitoring their symptoms with mobile and wearable technology. Better engagement strategies are expected to aid current efforts in bipolar research and clinical care, from the development of new mobile phone apps to providing the right intervention to the right individual at the right moment.

Trial Registration

ClinicalTrials.gov NCT03358238; https://clinicaltrials.gov/ct2/show/NCT03358238 (Archived by WebCite at http://www.webcitation.org/6yebuNfz5)

Registered Report Identifier

RR1-10.2196/9899

Using Behavioral Analytics to Increase Exercise: A Randomized N-of-1 Study

INTRODUCTION

This intervention study used mobile technologies to investigate whether those randomized to receive a personalized "activity fingerprint" (i.e., a one-time tailored message about personal predictors of exercise developed from 6 months of observational data) increased their physical activity levels relative to those not receiving the fingerprint.

STUDY DESIGN

A 12-month randomized intervention study.

SETTING/PARTICIPANTS

From 2014 to 2015, 79 intermittent exercisers had their daily physical activity assessed by accelerometry (Fitbit Flex) and daily stress experience, a potential predictor of exercise behavior, was assessed by smartphone.

INTERVENTION

Data collected during the first 6 months of observation were used to develop a person-specific "activity fingerprint" (i.e., N-of-1) that was subsequently sent via email on a single occasion to randomized participants.

MAIN OUTCOME MEASURES

Pre-post changes in the percentage of days exercised were analyzed within and between control and intervention groups.

RESULTS

The control group significantly decreased their proportion of days exercised (10.5% decrease, p<0.0001) following randomization. By contrast, the intervention group showed a nonsignificant decrease in the proportion of days exercised (4.0% decrease, p=0.14). Relative to the decrease observed in the control group, receipt of the activity fingerprint significantly increased the likelihood of exercising in the intervention group (6.5%, p=0.04).

CONCLUSIONS

This N-of-1 intervention study demonstrates that a one-time brief message conveying personalized exercise predictors had a beneficial effect on exercise behavior among urban adults.

Evaluating the Impact of Physical Activity Apps and Wearables: Interdisciplinary Review

Background

Although many smartphone apps and wearables have been designed to improve physical activity, their rapidly evolving nature and complexity present challenges for evaluating their impact. Traditional methodologies, such as randomized controlled trials (RCTs), can be slow. To keep pace with rapid technological development, evaluations of mobile health technologies must be efficient. Rapid alternative research designs have been proposed, and efficient in-app data collection methods, including in-device sensors and device-generated logs, are available. Along with effectiveness, it is important to measure engagement (ie, users’ interaction and usage behavior) and acceptability (ie, users’ subjective perceptions and experiences) to help explain how and why apps and wearables work.

Objectives

This study aimed to (1) explore the extent to which evaluations of physical activity apps and wearables: employ rapid research designs; assess engagement, acceptability, as well as effectiveness; use efficient data collection methods; and (2) describe which dimensions of engagement and acceptability are assessed.

Method

An interdisciplinary scoping review using 8 databases from health and computing sciences. Included studies measured physical activity, and evaluated physical activity apps or wearables that provided sensor-based feedback. Results were analyzed using descriptive numerical summaries, chi-square testing, and qualitative thematic analysis.

Results

A total of 1829 abstracts were screened, and 858 articles read in full. Of 111 included studies, 61 (55.0%) were published between 2015 and 2017. Most (55.0%, 61/111) were RCTs, and only 2 studies (1.8%) used rapid research designs: 1 single-case design and 1 multiphase optimization strategy. Other research designs included 23 (22.5%) repeated measures designs, 11 (9.9%) nonrandomized group designs, 10 (9.0%) case studies, and 4 (3.6%) observational studies. Less than one-third of the studies (32.0%, 35/111) investigated effectiveness, engagement, and acceptability together. To measure physical activity, most studies (90.1%, 101/111) employed sensors (either in-device [67.6%, 75/111] or external [23.4%, 26/111]). RCTs were more likely to employ external sensors (accelerometers: P=.005). Studies that assessed engagement (52.3%, 58/111) mostly used device-generated logs (91%, 53/58) to measure the frequency, depth, and length of engagement. Studies that assessed acceptability (57.7%, 64/111) most often used questionnaires (64%, 42/64) and/or qualitative methods (53%, 34/64) to explore appreciation, perceived effectiveness and usefulness, satisfaction, intention to continue use, and social acceptability. Some studies (14.4%, 16/111) assessed dimensions more closely related to usability (ie, burden of sensor wear and use, interface complexity, and perceived technical performance).

Conclusions

The rapid increase of research into the impact of physical activity apps and wearables means that evaluation guidelines are urgently needed to promote efficiency through the use of rapid research designs, in-device sensors and user-logs to assess effectiveness, engagement, and acceptability. Screening articles was time-consuming because reporting across health and computing sciences lacked standardization. Reporting guidelines are therefore needed to facilitate the synthesis of evidence across disciplines.