Toward a Just-in-Time Adaptive Intervention to Reduce Emerging Adult Alcohol Use: Testing Approaches for Identifying When to Intervene

Consolidated guidance for behavioral intervention pilot and feasibility studies

BACKGROUND

In the behavioral sciences, conducting pilot and/or feasibility studies (PFS) is a key step that provides essential information used to inform the design, conduct, and implementation of a larger-scale trial. There are more than 160 published guidelines, reporting checklists, frameworks, and recommendations related to PFS. All of these publications offer some form of guidance on PFS, but many focus on one or a few topics. This makes it difficult for researchers wanting to gain a broader understanding of all the relevant and important aspects of PFS and requires them to seek out multiple sources of information, which increases the risk of missing key considerations to incorporate into their PFS. The purpose of this study was to develop a consolidated set of considerations for the design, conduct, implementation, and reporting of PFS for interventions conducted in the behavioral sciences.

METHODS

To develop this consolidation, we undertook a review of the published guidance on PFS in combination with expert consensus (via a Delphi study) from the authors who wrote such guidance to inform the identified considerations. A total of 161 PFS-related guidelines, checklists, frameworks, and recommendations were identified via a review of recently published behavioral intervention PFS and backward/forward citation tracking of a well-known PFS literature (e.g., CONSORT Ext. for PFS). Authors of all 161 PFS publications were invited to complete a three-round Delphi survey, which was used to guide the creation of a consolidated list of considerations to guide the design, conduct, and reporting of PFS conducted by researchers in the behavioral sciences.

RESULTS

A total of 496 authors were invited to take part in the three-round Delphi survey (round 1, N = 46; round 2, N = 24; round 3, N = 22). A set of twenty considerations, broadly categorized into six themes (intervention design, study design, conduct of trial, implementation of intervention, statistical analysis, and reporting) were generated from a review of the 161 PFS-related publications as well as a synthesis of feedback from the three-round Delphi process. These 20 considerations are presented alongside a supporting narrative for each consideration as well as a crosswalk of all 161 publications aligned with each consideration for further reading.

CONCLUSION

We leveraged expert opinion from researchers who have published PFS-related guidelines, checklists, frameworks, and recommendations on a wide range of topics and distilled this knowledge into a valuable and universal resource for researchers conducting PFS. Researchers may use these considerations alongside the previously published literature to guide decisions about all aspects of PFS, with the hope of creating and disseminating interventions with broad public health impact.

Designing and testing treatments for alcohol use disorder

This chapter provides a succinct overview of several recommendations for the design and analysis of treatments for AUD with a specific focus on increasing rigor and generalizability of treatment studies in order to increase the reach of AUD treatment. We recommend that researchers always register their trials in a clinical trial registry and make the protocol accessible so that the trial can be replicated in future work, follow CONSORT reporting guidelines when reporting the results of the trial, carefully describe all inclusion and exclusion criteria as well as the randomization scheme, and always use an intent to treat design with attention to analysis of missing data. In addition, we recommend that researchers pay closer attention to recruitment and engagement strategies that increase enrollment and retention of historically marginalized and understudied populations, and we end with a plea for more consideration of implementation science approaches to increase the dissemination and implementation of AUD treatment in real-world settings.

Automated, tailored adaptive mobile messaging to reduce alcohol consumption in help-seeking adults: A randomized controlled trial

AIMS

To test differential outcomes between three 6-month text-messaging interventions to reduce at-risk drinking in help-seeking adults.

DESIGN

A three-arm single-blind randomized controlled trial with 1-, 3-, 6- and 12-month follow-ups.

SETTING

United States. A fully remote trial without human contact, with participants recruited primarily via social media outlets.

PARTICIPANTS

Seven hundred and twenty-three adults (mean = 39.9 years, standard deviation = 10.0; 62.5% female) seeking to reduce their drinking were allocated to 6 months of baseline 'tailored statically' messaging (TS; n = 240), 'tailored adaptive' messaging (TA; n = 239) or 'drink tracking' messaging (DT; n = 244).

INTERVENTIONS

TS consisted of daily text messages to reduce harmful drinking that were tailored to demographics and alcohol use. TA consisted of daily, tailored text messages that were also adapted based on goal achievement and proactive prompts. DT consisted of a weekly assessment for self-reported drinking over the past 7 days.

MEASUREMENTS

The primary outcome measure was weekly sum of standard drinks (SSD) at 6-month follow-up. Secondary outcome measures included drinks per drinking day (DDD), number of drinking days (NDD) per week and heavy drinking days (HDD) at 1-, 3-, 6- and 12-month follow-ups.

FINDINGS

At 6 months, compared with DT, TA resulted in significant SSD reductions of 16.2 (from 28.7 to 12.5) drinks [adjusted risk ratio (aRR) = 0.80, 95% confidence interval (CI) = 0.71, 0.91] using intent-to-treat analysis. TA also resulted in significant improvements in DDD (aRR = 0.84; 95% CI = 0.77-0.92) and drinking days per week (b = -0.39; 95% CI = -0.67, -0.10), but not HDD compared with DT at 6 months. TA was not significantly different from TS at any time-point, except DDD at 6 months. All groups made improvements in SSD at 12-month follow-up compared with baseline with an average reduction of 12.9 drinks per week across groups.

CONCLUSIONS

Automated tailored mobile messaging interventions are scalable solutions that can reduce weekly alcohol consumption in remote help-seeking drinkers over time.

The effect of cognitive behavioral therapy text messages on mood: A micro-randomized trial

The StayWell at Home intervention, a 60-day text-messaging program based on Cognitive Behavioral Therapy (CBT) principles, was developed to help adults cope with the adverse effects of the global pandemic. Participants in StayWell at Home were found to show reduced depressive and anxiety symptoms after participation. However, it remains unclear whether the intervention improved mood and which intervention components were most effective at improving user mood during the pandemic. Thus, utilizing a micro-randomized trial (MRT) design, we examined two intervention components to inform the mechanisms of action that improve mood: 1) text messages delivering CBT-informed coping strategies (i.e., behavioral activation, other coping skills, or social support); 2) time at which messages were sent. Data from two independent trials of StayWell are included in this paper. The first trial included 303 adults aged 18 or older, and the second included 266 adults aged 18 or older. Participants were recruited via online platforms (e.g., Facebook ads) and partnerships with community-based agencies aiming to reach diverse populations, including low-income individuals and people of color. The results of this paper indicate that participating in the program improved and sustained self-reported mood ratings among participants. We did not find significant differences between the type of message delivered and mood ratings. On the other hand, the results from Phase 1 indicated that delivering any type of message in the 3 pm-6 pm time window improved mood significantly over sending a message in the 9 am-12 pm time window. The StayWell at Home program increases in mood ratings appeared more pronounced during the first two to three weeks of the intervention and were maintained for the remainder of the study period. The current paper provides evidence that low-burden text-message interventions may effectively address behavioral health concerns among diverse communities.

Expert Perspectives on Pilot and Feasibility Studies: A Delphi Study and Consolidation of Considerations for Behavioral Interventions

Background

In the behavioral sciences, conducting pilot and/or feasibility studies (PFS) is a key step that provides essential information used to inform the design, conduct, and implementation of a larger-scale trial. There are more than 160 published guidelines, reporting checklists, frameworks, and recommendations related to PFS. All of these publications offer some form of guidance on PFS, but many focus on one or a few topics. This makes it difficult for researchers wanting to gain a broader understanding of all the relevant and important aspects of PFS and requires them to seek out multiple sources of information, which increases the risk of missing key considerations to incorporate into their PFS. The purpose of this study was to develop a consolidated set of considerations for the design, conduct, implementation, and reporting of PFS for interventions conducted in the behavioral sciences.

Methods

To develop this consolidation, we undertook a review of the published guidance on PFS in combination with expert consensus (via a Delphi study) from the authors who wrote such guidance to inform the identified considerations. A total of 161 PFS-related guidelines, checklists, frameworks, and recommendations were identified via a review of recently published behavioral intervention PFS and backward/forward citation tracking of well-know PFS literature (e.g., CONSORT Ext. for PFS). Authors of all 161 PFS publications were invited to complete a three-round Delphi survey, which was used to guide the creation of a consolidated list of considerations to guide the design, conduct, and reporting of PFS conducted by researchers in the behavioral sciences.

Results

A total of 496 authors were invited to take part in the Delphi survey, 50 (10.1%) of which completed all three rounds, representing 60 (37.3%) of the 161 identified PFS-related guidelines, checklists, frameworks, and recommendations. A set of twenty considerations, broadly categorized into six themes (Intervention Design, Study Design, Conduct of Trial, Implementation of Intervention, Statistical Analysis and Reporting) were generated from a review of the 161 PFS-related publications as well as a synthesis of feedback from the three-round Delphi process. These 20 considerations are presented alongside a supporting narrative for each consideration as well as a crosswalk of all 161 publications aligned with each consideration for further reading.

Conclusion

We leveraged expert opinion from researchers who have published PFS-related guidelines, checklists, frameworks, and recommendations on a wide range of topics and distilled this knowledge into a valuable and universal resource for researchers conducting PFS. Researchers may use these considerations alongside the previously published literature to guide decisions about all aspects of PFS, with the hope of creating and disseminating interventions with broad public health impact.

How Notifications Affect Engagement With a Behavior Change App: Results From a Micro-Randomized Trial

BACKGROUND

Drink Less is a behavior change app to help higher-risk drinkers in the United Kingdom reduce their alcohol consumption. The app includes a daily notification asking users to "Please complete your drinks and mood diary," yet we did not understand the causal effect of the notification on engagement nor how to improve this component of Drink Less. We developed a new bank of 30 new messages to increase users' reflective motivation to engage with Drink Less. This study aimed to determine how standard and new notifications affect engagement.

OBJECTIVE

Our objective was to estimate the causal effect of the notification on near-term engagement, to explore whether this effect changed over time, and to create an evidence base to further inform the optimization of the notification policy.

METHODS

We conducted a micro-randomized trial (MRT) with 2 additional parallel arms. Inclusion criteria were Drink Less users who consented to participate in the trial, self-reported a baseline Alcohol Use Disorders Identification Test score of ≥8, resided in the United Kingdom, were aged ≥18 years, and reported interest in drinking less alcohol. Our MRT randomized 350 new users to test whether receiving a notification, compared with receiving no notification, increased the probability of opening the app in the subsequent hour, over the first 30 days since downloading Drink Less. Each day at 8 PM, users were randomized with a 30% probability of receiving the standard message, a 30% probability of receiving a new message, or a 40% probability of receiving no message. We additionally explored time to disengagement, with the allocation of 60% of eligible users randomized to the MRT (n=350) and 40% of eligible users randomized in equal number to the 2 parallel arms, either receiving the no notification policy (n=98) or the standard notification policy (n=121). Ancillary analyses explored effect moderation by recent states of habituation and engagement.

RESULTS

Receiving a notification, compared with not receiving a notification, increased the probability of opening the app in the next hour by 3.5-fold (95% CI 2.91-4.25). Both types of messages were similarly effective. The effect of the notification did not change significantly over time. A user being in a state of already engaged lowered the new notification effect by 0.80 (95% CI 0.55-1.16), although not significantly. Across the 3 arms, time to disengagement was not significantly different.

CONCLUSIONS

We found a strong near-term effect of engagement on the notification, but no overall difference in time to disengagement between users receiving the standard fixed notification, no notification at all, or the random sequence of notifications within the MRT. The strong near-term effect of the notification presents an opportunity to target notifications to increase "in-the-moment" engagement. Further optimization is required to improve the long-term engagement.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/18690.

Daily diary study of loneliness, alcohol, and drug use during the COVID-19 Pandemic

BACKGROUND

Research conducted during the COVID-19 Pandemic has identified two co-occurring public health concerns: loneliness and substance use. Findings from research conducted prior to the pandemic are inconclusive as to the links between loneliness and substance use. This study aimed to measure associations of loneliness with three different types of substance use during COVID-19: daily number of alcoholic drinks, cannabis use, and non-cannabis drug use.

METHOD

Data were obtained between October 2020 and May 2021 from 2,648 US adults (Mage  = 38.76, 65.4% women) diverse with respect to race and ethnicity using online recruitment. Participants completed baseline surveys and daily assessments for 30 days. A daily loneliness measure was recoded into separate within- and between-person predictor variables. Daily outcome measures included the number of alcoholic drinks consumed and dichotomous cannabis and non-cannabis drug use variables. Generalized linear multilevel models (GLMLM) were used to examine within- and between-person associations between loneliness and substance use.

RESULTS

The unconditional means model indicated that 59.0% of the variance in the daily number of alcoholic drinks was due to within-person variability. GLMLM analyses revealed that, overall, people drank more on days when they felt a particularly high or particularly low degree of loneliness (positive quadratic effect). There was a negative and significant within-person association between daily loneliness and the likelihood of cannabis use. There was also a positive and significant within-person association between daily loneliness and the likelihood of non-cannabis drug use.

CONCLUSIONS

Associations between loneliness and substance use vary with substance type and whether within- or between-person differences are assessed. These findings are relevant to the persistence of substance use disorders and thus of potential clinical importance. Individuals who do not experience severe loneliness at intake but who show daily increases in loneliness above baseline levels are at heightened risk of alcohol and non-cannabis drug use. Future research could profitably examine just-in-time adaptive interventions that assess fluctuations in loneliness to prevent the development or exacerbation of substance use disorders.