Optimizing Text Messages to Promote Engagement With Internet Smoking Cessation Treatment: Results From a Factorial Screening Experiment

The Impact of Intervention Design on User Engagement in Digital Therapeutics Research: Factorial Experiment With a Mixed Methods Study

BACKGROUND

User engagement is crucial for digital therapeutics (DTx) effectiveness; due to variations in the conceptualization of engagement and intervention design, assessment and retention of engagement remain challenging.

OBJECTIVE

We investigated the influence of the perceived acceptability of experimental intervention components and satisfaction with core intervention components in DTx on user engagement, while also identifying potential barriers and facilitators to user engagement.

METHODS

We conducted a mixed methods study with a 2 × 2 factorial design, involving 12 outpatients with atopic dermatitis. Participants were randomized into 4 experimental groups based on push notification ("basic" or "advanced") and human coach ("on" or "off") experimental intervention components. All participants engaged in self-monitoring and learning courses as core intervention components within an app-based intervention over 8 weeks. Data were collected through in-app behavioral data, physician- and self-reported questionnaires, and semistructured interviews assessed at baseline, 4 weeks, and 8 weeks. Descriptive statistics and thematic analysis were used to evaluate user engagement, perceived acceptability of experimental intervention components (ie, push notification and human coach), satisfaction with core intervention components (ie, self-monitoring and learning courses), and intervention effectiveness through clinical outcomes.

RESULTS

The primary outcome indicated that group 4, provided with "advanced-level push notifications" and a "human coach," showed higher completion rates for self-monitoring forms and learning courses compared to the predetermined threshold of clinical significance. Qualitative data analysis revealed three key themes: (1) perceived acceptability of the experimental intervention components, (2) satisfaction with the core intervention components, and (3) suggestions for improvement in the overall intervention program. Regarding clinical outcomes, the Perceived Stress Scale and Dermatology Life Quality Index scores presented the highest improvement in group 4.

CONCLUSIONS

These findings will help refine the intervention and inform the design of a subsequent randomized trial to test its effectiveness. Furthermore, this design may serve as a model for broadly examining and optimizing overall engagement in DTx and for future investigation into the complex relationship between engagement and clinical outcomes.

TRIAL REGISTRATION

Clinical Research Information Service KCT0007675; http://tinyurl.com/2m8rjrmv.

A pilot study of sleep scholar: A single-session, internet-based insomnia intervention for college students with a history of suicide ideation

OBJECTIVE

Establish the feasibility and acceptability of Sleep Scholar, a single-session, self-guided, internet-based insomnia intervention.

PARTICIPANTS

College students with a lifetime history of suicide ideation and at least subclinical insomnia symptoms.

METHODS

Participants (N = 38) completed pretreatment sleep diaries, Sleep Scholar, and post-treatment feasibility, acceptability, and clinical measures.

RESULTS

Approximately 33 students could be recruited per semester, the overall attrition rate was 47%, Sleep Scholar was completed in approximately 30 minutes, and the majority of treatment information was retained. Participants reported positive acceptability and satisfaction, and approximately half of participants adhered to their prescribed time in bed recommendations. Most clinical measures had adequate variability and internal consistency, and post-hoc analyses revealed clinically significant reductions in several mental health symptoms.

CONCLUSIONS

Sleep Scholar is feasible in college settings, acceptable for college students, and produced reductions in mental health symptoms during an uncontrolled trial. Implications for a randomized-controlled trial are discussed.

Mobile Phone-Based Interventions for Smoking Cessation Among Young People: Systematic Review and Meta-Analysis

Background

Mobile phone-based cessation interventions have emerged as a promising alternative for smoking cessation, while evidence of the efficacy of mobile phone-based smoking cessation programs among young people is mixed.

Objective

This study aimed to determine the efficacy of mobile phone-based interventions compared to usual practice or assessment-only controls on smoking cessation in young people.

Methods

In this systematic review and meta-analysis, we searched Cochrane Library, Embase, PubMed, and Web of Science on March 8, 2023. We included randomized controlled trials that examined the efficacy of mobile phone-based interventions on smoking cessation in young people (age ≤30 years). The risk of bias was assessed with Cochrane Risk of Bias 2.

Results

A total of 13 eligible studies, comprising 27,240 participants, were included in this analysis. The age range of the participants was between 16 and 30 years. Nine studies were SMS text messaging interventions, and 4 studies were app-based interventions. The duration of the smoking cessation intervention varied from 5 days to 6 months. The included studies were conducted in the following countries: the United States, China, Sweden, Canada, Switzerland, and Thailand. The meta-analysis revealed that SMS text messaging interventions significantly improved continuous abstinence rates compared to inactive control conditions (risk ratio [RR] 1.51, 95% CI 1.24-1.84). The subgroup analysis showed pooled RRs of 1.90 (95% CI 1.29-2.81), 1.64 (95% CI 1.23-2.18), and 1.35 (95% CI 1.04-1.76) for continuous abstinence at the 1-, 3-, and 6- month follow-up, respectively. Pooling across 7 studies, SMS text messaging interventions showed efficacy in promoting 7-day point prevalence abstinence (PPA), with an RR of 1.83 (95% CI 1.34-2.48). The subgroup analysis demonstrated a significant impact at the 1- and 3-month follow-ups, with pooled RRs of 1.72 (95% CI 1.13-2.63) and 2.54 (95% CI 2.05-3.14), respectively, compared to inactive control conditions. However, at the 6-month follow-up, the efficacy of SMS text messaging interventions in promoting 7-day PPA was not statistically significant (RR 1.45, 95% CI 0.92-2.28). In contrast, app-based interventions did not show significant efficacy in promoting continuous abstinence or 7-day PPA. However, it is important to note that the evidence for app-based interventions was limited.

Conclusions

SMS text messaging-based smoking cessation interventions compared to inactive controls were associated with abstinence among young people and could be considered a viable option for smoking cessation in this population. More research is needed on smoking cessation apps, especially apps that target young people. Future research should focus on identifying the most effective mobile phone-based cessation approaches and on developing strategies to increase their uptake and intention.

Optimising engagement in a digital parenting intervention to prevent violence against adolescents in Tanzania: protocol for a cluster randomised factorial trial

BACKGROUND

Violence against adolescents is a universal reality, with severe individual and societal costs. There is a critical need for scalable and effective violence prevention strategies such as parenting programmes, particularly in low- and middle-income countries where rates of maltreatment are highest. Digital interventions may be a scalable and cost-effective alternative to in-person delivery, yet maximising caregiver engagement is a substantial challenge. This trial employs a cluster randomised factorial experiment and a novel mixed-methods analytic approach to assess the effectiveness, cost-effectiveness, and feasibility of intervention components designed to optimise engagement in an open-source parenting app, ParentApp for Teens. The app is based on the evidence-based Parenting for Lifelong Health for Teens programme, developed collaboratively by academic institutions in the Global South and North, the WHO, and UNICEF.

METHODS/DESIGN

Sixteen neighbourhoods, i.e., clusters, will be randomised to one of eight experimental conditions which consist of any combination of three components (Support: self-guided/moderated WhatsApp groups; App Design: sequential workshops/non-sequential modules; Digital Literacy Training: on/off). The study will be conducted in low-income communities in Tanzania, targeting socioeconomically vulnerable caregivers of adolescents aged 10 to 17 years (16 clusters, 8 conditions, 640 caregivers, 80 per condition). The primary objective of this trial is to estimate the main effects of the three components on engagement. Secondary objectives are to explore the interactions between components, the effects of the components on caregiver behavioural outcomes, moderators and mediators of programme engagement and impact, and the cost-effectiveness of components. The study will also assess enablers and barriers to engagement qualitatively via interviews with a subset of low, medium, and high engaging participants. We will combine quantitative and qualitative data to develop an optimised ParentApp for Teens delivery package.

DISCUSSION

This is the first known cluster randomised factorial trial for the optimisation of engagement in a digital parenting intervention in a low- and middle-income country. Findings will be used to inform the evaluation of the optimised app in a subsequent randomised controlled trial.

TRIAL REGISTRATION

Pan African Clinical Trial Registry, PACTR202210657553944. Registered 11 October 2022, https://pactr.samrc.ac.za/TrialDisplay.aspx?TrialID=24051 .

Digital Interventions for Social Participation in Adults with Long-term Physical Conditions: A Systematic Review

This review aims to identify and evaluate digital interventions for social participation in the growing population of adults with long-term physical conditions. Articles were sourced from MEDLINE, EMBASE, CINAHL and PsycINFO databases using subject headings and keywords related to "social participation" and "digital technology". Studies that adopted digital technology interventions to improve social participation in adults with long-term physical conditions were included. Data on study methodology, participant and digital intervention characteristics, and findings related to social participation were extracted. The search yielded a total of 4646 articles and 14 articles met criteria for final review with five randomized controlled trials, two non-randomized clinical trials and seven one-group pretest-posttest clinical trials. Studies were organized based on the digital intervention strategy implemented to improve social participation: group support (n = 4), individual skill training or counseling (n = 6), education and support (n = 3), and mixed intervention (n = 1). The group support interventions developed a social network among participants through videoconference, app, or virtual reality platform. Three studies reported positive improvements in different aspects of social participation. Individual skill training or counseling mainly utilized phone calls to help participants cope with activity participation and interpersonal relationship issues. Only two studies demonstrated benefits for social participation. The education and support intervention, which used messages and website information to increase participants' knowledge and provide support, showed positive findings in three studies. This review suggests digital interventions for improving social participation in adults with long-term physical conditions are feasible and the effectiveness of different strategies may vary.Registration: This review was prospectively registered on the International Prospective Register of Systematic Reviews (PROSPERO) (registry number: CRD42021254105).

Effectiveness of an optimized text message and Internet intervention for smoking cessation: A randomized controlled trial

AIMS

To evaluate the effectiveness of a combined internet and text message intervention for smoking cessation compared with an internet intervention alone. The text message intervention was optimized for engagement in an earlier multiphase optimization (MOST) screening phase.

DESIGN

A parallel, two-group, individually randomized clinical trial (RCT) was conducted in a MOST confirming phase. Recruitment spanned December 2018 to March 2019. Follow-up was conducted at 3 and 9 months, beginning March 2019 and ending January 2020.

SETTING

United States: a digital study conducted among new registrants on a free tobacco cessation website.

PARTICIPANTS

Eligible individuals were 618 adult current smokers in the United States, age 18 years or older who signed up for text messages during website registration (67.2% female, 70.4% white).

INTERVENTIONS

The treatment arm (WEB+TXT; n = 311) received access to the website and text messaging. The control arm (WEB; n = 307) received access to the website alone.

MEASUREMENTS

The primary outcome was self-reported 30-day point prevalence abstinence (ppa) at 9 months post-randomization analyzed under intent to treat (ITT), counting non-responders as smoking. Secondary outcomes included 3-month measures of 30-day ppa, intervention engagement and intervention satisfaction.

FINDINGS

Abstinence rates at 9 months were 23.1% among WEB+TXT and 23.2% among WEB (OR = 1.00, 95% CI = 0.69-1.45; P = 0.99). WEB+TXT increased engagement with 5 of 6 interactive features (standardized mean difference (SMD) = 0.26-0.47, all P < 0.001) and repeat website visits (48.7% vs 38.9%, SMD = 0.14, P = 0.02). Satisfaction metrics favored WEB+TXT (satisfied: 96.3% vs 90.5%, SMD = 0.17, P = 0.008; recommend to friend: 95.9% vs 90.1%, SMD = 0.16, P = 0.028).

CONCLUSIONS

A randomized controlled trial found no evidence that a combined internet and text message intervention for smoking cessation compared with an internet intervention alone increased 9-month abstinence rates among adult current smokers in the United States, despite evidence of higher levels of intervention engagement and satisfaction at 3 months.

Mindfulness and Mobile Health for Quitting Smoking: A Qualitative Study Among Predominantly African American Adults with Low Socioeconomic Status

Low-income and African American adults experience severe tobacco-related health disparities. Mindfulness-based interventions show promise for promoting smoking cessation, but most mindfulness research has focused on higher income, Caucasian samples. "iQuit Mindfully" is a personalized, interactive text messaging program that teaches mindfulness for smoking cessation. This qualitative study sought feedback from predominantly low-income African American smokers, to improve the intervention for this priority population. After receiving 8 weekly group sessions of Mindfulness-Based Addiction Treatment for smoking cessation and between-session iQuit Mindfully text messages, participants (N=32) completed semi-structured interviews. Participants were adult cigarette smokers (90.6% African American, 62.6% annual income <$30,000, mean age 45.1 [±12.9]). Interviews inquired about participants' experiences with and suggestions for improving iQuit Mindfully, including message content, number, and timing. Interviews were audio-recorded, transcribed verbatim, and coded by a team of 5 coders in NVivo. The coding manual was developed based on response categories from the interview guide and themes emerging from the data. Themes were organized into a conceptual model of factors related to engagement with the mHealth program. Response categories included helpful aspects (e.g., themes of social support, mindfulness, personalization); unhelpful/disliked aspects (e.g., too many/repetitive messages); links between in-person sessions and texts; and suggestions (e.g., changes to number/timing and more personalization). Findings provide insight into participants' day-to-day experiences with iQuit Mindfully and suggest ways to improve mHealth programs among low-income and African American adults.

Understanding Engagement Strategies in Digital Interventions for Mental Health Promotion: Scoping Review

BACKGROUND

Digital interventions offer a solution to address the high demand for mental health promotion, especially when facing physical contact restrictions or lacking accessibility. Engagement with digital interventions is critical for their effectiveness; however, retaining users' engagement throughout the intervention is challenging. It remains unclear what strategies facilitate engagement with digital interventions that target mental health promotion.

OBJECTIVE

Our aim is to conduct a scoping review to investigate user engagement strategies and methods to evaluate engagement with digital interventions that target mental health promotion in adults.

METHODS

This scoping review adheres to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines for scoping reviews. The search was conducted in 7 electronic databases from inception to April 2020. The inclusion criteria for studies were as follows: adult (aged ≥18 years) users of digital interventions for mental health promotion from the general population; any digital intervention for mental health promotion; and user engagement strategies described in the intervention design. We extracted the following data items: study characteristics, digital intervention (type and engagement strategy), evaluation of engagement strategy (method and result specifying whether the strategy was effective at facilitating engagement), and features of engagement (extent of use and subjective experience of users).

RESULTS

A total of 2766 studies were identified, of which 16 (0.58%) met the inclusion criteria. The 16 studies included randomized controlled trials (6/16, 37%), studies analyzing process data (5/16, 31%), observational studies (3/16, 19%), and qualitative studies (2/16, 13%). The digital interventions for mental health promotion were either web based (12/16, 75%) or mobile app based (4/16, 25%). The engagement strategies included personalized feedback about intervention content or users' mental health status; guidance regarding content and progress through e-coaching; social forums, and interactivity with peers; content gamification; reminders; and flexibility and ease of use. These engagement strategies were deemed effective based on qualitative user feedback or responses on questionnaires or tools (4/16, 25%), usability data (5/16, 31%), or both (7/16, 44%). Most studies identified personalized support in the form of e-coaching, peer support through a social platform, personalized feedback, or joint videoconference sessions as an engaging feature.

CONCLUSIONS

Personalized support during the intervention, access to social support, and personalized feedback seem to promote engagement with digital interventions for mental health promotion. These findings need to be interpreted with caution because the included studies were heterogeneous, had small sample sizes, and typically did not address engagement as the primary outcome. Despite the importance of user engagement for the effectiveness of digital interventions, this field has not yet received much attention. Further research is needed on the effectiveness of different strategies required to facilitate user engagement in digital interventions for mental health promotion.

Barriers to Building More Effective Treatments: Negative Interactions Amongst Smoking Intervention Components

Meaningfully improved mental and behavioral health treatment is an unrealized dream. Across three factorial experiments, inferential tests in prior studies showed a pattern of negative interactions suggesting that better clinical outcomes are obtained when participants receive fewer rather than more intervention components. Further, relatively few significant main effects were found in these experiments. Modeling suggested that negative interactions amongst components may account for these patterns. This paper evaluates factors that may contribute to such declining benefit: increased attentional or effort burden; components that produce their effects via the same capacity limited mechanisms, making their effects subadditive; and a tipping point phenomenon in which those near a hypothesized "tipping point" for change will benefit markedly from weak intervention while those far from the tipping point will benefit little from even strong intervention. New research should explore factors that cause negative interactions amongst components and constrain the development of more effective treatments.

Effectiveness of a Dyadic Buddy App for Smoking Cessation: Randomized Controlled Trial

Background

Tobacco smoking is one of the biggest public health threats. Smartphone apps offer new promising opportunities for supporting smoking cessation in real time. This randomized controlled trial investigated the effectiveness of an app that encourages individuals to quit smoking with the help of a social network member (buddy) in daily life.

Objective

The objective of this study is to test the effectiveness of the SmokeFree buddy app compared with a control group with self-reported smoking abstinence and carbon monoxide (CO)–verified smoking abstinence as primary outcomes and self-reports of smoked cigarettes per day (CPD) as a secondary outcome.

Methods

A total of 162 adults who smoked participated in this single-blind, two-arm, parallel-group, intensive longitudinal randomized controlled trial. Around a self-set quit date (ie, 7 days before the self-set quit date and 20 days after) and 6 months later, participants of the intervention and control groups reported on daily smoking abstinence and CPD in end-of-day diaries. Daily smoking abstinence was verified via daily exhaled CO assessments. This assessment was administered via an app displaying results of exhaled CO, thus addressing self-monitoring in both groups. In addition, participants in the intervention group used the SmokeFree buddy app, a multicomponent app that facilitates social support from a buddy of choice.

Results

A significant reduction in CPD from baseline to the 6-month follow-up was observed among participants in both groups. Multilevel analyses revealed no significant intervention effect on self-reported and CO-verified daily smoking abstinence at the quit date and 3 weeks later. However, CPD was lower at the quit date and 3 weeks later in the intervention group than in the control group. No significant differences between groups were found for any outcome measures 6 months after the quit date. Overall, low app engagement and low perceived usefulness were observed.

Conclusions

Despite some encouraging short-term findings on the amount of smoking, the SmokeFree buddy app did not have beneficial effects on smoking abstinence over and above the self-monitoring control condition. Future studies should examine whether and what support processes can be effectively stimulated and how app use can be improved to better achieve this goal.

Trial Registration

ISRCTN Registry 11154315; https://www.isrctn.com/ISRCTN11154315

International Registered Report Identifier (IRRID)

RR2-10.1186/s12889-019-7723-z

Smoking Treatment: A Report Card on Progress and Challenges

The impact of tobacco smoking treatment is determined by its reach into the smoking population and the effectiveness of its interventions. This review evaluates the reach and effectiveness of pharmacotherapy and psychosocial interventions for smoking. Historically, the reach of smoking treatment has been low, and therefore its impact has been limited, but new reach strategies such as digital interventions and health care system changes offer great promise. Pharmacotherapy tends to be more effective than psychosocial intervention when used clinically, and newer pharmacotherapy strategies hold great promise of further enhancing effectiveness. However, new approaches are needed to advance psychosocial interventions; progress has stagnated because research and dissemination efforts have focused too narrowly on skill training despite evidence that its core content may be inconsequential and the fact that its mechanisms are either unknown or inconsistent with supporting theory. Identifying effective psychosocial content and its mechanisms of action could greatly enhance the effectiveness of counseling, digital, and web interventions.

Engaging People in Tobacco Prevention and Cessation: Reflecting Back Over 20 Years Since the Master Settlement Agreement

Over the past 20 years, tobacco prevention and cessation efforts have evolved to keep pace with the changing tobacco product landscape and the widespread adoption of digital technologies. In 2019, Truth Initiative was awarded the Society of Behavioral Medicine’s Jessie Gruman Award for Health Engagement in recognition of the major role it has played on both fronts since its inception in 1999. This manuscript reviews the challenges and opportunities that have emerged over the past two decades, the evolving tactics deployed by Truth Initiative to engage people in tobacco prevention and cessation efforts, the approaches used to evaluate those efforts, and key achievements. It concludes with a summary of lessons learned and considerations for tobacco control researchers and practitioners to accelerate their impact on public health.

Digital Micro Interventions for Behavioral and Mental Health Gains: Core Components and Conceptualization of Digital Micro Intervention Care

Although many people access publicly available digital behavioral and mental health interventions, most do not invest as much effort in these interventions as hoped or intended by intervention developers, and ongoing engagement is often low. Thus, the impact of such interventions is minimized by a misalignment between intervention design and user behavior. Digital micro interventions are highly focused interventions delivered in the context of a person’s daily life with little burden on the individual. We propose that these interventions have the potential to disruptively expand the reach of beneficial therapeutics by lowering the bar for entry to an intervention and the effort needed for purposeful engagement. This paper provides a conceptualization of digital micro interventions, their component parts, and principles guiding their use as building blocks of a larger therapeutic process (ie, digital micro intervention care). The model represented provides a structure that could improve the design, delivery, and research on digital micro interventions and ultimately improve behavioral and mental health care and care delivery.

Developing a Messaging Graphic for Storage Times of Refrigerated Ready to Eat (RTE) Foods for a Consumer Food Safety Health Campaign

This study developed and evaluated risk communication messages for ready to eat (RTE) foods targeted towards consumer storage practices in a food safety health campaign. Concepts were determined from a fractional factorial design of five categories of attributes potentially present in health promotion: title, message, graphic, slogan, and icon. Consumers viewed a subset of concepts and scored how useful the concept was in remembering to throw away RTE foods that were stored too long. Regression analysis determined which combinations of message attributes were most likely to result in using the information to throw out foods, which could help prevent foodborne illness. Findings showed that for this type of information, a graphic is a critical element for the printed schematic. The slogan (i.e., a short statement similar to a jingle or tag-line in a commercial) may be important to consumers, but the icon was not important.