A "SMART" design for building individualized treatment sequences

A machine learning personalized treatment rule to optimize assignment to psychotherapies for grief among veterans

BACKGROUND

Complex grief patterns are associated with significant suffering, functional impairments, health and mental health problems, and increased healthcare use. This burden may be even more pronounced among veterans. Behavioral Activation and Therapeutic Exposure (BATE-G) and Cognitive Therapy for Grief (CT-G) are two evidence-based interventions for grief. The goal of this study was to use a precision medicine approach to develop a personalized treatment rule to optimize assignment among these psychotherapies.

METHODS

We analyzed data (N = 155) from a randomized clinical trial comparing BATE-G and CT-G. Outcome weighted learning was used to estimate an optimal personalized treatment rule. Baseline characteristics including demographics, social support, variables related to the death, and psychopathology dimensions were used as prescriptive factors of treatment assignment.

RESULTS

The estimated rule assigned 72 veterans to CT-G and 56 to BATE-G. Assigning participants according to this rule was estimated to lead to markedly lower mean grief level following 6 months from treatment compared to assigning everyone to either BATE-G (Vdopt - VBATE-G = -18.57 [95 % CI: -29.41, -7.72]) or CT-G (Vdopt - VBATE-G = -20.89 [95 % CI: -30.7, -11.07]) regardless of their characteristics.

LIMITATIONS

Participants were primarily male veterans, and identified with Black or White race. The estimated rule was not externally validated.

CONCLUSION

The estimated rule used relatively simple, easily accessible, client characteristics to personalize assignment to treatment using a precision medicine approach based on machine learning and causal inference. Upon further validation, such a rule can be easily implemented in clinical practice to prescriptively maximize treatment benefits.

Challenges and Opportunities in Interdisciplinary Research and Real-World Data for Treatment Sequences in Health Technology Assessments

With an ever-increasing number of treatment options, the assessment of treatment sequences has become crucial in health technology assessment (HTA). This review systematically explores the multifaceted challenges inherent in evaluating sequences, delving into their interplay and nuances that go beyond economic model structures. We synthesised a 'roadmap' of literature from key methodological studies, highlighting the evolution of recent advances and emerging research themes. These insights were compared against HTA guidelines to identify potential avenues for future research. Our findings reveal a spectrum of challenges in sequence evaluation, encompassing selecting appropriate decision-analytic modelling approaches and comparators, deriving appropriate clinical effectiveness evidence in the face of data scarcity, scrutinising effectiveness assumptions and statistical adjustments, considering treatment displacement, and optimising model computations. Integrating methodologies from diverse disciplines-statistics, epidemiology, causal inference, operational research and computer science-has demonstrated promise in addressing these challenges. An updated review of application studies is warranted to provide detailed insights into the extent and manner in which these methodologies have been implemented. Data scarcity on the effectiveness of treatment sequences emerged as a dominant concern, especially because treatment sequences are rarely compared in clinical trials. Real-world data (RWD) provide an alternative means for capturing evidence on effectiveness and future research should prioritise harnessing causal inference methods, particularly Target Trial Emulation, to evaluate treatment sequence effectiveness using RWD. This approach is also adaptable for analysing trials harbouring sequencing information and adjusting indirect comparisons when collating evidence from heterogeneous sources. Such investigative efforts could lend support to reviews of HTA recommendations and contribute to synthesising external control arms involving treatment sequences.

A matching-based machine learning approach to estimating optimal dynamic treatment regimes with time-to-event outcomes

Observational data (e.g. electronic health records) has become increasingly important in evidence-based research on dynamic treatment regimes, which tailor treatments over time to patients based on their characteristics and evolving clinical history. It is of great interest for clinicians and statisticians to identify an optimal dynamic treatment regime that can produce the best expected clinical outcome for each individual and thus maximize the treatment benefit over the population. Observational data impose various challenges for using statistical tools to estimate optimal dynamic treatment regimes. Notably, the task becomes more sophisticated when the clinical outcome of primary interest is time-to-event. Here, we propose a matching-based machine learning method to identify the optimal dynamic treatment regime with time-to-event outcomes subject to right-censoring using electronic health record data. In contrast to the established inverse probability weighting-based dynamic treatment regime methods, our proposed approach provides better protection against model misspecification and extreme weights in the context of treatment sequences, effectively addressing a prevalent challenge in the longitudinal analysis of electronic health record data. In simulations, the proposed method demonstrates robust performance across a range of scenarios. In addition, we illustrate the method with an application to estimate optimal dynamic treatment regimes for patients with advanced non-small cell lung cancer using a real-world, nationwide electronic health record database from Flatiron Health.

What to do after smoking relapse? A sequential multiple assignment randomized trial of chronic care smoking treatments

AIM

To compare effects of three post-relapse interventions on smoking abstinence.

DESIGN

Sequential three-phase multiple assignment randomized trial (SMART).

SETTING

Eighteen Wisconsin, USA, primary care clinics.

PARTICIPANTS

A total of 1154 primary care patients (53.6% women, 81.2% White) interested in quitting smoking enrolled from 2015 to 2019; 582 relapsed and were randomized to relapse recovery treatment.

INTERVENTIONS

In phase 1, patients received cessation counseling and 8 weeks nicotine patch. Those who relapsed and agreed were randomized to a phase 2 relapse recovery group: (1) reduction counseling + nicotine mini-lozenges + encouragement to quit starting 1 month post-randomization (preparation); (2) repeated encouragement to quit starting immediately post-randomization (recycling); or (3) advice to call the tobacco quitline (control). The first two groups could opt into phase 3 new quit treatment [8 weeks nicotine patch + mini-lozenges plus randomization to two treatment factors (skill training and supportive counseling) in a 2 × 2 design]. Phase 2 and 3 interventions lasted ≤ 15 months.

MEASUREMENTS

The study was powered to compare each active phase 2 treatment with the control on the primary outcome: biochemically confirmed 7-day point-prevalence abstinence 14 months post initiating phase 2 relapse recovery treatment. Exploratory analyses tested for phase 3 counseling factor effects.

FINDINGS

Neither skill training nor supportive counseling (each on versus off) increased 14-month abstinence rates; skills on versus off 9.3% (14/151) versus 5.2% (8/153), P = 0.19; support on versus off 6.6% (10/152) versus 7.9% (12/152), P = 0.73. Phase 2 preparation did not produce higher 14-month abstinence rates than quitline referral; 3.6% (8/220) versus 2.1% [3/145; risk difference = 1.5%, 95% confidence interval (CI) = -1.8-5.0%, odds ratio (OR) = 1.8, 95% CI = 0.5-6.9]. Recycling, however, produced higher abstinence rates than quitline referral; 6.9% (15/217) versus 2.1% (three of 145; risk difference, 4.8%, 95% CI = 0.7-8.9%, OR = 3.5, 95% CI = 1.0-12.4). Recycling produced greater entry into new quit treatment than preparation: 83.4% (181/217) versus 55.9% (123/220), P < 0.0001.

CONCLUSIONS

Among people interested in quitting smoking, immediate encouragement post-relapse to enter a new round of smoking cessation treatment ('recycling') produced higher probability of abstinence than tobacco quitline referral. Recycling produced higher rates of cessation treatment re-engagement than did preparation/cutting down using more intensive counseling and pharmacotherapy.

Imager-A mobile health mental imagery-based ecological momentary intervention targeting reward sensitivity: A randomized controlled trial

Robust reward sensitivity may help preserve mental well-being in the face of adversity and has been proposed as a key stress resilience factor. Here, we present a mobile health application, "Imager," which targets reward sensitivity by training individuals to create mental images of future rewarding experiences. We conducted a two-arm randomized controlled trial with 95 participants screened for reward sensitivity. Participants in the intervention group received an ecological momentary intervention-Imager, which encouraged participants to create mental images of rewarding events for 1 week. The control group participants received only ecological momentary assessment, without the instruction to generate mental images. Adherence to Imager was high; participants in the intervention group engaged in 88% of the planned activities. In the follow-up assessment, the intervention group reported less mental health symptoms, mainly in depression (β = -0.34, df = 93, p = .004) and less perceived stress (β = -0.18, df = 93, p = .035), than control group participants and compared with the baseline assessment. Our results show the positive effects of Imager on mental health symptoms. The encouraging effects of the app on mental health outcomes may lead to greater use of ecological momentary interventions in the clinical preventive practice of affective disorders.

Implementation of a day-stay joint replacement pathway in an Australian regional public hospital: A descriptive study

OBJECTIVE

To describe the implementation, feasibility and safety of a day-stay joint replacement pathway in a regional public hospital in Australia.

METHOD

Over a 12-month pilot period, a prospective descriptive analysis of consecutive patients undergoing total knee and hip arthroplasty was conducted. The number of eligible day-stay patients, proportion of successful same-day discharges and reasons for same-day failure to discharge were recorded. Outcome measures captured for all joint replacements across this period included length of stay (LoS), patient reported outcomes, complications and patient satisfaction. The implementation pathway as well as patient and staff identified success factors derived from interviews were outlined.

RESULTS

Forty-one/246 (17%) patients booked for joint replacement surgery were eligible for day-stay and 21/41 (51%) achieved a successful same-day discharge. Unsuccessful same-day discharges were due to time of surgery too late in the day (7/20), no longer meeting same-day discharge criteria (11/20) and declined discharge same-day (2/20). Over the implementation period 65% (162/246) of all patients were discharged with a LoS of 2 days or less. Patient satisfaction for the day-stay pathway was high. Complication rates and patient-reported outcomes were equivalent across LoS groups.

CONCLUSION

The day-stay joint replacement surgery pathway was feasible to implement, safe and acceptable to patients. Day-stay pathways have potential patient and system-level efficiency benefits.

Understanding Heterogeneity in Individual Responses to Digital Lifestyle Intervention Through Self-Monitoring Adherence Trajectories in Adults With Overweight or Obesity: Secondary Analysis of a 6-Month Randomized Controlled Trial

BACKGROUND

Achieving clinically significant weight loss through lifestyle interventions for obesity management is challenging for most individuals. Improving intervention effectiveness involves early identification of intervention nonresponders and providing them with timely, tailored interventions. Early and frequent self-monitoring (SM) adherence predicts later weight loss success, making it a potential indicator for identifying nonresponders in the initial phase.

OBJECTIVE

This study aims to identify clinically meaningful participant subgroups based on longitudinal adherence to SM of diet, activity, and weight over 6 months as well as psychological predictors of participant subgroups from a self-determination theory (SDT) perspective.

METHODS

This was a secondary data analysis of a 6-month digital lifestyle intervention for adults with overweight or obesity. The participants were instructed to perform daily SM on 3 targets: diet, activity, and weight. Data from 50 participants (mean age: 53.0, SD 12.6 y) were analyzed. Group-based multitrajectory modeling was performed to identify subgroups with distinct trajectories of SM adherence across the 3 SM targets. Differences between subgroups were examined for changes in clinical outcomes (ie, body weight, hemoglobin A1c) and SDT constructs (ie, eating-related autonomous motivation and perceived competence for diet) over 6 months using linear mixed models.

RESULTS

Two distinct SM trajectory subgroups emerged: the Lower SM group (21/50, 42%), characterized by all-around low and rapidly declining SM, and the Higher SM group (29/50, 58%), characterized by moderate and declining diet and weight SM with high activity SM. Since week 2, participants in the Lower SM group exhibited significantly lower levels of diet (P=.003), activity (P=.002), and weight SM (P=.02) compared with the Higher SM group. In terms of clinical outcomes, the Higher SM group achieved a significant reduction in body weight (estimate: -6.06, SD 0.87 kg; P<.001) and hemoglobin A1c (estimate: -0.38, SD 0.11%; P=.02), whereas the Lower SM group exhibited no improvements. For SDT constructs, both groups maintained high levels of autonomous motivation for over 6 months. However, the Lower SM group experienced a significant decline in perceived competence (P=.005) compared with the Higher SM group, which maintained a high level of perceived competence throughout the intervention (P=.09).

CONCLUSIONS

The presence of the Lower SM group highlights the value of using longitudinal SM adherence trajectories as an intervention response indicator. Future adaptive trials should identify nonresponders within the initial 2 weeks based on their SM adherence and integrate intervention strategies to enhance perceived competence in diet to benefit nonresponders.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05071287; https://clinicaltrials.gov/study/NCT05071287.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1016/j.cct.2022.106845.

SMART use of medications for the treatment of adolescent severe obesity: A sequential multiple assignment randomized trial protocol

BACKGROUND

Severe obesity is a complex, chronic disease affecting nearly 9% of adolescents in the U.S. Although the current mainstay of treatment is lifestyle therapy, pediatric clinical practice guidelines recommend the addition of adjunct anti-obesity medication (AOM), such as phentermine and topiramate. However, guidance regarding when adjunct AOM should be started and how AOM should be used is unclear. Furthermore, an inherent limitation of current treatment guidelines is their "one-size-fits-all" approach, which does not account for the heterogeneous nature of obesity and high degree of patient variability in response to all interventions.

METHODS

This paper describes the study design and methods of a sequential multiple assignment randomized trial (SMART), "SMART Use of Medications for the Treatment of Adolescent Severe Obesity." The trial will examine 1) when to start AOM (specifically phentermine) in adolescents who are not responding to lifestyle therapy and 2) how to modify AOM when there is a sub-optimal response to the initial pharmacological intervention (specifically, for phentermine non-responders, is it better to add topiramate to phentermine or switch to topiramate monotherapy). Critically, participant characteristics that may differentially affect response to treatment will be assessed and evaluated as potential moderators of intervention efficacy.

CONCLUSION

Data from this study will be used to inform the development of an adaptive intervention for the treatment of adolescent severe obesity that includes empirically-derived decision rules regarding when and how to use AOM. Future research will test this adaptive intervention against standard "one-size-fits-all" treatments.

Machine Learning and Health Science Research: Tutorial

Machine learning (ML) has seen impressive growth in health science research due to its capacity for handling complex data to perform a range of tasks, including unsupervised learning, supervised learning, and reinforcement learning. To aid health science researchers in understanding the strengths and limitations of ML and to facilitate its integration into their studies, we present here a guideline for integrating ML into an analysis through a structured framework, covering steps from framing a research question to study design and analysis techniques for specialized data types.

Burst versus continuous delivery design in digital mental health interventions: Evidence from a randomized clinical trial

Objective

Digital mental health interventions delivered via smartphone-based apps effectively treat various conditions; however, optimizing their efficacy while minimizing participant burden remains a key challenge. In this study, we investigated the potential benefits of a burst delivery design (i.e. interventions delivered only in pre-defined time intervals) in comparison to the continuous delivery of interventions.

Methods

We randomly assigned 93 participants to the continuous delivery (CD) or burst delivery (BD) group. The CD group engaged in ReApp, a mobile app that increases positive cognitive reappraisal with a consistent delivery schedule that provides five prompts per day throughout the 3-week-long study, while the BD group received five daily prompts only in the first and third weeks of the study.

Results

No significant differences were found between the groups in terms of adherence, mental health outcomes (specifically depressive and anxiety symptoms), level of perceived stress, and perceived helpfulness of intervention. The BD group showed a significantly decreased perceived difficulty of intervention over time.

Conclusions

The results suggest that the burst delivery may be as suitable for digital mental health interventions as the continuous delivery. The perceived difficulty of the intervention declined more steeply for the BD group, indicating that it improved the feasibility of the positive cognitive reappraisal intervention without hurting its efficacy. This outcome may inform the design of less burdensome interventions with improved outcomes in future research.

Randomized Trial of Two Exercise Programs to Increase Physical Activity and Health-Related Quality of Life for Persons With Spinal Cord Injury

Objectives

To compare the effectiveness of two different interventions that promote physical activity in individuals with traumatic spinal cord injury (SCI) and determine the effect of relapse prevention.

Methods

A sequential, multiple assignment, randomized trial was conducted at a universally designed community-based exercise facility. Participants were individuals with traumatic SCI, >3 months post injury, levels C5 to T12, age ≥18 years (N = 79). After randomization, Bridge Program participants completed an 8-week personalized, less intense, exercise program informed by American College of Sports Medicine (ACSM) guidelines and supported with hands-on peer mentoring, exercise of choice, and caregiver training. Structured Exercise participants completed an 8-week program in a group format based on ACSM guidelines. After intervention, participants were randomized to receive or not receive relapse prevention for 6 months. The time and intensity of physical activity and psychological change in depression, anxiety, self-efficacy, and function were assessed with self-reported measures.

Results

Compared to baseline, physical activity increased post intervention for both the Bridge and Structured Exercise programs. Compared to baseline, participants in the Bridge Program recorded fewer anxiety symptoms. No significant changes were noted for either program in depressive symptoms, self-efficacy, or function. There was no difference in relapse prevention between the two groups at 6 months.

Conclusions

The Bridge Program, a novel personalized exercise program with peer support, exercise of choice, and caregiver training, and a structured exercise program both improved self-reported physical activity, but the Bridge Program also reduced anxiety symptoms. This study provides important insight into the limitations of commonly used measures of physical activity and psychosocial domains in people with SCI.

A randomized controlled trial of the online OurRelationship program with varying levels of coach support

Online programs that reduce relationship distress fill a critical need; however, their scalability is limited by their reliance on coach calls. To determine the effectiveness of the online OurRelationship program with varying levels of coach support, we conducted a comparative effectiveness trial with 740 low-income couples in the United States. Couples were randomly assigned to full-coach (ncouples = 226; program as originally designed), automated-coach (ncouples = 145; as a stand-alone program with tailored automated emails only), contingent-coach (ncouples = 145; as an adaptive program where tailored automated emails are followed by more coaching if couples did not meet progress milestones), or a waitlist control condition (ncouples = 224). All analyses were conducted within a Bayesian framework. Completion rates were comparable across conditions (full-coach: 65 %, automated-coach: 59 %, contingent-coach: 54 %). All intervention couples reported reliable pre-post gains in relationship satisfaction compared to waitlist control couples (dfull = 0.46, dcontingent = 0.47, and dautomated = 0.40) with no reliable differences across intervention conditions. Over four-month follow-up, couples in full- and contingent-coach conditions maintained gains in relationship satisfaction and couples in the automated-coach condition continued to improve. Given the comparable completion rates and minimal differences in effect sizes across intervention conditions, all three coaching models appear viable; therefore, the choice of model can vary depending on available resources as well as couple or stakeholder preferences. This study was preregistered (ClinicalTrials.govNCT03568565).

A youth-centred approach to improving engagement in HIV services: human-centred design methods and outcomes in a research trial in Kisumu County, Kenya

IntroductionInnovative interventions are needed to improve HIV outcomes among adolescents and young adults (AYAs) living with HIV. Engaging AYAs in intervention development could increase effectiveness and youth acceptance, yet research is limited. We applied human-centred design (HCD) to refine adherence-support interventions pretrial and assessed HCD workshop acceptability.

METHODS

We applied an iterative, four-phased HCD process in Kenya that included: (1) systematic review of extant knowledge, (2) prioritisation of design challenges, (3) a co-creation workshop and (4) translation tables to pair insights with trial intervention adaptations. The co-creation workshop was co-led by youth facilitators employing participatory activities to inform intervention adaptations. Iterative data analysis included rapid thematic analysis of visualised workshop outputs and notes using affinity mapping and dialogue to identify key themes. We conducted a survey to assess workshop acceptability among participants.

RESULTS

Twenty-two participants engaged in the 4-day workshop. Co-creation activities yielded recommendations for improving planned interventions (eg, message frequency and content; strategies to engage hard-to-reach participants), critical principles to employ across interventions (eg, personalisation, AYA empowerment) and identification of unanticipated AYA HIV treatment priorities (eg, drug holidays, transition from adolescent to adult services). We revised intervention content, peer navigator training materials and study inclusion criteria in response to findings. The youth-led HCD workshop was highly acceptable to participants.

CONCLUSIONS

Research employing HCD among youth can improve interventions preimplementation through empathy, youth-led inquiry and real-time problem solving. Peer navigation may be most influential in improving retention when engagement with young people is based on mutual trust, respect, privacy and extends beyond HIV-specific support. Identifying opportunities for personalisation and adaptation within intervention delivery is important for AYAs. Patient engagement interventions that target young people should prioritise improved transition between youth and adult services, youth HIV status disclosure, AYA empowerment and healthcare worker responsiveness in interactions and episodic adherence interruptions.

Increasing the reach of evidence-based interventions for weight management and diabetes prevention among Medicaid patients: study protocol for a pilot Sequential Multiple Assignment Randomised Trial

INTRODUCTION

Over 40% of US adults meet criteria for obesity, a major risk factor for chronic disease. Obesity disproportionately impacts populations that have been historically marginalised (eg, low socioeconomic status, rural, some racial/ethnic minority groups). Evidence-based interventions (EBIs) for weight management exist but reach less than 3% of eligible individuals. The aims of this pilot randomised controlled trial are to evaluate feasibility and acceptability of dissemination strategies designed to increase reach of EBIs for weight management.

METHODS AND ANALYSIS

This study is a two-phase, Sequential Multiple Assignment Randomized Trial, conducted with 200 Medicaid patients. In phase 1, patients will be individually randomised to single text message (TM1) or multiple text messages (TM+). Phase 2 is based on treatment response. Patients who enrol in the EBI within 12 weeks of exposure to phase 1 (ie, responders) receive no further interventions. Patients in TM1 who do not enrol in the EBI within 12 weeks of exposure (ie, TM1 non-responders) will be randomised to either TM1-Continued (ie, no further TM) or TM1 & MAPS (ie, no further TM, up to 2 Motivation And Problem Solving (MAPS) navigation calls) over the next 12 weeks. Patients in TM+ who do not enrol in the EBI (ie, TM+ non-responders) will be randomised to either TM+Continued (ie, monthly text messages) or TM+ & MAPS (ie, monthly text messages, plus up to 2 MAPS calls) over the next 12 weeks. Descriptive statistics will be used to characterise feasibility (eg, proportion of patients eligible, contacted and enrolled in the trial) and acceptability (eg, participant opt-out, participant engagement with dissemination strategies, EBI reach (ie, the proportion of participants who enrol in EBI), adherence, effectiveness).

ETHICS AND DISSEMINATION

Study protocol was approved by the University of Utah Institutional Review Board (#00139694). Results will be disseminated through study partners and peer-reviewed publications.

TRIAL REGISTRATION NUMBER

clinicaltrials.gov; NCT05666323.

Causal inference for oncology: past developments and current challenges

In this paper, we review some important early developments on causal inference in medical statistics and epidemiology that were inspired by questions in oncology. We examine two classical examples from the literature and point to a current area of ongoing methodological development, namely the estimation of optimal adaptive treatment strategies. While causal approaches to analysis have become more routine in oncology research, many exciting challenges and open problems remain, particularly in the context of censored outcomes.

An Exploration of Intervention Augmentation in a Single Case

Recent work has highlighted that process-outcome relationships are likely to vary depending on the client, yet much work remains to be done in the area of tailoring interventions to a given client. This naturalistic single-case analysis provides an example of augmenting a treatment protocol with "off protocol" relaxation methods, based on routinely collected outcome information to guide shared decision making. Intensive case study analyses were applied to one client with principal generalized anxiety disorder and comorbid major depressive disorder receiving transdiagnostic cognitive-behavioral therapy. The client completed two routine anxiety and depression symptom and functioning scales prior to each session of naturalistic treatment. Time series analyses were applied to the two symptom measures. Among the results, (a) significant linear decreases in anxiety and depression from baseline to posttreatment were observed; and (b) the introduction of relaxation methods had a significant impact on the course of anxiety symptom change. In conclusion, routine outcome assessment can be used to inform intervention augmentation with individual clients. Furthermore, regular assessment is needed to determine if a client may benefit from an alternative set of specific intervention strategies.

Extending the vision of adaptive point-of-care platform trials to improve targeted use of drug therapy regimens: An agile approach in the learning healthcare system toolkit

OBJECTIVES

Improving the targeted use of drug regimens requires robust real-world evidence (RWE) to address the uncertainties that remain regarding their real-world performance following market entry. However, challenges in the current state of RWE production limit its impact on clinical decisions, as well as its operational scalability and sustainability. We propose an adaptive point-of-care (APoC) platform trial as an approach to RWE production that improves both clinical and operational efficiencies.

METHODS AND FINDINGS

We explored design innovations, operational challenges, and infrastructure needs within a multi-stakeholder consortium to evaluate the potential of an APoC platform trial for studying chronic disease treatment regimens using rheumatoid arthritis as a case study. The concept integrates elements from adaptive clinical trials (dynamic treatment regimen strategies) and point-of-care trials (research embedded into routine clinical care) under a perpetual platform infrastructure. The necessary components to implement an APoC platform trial within outpatient settings exist, and present an opportunity for a cross-disciplinary, multi-stakeholder approach. Effective engagement of key stakeholders involved in and impacted by the platform is critical to success. Our collaborative design process identified three high-impact stakeholder-engagement areas: (1) focus on research question(s), (2) design and implementation planning such that it is feasible and fit-for-purpose, and (3) measurement, or meaningful metrics for both clinical (patient outcomes) and system (operational efficiencies) impact.

CONCLUSIONS

An APoC platform trial for rheumatoid arthritis integrating innovative design elements in a scalable infrastructure has the potential to reduce important uncertainties about the real-world performance of biomedical innovations and improve clinical decisions.

Developing an Implementation Blueprint for the NIH HEAL Initiative GRACE Trial: Perspectives on Acupuncture and Guided Relaxation for Chronic Sickle Cell Disease Pain

Objective: This study aimed to explore perspectives of people living with sickle cell disease (SCD) and SCD clinic providers and staff about the use of acupuncture and guided relaxation for treating chronic SCD pain. Data obtained were to inform an implementation blueprint for an effectiveness implementation clinical trial (GRACE Trial) testing whether acupuncture or guided relaxation reduces chronic pain when compared with usual care. Design: Qualitative research design. Methods: We conducted 33 semistructured interviews with people with SCD and SCD clinic providers and staff. Interviews were transcribed and coded. A deductive content analysis process was used to identify themes. Results: Four themes were identified: Receptivity to Acupuncture and Guided Relaxation, Limited Awareness, Complementary and Integrative Health (CIH) Therapy Preference, and Access Barriers. Both patients and clinic providers and staff were open to the use of acupuncture and guided relaxation for chronic pain treatment. After learning about these CIH therapies, some patients expressed a preference for one therapy over the other. They also discussed their ability to successfully engage with each therapy. There is a need to dispel misconceptions about the therapies by increasing understanding of how each therapy is implemented and functions to reduce pain. We identified several potential barriers that might affect the success of the trial and future health system integration, including time, transportation, and technology. Conclusion: This study is one of the first to present perspectives of both patients with SCD and clinic providers and staff on the use of acupuncture and guided relaxation for chronic SCD pain. Stakeholders' early input and perspectives highlighted that they welcome nonpharmacological CIH therapies. Implementation of a clinical trial and future health system integration will require the addressing misinformation and identifying strategies to overcome access barriers. Clinical trial registration number: NCT04906447.

Enhanced Skills Training in Affective and Interpersonal Regulation (ESTAIR): A New Modular Treatment for ICD-11 Complex Posttraumatic Stress Disorder (CPTSD)

ICD-11 Complex Posttraumatic Stress Disorder (CPTSD) is a relatively new condition; therefore, there is limited available evidence for its treatment. Prior to the recognition of CPTSD as a separate trauma condition, people who met criteria were often diagnosed with multiple co-morbid conditions such as PTSD, anxiety, depression, and emotional dysregulation difficulties. In the absence of a coherent evidence base, treatment tended to involve multiple treatments for these multiple conditions or lengthy phase-based interventions, often delivered in an integrative fashion, which was not standardized. In this paper, we present Enhanced Skills Training in Affective and Interpersonal Regulation (ESTAIR), a new flexible multi-modular approach for the treatment of CPTSD and its transdiagnostic symptoms. ESTAIR is consistent with trauma-informed and patient-centered care, which highlights the importance of patient choice in identification and sequencing in targeting CPTSD symptoms. Directions for future research are discussed.

Bayesian sample size calculations for comparing two strategies in SMART studies

In the management of most chronic conditions characterized by the lack of universally effective treatments, adaptive treatment strategies (ATSs) have grown in popularity as they offer a more individualized approach. As a result, sequential multiple assignment randomized trials (SMARTs) have gained attention as the most suitable clinical trial design to formalize the study of these strategies. While the number of SMARTs has increased in recent years, sample size and design considerations have generally been carried out in frequentist settings. However, standard frequentist formulae require assumptions on interim response rates and variance components. Misspecifying these can lead to incorrect sample size calculations and correspondingly inadequate levels of power. The Bayesian framework offers a straightforward path to alleviate some of these concerns. In this paper, we provide calculations in a Bayesian setting to allow more realistic and robust estimates that account for uncertainty in inputs through the 'two priors' approach. Additionally, compared to the standard frequentist formulae, this methodology allows us to rely on fewer assumptions, integrate pre-trial knowledge, and switch the focus from the standardized effect size to the MDD. The proposed methodology is evaluated in a thorough simulation study and is implemented to estimate the sample size for a full-scale SMART of an internet-based adaptive stress management intervention on cardiovascular disease patients using data from its pilot study conducted in two Canadian provinces.

Behavioral cancer pain intervention dosing: results of a Sequential Multiple Assignment Randomized Trial

ABSTRACT

Behavioral pain management interventions are efficacious for reducing pain in patients with cancer. However, optimal dosing of behavioral pain interventions for pain reduction is unknown, and this hinders routine clinical use. A Sequential Multiple Assignment Randomized Trial (SMART) was used to evaluate whether varying doses of Pain Coping Skills Training (PCST) and response-based dose adaptation can improve pain management in women with breast cancer. Participants (N = 327) had stage I-IIIC breast cancer and a worst pain score of > 5/10. Pain severity (a priori primary outcome) was assessed before initial randomization (1:1 allocation) to PCST-Full (5 sessions) or PCST-Brief (1 session) and 5 to 8 weeks later. Responders ( > 30% pain reduction) were rerandomized to a maintenance dose or no dose and nonresponders (<30% pain reduction) to an increased or maintenance dose. Pain severity was assessed again 5 to 8 weeks later (assessment 3) and 6 months later (assessment 4). As hypothesized, PCST-Full resulted in greater mean percent pain reduction than PCST-Brief (M [SD] = -28.5% [39.6%] vs M [SD]= -14.8% [71.8%]; P = 0.041). At assessment 3 after second dosing, all intervention sequences evidenced pain reduction from assessment 1 with no differences between sequences. At assessment 4, all sequences evidenced pain reduction from assessment 1 with differences between sequences ( P = 0.027). Participants initially receiving PCST-Full had greater pain reduction at assessment 4 ( P = 0.056). Varying PCST doses led to pain reduction over time. Intervention sequences demonstrating the most durable decreases in pain reduction included PCST-Full. Pain Coping Skills Training with intervention adjustment based on response can produce sustainable pain reduction.

Mobile Technologies for Supporting Mental Health in Youths: Scoping Review of Effectiveness, Limitations, and Inclusivity

BACKGROUND

Over the past decade, there has been growing support for the use of mobile health (mHealth) technologies to improve the availability of mental health interventions. While mHealth is a promising tool for improving access to interventions, research on the effectiveness and efficacy of mHealth apps for youths is limited, particularly for underrepresented populations, including youths of color and economically marginalized youths.

OBJECTIVE

This scoping review study sought to evaluate the following research questions: (1) What is the extent of the current literature on mHealth apps that provide intervention for mental health problems in children and adolescents? (2) What is known from the existing literature about the effectiveness or efficacy of delivering mental health services via mHealth apps? (3) What are the gaps in the knowledge base in the fields of technology and mental health? (4) Do the reviewed mHealth apps address issues of cultural sensitivity or have they been tested with underrepresented groups (ie, youths of color or economically marginalized groups)?

METHODS

An electronic database search was conducted using relevant search terms. Seven independent reviewers screened identified studies, including title and abstract review to determine if studies met the following inclusion criteria: (1) targeted samples with mental health symptomology or disorders, (2) studied youth participants aged 6-17 years, and (3) examined the use of a mobile app-based platform for intervention. Relevant studies were subjected to full-text review to extract and chart relevant data based on a priori research questions.

RESULTS

The initial database search yielded 304 papers published from 2010 to 2021. After screening and selection, the final review included 10 papers on the effectiveness and efficacy of mental health intervention apps for youths aged 8 to 17 years. Identified apps targeted a broad range of mental health challenges in youths (ie, depression, self-harm, autism spectrum disorder, anxiety, and obsessive-compulsive disorder). Results identified only a small number of studies suggesting that current effectiveness and efficacy research in this area are limited. While some studies provided general support for the effectiveness of mHealth apps in improving mental health outcomes in youths, several notable limitations were present across the literature, reducing the generalizability of findings. Additionally, considerations around racial, ethnic, and socioeconomic diversity were scarce across studies.

CONCLUSIONS

Although some studies cited in this scoping review provide support for the effectiveness and efficacy of mHealth apps targeting mental health concerns in youths, the overall body of literature remains quite limited. Moreover, mHealth apps expressly developed to be culturally responsive are almost nonexistent. Further efforts are needed to recruit youths who are typically underrepresented in research and invite stakeholder participation and collaborative input in the early stages of the mHealth app development process.

Cognitive behavioral therapies for individuals with cerebral palsy: A scoping review

AIM

To synthesize the evidence about the main intervention characteristics of cognitive behavioral therapies (CBTs) for individuals with cerebral palsy and identify barriers and facilitators to their success, focusing on aspects of feasibility and markers of success.

METHOD

A scoping review methodology informed a literature search for papers published between 1991 and 2021. Articles were screened, reviewed, and categorized using the DistillerSR systematic review software, and critically appraised for quantitative and/or qualitative criteria.

RESULTS

Out of 1265 publications identified, 14 met the inclusion criteria. Elements associated with the specific study participant characteristics (46% female; aged 6-65 years), type of CBT techniques used (third-wave [n = 6], cognitive [n = 3], cognitive and behavioral [n = 2], biofeedback training [n = 2]), and features of the study context and methodological quality (two randomized clinical trials and small sample sizes [n ≤ 12]), were identified. Most studies had psychological targets of intervention (n = 10) and secondary physiological (n = 3) or social (n = 2) objectives. Feasibility indicators were described in nearly one-third of the papers.

INTERPRETATION

This study highlights the high flexibility within CBT interventions, enabling their adaptation for individuals with cerebral palsy. However, relatively little, and only low-certainty evidence was identified. More high-quality research in terms of specific CBT techniques, optimal treatment doses, and detailed population characteristics are needed.

Research objectives and general considerations for pragmatic clinical trials of pain treatments: IMMPACT statement

ABSTRACT

Many questions regarding the clinical management of people experiencing pain and related health policy decision-making may best be answered by pragmatic controlled trials. To generate clinically relevant and widely applicable findings, such trials aim to reproduce elements of routine clinical care or are embedded within clinical workflows. In contrast with traditional efficacy trials, pragmatic trials are intended to address a broader set of external validity questions critical for stakeholders (clinicians, healthcare leaders, policymakers, insurers, and patients) in considering the adoption and use of evidence-based treatments in daily clinical care. This article summarizes methodological considerations for pragmatic trials, mainly concerning methods of fundamental importance to the internal validity of trials. The relationship between these methods and common pragmatic trials methods and goals is considered, recognizing that the resulting trial designs are highly dependent on the specific research question under investigation. The basis of this statement was an Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT) systematic review of methods and a consensus meeting. The meeting was organized by the Analgesic, Anesthetic, and Addiction Clinical Trial Translations, Innovations, Opportunities, and Networks (ACTTION) public-private partnership. The consensus process was informed by expert presentations, panel and consensus discussions, and a preparatory systematic review. In the context of pragmatic trials of pain treatments, we present fundamental considerations for the planning phase of pragmatic trials, including the specification of trial objectives, the selection of adequate designs, and methods to enhance internal validity while maintaining the ability to answer pragmatic research questions.

Adaptive interventions for alcohol misuse and violent behaviors among adolescents and emerging adults in the emergency department: A sequential multiple assignment randomized controlled trial protocol

Alcohol use and violent behaviors among youth are associated with morbidity and mortality. An emergency department (ED) visit provides an opportunity to initiate prevention efforts. Despite promising findings from our single session SafERteens brief intervention (BI), impact is limited by modest effect sizes, with data lacking on optimal boosters to enhance effects. This paper describes the protocol for a sequential, multiple assignment, randomized trial (SMART). Adolescents and emerging adults (ages 14-20) in the ED screening positive for alcohol use and violent behaviors (physical aggression) were randomly assigned to: 1) SafERteens BI + Text Messaging (TM), or 2) SafERteens BI + remote Health Coach (HC). Participants completed weekly surveys over 8 weeks after the ED visit to tailor intervention content and measure mechanisms of change. At one-month, intervention response/non-response is determined (e.g., binge drinking or violent behaviors). Responders are re-randomized to continued intervention condition (e.g., maintenance) or minimized condition (e.g., stepped down). Non-responders are re-randomized to continued condition (e.g., maintenance), or intensified condition (e.g., stepped up). Outcomes were measured at 4 and 8 months, including primary outcomes of alcohol consumption and violence, with secondary outcomes of alcohol consequences and violence consequences. Although the original goal was to enroll 700 participants, COVID-19 impacts on research diminished recruitment in this trial (enrolled n = 400). Nonetheless, the proposed SMART is highly innovative by blending real-time assessment methodologies with adaptive intervention delivery among teens with comorbid alcohol misuse and violent behaviors. Findings will inform the content and timing booster interventions to alter risk behavior trajectories. Trial Registration:ClinicalTrials.govNCT03344666. University of Michigan # HUM00109156.

Translating the Recommended Multicomponent Intervention for Childhood Overweight and Obesity into Practice: Implementation Challenges

A multicomponent, family-based intervention with ≥ 26 contact hours is recommended for the treatment of childhood overweight and obesity. This intervention utilizes behavioral strategies to improve diet, physical activity, and sedentary behaviors. The evidence-based recommendations for this treatment have predominantly come from randomized trials in which the intervention is implemented by research-trained staff in academic research settings, with the intervention delivered to fairly homogeneous samples that are limited in being inclusive of those experiencing health disparities. Thus, there are challenges in implementing the recommended intervention into practice. In particular, there are implementation challenges related to providers, contact time, and settings that impact all children. Specifically, the structure of the intervention may diminish its ability to be delivered by many types of providers in different settings, limiting overall accessibility. There are implementation challenges affecting children who experience health disparities, as it is not clear how efficacious the recommended intervention is for African American or Latinx children, or children from households with low income. Several strategies to reduce identified implementation challenges, such as reducing contact time and intensity of the dietary intervention, are discussed. However, use of these strategies may reduce the effect size of the weight improvements commonly seen with the recommended intervention. Suggestions for future research regarding implementation, specifically using study designs that enhance the ability to create cost-efficient and adaptive interventions that can generalize to many different children and families, are provided.

Testing adaptive interventions to improve PTSD treatment outcomes in Federally Qualified Health Centers: Protocol for a randomized clinical trial

BACKGROUND

Posttraumatic stress disorder (PTSD) disproportionately affects low-income individuals and is untreated in 70% of those affected. One third of low-income Americans are treated in Federally Qualified Health Centers (FQHCs), which do not have the capacity to provide all patients with first-line treatments such as Prolonged Exposure (PE). To address this problem, FQHCs could use low-intensity interventions (e.g., Clinician-Supported PTSD Coach: CS PTSD Coach) and medium-intensity interventions (e.g., PE for Primary Care: PE-PC) to treat PTSD with fewer resources. However, some patients will still require high-intensity treatments (e.g., full-length PE) for sustained clinical benefit. Thus, there is a critical need to develop stepped-care models for PTSD in FQHCs.

METHOD

We are conducting a Sequential, Multiple Assignment, Randomized Trial (SMART) with 430 adults with PTSD in FQHCs. Participants are initially randomized to CS PTSD Coach or PE-PC. After four sessions, early responders step down to lower frequency interaction within their assigned initial treatment strategy. Slow responders are re-randomized to either continue their initial treatment strategy or step up to Full PE for an additional eight weeks. The specific aims are to test the effectiveness of initiating treatment with PE-PC versus CS PTSD Coach in reducing PTSD symptoms and to test the effectiveness of second-stage strategies (continue versus step-up to Full PE) for slow responders.

CONCLUSIONS

This project will provide critical evidence to inform the development of an effective stepped-care model for PTSD. Testing scalable, sustainable sequences of PTSD treatments delivered in low-resource community health centers will improve clinical practice for PTSD.

A SMART Approach to Retention in HIV Care

The Joint United Nation Programme on HIV/AIDS (UNAIDS) has aims that, by 2025, 95% of people with HIV should know their HIV status, 95% of people who receive a diagnosis should be receiving antiretroviral therapy (ART), and 95% of people with HIV and receiving ART should be virally suppressed.1 The challenge and opportunity of the UNAIDS 95-95-95 goal are to reach people outside standard clinic-based services.2 However, after ART is initiated, retention in care is a challenge, with only 67% of persons continuing to receive ART after 5 years.3.

Adapt for Adolescents: Protocol for a sequential multiple assignment randomized trial to improve retention and viral suppression among adolescents and young adults living with HIV in Kenya

BACKGROUND

Adolescents and young adults living with HIV (AYAH) aged 14-24 years in Africa experience substantially higher rates of virological failure and HIV-related mortality than adults. We propose to utilize developmentally appropriate interventions with high potential for effectiveness, tailored by AYAH pre-implementation, in a sequential multiple assignment randomized trial (SMART) aimed at improving viral suppression for AYAH in Kenya.

METHODS

Using a SMART design, we will randomize 880 AYAH in Kisumu, Kenya to either youth-centered education and counseling (standard of care) or electronic peer navigation in which a peer provides support, information, and counseling via phone and automated monthly text messages. Those with a lapse in engagement (defined as either a missed clinic visit by ≥14 days or HIV viral load ≥1000 copies/ml) will be randomized a second time to one of three higher-intensity re-engagement interventions: This study will evaluate which interventions and which dynamic sequence of interventions improve sustained viral suppression and HIV care engagement in AYAH at 24 months post-enrollment and assess the cost-effectiveness of successful strategies.

DISCUSSION

The study utilizes promising interventions tailored to AYAH while optimizing resources by intensifying services only for those AYAH who need more support. Findings from this innovative study will offer evidence for public health programming to end the HIV epidemic as a public health threat for AYAH in Africa.

TRIAL REGISTRATION

Clinicaltrials.govNCT04432571, registered June 16, 2020.

Get SMART - Understanding Sequential Multiple Assignment Randomized Trials

Sequential multiple assignment randomized trials (SMARTs) have been used to advance treatments for complex problems that lack clearly defined interventions.1,2 Unlike in traditional clinical trials in which participants are randomly assigned to only one intervention or one intervention strategy,3,4 in SMARTs participants are randomly assigned to an intervention at two or more stages of the trial. The adaptive reallocation strategy constructs a tailored or personalized strategy of interventions on the basis of the individuals' responses.5-8 An example of a SMART design is reported in this issue of NEJM Evidence.9.

Adaptive Strategies for Retention in Care among Persons Living with HIV

BACKGROUND

Optimizing retention in human immunodeficiency virus (HIV) treatment may require sequential behavioral interventions based on patients' response.

METHODS

In a sequential multiple assignment randomized trial in Kenya, we randomly assigned adults initiating HIV treatment to standard of care (SOC), Short Message Service (SMS) messages, or conditional cash transfers (CCT). Those with retention lapse (missed a clinic visit by ≥14 days) were randomly assigned again to standard-of-care outreach (SOC-Outreach), SMS+CCT, or peer navigation. Those randomly assigned to SMS or CCT who did not lapse after 1 year were randomly assigned again to either stop or continue the initial intervention. Primary outcomes were retention in care without an initial lapse, return to the clinic among those who lapsed, and time in care; secondary outcomes included adjudicated viral suppression. Average treatment effect (ATE) was calculated using targeted maximum likelihood estimation with adjustment for baseline characteristics at randomization and certain time-varying characteristics at rerandomization.

RESULTS

Among 1809 participants, 79.7% of those randomly assigned to CCT (n=523/656), 71.7% to SMS (n=393/548), and 70.7% to SOC (n=428/605) were retained in care in the first year (ATE: 9.9%; 95% confidence interval [CI]: 5.4%, 14.4% and ATE: 4.2%; 95% CI: -0.7%, 9.2% for CCT and SMS compared with SOC, respectively). Among 312 participants with an initial lapse who were randomly assigned again, 69.1% who were randomly assigned to a navigator (n=76/110) returned, 69.5% randomly assigned to CCT+SMS (n=73/105) returned, and 55.7% randomly assigned to SOC-Outreach (n=54/97) returned (ATE: 14.1%; 95% CI: 0.6%, 27.6% and ATE: 11.4%; 95% CI: -2.2%, 24.9% for navigator and CCT+SMS compared with SOC-Outreach, respectively). Among participants without lapse on SMS, continuing SMS did not affect retention (n=122/180; 67.8% retained) versus stopping (n=151/209; 72.2% retained; ATE: -4.4%; 95% CI: -16.6%, 7.9%). Among participants without lapse on CCT, those continuing CCT had higher retention (n=192/230; 83.5% retained) than those stopping (n=173/287; 60.3% retained; ATE: 28.6%; 95% CI: 19.9%, 37.3%). Among 15 sequenced strategies, initial CCT, escalated to navigator if lapse occurred and continued if no lapse occurred, increased time in care (ATE: 7.2%, 95% CI: 3.7%, 10.7%) and viral suppression (ATE: 8.2%, 95% CI: 2.2%, 14.2%), the most compared with SOC throughout. Initial SMS escalated to navigator if lapse occurred, and otherwise continued, showed similar effect sizes compared with SOC throughout.

CONCLUSIONS

Active interventions to prevent retention lapses followed by navigation for those who lapse and maintenance of initial intervention for those without lapse resulted in best overall retention and viral suppression among the strategies studied. Among those who remained in care, discontinuation of CCT, but not SMS, compromised retention and suppression. (Funded by National Institutes of Health grants R01 MH104123, K24 AI134413, and R01 AI074345; ClinicalTrials.gov number, NCT02338739.).

A sequential, multiple assignment randomized trial comparing web-based education to mobile video interpreter access for improving provider interpreter use in primary care clinics: the mVOCAL hybrid type 3 study protocol

BACKGROUND

Individuals who use a language other than English for medical care are at risk for disparities related to healthcare safety, patient-centered care, and quality. Professional interpreter use decreases these disparities but remains underutilized, despite widespread access and legal mandates. In this study, we compare two discrete implementation strategies for improving interpreter use: (1) enhanced education targeting intrapersonal barriers to use delivered in a scalable format (interactive web-based educational modules) and (2) a strategy targeting system barriers to use in which mobile video interpreting is enabled on providers' own mobile devices.

METHODS

We will conduct a type 3 hybrid implementation-effectiveness study in 3-5 primary care organizations, using a sequential multiple assignment randomized trial (SMART) design. Our primary implementation outcome is interpreter use, calculated by matching clinic visits to interpreter invoices. Our secondary effectiveness outcome is patient comprehension, determined by comparing patient-reported to provider-documented visit diagnosis. Enrolled providers (n = 55) will be randomized to mobile video interpreting or educational modules, plus standard interpreter access. After 9 months, providers with high interpreter use will continue as assigned; those with lower use will be randomized to continue as before or add the alternative strategy. After another 9 months, both strategies will be available to enrolled providers for 9 more months. Providers will complete 2 surveys (beginning and end) and 3 in-depth interviews (beginning, middle, and end) to understand barriers to interpreter use, based on the Theoretical Domains Framework. Patients who use a language other than English will be surveyed (n = 648) and interviewed (n = 75) following visits with enrolled providers to understand their experiences with communication. Visits will be video recorded (n = 100) to assess fidelity to assigned strategies. We will explore strategy mechanism activation to refine causal pathway models using a quantitative plus qualitative approach. We will also determine the incremental cost-effectiveness of each implementation strategy from a healthcare organization perspective, using administrative and provider survey data.

DISCUSSION

Determining how these two scalable strategies, alone and in sequence, perform for improving interpreter use, the mechanisms by which they do so, and at what cost, will provide critical insights for addressing a persistent cause of healthcare disparities.

TRIAL REGISTRATION

NCT05591586.

Do specific modules of cognitive behavioral therapy for depression have measurable effects on youth internalizing symptoms? An idiographic analysis

OBJECTIVE

Understanding the efficacy of each module of cognitive behavioral therapy (CBT) may inform efforts to improve outcomes for youth depression, but effects of specific modules have been difficult to examine. Idiographic interrupted time series models offer a robust way to estimate module effects on an individual's symptoms. This study examined the association of specific CBT modules for depression on internalizing symptoms among depressed youths who received modular CBT in a randomized trial.

METHODS

Individual models were created for three youths who met study criteria. Youths completed weekly symptom reports, and clinicians completed records of modules delivered. First order auto-regressive models quantified the change in average internalizing symptom severity between pre- and post-module delivery.

RESULTS

All youths had 1-3 modules that were significantly associated with symptom reduction and 1-3 modules associated with deterioration. The 5 modules associated with improvement in at least one youth also lacked association (engagement, relaxation, cognitive reframing), or were associated with worsening (activity selection, parent psychoeducation) in others. Seven modules showed no measurable benefit, or detriment to any youth.

CONCLUSION

This study demonstrated that specific modules have measurable effects, but more work is needed to build an evidence base of specific module effects to inform treatment personalization for youth depression.

Interim monitoring in sequential multiple assignment randomized trials

A sequential multiple assignment randomized trial (SMART) facilitates the comparison of multiple adaptive treatment strategies (ATSs) simultaneously. Previous studies have established a framework to test the homogeneity of multiple ATSs by a global Wald test through inverse probability weighting. SMARTs are generally lengthier than classical clinical trials due to the sequential nature of treatment randomization in multiple stages. Thus, it would be beneficial to add interim analyses allowing for an early stop if overwhelming efficacy is observed. We introduce group sequential methods to SMARTs to facilitate interim monitoring based on the multivariate chi-square distribution. Simulation studies demonstrate that the proposed interim monitoring in SMART (IM-SMART) maintains the desired type I error and power with reduced expected sample size compared to the classical SMART. Finally, we illustrate our method by reanalyzing a SMART assessing the effects of cognitive behavioral and physical therapies in patients with knee osteoarthritis and comorbid subsyndromal depressive symptoms.

A Methodological Approach for Documenting Multi-Component Interventions Targeting Family Caregivers

Managing the complex care needs of seriously ill patients transitioning from hospital to home can have detrimental effects on family caregivers (FCG). Multi-component interventions tailored to FCG needs are most effective at reducing caregiver burden, distress, and depression. However, gaps exist in determining best methods to assess, document, and analyze intervention components for FCGs. Common methods used to capture patient data during transitions in care may not be appropriate or allowed for FCG needs. As such, we present a methodological approach for electronically capturing, reporting, and analyzing multiple intervention components. This approach uses a standardized terminology and pathway for tailoring intervention components in real time while evaluating intervention effects across time. We use examples from a randomized controlled trial to illustrate the benefits of the current approach for analyzing the effectiveness of multi-component interventions in the context of caregiving research.

Cluster-based psychological phenotyping and differences in anxiety treatment outcomes

The identification of markers of mental health illness treatment response and susceptibility using personalized medicine has been elusive. In the context of psychological treatment for anxiety, we conducted two studies to identify psychological phenotypes with distinct characteristics related to: psychological intervention modalities (mindfulness training/awareness), mechanism of action (worry), and clinical outcome (generalized anxiety disorder scale scores). We also examined whether phenotype membership interacted with treatment response (Study 1) and mental health illness diagnosis (Studies 1-2). Interoceptive awareness, emotional reactivity, worry, and anxiety were assessed at baseline in treatment-seeking individuals (Study 1, n = 63) and from the general population (Study 2, n = 14,010). In Study 1, participants were randomly assigned to an app-delivered mindfulness program for anxiety for two months or treatment as usual. Changes in anxiety were assessed 1 and 2 months post-treatment initiation. In studies 1-2, three phenotypes were identified: 'severely anxious with body/emotional awareness' (cluster 1), 'body/emotionally unaware' (cluster 2), and 'non-reactive and aware' (cluster 3). Study 1's results revealed a significant treatment response relative to controls (ps < 0.001) for clusters 1 and 3, but not for cluster 2. Chi-square analyses revealed that phenotypes exhibited significantly different proportions of participants with mental health diagnoses (studies 1-2). These results suggest that psychological phenotyping can bring the application of personalized medicine into clinical settings.Registry name and URL: Developing a novel digital therapeutic for the treatment of generalized anxiety disorder https://clinicaltrials.gov/ct2/show/NCT03683472?term=judson+brewer&draw=1&rank=1 .Trial registration: Registered at clinicaltrials.gov (NCT03683472) on 25/09/2018.

Familias Unidas Prevents Youth Internalizing Symptoms: a Baseline Target Moderated Mediation (BTMM) Study

Family-based preventive interventions have been found to prevent youth internalizing symptoms, yet they operate through diverse mechanisms with heterogeneous effects for different youth. To better target preventive interventions, this study examines the effects of the Familias Unidas preventive intervention on reducing internalizing symptoms with a universal sample of Hispanic youth in a real-world school setting (i.e., effectiveness trial). The study utilizes emerging methods in baseline target moderated mediation (BTMM) to determine whether the intervention reduces internalizing symptoms through its impact on three distinct mechanisms: family functioning, parent stress, and social support for parents. Data are from a randomized controlled effectiveness trial of 746 Hispanic eighth graders and their parents assessed at baseline, 6-, 18-, and 30-month post-baseline. BTMM models examined three moderated mechanisms through which the intervention might influence 30-month adolescent internalizing symptoms. The intervention decreased youth internalizing symptoms through improvements in family functioning in some models, but there was no evidence of moderation by baseline level of family functioning. There was some evidence of mediation through increasing social support for parents for those intervention parents presenting with lower baseline support. However, there was no evidence of mediation through parent stress. Post hoc analyses suggest a possible cascading of effects where improvements in support for parents strengthened parental monitoring of youth and ultimately reduced youth internalizing symptoms. Findings support the intervention's effects on internalizing symptoms in a universal, real-world setting, and the value of BTMM methods to improve the targeting of preventive interventions. ClinicalTrials.gov Identifier: NCTO1038206, First Posted: December 23, 2009.

Understanding tailoring to support the implementation of evidence-based interventions in healthcare: The CUSTOMISE research programme protocol

Although there are effective evidence-based interventions (EBIs) to prevent, treat and coordinate care for chronic conditions they may not be adopted widely and when adopted, implementation challenges can limit their impact.  Implementation strategies are "methods or techniques used to enhance the adoption, implementation, and sustainment of a clinical program or practice". There is some evidence to suggest that to be more effective,  strategies should be tailored; that is, selected and designed to address specific determinants which may influence implementation in a given context. Despite the growing popularity of tailoring the concept is ill-defined, and the way in which tailoring is applied can vary across studies or lack detail when reported. There has been less focus on the part of tailoring where stakeholders prioritise determinants and select strategies, and the way in which theory, evidence and stakeholders' perspectives should be combined to make decisions during the process. Typically, tailoring is evaluated based on the effectiveness of the tailored strategy, we do not have a clear sense of the mechanisms through which tailoring works, or how to measure the "success" of the tailoring process. We lack an understanding of how stakeholders can be involved effectively in tailoring and the influence of different approaches on the outcome of tailoring. Our research programme, CUSTOMISE (Comparing and Understanding Tailoring Methods for Implementation Strategies in healthcare) will address some of these outstanding questions and generate evidence on  the feasibility, acceptability, and efficiency of different tailoring approaches, and build capacity in implementation science in Ireland, developing and delivering training and supports for, and network of, researchers and implementation practitioners. The evidence generated across the studies conducted as part of CUSTOMISE will bring greater clarity, consistency, coherence, and transparency to tailoring, a key process in implementation science.

A Sequential Multiple Assignment Randomized Trial of scalable interventions for ART delivery in South Africa: the SMART ART study

BACKGROUND

Of the 8 million people in South Africa living with HIV, 74% of persons living with HIV are on antiretroviral therapy (ART) and 65% are virally suppressed. Detectable viral load results in HIV-associated morbidity and mortality and HIV transmission. Patient barriers to care, such as missed wages, transport costs, and long wait times for clinic visits and ART refills, are associated with detectable viral load. HIV differentiated service delivery (DSD) has simplified ART delivery for clients who achieve viral suppression and engage in care. However, DSD needs adaptation to serve clients who are not engaged in care.

METHODS

A Sequential Multiple Assignment Randomized Trial will be undertaken in KwaZulu-Natal, South Africa, to test adaptive ART delivery for persons with detectable viral load and/or who are not engaged in care. The types of differentiated service delivery (DSD) which will be examined in this study are clinic-based incentives, community-based smart lockers, and home delivery. The study plans to enroll up to 900 participants-people living with HIV, eligible for ART, and who are not engaged in care. The study aims to assess the proportion of ART-eligible persons living with HIV who achieve viral suppression at 18 months. The study will also evaluate the preferences of clients and providers for differentiated service delivery and evaluate the cost-effectiveness of adaptive HIV treatment for those who are not engaged in care.

DISCUSSION

To increase population-level viral suppression, persons with detectable viral load need responsive DSD interventions. A Sequential Multiple Assignment Randomized Trial (SMART) design facilitates the evaluation of a stepped, adaptive approach to achieving viral suppression with "right-sized" interventions for patients most in need of effective and efficient HIV care delivery strategies.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05090150. Registered on October 22, 2021.

The Operations Triad Model and Youth Mental Health Assessments: Catalyzing a Paradigm Shift in Measurement Validation

Researchers strategically assess youth mental health by soliciting reports from multiple informants. Typically, these informants (e.g., parents, teachers, youth themselves) vary in the social contexts where they observe youth. Decades of research reveal that the most common data conditions produced with this approach consist of discrepancies across informants' reports (i.e., informant discrepancies). Researchers should arguably treat these informant discrepancies as domain-relevant information: data relevant to understanding youth mental health domains (e.g., anxiety, depression, aggression). Yet, historically, in youth mental health research as in many other research areas, one set of paradigms has guided interpretations of informant discrepancies: Converging Operations and the Multi-Trait Multi-Method Matrix (MTMM). These paradigms (a) emphasize shared or common variance observed in multivariate data, and (b) inspire research practices that treat unique variance (i.e., informant discrepancies) as measurement confounds, namely random error and/or rater biases. Several yearsw ago, the Operations Triad Model emerged to address a conceptual problem that Converging Operations does not address: Some informant discrepancies might reflect measurement confounds, whereas others reflect domain-relevant information. However, addressing this problem requires more than a conceptual paradigm shift beyond Converging Operations. This problem necessitates a paradigm shift in measurement validation. We advance a paradigm (Classifying Observations Necessitates Theory, Epistemology, and Testing [CONTEXT]) that addresses problems with using the MTMM in youth mental health research. CONTEXT optimizes measurement validity by guiding researchers to leverage (a) informants that produce domain-relevant informant discrepancies, (b) analytic procedures that retain domain-relevant informant discrepancies, and (c) study designs that facilitate detecting domain-relevant informant discrepancies.

The Sequential Multiple Assignment Randomized Trial for Controlling Infectious Diseases: A Review of Recent Developments

Infectious diseases have posed severe threats to public health across the world. Effective prevention and control of infectious diseases in the long term requires adapting interventions based on epidemiological evidence. The sequential multiple assignment randomized trial (SMART) is a multistage randomized trial that can provide valid evidence of when and how to adapt interventions for controlling infectious diseases based on evolving epidemiological evidence. We review recent developments in SMARTs to bring wider attention to the potential benefits of employing SMARTs in constructing effective adaptive interventions for controlling infectious diseases and other threats to public health. We discuss 2 example SMARTs for infectious diseases and summarize recent developments in SMARTs from the varied aspects of design, analysis, cost, and ethics. Public health investigators are encouraged to familiarize themselves with the related materials we discuss and collaborate with experts in SMARTs to translate the methodological developments into preeminent public health research. (Am J Public Health. 2023;113(1):49-59. https://doi.org/10.2105/AJPH.2022.307135).

Secondary Analysis to Inform the Development of Adaptive Preventive Interventions

For the past 30 years, scholars across the fields of epidemiology, education, psychology, and numerous other fields have worked to develop interventions designed to reduce risk and enhance protection to prevent mental, emotional, and behavioral problems across the lifespan. This article presents a series of next steps that leverage this foundational science to inform the development of adaptive preventive interventions. Adaptive preventive interventions (APIs) tailor the intervention to fit the diverse, sometimes changing, needs of participants with the goal of better prevention outcomes for more individuals. Secondary analyses of data from preventive intervention trials to identify moderators, mediators, and antecedents of attrition and intervention failure can be useful for designing effective APIs. Moderators that identify intervention effect heterogeneity can be used within an API to tailor the intervention to meet the unique needs of important participant subgroups. Mediators and predictors of disengagement and attrition can be helpful tailoring variables in an API to trigger change to the intervention. Preventive intervention trials that incorporate frequent assessment of potential mediators, moderators, and antecedents of attrition during the intervention period are needed. Secondary analyses of data from preventive intervention trials provide an important foundation for next-generation APIs.

Conceptual tensions and practical trade-offs in tailoring implementation interventions

Tailored interventions have been shown to be effective and tailoring is a popular process with intuitive appeal for researchers and practitioners. However, the concept and process are ill-defined in implementation science. Descriptions of how tailoring has been applied in practice are often absent or insufficient in detail. This lack of transparency makes it difficult to synthesize and replicate efforts. It also hides the trade-offs for researchers and practitioners that are inherent in the process. In this article we juxtapose the growing prominence of tailoring with four key questions surrounding the process. Specifically, we ask: (1) what constitutes tailoring and when does it begin and end?; (2) how is it expected to work?; (3) who and what does the tailoring process involve?; and (4) how should tailoring be evaluated? We discuss these questions as a call to action for better reporting and further research to bring clarity, consistency, and coherence to tailoring, a key process in implementation science.

Treatment Effect Heterogeneity

This paper considers recent methodological developments in the treatment effects literature, describes their value for applied evaluation work, and suggests next steps. It pays particular attention to documenting the presence of treatment effect heterogeneity, to the quest to attach treatment effect heterogeneity to particular subgroups and other moderators, and to the recent application of machine learning methods in this domain.

Stepped implementation-to-target: a study protocol of an adaptive trial to expand access to addiction medications

Background

In response to the US opioid epidemic, significant national campaigns have been launched to expand access to `opioid use disorder (MOUD). While adoption has increased in general medical care settings, specialty addiction programs have lagged in both reach and adoption. Elevating the quality of implementation strategy, research requires more precise methods in tailoring strategies rather than a one-size-fits-all-approach, documenting participant engagement and fidelity to the delivery of the strategy, and conducting an economic analysis to inform decision making and policy. Research has yet to incorporate all three of these recommendations to address the challenges of implementing and sustaining MOUD in specialty addiction programs.

Methods

This project seeks to recruit 72 specialty addiction programs in partnership with the Washington State Health Care Authority and employs a measurement-based stepped implementation-to-target approach within an adaptive trial design. Programs will be exposed to a sequence of implementation strategies of increasing intensity and cost: (1) enhanced monitoring and feedback (EMF), (2) 2-day workshop, and then, if outcome targets are not achieved, randomization to either internal facilitation or external facilitation. The study has three aims: (1) evaluate the sequential impact of implementation strategies on target outcomes, (2) examine contextual moderators and mediators of outcomes in response to the strategies, and (3) document and model costs per implementation strategy. Target outcomes are organized by the RE-AIM framework and the Addiction Care Cascade.

Discussion

This implementation project includes elements of a sequential multiple assignment randomized trial (SMART) design and a criterion-based design. An innovative and efficient approach, participating programs only receive the implementation strategies they need to achieve target outcomes. Findings have the potential to inform implementation research and provide key decision-makers with evidence on how to address the opioid epidemic at a systems level.

Trial registration

This trial was registered at ClinicalTrials.gov (NCT05343793) on April 25, 2022.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01239-y.

Monitor to innovate with feedback loops: process evaluation protocol for an anemia prevention intervention

Background: Digital process monitoring and evaluation tools designed to capture near-to-real-time intervention data paired with feedback loops have the potential to innovate intervention delivery.

Objective: To describe how a multilevel social norms field trial (RANI) is using feedback loops to enhance intervention delivery.

Methods: We use a mixed-methods process evaluation design to monitor the Reduction of Anemia through Normative Innovations (RANI) project; a three-year randomized control trial which aims to lower rates of anemia among women in Odisha, India. Surveys and structured observation monitor fidelity to implementation and acceptability of implementation activities among study participants. Quantitative data evaluates implementation dose, coverage, exposure, and reach of intervention activities, and qualitative data will delve more deeply into reasons for high or low functioning. Iron folic acid supplement supply and demand are also monitored for stock-outs. Data collected from 130 intervention villages is processed, visualized, and triangulated in near to real-time via Real-time Monitoring for Knowledge Generation (RPM4K), a locally developed software application. Data visualization products facilitate the examination of monitoring data to mitigate bottlenecks and identify and implement tweaks to our intervention delivery strategy on an ongoing basis.

Discussion: Feedback loops facilitate timely course corrections. Feedback loops can also engender a shared understanding of ground realities for a geographically dispersed and culturally diverse team. Leveraging feedback loops, we identify opportunities to provide on-going supportive supervision for our community facilitators promoting joint problem-solving, and communication. Monthly media and hemoglobin level demonstration strategies are informed by participant engagement and acceptability. Stock-outs of iron folic acid tablets activate contingency plans to mobilize local stakeholders and advocate for timely resolutions. Unintended effects are monitored based on ongoing feedback from community facilitators.

Conclusions: Documenting our processes can inform the future implementation or scale up of similar projects embracing feedback loops to iterate and innovate their intervention delivery.

Feasibility of a Platform Trial Design for the Development of Mobile Health Applications: A Review

Background: A novel adaptive trial design called platform trials (PTs) may offer an effective, efficient, and unbiased approach to evaluate different developer versions of mobile health (m-health) apps. However, the feasibility of their use for this purpose is yet to be explored. Objective: This literature review aims to explore the reported challenges associated with the adaptive PT design to assess its feasibility for the development of m-health apps. Methods: A descriptive literature review using two databases (MEDLINE and Embase) was conducted. Documents published in English between 1947 and September 20, 2020, were eligible for inclusion. Results: The titles and abstracts of 758 records were screened after which 179 full-text articles were assessed for eligibility. A total of 41 articles were included in the synthesis, all published after the year 2000. The synthesis yielded eight distinct categories of challenging issues with PTs relevant to their application in m-health app development, along with potential solutions. These categories are ethical issues (e.g., related to informed consent, equipoise, justice) (with 19 articles contributing content), biases (7 articles), temporal drift (4 articles), miscellaneous statistical issues (3 articles), logistical issues (e.g., cost and human resources, frequent amendments; 6 articles), sample size and power conflict (2 articles), generalizability of the results (2 articles), and operational challenges (1 article). Conclusion: Although PT designs are relatively new, they have promising feasibility for the seamless evaluation of interventions that undergo continuous development, including m-health apps; however, various challenges may hinder their successful implementation.

A randomized controlled trial of social media interventions for risky drinking among adolescents and emerging adults

PURPOSE

Alcohol use among adolescents and emerging adults is an important public health issue requiring prevention approaches. Herein, we describe outcomes from a randomized controlled trial testing the efficacy of group-based social media interventions targeting risky drinking among youth.

PROCEDURES

Using social media advertisements to screen potential participants, we recruited 955 youth (ages 16-24) reporting recent risky drinking. After completing a baseline assessment, participants were randomized to 8-week secret Facebook group conditions: Social Media Intervention + Incentives for engagement, Social Media Intervention only, and attention-placebo control. Electronic coaches trained in motivational interviewing facilitated interaction in intervention groups. Primary outcomes include past 3-month alcohol use and consequences over 3-, 6-, and 12-month follow-ups. Secondary outcomes include other drug use, consequences, and impaired driving. We also measured intervention engagement and acceptability.

RESULTS

The interventions were well-received, with significantly greater acceptability ratings and engagement in the SMI+I condition relative to other groups. In adjusted analyses, there were no significant differences between interventions and control on alcohol-related outcomes, with all groups showing reductions. Regarding secondary outcomes (70.4% used other drugs), compared to control, the incentivized group reduced other drug use, consequences, and cannabis-impaired driving; the non-incentivized group did not significantly differ from the control condition.

CONCLUSIONS

Among this predominantly poly-substance using sample, findings were mixed, with significant effects of the incentivized social media intervention on drug (but not alcohol) outcomes. Future studies are needed to further refine social media-delivered interventions to reduce alcohol and other drug use.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02809586; University of Michigan HUM#00102242.