A "SMART" design for building individualized treatment sequences

A randomized controlled trial of social media interventions for risky drinking among adolescents and emerging adults

PURPOSE

Alcohol use among adolescents and emerging adults is an important public health issue requiring prevention approaches. Herein, we describe outcomes from a randomized controlled trial testing the efficacy of group-based social media interventions targeting risky drinking among youth.

PROCEDURES

Using social media advertisements to screen potential participants, we recruited 955 youth (ages 16-24) reporting recent risky drinking. After completing a baseline assessment, participants were randomized to 8-week secret Facebook group conditions: Social Media Intervention + Incentives for engagement, Social Media Intervention only, and attention-placebo control. Electronic coaches trained in motivational interviewing facilitated interaction in intervention groups. Primary outcomes include past 3-month alcohol use and consequences over 3-, 6-, and 12-month follow-ups. Secondary outcomes include other drug use, consequences, and impaired driving. We also measured intervention engagement and acceptability.

RESULTS

The interventions were well-received, with significantly greater acceptability ratings and engagement in the SMI+I condition relative to other groups. In adjusted analyses, there were no significant differences between interventions and control on alcohol-related outcomes, with all groups showing reductions. Regarding secondary outcomes (70.4% used other drugs), compared to control, the incentivized group reduced other drug use, consequences, and cannabis-impaired driving; the non-incentivized group did not significantly differ from the control condition.

CONCLUSIONS

Among this predominantly poly-substance using sample, findings were mixed, with significant effects of the incentivized social media intervention on drug (but not alcohol) outcomes. Future studies are needed to further refine social media-delivered interventions to reduce alcohol and other drug use.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02809586; University of Michigan HUM#00102242.

Deep reinforcement learning for personalized treatment recommendation

In precision medicine, the ultimate goal is to recommend the most effective treatment to an individual patient based on patient-specific molecular and clinical profiles, possibly high-dimensional. To advance cancer treatment, large-scale screenings of cancer cell lines against chemical compounds have been performed to help better understand the relationship between genomic features and drug response; existing machine learning approaches use exclusively supervised learning, including penalized regression and recommender systems. However, it would be more efficient to apply reinforcement learning to sequentially learn as data accrue, including selecting the most promising therapy for a patient given individual molecular and clinical features and then collecting and learning from the corresponding data. In this article, we propose a novel personalized ranking system called Proximal Policy Optimization Ranking (PPORank), which ranks the drugs based on their predicted effects per cell line (or patient) in the framework of deep reinforcement learning (DRL). Modeled as a Markov decision process, the proposed method learns to recommend the most suitable drugs sequentially and continuously over time. As a proof-of-concept, we conduct experiments on two large-scale cancer cell line data sets in addition to simulated data. The results demonstrate that the proposed DRL-based PPORank outperforms the state-of-the-art competitors based on supervised learning. Taken together, we conclude that novel methods in the framework of DRL have great potential for precision medicine and should be further studied.

The optimal dynamic treatment rule superlearner: considerations, performance, and application to criminal justice interventions

The optimal dynamic treatment rule (ODTR) framework offers an approach for understanding which kinds of patients respond best to specific treatments - in other words, treatment effect heterogeneity. Recently, there has been a proliferation of methods for estimating the ODTR. One such method is an extension of the SuperLearner algorithm - an ensemble method to optimally combine candidate algorithms extensively used in prediction problems - to ODTRs. Following the ``causal roadmap," we causally and statistically define the ODTR and provide an introduction to estimating it using the ODTR SuperLearner. Additionally, we highlight practical choices when implementing the algorithm, including choice of candidate algorithms, metalearners to combine the candidates, and risk functions to select the best combination of algorithms. Using simulations, we illustrate how estimating the ODTR using this SuperLearner approach can uncover treatment effect heterogeneity more effectively than traditional approaches based on fitting a parametric regression of the outcome on the treatment, covariates and treatment-covariate interactions. We investigate the implications of choices in implementing an ODTR SuperLearner at various sample sizes. Our results show the advantages of: (1) including a combination of both flexible machine learning algorithms and simple parametric estimators in the library of candidate algorithms; (2) using an ensemble metalearner to combine candidates rather than selecting only the best-performing candidate; (3) using the mean outcome under the rule as a risk function. Finally, we apply the ODTR SuperLearner to the ``Interventions" study, an ongoing randomized controlled trial, to identify which justice-involved adults with mental illness benefit most from cognitive behavioral therapy to reduce criminal re-offending.

Linking organizational climate for evidence-based practice implementation to observed clinician behavior in patient encounters: a lagged analysis

Background

Theory and empirical research suggest organizational climate for evidence-based practice (EBP) implementation may be an important and malleable target to improve clinician use of EBPs in healthcare; however, this work has been criticized for overreliance on self-report measures of implementation outcomes and cross-sectional designs. This study combines data from two studies spanning 7 years to test the hypothesis that higher levels of organizational EBP implementation climate prospectively predicts improved clinician adherence to an EBP, cognitive behavioral therapy (CBT), as rated by expert observers.

Methods

Biennial assessments of EBP implementation climate collected in 10 community mental health agencies in Philadelphia as part of a systemwide evaluation (time 1) were linked to subsequent observer ratings of clinician adherence to CBT in clinical encounters with 108 youth (time 2). Experts rated clinician adherence to CBT using the Therapy Process Observation Coding System which generated two primary outcomes (a) maximum CBT adherence per session (i.e., highest rated CBT intervention per session; depth of delivery) and (b) average CBT adherence per session (i.e., mean rating across all CBT interventions used; depth and breadth of delivery).

Results

On average, time 2 clinician adherence observations occurred 19.8 months (SD = 10.15) after time 1 organizational climate assessments. Adjusting for organization, clinician, and client covariates, a one standard deviation increase in organizational EBP implementation climate at time 1 predicted a 0.63-point increase in clinicians’ maximum CBT adherence per session at time 2 (p = 0.000), representing a large effect size (d = 0.93; 95% CI = 0.63–1.24) when comparing organizations in the upper (k = 3) versus lower tertiles (k = 3) of EBP implementation climate. Higher levels of time 1 organizational EBP implementation climate also predicted higher time 2 average CBT adherence per session (b = 0.23, p < 0.001, d = 0.72). Length of time between assessments of climate and adherence did not moderate these relationships.

Conclusions

Organizational EBP implementation climate is a promising predictor of clinicians’ subsequent observed adherence to CBT. Implementation strategies that target this antecedent may improve the delivery of EBPs in healthcare settings.

Estimators for the value of the optimal dynamic treatment rule with application to criminal justice interventions

Given an (optimal) dynamic treatment rule, it may be of interest to evaluate that rule - that is, to ask the causal question: what is the expected outcome had every subject received treatment according to that rule? In this paper, we study the performance of estimators that approximate the true value of: (1) an a priori known dynamic treatment rule (2) the true, unknown optimal dynamic treatment rule (ODTR); (3) an estimated ODTR, a so-called "data-adaptive parameter," whose true value depends on the sample. Using simulations of point-treatment data, we specifically investigate: (1) the impact of increasingly data-adaptive estimation of nuisance parameters and/or of the ODTR on performance; (2) the potential for improved efficiency and bias reduction through the use of semiparametric efficient estimators; and, (3) the importance of sample splitting based on the cross-validated targeted maximum likelihood estimator (CV-TMLE) for accurate inference. In the simulations considered, there was very little cost and many benefits to using CV-TMLE to estimate the value of the true and estimated ODTR; importantly, and in contrast to non cross-validated estimators, the performance of CV-TMLE was maintained even when highly data-adaptive algorithms were used to estimate both nuisance parameters and the ODTR. In addition, we apply these estimators for the value of the rule to the "Interventions" study, an ongoing randomized controlled trial, to identify whether assigning cognitive behavioral therapy (CBT) to criminal justice-involved adults with mental illness using an ODTR significantly reduces the probability of recidivism, compared to assigning CBT in a non-individualized way.

Leveraging technology to personalize cognitive enhancement methods in aging

As population aging advances at an increasing rate, efforts to help people maintain or improve cognitive function late in life are critical. Although some studies have shown promise, the question of whether cognitive training is an effective tool for improving general cognitive ability remains incompletely explored, and study results to date have been inconsistent. Most approaches to cognitive enhancement in older adults have taken a 'one size fits all' tack, as opposed to tailoring interventions to the specific needs of individuals. In this Perspective, we argue that modern technology has the potential to enable large-scale trials of public health interventions to enhance cognition in older adults in a personalized manner. Technology-based cognitive interventions that rely on closed-loop systems can be tailored to individuals in real time and have the potential for global testing, extending their reach to large and diverse populations of older adults. We propose that the future of cognitive enhancement in older adults will rely on harnessing new technologies in scientifically informed ways.

The Relationship Between Harmful Alcohol Use and Antiretroviral Non-adherence in People Accessing HIV Treatment in Cape Town, South Africa: An Event-Level Analysis

Harmful alcohol consumption can significantly compromise adherence to antiretroviral therapy (ART). Prior research has identified aggregate relationships between alcohol use and ART non-adherence, largely relying on concurrent assessment of these domains. There is relatively limited evidence on more nuanced day-level associations between alcohol use and ART non-adherence, despite potentially important clinical implications. We recruited adults with HIV treatment adherence challenges and harmful alcohol use (n = 53) from HIV care in South Africa. We examined relationships between alcohol use and same and next day ART adherence, accounting for the role of weekends/holidays and participant demographics, including gender. Results demonstrated that ART adherence was significantly worse on weekend/holiday days. Next day adherence was significantly worse in the context of weekend alcohol use and among men. These results suggest the importance of tailoring intervention strategies to support ART adherence during weekend drinking and for men engaged in heavy episodic drinking.

Adaptive web-based stress management programs among adults with a cardiovascular disease: A pilot Sequential Multiple Assignment Randomized Trial (SMART)

OBJECTIVE

To assess the feasibility and acceptability of using a Sequential Multiple Assignment Randomized Trial (SMART) to optimize the delivery of a web-based, stress management intervention for patients with a cardiovascular disease (CVD).

METHODS

59 patients with a CVD and moderate stress were randomized to a self-directed web-based stress management program (n = 30) or the same intervention plus lay telephone coaching (n = 29). After 6 weeks, non-responders were re-randomized to continue with their initial intervention or switched to motivational interviewing (MI). Feasibility, acceptability, and clinical significance were assessed.

RESULTS

SMART procedures were feasible. Attrition rates were almost twice as high in the web-only group than the lay coach group. This might be because of the low satisfaction (47%) in the web-only group. On average, 1.7/5 modules were completed. Effect sizes for stress and quality of life generally exceeded 0.2 (clinical benchmark), except for the group that initially received lay coaching and then switched to MI.

CONCLUSIONS

Results suggest that a larger trial would be feasible. Issues pertaining to attrition and satisfaction for non-responders need to be addressed.

PRACTICE IMPLICATIONS

Findings contribute to the evidence on how best to develop and deliver e-Health interventions to maximize their efficacy while remaining cost-effective.

Minimax designs for causal effects in temporal experiments with treatment habituation

In many modern settings, such as an online marketplace, randomized experiments need to be executed over multiple time periods. In such temporal experiments, it has been observed that the effects of an intervention on an experimental unit may be large when the unit is first exposed to it, but then it attenuates after repeated exposures. This is typically due to units’ habituation to the intervention, or some other form of learning, such as when users gradually start to ignore repeated mails sent by a promotional campaign. This paper proposes randomized designs for estimating causal effects in temporal experiments when habituation is present. We show that our designs are minimax optimal in a large class of practical designs. Our analysis is based on the randomization framework of causal inference, and imposes no parametric modelling assumptions on the outcomes.

Adaptive HIV pre-exposure prophylaxis adherence interventions for young South African women: Study protocol for a sequential multiple assignment randomized trial

INTRODUCTION

Pre-exposure prophylaxis (PrEP) is a highly effective HIV prevention strategy and is recommended for populations at risk of HIV, including adolescent girls and young women (AGYW) in HIV endemic settings. However, PrEP continuation and high adherence remain challenges to its impact. Existing PrEP adherence interventions can be time- and cost-intensive. Widescale PrEP delivery will require the identification of layered PrEP support strategies for AGYW with diverse prevention needs. We describe the design of a sequential multiple assignment randomized trial (SMART) to evaluate a PrEP adherence support model using scalable, stepped interventions in AGYW in South Africa.

METHODS

"PrEP SMART" is a randomized trial in Johannesburg, South Africa, enrolling AGYW who are between 18 and 25 years of age, sexually active, newly initiating PrEP, and have regular access to a mobile phone. Participants are randomized 1:1 to standard-of-care PrEP counseling with either two-way SMS or WhatsApp group adherence support. Adherence is assessed at three months using tenofovir diphosphate (TFV-DP) levels from dried blood spots collected at month 2 to categorize participants as "responders" (TFV-DP ≥500 fmol/punch) or "non-responders" (TFV-DP <500 fmol/punch). AGYW defined as 'non-responders' undergo a secondary 1:1 randomization to either quarterly drug-level feedback counseling or monthly issue-focused counseling, in addition to their first-level intervention. The primary outcome is PrEP adherence at nine months (TFV-DP ≥700 fmol/punch). We will assess the effect of our two initial interventions on TFV-DP levels among responders, assess the effect of our intensified interventions on TFV-DP levels among non-responders, and identify the optimal sequence of adherence interventions through nine months.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT04038060. Registered on 30 July 2019.

Investigating strategies to increase general education teachers' adherence to evidence-based social-emotional behavior practices: A meta-analysis of the single-case literature

Educational researchers have produced a variety of evidence-based practices (EBP) to address social, emotional, and behavioral (SEB) needs among students. Yet, these practices are often insufficiently adopted and implemented with fidelity by teachers to produce the beneficial outcomes associated with the EBP, leaving students at risk for developing SEB problems. If ignored, SEB problems can lead to other negative outcomes, such as academic failure. Therefore, implementation strategies (i.e., methods and procedures designed to promote implementation outcomes) are needed to improve teachers' uptake and delivery of EBPs with fidelity. This meta-analysis sought to examine the types and magnitude of effect of implementation strategies that have been designed and tested to improve teacher adherence to SEB EBPs. Included studies (a) used single case experimental designs, (b) employed at least one implementation strategy, (c) targeted general education teachers, and (d) evaluated adherence as a core dimension of fidelity related to the delivery of EBPs. In total, this study included 28 articles and evaluated 122 effect sizes. A total of 15 unique implementation strategies were categorized. Results indicated that, on average, implementation strategies were associated with increases in teacher adherence to EBPs above baseline and group-based pre-implementation trainings alone (g = 2.32, tau = 0.77). Moderator analysis also indicated that larger effects were associated with implementation strategies that used a greater number of unique behavior change techniques (p < .001). Implications and future directions for research and practice regarding use of implementation strategies for general education teachers are discussed.

Do Integrated Hub Models of Care Improve Mental Health Outcomes for Children Experiencing Adversity? A Systematic Review

This review assesses the effectiveness of integrated primary health and social care hubs on mental health outcomes for children experiencing adversity and describes common integration dimensions of effective hubs.

PubMed, OVID Medline and PyschINFO databases were systematically searched for relevant articles between 2006–2020 that met the inclusion criteria: (i) interventional studies, (ii) an integrated approach to mental health within a primary health care setting, (iii) validated measures of child mental health outcomes, and (iv) in English language.

Of 5961 retrieved references, four studies involving children aged 0–12 years experiencing one or more adversities were included. Most children were male (mean: 60.5%), and Hispanic or African American (82.5%).

Three studies with low-moderate risk of bias reported improvements in mental health outcomes for children experiencing adversity receiving integrated care. The only RCT in this review did not show significant improvements.

The most common dimensions of effective integrated hubs based on the Rainbow Model of Integrated Care were clinical integration (including case management, patient-centred care, patient education, and continuity of care), professional integration, and organisational integration including co-location.

These results suggest hubs incorporating effective integration dimensions could improve mental health outcomes for children experiencing adversity; however, further robust studies are required.

Registered with Prospero: CRD42020206015.

The Role of Physiotherapy in the Management of Functional Neurological Disorder in Children and Adolescents

Children and adolescents with functional neurological (conversion) disorder (FND) present with symptoms of impaired motor and sensory function. FND involves complex interactions between the brain, mind, body, and lived experience of the child. The gold standard for treatment is therefore a holistic, biopsychosocial approach with multimodal interventions delivered by a multidisciplinary team. In this narrative review we examine the role of physiotherapy in managing FND in children. We searched Embase, Medline, PsycINFO, and PubMed (back to 2000) for relevant physiotherapy articles and also manually searched their reference lists. Two review articles and ten observational studies were identified. Data were extracted concerning the type of study, therapies involved, outcome measures, and comorbid mental health outcomes. FND symptoms resolved in 85% to 95% of the patients, and about two-thirds returned to full-time school after completing the multidisciplinary intervention. Ongoing mental health concerns at follow-up were associated with poorer functional outcomes. Key themes included the following: use of psychological interventions embedded in the physiotherapy intervention; integration of play, music, and dance; role of physical exercise in modulating physiological, neural, and endocrine systems; need for FND-specific outcome measures; ethical issues pertaining to randomized trials; and need to develop alternate study methodologies for assessing combined treatments. Clinical vignettes were included to highlight a range of physiotherapy interventions. In conclusion, the emerging literature suggests that physiotherapy for children with FND is a useful intervention for improving motor dysfunction and for addressing other concurrent issues such as physical deconditioning, neuroprotection, chronic pain, disturbed sleep, anxiety and depression, and resilience building.

Treatment Approaches for Functional Neurological Disorders in Children

Purpose of Review

Functional neurological disorder (FND) is a multi-network brain disorder that encompasses a broad range of neurological symptoms. FND is common in pediatric practice. It places substantial strains on children, families, and health care systems. Treatment begins at assessment, which requires the following: the medical task of making the diagnosis, the interpersonal task of engaging the child and family so that they feel heard and respected, the communication task of communicating and explaining the diagnosis, and the logistical task of organizing treatment.

Recent Findings

Over the past decade, three treatment approaches—Retraining and Control Therapy (ReACT), other cognitive-behavioral therapies, and multidisciplinary rehabilitation—have been evaluated in the USA, Canada, and Australia. Of children treated in such programs, 63 − 95% showed full resolution of FND symptoms. The common thread across the programs is their biopsychosocial approach—consideration of biological, psychological, relational, and school-related factors that contribute to the child’s clinical presentation.

Summary

Current research strongly supports a biopsychosocial approach to pediatric FND and provides a foundation for a stepped approach to treatment. Stepped care is initially tailored to the needs of the individual child (and family) based on the pattern and severity of FND presentation. The level of care and type of intervention may then be adjusted to consider the child’s response, over time, to treatment or treatment combinations. Future research is needed to confirm effective treatment targets, to inform the development of stepped care, and to improve methodologies that can assess the efficacy of stepped-care interventions.

Monitor to innovate with feedback loops: process evaluation protocol for an anemia prevention intervention

Background: With the proliferation of the digital age, information and communication technologies paired with feedback loops have the potential to innovate process evaluations. Objective: To describe how a multilevel social norms field trial (RANI) is using feedback loops to enhance intervention delivery. Methods: We use a mixed-methods process evaluation design to monitor the Reduction of Anemia through Normative Innovations (RANI) project; a three-year randomized control trial which aims to lower rates of anemia among women in Odisha, India. Surveys and structured observation monitor fidelity to implementation and receptivity to implementation activities among study participants. Quantitative data evaluates implementation dose, coverage, exposure, and reach of intervention activities, and qualitative data will delve more deeply into reasons for high or low functioning. Iron folic acid supplement supply and demand are also monitored for stock-outs. Data collected from 130 intervention villages is processed, visualized, and triangulated in near to real-time via Real-time Monitoring for Knowledge Generation (RPM4K), a locally developed software application. Data visualization products facilitate the examination of monitoring data to mitigate bottlenecks and identify and implement tweaks to our intervention delivery strategy on an ongoing basis. Discussion: Feedback loops facilitate timely course corrections. Feedback loops can also engender a shared understanding of ground realities for a geographically dispersed and culturally diverse team. Leveraging feedback loops, we identify opportunities to provide on-going supportive supervision for our community facilitators promoting joint problem-solving, and communication. Monthly media and hemoglobin level demonstration strategies are informed by participant engagement and receptivity. Stock-outs of iron folic acid tablets activate contingency plans to mobilize local stakeholders and advocate for timely resolutions. Unintended effects are monitored based on ongoing feedback from community facilitators. Conclusions: Documenting our processes can inform the future implementation or scale up of similar projects embracing feedback loops to iterate and innovate their intervention delivery.

Advances in clinical trials methodology: Intervention optimization approaches in emergency medicine

The classical two-arm randomized clinical trial (RCT) is designed to test the efficacy or effectiveness of an intervention, which may consist of one or more components. However, this approach does not enable the investigator to obtain information that is important in intervention development, such as which individual components of the intervention are efficacious, which are not and possibly should be removed, and whether any components interact. The Multiphase Optimization Strategy (MOST) is a new framework for development, optimization, and evaluation of interventions. MOST includes the RCT for purposes of evaluation, but inserts a phase of research before the RCT aimed at intervention optimization. The optimization phase requires one or more separate trials similar in scope to an RCT, but employing a different experimental design. The design of the optimization trial is selected strategically so as to maximize the amount of scientific information gained using the available resources. One consideration in selecting this experimental design is the type of intervention to be optimized. If a fixed intervention, i.e. one in which the same intervention content and intensity is provided to all participants, is to be optimized, a factorial experiment is often appropriate. If an adaptive intervention, i.e. one in which intervention content or intensity is varied in a principled manner, is to be optimized, a sequential multiple-assignment randomized trial (SMART) is often a good choice. The objective of this article is to describe MOST and the scientific rationale for its use; describe two current applications of MOST in emergency medicine research, one using a factorial experiment and the other using a SMART; and discuss funding strategies and potential future applications in studying the care of individuals with acute illness, injury, or behavioral disorders.

A Randomization Permutation Test for Single Subject Mediation

In response to the importance of individual-level effects, the purpose of this paper is to describe the new randomization permutation (RP) test for a mediation mechanism for a single subject. We extend seminal work on permutation tests for individual-level data by proposing a test for mediation for one person. The method requires random assignment to the levels of the treatment variable at each measurement occasion, and repeated measures of the mediator and outcome from one subject. If several assumptions are met, the process by which a treatment changes an outcome can be statistically evaluated for a single subject, using the permutation mediation test method and the permutation confidence interval method for residuals. A simulation study evaluated the statistical properties of the new method suggesting that at least eight repeated measures are needed to control Type I error rates and larger sample sizes are needed for power approaching .8 even for large effects. The RP mediation test is a promising method for elucidating intraindividual processes of change that may inform personalized medicine and tailoring of process-based treatments for one subject.

Treatment of Psychiatric Problems After Traumatic Brain Injury

Psychiatric sequelae of traumatic brain injury (TBI) can cause significant and often chronic impairment in functioning and quality of life; however, their phenomenological and mechanistic complexities continue to present significant treatment challenges. The clinical presentation is often an amalgam of syndromes and co-occurring symptoms that require a highly nuanced and systematic approach to treatment. Although few randomized controlled trials have tested treatments for psychiatric problems after TBI and the synthesis of results continues to be compromised by the heterogeneity of study populations, small samples, and differing inclusion criteria and outcome measures, an increasing body of literature supports evidence-based treatment strategies. We provide a narrative review of pharmacological, psychoeducational/behavioral, and neuromodulation treatments for psychiatric conditions in adults with TBI and discuss known or postulated mechanisms of action for these treatment approaches. Where data are available, we focus on randomized controlled trials and large case series in which a psychiatric condition provides both a selection criterion and a primary or secondary outcome. We conclude by proposing directions for future research, particularly the need for novel neuropharmacological, behavioral, and neurophysiological studies and pragmatic trials of multicomponent and adaptive models that will increase understanding of the mechanisms underlying post-TBI psychiatric disorders and accelerate dissemination and implementation of effective person-centered care.

Individualized treatment rules under stochastic treatment cost constraints

Estimation and evaluation of individualized treatment rules have been studied extensively, but real-world treatment resource constraints have received limited attention in existing methods. We investigate a setting in which treatment is intervened upon based on covariates to optimize the mean counterfactual outcome under treatment cost constraints when the treatment cost is random. In a particularly interesting special case, an instrumental variable corresponding to encouragement to treatment is intervened upon with constraints on the proportion receiving treatment. For such settings, we first develop a method to estimate optimal individualized treatment rules. We further construct an asymptotically efficient plug-in estimator of the corresponding average treatment effect relative to a given reference rule.

Future Challenges in Psychotherapy Research for Personality Disorders

PURPOSE OF REVIEW

Individuals with personality disorders are frequently seen in mental health settings. Their symptoms typically reflect a high level of suffering and burden of disease, with potentially harmful societal consequences, including costs related to absenteeism at work, high use of health services, ineffective or harmful parenting, substance use, suicidal and non-suicidal self-harming behavior, and aggressiveness with legal consequences. Psychotherapy is currently the first-line treatment for patients with personality disorders, but the study of psychotherapy in the domain of personality disorders faces specific challenges.

RECENT FINDINGS

Challenges include knowing what works for whom, identifying which putative mechanisms of change explain therapeutic effects, and including the social interaction context of patients with a personality disorder. By following a dimensional approach, psychotherapy research on personality disorders may serve as a model for the development and study of innovative psychotherapeutic interventions. We recommend developing the following: (a) an evidence base to make treatment decisions based on individual features; (b) a data-driven approach to predictors, moderators, and mechanisms of change in psychotherapy; (c) methods for studying the interaction between social context and psychotherapy.

Towards adaptive technology in routine mental health care

This paper summarizes the information technology-related research findings after 5 years with the INTROducing Mental health through Adaptive Technology project. The aim was to improve mental healthcare by introducing new technologies for adaptive interventions in mental healthcare through interdisciplinary research and development. We focus on the challenges related to internet-delivered psychological treatments, emphasising artificial intelligence, human-computer interaction, and software engineering. We present the main research findings, the developed artefacts, and lessons learned from the project before outlining directions for future research. The main findings from this project are encapsulated in a reference architecture that is used for establishing an infrastructure for adaptive internet-delivered psychological treatment systems in clinical contexts. The infrastructure is developed by introducing an interdisciplinary design and development process inspired by domain-driven design, user-centred design, and the person based approach for intervention design. The process aligns the software development with the intervention design and illustrates their mutual dependencies. Finally, we present software artefacts produced within the project and discuss how they are related to the proposed reference architecture. Our results indicate that the proposed development process, the reference architecture and the produced software can be practical means of designing adaptive mental health care treatments in correspondence with the patients’ needs and preferences. In summary, we have created the initial version of an information technology infrastructure to support the development and deployment of Internet-delivered mental health interventions with inherent support for data sharing, data analysis, reusability of treatment content, and adaptation of intervention based on user needs and preferences.

National Institutes of Health Pathways to Prevention Workshop: Physical Activity and Health for Wheelchair Users

Health benefits of physical activity are well recognized in the general population for reducing the risk of chronic health conditions. Less is known about the effects of physical activity on people currently using or who may use wheeled mobility devices in the future, specifically individuals with multiple sclerosis, cerebral palsy, and spinal cord injury who are at increased likelihood for use of a wheeled mobility device. On December 1-3, 2020, the National Institutes of Health convened the Pathways to Prevention workshop: "Can Physical Activity Improve the Health of Wheelchair Users?" to consider the available scientific evidence on the clinical benefits and harms of physical activity for people currently using or who may use wheeled mobility devices in the future, with the aim of developing recommendations to fill gaps in the evidence base. A multidisciplinary team of content area experts developed the agenda and an evidence-based practice center prepared the evidence report. An independent panel, selected by the National Institutes of Health, attended the workshop; convened to develop recommendations on the basis of the systematic review, presentations, and public comments received during the workshop; and revised recommendations based on public comments received. This final report summarizes the panel's findings and identifies current gaps in knowledge. The panel made recommendations for new research efforts, including novel methods and new research infrastructure to improve the evidence base about the effects of physical activity on people currently using or who may use wheeled mobility devices in the future.

Sequential multiple assignment randomised trial of a brief contact intervention for suicide risk management among discharged psychiatric patients: an implementation study protocol

INTRODUCTION

The postdischarge suicide risk among psychiatric patients is significantly higher than it is among patients with other diseases and general population. The brief contact interventions (BCIs) are recommended to decrease suicide risk in areas with limited mental health service resources like China. This study aims to develop a postdischarge suicide intervention strategy based on BCIs and evaluate its implementability under the implementation outcome framework.

METHODS AND ANALYSIS

This study will invite psychiatric patients and family members, clinical and community mental health service providers as the community team to develop a postdischarge suicide intervention strategy. The study will recruit 312 patients with psychotic symptoms and 312 patients with major depressive disorder discharged from Shenzhen Kangning Hospital (SKH) in a Sequential Multiple Assignment Randomised Trial. Participants will be initially randomised into two intervention groups to receive BCIs monthly and weekly, and they will be rerandomised into three intervention groups to receive BCIs monthly, biweekly and weekly at 3 months after discharge according to the change of their suicide risk. Follow-ups are scheduled at 1, 3, 6 and 12 months after discharge. With the intention-to-treat approach, generalised estimating equation and survival analysis will be applied. This study will also collect qualitative and quantitative information on implementation and service outcomes from the community team.

ETHICS/DISSEMINATION

This study has received ethical approval from the Ethics Committee Review Board of SKH. All participants will provide written informed consent prior to enrolment. The findings of the study will be disseminated through peer-reviewed scientific journals, conference presentations. A project report will be submitted to the National Natural Science Foundation of China as the concluding report of this funded project, and to the mental health authorities in the Shenzhen to refine and apply evidence-based and pragmatic interventions into health systems for postdischarge suicide prevention.

TRIAL REGISTRATION NUMBER

NCT04907669.

Randomized Clinical Trial of a Self-care and Communication Intervention for Parents of Adolescent/Young Adults Undergoing High-Risk Cancer Treatment: A Report From the Children's Oncology Group

BACKGROUND

Parents of adolescents and young adults (AYAs) with cancer offer primary support to their children and often experience their own high levels of distress, affecting parent-AYA communication and quality of life.

OBJECTIVE

To reduce parent distress and improve communication during high-risk cancer treatment, we examined efficacy of a self-care and communication intervention for parents and indirect benefit for AYAs receiving a therapeutic music video (TMV) intervention.

METHODS

In this study, we conducted a multisite, randomized controlled trial with AYAs and parents enrolled as dyads (n = 110). Parents were randomized to intervention or low-dose control; all AYAs received TMV. Data collection occurred at baseline, 2 weeks post intervention (T2), and 90 days post intervention (T3).

RESULTS

There were no significant between-group differences on primary outcomes for parents or AYAs. We did find significant differences favoring the parent intervention group on parenting confidence at T2 and marginally better outcomes for family adaptability/cohesion at T3. Both groups exhibited significant within-group improvement for parent distress (state anxiety, T3; perceived stress, T2 and T3; mood, T3), state anxiety (T2) intervention only, and family strengths control group only. Qualitative data demonstrate the parent intervention raised self-awareness and parent confidence in the short term.

CONCLUSION

Parents found their intervention helpful. Absence of significant results may be due to short intervention duration, need for tailored content, underpowered sample, and potential indirect parent benefit from AYA participation in TMV. The parent intervention did not provide an indirect benefit for AYAs.

IMPLICATIONS FOR NURSING

Parents identified their own need for communication and support from nurses. Nurses can optimize AYA care by attending to parent needs through supportive listening and encouraging self-care.

Low-touch, team-based care for co-morbidity management in cancer patients: the ONE TEAM randomized controlled trial

Background

As treatments for cancer have improved, more people are surviving cancer. However, compared to people without a history of cancer, cancer survivors are more likely to die of cardiovascular disease (CVD). Increased risk for CVD-related mortality among cancer survivors is partially due to lack of medication adherence and problems that exist in care coordination between cancer specialists, primary care physicians, and cardiologists.

Methods/Design

The Onco-primary care networking to support TEAM-based care (ONE TEAM) study is an 18-month cluster-randomized controlled trial with clustering at the primary care clinic level. ONE TEAM compares the provision of the iGuide intervention to patients and primary care providers versus an education-only control. For phase 1, at the patient level, the intervention includes video vignettes and a live webinar; provider-level interventions include electronic health records-based communication and case-based webinars. Participants will be enrolled from across North Carolina one of their first visits with a cancer specialist (e.g., surgeon, radiation or medical oncologist). We use a sequential multiple assignment randomized trial (SMART) design.

Outcomes (measured at the patient level) will include Healthcare Effectiveness Data and Information Set (HEDIS) quality measures of management of three CVD comorbidities using laboratory testing (glycated hemoglobin [A1c], lipid profile) and blood pressure measurements; (2) medication adherence assessed pharmacy refill data using Proportion of Days Covered (PDC); and (3) patient-provider communication (Patient-Centered Communication in Cancer Care, PCC-Ca-36).

Primary care clinics in the intervention arm will be considered non-responders if 90% or more of their participating patients do not meet the modified HEDIS quality metrics at the 6-month measurement, assessed once the first enrollee from each practice reaches the 12-month mark. Non-responders will be re-randomized to either continue to receive the iGuide 1 intervention, or to receive the iGuide 2 intervention, which includes tailored videos for participants and specialist consults with primary care providers.

Discussion

As the population of cancer survivors grows, ONE TEAM will contribute to closing the CVD outcomes gap among cancer survivors by optimizing and integrating cancer care and primary care teams. ONE TEAM is designed so that it will be possible for others to emulate and implement at scale.

Trial registration

This study (NCT04258813) was registered in clinicaltrals.gov on February 6, 2020.

Sequential multiple assignment randomized trial studies should report all key components: a systematic review

OBJECTIVE

Sequential Multiple Assignment Randomised Trial (SMART) designs allow multiple randomisations of participants; this allows assessment of stage-specific questions (individual randomisations) and adaptive interventions (i.e. treatment strategies). We assessed the quality of reporting of the information required to design SMART studies.

STUDY DESIGN AND SETTING

We systematically searched four databases (PubMed, Ovid, Web of Science and Scopus) for all trial reports, protocols, reviews, and methodological papers which mentioned SMART designs up to June 15, 2020.

RESULTS

Of the 157 selected records, 12 (7.64%) were trial reports, 24 (15.29%) were study protocols, 91 (58%) were methodological papers, and 30 (19.1%) were review papers. All these trials were powered using stage-specific aims. Only four (33.33%) of these trials reported parameters required for sample size calculations. A small number of the trials (16.67 %) were interested in determining the best embedded adaptive interventions. Most of the trials did not report information about multiple testing adjustment. Furthermore, most of records reported designs that were mainly focused on stage-specific aims.

CONCLUSIONS

Some features of SMART designs are seldomly reported and/or used. Furthermore, studies using this design tend to not adequately report information about all the design parameters, limiting their transparency and interpretability.

A technology-based intervention to improve safety, mental health and empowerment outcomes for immigrant women with intimate partner violence experiences: it's weWomen plus sequential multiple assignment randomized trial (SMART) protocol

BACKGROUND

Intimate partner violence (IPV) disproportionately affects immigrant women, an understudied and underserved population in need for evidence-based rigorously evaluated culturally competent interventions that can effectively address their health and safety needs.

METHODS

This study uses a sequential, multiple assignment, randomized trial (SMART) design to rigorously evaluate an adaptive, trauma-informed, culturally tailored technology-delivered intervention tailored to the needs of immigrant women who have experienced IPV. In the first stage randomization, participants are randomly assigned to an online safety decision and planning or a usual care control arm and safety, mental health and empowerment outcomes are assessed at 3-, 6- and 12-months post-baseline. For the second stage randomization, women who do not report significant improvements in safety (i.e., reduction in IPV) and empowerment from baseline to 3 months follow up (i.e., non-responders) are re- randomized to safety and empowerment strategies delivered via text only or a combination of text and phone calls with trained advocates. Data on outcomes (safety, mental health, and empowerment) for early non-responders is assessed at 6 and 12 months post re-randomization.

DISCUSSION

The study's SMART design provides an opportunity to implement and evaluate an individualized intervention protocol for immigrant women based on their response to type or intensity of intervention. The findings will be useful for identifying what works for whom and characteristics of participants needing a particular type or intensity level of intervention for improved outcomes. If found to be effective, the study will result in an evidence-based trauma-informed culturally tailored technology-based safety decision and planning intervention for immigrant survivors of IPV that can be implemented by practitioners serving immigrant women in diverse settings.

TRIAL REGISTRATION

This trial was registered with ClinicalTrials.gov as NCT04098276 on September 13, 2019.

Toward more rigorous and informative nutritional epidemiology: The rational space between dismissal and defense of the status quo

To date, nutritional epidemiology has relied heavily on relatively weak methods including simple observational designs and substandard measurements. Despite low internal validity and other sources of bias, claims of causality are made commonly in this literature. Nutritional epidemiology investigations can be improved through greater scientific rigor and adherence to scientific reporting commensurate with research methods used. Some commentators advocate jettisoning nutritional epidemiology entirely, perhaps believing improvements are impossible. Still others support only normative refinements. But neither abolition nor minor tweaks are appropriate. Nutritional epidemiology, in its present state, offers utility, yet also needs marked, reformational renovation. Changing the status quo will require ongoing, unflinching scrutiny of research questions, practices, and reporting-and a willingness to admit that "good enough" is no longer good enough. As such, a workshop entitled "Toward more rigorous and informative nutritional epidemiology: the rational space between dismissal and defense of the status quo" was held from July 15 to August 14, 2020. This virtual symposium focused on: (1) Stronger Designs, (2) Stronger Measurement, (3) Stronger Analyses, and (4) Stronger Execution and Reporting. Participants from several leading academic institutions explored existing, evolving, and new better practices, tools, and techniques to collaboratively advance specific recommendations for strengthening nutritional epidemiology.

Development features and study characteristics of mobile health apps in the management of chronic conditions: a systematic review of randomised trials

COVID-19 pandemic challenges have accelerated the reliance on digital health fuelling the expanded incorporation of mobile apps into healthcare services, particularly for the management of long-term conditions such as chronic diseases (CDs). However, the impact of health apps on outcomes for CD remains unclear, potentially owing to both the poor adoption of formal development standards in the design process and the methodological quality of studies. A systematic search of randomised trials was performed on Medline, ScienceDirect, the Cochrane Library and Scopus to provide a comprehensive outlook and review the impact of health apps on CD. We identified 69 studies on diabetes (n = 29), cardiovascular diseases (n = 13), chronic respiratory diseases (n = 13), cancer (n = 10) or their combinations (n = 4). The apps rarely adopted developmental factors in the design stage, with only around one-third of studies reporting user or healthcare professional engagement. Apps differed significantly in content, with a median of eight behaviour change techniques adopted, most frequently pertaining to the ‘Feedback and monitoring’ (91%) and ‘Shaping knowledge’ (72%) categories. As for the study methodologies, all studies adopted a traditional randomised control trial (RCT) design, with relatively short follow-ups and limited sample sizes. Findings were not significant for the majority of studies across all CD, with most RCTs revealing a high risk of bias. To support the adoption of apps for CD management, this review reinforces the need for more robust development and appropriate study characteristics to sustain evidence generation and elucidate whether study results reflect the true benefits of apps or a biased estimate due to unsuitable designs.

A Randomized Controlled Trial of the Collaborative Assessment and Management of Suicidality (CAMS) Versus Treatment as Usual (TAU) for Suicidal College Students

This randomized controlled trial compared the Collaborative Assessment and Management of Suicidality (CAMS) and Treatment as Usual (TAU) for suicidal college students within a feasibility trial. Sixty-two suicidal college students were randomized to CAMS (n = 33) or TAU (n = 29). We hypothesized that those receiving CAMS would show more improvement in suicide-related measures, and effects would be moderated by borderline personality disorder (BPD), prior suicide attempts, and age. Both treatment groups showed improvements in all outcome variables; CAMS had a significantly higher impact on depression and suicidal ideation when measured weekly during care and was more likely than TAU to decrease hopelessness among students with fewer BPD features, no suicide attempt history, and older age. Conversely, TAU did better for students with BPD features and history of multiple suicide attempts.

Sequential Multiple Assignment Randomized Trial (SMART) to identify optimal sequences of telemedicine interventions for improving initiation of insulin therapy: A simulation study

BACKGROUND

To examine the value of a Sequential Multiple Assignment Randomized Trial (SMART) design compared to a conventional randomized control trial (RCT) for telemedicine strategies to support titration of insulin therapy for Type 2 Diabetes Mellitus (T2DM) patients new to insulin.

METHODS

Microsimulation models were created in R using a synthetic sample based on primary data from 63 subjects enrolled in a pilot study of a smartphone application (App), Diabetes Pal compared to a nurse-based telemedicine strategy (Nurse). For comparability, the SMART and an RCT design were constructed to allow comparison of four (embedded) adaptive interventions (AIs).

RESULTS

In the base case scenario, the SMART has similar overall mean expected HbA1c and cost per subject compared with RCT, for sample size of n = 100 over 10,000 simulations. SMART has lower (better) standard deviations of the mean expected HbA1c per AI, and higher efficiency of choosing the correct AI across various sample sizes. The differences between SMART and RCT become apparent as sample size decreases. For both trial designs, the threshold value at which a subject was deemed to have been responsive at an intermediate point in the trial had an optimal choice (i.e., the sensitivity curve had a U-shape). SMART design dominates the RCT, in the overall mean HbA1c (lower value) when the threshold value is close to optimal.

CONCLUSIONS

SMART is suited to evaluating the efficacy of different sequences of treatment options, in addition to the advantage of providing information on optimal treatment sequences.

Adolescence Amid a Pandemic: Short- and Long-Term Implications

Members of the Society for Research on Adolescents COVID-19 Response Team offer this commentary to accompany this special issue of the Journal of Research on Adolescence regarding the impact of the pandemic on adolescents' social, emotional, and academic functioning. In addition to outlining the critical need for scholarly collaboration to address the global impact of this crisis on adolescent development, we argue that a broad investigative lens is needed to guide research and recovery efforts targeting youth development. We then use this broad lens to consider dimensions of the pandemic impact relative to developmental implications within community and policy contexts, educational contexts, social contexts, and family contexts. Finally, we describe guideposts for setting a global, shared research agenda that can hasten research to recovery efforts surrounding the pandemic and youth development.

Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update

BACKGROUND

The Medical Research Council published the second edition of its framework in 2006 on developing and evaluating complex interventions. Since then, there have been considerable developments in the field of complex intervention research. The objective of this project was to update the framework in the light of these developments. The framework aims to help research teams prioritise research questions and design, and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods.

METHODS

There were four stages to the update: (1) gap analysis to identify developments in the methods and practice since the previous framework was published; (2) an expert workshop of 36 participants to discuss the topics identified in the gap analysis; (3) an open consultation process to seek comments on a first draft of the new framework; and (4) findings from the previous stages were used to redraft the framework, and final expert review was obtained. The process was overseen by a Scientific Advisory Group representing the range of relevant National Institute for Health Research and Medical Research Council research investments.

RESULTS

Key changes to the previous framework include (1) an updated definition of complex interventions, highlighting the dynamic relationship between the intervention and its context; (2) an emphasis on the use of diverse research perspectives: efficacy, effectiveness, theory-based and systems perspectives; (3) a focus on the usefulness of evidence as the basis for determining research perspective and questions; (4) an increased focus on interventions developed outside research teams, for example changes in policy or health services delivery; and (5) the identification of six 'core elements' that should guide all phases of complex intervention research: consider context; develop, refine and test programme theory; engage stakeholders; identify key uncertainties; refine the intervention; and economic considerations. We divide the research process into four phases: development, feasibility, evaluation and implementation. For each phase we provide a concise summary of recent developments, key points to address and signposts to further reading. We also present case studies to illustrate the points being made throughout.

LIMITATIONS

The framework aims to help research teams prioritise research questions and design and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. In many of the areas of innovation that we highlight, such as the use of systems approaches, there are still only a few practical examples. We refer to more specific and detailed guidance where available and note where promising approaches require further development.

CONCLUSIONS

This new framework incorporates developments in complex intervention research published since the previous edition was written in 2006. As well as taking account of established practice and recent refinements, we draw attention to new approaches and place greater emphasis on economic considerations in complex intervention research. We have introduced a new emphasis on the importance of context and the value of understanding interventions as 'events in systems' that produce effects through interactions with features of the contexts in which they are implemented. The framework adopts a pluralist approach, encouraging researchers and research funders to adopt diverse research perspectives and to select research questions and methods pragmatically, with the aim of providing evidence that is useful to decision-makers.

FUTURE WORK

We call for further work to develop relevant methods and provide examples in practice. The use of this framework should be monitored and the move should be made to a more fluid resource in the future, for example a web-based format that can be frequently updated to incorporate new material and links to emerging resources.

FUNDING

This project was jointly funded by the Medical Research Council (MRC) and the National Institute for Health Research (Department of Health and Social Care 73514).

BestFIT Sequential Multiple Assignment Randomized Trial Results: A SMART Approach to Developing Individualized Weight Loss Treatment Sequences

BACKGROUND

State-of-the-art behavioral weight loss treatment (SBT) can lead to clinically meaningful weight loss, but only 30-60% achieve this goal. Developing adaptive interventions that change based on individual progress could increase the number of people who benefit.

PURPOSE

Conduct a Sequential Multiple Assignment Randomized Trial (SMART) to determine the optimal time to identify SBT suboptimal responders and whether it is better to switch to portion-controlled meals (PCM) or acceptance-based treatment (ABT).

METHOD

The BestFIT trial enrolled 468 adults with obesity who started SBT and were randomized to treatment response assessment at Session 3 (Early TRA) or 7 (Late TRA). Suboptimal responders were re-randomized to PCM or ABT. Responders continued SBT. Primary outcomes were weight change at 6 and 18 months.

RESULTS

PCM participants lost more weight at 6 months (-18.4 lbs, 95% CI -20.5, -16.2) than ABT participants (-15.7 lbs, 95% CI: -18.0, -13.4), but this difference was not statistically significant (-2.7 lbs, 95% CI: -5.8, 0.5, p = .09). PCM and ABT participant 18 month weight loss did not differ. Early and Late TRA participants had similar weight losses (p = .96), however, Early TRA PCM participants lost more weight than Late TRA PCM participants (p = .03).

CONCLUSIONS

Results suggest adaptive intervention sequences that warrant further research (e.g., identify suboptimal responders at Session 3, use PCMs as second-stage treatment). Utilizing the SMART methodology to develop an adaptive weight loss intervention that would outperform gold standard SBT in a randomized controlled trial is an important next step, but may require additional optimization work.

CLINICAL TRIAL INFORMATION

ClinicalTrials.gov identifier; NCT02368002.

Trajectory of treatment response in the child and adolescent migraine prevention (CHAMP) study: A randomized clinical trial

OBJECTIVE

Identify preventive medication treatment response trajectories among youth participating in the Childhood and Adolescent Migraine Prevention study.

METHODS

Data were evaluated from 328 youth (ages 8-17). Childhood and Adolescent Migraine Prevention study participants completed headache diaries during a 28-day baseline period and a 168-day active treatment period during which youth took amitriptyline, topiramate, or placebo. Daily headache occurrence trajectories were established across baseline and active treatment periods using longitudinal hierarchical linear modeling. We tested potential treatment group differences. We also compared final models to trajectory findings from a clinical trial of cognitive behavioral therapy plus amitriptyline for youth with chronic migraine to test for reproducibility.

RESULTS

Daily headache occurrence showed stability across baseline. Active treatment models revealed decreases in headache frequency that were most notable early in the trial period. Baseline and active treatment models did not differ by treatment group and replicated trajectory cognitive behavioral therapy plus amitriptyline trial findings.

CONCLUSIONS

Replicating headache frequency trajectories across clinical trials provides strong evidence that youth can improve quickly. Given no effect for medication, we need to better understand what drives this clinically meaningful improvement. Results also suggest an expected trajectory of treatment response for use in designing and determining endpoints for future clinical trials.Trial Registration. ClinicalTrials.gov Identifier: NCT01581281.

Communication research at the National Cancer Institute, 2013-2019: a grant portfolio analysis

PURPOSE

To analyze communication-focused grants funded by the National Cancer Institute (NCI) between fiscal years 2013 and 2019 to provide insight into the characteristics of funded projects and identify promising areas for future research.

METHODS

iSearch, a portfolio analysis tool, was queried to identify communication-related grants funded by NCI. Abstracts and specific aims were coded for key study characteristics. 344 unique competing grants with a substantial communication component were included in the final analysis. SAS version 9.4 was used to calculate code frequencies.

RESULTS

Most communication grants focused on cancer prevention (n = 197), with fewer targeting diagnosis, treatment, survivorship, or end-of-life. Tobacco product use was the most frequently addressed topic (n = 128). Most grants targeted or measured outcomes at the individual (n = 332) or interpersonal level (n = 127). Cancer patients/survivors (n = 101) and healthcare providers (n = 63) were often the population of focus, while caregivers or those at increased risk for cancer received less attention. Studies were often based in healthcare settings (n = 125); few studies were based in schools or worksites. Many grants employed randomized controlled trials (n = 168), but more novel methods, like optimization trials, were uncommon.

CONCLUSION

NCI's support of health communication research covers a diverse array of topics, populations, and methods. However, the current analysis also points to several promising opportunities for future research, including efforts focused on communication at later stages of the cancer control continuum and at multiple levels of influence, as well as studies that take advantage of a greater diversity of settings and leverage novel methodological approaches.

Evaluating study procedure training methods for a remote daily diary study of sexual minority women

BACKGROUND

Ecological momentary assessment (EMA) methods can be used to remotely assess physical and mental health in daily life for hard-to-reach, marginalized, and geographically dispersed populations in the U.S., such as sexual minority women (e.g., lesbian, bisexual). However, EMA studies are often complex, and engaging participants from afar can be a challenge. This study experimentally examined whether adding videos to written recruitment materials would improve consent rates, reduce dropout rates, and improve survey completion rates for an online daily diary study.

METHODS

As part of a 2-week study of same-sex female couples' health, 376 women ages 18-35 were recruited from across the U.S. using a market research firm. Couples were randomized to an introductory information condition (written + video materials or written-only materials) prior to informed consent.

RESULTS

Overall, 97.1% of eligible women reviewed introductory materials and of these 96.7% consented; consent rates did not differ by condition (written + video: 97.1%, written-only: 97.1%). Dropout rates were low (5.4%) and survey completion rates were high (90.4% of surveys completed); there were no group differences for study dropout (written + video: 3.6%, written-only: 7.0%) or survey completion (written + video: 92.5%, written-only: 88.4%). Data from women randomized to receive videos indicated more than half (53.3%) did not watch any of the five videos in full. However, among those who viewed the videos, time spent watching videos, watching more videos in full, and watching at least one video in full were each positive associated with survey completion rates.

CONCLUSIONS

In summary, we had high consent rates, low dropout rates, and high survey completion rates regardless of video instructions. Although sexual minority women can be hard to reach, our potential participants appeared highly motivated to take part in research, and thus video recruitment materials were not necessary to improve participation. Future experimental research to maximize EMA study design and implementation could be important for populations less inclined to participate in EMA studies, or who are less familiar with research.

Innovative trial approaches in immune-mediated inflammatory diseases: current use and future potential

BACKGROUND

Despite progress that has been made in the treatment of many immune-mediated inflammatory diseases (IMIDs), there remains a need for improved treatments. Randomised controlled trials (RCTs) provide the highest form of evidence on the effectiveness of a potential new treatment regimen, but they are extremely expensive and time consuming to conduct. Consequently, much focus has been given in recent years to innovative design and analysis methods that could improve the efficiency of RCTs. In this article, we review the current use and future potential of these methods within the context of IMID trials.

METHODS

We provide a review of several innovative methods that would provide utility in IMID research. These include novel study designs (adaptive trials, Sequential Multi-Assignment Randomised Trials, basket, and umbrella trials) and data analysis methodologies (augmented analyses of composite responder endpoints, using high-dimensional biomarker information to stratify patients, and emulation of RCTs from routinely collected data). IMID trials are now well-placed to embrace innovative methods. For example, well-developed statistical frameworks for adaptive trial design are ready for implementation, whilst the growing availability of historical datasets makes the use of Bayesian methods particularly applicable. To assess whether and how these innovative methods have been used in practice, we conducted a review via PubMed of clinical trials pertaining to any of 51 IMIDs that were published between 2018 and 20 in five high impact factor clinical journals.

RESULTS

Amongst 97 articles included in the review, 19 (19.6%) used an innovative design method, but most of these were relatively straightforward examples of innovative approaches. Only two (2.1%) reported the use of evidence from routinely collected data, cohorts, or biobanks. Eight (9.2%) collected high-dimensional data.

CONCLUSIONS

Application of innovative statistical methodology to IMID trials has the potential to greatly improve efficiency, to generalise and extrapolate trial results, and to further personalise treatment strategies. Currently, such methods are infrequently utilised in practice. New research is required to ensure that IMID trials can benefit from the most suitable methods.

A Sequential Multiple Assignment Randomized Trial (SMART) study of medication and CBT sequencing in the treatment of pediatric anxiety disorders

BACKGROUND

Treatment of a child who has an anxiety disorder usually begins with the question of which treatment to start first, medication or psychotherapy. Both have strong empirical support, but few studies have compared their effectiveness head-to-head, and none has investigated what to do if the treatment tried first isn't working well-whether to optimize the treatment already begun or to add the other treatment.

METHODS

This is a single-blind Sequential Multiple Assignment Randomized Trial (SMART) of 24 weeks duration with two levels of randomization, one in each of two 12-week stages. In Stage 1, children will be randomized to fluoxetine or Coping Cat Cognitive Behavioral Therapy (CBT). In Stage 2, remitters will continue maintenance-level therapy with the single-modality treatment received in Stage 1. Non-remitters during the first 12 weeks of treatment will be randomized to either [1] optimization of their Stage 1 treatment, or [2] optimization of Stage 1 treatment and addition of the other intervention. After the 24-week trial, we will follow participants during open, naturalistic treatment to assess the durability of study treatment effects. Patients, 8-17 years of age who are diagnosed with an anxiety disorder, will be recruited and treated within 9 large clinical sites throughout greater Los Angeles. They will be predominantly underserved, ethnic minorities. The primary outcome measure will be the self-report score on the 41-item youth SCARED (Screen for Child Anxiety Related Disorders). An intent-to-treat analysis will compare youth randomized to fluoxetine first versus those randomized to CBT first ("Main Effect 1"). Then, among Stage 1 non-remitters, we will compare non-remitters randomized to optimization of their Stage 1 monotherapy versus non-remitters randomized to combination treatment ("Main Effect 2"). The interaction of these main effects will assess whether one of the 4 treatment sequences (CBT➔CBT; CBT➔med; med➔med; med➔CBT) in non-remitters is significantly better or worse than predicted from main effects alone.

DISCUSSION

Findings from this SMART study will identify treatment sequences that optimize outcomes in ethnically diverse pediatric patients from underserved low- and middle-income households who have anxiety disorders.

TRIAL REGISTRATION

This protocol, version 1.0, was registered in ClinicalTrials.gov on February 17, 2021 with Identifier: NCT04760275 .

Randomized Controlled Trials 1: Design

Today's clinical practice relies on the application of well-designed clinical research, the gold standard test of an intervention being the randomized controlled trial. Principles of the randomized control trial include emphasis on the principal research question, randomization, blinding; definitions of outcome measures, of inclusion and exclusion criteria, and of co-morbid and confounding factors; enrolling an adequate sample size; planning data management and analysis; preventing challenges to trial integrity such as drop-out, drop-in, and bias. The application of pre-trial planning is stressed to ensure the proper application of epidemiological principles resulting in clinical studies that are feasible and generalizable. In addition, funding strategies and trial team composition are discussed.

The Applications of Implementation Science in Water, Sanitation, and Hygiene (WASH) Research and Practice

BACKGROUND

Delivery of high quality, at-scale, and sustained services is a major challenge in the water, sanitation, and hygiene (WASH) sector, made more challenging by a dearth of evidence-based models for adaption across contexts in low- and middle-income countries.

OBJECTIVE

We aim to describe the value of implementation science (IS) for the WASH sector and provide recommendations for its application.

METHODS

We review concepts from the growing field of IS-defined as the "scientific study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice, and hence, to improve the quality and effectiveness of health services"-and we translate their relevance to WASH research, learning, and delivery.

DISCUSSION

IS provides a suite of methods and theories to systematically develop, evaluate, and scale evidence-based interventions. Though IS thinking has been applied most notably in health services delivery in high-income countries, there have been applications in low-income settings in fields such as HIV/AIDS and nutrition. Expanding the application of IS to environmental health, specifically WASH interventions, would respond to the complexity of sustainable service delivery. WASH researchers may want to consider applying IS guidelines to their work, including adapting pragmatic research models, using established IS frameworks, and cocreating knowledge with local stakeholders. https://doi.org/10.1289/EHP7762.

Adaptive randomization in a two-stage sequential multiple assignment randomized trial

Sequential multiple assignment randomized trials (SMARTs) are systematic and efficient media for comparing dynamic treatment regimes (DTRs), where each patient is involved in multiple stages of treatment with the randomization at each stage depending on the patient's previous treatment history and interim outcomes. Generally, patients enrolled in SMARTs are randomized equally to ethically acceptable treatment options regardless of how effective those treatments were during the previous stages, which results in some undesirable consequences in practice, such as low recruitment, less retention, and lower treatment adherence. In this article, we propose a response-adaptive SMART (RA-SMART) design where the allocation probabilities are imbalanced in favor of more promising treatments based on the accumulated information on treatment efficacy from previous patients and stages. The operating characteristics of the RA-SMART design relative to SMART design, including the consistency and efficiency of estimated response rate under each DTR, the power of identifying the optimal DTR, and the number of patients treated with the optimal and the worst DTRs, are assessed through extensive simulation studies. Some practical suggestions are discussed in the conclusion.

Building Healthy Children: A preventive intervention for high-risk young families

The Building Healthy Children (BHC) home-visiting preventive intervention was designed to provide concrete support and evidence-based intervention to young mothers and their infants who were at heightened risk for child maltreatment and poor developmental outcomes. This paper presents two studies examining the short- and long-term effectiveness of this program at promoting positive parenting and maternal mental health, while preventing child maltreatment and harsh parenting. It also examines the intervention's sustained effect on child symptomatology and self-regulation. At baseline, young mothers and their infants were randomly assigned to receive BHC or Enhanced Community Standard. Families were assessed longitudinally across four time points. Data were also collected from the child's teacher at follow-up. Mothers who received BHC evidenced significant reductions in depressive symptoms at mid-intervention, which was associated with improvements in parenting self-efficacy and stress as well as decreased child internalizing and externalizing symptoms at postintervention. The follow-up study found that BHC mothers exhibited less harsh and inconsistent parenting, and marginally less psychological aggression. BHC children also exhibited less externalizing behavior and self-regulatory difficulties across parent and teacher report. Following the impactful legacy of Dr. Edward Zigler, these findings underline the importance of early, evidence-based prevention to promote well-being in high-risk children and families.

Optimizing Implementation in Cancer Control (OPTICC): protocol for an implementation science center

BACKGROUND

Evidence-based interventions (EBIs) could reduce cervical cancer deaths by 90%, colorectal cancer deaths by 70%, and lung cancer deaths by 95% if widely and effectively implemented in the USA. Yet, EBI implementation, when it occurs, is often suboptimal. This manuscript outlines the protocol for Optimizing Implementation in Cancer Control (OPTICC), a new implementation science center funded as part of the National Cancer Institute Implementation Science Consortium. OPTICC is designed to address three aims. Aim 1 is to develop a research program that supports developing, testing, and refining of innovative, efficient methods for optimizing EBI implementation in cancer control. Aim 2 is to support a diverse implementation laboratory of clinical and community partners to conduct rapid, implementation studies anywhere along the cancer care continuum for a wide range of cancers. Aim 3 is to build implementation science capacity in cancer control by training new investigators, engaging established investigators in cancer-focused implementation science, and contributing to the Implementation Science Consortium in Cancer.

METHODS

Three cores serve as OPTICC's foundation. The Administrative Core plans coordinates and evaluates the Center's activities and leads its capacity-building efforts. The Implementation Laboratory Core (I-Lab) coordinates a network of diverse clinical and community sites, wherein studies are conducted to optimize EBI implementation, implement cancer control EBIs, and shape the Center's agenda. The Research Program Core conducts innovative implementation studies, measurement and methods studies, and pilot studies that advance the Center's theme. A three-stage approach to optimizing EBI implementation is taken-(I) identify and prioritize determinants, (II) match strategies, and (III) optimize strategies-that is informed by a transdisciplinary team of experts leveraging multiphase optimization strategies and criteria, user-centered design, and agile science.

DISCUSSION

OPTICC will develop, test, and refine efficient and economical methods for optimizing EBI implementation by building implementation science capacity in cancer researchers through applications with our I-Lab partners. Once refined, OPTICC will disseminate its methods as toolkits accompanied by massive open online courses, and an interactive website, the latter of which seeks to simultaneously accumulate knowledge across OPTICC studies.