Fidelity, adherence, and robustness of interventions

Occupational Therapy and Evidence-Based Practice in Mental Health

Evidence-based practice (EBP) represents a paradigm shift in health care. This review has two aims. The first is to consider the merits of EBP, especially in respect of its use in mental health settings. The second is both to identify psychosocial interventions that have an established evidence base for effectiveness and to provide an analysis of the quality of this evidence and its implications for occupational therapy. Supported employment, family psychoeducation, assertive case management and integrated substance use treatment are examined in detail.

It is proposed that occupational therapists working in mental health give priority to psychosocial interventions that are based on evidence and incorporate these into their practice. It is further proposed that, in implementing EBP, practitioners take an active evaluating position in relation to published evidence, paying particular attention to the evidence of effectiveness in equivalent clinical environments.

Treatment-refractory anxiety; definition, risk factors, and treatment challenges

A sizable proportion of psychiatric patients will seek clinical evaluation and treatment for anxiety symptoms reportedly refractory to treatment. This apparent lack of response is either due to “pseudo-resistance” (a failure to have received and adhered to a recognized and effective treatment or treatments for their condition) or to true “treatment resistance.” Pseudo-resistance can be due to clinician errors in selecting and delivering an appropriate treatment effectively, or to patient nonadherence to a course of treatment. True treatment resistance can be due to unrecognized exogenous anxiogenic factors (eg, caffeine overuse, sleep deprivation, use of alcohol or marijuana) or an incorrect diagnosis (eg, atypical bipolar illness, occult substance abuse, attention deficit-hyperactivity disorder). Once the above factors are eliminated, treatment should focus on combining effective medications and cognitive behavioral therapy, combining several medications (augmentation), or employing novel medications or psychotherapies not typically indicated as first-line evidence-based anxiety treatments.

A large-scale initiative to disseminate an evidence-based drug abuse prevention program in Italy: Lessons learned for practitioners and researchers

Across developed countries, experimentation with alcohol, tobacco, and other drugs often begins in the early adolescent years. Several evidence-based programs have been developed to prevent adolescent substance use. Many of the most rigorously tested and empirically supported prevention programs were initially developed and tested in the United States. Increasingly, these interventions are being adopted for use in Europe and throughout the world. This paper reports on a large-scale comprehensive initiative designed to select, adapt, implement, and sustain an evidence-based drug abuse prevention program in Italy. As part of a large-scale regionally funded collaboration in the Lombardy region of Italy, we report on processes through which a team of stakeholders selected, translated and culturally adapted, planned, implemented and evaluated the Life Skills Training (LST) school-based drug abuse prevention program, an evidence-based intervention developed in the United States. We discuss several challenges and lessons learned and implications for prevention practitioners and researchers attempting to undertake similar international dissemination projects. We review several published conceptual models designed to promote the replication and widespread dissemination of effective programs, and discuss their strengths and limitations in the context of planning and implementing a complex, large-scale real-world dissemination effort.

Protocol: Adaptive Implementation of Effective Programs Trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program

BACKGROUND

Despite the availability of psychosocial evidence-based practices (EBPs), treatment and outcomes for persons with mental disorders remain suboptimal. Replicating Effective Programs (REP), an effective implementation strategy, still resulted in less than half of sites using an EBP. The primary aim of this cluster randomized trial is to determine, among sites not initially responding to REP, the effect of adaptive implementation strategies that begin with an External Facilitator (EF) or with an External Facilitator plus an Internal Facilitator (IF) on improved EBP use and patient outcomes in 12 months.

METHODS/DESIGN

This study employs a sequential multiple assignment randomized trial (SMART) design to build an adaptive implementation strategy. The EBP to be implemented is life goals (LG) for patients with mood disorders across 80 community-based outpatient clinics (N = 1,600 patients) from different U.S. regions. Sites not initially responding to REP (defined as < 50% patients receiving ≥ 3 EBP sessions) will be randomized to receive additional support from an EF or both EF/IF. Additionally, sites randomized to EF and still not responsive will be randomized to continue with EF alone or to receive EF/IF. The EF provides technical expertise in adapting LG in routine practice, whereas the on-site IF has direct reporting relationships to site leadership to support LG use in routine practice. The primary outcome is mental health-related quality of life; secondary outcomes include receipt of LG sessions, mood symptoms, implementation costs, and organizational change.

DISCUSSION

This study design will determine whether an off-site EF alone versus the addition of an on-site IF improves EBP uptake and patient outcomes among sites that do not respond initially to REP. It will also examine the value of delaying the provision of EF/IF for sites that continue to not respond despite EF.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT02151331.

Individual-level predictors of nonparticipation and dropout in a life-skills HIV prevention program for adolescents in foster care

The purpose of this study is to identify individual-level characteristics of foster care adolescents who are more likely to not participate in, and drop out of, a life-skills HIV prevention program delivered over 8 months. Structured interviews were conducted with 320 foster care adolescents (15-18 years). Logistic regression and survival analyses (Cox Proportional Hazards Regression) determined the influence of demographics, HIV sexual risk behaviors, substance use, mental health problems, and other individual-level risk factors on nonparticipation and dropout. Older age and having vaginal intercourse without a condom were significant predictors of nonparticipation. Older age and marijuana use significantly increased the hazard of dropping out of the program. Foster care adolescents at increased risk for HIV infection were more likely to never participate in and drop out of the program. To improve initial and ongoing participation, HIV prevention efforts for adolescents in foster care should be tailored to individual-level HIV risk behaviors and incorporate early and ongoing engagement and retention strategies.

Design elements in implementation research: a structured review of child welfare and child mental health studies

Implementation science is an emerging field of research with considerable penetration in physical medicine and less in the fields of mental health and social services. There remains a lack of consensus on methodological approaches to the study of implementation processes and tests of implementation strategies. This paper addresses the need for methods development through a structured review that describes design elements in nine studies testing implementation strategies for evidence-based interventions addressing mental health problems of children in child welfare and child mental health settings. Randomized trial designs were dominant with considerable use of mixed method designs in the nine studies published since 2005. The findings are discussed in reference to the limitations of randomized designs in implementation science and the potential for use of alternative designs.

Interactive "Video Doctor" counseling reduces drug and sexual risk behaviors among HIV-positive patients in diverse outpatient settings

BACKGROUND

Reducing substance use and unprotected sex by HIV-positive persons improves individual health status while decreasing the risk of HIV transmission. Despite recommendations that health care providers screen and counsel their HIV-positive patients for ongoing behavioral risks, it is unknown how to best provide "prevention with positives" in clinical settings. Positive Choice, an interactive, patient-tailored computer program, was developed in the United States to improve clinic-based assessment and counseling for risky behaviors.

METHODOLOGY AND FINDINGS

We conducted a parallel groups randomized controlled trial (December 2003-September 2006) at 5 San Francisco area outpatient HIV clinics. Eligible patients (HIV-positive English-speaking adults) completed an in-depth computerized risk assessment. Participants reporting substance use or sexual risks (n = 476) were randomized in stratified blocks. The intervention group received tailored risk-reduction counseling from a "Video Doctor" via laptop computer and a printed Educational Worksheet; providers received a Cueing Sheet on reported risks. Compared with control, fewer intervention participants reported continuing illicit drug use (RR 0.81, 95% CI: 0.689, 0.957, p = 0.014 at 3 months; and RR 0.65, 95% CI: 0.540, 0.785, p<0.001 at 6 months) and unprotected sex (RR 0.88, 95% CI: 0.773, 0.993, p = 0.039 at 3 months; and RR 0.80, 95% CI: 0.686, 0.941, p = 0.007 at 6 months). Intervention participants reported fewer mean days of ongoing illicit drug use (-4.0 days vs. -1.3 days, p = 0.346, at 3 months; and -4.7 days vs. -0.7 days, p = 0.130, at 6 months) than did controls, and had fewer casual sex partners at (-2.3 vs. -1.4, p = 0.461, at 3 months; and -2.7 vs. -0.6, p = 0.042, at 6 months).

CONCLUSIONS

The Positive Choice intervention achieved significant cessation of illicit drug use and unprotected sex at the group-level, and modest individual-level reductions in days of ongoing drug use and number of casual sex partners compared with the control group. Positive Choice, including Video Doctor counseling, is an efficacious and appropriate adjunct to risk-reduction efforts in outpatient settings, and holds promise as a public health HIV intervention.

TRIAL REGISTRATION

Clinicaltrials.gov NCT00447707.

Implementing evidence-based interventions in health care: application of the replicating effective programs framework

Background

We describe the use of a conceptual framework and implementation protocol to prepare effective health services interventions for implementation in community-based (i.e., non-academic-affiliated) settings.

Methods

The framework is based on the experiences of the U.S. Centers for Disease Control and Prevention (CDC) Replicating Effective Programs (REP) project, which has been at the forefront of developing systematic and effective strategies to prepare HIV interventions for dissemination. This article describes the REP framework, and how it can be applied to implement clinical and health services interventions in community-based organizations.

Results

REP consists of four phases: pre-conditions (e.g., identifying need, target population, and suitable intervention), pre-implementation (e.g., intervention packaging and community input), implementation (e.g., package dissemination, training, technical assistance, and evaluation), and maintenance and evolution (e.g., preparing the intervention for sustainability). Key components of REP, including intervention packaging, training, technical assistance, and fidelity assessment are crucial to the implementation of effective interventions in health care.

Conclusion

REP is a well-suited framework for implementing health care interventions, as it specifies steps needed to maximize fidelity while allowing opportunities for flexibility (i.e., local customizing) to maximize transferability. Strategies that foster the sustainability of REP as a tool to implement effective health care interventions need to be developed and tested.

Self-monitoring of behaviour as a risk reduction strategy for persons living with HIV

To reduce the HIV-related transmission behaviours of persons living with HIV (PLH), a few efficacious interventions have been designed and evaluated. However, these interventions were delivered at relatively high cost, both in terms of time and resources. Given the challenges for health providers and community agencies in delivering these interventions, alternatives are needed. One possible intervention is allowing PLH to self-monitor their HIV transmission risk behaviour. Previous research suggests that self-monitoring of HIV-risk related behaviours may be a useful risk reduction strategy. This paper examines the impact of repeated risk assessments for behavioural self-monitoring as an intervention strategy for reducing sexual and substance use risk behaviours. A total of 365 PLH, recruited from community clinics, health management organizations, and health departments, completed self-assessments over time. Increased self-monitoring resulted in increases in protected sex with sexual partners of HIV-negative or unknown serostatus, and changes in attitudes conducive to reducing risk. Self-monitoring is a relatively low cost and easily implementable strategy for reducing the HIV-related transmission risk of PLH.

Doing the difficult and dangerous: the community program practice scale

The CPPS uses staff respondents to portray practices and program climate of nonresidential mental health programs. We report psychometric analyses of 1,533 respondents in 165 programs. Confirmatory factor and partial credit analyses identified eight practice and five climate subscales, all of which show adequate psychometric properties. Program types are distinguished better by practices (R (2) values .37 to .52) than by climate (R (2) values .09 to .23), as expected. Multiple discriminant analysis and K-means cluster analysis illustrate how well the CPPS distinguishes program differences. The CPPS offers a promising, economical approach to measuring program practices in clinical trials comparing service programs.

Lessons learned in translating research evidence on early intervention programs into clinical care

There is research evidence describing quality early intervention programs that can promote positive child health and behavior and enhance parenting behaviors and parent-child interactions. Two of the programs with persuasive research evidence are home visitation and parent training. Despite the evidence, it seems that few of these strategies have been translated to real-world clinical settings. This article reviews an evidence-based practice framework that highlights the influence of the research evidence, patient preferences, provider expertise, setting-specific contextual factors, and important role of a facilitator. Examples from one particular early intervention project that implemented a standardized parent training program via home visiting the families of 2- to 6-year-old children help explicate the facilitators and pitfalls in translating best practices into the real-world settings. Strategies that can lead to successful implementation of early intervention child health and parenting best practices in real-world clinical settings are recommended.

Intensive case management: a critical re-appraisal of the scientific evidence for effectiveness

Intensive Case Management (ICM) is widely claimed to be an evidence-based and cost effective program for people with high levels of disability as a result of mental illness. However, the findings of recent randomized controlled trials comparing ICM with 'usual services' suggest that both clinical and cost effectiveness of ICM may be weakening. Possible reasons for this, including fidelity of implementation, researcher allegiance effects and changes in the wider service environment within which ICM is provided, are considered. The implications for service delivery and research are discussed.

Predictors of intervention adherence among young people living with HIV

OBJECTIVE

To examine adherence to a 23-session intervention for young people living with HIV.

METHODS

Two hundred eight HIV-positive youth were assigned by small cohort to a behavioral intervention.

RESULTS

Youth with more personal strengths were more likely to attend the intervention; those with more competing environmental demands (eg, employment, school) were less likely to attend the intervention. Using a social support, spiritual hope, or self-destructive and escape coping style was associated with attendance. Youth who reported many sexual partners attended fewer sessions. Adherence varied by cohort assignment.

CONCLUSION

When designing future interventions, high attendance should be considered as a goal.