Quality improvement as a tool for translating evidence based interventions into practice: what the youth violence prevention community can learn from healthcare

From "Homegrown" to Research-Ready: Converting an Existing Practitioner-Developed Violence Prevention Intervention Into an Evaluable Intervention

There is an increased call for research on promising prevention programs already embedded in communities ("homegrown interventions"). Unfortunately, there is limited guidance to help researchers prepare these types of interventions for rigorous evaluation. To address this need, this article presents our team's process for revising a promising community-based sexual violence prevention intervention for rigorous research. Our extensive and iterative process of reviewing and revising the intervention was guided by evaluability assessment (EA) approaches, implementation science, and a close collaboration with our community partners. Our EA process allowed us to specify the intervention's core components and develop a "research ready" standardized curriculum with implementation fidelity assessments. We offer four lessons learned from our process: (1) even with existing materials and an extensive history of community-based delivery, community-developed programs are not necessarily research-ready; (2) close collaboration and a trusting relationship between researchers and community partners throughout the revision process ensures the integrity of core program components are maintained and implementation in diverse community settings is feasible; (3) observations of program implementation are a crucial part of the revision process; and (4) it is important to budget adequate time and resources for such revisions.

Measuring Treatment Integrity: Use of and Experience with Measurements in Child and Youth Care Organizations

Performance feedback and supervision are essential to the adoption of evidence-based interventions with high treatment integrity in child and youth care organizations. Little is known about the use of treatment integrity measurements in these organizations. For this study, 12 interventions for children and young people in the Netherlands with externalizing behavioral problems were selected. For each intervention, an expert, two supervisors, and two therapists were approached for an interview. In total, 54 semi-structured interviews were conducted. The results show that almost all interventions used treatment integrity instruments (N = 11, 91.7%). Only two used measurements for both QA procedures (certification and recertification) and supervision purposes. Therapists regard treatment integrity measurements as valuable when they are used for multiple purposes and feedback is provided. The results of this study suggest the feasibility of the use of measurements for multiple purposes. Collaborative action is required to develop instruments that effectively contribute to continuous improvement.

PROSPER partnership delivery system: Effects on adolescent conduct problem behavior outcomes through 6.5 years past baseline

We report long-term effects of the PROSPER delivery system for universal evidence-based preventive interventions on adolescent conduct problem behaviors (CPBs). A cluster randomized trial included 28 school districts assigned to PROSPER or a control condition. Community-based teams in PROSPER condition school districts selected evidence-based interventions-a family-focused intervention in sixth grade and a school-based intervention the next year; follow-up assessments were conducted through 12th grade. CPBs were measured with 12 self-report items derived from the National Youth Survey. Intervention-control differences were tested via a multi-level Zero-Inflated Poisson (ZIP) model. Differences were significant from 9th through 12th grades; Relative Reduction Rates were between 10.1% and 14.5%. The intervention group was delayed in reaching a 10th grade reference level of CPBs by 10.7 months. Moderation analyses indicated stronger effects for early substance initiators. Findings suggest that the PROSPER delivery system has the potential to reduce CPBs in general populations.

Community-engagement strategies of the developmental disabilities practice-based research network (DD-PBRN)

There is often a rich but untold history of events that occur and relationships that form before a practice-based research network (PBRN) is launched. This is particularly the case in PBRNs that are community based and comprise partnerships outside of the health care system. In this article we summarize an organizational "prenatal history" before the birth of a PBRN devoted to people with developmental disabilities. Using a case study approach, this article describes the historic events that preceded and fostered the evolution of this PBRN and contrasts how the processes leading to the creation of this multistakeholder, community-based PBRN differ from those of typical academic/clinical practice PBRNs. We propose potential advantages and complexities inherent to this newest iteration of PBRNs.

Implementing and sustaining evidence-based practice in juvenile justice: a case study of a rural state

US juvenile justice is at the forefront of experimentation with the evidence-based paradigm, whereby the best available research is utilized to help inform more rational and effective practice. Increasingly, state governments are playing a major role in this endeavor. Maine is one of these states and is the focus of this article. Using a case-study design, we set out to develop a fuller understanding of the events and processes that have contributed to the development, implementation, and sustainment of evidence-based practice in juvenile justice in the state. Four major themes emerged. First, Maine has benefited from strong and lasting leadership within its corrections department. These leaders paved the way for the implementation and sustainment of programs, including finding innovative ways to use existing resources. Second, the adoption of the Risk-Need-Responsivity model was important in laying the groundwork for the use of evidence-based programming. Third, collaborations within and among state agencies and public and private groups were essential. Finally, buy-in and support from multiple stakeholders was and continues to be essential to Maine's work. Ongoing problems remain with respect to ensuring agencies prioritize fidelity to the model and locating increasingly scarce funding. Implications for other states are discussed.

Making a Case for Treatment Integrity as a Psychosocial Treatment Quality Indicator for Youth Mental Health Care

Measures of treatment integrity are needed to advance clinical research in general and are viewed as particularly relevant for dissemination and implementation research. Although some efforts to develop such measures are underway, a conceptual and methodological framework will help guide these efforts. The purpose of this article is to demonstrate how frameworks adapted from the psychosocial treatment, therapy process, healthcare, and business literatures can be used to address this gap. We propose that components of treatment integrity (i.e., adherence, differentiation, competence, alliance, client involvement) pulled from the treatment technology and process literatures can be used as quality indicators of treatment implementation and thereby guide quality improvement efforts in practice settings. Further, we discuss how treatment integrity indices can be used in feedback systems that utilize benchmarking to expedite the process of translating evidence-based practices to service settings.

Advances in Applying Treatment Integrity Research for Dissemination and Implementation Science: Introduction to Special Issue

This special series focuses upon the ways in which research on treatment integrity, a multidimensional construct including assessment of the content and quality of a psychosocial treatment delivered to a client as well as relational elements, can inform dissemination and implementation science. The five articles for this special series illustrate how treatment integrity concepts and methods can be applied across different levels of the mental health service system to advance dissemination and implementation science. In this introductory article, we provide an overview of treatment integrity research and describe three broad conceptual models that are relevant to the articles in the series. We conclude with a brief description of each of the five articles in the series.

Longitudinal effects of universal preventive intervention on prescription drug misuse: three randomized controlled trials with late adolescents and young adults

OBJECTIVES

We examined long-term prescription drug misuse outcomes in 3 randomized controlled trials evaluating brief universal preventive interventions conducted during middle school.

METHODS

In 3 studies, we tested the Iowa Strengthening Families Program (ISFP); evaluated a revised ISFP, the Strengthening Families Program: For Parents and Youth 10-14 plus the school-based Life Skills Training (SFP 10-14 + LST); and examined the SFP 10-14 plus 1 of 3 school-based interventions. Self-reported outcomes were prescription opioid misuse (POM) and lifetime prescription drug misuse overall (PDMO).

RESULTS

In study 1, ISFP showed significant effects on POM and PDMO, relative reduction rates (RRRs; age 25 years) of 65%, and comparable benefits for higher- and lower-risk subgroups. In study 2, SFP 10-14 + LST showed significant or marginally significant effects on POM and PDMO across all ages (21, 22, and 25 years); higher-risk participants showed stronger effects (RRRs = 32%-79%). In study 3, we found significant results for POM and PDMO (12th grade RRRs = 20%-21%); higher-risk and lower-risk participants showed comparable outcomes.

CONCLUSIONS

Brief universal interventions have potential for public health impact by reducing prescription drug misuse among adolescents and young adults.

Moving knowledge into action: developing the rapid synthesis and translation process within the interactive systems framework

The Interactive Systems Framework (ISF) for Dissemination and Implementation presents an overall framework for translating knowledge into action. Each of its three systems requires further clarification and explanation to truly understand how to conduct this work. This article describes the development and initial application of the Rapid Synthesis and Translation Process (RSTP) using the exchange model of knowledge transfer in the context of one of the ISF systems: the Prevention Synthesis and Translation System (see [special issue "introduction" article] for a translation of the Wandersman et al. (Am J Community Psychol 41:3-4, 2008) article using the RSTP). This six-step process, which was developed by and for the Division of Violence Prevention at the Centers for Disease Control and Prevention in collaboration with partners, serves as an example of how a federal agency can expedite the transfer of research knowledge to practitioners to prevent violence. While the RSTP itself represents one of the possible functions in the Prevention Synthesis and Translation System, the resulting products affect both prevention support and prevention delivery as well. Examples of how practitioner and researcher feedback were incorporated into the Rapid Synthesis and Translation Process are discussed.

Mobilizing communities to implement evidence-based practices in youth violence prevention: the state of the art

Community mobilization can increase the effective implementation of evidence-based practices (EBPs) in youth violence prevention. These strategies bring together people and organizations in a community to try to solve or reduce a problem. They help communities address the challenges of identifying EBPs, disseminating them to local decision-makers, and then implementing and sustaining them if they are successful. Science-based systems for implementing EBPs such as PROSPER and Communities That Care can help to integrate this complex work in communities. Further insight about implementing EBPs in youth violence prevention is being developed through the CDC-funded Academic Centers for Excellence in Youth Violence Prevention. Community mobilization approaches for seven of these programs are discussed, highlighting successful approaches and challenges encountered.