Improving quality of care in substance abuse treatment using five key process improvement principles

Responding to health policy recommendations on managing opioid use disorder during Russia's invasion of Ukraine: Divergent responses from the frontline to the west

Russia's invasion of Ukraine on February 24, 2022, followed by Ukraine's Martial law, has disrupted the routine delivery of healthcare services, including opioid agonist treatment (OAT) programs. Directors (chief addiction treatment physicians) of these programs in each region had flexibility with implementing a series of adaptations to their practice to respond to war disruptions like mass internal displacement and legislation updates allowing more flexibility with OAT distribution policies and take-home dosing regulations. We conducted 8 in-depth interviews with directors from seven regions of Ukraine to describe their experiences providing OAT during a specific time during the war and the local crisis-response approach under the emergency policy updates. We categorized their experiences according to the level of exposure to conflict in each region and displacement of patients across the country, which may provide future guidance for OAT provision during the conflict.

Adapting the stages of implementation completion to an evidence-based implementation strategy: The development of the NIATx stages of implementation completion

Background

Dissemination and implementation frameworks provide the scaffolding to explore the effectiveness of evidence-based practices (EBPs) targeting process of care and organizational outcomes. Few instruments, like the stages of implementation completion (SIC) examine implementation fidelity to EBP adoption and how organizations differ in their approach to implementation. Instruments to measure organizational competency in the utilization of implementation strategies are lacking.

Method

An iterative process was utilized to adapt the SIC to the NIATx implementation strategies. The new instrument, NIATx-SIC, was applied in a randomized controlled trial involving 53 addiction treatment agencies in Washington state to improve agency co-occurring capacity. NIATx-SIC data were reported by state staff and external facilitators and through participating agency documentation. Proportion and duration scores for each stage and phase of the NIATx-SIC were calculated for each agency. Competency was assessed using the NIATx fidelity tool. Comparisons of proportion, duration, and NIATx activities completed were determined using independent sample t-tests by agency competency level.

Results

The NIATx-SIC distinguished between agencies achieving competency (n  =  23) and those not achieving competency (n  =  26). Agencies achieving competency completed a greater proportion of implementation phase activities and had a significantly longer Stage 7 duration. These agencies participated in significantly more individual and group coaching calls, attended more in-person meetings, implemented more change projects, and spent approximately 64 more days, on average, engaging in all NIATx activities.

Conclusions

Organizational participation in dissemination and implementation research requires a significant investment of staff resources. The inability of an organization to achieve competency when utilizing a set of implementation strategies waste an opportunity to institutionalize knowledge of how to apply implementation strategies to future change efforts. The NIATx-SIC provides evidence that competency is not an attribute of the organization but rather a result of the application of the NIATx implementation strategies to improve agency co-occurring capacity.

Trial Registration

ClinicalTrials.gov, NCT03007940. Registered January 2, 2017, https://clinicaltrials.gov/ct2/show/NCT03007940.

The comparative effectiveness of Core versus Core+Enhanced implementation strategies in a randomized controlled trial to improve substance use treatment receipt among justice-involved youth

BACKGROUND

Most justice-involved youth are supervised in community settings, where assessment and linkage to substance use (SU) treatment services are inconsistent and fragmented. Only 1/3 of youth with an identified SU need receive a treatment referral and even fewer initiate services. Thus, improving identification and linkage to treatment requires coordination across juvenile justice (JJ) and behavioral health (BH) agencies. The current study examines the comparative effectiveness of two bundled implementation intervention strategies for improving SU treatment initiation, engagement, and continuing care among justice-involved youth supervised in community settings. Exploration, Preparation, Implementation, Sustainment (EPIS) served as the conceptual framework for study design and selection/timing of implementation intervention components, and the BH Services Cascade served as the conceptual and measurement framework for identifying and addressing gaps in service receipt.

METHODS

Part of a larger Juvenile-Justice Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS) Cooperative, this study involved a multisite, cluster-randomized control trial where sites were paired then randomly assigned to receive Core (training teams on the BH Services Cascade and data-driven decision making; supporting goal selection) or Core+Enhanced (external facilitation of implementation teams) intervention components. Youth service records were collected from 20 JJ community supervision agencies (in five states) across five study phases (baseline, pre-randomization, early experiment, late experiment, maintenance). Implementation teams comprised of JJ and BH staff collaboratively identified goals along the BH Cascade and used data-driven decision-making to implement change.

RESULTS

Results suggest that Core intervention components were effective at increasing service receipt over time relative to baseline, but differences between Core and Core+Enhanced conditions were non-significant. Time to service initiation was shorter among Core+Enhanced sites, and deeper Cascade penetration occurred when external facilitation (of implementation teams) was provided. Wide variation existed in the degree and nature of change across service systems.

CONCLUSIONS

Findings demonstrate the criticality of early EPIS phases, demonstrating that strategies provided during the formative exploration and preparation phases produced some improvement in service receipt, whereas implementation-focused activities produced incremental improvement in moving youth farther along the Cascade.

Using structured implementation interventions to improve referral to substance use treatment among justice-involved youth: Findings from a multisite cluster randomized trial

INTRODUCTION

Youth involved in the justice system have high rates of alcohol and other drug use, but limited treatment engagement. JJ-TRIALS tested implementation activities with community supervision (CS) and behavioral health (BH) agencies to improve screening, identification of substance use service need, referral, and treatment initiation and engagement, guided by the BH Services Cascade and EPIS frameworks. This paper summarizes intervention impacts on referrals to treatment among youth on CS.

METHODS

This multisite cluster-randomized trial involved 18 matched pairs of sites in 36 counties in seven states randomly assigned to core or enhanced conditions after implementing the core intervention at all sites for six months. Enhanced sites received external facilitation for local change team activities to reduce unmet treatment needs; Core sites were encouraged to form interagency workgroups. The dependent variable was percentage referred to treatment among youth in need (N = 14,012). Two-level Bayesian regression assessed factors predicting referral across all sites and time periods. Generalized linear mixed models using logit transformation tested two hypotheses: (H1) referrals will increase from baseline to the experimental period, (H2) referral increases will be larger in enhanced sites than in core sites.

RESULTS

Although the intervention significantly increased referral, condition did not significantly predict referral across all time periods. Youth who tested drug positive, had an alcohol/other drug-related or felony charge, were placed in secure detention or assigned more intensive supervision, or who were White were more likely to be referred. H1 (p < .05) and H2 (p < .0001) were both significant in the hypothesized direction. Interaction analyses comparing site pair differences showed that findings were not consistent across sites.

CONCLUSIONS

The percentage of youth referred to treatment increased compared with baseline overall, and enhanced sites showed larger increases in referrals over time. However, variations in effects suggest that site-level differences were important. Researchers should carry out mixed methods studies to further understand reasons for the inconsistent findings within randomized site pairs, and how to further improve treatment referrals across CS and BH systems. Findings also highlight that even when CS agencies work collaboratively with BH providers to improve referrals, most justice-involved youth who need SU services are not referred.

Wait No Longer: Reducing Medication Wait-Times for Individuals with Co-Occurring Disorders

Objective: Community addiction treatment agencies have utilized Network for the Improvement of Addiction Treatment (NIATx), a proven implementation strategy, to reduce appointment wait-times. However, its effectiveness at reducing medication access wait-times has not been explored. Thus, we conducted an exploratory analysis to evaluate the impact of the NIATx implementation strategies on reduced wait-times to addiction, psychotropic or both medications for individuals with co-occurring disorders (COD). Methods: In a cluster-randomized waitlist control group design, community addiction treatment agencies (n = 49) were randomized to receive the NIATx strategy (Cohort 1, n = 25) or to a Waitlist control (Cohort 2, n = 24). All agencies had a 12-month active intervention period. The primary outcome was the medication encounter wait-time. A univariate general linear model analysis utilizing a logarithmic (log10) transformation examined medication wait-times improvements. Results: The intent-to-treat analysis for psychotropic medications and both medications (reflecting integrated treatment) showed significant main effects for intervention and time, especially comparing Baseline and Year 1 to Year 2. Conversely, only the main effect for time was significant for addiction medications. Wait-time reductions in Cohort 1 agencies was delayed and occurred in the sustainment phase. Wait-times to a psychotropic, addiction, or both medications encounter declined by 3 days, 4.9 days, and 6.8 days, respectively. For Cohort 2 agencies, reduced wait-times were seen for psychotropic (3.4 days), addiction (6 days), and both medications (4.9 days) during their active implementation period. Same- or next-day medication access also improved. Conclusions: NIATx implementation strategies reduced medication encounter wait-times but timing of agency improvements varied. Despite a significant improvement, a three-week wait-time to receive integrated pharmacological interventions is clinically suboptimal for individuals with a COD in need of immediate intervention. Community addiction treatment agencies should identify barriers and implement changes to improve medication access so that their patients "wait no longer" to receive integrated treatment and medications for their COD.

Test of an organizational change model to reduce no-shows in dental care settings

OBJECTIVES

To test the feasibility and preliminary effectiveness of the NIATx model for organizational change to reduce appointment no-shows in dental care settings.

METHODS

The NIATx Dental Pilot Study used a clustered prepost interventional design and a mixed-methods approach. Five independent dental clinics serving Medicaid enrollees were recruited. Quantitative data on the impact of the NIATx model were complemented by qualitative assessment information collected from dental staff. The NIATx model was applied through a multisite learning collaborative that engaged participating organizations in adopting targeted no-show best practices. The primary outcome measure was no-show data collected at the preintervention phase (5 months), intervention phase (7 months), and postintervention phase (3 months).

RESULTS

Female patients were in the majority (median 54.5 percent). Mean age ranged from 8 to 50 (median 35.2) years. The median percentage for Hispanics was 11.0 percent, and the proportion of uninsured patients was 25 percent. Preintervention no-show rates ranged from 14 percent (clinic B) to 38 percent (clinic E). All clinics had lower no-show rates during the postintervention period, with decreases ranging from 1 percent (clinic B) to 13 percent (clinic E). Overall, the no-show rates decreased in the study.

CONCLUSIONS

The study demonstrated the feasibility of applying the NIATx model to reduce no-show rates, with some difficulty observed with sustainability across dental practices during the postintervention period.

Improving Medication Access within Integrated Treatment for Individuals with Co-Occurring Disorders in Substance Use Treatment Agencies

BACKGROUND

The best approach to provide comprehensive care for individuals with co-occurring disorders (CODs) related to substance use and mental health is to address both disorders through an integrated treatment approach. However, only 25% of behavioral health agencies offer integrated care and less than 7% of individuals who need integrated treatment receive it. A project used a cluster-randomized waitlist control group design to evaluate the effectiveness of Network for the Improvement of Addiction Treatment (NIATx) implementation strategies to improve access to addiction and psychotropic medications.

METHODS

This study represents a secondary analysis of data from the NIATx project. Forty-nine agencies were randomized to Cohort1 (active implementation group, receiving the NIATx strategy [n=25]) or Cohort2 (waitlist control group [n=24]). Data were collected at three time points (Baseline, Year1 and Year2). A two-level (patient within agency) multinomial logistic regression model investigated the effects of implementation strategy condition on one of four medication outcomes: both medication types, only psychotropic medication, only addiction medication, or neither medication type. A per-protocol analysis included time, NIATx fidelity, and agency focus as predictors.

RESULTS

The intent-to-treat analysis found a statistically significant change in access to addiction versus neither medication, but Cohort1 compared to Cohort2 at Year1 showed no differences. Changes were associated with the experimental intervention and occurred in the transition from Year 1 to Year 2, where greater increases were seen for agencies in Cohort2 versus Cohort1. The per-protocol analysis showed increased access to both medications and addiction medications from pre- to post-intervention for agencies in both cohorts; however, differences in change between high- and low-implementation agencies were not significant.

CONCLUSIONS

Access to integrated services for people with CODs is a long-standing problem. NIATx implementation strategies had limited effectiveness in improving medication access for individuals with CODs. Implementation strategy adherence is associated with increased medication access.

Development of Rapid Response Capabilities in a Large COVID-19 Alternate Care Site Using Failure Modes and Effect Analysis with In Situ Simulation

Preparedness measures for the anticipated surge of coronavirus disease 2019 (COVID-19) cases within eastern Massachusetts included the establishment of alternate care sites (field hospitals). Boston Hope hospital was set up within the Boston Convention and Exhibition Center to provide low-acuity care for COVID-19 patients and to support local healthcare systems. However, early recognition of the need to provide higher levels of care, or critical care for the potential deterioration of patients recovering from COVID-19, prompted the development of a hybrid acute care-intensive care unit. We describe our experience of implementing rapid response capabilities of this innovative ad hoc unit. Combining quality improvement tools for hazards detection and testing through in situ simulation successfully identified several operational hurdles. Through rapid continuous analysis and iterative change, we implemented appropriate mitigation strategies and established rapid response and rescue capabilities. This study provides a framework for future planning of high-acuity services within a unique field hospital setting.

Bridging Systems to Implement HIV/STI Programming Within the Juvenile Justice System: Strengths and Challenges of a Local Change Team Approach

Justice-involved youth are at risk for HIV/STIs but do not access services. The complex challenges of improving the delivery of health-related services within juvenile justice (JJ) settings warrant exploration of strategies to close this service gap. This study describes the successes and challenges of utilizing a local change team (LCT) strategy comprising JJ and health agency staff to implement HIV/STI programming in JJ settings, across six counties in six states in the U.S. Five focus groups comprising n = 28 JJ and health agency staff who served as LCT members were conducted. Results demonstrated the structured nature of the collaborative process and strength of commitment among LCT members were necessary for successful implementation of HIV/STI programming. The use of LCTs comprising membership of JJ and (behavioral) health systems has broader applicability to other health and behavioral health issues faced by youth on probation that JJ staff may feel ill equipped to address.

A System-Level Intervention to Encourage Collaboration Between Juvenile Justice and Public Health Agencies to Promote HIV/STI Testing

Justice-involved youth are at high risk for HIV and STIs, and justice agencies are uniquely poised to offer HIV/STI testing. However, testing in these settings is not routine and represents a missed opportunity. This study describes a system-level implementation intervention designed to increase access to HIV/STI testing through juvenile justice (JJ) and public health agency collaboration across six counties in six states in the United States. Local change teams, active facilitation, and training were utilized to facilitate agency partnerships and development of HIV/STI practice change protocols. Five counties established health and JJ partnerships and four counties successfully implemented their protocols. Sites with HIV/STI education and testing protocols behaviorally screened 98.5% of youth and tested 41.2% of those youth; 0% were HIV+ and 43.2% had an STI. The intervention provides a feasible, scalable solution, through promoting partnerships between JJ and health agencies, to link youth to testing and treatment services.

Implementing integrated services in routine behavioral health care: primary outcomes from a cluster randomized controlled trial

BACKGROUND

An estimated 8.2 million adults in the United States live with co-occurring mental health and substance use disorders. Although the benefits of integrated treatment services for persons with co-occurring disorders has been well-established, gaps in access to integrated care persist. Implementation research can address this gap. We evaluated if the Network for the Improvement of Addiction Treatment (NIATx) implementation strategy was effective in increasing integrated services capacity among organizations treating persons with co-occurring disorders.

METHODS

This study employed a cluster randomized waitlist control group design. Forty-nine addiction treatment organizations from the State of Washington were randomized into one of two study arms: (1) NIATx strategy (active implementation strategy), or (2) waitlist (control). The primary outcome was a standardized organizational measure of integrated service capability: the Dual Diagnosis in Addiction Treatment (DDCAT) Index. Intent-to-treat analyses and per-protocol analyses were conducted to address the following questions: (1) Is NIATx effective in increasing integrated service capacity? and (2) Are there differences in organizations that actually use NIATx per-protocol versus those that do not?

RESULTS

From baseline to one-year post active implementation, both the NIATx strategy and waitlist arms demonstrated improvements over time in DDCAT Index total and DDCAT dimension scores. In intent-to-treat analyses, a moderate but statistically significant difference in improvement between study arms was seen only in the Program Milieu dimension (p = 0.020, Cohen's d = 0.54). In per-protocol analyses, moderate-to-large effects in Program Milieu (p = 0.002, Cohen's d = 0.91) and Continuity of Care (p = 0.026, Cohen's d = 0.63) dimensions, and in total DDCAT Index (p = 0.046, Cohen's d = 0.51) were found.

CONCLUSIONS

Overall, organizations in both study arms improved DDCAT Index scores over time. Organizations in the NIATx strategy arm with full adherence to the NIATx protocol had significantly greater improvements in the primary outcome measure of integrated service capacity for persons with co-occurring disorders.

TRAIL REGISTRATION

ClinicalTrials.gov, NCT03007940 . Retrospectively registered January 2017.

Overcoming Barriers to Adopting and Implementing Pharmacotherapy: the Medication Research Partnership

Pharmacotherapy includes a growing number of clinically effective medications for substance use disorder, yet there are significant barriers to its adoption and implementation in routine clinical practice. The Medication Research Partnership (MRP) was a successful effort to promote adoption of pharmacotherapy for opioid and alcohol use disorders in nine substance abuse treatment centers and a commercial health plan. This qualitative analysis of interviews (n = 39) conducted with change leaders at baseline and at the end/beginning of 6-month change cycles explains how treatment centers overcame obstacles to the adoption, implementation, and sustainability of pharmacotherapy. Results show that barriers to adopting, implementing, and sustaining pharmacotherapy can be overcome through incremental testing of organizational change strategies, accompanied by expert coaching and a learning community of like-minded professionals. The greatest challenges lie in overcoming abstinence-only philosophies, establishing a business case for pharmacotherapy, and working with payers and pharmaceutical representatives.

Measurement Training and Feedback System for Implementation of family-based services for adolescent substance use: protocol for a cluster randomized trial of two implementation strategies

BACKGROUND

This article describes a study protocol for testing the Measurement Training and Feedback System for Implementation (MTFS-I) and comparing two implementation strategies for MTFS-I delivery. MTFS-I is a web-based treatment quality improvement system designed to increase the delivery of evidence-based interventions for behavioral health problems in routine care settings. This version of MTFS-I focuses on family-based services (FBS) for adolescent substance use. FBS, comprising both family participation in treatment and family therapy technique use, have achieved the strongest evidence base for adolescent substance use and are a prime candidate for upgrading treatment quality in outpatient care. For FBS to fulfill their potential for widespread dissemination, FBS implementation must be bolstered by effective quality procedures that support sustainable delivery in usual care.

METHODS/DESIGN

Adapted from measurement feedback systems for client outcomes, MTFS-I contains three synergistic components: (a) weekly reporter training modules to instruct therapists in reliable post-session self-reporting on FBS utilization; (b) weekly mock session videos of FBS interventions (5-8 min) for supportive training in, and practice coding of, high-quality FBS; and (c) monthly feedback reports to therapists and supervisors displaying aggregated data on therapist-reported FBS use. MTFS-I is hosted online and requires approximately 20 min per week to complete. The study will experimentally compare two well-established implementation strategies designed to foster ongoing MTFS-I usage: Core Training, consisting of two 3-h training sessions focused on FBS site mapping, selecting FBS improvement goals, and sustaining MTFS-I, followed by routine remote technical assistance; and Core + Facilitation, which boosts Core Training sessions with collaborative phone-based clinical consultation and on-site facilitation meetings for 1 year to promote FBS goal achievement. The study design is a cluster randomized trial testing Core Training versus Core + Facilitation in ten substance use treatment clinics. Study aims will compare conditions on MTFS-I uptake, FBS delivery (based on therapist-report and observational data), and 1-year client outcomes.

DISCUSSION

Study contributions to implementation science and considerations of MTFS-I sustainability are discussed.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03342872 . Registered 10 November 2017.

Using NIATx strategies to implement integrated services in routine care: a study protocol

Background

Access to integrated services for individuals with co-occurring substance use and mental health disorders is a long-standing public health issue. Receiving integrated treatment services are both more effective and preferred by patients and families versus parallel or fragmented care. National policy statements and expert consensus guidelines underscore the benefits of integrated treatment. Despite decades of awareness, adequate treatment for individuals with co-occurring substance use and mental health disorders occurs infrequently. The underlying disease burden associated with alcohol, illicit and prescription drug problems, as well as mental health disorders, such as depression, posttraumatic stress disorder and schizophrenia, is substantial.

Methods

This cluster randomized controlled trial (RCT) is designed to determine if the multi-component Network for the Improvement of Addiction Treatment (NIATx) strategies are effective in implementing integrated services for persons with co-occurring substance use and mental health disorders. In this study, 50 behavioral health programs in Washington State will be recruited and then randomized into one of two intervention arms: 1) NIATx implementation strategies, including coaching and learning sessions over a 12-month intervention period to implement changes targeting integrated treatment services; or 2) wait-list control. Primary outcome measures include: 1) fidelity - a standardized organizational assessment of integrated services (Dual Diagnosis in Addiction Treatment [DDCAT] Index); and 2) penetration - proportion of patients screened and diagnosed with co-occurring disorders, proportion of eligible patients receiving substance use and mental health services, and psychotropic or substance use disorder medications. Barriers and facilitators, as determinants of implementation outcomes, will be assessed using the Consolidated Framework for Implementation Research (CFIR) Index. Fidelity to and participation in NIATx strategies will be assessed utilizing the NIATx Fidelity Scale and Stages of Implementation Completion (SIC).

Discussion

This study addresses an issue of substantial public health significance: the gap in access to an evidence-based practice for integrated treatment for individuals with co-occurring mental health and substance use disorders. The study utilizes rigorous and reproducible quantitative approaches to measuring implementation determinants and strategies, and may address a longstanding gap in the quality of care for persons with co-occurring disorders.

Trial registration

ClinicalTrials.gov NCT03007940. Registered 02 January 2017 – Retrospectively Registered

Electronic supplementary material

The online version of this article (10.1186/s12913-018-3241-4) contains supplementary material, which is available to authorized users.

Using Goal Achievement Training in juvenile justice settings to improve substance use services for youth on community supervision

BACKGROUND

The link between substance use and involvement in the juvenile justice system has been well established. Justice-involved youth tend to have higher rates of drug use than their non-offending peers. At the same time, continued use can contribute to an elevated risk of recidivism, which leads to further, and oftentimes more serious, involvement with the juvenile justice system. Because of these high rates of use, the juvenile justice system is well positioned to help identify youth with substance use problems and connect them to treatment. However, research has found that only about 60% of juvenile probation agencies screen all youth for substance involvement, and even fewer provide comprehensive assessment or help youth enroll in substance use treatment.

METHOD

This paper describes an integrated training curriculum that was developed to help juvenile justice agencies improve their continuum of care for youth probationers with substance use problems. Goal Achievement Training (GAT) provides a platform for continuous quality improvement via two sessions delivered onsite to small groups of staff from juvenile justice and behavioral health agencies. In the first session, participants are taught to identify goals and goal steps for addressing identified areas of unmet need (i.e., screening, assessment, and linkage to treatment services). In the second session, participants learn principles and strategies of data-driven decision-making for achieving these goals. This paper highlights GAT as a model for the effective implementation of cost-efficient training strategies designed to increase self-directed quality improvement activities that can be applied to any performance domain within juvenile justice settings. Efforts to monitor implementation fidelity of GAT within the specific context of the juvenile justice settings are highlighted.

DISCUSSION

Challenges to setting the stage for process improvement generally, as well as specific hurdles within juvenile justice settings are discussed, as are next steps in disseminating findings regarding the fidelity to and effectiveness of GAT in this unique context.

TRIAL REGISTRATION

Clinical Trials Registration number - NCT02672150 .

Implementation of Network for the Improvement of Addiction Treatment (NIATx) Processes in Substance Use Disorder Treatment Centers

Internal process improvements embedded within the Network for Improvement of Addiction Treatment (NIATx) program are promising innovations for improving substance use disorder (SUD) treatment performance, such as engagement and retention. To date, few studies have examined the variables that may increase diffusion and implementation of NIATx innovations. This study investigates organizational characteristics associated with SUD treatment center utilization of NIATx process improvements in a sample of 458 treatment programs. Overall, 19% had utilized NIATx process improvements. After statistically controlling environmental factors, five organizational variables were associated with the likelihood that treatment centers used NIATx processes. Organization size, administrative intensity, membership in a provider association, and participation in National Institute on Drug Abuse's Clinical Trials Network were positively associated with the odds of utilizing NIATx processes, while the association for the level of slack resources was negative. The findings suggest that policies and related supportive efforts may be required to facilitate diffusion and implementation of NIATx processes to affect SUD treatment center performance and capacity.

Building capacity for continuous quality improvement (CQI): A pilot study

BACKGROUND AND OBJECTIVE

Little is known about the feasibility, effectiveness, and sustainability of CQI approaches in substance use disorder treatment settings.

METHODS

In the initial phase of this study, eight programs were randomly assigned to receive a CQI intervention or to a waitlist control condition to obtain preliminary information about potential effectiveness. In the second phase, the initially assigned control programs received the CQI intervention to gain additional information about intervention feasibility while sustainability was explored among the initially assigned intervention programs.

RESULTS AND CONCLUSIONS

Although CQI was feasible and sustainable, demonstrating its effectiveness using administrative data was challenging suggesting the need to better align performance measurement systems with CQI efforts. Further, although the majority of staff were enthusiastic about utilizing this approach and reported provider and patient benefits, many noted that dedicated time was needed in order to implement and sustain it.

Continuous quality improvement in substance abuse treatment facilities: How much does it cost?

Continuous quality improvement (CQI) has grown in the U.S. since the 1970s, yet little is known about the costs to implement CQI in substance abuse treatment facilities. This paper is part of a larger group randomized control trial in a large urban county evaluating the impact of Plan-Study-Do-Act (PDSA)-CQI designed for community service organizations (Hunter, Ober, Paddock, Hunt, & Levan, 2014). Operated by one umbrella organization, each of the eight facilities of the study, four residential and four outpatient substance abuse treatment facilities, selected their own CQI Actions, including administrative- and clinical care-related Actions. Using an activity-based costing approach, we collected labor and supplies and equipment costs directly attributable to CQI Actions over a 12-month trial period. Our study finds implementation of CQI and meeting costs of this trial per facility were approximately $2000 to $10,500 per year ($4500 on average), or $10 to $60 per admitted client. We provide a description of the sources of variation in these costs, including differing intensity of the CQI Actions selected, which should help decision makers plan use of PDSA-CQI.

Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: a cluster randomized trial study protocol

BACKGROUND

Evidence-based practice (EBP) implementation represents a strategic change in organizations that requires effective leadership and alignment of leadership and organizational support across organizational levels. As such, there is a need for combining leadership development with organizational strategies to support organizational climate conducive to EBP implementation. The leadership and organizational change for implementation (LOCI) intervention includes leadership training for workgroup leaders, ongoing implementation leadership coaching, 360° assessment, and strategic planning with top and middle management regarding how they can support workgroup leaders in developing a positive EBP implementation climate.

METHODS

This test of the LOCI intervention will take place in conjunction with the implementation of motivational interviewing (MI) in 60 substance use disorder treatment programs in California, USA. Participants will include agency executives, 60 program leaders, and approximately 360 treatment staff. LOCI will be tested using a multiple cohort, cluster randomized trial that randomizes workgroups (i.e., programs) within agency to either LOCI or a webinar leadership training control condition in three consecutive cohorts. The LOCI intervention is 12 months, and the webinar control intervention takes place in months 1, 5, and 8, for each cohort. Web-based surveys of staff and supervisors will be used to collect data on leadership, implementation climate, provider attitudes, and citizenship. Audio recordings of counseling sessions will be coded for MI fidelity. The unit of analysis will be the workgroup, randomized by site within agency and with care taken that co-located workgroups are assigned to the same condition to avoid contamination. Hierarchical linear modeling (HLM) will be used to analyze the data to account for the nested data structure.

DISCUSSION

LOCI has been developed to be a feasible and effective approach for organizations to create a positive climate and fertile context for EBP implementation. The approach seeks to cultivate and sustain both effective general and implementation leadership as well as organizational strategies and support that will remain after the study has ended. Development of a positive implementation climate for MI should result in more positive service provider attitudes and behaviors related to the use of MI and, ultimately, higher fidelity in the use of MI.

TRIAL REGISTRATION

This study is registered with Clinicaltrials.gov ( NCT03042832 ), 2 February 2017, retrospectively registered.

Factors associated with high use of general practitioner and psychiatrist services among patients attending an addiction rehabilitation center

BACKGROUND

This study aimed to 1) identify the characteristics of individuals with substance use disorders (SUDs) who make high use of services provided by general practitioners (GP) and psychiatrists while receiving services concurrently from an addiction rehabilitation center (ARC), and 2) to compare high service users to moderate and low service users.

METHODS

Data were compiled for 4,407 individuals with SUDs who were receiving services from an ARC in 2004. The data came from the merging of four databases: the ARC data registry (January 1(st), 2004-December 31, 2004), the Quebec Health Insurance Board database (March 31, 2003-April 1st, 2005), the Quebec provincial database for hospitalizations (March 31, 2003-April 1st, 2005), and the Quebec National Institute of Public Health database (2004). Independent variables were grouped according to the Andersen Behavioral Model of Health Services Use: predisposing, enabling and need factors. Generalized estimating equations analyses were performed to assess the influence of individual and neighborhood-level characteristics on high use of services outside the ARC provided by GPs and psychiatrists. Benjamini-Hochberg's procedure was applied to correct for multiple comparisons.

RESULTS

About 97 % of individuals attending the ARC consulted a GP or a psychiatrist during the two-year study period, for a mean of 1.5 consultations per month. Findings revealed that 5 % of the sample made 26 % of all consultations over the two years, and they were defined as high users. No single predisposing factor was associated with high use. One enabling factor significantly increased the risk of being a high user of services from general practitioners and psychiatrists: receiving services at the ARC for three years prior to 2004. Four needs factors, all related to mental health diagnoses (schizophrenia, mood disorder, anxiety disorder, personality disorder), predicted high use of general practitioner and psychiatrist services.

CONCLUSIONS

This study found that nearly all individuals with SUDs receiving services from an ARC were users of health services from GPs and psychiatrists outside the ARC. High users most probably accessed them in inpatient settings. No previous study has compared high service users with low and moderate users among individuals with SUDs. Considering that ARCs are treating individuals with complex needs, some of whom make high use of medical professionals, both ARCs and their clients could benefit from increased collaboration and integration between the addictions and mental healthcare sectors.

Juvenile Justice-Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS): a cluster randomized trial targeting system-wide improvement in substance use services

Background

The purpose of this paper is to describe the Juvenile Justice—Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS) study, a cooperative implementation science initiative involving the National Institute on Drug Abuse, six research centers, a coordinating center, and Juvenile Justice Partners representing seven US states. While the pooling of resources across centers enables a robust implementation study design involving 36 juvenile justice agencies and their behavioral health partner agencies, co-producing a study protocol that has potential to advance implementation science, meets the needs of all constituencies (funding agency, researchers, partners, study sites), and can be implemented with fidelity across the cooperative can be challenging. This paper describes (a) the study background and rationale, including the juvenile justice context and best practices for substance use disorders, (b) the selection and use of an implementation science framework to guide study design and inform selection of implementation components, and (c) the specific study design elements, including research questions, implementation interventions, measurement, and analytic plan.

Methods/design

The JJ-TRIALS primary study uses a head-to-head cluster randomized trial with a phased rollout to evaluate the differential effectiveness of two conditions (Core and Enhanced) in 36 sites located in seven states. A Core strategy for promoting change is compared to an Enhanced strategy that incorporates all core strategies plus active facilitation. Target outcomes include improvements in evidence-based screening, assessment, and linkage to substance use treatment.

Discussion

Contributions to implementation science are discussed as well as challenges associated with designing and deploying a complex, collaborative project.

Trial registration

NCT02672150.

[Factors Associated With the Temporary Abandonment of Treatment for Disorders Due to Substance Abuse in an Institution in Medellin, Colombia]

OBJECTIVE

To determine the frequency and factors associated withtreatment drop-out in patients from a Substance User Treatment Center in Medellín, Colombia.

METHODS

A case-control study was conducted, with patients with an early treatment dropout as cases, and patients who completed the treatment as controls. Demographic data, substance use pattern, concomitant diseases, and the decision to initiate treatment were compared between cases and controls.

RESULTS

The frequency of early drop-out was 59%, but a high proportion of this drop-out (47.5%) occurred in the transition period between the program stages. The variables associated with drop-out were: psychotic disorder (OR=0.32; 95% CI, 0.11-0.91), bipolar disorder (OR=0.31; 95% CI, 0.12-0.77), heroin as the principal substance compared to alcohol (OR=6.68; 95% CI, 1.52-29.4), decision to initiate the treatment by the family compared to personal decision (OR=3.02; 95% CI, 1.28-7.17), and previous treatments (OR=1.87; 95% CI, 1.02-3.44).

CONCLUSIONS

The drop-out frequency is similar to those reported in other studies. Associated factors were found, which could be considered in order to plan strategies to improve the program results.

Continuous quality improvement (CQI) in addiction treatment settings: design and intervention protocol of a group randomized pilot study

Background

Few studies have designed and tested the use of continuous quality improvement approaches in community based substance use treatment settings. Little is known about the feasibility, costs, efficacy, and sustainment of such approaches in these settings.

Methods/Design

A group-randomized trial using a modified stepped wedge design is being used. In the first phase of the study, eight programs, stratified by modality (residential, outpatient) are being randomly assigned to the intervention or control condition. In the second phase, the initially assigned control programs are receiving the intervention to gain additional information about feasibility while sustainment is being studied among the programs initially assigned to the intervention.

Discussion

By using this design in a pilot study, we help inform the field about the feasibility, costs, efficacy and sustainment of the intervention. Determining information at the pilot stage about costs and sustainment provides value for designing future studies and implementation strategies with the goal to reduce the time between intervention development and translation to real world practice settings.

Implementing drug abuse treatment services in criminal justice settings: Introduction to the CJ-DATS study protocol series

BACKGROUND

Despite a growing pipeline of effective clinical treatments, there remains a persistent research-to-practice gap in drug abuse services. Delivery of effective treatment services is especially lacking in the U.S. criminal justice system, where half of all incarcerated persons meet the need for drug abuse or dependence, yet few receive needed care. Structural, financial, philosophical and other barriers slow the pace of adoption of available evidence-based practices. These challenges led to the development of a multi-site cooperative research endeavor known as the Criminal Justice Drug Abuse Treatment Studies (CJ-DATS), funded by the National Institute on Drug Abuse (NIDA). CJ-DATS engages university-based research teams, criminal justice agencies, and community-based treatment providers in implementation research studies to test strategies for enhancing treatment service delivery to offender populations.

METHODS

This Introduction reviews the mission of NIDA, the structure and goals of the CJ-DATS cooperative, and the implementation studies being conducted by the participating organizations. The component Study Protocols in this article collection are then described.

DISCUSSION

CJ-DATS applies implementation science perspectives and methods to address a vexing problem - the need to link offender populations with effective treatment for drug abuse, HIV, and other related conditions for which they are at high risk. Applying these principles to the U.S. criminal justice system is an innovative extension of lessons that have been learned in mainstream healthcare settings. This collection is offered as both an introduction to NIDA's work in this area, as well as a window onto the challenges of conducting health services research in settings in which improving public health is not the organization's core mission.

Scaling up HIV prevention efforts targeting people who inject drugs in Central Asia: a review of key challenges and ways forward

BACKGROUND

In Central Asia, between 33% and 72% of cumulative HIV infections has been attributed to unsafe injection practices among people who inject drugs (PWID).

METHODS

We reviewed the current status and trends of national efforts in Central Asian countries to control HIV among PWID, and also reviewed the key structural and health-systems-related challenges that facilitate drug-use-related HIV risk in Central Asia.

RESULTS

The spectrum and scale of HIV prevention services targeting PWID vary considerably among Central Asian countries. In all countries, the potential impact of these interventions is hindered by several key features: a restrictive legal environment, poor performance of service providers, widespread opposition to harm reduction, deficient human resources and funding mechanisms, poor services integration, insufficient community involvement, and other structural factors.

CONCLUSIONS

Scaling up HIV prevention interventions in Central Asia will demand greater attention to the structural, health-care-related and social factors that facilitate HIV risk and impede service utilization among PWID. Multi-level combination prevention interventions should be developed with a focus on the sexual partners and risk networks of PWID, aiming at early detection of HIV, timely enrollment in HIV care, and retention in HIV care.