Consultation as an implementation strategy for evidence-based practices across multiple contexts: unpacking the black box

Effects of Fidelity-Focused Consultation on Clinicians' Implementation: An Exploratory Multiple Baseline Design

Identification of effective consultation models could inform implementation efforts. This study examined the effects of a fidelity-focused consultation model among community-based clinicians implementing Attachment and Biobehavioral Catch-up. Fidelity data from 1217 sessions from 7 clinicians were examined in a multiple baseline design. In fidelity-focused consultation, clinicians received feedback from consultants' fidelity coding, and also coded their own fidelity. Clinicians' fidelity increased after fidelity-focused consultation began, but did not increase during other training periods. Fidelity was sustained for 30 months after consultation ended. Findings suggest that consultation procedures involving fidelity coding feedback and self-monitoring of fidelity may promote implementation outcomes.

Implementation support practitioners - a proposal for consolidating a diverse evidence base

BACKGROUND

Workforce development for implementation practice has been identified as a grand challenge in health services. This is due to the embryonic nature of the existing research in this area, few available training programs and a general shortage of frontline service staff trained and prepared for practicing implementation in the field. The interest in the role of "implementation support" as a way to effectively build the implementation capacities of the human service sector has therefore increased. However, while frequently used, little is known about the skills and competencies required to effectively provide such support.

MAIN BODY

To progress the debate and the research agenda on implementation support competencies, we propose the role of the "implementation support practitioner" as a concept unifying the multiple streams of research focused on e.g. consultation, facilitation, or knowledge brokering. Implementation support practitioners are professionals supporting others in implementing evidence-informed practices, policies and programs, and in sustaining and scaling evidence for population impact. They are not involved in direct service delivery or management and work closely with the leadership and staff needed to effectively deliver direct clinical, therapeutic or educational services to individuals, families and communities. They may be specialists or generalists and be located within and/or outside the delivery system they serve. To effectively support the implementation practice of others, implementation support practitioners require an ability to activate implementation-relevant knowledge, skills and attitudes, and to operationalize and apply these in the context of their support activities. In doing so, they aim to trigger both relational and behavioral outcomes. This thinking is reflected in an overarching logic outlined in this article.

CONCLUSION

The development of implementation support practitioners as a profession necessitates improved conceptual thinking about their role and work and how they enable the uptake and integration of evidence in real world settings. This article introduces a preliminary logic conceptualizing the role of implementation support practitioners informing research in progress aimed at increasing our knowledge about implementation support and the competencies needed to provide this support.

Using Technology to Train Clinicians in Evidence-Based Treatment: A Systematic Review

OBJECTIVE

There is a critical shortage of clinicians trained in evidence-based treatments (EBTs). New technologies, such as Internet-based training, video conferences, and mobile applications, can increase accessibility to specialized training and enhance traditional face-to-face training. A systematic review was conducted to identify and summarize research on the use of technology to train clinicians in EBTs.

METHODS

An electronic database search of PsycINFO, PubMed, Medline, Web of Science, CINAHL, and the Cochrane Library was conducted in June 2018. Articles were independently coded and assessed for risk of bias by two reviewers using the National Heart, Lung, and Blood Institute's Quality Assessment Tool for Controlled Intervention Studies.

RESULTS

Of the 7,767 citations initially identified, 24 articles met inclusion criteria. These articles described 21 training programs, including training for anxiety, depression, substance abuse, and eating disorder treatment. Most training programs were Internet based (N=19), and a majority of studies used a randomized controlled design (N=21). Most studies reported significant increases in clinician knowledge or skills, with small to large effect sizes. The methodological quality of studies ranged from good to poor. Many programs were limited by their use of completer analyses (i.e., only those who completed study included in analyses) and self-report measures.

CONCLUSIONS

Technology has great potential for increasing availability of training opportunities for clinicians and increasing the workforce trained in EBTs. Although technology-assisted training programs are not without limitations, overall they promise a new era of facilitative learning that promotes the adoption of new clinical practices in a dynamic and efficient manner.

Enhancing primary care services for diverse sexual and gender minority populations: a developmental study protocol

INTRODUCTION

Compared with heterosexual, cisgender populations, sexual and gender minority (SGM) people are more likely to suffer from serious health conditions and insufficient access to health services. Primary care is at the frontlines of healthcare delivery; yet, few clinics have resources or mechanisms in place to meet SGM patient needs. This developmental study protocol focuses on reducing health disparities among SGM patients by identifying, adapting and developing SGM practice guidelines/recommendations and implementation strategies for primary care clinics in urban and rural New Mexico. Using input from patients, healthcare advocates and providers, and researchers, the study will pilot a practice parameter and implementation toolkit to promote SGM-specific cultural competence at multiple service delivery levels.

METHODS AND ANALYSIS

We will recruit providers/staff from four Federally Qualified Health Centers (FQHCs) serving ethnically and geographically diverse communities. Incorporating the Implementation of Change Model and an intersectionality perspective, data collection includes a systematic review of SGM-specific practice guidelines/recommendations, focus groups and semistructured interviews, quantitative surveys and the Nominal Group Technique (NGT) with providers/staff. We will categorise guidelines/recommendations identified through the review by shared elements, use iterative processes of open and focused coding to analyse qualitative data from focus groups, interviews and the NGT, and apply descriptive statistics to assess survey data. Findings will provide the foundation for the toolkit. Focus groups with SGM patients will yield supplemental information for toolkit refinement. To investigate changes in primary care contexts following the toolkit's pilot, we will undertake systematic walkthroughs and document review at the FQHCs, analysing these data qualitatively to examine SGM inclusiveness. The structured data-informed Plan-Do-Study-Act method will enable further revision of the toolkit. Finally, focus groups, interviews and quantitative surveys with providers/staff will highlight changes made in the FQHCs to address SGM patient needs, barriers to sustainment of changes, satisfaction, acceptability, usability and feasibility of the toolkit.

ETHICS AND DISSEMINATION

The study has been reviewed and approved by the Pacific Institute for Research and Evaluation Institutional Review Board. Informed consent will be obtained from all participants before their involvement in research activities begins. Study results will be actively disseminated through peer-reviewed journals, conference presentations, social media and the internet, and community/stakeholder engagement activities.

Trauma-Responsive Care in a Pediatric Setting: Feasibility and Acceptability of Screening for Adverse Childhood Experiences

Adverse childhood experiences (ACEs) have demonstrable negative effects on long-term physical and mental health. Low-income and ethnic minority communities face significant disparities in exposure to ACEs. Pediatric settings offer an opportune context to identify and address ACEs, with the potential to reduce barriers in access to resources and services. The current study examined the feasibility and acceptability of screening infants and their parents for ACEs at a community medical clinic. Feasibility data indicated that 151 (92%) of the 164 unique patients that presented for well-child visits for infants (4- to 12-months) across a 13-month period were screened for infant and parent ACEs. Of these 151 patients, 47% met eligibility (infants with 1 + ACEs, parents with 2 + ACEs) deemed intermediate risk and indicated referral to prevention services. The majority of referred families (77%) accepted prevention services, including appointments with bilingual and bicultural wellness navigators who provided a cultural bridge and access to resources that could address patients' social determinants of health. Qualitative interviews with providers expand upon screening acceptability. Implications for integrated behavioral health, ACEs screening, and trauma-responsive prevention in a pediatric setting are discussed.

SIPsmartER delivered through rural, local health districts: adoption and implementation outcomes

BACKGROUND

SIPsmartER is a 6-month evidenced-based, multi-component behavioral intervention that targets sugar-sweetened beverages among adults. It consists of three in-person group classes, one teach-back call, and 11 automated phone calls. Given SIPsmartER's previously demonstrated effectiveness, understanding its adoption, implementation, and potential for integration within a system that reaches health disparate communities is important to enhance its public health impact. During this pilot dissemination and implementation trial, SIPsmartER was delivered by trained staff from local health districts (delivery agents) in rural, Appalachian Virginia. SIPsmartER's execution was supported by consultee-centered implementation strategies.

METHODS

In this mixed-methods process evaluation, adoption and implementation indicators of the program and its implementation strategy (e.g., fidelity, feasibility, appropriateness, acceptability) were measured using tracking logs, delivery agent surveys and interviews, and fidelity checklists. Quantitative data were analyzed with descriptive statistics. Qualitative data were inductively coded.

RESULTS

Delivery agents implemented SIPsmartER to the expected number of cohorts (n = 12), recruited 89% of cohorts, and taught 86% of expected small group classes with > 90% fidelity. The planned implementation strategies were also executed with high fidelity. Delivery agents completing the two-day training, pre-lesson meetings, fidelity checklists, and post-lesson meetings at rates of 86, 75, 100, and 100%, respectively. Additionally, delivery agents completed 5% (n = 3 of 66) and 10% (n = 6 of 59) of teach-back and missed class calls, respectively. On survey items using 6-point scales, delivery agents reported, on average, higher feasibility, appropriateness, and acceptability related to delivering the group classes (range 4.3 to 5.6) than executing missed class and teach-back calls (range 2.6 to 4.6). They also, on average, found the implementation strategy activities to be helpful (range 4.9 to 6.0). Delivery agents identified strengths and weakness related to recruitment, lesson delivery, call completion, and the implementation strategy.

CONCLUSIONS

In-person classes and the consultee-centered implementation strategies were viewed as acceptable, appropriate, and feasible and were executed with high fidelity. However, implementation outcomes for teach-back and missed class calls and recruitment were not as strong. Findings will inform the future full-scale dissemination and implementation of SIPsmartER, as well as other evidence-based interventions, into rural health districts as a means to improve population health.

Clinical Supervision of Mental Health Professionals Serving Youth: Format and Microskills

Clinical supervision is an element of quality assurance in routine mental health care settings serving children; however, there is limited scientific evaluation of its components. This study examines the format and microskills of routine supervision. Supervisors (n = 13) and supervisees (n = 20) reported on 100 supervision sessions, and trained coders completed observational coding on a subset of recorded sessions (n = 57). Results indicate that microskills shown to enhance supervisee competency in effectiveness trials and experiments were largely absent from routine supervision, highlighting potential missed opportunities to impart knowledge to therapists. Findings suggest areas for quality improvement within routine care settings.

Promoting Teachers' Implementation of Classroom-Based Prevention Programming Through Coaching: The Mediating Role of the Coach-Teacher Relationship

There is growing awareness of the importance of implementation fidelity and the supports, such as coaching, to optimize it. This study examined how coaching activities (i.e., check-ins, needs assessment, modeling, and technical assistance) related directly and indirectly to implementation dosage and quality of the PAX Good Behavior Game, via a mediating pathway through working relationship. Mediation analyses of 138 teachers revealed direct effects of modeling and working relationship on implementation dosage, whereas needs assessment was associated with greater dosage indirectly, by higher ratings of the working relationship. Understanding how coaching activities promote implementation fidelity elements has implications for improving program effectiveness.

Implementation Science in Nutrition: Concepts and Frameworks for an Emerging Field of Science and Practice

Malnutrition in all its forms has risen on global and national agendas in recent years because of the recognition of its magnitude and its consequences for a wide range of human, social, and economic outcomes. Although the WHO, national governments, and other organizations have endorsed targets and identified appropriate policies, programs, and interventions, a major challenge lies in implementing these with the scale and quality needed to achieve population impact. This paper presents an approach to implementation science in nutrition (ISN) that builds upon concepts developed in other policy domains and addresses critical gaps in linking knowledge to effective action. ISN is defined here as an interdisciplinary body of theory, knowledge, frameworks, tools, and approaches whose purpose is to strengthen implementation quality and impact. It includes a wide range of methods and approaches to identify and address implementation bottlenecks; means to identify, evaluate, and scale up implementation innovations; and strategies to enhance the utilization of existing knowledge, tools, and frameworks based on the evolving science of implementation. The ISN framework recognizes that quality implementation requires alignment across 5 domains: the intervention, policy, or innovation being implemented; the implementing organization(s); the enabling environment of policies and stakeholders; the individuals, households, and communities of interest; and the strategies and decision processes used at various stages of the implementation process. The success of aligning these domains through implementation research requires a culture of inquiry, evaluation, learning, and response among program implementers; an action-oriented mission among the research partners; continuity of funding for implementation research; and resolving inherent tensions between program implementation and research. The Society for Implementation Science in Nutrition is a recently established membership society to advance the science and practice of nutrition implementation at various scales and in varied contexts.

Who Wants Feedback? Effects of Transformational Leadership and Leader-Member Exchange on Mental Health Practitioners' Attitudes Toward Feedback

OBJECTIVE

The purpose of this study was to identify the mechanisms through which different aspects of leadership affect mental health practitioners' attitudes toward supervisory feedback.

METHODS

Data were collected from 363 practitioners nested in 68 treatment teams in public-sector mental health organizations. A multilevel path analysis was conducted to examine the associations of transformational leadership (supervisor's ability to inspire others to follow a course of action) and leader-member exchange (quality of the supervisor-practitioner relationship) with practitioner attitudes toward feedback.

RESULTS

Transformational leadership and leader-member exchange were directly and positively associated with practitioners' attitudes toward feedback. Transformational leadership was also indirectly associated with practitioners' attitudes toward feedback through the quality of supervisor-practitioner relationships.

CONCLUSIONS

Study results contribute to the growing body of evidence suggesting that leaders play a key role in shaping mental health service delivery. Both leadership behavior and high-quality supervisor-practitioner relationships are important in supporting practitioners in delivering evidence-based mental health care. Policymakers, administrators, and researchers should consider an integrative approach when developing leadership training interventions.

Implementation Climate and Time Predict Intensity of Supervision Content Related to Evidence Based Treatment

Objective: Children infrequently receive evidence-based treatments (EBTs) for mental health problems due to a science-to-practice implementation gap. Workplace-based clinical supervision, in which supervisors provide oversight, feedback, and training on clinical practice, may be a method to support EBT implementation. Our prior research suggests that the intensity of supervisory focus on EBT (i.e., thoroughness of coverage) during workplace-based supervision varies. This study explores predictors of supervisory EBT intensity.

Methods: Participants were twenty-eight supervisors and 70 clinician supervisees. They completed a baseline survey, and audio recorded supervision sessions over 1 year. Four hundred and thirty eight recordings were coded for supervision content. We chose to explore predictors of two EBT content elements due to their strong evidence for effectiveness and sufficient variance to permit testing. These included a treatment technique (“exposure”) and a method to structure treatment (“assessment”). We also explored predictors of non-EBT content (“other topics”). Mixed-effects models explored predictors at organizational/supervisor, clinician, and session levels.

Results: Positive implementation climate predicted greater intensity of EBT content coverage for assessment (coefficient = 0.82, p = 0.004) and exposure (coefficient = 0.87, p = 0.001). Intensity of exposure coverage was also predicted by more time spent discussing each case (coefficient = 0.04, p < 0.001). Predictors of greater non-EBT content coverage included longer duration of supervision sessions (coefficient = 0.05, p < 0.001) and lower levels of supervisor EBT knowledge (coefficient = −0.17, p = 0.013). No other supervisor- or clinician-level variables were significant predictors in the mixed effects models.

Conclusion: This was the first study to explore multi-level predictors of objectively coded workplace-based supervision content. Results suggest that organizations that expect, support and reward EBT are more likely to have greater intensity of EBT supervision coverage, which in turn may positively impact clinician EBT fidelity and client outcomes. There was evidence that supervisor knowledge of the EBT contributes to greater coverage, although robust supervisor and clinician factors that drive supervision are yet to be identified. Findings highlight the potential effectiveness of implementation strategies that simultaneously address organizational implementation climate and supervisor practices. More research is needed to identify mechanisms that support integration of EBT into supervision.

Adaptive School-based Implementation of CBT (ASIC): clustered-SMART for building an optimized adaptive implementation intervention to improve uptake of mental health interventions in schools

Background

Depressive and anxiety disorders affect 20–30% of school-age youth, most of whom do not receive adequate services, contributing to poor developmental and academic outcomes. Evidence-based practices (EBPs) such as cognitive behavioral therapy (CBT) can improve outcomes, but numerous barriers limit access among affected youth. Many youth try to access mental health services in schools, but school professionals (SPs: counselors, psychologists, social workers) are rarely trained adequately in CBT methods. Further, SPs face organizational barriers to providing CBT, such as lack of administrative support. Three promising implementation strategies to address barriers to school-based CBT delivery include (1) Replicating Effective Programs (REP), which deploys customized CBT packaging, didactic training in CBT, and technical assistance; (2) coaching, which extends training via live supervision to improve SP competence in CBT delivery; and (3) facilitation, which employs an organizational expert who mentors SPs in strategic thinking to promote self-efficacy in garnering administrative support. REP is a relatively low-intensity/low-cost strategy, whereas coaching and facilitation require additional resources. However, not all schools will require all three strategies. The primary aim of this study is to compare the effectiveness of a school-level adaptive implementation intervention involving REP, coaching, and facilitation versus REP alone on the frequency of CBT delivered to students by SPs and student mental health outcomes. Secondary and exploratory aims examine cost-effectiveness, moderators, and mechanisms of implementation strategies.

Methods

Using a clustered, sequential multiple-assignment, randomized trial (SMART) design, ≥ 200 SPs from 100 schools across Michigan will be randomized initially to receive REP vs. REP+coaching. After 8 weeks, schools that do not meet a pre-specified implementation benchmark are re-randomized to continue with the initial strategy or to augment with facilitation.

Discussion

EBPs need to be implemented successfully and efficiently in settings where individuals are most likely to seek care in order to gain large-scale impact on public health. Adaptive implementation interventions hold the promise of providing cost-effective implementation support. This is the first study to test an adaptive implementation of CBT for school-age youth, at a statewide level, delivered by school staff, taking an EBP to large populations with limited mental health care access.

Trial registration

NCT03541317—Registered on 29 May 2018 on ClinicalTrials.gov PRS

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0808-8) contains supplementary material, which is available to authorized users.

Improving STI and HIV Passive Partner Notification using the Model for Improvement: A Quality Improvement Study in Lilongwe Malawi

Background:

In Malawi, passive partner notification is the mainstay method of partner notification (PN). Despite its wide use, the proportion of sexual partners referred for care through this method is very low. We aimed to increase the proportion of sexual partner referral through passive PN.

Methods:

We implemented a quality improvement (QI) project at Bwaila STI unit in Lilongwe, Malawi between January and June 2017 using a pre- and post- intervention quasi-experimental study design. Pre-intervention, we conducted key-informant interviews and clinic observations and used the findings to design a QI project using expert opinion. The intervention included three change ideas: early start time of the clinic, shortening of the group health talk and expedited clinic flow for sexual partners. Each change idea was tested twice through 1-week long Plan-Do-Study-Act cycles using the model for improvement (MFI) and then combined and tested twice. Process data were collected and monitored using run charts. Post-intervention, we evaluated the proportion of sexual partners who presented to the clinic, to detect a 10% increase at 95% power and α=0.05, between pre- and post-intervention periods.

Results:

The average duration of the group health talk dropped from 56 minutes to 38 minutes and the duration of clinic stay for sexual partners reduced by 45 minutes (from 1hour 36 minutes to 51 minutes). The average clinic start time improved from 09:02 hours to 08:17 hours. The proportion of sexual partner referral increased by 37% (P=0.04) - from 15.6% to 21.4%. We observed an upward trend in the proportion of sexual partners referred in the post-intervention period.

Conclusion:

The yield of sexual partners through passive PN was improved using a simple QI intervention implemented using the MFI. However, the proportion of sexual partner referral remains suboptimal. More effort is required to increase the proportion of sexual partner referral in Malawi.

Pilot to policy: statewide dissemination and implementation of evidence-based treatment for traumatized youth

BACKGROUND

A model for statewide dissemination of evidence-based treatment (EBT) for traumatized youth was piloted and taken to scale across North Carolina (NC). This article describes the implementation platform developed, piloted, and evaluated by the NC Child Treatment Program to train agency providers in Trauma-Focused Cognitive Behavioral Therapy using the National Center for Child Traumatic Stress Learning Collaborative (LC) Model on Adoption & Implementation of EBTs. This type of LC incorporates adult learning principles to enhance clinical skills development as part of training and many key implementation science strategies while working with agencies and clinicians to implement and sustain the new practice.

METHODS

Clinicians (n = 124) from northeastern NC were enrolled in one of two TF-CBT LCs that lasted 12 months each. During the LC clinicians were expected to take at least two clients through TF-CBT treatment with fidelity and outcomes monitoring by trainers who offered consultation by phone and during trainings. Participating clinicians initiated treatment with 281 clients. The relationship of clinician and client characteristics to treatment fidelity and outcomes was examined using hierarchical linear regression.

RESULTS

One hundred eleven clinicians completed general training on trauma assessment batteries and TF-CBT. Sixty-five clinicians met all mastery and fidelity requirements to meet roster criteria. One hundred fifty-six (55%) clients had fidelity-monitored assessment and TF-CBT. Child externalizing, internalizing, and post-traumatic stress symptoms, as well as parent distress levels, decreased significantly with treatment fidelity moderating child PTSD outcomes. Since this pilot, 11 additional cohorts of TF-CBT providers have been trained to these roster criteria.

CONCLUSION

Scaling up or outcomes-oriented implementation appears best accomplished when training incorporates: 1) practice-based learning, 2) fidelity coaching, 3) clinical assessment and outcomes-oriented treatment, 4) organizational skill-building to address barriers for agencies, and 5) linking clients to trained clinicians via an online provider roster. Demonstrating clinician performance and client outcomes in this pilot and subsequent cohorts led to legislative support for dissemination of a service array of EBTs by the NC Child Treatment Program.

Coaching Models of School-Based Prevention and Promotion Programmes: A Qualitative Exploration of UK Teachers' Perceptions

There has been increased interest in recent years regarding the utility of imported universal prevention and promotion (P&P) programmes in UK schools, many of which have a coaching model attached. However, there have been relatively few studies exploring the cultural transferability and social validity of these models, even though evidence suggests that these factors are important to the successful implementation of the programmes, and thus the achievement of the intended outcomes. The aim of the current study was to explore the coaching practices that teachers report experiencing, and to further understanding of the perceived benefits of these coaching practices to teachers. The sample consisted of 33 teachers implementing one of two universal, school-based P&P programmes, Good Behavior Game and Promoting Alternative Thinking Strategies as part of large-scale, randomised controlled trials. Qualitative, semi-structured interviews were conducted, and data were analysed thematically utilising a hybrid approach. Teachers typically reported engaging in six distinct practices with their coaches. While the majority of these practices were in line with coaching literature, there were some discrepancies between intended coaching practices and teachers’ reports. The coaching practices were generally perceived to be acceptable to teachers. Two unanticipated practices, validation and motivation, appeared to be of particular value to teachers, although these are not currently a prominent feature in existing coaching models. The findings provide implications for improving the development of socially valid coaching models for UK schools.

Group CBT for Externalizing Disorders in Urban Schools: Effect of Training Strategy on Treatment Fidelity and Child Outcomes

Public schools are an ideal setting for the delivery of mental health services to children. Unfortunately, services provided in schools, and more so in urban schools, have been found to lead to little or no significant clinical improvements. Studies with urban school children seldom report on the effects of clinician training on treatment fidelity and child outcomes. This study examines the differential effects of two levels of school-based counselor training: training workshop with basic consultation (C) vs. training workshop plus enhanced consultation (C+) on treatment fidelity and child outcomes. Fourteen school staff members (counselors) were randomly assigned to C or C+. Counselors implemented a group cognitive behavioral therapy protocol (Coping Power Program, CPP) for children with or at risk for externalizing behavior disorders. Independent coders coded each CPP session for content and process fidelity. Changes in outcomes from pre to post were assessed via a parent psychiatric interview and interviewer-rated severity of illness and global impairment. Counselors in C+ delivered CPP with significantly higher levels of content and process fidelity compared to counselors in C. Both C and C+ resulted in significant improvement in interviewer-rated impairment; the conditions did not differ from each other with regard to impairment. Groups did not differ with regard to pre- to- posttreatment changes in diagnostic severity level. School-based behavioral health staff in urban schools are able to implement interventions with fidelity and clinical effectiveness when provided with ongoing consultation. Enhanced consultation resulted in higher fidelity. Enhanced consultation did not result in better student outcomes compared to basic consultation. Implications for resource allocation decisions with staff training in EBP are discussed.

Web-Based Training Methods for Behavioral Health Providers: A Systematic Review

There has been an increase in the use of web-based training methods to train behavioral health providers in evidence-based practices. This systematic review focuses solely on the efficacy of web-based training methods for training behavioral health providers. A literature search yielded 45 articles meeting inclusion criteria. Results indicated that the serial instruction training method was the most commonly studied web-based training method. While the current review has several notable limitations, findings indicate that participating in a web-based training may result in greater post-training knowledge and skill, in comparison to baseline scores. Implications and recommendations for future research on web-based training methods are discussed.

A Mixed Methods Study of the Stages of Implementation for an Evidence-Based Trauma Intervention in Schools

A mixed methods study was conducted to examine the implementation process of 26 urban school-based mental health clinics that took part in a training and implementation support program for an evidence-based school trauma intervention. Implementation process was observed using the Stages of Implementation Completion (SIC) measure. Qualitative interviews were conducted with clinic leaders in order to gain insight into clinic processes related to the SIC. Results showed that almost all of the clinics engaged in some activities related to pre-implementation (engagement, feasibility, and readiness), but only 31% of the sites formally started delivering the program to youth. Completing more pre-implementation activities, particularly those related to readiness, predicted program start-up. Qualitative analysis comparing those that implemented the program to those that did not revealed critical differences in decision-making processes, leadership strategies, and the presence of local champions for the program. This study documented the patterns of clinic behavior that occurs as part of large-scale training efforts, suggests some unique challenges that occur in schools, and highlights the importance of engaging in particular implementation activities (i.e., readiness planning, stakeholder consensus and planning meetings) as part of program start-up. Findings indicate that pre-implementation and readiness-related consultation should be employed as part of broad-scale implementation and training efforts.

How Intervention and Implementation Characteristics Relate to Community Therapists' Attitudes Toward Evidence-Based Practices: A Mixed Methods Study

Therapists' perceptions toward evidence-based practices (EBPs) are important in implementation efforts, however little is known about characteristics of EBPs associated with more positive attitudes. This mixed-methods study examined how intervention and implementation characteristics of six EBPs related to therapist attitudes. Quantitative analysis of 793 cross-sectional surveys revealed that therapists endorsed more positive attitudes toward EBPs with (1) prescribed session content and order and (2) required consultation. Associations between these intervention and implementation characteristics and attitudes were not moderated by therapist experience or emotional exhaustion. Qualitative analyses complemented quantitative findings, indicating that "structure" was appealing for interventions and that therapists felt supported by consultation.

The Juggling Act of Supervision in Community Mental Health: Implications for Supporting Evidence-Based Treatment

Supervisors are an underutilized resource for supporting evidence-based treatments (EBTs) in community mental health. Little is known about how EBT-trained supervisors use supervision time. Primary aims were to describe supervision (e.g., modality, frequency), examine functions of individual supervision, and examine factors associated with time allocation to supervision functions. Results from 56 supervisors and 207 clinicians from 25 organizations indicate high prevalence of individual supervision, often alongside group and informal supervision. Individual supervision serves a wide range of functions, with substantial variation at the supervisor-level. Implementation climate was the strongest predictor of time allocation to clinical and EBT-relevant functions.

The effectiveness of consultation for clinicians learning to deliver motivational interviewing with fidelity

Despite the emerging literature documenting gains in clinician competence following consultation, little empirical work has examined consultation as an implementation strategy. To this end, the present study examined consultation in the context of implementing motivational interviewing in four community child and youth mental health organizations. We used qualitative methods with a dual goal: to describe the consultation process and to explore trainees' perspectives on consultation. Participants included 22 clinicians and 9 supervisors who received monthly, group, phone-based consultation for seven months following training in motivational interviewing. Analyses showed that consultation was perceived as effective because it helped to "keep motivational interviewing alive," fulfilled a profound learning function through collaboration and connection with others, and served as protected time for reflection on practice change. Our findings contribute to a body of knowledge about consultation elements that appear to be effective when implementing research-supported interventions in child and youth mental health.

Clinical Case Consultation and Experiential Learning in Cognitive Behavioral Therapy Implementation: Brief Qualitative Investigation

There has been an increased emphasis on the implementation of cognitive behavioral therapy (CBT) to community mental health (CMH) systems due to its broad efficacy. Previous research has highlighted the importance of ongoing consultation in this process. The current study clarifies the role and process of clinical case consultation in the implementation of CBT to CMH from the consultants' perspective. Trainers from two large-scale implementation initiatives (n = 27) were surveyed regarding their strategies used in the consultation process. Historically, researchers have focused on trainees who view relational variables as the most effective elements of consultation; however, in the current study, trainers perceived experiential learning as being the most effective consultation strategy for helping CMH clinicians learn CBT. Other aspects of consultation such as case conceptualization and practice sample review are discussed in terms of their relative perceived utility in raising CMH clinician's competency to treat comorbid patients.

Best practices in supervising cognitive behavioral therapy with youth

Clinical supervision of cognitive behavioral therapy (CBT) with youth ensures better patient care and fosters trainees' professional development. However, often insufficient attention is directed toward disseminating best practices in supervision of CBT with youth. This Therapeutic Advances contribution aims to communicate the core content of supervision. Additionally, the key supervisory practices associated with CBT with youth are described. Supervisory outcomes are summarized and recommendations for supervisory practices are made.

Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health

BACKGROUND

Workplace-based clinical supervision as an implementation strategy to support evidence-based treatment (EBT) in public mental health has received limited research attention. A commonly provided infrastructure support, it may offer a relatively cost-neutral implementation strategy for organizations. However, research has not objectively examined workplace-based supervision of EBT and specifically how it might differ from EBT supervision provided in efficacy and effectiveness trials.

METHODS

Data come from a descriptive study of supervision in the context of a state-funded EBT implementation effort. Verbal interactions from audio recordings of 438 supervision sessions between 28 supervisors and 70 clinicians from 17 public mental health organizations (in 23 offices) were objectively coded for presence and intensity coverage of 29 supervision strategies (16 content and 13 technique items), duration, and temporal focus. Random effects mixed models estimated proportion of variance in content and techniques attributable to the supervisor and clinician levels.

RESULTS

Interrater reliability among coders was excellent. EBT cases averaged 12.4 min of supervision per session. Intensity of coverage for EBT content varied, with some discussed frequently at medium or high intensity (exposure) and others infrequently discussed or discussed only at low intensity (behavior management; assigning/reviewing client homework). Other than fidelity assessment, supervision techniques common in treatment trials (e.g., reviewing actual practice, behavioral rehearsal) were used rarely or primarily at low intensity. In general, EBT content clustered more at the clinician level; different techniques clustered at either the clinician or supervisor level.

CONCLUSIONS

Workplace-based clinical supervision may be a feasible implementation strategy for supporting EBT implementation, yet it differs from supervision in treatment trials. Time allotted per case is limited, compressing time for EBT coverage. Techniques that involve observation of clinician skills are rarely used. Workplace-based supervision content appears to be tailored to individual clinicians and driven to some degree by the individual supervisor. Our findings point to areas for intervention to enhance the potential of workplace-based supervision for implementation effectiveness.

TRIAL REGISTRATION

NCT01800266 , Clinical Trials, Retrospectively Registered (for this descriptive study; registration prior to any intervention [part of phase II RCT, this manuscript is only phase I descriptive results]).

Evaluation of a Train-The-Trainers Model for Family Peer Advocates in Children's Mental Health

Standardized training and credentialing is increasingly important to states and healthcare systems. Workforce shortages in children's mental health can be addressed through training and credentialing of professional peer parents (called family peer advocates or FPAs), who deliver a range of services to caregivers. A theory-based training program for FPAs targeting skills and knowledge about childhood mental health services (Parent Empowerment Program, or PEP) was developed through a partnership among a statewide family-run organization, state policy leaders, and academic researchers. Prior studies by this team using highly-experienced family peer advocates (who were also co-developers of the training program) as trainers found improvements in knowledge about mental health services and self-efficacy. In 2010, to meet demands and scale the model, a training of trainers (TOT) model was developed to build a cohort of locally-trained FPAs to deliver PEP training. A pre/post design was used to evaluate the impact of TOT model on knowledge and self-efficacy among 318 FPAs across the state. Participants showed significant pre-post (6 month) changes in knowledge about mental health services and self-efficacy. There were no significant associations between any FPA demographic characteristics and their knowledge or self-efficacy scores. A theory-based training model for professional peer parents working in the children's mental health system can be taught to local FPAs, and it improves knowledge about the mental health system and self-efficacy. Studies that evaluate the effectiveness of different training modalities are critical to ensure that high-quality trainings are maintained.

Training Community-Based Clinicians in Parent-Child Interaction Therapy: The Interaction Between Expert Consultation and Caseload

Professional psychologists are increasingly encouraged to utilize evidence-based treatments (EBTs), and therefore have a need to participate and provide the most efficient training methods for these treatments. Multicomponent trainings, which commonly include ongoing support, are more effective than brief methods such as 1-day workshops or reading treatment manuals. The present study examined the effectiveness of 1 form of ongoing support, consultation, as part of a multicomponent training protocol. Thirty-two community-based clinicians were trained in Parent-Child Interaction Therapy (PCIT) as part of a statewide implementation effort, and data were collected on clinician and implementation outcomes at pre-, mid-, and posttraining. Simple and multiple linear regression analyses were conducted to predict posttraining knowledge, skill, acceptability, and feasibility, as well as to examine clinician variables that might moderate these relations. Greater consultation call attendance significantly predicted higher posttraining skill; however, this association was qualified by a significant interaction with PCIT caseload. Implications for training guidelines are discussed.

Boundary-spanning actors in complex adaptive governance systems: The case of multisectoral nutrition

A growing literature highlights complexity of policy implementation and governance in global health and argues that the processes and outcomes of policies could be improved by explicitly taking this complexity into account. Yet there is a paucity of studies exploring how this can be achieved in everyday practice. This study documents the strategies, tactics, and challenges of boundary‐spanning actors working in 4 Sub‐Saharan Africa countries who supported the implementation of multisectoral nutrition as part of the African Nutrition Security Partnership in Burkina Faso, Mali, Ethiopia, and Uganda. Three action researchers were posted to these countries during the final 2 years of the project to help the government and its partners implement multisectoral nutrition and document the lessons. Prospective data were collected through participant observation, end‐line semistructured interviews, and document analysis. All 4 countries made significant progress despite a wide range of challenges at the individual, organizational, and system levels. The boundary‐spanning actors and their collaborators deployed a wide range of strategies but faced significant challenges in playing these unconventional roles. The study concludes that, under the right conditions, intentional boundary spanning can be a feasible and acceptable practice within a multisectoral, complex adaptive system in low‐ and middle‐income countries.

Therapist Training on Cognitive Behavior Therapy for Anxiety Disorders Using Internet-Based Technologies

This study investigated a technology-enhanced training protocol to facilitate dissemination of therapist training on cognitive behavior therapy (CBT) for anxiety disorders. Seventy community clinicians received an online tutorial followed by live remote observation of clinical skills via videoconference. Impact of training on patient outcomes was also assessed. Training resulted in a significant increase in both trainee knowledge of CBT concepts and techniques and therapist competence in applying these skills. Patients treated by trainees following training had significant reductions in anxiety and depression. Ratings of user satisfaction were high. Results provide support for the use of these technologies for therapist training in CBT.

Self-Efficacy as a Mediator in Bottom-Up Dissemination of a Research-Supported Intervention for Young, Traumatized Children and Their Families

Implementation literature has under-reported bottom-up dissemination attempts of research-supported interventions (RSI). This study examined factors associated with individual clinicians' implementation of Child-Parent Psychotherapy (CPP), including CPP social network (SN), supervision, and self-efficacy. Seventy-seven (90%) CPP graduates completed a cross-sectional survey, including measures regarding social network, receiving supervision, and CPP self-efficacy. Self-efficacy was significantly associated with CPP implementation; CPP SN and supervision were not. Mediation models showed that self-efficacy significantly mediated between CPP SN and supervision, and the implementation variables. Findings illuminate the importance of supporting clinicians using a new RSI, particularly in bottom-up dissemination, in order to foster RSI self-efficacy.

A Digital Feedback System to Support Implementation of Measurement-Based Care by School-Based Mental Health Clinicians

Evidence supports the utility of measurement-based care (MBC) to improve youth mental health outcomes, but clinicians rarely engage in MBC practices. Digital measurement feedback systems (MFS) may reflect a feasible strategy to support MBC adoption and sustainment. This pilot study was initiated to evaluate the impact of a MFS and brief consultation supports to facilitate MBC uptake and sustainment among mental health clinicians in the education sector, the most common mental health service delivery setting for youth. Following an initial training in MBC, 14 clinicians were randomized to either a digital MFS and brief consultation supports or control. Baseline ratings of MBC attitudes, skill, and use were collected. In addition, daily assessment ratings tracked 2 core MBC practices (i.e., assessment tool administration, provision of feedback) over a 6-month follow-up period. Clinicians in the MFS condition demonstrated rapid increases in both MBC practices, whereas the control group did not significantly change. For clinicians in the MFS group, consultation effects were significant for feedback and approached significance for administration. Over the follow-up period, average decreases in the current study were moderate with only 1 of the 2 outcome variables (administration) decreasing significantly. Inspection of individual clinician trajectories revealed substantial within-group trend variation. MFS may represent an effective MBC implementation strategy beyond initial training, although individual clinician response is variable. Identifying feasible and impactful implementation strategies is critical given the ability of MBC to support precision health care.

Building an Evidence Base for Effective Supervision Practices: An Analogue Experiment of Supervision to Increase EBT Fidelity

Treatments that are efficacious in research trials perform less well under routine conditions; differences in supervision may be one contributing factor. This study compared the effect of supervision using active learning techniques (e.g. role play, corrective feedback) versus "supervision as usual" on therapist cognitive restructuring fidelity, overall CBT competence, and CBT expertise. Forty therapist trainees attended a training workshop and were randomized to supervision condition. Outcomes were assessed using behavioral rehearsals pre- and immediately post-training, and after three supervision meetings. EBT knowledge, attitudes, and fidelity improved for all participants post-training, but only the SUP+ group demonstrated improvement following supervision.

Can Learning Collaboratives Support Implementation by Rewiring Professional Networks?

This study examined how a learning collaborative focusing on trauma-focused CBT (TF-CBT) impacted advice-seeking patterns between clinicians and three key learning sources: (1) training experts who share technical knowledge about TF-CBT, (2) peers from other participating organizations who share their implementation experiences, and (3) colleagues from their own agency who provide social and professional support. Based on surveys administered to 132 clinicians from 32 agencies, participants' professional networks changed slightly over time by forming new advice-seeking relationships with training experts. While small, these changes at the clinician-level yielded substantial changes in the structure of the regional advice network.

Translating E-Mental Health Into Practice: What Are the Barriers and Enablers to E-Mental Health Implementation by Aboriginal and Torres Strait Islander Health Professionals?

BACKGROUND

With increasing evidence for the effectiveness of e-mental health interventions for enhancing mental health and well-being, a growing challenge is how to translate promising research findings into service delivery contexts. A 2012 e-mental health initiative by the Australian Federal Government (eMHPrac) has sought to address the issue through several strategies, one of which has been to train different health professional workforces in e-mental health (e-MH).

OBJECTIVE

The aim of the study was to report on the barriers and enablers of e-MH uptake in a cohort of predominantly Aboriginal and Torres Strait Islander health professionals (21 Indigenous, 5 non-Indigenous) who occupied mainly support or case management roles within their organizations.

METHODS

A 3- or 2-day e-MH training program was followed by up to 5 consultation sessions (mean 2.4 sessions) provided by the 2 trainers. The trainer-consultants provided written reports on each of the 30 consultation sessions for 7 consultation groups. They were also interviewed as part of the study. The written reports and interview data were thematically analyzed by 2 members of the research team.

RESULTS

Uptake of e-MH among the consultation group was moderate (22%-30% of participants). There were significant organizational barriers to uptake resulting from procedural and administrative problems, demanding workloads, prohibitive policies, and a lack of fit between the organizational culture and the introduction of new technologies. Personal barriers included participant beliefs about the applicability of e-MH to certain populations, and workers' lack of confidence and skills. However, enthusiastic managers and tech-savvy champions could provide a counter-balance as organizational enablers of e-MH; and the consultation sessions themselves appear to have enhanced skills and confidence, shifted attitudes to new technologies, and seeded a perception that e-MH could be a valuable health education resource.

CONCLUSIONS

A conclusion from the program was that it was important to match e-MH training and resources to work roles. In the latter stages of the consultation sessions, the Aboriginal and Torres Strait Islander health professionals responded very positively to YouTube video clips and apps with a health education dimension. Therapy-oriented apps and programs may fit less well within the scope of practice of some workforces, including this one. We suggest that researchers broaden their focus and definitions of e-MH and give rather more weight to e-MH's health education possibilities. Developing criteria for evaluating apps and YouTube videos may empower a rather greater section of health workforce to use e-MH with their clients.

Improving access and systems of care for evidence-based childhood obesity treatment: Conference key findings and next steps

OBJECTIVE

To improve systems of care to advance implementation of the U.S. Preventive Services Task Force recommendations for childhood obesity treatment (i.e., clinicians offer/refer children with obesity to intensive, multicomponent behavioral interventions of >25 h over 6 to 12 months to improve weight status) and to expand payment for these services.

METHODS

In July 2015, 43 cross-sector stakeholders attended a conference supported by the Agency for Healthcare Research and Quality, American Academy of Pediatrics Institute for Healthy Childhood Weight, and The Obesity Society. Plenary sessions presenting scientific evidence and clinical and payment practices were interspersed with breakout sessions to identify consensus recommendations.

RESULTS

Consensus recommendations for childhood obesity treatment included: family-based multicomponent behavioral therapy; integrated care model; and multidisciplinary care team. The use of evidence-based protocols, a well-trained healthcare team, medical oversight, and treatment at or above the minimum dose (e.g., >25 h) are critical components to ensure effective delivery of high-quality care and to achieve clinically meaningful weight loss. Approaches to secure reimbursement for evidence-based obesity treatment within payment models were recommended.

CONCLUSIONS

Continued cross-sector collaboration is crucial to ensure a unified approach to increase payment and access for childhood obesity treatment and to scale up training to ensure quality of care.

Themes arising in clinical consultation for therapists implementing family-based treatment for adolescents with anorexia nervosa: a qualitative study

BACKGROUND

Our study aims to explore and describe themes arising in sessions of clinical consultation with therapists implementing Family-Based Treatment (FBT) for adolescents with Anorexia Nervosa (AN). There is currently no literature describing the content of clinical consultation for FBT. Thus, this knowledge will add to the evidence-base on what therapists need from consultants in ongoing clinical consultation.

METHODS

Eight therapists at four sites participated in this study, which spanned a two-year period. Following a two-day training workshop, each therapist treated at least one adolescent patient presenting with a restrictive eating disorder with FBT, focusing on adherence to the treatment manual. Clinical consultation sessions occurred monthly and were led by an external FBT expert. Thirty-five (average per site = 9) audio recorded group clinical consultation sessions were transcribed verbatim and coded for themes. Twenty percent of the transcripts were double-coded to ensure consistency. Fundamental qualitative description guided the sampling and data collection.

RESULTS

Thematic content analysis revealed ten common themes relating to the provision of clinical consultation to therapists implementing FBT in clinical practice: encouraging parental meal time supervision,discussing the role of mothers, how to align parents, ensuring parental buy-in, when to transition to Phase 2, weighing the patient and the patients' knowledge of their weight, the role of siblings in FBT sessions, how best to manage patient co-morbidities, the role of the father in FBT and how best to manage the family meal.

CONCLUSIONS

In conclusion, clinical consultation themes aligned with many of the central tenets of FBT, including how to help parents align their supportive approach during the refeeding process, and how to help parents assume control of eating disordered behaviours. This knowledge helps to guide consultants to anticipate common issues brought forward by therapists attempting to implement FBT.

Lessons learned while building a trauma-informed public behavioral health system in the City of Philadelphia

Exposure to traumatic experiences among youth is a serious public health concern. A trauma-informed public behavioral health system that emphasizes core principles such as understanding trauma, promoting safety, supporting consumer autonomy, sharing power, and ensuring cultural competence, is needed to support traumatized youth and the providers who work with them. This article describes a case study of the creation and evaluation of a trauma-informed publicly funded behavioral health system for children and adolescents in the City of Philadelphia (the Philadelphia Alliance for Child Trauma Services; PACTS) using the Exploration, Preparation, Implementation, and Sustainment (EPIS) as a guiding framework. We describe our evaluation of this effort with an emphasis on implementation determinants and outcomes. Implementation determinants include inner context factors, specifically therapist knowledge and attitudes (N=114) towards evidence-based practices. Implementation outcomes include rate of PTSD diagnoses in agencies over time, number of youth receiving TF-CBT over time, and penetration (i.e., number of youth receiving TF-CBT divided by the number of youth screening positive on trauma screening). We describe lessons learned from our experiences building a trauma-informed public behavioral health system in the hopes that this case study can guide other similar efforts.

The Role of Context in the Implementation of Trauma-Focused Treatments: Effectiveness Research and Implementation in Higher and Lower Income Settings

In recent years, the implementation of trauma-focused treatments has expanded across settings that vary widely in the availability of resources, infrastructure, and personnel. The present review aims to inform researchers, policy makers, trainers, and administrators about this diverse range of research. Taking a global health perspective, this review of effectiveness trials and implementation studies compares strategies used in high-income countries to those in low- and medium-income countries. A primary difference between studies in high-income and low- and medium-income countries is the relative emphasis placed on fidelity or adaptation. Adaptations used in low- and medium-income countries might offer useful ideas for increasing the portability, impact, and accessibility of evidence-based interventions in high-income countries.

Using a Theory-Guided Learning Collaborative Model to Improve Implementation of EBPs in a State Children's Mental Health System: A Pilot Study

Learning collaboratives (LCs) are used widely to promote implementation of evidence-based practices. However, there has been limited research on the effectiveness of LCs and models vary widely in their structure, focus and components. The goal of the present study was to develop and field test a theory-based LC model to augment a state-led, evidence-based training program for clinicians providing mental health services to children. Analysis of implementation outcomes contrasted LC sites to matched comparison sites that participated in the clinical training program alone. Results suggested that clinicians from sites participating in the LC were more highly engaged in the state-led clinical training program and were more likely to complete program requirements.

IMPLEMENTATION AND SUSTAINABILITY OF CHILD-PARENT PSYCHOTHERAPY: THE ROLE OF REFLECTIVE CONSULTATION IN THE LEARNING COLLABORATIVE MODEL

Recent implementation science in mental health has focused on identifying the most effective strategies to disseminate and implement evidence-based treatments (EBTs) into real-world practice settings. The learning collaborative training methodology and its use of expert trainers/consultants have become increasingly popular as one of these approaches. Moreover, there is preliminary evidence that ongoing expert consultation may increase the adoption, learning, and sustainability of EBTs by an already practicing workforce and, consequently, help trainers, practitioners, and organizations address implementation barriers. This article describes the authors' experiences in facilitating Child-Parent Psychotherapy (CPP) training and explores the role of reflective clinical consultation as an active process that supports the implementation of a rich, but complex, model that requires sophisticated knowledge and skills from practitioners. It examines the intricate range of the CPP consultant's functions, which ultimately support clinicians' reflective practice as they learn and adopt this EBT. Reflective consultation is proposed as an essential component for the integration of knowledge, experience, and emotions in practitioners and as a catalyst for organizational change. Using their voices as trainers-consultants and those of their trainees, the authors discuss the implications of reflective consultation for the effective implementation and sustainability of CPP. Reflections are offered on lessons learned.

Supporting our supervisors: sending out an SOS

In this Introduction to the Special Issue of the Cognitive Behaviour Therapist on clinical supervision we start by highlighting the unmet and overdue need for coherent organizational systems to support, guide and develop clinical supervisors. We identify a seven-step, cyclical model that describes how such a system might work, with particular reference to CBT supervision. These steps start with conceptualization (e.g. definition of CBT supervision) and complete the problem-solving cycle with evaluation (e.g. corrective feedback). We provide an overview of typical research and development activity for each part of this model to illustrate how a sound supervision infrastructure might best be developed. The SOS model provides a systematic approach to indicate the organizational conditions under which CBT supervision might flourish.

The Effect of a Change Agent on Use of Evidence-Based Mental Health Practices

Children's service systems are faced with a critical need to disseminate evidence-based mental health interventions. Despite the proliferation of comprehensive implementation models, little is known about the key active processes in effective implementation strategies. This proof of concept study focused on the effect of change agent interactions as conceptualized by Rogers' diffusion of innovation theory on providers' (N = 57) use of a behavioral intervention in a child welfare agency. An experimental design compared use for providers randomized to training as usual or training as usual supplemented by change agent interactions after the training. Results indicate that the enhanced condition increased use of the intervention, supporting the positive effect of change agent interactions on use of new practices. Change agent types of interaction may be a key active process in implementation strategies following training.

Randomized Trial of the Parent And Caregiver Active Participation Toolkit for Child Mental Health Treatment

The purpose of this pilot study was to examine preliminary feasibility, acceptability, and effectiveness of a toolkit (Parent And Caregiver Active Participation Toolkit) to increase parent participation in community-based child mental health services. Study participants included 29 therapists (93% female; M age = 34.1 years; 38% Latino) and 20 parent/child dyads (children 80% female; M age = 8.6 years; parents 40% Latino) in 6 diverse community mental health clinics. Therapists were randomly assigned to standard care or the toolkit with standard care. Therapist and parent survey data and observational coding of treatment sessions were utilized. Mean comparisons and repeated measures analyses were used to test differences between study conditions over 4 months. Results supported preliminary feasibility and acceptability of the toolkit, with therapists assigned to the toolkit participating in ongoing training, adhering to toolkit use, and perceiving the toolkit as feasible and acceptable within their setting. Results preliminarily demonstrated improvement in therapists' job attitudes, as well as actual use of parent engagement strategies. Results also preliminarily demonstrated increases in parent participation in child therapy sessions and more regular attendance, as well as some indication of support for perceived treatment effectiveness. Overall, results suggest the feasibility, acceptability, and potential effectiveness of the toolkit to enhance therapist job attitudes; practices that support parent engagement, parent engagement itself, and consumer perspectives on treatment outcomes; and the potential promise of future research in the area of parent participation interventions in child mental health services.

Understanding and Measuring Coach-Teacher Alliance: A Glimpse Inside the 'Black Box'

Coaching models are increasingly used in schools to enhance fidelity and effectiveness of evidence-based interventions; yet, little is known about the relationship between the coach and teacher (i.e., coach-teacher alliance), which may indirectly enhance teacher and student outcomes through improved implementation quality. There is also limited research on measures of coach-teacher alliance, further hindering the field from understanding the active components for successful coaching. The current study examined the factor structure and psychometric characteristics of a measure of coach-teacher alliance as reported by both teachers and coaches and explored the extent to which teachers and coaches reliably rate their alliance. Data come from a sample of 147 teachers who received implementation support from one of four coaches; both the teacher and the coach completed an alliance questionnaire. Separate confirmatory factor analyses for each informant revealed four factors (relationship, process, investment, and perceived benefits) as well as an additional coach-rated factor (perceived teacher barriers). A series of analyses, including cross-rater correlations, intraclass correlation coefficients, and Kuder-Richardson reliability estimates suggested that teachers and coaches provide reliable, though not redundant, information about the alliance. Implications for future research and the utilization of the parallel coach-teacher alliance measures to increase the effectiveness of coaching are discussed.

The what, when, and why of implementation frameworks for evidence-based practices in child welfare and child mental health service systems

It is widely recognized that children in the child welfare system are particularly vulnerable to the adverse health and mental effects associated with exposure to abuse and neglect, making it imperative to have broad-based availability of evidence-based practices (EBPs) that can prevent child maltreatment and reduce the negative mental health outcomes for youth who are victims. A variety of EBPs exist for reducing child maltreatment risk and addressing the associated negative mental health outcomes, but the reach of these practices is limited. An emerging literature documents factors that can enhance or inhibit the success of EBP implementation in community service agencies, including how the selection of a theory-driven conceptual framework, or model, might facilitate implementation planning by providing guidance for best practices during implementation phases. However, limited research is available to guide decision makers in the selection of implementation frameworks that can boost implementation success for EBPs that focus on preventing child welfare recidivism and serving the mental health needs of maltreated youth. The aims of this conceptual paper are to (1) provide an overview of existing implementation frameworks, beginning with a discussion of definitional issues and the selection criteria for frameworks included in the review; and (2) offer recommendations for practice and policy as applicable for professionals and systems serving victims of child maltreatment and their families.