The role of consultation calls for clinic supervisors in supporting large-scale dissemination of evidence-based treatments for children

Clinical Consultation During a Trauma-Focused Cognitive Behavioral Therapy Community-Based Learning Collaborative: Examination of Consultation Content, Consultative Strategies, and Provider Engagement

Consultation following evidence-based practice (EBP) training enhances the uptake of EBPs. Yet, little is known about what occurs during consultation, and it is often difficult for providers to engage in consultation. This study examined provider engagement in consultation and the content and strategies used during consultation following training in Trauma-focused Cognitive Behavioral Therapy (TF-CBT) as part of a community-based learning collaborative (CBLC). Minute-to-minute live coding of consultation calls revealed most content was clinically-oriented and the most common strategies used by consultants were didactic in nature. Providers with more years of professional experience and those with greater TF-CBT knowledge attended significantly more consultation calls. Providers with a greater average weekly caseload and providers who were supervisors presented significantly more cases on calls. Providers with greater TF-CBT knowledge spoke significantly more minutes on calls. Consistent with previous work, findings highlight difficulties with provider engagement in consultation and that providers with more baseline expertise are most likely to be engaged. Findings suggest tailoring EBP training efforts to better engage providers at greatest risk for low engagement.

Knowledge and attitudes of Implementation Support Practitioners-Findings from a systematic integrative review

BACKGROUND

It requires thoughtful planning and work to successfully apply and sustain research-supported interventions like healthcare treatments, social support, or preventive programs in practice. Implementation support practitioners (ISPs) such as facilitators, technical assistance providers, knowledge brokers, coaches or consultants may be involved to actively support the implementation process. This article presents knowledge and attitudes ISPs bring to their work.

METHODS

Building on a previously developed program logic, a systematic integrative review was conducted. Literature was sourced by searching nine electronic data bases, organizational websites, and by launching a call for publications among selected experts and social media. Article screening was performed independently by two researchers, and data from included studies were extracted by members of the research team and quality-assured by the lead researcher. The quality of included RCTs was assessed based on a framework by Hodder and colleagues. Thematic Analysis was used to capture information on knowledge and attitudes of ISPs across the included studies. Euler diagrams and heatmaps were used to present the results.

RESULTS

Results are based on 79 included studies. ISPs reportedly displayed knowledge about the clinical practice they work with, implementation / improvement practice, the local context, supporting change processes, and facilitating evidence-based practice in general. In particular, knowledge about the intervention to be implemented and its target population, specific improvement / implementation methods and approaches, organizational structures and sensitivities, training, and characteristics of (good) research was described in the literature. Seven themes describing ISPs' attitudes were identified: 1) professional, 2) motivated / motivating / encouraging / empowering, 3) empathetic / respectful / sensitive, 4) collaborative / inclusive, 5) authentic, 6) creative / flexible / innovative / adaptive, and 7) frank / direct / honest. Pertaining to a professional attitude, being responsive and focused were the most prevalent indicators across included publications.

CONCLUSION

The wide range and complexity of knowledge and attitudes found in the literature calls for a comprehensive and systematic approach to collaboratively develop a professional role for ISPs across disciplines. Embedding the ISP role in different health and social welfare settings will enhance implementation capacities considerably.

Care team and practice-level implementation strategies to optimize pediatric collaborative care: study protocol for a cluster-randomized hybrid type III trial

BACKGROUND

Implementation facilitation is an effective strategy to support the implementation of evidence-based practices (EBPs), but our understanding of multilevel strategies and the mechanisms of change within the "black box" of implementation facilitation is limited. This implementation trial seeks to disentangle and evaluate the effects of facilitation strategies that separately target the care team and leadership levels on implementation of a collaborative care model in pediatric primary care. Strategies targeting the provider care team (TEAM) should engage team-level mechanisms, and strategies targeting leaders (LEAD) should engage organizational mechanisms.

METHODS

We will conduct a hybrid type 3 effectiveness-implementation trial in a 2 × 2 factorial design to evaluate the main and interactive effects of TEAM and LEAD and test for mediation and moderation of effects. Twenty-four pediatric primary care practices will receive standard REP training to implement Doctor-Office Collaborative Care (DOCC) and then be randomized to (1) Standard REP only, (2) TEAM, (3) LEAD, or (4) TEAM + LEAD. Implementation outcomes are DOCC service delivery and change in practice-level care management competencies. Clinical outcomes are child symptom severity and quality of life.

DISCUSSION

This statewide trial is one of the first to test the unique and synergistic effects of implementation strategies targeting care teams and practice leadership. It will advance our knowledge of effective care team and practice-level implementation strategies and mechanisms of change. Findings will support efforts to improve common child behavioral health conditions by optimizing scale-up and sustainment of CCMs in a pediatric patient-centered medical home.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT04946253 . Registered June 30, 2021.

Therapist adherence to family-based treatment for adolescents with anorexia nervosa: A multi-site exploratory study

OBJECTIVE

This exploratory study is the first to examine family-based treatment (FBT) adherence and association to treatment outcome in the context of a large-scale, multi-centre study for the treatment of adolescents with anorexia nervosa.

METHOD

One hundred and ninety recorded FBT sessions from 68 adolescents with anorexia nervosa and their families were recruited across multiple sites (N = 6). Each site provided 1-4 tapes per family over four treatment time points, and each was independently rated for therapist adherence.

RESULTS

There were differences in adherence scores within and between sites. ANOVA produced a main effect for site, F(5, 46) = 8.6, p < .001, and phase, F(3, 42) = 12.7, p < .001, with adherence decreasing in later phases. Adherence was not associated to end of treatment percent ideal body weight after controlling for baseline percent ideal body weight (r = .088, p = .48).

CONCLUSIONS

Results suggest that FBT can be delivered with adherence in phase one of treatment. Adherence was not associated with treatment outcome as determined using percent ideal body weight.

A Mixed Methods Study of Organizational Readiness for Change and Leadership During a Training Initiative Within Community Mental Health Clinics

This longitudinal mixed-methods study explored variation in organizational readiness for change and leadership behavior across seven organizations during a 12-month training initiative in person-centered care planning. Quantitative data was used to examine trajectories of organizational readiness for change and leadership behavior over time and qualitative data explored provider perspectives on the trajectory of these organizational factors during the 12-month training initiative. Findings indicated that levels of organizational readiness for change and leadership behavior varied across clinics, but most experienced a significant positive change at the mid-point of the training. Organizational readiness for change was positively correlated with leaderships behaviors across time. Provider focus group findings gave insight into their initial resistance to adopting the new practice and their increasing receptivity in the second 6 months due to increased understanding of the practice and leadership endorsement. Increasing provider openness to a new practice prior to training and having a consistently engaged leadership have the potential to improve the efficiency of a training initiative.

Supervision in Community Mental Health: Understanding Intensity of EBT Focus

The goal of the present study was to examine clinician, supervisor, and organizational factors that are associated with the intensity of evidence-based treatment (EBT) focus in workplace-based clinical supervision of a specific EBT, Trauma-Focused Cognitive Behavioral Therapy (TF-CBT). Supervisors (n = 56) and clinicians (n = 207) from mental health organizations across Washington State completed online self-report questionnaires. Multilevel modeling (MLM) analyses were used to examine the relative influence of nested clinician and supervisor factors on the intensity of EBT focus in supervision. We found that 33% of the variance in clinician report of EBT supervision intensity clustered at the supervisor level and implementation climate was the only significant factor associated with EBT supervision intensity. While individual clinician and supervisor factors may play a role in EBT coverage in supervision, our results suggest that an implementation climate that supports EBT may be the most critical factor for improving intensity of EBT coverage. Thus, implementation efforts that address the extent to which EBTs are expected, rewarded, and supported within an organization may be needed to support greater coverage of EBT during workplace-based supervision.

The effectiveness of consultation for clinicians learning to deliver motivational interviewing with fidelity

Despite the emerging literature documenting gains in clinician competence following consultation, little empirical work has examined consultation as an implementation strategy. To this end, the present study examined consultation in the context of implementing motivational interviewing in four community child and youth mental health organizations. We used qualitative methods with a dual goal: to describe the consultation process and to explore trainees' perspectives on consultation. Participants included 22 clinicians and 9 supervisors who received monthly, group, phone-based consultation for seven months following training in motivational interviewing. Analyses showed that consultation was perceived as effective because it helped to "keep motivational interviewing alive," fulfilled a profound learning function through collaboration and connection with others, and served as protected time for reflection on practice change. Our findings contribute to a body of knowledge about consultation elements that appear to be effective when implementing research-supported interventions in child and youth mental health.

Self-Efficacy as a Mediator in Bottom-Up Dissemination of a Research-Supported Intervention for Young, Traumatized Children and Their Families

Implementation literature has under-reported bottom-up dissemination attempts of research-supported interventions (RSI). This study examined factors associated with individual clinicians' implementation of Child-Parent Psychotherapy (CPP), including CPP social network (SN), supervision, and self-efficacy. Seventy-seven (90%) CPP graduates completed a cross-sectional survey, including measures regarding social network, receiving supervision, and CPP self-efficacy. Self-efficacy was significantly associated with CPP implementation; CPP SN and supervision were not. Mediation models showed that self-efficacy significantly mediated between CPP SN and supervision, and the implementation variables. Findings illuminate the importance of supporting clinicians using a new RSI, particularly in bottom-up dissemination, in order to foster RSI self-efficacy.

Improving and sustaining delivery of CPT for PTSD in mental health systems: a cluster randomized trial

BACKGROUND

Large-scale implementation of evidence-based psychotherapies (EBPs) such as cognitive processing therapy (CPT) for posttraumatic stress disorder can have a tremendous impact on mental and physical health, healthcare utilization, and quality of life. While many mental health systems (MHS) have invested heavily in programs to implement EBPs, few eligible patients receive EBPs in routine care settings, and clinicians do not appear to deliver the full treatment protocol to many of their patients. Emerging evidence suggests that when CPT and other EBPs are delivered at low levels of fidelity, clinical outcomes are negatively impacted. Thus, identifying strategies to improve and sustain the delivery of CPT and other EBPs is critical. Existing literature has suggested two competing strategies to promote sustainability. One emphasizes fidelity to the treatment protocol through ongoing consultation and fidelity monitoring. The other focuses on improving the fit and effectiveness of these treatments through appropriate adaptations to the treatment or the clinical setting through a process of data-driven, continuous quality improvement. Neither has been evaluated in terms of impact on sustained implementation.

METHODS

To compare these approaches on the key sustainability outcomes and provide initial guidance on sustainability strategies, we propose a cluster randomized trial with mental health clinics (n = 32) in three diverse MHSs that have implemented CPT. Cohorts of clinicians and clinical managers will participate in 1 year of a fidelity oriented learning collaborative or 1 year of a continuous quality improvement-oriented learning collaborative. Patient-level PTSD symptom change, CPT fidelity and adaptation, penetration, and clinics' capacity to deliver EBP will be examined. Survey and interview data will also be collected to investigate multilevel influences on the success of the two learning collaborative strategies. This research will be conducted by a team of investigators with expertise in CPT implementation, mixed method research strategies, quality improvement, and implementation science, with input from stakeholders in each participating MHS.

DISCUSSION

It will have broad implications for supporting ongoing delivery of EBPs in mental health and healthcare systems and settings. The resulting products have the potential to significantly improve efforts to ensure ongoing high quality implementation and consumer access to EBPs.

TRIAL REGISTRATION

NCT02449421 . Registered 02/09/2015.

IMPLEMENTATION AND SUSTAINABILITY OF CHILD-PARENT PSYCHOTHERAPY: THE ROLE OF REFLECTIVE CONSULTATION IN THE LEARNING COLLABORATIVE MODEL

Recent implementation science in mental health has focused on identifying the most effective strategies to disseminate and implement evidence-based treatments (EBTs) into real-world practice settings. The learning collaborative training methodology and its use of expert trainers/consultants have become increasingly popular as one of these approaches. Moreover, there is preliminary evidence that ongoing expert consultation may increase the adoption, learning, and sustainability of EBTs by an already practicing workforce and, consequently, help trainers, practitioners, and organizations address implementation barriers. This article describes the authors' experiences in facilitating Child-Parent Psychotherapy (CPP) training and explores the role of reflective clinical consultation as an active process that supports the implementation of a rich, but complex, model that requires sophisticated knowledge and skills from practitioners. It examines the intricate range of the CPP consultant's functions, which ultimately support clinicians' reflective practice as they learn and adopt this EBT. Reflective consultation is proposed as an essential component for the integration of knowledge, experience, and emotions in practitioners and as a catalyst for organizational change. Using their voices as trainers-consultants and those of their trainees, the authors discuss the implications of reflective consultation for the effective implementation and sustainability of CPP. Reflections are offered on lessons learned.

Consultation as an implementation strategy for evidence-based practices across multiple contexts: unpacking the black box

There is great interest in the dissemination and implementation of evidence-based treatments and practices for children across schools and community mental health settings. A growing body of literature suggests that the use of one-time workshops as a training tool is ineffective in influencing therapist behavior and patient outcomes and that ongoing expert consultation and coaching is critical to actual uptake and quality implementation. Yet, we have very limited understanding of how expert consultation fits into the larger implementation support system, or the most effective consultation strategies. This commentary reviews the literature on consultation in child mental health, and proposes a set of core consultation functions, processes, and outcomes that should be further studied in the implementation of evidence-based practices for children.

Scaling up evidence-based practices for children and families in New York State: toward evidence-based policies on implementation for state mental health systems

Dissemination of innovations is widely considered the sine qua non for system improvement. At least two dozen states are rolling out evidence-based mental health practices targeted at children and families using trainings, consultations, webinars, and learning collaboratives to improve quality and outcomes. In New York State (NYS) a group of researchers, policymakers, providers, and family support specialists have worked in partnership since 2002 to redesign and evaluate the children's mental health system. Five system strategies driven by empirically based practices and organized within a state-supported infrastructure have been used in the child and family service system with more than 2,000 providers: (a) business practices, (b) use of health information technologies in quality improvement, (c) specific clinical interventions targeted at common childhood disorders, (d) parent activation, and (e) quality indicator development. The NYS system has provided a laboratory for naturalistic experiments. We describe these initiatives, key findings and challenges, lessons learned for scaling, and implications for creating evidence-based implementation policies in state systems.