Prospective predictors of sustainment of multiple EBPs in a system-driven implementation context: Examining sustained delivery based on administrative claims

Outside the Clinic Door: How Neighborhood Sociodemographic Disadvantage is Associated with Community Therapist Secondary Traumatic Stress and Emotional Exhaustion

Therapists serving families with high rates of trauma exposure in community mental health clinics face the potential risk of experiencing secondary traumatic stress and emotional exhaustion, both of which pose barriers for the implementation and sustainment of evidence-based practices. Previous research documents negative effects of living in socioeconomic disadvantaged neighborhoods on child development but has not examined the effects of working in these neighborhoods on therapist well-being. The current study merges publicly available data, administrative claims data on mental health services, and therapy survey data to 1) identify associations between neighborhood sociodemographic disadvantage and two community therapist well-being constructs, specifically secondary traumatic stress and emotional exhaustion; and 2) examine potential clinic- and therapist-level explanatory factors in the associations between neighborhood sociodemographic disadvantage and therapist well-being. A cumulative risk index approach was applied to calculate neighborhood sociodemographic disadvantage. Greater neighborhood sociodemographic disadvantage was significantly associated with higher levels of therapist secondary traumatic stress (B=.09, p<.05) but not emotional exhaustion. Because therapists in higher risk neighborhoods face higher secondary traumatic stress levels, additional research is needed to better understand how these therapists can be best supported; thus, supporting families receiving treatment and implementation of evidence-based practices.

Supporting Emotionally Exhausted Community Mental Health Therapists in Appropriately Adapting EBPs for Children and Adolescents

Evidence-based practices (EBPs) are often adapted during community implementation to improve EBP fit for clients and the service context. Augmenting EBPs with additional dosing and content may improve fit. However, reducing EBP content can reduce EBP effectiveness. Using multilevel regression models, this study examined whether supportive program climate and program-furnished EBP-specific implementation strategies (e.g., materials, ongoing training, in-house experts) are associated with augmenting and reducing adaptations, and whether therapist emotional exhaustion moderated these associations. Data were collected from surveys completed by 439 therapists from 102 programs 9 years after a system-driven EBP implementation initiative. Supportive program climate was associated with more augmenting adaptations. Emotional exhaustion was a significant moderator. When organizations used more EBP-specific implementation strategies, more emotionally exhausted therapists reduced EBPs less and less emotionally exhausted therapists augmented EBPs more. Findings provide guidance on how organizations can support appropriate EBP adaptations in spite of therapist emotional exhaustion.

Predicting the Sustained Implementation of an Evidence-Based Parenting Program: A Structural Equation Modelling Approach

PURPOSE

Sustained implementation is required for evidence-based parenting programs to promote children and their families' wellbeing at the societal level. Previous literature has examined the role of a range of different factors in enhancing sustainability. However, the inter-relationship between, and the relative importance of different factors remain largely unknown. The overall aim of this study is to identify predictors of sustained program use, the relative importance of factors, and potential mediation pathways.

METHODS

We surveyed 1202 practitioners who were trained in at least one variant of the Triple P-Positive Parenting Program, at least one and half years before data collection. The present data were linked with data collected during professional training. We first examined the independent effect of each factor on sustained program use, then, developed and evaluated a structural equation model of sustained program use.

RESULTS

The structural equation model explained a considerable amount of variance in sustained program use, with seven positive predictors and one negative predictor identified. Organisational support was identified as a key facilitator, which was not only positively linked with other facilitators but also had an independent positive effect. Perceived usefulness of the program was the most important practitioner-level facilitator, which might be contributed by both research-based evidence and practice-based evidence. Practitioners' self-regulation in program delivery impacted sustained use by influencing other factors such as perceived usefulness of the program.

CONCLUSION

The findings provided insight into factors influencing the sustainability of evidence-based parenting programs which could be used to inform future implementation practice.

A Comparison Between Clinical Guidelines and Real-World Treatment Data in Examining the Use of Session Summaries: Retrospective Study

Background

Although behavioral interventions have been found to be efficacious and effective in randomized clinical trials for most mental illnesses, the quality and efficacy of mental health care delivery remains inadequate in real-world settings, partly owing to suboptimal treatment fidelity. This “therapist drift” is an ongoing issue that ultimately reduces the effectiveness of treatments; however, until recently, there have been limited opportunities to assess adherence beyond large randomized controlled trials.

Objective

This study explored therapists’ use of a standard component that is pertinent across most behavioral treatments—prompting clients to summarize their treatment session as a means for consolidating and augmenting their understanding of the session and the treatment plan.

Methods

The data set for this study comprised 17,607 behavioral treatment sessions administered by 322 therapists to 3519 patients in 37 behavioral health care programs across the United States. Sessions were captured by a therapy-specific artificial intelligence (AI) platform, and an automatic speech recognition system transcribed the treatment meeting and separated the data to the therapist and client utterances. A search for possible session summary prompts was then conducted, with 2 psychologists validating the text that emerged.

Results

We found that despite clinical recommendations, only 54 (0.30%) sessions included a summary. Exploratory analyses indicated that session summaries mostly addressed relationships (n=27), work (n=20), change (n=6), and alcohol (n=5). Sessions with meeting summaries were also characterized by greater therapist interventions and included greater use of validation, complex reflections, and proactive problem-solving techniques.

Conclusions

To the best of our knowledge, this is the first study to assess a large, diverse data set of real-world treatment practices. Our findings provide evidence that fidelity with the core components of empirically designed psychological interventions is a challenge in real-world settings. The results of this study can inform the development of machine learning and AI algorithms and offer nuanced, timely feedback to providers, thereby improving the delivery of evidence-based practices and quality of mental health care services and facilitating better clinical outcomes in real-world settings.