Pilot to policy: statewide dissemination and implementation of evidence-based treatment for traumatized youth

Scale-up of Global Child and Youth Mental Health Services: A Scoping Review

Numerous influential policy and scientific bodies are calling for more rapid advances in the scale-up of child and youth mental health services (CYMHS). A number of CYMHS innovations hold promise for advancing scale-up but little is known about how real-world efforts are progressing. We conducted a scoping review to identify promising approaches to CYMHS scale-up across the globe. Searches were completed in six databases (Academic Search Complete, CINAHL, MEDLINE, PsychInfo, PubMed, and Web of Science). Article selection and synthesis were conducted in accordance to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis extension for Scoping Reviews (PRISMA-ScR) checklist. A second search focused on low-and-middle-income countries (LMIC) was conducted based on the Cochrane Library recommended search filters of the World Bank listed LMIC countries. Authors used a double coding strategy during the title/abstract and full-text review. Twenty-eight articles meeting the eligibility criteria were identified that described 22 initiatives (in 11 different countries). Our review found the majority of published scale-up studies in CYMHS were not informed by scale-up frameworks in design or reporting. The methods and outcomes used in the identified articles were highly variable and limited our ability to draw conclusions about comparative effectiveness although promising approaches emerged. Successes and failures identified in our review largely reflect consensus in the broader literature regarding the need for strategies to better navigate the complexities of system and policy implementation while ensuring CYMHS interventions fit local contexts.

Therapist Participation in a Learning Collaborative on Trauma-Focused Cognitive Behavioral Therapy: Impact of COVID-related Stressors and Challenges

The rise in mental health problems during the COVID-19 pandemic amplified the need to improve access to evidence-based treatments (EBT) and necessitated changes in treatment delivery and training of mental health providers (MHPs). There is limited information on how the pandemic may have impacted MHPs' participation in training and treatment delivery. This study included 269 MHPs who participated in a Learning Collaborative (LC) focused on an EBT. Qualitative interviews conducted with 15 MHPs who participated in the LC during the pandemic identified facilitators and barriers to training participation and EBT delivery that included social support, technology challenges, and difficulty completing cases following the transition to telehealth. Quantitative results showed that MHPs in the peri-COVID cohorts completed significantly fewer cases and fewer consultation calls compared to those prior to the pandemic. Findings suggest that providing support to train MHPs and promote EBT delivery may be beneficial during times of heightened stress.

Psychological intervention in women victims of childhood sexual abuse: a randomized controlled clinical trial comparing EMDR psychotherapy and trauma-focused cognitive behavioral therapy

Introduction

Childhood sexual abuse persists as a painful societal reality, necessitating responses from institutions and healthcare professionals to prevent and address its severe long-term consequences in victims. This study implements an intervention comprising two psychotherapeutic approaches recommended by the WHO and international clinical guidelines for addressing short-, medium-, and long-term posttraumatic symptomatology: Trauma-Focused Cognitive Behavioral Therapy (TF-CBT) and Eye Movement Desensitization and Reprocessing (EMDR). Both approaches are adapted from group formats for implementation in small online groups via Zoom.

Methods

The impact of both therapeutic approaches on trauma improvement was assessed in a sample of 19 women who were victims of childhood sexual abuse through a Randomized Clinical Trial comparing EMDR Psychotherapy and Trauma-Focused Cognitive Behavioral Therapy after a baseline period. Intra and inter comparison were made using statistics appropriate to the sample.

Results

Both therapeutic approaches significantly reduced symptomatology across various evaluated variables, suggesting their efficacy in improving the quality of life for these individuals. Following CBT-FT treatment, patients exhibited enhanced emotional regulation, reduced reexperiencing, and avoidance. The EMDR group, utilizing the G-TEP group protocol, significantly improved dissociation, along with other crucial clinical variables and the perception of quality of life.

Discussion

Although the limitations of this study must be taken into account due to the size of the sample and the lack of long-term follow-up, the results align with existing scientific literature, underscoring the benefits of trauma-focused psychological treatments. The online group format appears promising for enhancing the accessibility of psychological treatment for these women. Furthermore, the differential outcomes of each treatment support recent research advocating for the inclusion of both approaches for individuals with trauma-related symptomatology.

Ethics and dissemination

The study has been approved by the Ethics Committee of the Valencian International University (VIU) (Valencia, Spain) (Ref. CEID2021_07). The results will be submitted for publication in peer-reviewed journals and disseminated to the scientific community.

Clinical trial registration

https://clinicaltrials.gov/ct2/show/NCT04813224, identifier NCT04813224.

External and Internal Validity Considerations in Youth Effectiveness Trials: Lessons Learned from the COMET Study

OBJECTIVE

Effectiveness trials aim to increase the generalizability and public health impact of interventions. However, challenges associated with this design present threats to external and internal validity. This paper illustrates these challenges using data from a two-site randomized effectiveness trial, the Community Study of Outcome Monitoring for Emotional Disorders in Teens (COMET) and presents recommendations for future research.

METHOD

COMET was a randomized effectiveness trial conducted in 19 community mental health clinics in two states comparing three interventions: treatment as usual (TAU), TAU with measurement-based care (TAU+), and the Unified Protocol forTransdiagnostic Treatment of Emotional Disorders in Adolescents with MBC (UPA). Participants included 176 clinicians (mean age = 35.5; 85.8% cisgender female; 53.0% racially and/or ethnically minorized) and 196 adolescents (mean age = 14.7; 65.3% cisgender female; 69.4% racially and/or ethnically minorized). Analyses outlined participant flow from recruitment to study completion, described participant characteristics, and examined site differences.

RESULTS

Analysis of participant flow suggested that recruitment and retention of clinicians and adolescents was challenging, raising questions about whether participants were representative of participating clinics. Both the clinician and adolescent samples were racially and ethnically diverse and adolescents were low income and clinically complex. Significant site differences were observed in clinician and adolescent characteristics.

CONCLUSIONS

While this study was successful in recruiting a diverse and historically under-represented sample, difficulties in recruitment and retention raise questions about external validity and site differences present challenges to internal validity of study findings. Suggestions for future effectiveness studies, drawing from implementation science approaches, are discussed.

Therapists' Perceived Competence in Delivering Trauma-Focused Cognitive Behavioral Therapy During Statewide Learning Collaboratives

The learning collaborative (LC), a multi-component training and implementation model, is one promising approach to address the need for increased availability of trauma-focused evidence-based practices. The current study used data from four cohorts of a statewide LC on Trauma-Focused Cognitive Behavioral Therapy (TF-CBT) to 1) evaluate pre- to post-LC changes in therapists' perceived competence in delivering TF-CBT and 2) explore therapist and contextual factors related to therapists' perceived TF-CBT competence. Therapists (N = 237) completed pre- and post-LC measures of practice information, interprofessional collaboration, organizational climate, and TF-CBT knowledge, perceived competence, and use. Findings indicated therapists' perceived TF-CBT competence significantly increased, pre- to post-LC (d = 1.31), with greater use of trauma-focused practices at pre-training and more TF-CBT training cases completed predicting greater pre- to post-LC gains in perceived TF-CBT competence. These findings highlight the need to assist therapists in identifying and completing training cases to promote competence and implementation.

Implementing Person-Centered Recovery Planning: New England Mental Health Technology Transfer Center Learning Collaborative Evaluation Report

Person-centered recovery planning (PCRP) has been a key aspect in mental health system transformation and delivering quality health care. Despite the mandate to deliver this practice and a growing evidence base, its implementation and understanding of implementation processes in behavioral health settings remain a challenge. New England Mental Health Technology Transfer Center (MHTTC) launched the PCRP in Behavioral Health Learning Collaborative to support agencies' implementation efforts through training and technical assistance. In an effort to explore and understand the internal implementation process changes facilitated by the learning collaborative, the authors conducted qualitative key informant interviews with the participants and the leadership of the PCRP learning collaborative. The interviews revealed the processes that are part of the PCRP implementation efforts, including staff training, changing agency policies and procedures, modifying treatment planning tools, and the structure of the electronic health records. The higher prior organizational investment and readiness for change, building staff's competencies in PCRP, leadership investment, and frontline staff buy-in act as factors that facilitate the implementation of PCRP in behavioral health settings. Our findings inform both the implementation of PCRP in behavioral health settings and future efforts of organizing multi-agency learning collaboratives to support PCRP implementation.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43477-023-00078-3.

Youth Trauma Histories are Associated with Under-diagnosis and Under-treatment of Co-occurring Youth Psychiatric Symptoms

OBJECTIVE

We examined whether in the presence of trauma exposure, non-traumatic stress-related symptoms are interpreted by mental health clinicians as less salient than the trauma exposure and are de-emphasized as a treatment target, consistent with a diagnostic overshadowing bias.

METHODS

Using an adapted version of a diagnostic overshadowing bias experimental paradigm, mental health clinicians (N = 266, M age = 34.4 years, 82% female) were randomly assigned to receive two of six clinical vignette variations. Vignette 1 described an adolescent with obsessive-compulsive disorder (OCD). Vignette 2 described a pre-adolescent with oppositional defiant disorder (ODD). Vignettes were identical except for whether the youth reported exposure to a potentially traumatic event (PTE; no PTE, sexual PTE, or physical PTE). Clinicians received one vignette with a PTE and one without, counterbalancing order. Clinicians rated the likelihood the youth met criteria for various diagnoses and the appropriateness of various treatments on 7-point scales.

RESULTS

Across both vignettes, clinicians rated the target diagnosis (OCD in Vignette 1, ODD in Vignette 2) as less likely for vignettes with a PTE than for the same vignettes without a PTE. Clinicians also rated evidence-based treatment modalities for target diagnoses as less appropriate in the presence of a PTE than when a PTE was present.

CONCLUSIONS

Consistent with possible bias, clinicians may under-recognize and under-treat non-traumatic stress-related mental health symptoms in youth with a co-occurring trauma history. Future work to validate this bias in real-world practice is indicated.

Implementing trauma-focused cognitive behavioral therapy in Philadelphia: A 10-year evaluation

Background: In 2012, Philadelphia's Department of Behavioral Health and Intellectual disAbility Services (DBHIDS) developed an initiative to implement an evidence-based treatment for posttraumatic stress disorder (PTSD), trauma-focused cognitive behavioral therapy (TF-CBT), across the city's behavioral health system. This report evaluates the initiative's 10-year implementation and effectiveness outcomes. Method: The Exploration, Preparation, Implementation, and Sustainment framework guided our implementation evaluation. The implementation outcomes include adoption, reach, and sustainment; these were obtained during regular evaluation data collection from publicly funded behavioral health agencies participating in the TF-CBT initiative. We analyze effectiveness outcomes (i.e., changes in PTSD symptoms) from a subset of patients receiving TF-CBT, which were collected in 6-month intervals by our research team between 2013 and 2021. Results: From 2012 to 2021, DBHIDS trained 478 clinicians in TF-CBT across 20 behavioral health agencies. During this time, 23,401 youths were screened for potentially traumatic events and PTSD symptoms, and 7,550 youths received TF-CBT. Through the TF-CBT initiative, the city expanded the network of TF-CBT providers from 3 to 20 agencies. DBHIDS sustained this network by maintaining the participation of 16 behavioral health agencies over the course of a decade. The subset of 202 youths who were evaluated to assess TF-CBT effectiveness was drawn from 94 therapists and 20 agencies across Philadelphia. All participating youths completed a baseline assessment, and 151 (75%) completed at least one follow-up assessment. Linear mixed-effects models accounting for observations nested within participants and nested within clinicians found that treatment significantly reduced PTSD symptoms. Conclusion: Between 2012 and 2021, DBHIDS successfully implemented and sustained TF-CBT across the city's behavioral health system. Adoption, reach, and sustainment of TF-CBT were high. Despite the considerable adverse experiences faced by youths seeking treatment in Philadelphia's behavioral health system, TF-CBT was effective. Future directions to improve TF-CBT implementation in the next iteration of the initiative are described.

Learning Collaboratives: a Strategy for Quality Improvement and Implementation in Behavioral Health

Learning collaboratives are increasingly used in behavioral health. They generally involve bringing together teams from different organizations and using experts to educate and coach the teams in quality improvement, implementing evidence-based practices, and measuring the effects. Although learning collaboratives have demonstrated some effectiveness in general health care, the evidence is less clear in behavioral health and more rigorous studies are needed. Learning collaboratives may contain a range of elements, and which elements are included in any one learning collaborative varies widely; the unique contribution of each element has not been established. This commentary seeks to clarify the concept of a learning collaborative, highlight its common elements, review evidence of its effectiveness, identify its application in behavioral health, and highlight recommendations to guide technical assistance purveyors and behavioral health providers as they employ learning collaboratives to improve behavioral health access and quality.

Predictors of nonresponse and drop-out among children and adolescents receiving TF-CBT: investigation of client-, therapist-, and implementation factors

BACKGROUND

There is a paucity of evidence about effective implementation strategies to increase treatment response and prevent drop-out among children receiving evidence-based treatment. This study examines patient, therapist, and implementation factors and their association to nonresponse and drop-out among youth receiving Trauma-Focused Cognitive Behavioral Therapy (TF-CBT).

METHODS

Youth (n = 1240) aged 6-18 (M = 14.6) received TF-CBT delivered by 382 TF-CBT therapists at 66 clinics. Odds ratio analyses were used to investigate whether pretreatment child (age, gender, number of trauma experiences, post-traumatic stress symptoms (PTSS), therapist (education), and implementation strategy factors (high-low, low-low, low-high intensity therapist and leadership training respectively) or tele-mental health training during the Covid-19 pandemic are associated with nonresponse (above clinical PTSS level post-treatment) and drop-out (therapist-defined early termination). Fidelity checks were conducted to ensure that TF-CBT was used consistently.

RESULTS

One fourth of the children (24.4%) were nonresponders and 13.3 percent dropped out. Exposure to three or more traumatic experiences were related to nonresponse and drop-out. Higher baseline PTSS was related to a higher probability of nonresponse. There was no effect of therapist education or child gender on nonresponse and drop-out, whereas children over 15 years had a higher likelihood of both. After controlling for baseline PTSS, the effect of age on nonresponse was no longer significant. Drop-out was related to fewer sessions, and most dropped out during the first two phases of TF-CBT. Fidelity was high throughout the different implementation phases. High-intensity therapist training was related to a lower probability of both nonresponse and drop-out, whereas low therapist and leadership training were related to a higher likelihood of both. Multivariate analysis revealed higher child age and higher PTSS baseline scores as significant predictors of nonresponse, and number of trauma experiences (> = 3) at baseline as the only predictor of drop-out.

CONCLUSIONS

High-intensity therapist training seem key to prevent patient nonresponse and drop-out. Leadership training might positively affect both, although not enough to compensate for less intensive therapist training. More complex cases (higher PTSS and exposure to more traumas) predict nonresponse and drop-out respectively, which underscores the importance of symptom assessment to tailor the treatment. The lack of predictive effect of therapist education increases the utilization of TF-CBT.

TRIAL REGISTRATION

Retrospectively registered in ClinicalTrials, ref. nr. NCT05248971.

Therapists' Perceived Competence in Trauma-Focused Cognitive Behavioral Therapy and Client Outcomes: Findings From a Community-Based Learning Collaborative

This study examined therapists' perceived competence in Trauma-Focused Cognitive Behavioral Therapy (TF-CBT) and its association with youth treatment outcomes (posttraumatic stress and depression). Participants included 99 community therapists enrolled in a TF-CBT-focused Learning Collaborative (LC), along with one of their randomly selected TF-CBT training cases. Analyzed data included: 1) caregiver/youth-reported posttraumatic stress and depressive symptoms, pre- and post-treatment, and 2) therapist-perceived competence with TF-CBT components across treatment delivery. Youth- and caregiver-reports indicated large, significant pre- to post-treatment decreases in youth posttraumatic stress (ds = 1.10-1.30, ps < .001) and depressive symptoms (d = 1.01, p < .001). Higher therapist-perceived competence with TF-CBT predicted positive treatment responses for posttraumatic stress (ds = 0.38-0.39, ps = .03) and depression (d = 0.25), though only the former association was significant (ps = .03 vs. p = .15). Findings highlight the need to monitor and improve therapists' competencies to enhance clinical outcomes for trauma-exposed youth and suggest that LCs may be an effective training/implementation model to help achieve those critical goals.

Testing a community developed training protocol for an evidence-based treatment

The implementation of evidence-based treatments (EBTs) in community behavioral health settings is a recommended practice, yet training experienced by community-based clinicians may require novel and creative training methods. The current study focused on creating a training protocol for Alternative for Families: a Cognitive-Behavioral Therapy from both evidence-based foundations and community-based agency feedback to promote better EBT integration into agencies. Twenty-four clinicians from three agencies were trained using a community-informed training protocol. Outcomes for clinician-reports of organizational functioning, self-reports of skill and knowledge, and observational single-subject data of clinician skills were assessed. Minimal improvements were found for clinician skills across self-report and observations. More research on tailoring trainings to meet needs of community agencies and clinicians should be explored to determine best practice in wide-scale implementation efforts.

Comparing two federal financing strategies on penetration and sustainment of the adolescent community reinforcement approach for substance use disorders: protocol for a mixed-method study

BACKGROUND

Sustained, widespread availability of evidence-based practices (EBPs) is essential to address the public health and societal impacts of adolescent substance use disorders (SUD). There remains a particularly significant need to identify effective financing strategies, which secure and direct financial resources to support the costs associated with EBP implementation and sustainment. This protocol describes a new project comparing two types of U.S. federal grant mechanisms (i.e., a type of financing strategy), which supported the implementation of the Adolescent Community Reinforcement Approach (A-CRA) EBP for SUD, through either organization-focused or state-focused granting of funds. The Exploration-Preparation-Implementation-Sustainment (EPIS) framework will guide our study aims, hypotheses, and selection of measures.

METHOD

We will employ a longitudinal, mixed-method (i.e., web surveys, semi-structured interviews, document review, focus groups, administrative data), quasi-experimental design to compare the grant types' outcomes and examine theoretically informed mediators and moderators. Aim 1 will examine the proportion of eligible clinicians certified in A-CRA with adequate fidelity levels (i.e., penetration outcomes) at the end of grant funding. Aim 2 will examine the sustainment of A-CRA up to 5 years post-funding, using a 10-element composite measure of treatment delivery and supervision activities. We will integrate the new data collected from state-focused grant recipients (~85 organizations in 19 states) with previously collected data from organization-focused grant recipients (Hunter et al., Implement Sci 9:104, 2014) (82 organizations in 26 states) for analysis. We will also use sensitivity analyses to characterize the effects of observed and unobserved secular trends in our quasi-experimental design. Finally, aim 3 will use comparative case study methods (integrating diverse quantitative and qualitative measures) to identify and disseminate policy implications about the roles of state- and organization-focused federal grants in efforts to promote adolescent SUD EBP implementation and sustainment.

DISCUSSION

The proposed research will have direct, practical implications for behavioral health administrators, policymakers, implementation experts, and the public. It will offer new knowledge that can directly inform financing strategies to support large-scale, sustained EBP delivery in behavioral health-while advancing implementation science through the use of novel methods to study financing strategies and sustainment.

Implementation science in adolescent healthcare research: an integrative review

Background

Multiple theories, models and frameworks have been developed to assist implementation of evidence-based practice. However, to date there has been no review of implementation literature specific to adolescent healthcare. This integrative review therefore aimed to determine what implementation science theories, models and frameworks have been applied, what elements of these frameworks have been identified as influential in promoting the implementation and sustainability of service intervention, and to what extent, in what capacity and at what time points has the contribution of adolescent consumer perspectives on evidence implementation been considered. 

Methods

An integrative design was used and reported based on a modified form of the PRISMA (2020) checklist. Seven databases were searched for English language primary research which included any implementation science theory, model or framework developed for/with adolescents or applied in relation to adolescent healthcare services within the past 10 years. Content and thematic analysis were applied with the Consolidated Framework for Implementation Research (CFIR) used to frame analysis of the barriers and facilitators to effective implementation of evidence-informed interventions within youth health settings.

Results

From 8717 citations, 13 papers reporting 12 studies were retained. Nine different implementation science theories, frameworks or approaches were applied; six of 12 studies used the CFIR, solely or with other models. All CFIR domains were represented as facilitators and barriers for implementation in included studies. However, there was little or no inclusion of adolescents in the development or review of these initiatives. Only three mentioned youth input, occurring in the pre-implementation or implementation stages.

Conclusions

The few studies found for this review highlight the internationally under-developed nature of this topic. Flagging the importance of the unique characteristics of this particular age group, and of the interventions and strategies to target it, the minimal input of adolescent consumers is cause for concern. Further research is clearly needed and must ensure that youth consumers are engaged from the start and consistently throughout; that their voice is prioritised and not tokenistic; that their contribution is taken seriously. Only then will age-appropriate evidence implementation enable innovations in youth health services to achieve the evidence-based outcomes they offer.

Trial Registration

PROSPERO 2020 CRD42020201142 https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=201142

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-07941-3.

Exploring perceptions of implementation practice capacity in community-based behavioral health organizations

Community-based organizations (CBOs) must have the capacity to adopt, implement, and sustain evidence-based practices (EBPs). However, limited research exists examining CBOs' ability/capacity to implement EBPs. The purpose of this preliminary study was to investigate how staff of CBOs perceive implementation practice capacity, determine factors needed for adequate capacity for implementing EBPs, and examine which perspectives of capacity are shared across organizational levels. Ninety-seven administrators and practitioners of CBOs were surveyed using the Implementation Capacity Survey, which examines perceived importance, presence, and organizational capacity of the CBO in nine implementation practice areas (IPAs) (e.g., leadership). Results revealed participants rated IPAs on the importance scale higher than IPAs on the present scale. Presence and organizational capacity scales were strongly correlated, and results showed significant differences between administrators and practitioners on ratings of presence and organizational capacity. Implications for future research aimed at examining/building implementation practice capacity in community settings will be discussed.

The impact of implementation climate on community mental health clinicians’ attitudes toward exposure: An evaluation of the effects of training and consultation

Background:

Most evidence-based treatments (EBTs) for posttraumatic stress disorder (PTSD) and anxiety disorders include exposure; however, in community settings, the implementation of exposure lags behind other EBT components. Clinician-level determinants have been consistently implicated as barriers to exposure implementation, but few organizational determinants have been studied. The current study examines an organization-level determinant, implementation climate, and clinician-level determinants, clinician demographic and background factors, as predictors of attitudes toward exposure and changes in attitudes following training.

Method:

Clinicians (n = 197) completed a 3-day training with 6 months of twice-monthly consultation. Clinicians were trained in cognitive behavioral therapy (CBT) for anxiety, depression, behavior problems, and trauma-focused CBT (TF-CBT). Demographic and background information, implementation climate, and attitudes toward exposure were assessed in a pre-training survey; attitudes were reassessed at post-consultation. Implementation climate was measured at the aggregated/group-level and clinician-level.

Results:

Attitudes toward exposure significantly improved from pre-training to post-consultation (t(193) = 9.9, p < .001; d = 0.71). Clinician-level implementation climate scores did not predict more positive attitudes at pre-training (p > .05) but did predict more positive attitudes at post-consultation (ß = −2.46; p < .05) and greater changes in those attitudes (ß = 2.28; p < .05). Group-level implementation climate scores did not predict attitudes at pre-training, post-consultation, or changes in attitudes (all ps > .05). Higher frequency of self-reported CBT use was associated with more positive attitudes at pre-training (ß = −0.81; p < .05), but no other clinician demographic or background determinants were associated with attitudes at post-consultation (all p > .05) or with changes in attitudes (all p > .05).

Conclusions:

Clinician perceptions of implementation climate predicted greater improvement of attitudes toward exposure following EBT training and consultation. Findings suggest that organizational determinants outside of training impact changes in clinicians’ attitudes. Training in four EBTs, only two of which include exposure as a component, resulted in positive changes in clinicians’ attitudes toward exposure, which suggests non-specialty trainings can be effective at changing attitudes, which may enable scale-up.

Exposure is highly effective for treating trauma symptoms and anxiety-based disorders, but it is not commonly used in community mental health settings. Clinicians who endorsed higher expectations, support, and rewards for using exposure in their agency had more positive attitudes toward exposure after training and consultation. Additionally, clinicians who endorsed that exposure is expected, supported, and rewarded in their agency showed a greater improvement in attitudes throughout the training process. Organizational culture can affect clinicians’ attitude changes in the training process, and therefore should become a focus of training efforts.

Child-reported posttraumatic stress symptoms and attrition from therapy

BACKGROUND

High rates of attrition from child trauma-focused treatment are a significant barrier to mitigating children's trauma-related difficulties. Nonetheless, to date, only one study has investigated child-reported posttraumatic stress symptoms (PTSS) in relation to dropout from trauma-focused therapy and the posttraumatic stress disorder (PTSD) symptom clusters remain unexamined.

OBJECTIVE

The present study sought to determine whether higher levels of child-reported PTSS, as well as the specific DSM-IV PTSD symptom clusters, predicted attrition from trauma-focused cognitive behavioral therapy (TF-CBT).

PARTICIPANTS/SETTING/METHOD

One hundred and seventy one children ages 7-18 (M = 11.76, SD = 2.71; 67.4% female; 55.8% Black) were included in the study from an archival database. Dropout was investigated by two operational definitions: 1) clinician-rated dropout, and 2) whether the child received an adequate dose of treatment (i.e., 12 or more sessions).

RESULTS

Sixty eight percent (68.4%) of the children prematurely terminated treatment per their clinician, yet 70.2% received an adequate treatment dose. Child's age and income were related to clinician-rated attrition, but PTSS did not correspond with either attrition definition. None of the PTSD symptom clusters were associated with clinician-rated dropout; however, higher levels of avoidance symptoms were tied to increased likelihood of the child receiving an adequate dose of treatment.

CONCLUSION

From a public health perspective, it is encouraging that children who are reporting higher levels of PTSS may not be at greater risk for attrition.

Sustainment of Trauma-Focused and Evidence-Based Practices Following Learning Collaborative Implementation

Given the need to develop and validate effective implementation models that lead to sustainable improvements, we prospectively examined changes in attitudes, behaviors, and perceived organizational support during and after statewide Community-Based Learning Collaboratives (CBLCs) promoting trauma-focused evidence-based practices (EBPs). Participants (N = 857; i.e., 492 clinicians, 218 brokers, and 139 senior leaders) from 10 CBLCs completed surveys pre- and post-CBLC; a subsample (n = 146) completed a follow-up survey approximately two years post-CBLC. Results indicated (a) medium, sustained increases in clinician-reported use of trauma-focused EBPs, (b) medium to large, sustained increases in perceived organizational support for trauma-focused EBPs, and (c) trivial to small, sustained increases in perceived organizational support for EBPs broadly. In contrast, clinician-reported overall attitudes towards EBPs decreased to a trivial degree pre- to post-CBLC, but then increased to a small, statistically significant degree from post-CBLC to follow-up. Notably, the degree of perceived improvements in organizational support for general and trauma-focused EBPs varied by professional role. Findings suggest the CBLC implementation strategies may both increase and sustain provider practices and organizational support towards EBPs, particularly those EBPs a CBLC explicitly targets.

Assessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review

Inadequate implementation strategy reporting restricts research synthesis and replicability. We explored the implementation strategy reporting quality of a sample of mental health articles using Proctor et al.'s (Implement Sci 8:139, 2013) reporting recommendations. We conducted a narrative review to generate the sample of articles and assigned a reporting quality score to each article. The mean article reporting score was 54% (range 17-100%). The most reported domains were: name (100%), action (82%), target (80%), and actor (67%). The least reported domains included definition (6%), temporality (26%), justification (34%), and outcome (37%). We discuss limitations and provide recommendations to improve reporting.

Using behavioral insights to design implementation strategies in public mental health settings: a qualitative study of clinical decision-making

BACKGROUND

Trauma-focused cognitive behavioral therapy (TF-CBT) is an evidence-based intervention for youth with posttraumatic stress disorder. An important component of TF-CBT is the trauma narrative (TN), a phase in the intervention in which youth are guided to process the memories, thoughts, and feelings associated with their traumatic experience(s). Previous work has shown that TF-CBT clinicians complete TNs with only half of their clients, yet little is known about what determines TF-CBT clinicians' use of TNs. The behavioral insights literature-an interdisciplinary field studying judgment and decision-making-offers theoretical and empirical tools to conceptualize what drives complex human behaviors and decisions. Drawing from the behavioral insights literature, the present study seeks to understand what determines clinician use of TNs and to generate strategies that target these determinants.

METHODS

Through semi-structured qualitative interviews, we sought the perspectives of trained TF-CBT clinicians working in public mental health settings across the city of Philadelphia (N = 17) to understand their decisions to use TNs with clients. We analyzed the qualitative data using a coding approach informed by the behavioral insights literature. We used an iterative process of structured hypothesis generation, aided by a behavioral insights guide, and rapid validation informed by behavioral insights to uncover the determinants of TN use. We then generated implementation strategies that targeted these determinants using the "Easy Attractive Social Timely" framework, a behavioral insights design approach.

RESULTS

We generated and validated three broad themes about what determines clinician implementation of TNs: decision complexity, clinician affective experience, and agency norms. We hypothesized behavioral insights that underlie these implementation determinants and designed a list of nine corresponding behavioral insights strategies that may facilitate TN implementation.

CONCLUSIONS

Our study investigated why an effective component of an evidence-based intervention is difficult to implement. We leveraged robust scientific theories and empirical regularities from the behavioral insights literature to understand clinician perspectives on TN implementation. These factors were theoretically linked to implementation strategies. Our work revealed the potential for using behavioral insights in the diagnosis of evidence-based intervention determinants and the design of implementation strategies.

Disseminating Trauma-Focused Cognitive Behavioral Therapy with a Systematic Self-care Approach to Addressing Secondary Traumatic Stress: PRACTICE What You Preach

This pilot study evaluated the effectiveness of Trauma-Focused Cognitive Behavioral Therapy (TF-CBT) training programs augmented with a systematic "PRACTICE What You Preach" (PWYP) self-care focus, which has trainees personally utilize the coping skills they teach their clients. Participants were 115 clinicians/supervisors who completed a PWYP TF-CBT training program. Pre- to post-training analyses documented significant increases in participants' competency and fidelity in implementing TF-CBT (ps < .001), significantly more frequent use of coping skills including instrumental social support (p < .01), active coping (p < .001), humor (p < .01), and restraint (p < .01), and significant decreases in secondary traumatic stress (STS; p < .001). Children's symptoms of PTSD (ps < .001) and behavior problems (p < .05) also decreased significantly. This preliminary evidence suggests that training augmented with PWYP may enhance clinicians'/supervisors' personal coping and reduce their levels of STS without compromising treatment implementation efforts and client outcomes.

Determinants of Implementing Evidence-Based Trauma-Focused Interventions for Children and Youth: A Systematic Review

A systematic review was conducted to identify determinants (barriers and facilitators) of implementing evidence-based psychosocial interventions for children and youth who experience emotional or behavioral difficulties due to trauma exposure. Determinants were coded, abstracted, and synthesized using the Exploration, Preparation, Implementation, and Sustainment framework. Twenty-three articles were included, all of which examined implementation of Trauma-Focused Cognitive Behavioral Therapy or Cognitive-Behavioral Intervention for Trauma in Schools. This review identified multilevel and multiphase determinants that can be addressed by implementation strategies to improve implementation and clinical outcomes, and suggests how future studies might address gaps in the evidence base.

The use of the PARIHS framework in implementation research and practice-a citation analysis of the literature

BACKGROUND

The Promoting Action on Research Implementation in Health Services (PARIHS) framework was developed two decades ago and conceptualizes successful implementation (SI) as a function (f) of the evidence (E) nature and type, context (C) quality, and the facilitation (F), [SI = f (E,C,F)]. Despite a growing number of citations of theoretical frameworks including PARIHS, details of how theoretical frameworks are used remains largely unknown. This review aimed to enhance the understanding of the breadth and depth of the use of the PARIHS framework.

METHODS

This citation analysis commenced from four core articles representing the key stages of the framework's development. The citation search was performed in Web of Science and Scopus. After exclusion, we undertook an initial assessment aimed to identify articles using PARIHS and not only referencing any of the core articles. To assess this, all articles were read in full. Further data extraction included capturing information about where (country/countries and setting/s) PARIHS had been used, as well as categorizing how the framework was applied. Also, strengths and weaknesses, as well as efforts to validate the framework, were explored in detail.

RESULTS

The citation search yielded 1613 articles. After applying exclusion criteria, 1475 articles were read in full, and the initial assessment yielded a total of 367 articles reported to have used the PARIHS framework. These articles were included for data extraction. The framework had been used in a variety of settings and in both high-, middle-, and low-income countries. With regard to types of use, 32% used PARIHS in planning and delivering an intervention, 50% in data analysis, 55% in the evaluation of study findings, and/or 37% in any other way. Further analysis showed that its actual application was frequently partial and generally not well elaborated.

CONCLUSIONS

In line with previous citation analysis of the use of theoretical frameworks in implementation science, we also found a rather superficial description of the use of PARIHS. Thus, we propose the development and adoption of reporting guidelines on how framework(s) are used in implementation studies, with the expectation that this will enhance the maturity of implementation science.

Improving the implementation and sustainment of evidence-based practices in community mental health organizations: a study protocol for a matched-pair cluster randomized pilot study of the Collaborative Organizational Approach to Selecting and Tailoring Implementation Strategies (COAST-IS)

Background

Implementing and sustaining evidence-based programs with fidelity may require multiple implementation strategies tailored to address multi-level, context-specific barriers and facilitators. Ideally, selecting and tailoring implementation strategies should be guided by theory, evidence, and input from relevant stakeholders; however, methods to guide the selection and tailoring of strategies are not well-developed. There is a need for more rigorous methods for assessing and prioritizing implementation determinants (barriers and facilitators) and linking implementation strategies to determinants. The Collaborative Organizational Approach to Selecting and Tailoring Implementation Strategies (COAST-IS) is an intervention designed to increase the effectiveness of evidence-based practice implementation and sustainment. COAST-IS will enable organizational leaders and clinicians to use Intervention Mapping to select and tailor implementation strategies to address their site-specific needs. Intervention Mapping is a multi-step process that incorporates theory, evidence, and stakeholder perspectives to ensure that implementation strategies effectively address key determinants of change.

Methods

COAST-IS will be piloted with community mental health organizations that are working to address the needs of children and youth who experience trauma-related emotional or behavioral difficulties by engaging in a learning collaborative to implement an evidence-based psychosocial intervention (trauma-focused cognitive behavioral therapy). Organizations will be matched and then randomized to participate in the learning collaborative only (control) or to receive additional support through COAST-IS. The primary aims of this study are to (1) assess the acceptability, appropriateness, feasibility, and perceived utility of COAST-IS; (2) evaluate the organizational stakeholders' fidelity to the core elements of COAST-IS; and (3) demonstrate the feasibility of testing COAST-IS in a larger effectiveness trial.

Discussion

COAST-IS is a systematic method that integrates theory, evidence, and stakeholder perspectives to improve the effectiveness and precision of implementation strategies. If effective, COAST-IS has the potential to improve the implementation and sustainment of a wide range of evidence-based practices in mental health and other sectors.

Trial registration

This study was registered in ClinicalTrials.gov (NCT03799432) on January 10, 2019 (last updated August 5, 2019).

Preaching to the Choir? Predictors of Engagement in a Community-Based Learning Collaborative

This study examined predictors of engagement among 283 professionals from 34 agencies participating in three community-based learning collaboratives (CBLCs) on trauma-focused cognitive-behavioral therapy (TF-CBT). Only 50.2% of participants completed the CBLC, primarily due to not attending consultation calls or completing training cases. While higher engagement was associated with being trauma-informed and using more of the TF-CBT components prior to the CBLC, most predictors were not significant, perhaps due to ceiling effects. Positive attitudes and high organizational support were not sufficient to ensure engagement. Future research using longitudinal measurement of a wider range of predictors is needed.

Association of Childhood Trauma Exposure With Adult Psychiatric Disorders and Functional Outcomes

IMPORTANCE

Being exposed to trauma is a common childhood experience associated with symptoms and impairments in childhood.

OBJECTIVE

To assess the association between cumulative childhood trauma exposure and adult psychiatric and functional outcomes.

DESIGN, SETTING, AND PARTICIPANTS

Prospective, population-based cohort study of 1420 participants. A community representative sample of participants was assessed with structured Child and Adolescent Psychiatric Assessment interviews up to 8 times in childhood (ages 9-16 years; 6674 observations; 1993-2000) for lifetime trauma exposure as defined by the Diagnostic and Statistical Manual of Mental Disorders. Participants were followed up 4 times in adulthood (ages 19, 21, 25, and 30 years; 4556 observations of 1336 participants; 1999-2015) with the structured Young Adult Psychiatric Assessment Interview for psychiatric outcomes, functional outcomes, and evidence of a disrupted transition to adulthood. Analysis was completed in 2018.

EXPOSURE

Participants were assessed with the structured Child and Adolescent Psychiatric Assessment interview (parent and self-report) up to 8 times in childhood for lifetime trauma exposure (ages 9-16 years; 6674 observations; 1993-2000).

MAIN OUTCOMES AND MEASURES

Participants were assessed up to 4 times with the structured Young Adult Psychiatric Assessment interview (self-report) in adulthood (ages 19, 21, 25, and 30 years; 4556 observations of 1336 participants; 1999-2015) for psychiatric outcomes, functional outcomes, and evidence of a disrupted transition to adulthood.

RESULTS

Among the 1420 study participants, 630 (49.0%) were female and 983 (89.4%) were white. By age 16 years, 30.9% of children (n = 451) were exposed to 1 traumatic event, 22.5% (n = 289) were exposed to 2 such events, and 14.8% (n = 267) were exposed to 3 or more. Cumulative childhood trauma exposure to age 16 years was associated with higher rates of adult psychiatric disorders (odds ratio for any disorder, 1.2; 95% CI, 1.0-1.4) and poorer functional outcomes, including key outcomes that indicate a significantly disrupted transition to adulthood (eg, failure to hold a job and social isolation). Childhood trauma exposure continued to be associated with higher rates of adult psychiatric and functional outcomes after adjusting for a broad range of childhood risk factors, including psychiatric functioning and family adversities and hardships (adjusted odds ratio for any disorder, 1.3; 95% CI, 1.0-1.5).

CONCLUSIONS AND RELEVANCE

Cumulative childhood trauma exposure was associated with poor adult outcomes even after accounting for many of the childhood and family factors associated with both trauma exposure and poor adult outcomes. Childhood trauma exposures are common, but often preventable, thus providing a clear target for child-focused public health efforts to ameliorate long-term morbidity.