Improving and sustaining delivery of CPT for PTSD in mental health systems: a cluster randomized trial

Using the multiphase optimization strategy to adapt cognitive processing therapy (CPT MOST): study protocol for a randomized controlled factorial experiment

BACKGROUND

Approximately ten percent of US military veterans suffer from posttraumatic stress disorder (PTSD). Cognitive processing therapy (CPT) is a highly effective, evidence-based, first-line treatment for PTSD that has been widely adopted by the Department of Veterans Affairs (VA). CPT consists of discrete therapeutic components delivered across 12 sessions, but most veterans (up to 70%) never reach completion, and those who discontinue therapy receive only four sessions on average. Unfortunately, veterans who drop out prematurely may never receive the most effective components of CPT. Thus, there is an urgent need to use empirical approaches to identify the most effective components of CPT so CPT can be adapted into a briefer format.

METHODS

The multiphase optimization strategy (MOST) is an innovative, engineering-inspired framework that uses an optimization trial to assess the performance of individual intervention components within a multicomponent intervention such as CPT. Here we use a fractional factorial optimization trial to identify and retain the most effective intervention components to form a refined, abbreviated CPT intervention package. Specifically, we used a 16-condition fractional factorial experiment with 270 veterans (N = 270) at three VA Medical Centers to test the effectiveness of each of the five CPT components and each two-way interaction between components. This factorial design will identify which CPT components contribute meaningfully to a reduction in PTSD symptoms, as measured by PTSD symptom reduction on the Clinician-Administered PTSD Scale for DSM-5, across 6 months of follow-up. It will also identify mediators and moderators of component effectiveness.

DISCUSSION

There is an urgent need to adapt CPT into a briefer format using empirical approaches to identify its most effective components. A brief format of CPT may reduce attrition and improve efficiency, enabling providers to treat more patients with PTSD. The refined intervention package will be evaluated in a future large-scale, fully-powered effectiveness trial. Pending demonstration of effectiveness, the refined intervention can be disseminated through the VA CPT training program.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05220137. Registration date: January 21, 2022.

Initiating Cognitive Processing Therapy (CPT) in Community Settings: A Qualitative Investigation of Therapist Decision-Making

Various organizations have provided treatment guidelines intended to aid therapists in deciding how to treat posttraumatic stress disorder (PTSD). Yet evidence-based psychotherapies (EBPs) for PTSD in the community may be difficult to obtain. Although strides have been made to implement EBPs for PTSD in institutional settings such as the United States Veterans Affairs, community uptake remains low. Factors surrounding clients' decisions to enroll in EBPs have been identified in some settings; however less is known regarding trained therapists' decisions related to offering trauma-focused therapies or alternative treatment options. Thus, the aim of the current study was to examine therapist motivations to initiate CPT in community settings. The present study utilizes data from a larger investigation aiming to support the sustained implementation of Cognitive Processing Therapy (CPT) in community mental health treatment settings. Enrolled therapists participated in phone interviews discussing their opinions of CPT, preferred treatments for PTSD, and process in assessing appropriate PTSD treatments for clients. Semi-structured interviews (N = 29) were transcribed and analyzed using a directed content analysis approach. Several themes emerged regarding therapists' decision-making in selecting PTSD treatments. Therapist motivations to use EBPs for PTSD, primarily CPT, were identified at the client (e.g., perceived compatibility with client-level characteristics), therapist (e.g., time limitations), and clinic levels (e.g., leadership support). The results provide insight into the complex array of factors that affect sustainability of EBPs for PTSD in community settings and inform future dissemination of EBPs, including training efforts in community settings.

Learning Collaboratives: a Strategy for Quality Improvement and Implementation in Behavioral Health

Learning collaboratives are increasingly used in behavioral health. They generally involve bringing together teams from different organizations and using experts to educate and coach the teams in quality improvement, implementing evidence-based practices, and measuring the effects. Although learning collaboratives have demonstrated some effectiveness in general health care, the evidence is less clear in behavioral health and more rigorous studies are needed. Learning collaboratives may contain a range of elements, and which elements are included in any one learning collaborative varies widely; the unique contribution of each element has not been established. This commentary seeks to clarify the concept of a learning collaborative, highlight its common elements, review evidence of its effectiveness, identify its application in behavioral health, and highlight recommendations to guide technical assistance purveyors and behavioral health providers as they employ learning collaboratives to improve behavioral health access and quality.

Performance of a Supervisor Observational Coding System and an Audit and Feedback Intervention

Workplace-based clinical supervision is common in community based mental health care for youth and families and could be a leveraged to scale and improve the implementation of evidence-based treatment (EBTs). Accurate methods are needed to measure, monitor, and support supervisor performance with limited disruption to workflow. Audit and Feedback (A&F) interventions may offer some promise in this regard. The study-a randomized controlled trial with 60 clinical supervisors measured longitudinally for 7 months-had two parts: (1) psychometric evaluation of an observational coding system for measuring adherence and competence of EBT supervision and (2) evaluation of an experimental Supervisor Audit and Feedback (SAF) intervention on outcomes of supervisor adherence and competence. All supervisors recorded and uploaded weekly supervision sessions for 7 months, and those in the experimental condition were provided a single, monthly web-based feedback report. Psychometric performance was evaluated using measurement models based in Item Response Theory, and the effect of the SAF intervention was evaluated using mixed-effects regression models. The observational instrument performed well across psychometric indicators of dimensionality, rating scale functionality, and item fit; however, coder reliability was lower for competence than for adherence. Statistically significant A&F effects were largely in the expected directions and consistent with hypotheses. The observational coding system performed well, and a monthly electronic feedback report showed promise in maintaining or improving community-based clinical supervisors' adherence and, to a lesser extent, competence. Limitations discussed include unknown generalizability to the supervision of other EBTs.

The Association Between Clinician and Perceived Organizational Factors with Early Fidelity to Cognitive Processing Therapy for Posttraumatic Stress Disorder in a Randomized Controlled Implementation Trial

A common metric for determining implementation success is the measurement of clinician adherence to, and competence in, delivering a psychotherapy. The present study examined clinician and organizational factors as predictors of early adherence and competence among 78 clinicians delivering cognitive processing therapy (CPT), an evidence-based psychotherapy (EBP) for posttraumatic stress disorder, in a randomized controlled implementation trial. Results indicated that clinicians' willingness to adopt an EBP if required to do so was significantly associated with early adherence and competence in CPT delivery. Level of clinician education was significantly associated with early competence in delivering CPT. Organizational factors did not predict early adherence or competence. Implications of the findings are discussed.

Assessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review

Inadequate implementation strategy reporting restricts research synthesis and replicability. We explored the implementation strategy reporting quality of a sample of mental health articles using Proctor et al.'s (Implement Sci 8:139, 2013) reporting recommendations. We conducted a narrative review to generate the sample of articles and assigned a reporting quality score to each article. The mean article reporting score was 54% (range 17-100%). The most reported domains were: name (100%), action (82%), target (80%), and actor (67%). The least reported domains included definition (6%), temporality (26%), justification (34%), and outcome (37%). We discuss limitations and provide recommendations to improve reporting.

Training During a Pandemic: Successes, Challenges, and Practical Guidance From a Virtual Facilitated Learning Collaborative Training Program for Written Exposure Therapy

In response to COVID-19, continued workforce training is essential to ensure that evidence-based treatments are available on the frontline to meet communities' ongoing and emerging mental health needs. However, training during a pandemic imposes many new challenges. This paper describes a multisite training and implementation pilot program, facets of which allowed for continued training despite the onset of the COVID-19 pandemic and subsequent social distancing guidelines. This virtual facilitated learning collaborative in Written Exposure Therapy, an evidence-based treatment for posttraumatic stress disorder, included virtual workshop training, phone-based clinical consultation, implementation-focused video calls for program leadership, and program evaluation. Data are presented about program enrollees and patient impact following the onset of COVID-19-related social distancing restrictions. Challenges, successes, and practical guidance are discussed to inform the field regarding training strategies likely to be durable in an uncertain, dynamic healthcare landscape.

The Value Equation: Three complementary propositions for reconciling fidelity and adaptation in evidence-based practice implementation

BACKGROUND

There has long been debate about the balance between fidelity to evidence-based interventions (EBIs) and the need for adaptation for specific contexts or particular patients. The debate is relevant to virtually all clinical areas. This paper synthesises arguments from both fidelity and adaptation perspectives to provide a comprehensive understanding of the challenges involved, and proposes a theoretical and practical approach for how fidelity and adaptation can optimally be managed.

DISCUSSION

There are convincing arguments in support of both fidelity and adaptations, representing the perspectives of intervention developers and internal validity on the one hand and users and external validity on the other. Instead of characterizing fidelity and adaptation as mutually exclusive, we propose that they may better be conceptualized as complimentary, representing two synergistic perspectives that can increase the relevance of research, and provide a practical way to approach the goal of optimizing patient outcomes. The theoretical approach proposed, the "Value Equation," provides a method for reconciling the fidelity and adaptation debate by putting it in relation to the value (V) that is produced. The equation involves three terms: intervention (IN), context (C), and implementation strategies (IS). Fidelity and adaptation determine how these terms are balanced and, in turn, the end product - the value it produces for patients, providers, organizations, and systems. The Value Equation summarizes three central propositions: 1) The end product of implementation efforts should emphasize overall value rather than only the intervention effects, 2) implementation strategies can be construed as a method to create fit between EBIs and context, and 3) transparency is vital; not only for the intervention but for all of the four terms of the equation. There are merits to arguments for both fidelity and adaptation. We propose a theoretical approach, a Value Equation, to reconciling the fidelity and adaptation debate. Although there are complexities in the equation and the propositions, we suggest that the Value Equation be used in developing and testing hypotheses that can help implementation science move toward a more granular understanding of the roles of fidelity and adaptation in the implementation process, and ultimately sustainability of practices that provide value to stakeholders.

The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions

Background

This paper describes the process and results of a refinement of a framework to characterize modifications to interventions. The original version did not fully capture several aspects of modification and adaptation that may be important to document and report. Additionally, the earlier framework did not include a way to differentiate cultural adaptation from adaptations made for other reasons. Reporting additional elements will allow for a more precise understanding of modifications, the process of modifying or adapting, and the relationship between different forms of modification and subsequent health and implementation outcomes.

Discussion

We employed a multifaceted approach to develop the updated FRAME involving coding documents identified through a literature review, rapid coding of qualitative interviews, and a refinement process informed by multiple stakeholders. The updated FRAME expands upon Stirman et al.’s original framework by adding components of modification to report: (1) when and how in the implementation process the modification was made, (2) whether the modification was planned/proactive (i.e., an adaptation) or unplanned/reactive, (3) who determined that the modification should be made, (4) what is modified, (5) at what level of delivery the modification is made, (6) type or nature of context or content-level modifications, (7) the extent to which the modification is fidelity-consistent, and (8) the reasons for the modification, including (a) the intent or goal of the modification (e.g., to reduce costs) and (b) contextual factors that influenced the decision. Methods of using the framework to assess modifications are outlined, along with their strengths and weaknesses, and considerations for research to validate these measurement strategies.

Conclusion

The updated FRAME includes consideration of when and how modifications occurred, whether it was planned or unplanned, relationship to fidelity, and reasons and goals for modification. This tool that can be used to support research on the timing, nature, goals and reasons for, and impact of modifications to evidence-based interventions.

Provider fidelity and modifications to cognitive processing therapy in a diverse community health clinic: Associations with clinical change

OBJECTIVE

The purpose of this study is to examine associations between therapist adherence, competence, and modifications of an evidence-based protocol (EBP) delivered in routine clinical care and client outcomes.

METHOD

Data were derived from a NIMH-funded implementation-effectiveness hybrid study of Cognitive Processing Therapy (CPT) for PTSD in a diverse community health center. Providers (n = 19) treated clients (n = 58) as part of their routine clinical care. Clients completed the PCL-S and PHQ-9 at baseline, after each CPT session, and posttreatment. CPT sessions were rated for treatment fidelity and therapist modifications.

RESULTS

Overall, therapist adherence was high, although it decreased across sessions suggesting potential drift. Therapist competence ratings varied widely. Therapists made on average 1.6 fidelity-consistent and 0.4 fidelity-inconsistent modifications per session. Results show that higher numbers of fidelity-consistent modifications were associated with larger reductions in posttraumatic stress and depressive symptoms. High adherence ratings were associated with greater reductions in depressive symptoms, whereas higher competence ratings were associated with greater reduction in posttraumatic stress symptoms.

CONCLUSIONS

The results highlight the importance of differentially assessing therapist adherence, competence, and modifications to EBP in usual care settings. The findings also suggest that effective EBP delivery in routine care may require minor adaptations to meet client needs, consistent with previous studies. Greater attention to fidelity and adaptation can enhance training so providers can tailor while retaining core components of the intervention. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Treatment of military-related post-traumatic stress disorder: challenges, innovations, and the way forward

Post-traumatic stress disorder (PTSD) is one of the common mental disorders in military and veteran populations. Considerable research and clinical opinion has been focused on understanding the relationship between PTSD and military service and the implications for prevention, treatment, and management. This paper examines factors associated with the development of PTSD in this population, considers issues relating to engagement in treatment, and discusses the empirical support for best practice evidence-based treatment. The paper goes on to explore the challenges in those areas, with particular reference to treatment engagement and barriers to care, as well as treatment non-response. The final section addresses innovative solutions to these challenges through improvements in agreed terminology and definitions, strategies to increase engagement, early identification approaches, understanding predictors of treatment outcome, and innovations in treatment. Treatment innovations include enhancing existing treatments, emerging non-trauma-focused interventions, novel pharmacotherapy, personalized medicine approaches, advancing functional outcomes, family intervention and support, and attention to physical health.

An analysis of adaptations to multi-level intervention strategies to enhance implementation of clinical practice guidelines for treating tobacco use in dental care settings

Introduction

Our team conducted a cluster randomized controlled trial (DUET) that compared the effectiveness of three theory-driven, implementation strategies on dental provider adherence to tobacco dependence treatment guidelines (TDT). In this paper we describe the process of adapting the implementation strategies to the local context of participating dental public health clinics in New York City.

Methods

Eighteen dental clinics were randomized to one of three study arms testing several implementation strategies: Current Best Practices (CBP) (i.e. staff training, clinical reminder system and Quitline referral system); CBP + Performance Feedback (PF) (i.e. feedback reports on provider delivery of TDT); and CBP + PF + Pay-for-Performance (i.e. financial incentives for provision of TDT). Through an iterative process, we used Stirman's modification framework to classify, code and analyze modifications made to the implementation strategies.

Results

We identified examples of six of Stirman's twelve content modification categories and two of the four context modification categories. Content modifications were classified as: tailoring, tweaking or refining (49.8%), adding elements (14.1%), departing from the intervention (9.3%), loosening structure (4.4%), lengthening and extending (4.4%) and substituting elements (4.4%). Context modifications were classified as those related to personnel (7.9%) and to the format/channel (8.8%) of the intervention delivery. Common factors associated with adaptations that arose during the intervention included staff changes, time constraints, changes in leadership preferences and functional limitations of to the Electronic Dental Record.

Conclusions

This study offers guidance on how to capture intervention adaptation in the context of a multi-level intervention aimed at implementing sustainable changes to optimize TDT in varying public health dental settings.

The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care

There is strong interest in implementation science to address the gap between research and practice in public health. Research on the sustainability of evidence-based interventions has been growing rapidly. Sustainability has been defined as the continued use of program components at sufficient intensity for the sustained achievement of desirable program goals and population outcomes. This understudied area has been identified as one of the most significant translational research problems. Adding to this challenge is uncertainty regarding the extent to which intervention adaptation and evolution are necessary to address the needs of populations that differ from those in which interventions were originally tested or implemented. This review critically examines and discusses conceptual and methodological issues in studying sustainability, summarizes the multilevel factors that have been found to influence the sustainability of interventions in a range of public health and health care settings, and highlights key areas for future research.