Implementing cognitive behavioral therapy in the real world: a case study of two mental health centers

Implementation of 'IBD-Specific Cognitive Behavioural Therapy' for Patients with Inflammatory Bowel Diseases with Poor Mental Quality of Life, Anxiety and Depression

This paper describes the implementation of inflammatory bowel disease (IBD)-specific cognitive behavioural therapy (CBT) for IBD patients with poor quality of life (QoL), anxiety and depression, in four hospitals in the Netherlands. Treatment outcomes were compared with those of a previously published randomized control trial (RCT) of 'IBD-specific CBT', following a benchmark strategy. Primary outcome was IBD-specific QoL (IBDQ) completed before and after CBT, secondary outcomes were anxiety and depressive symptoms (HADS, CES-D). Semi-structured interviews were conducted among a pilot of gastroenterologists, nurse specialists and psychologists to evaluate 'IBD-specific CBT'. 94 patients started treatment (280 screened). At follow-up, 63 participants (67% compared to 81% in the RCT benchmark) completed the IBDQ. Treatment effect sizes of the implementation study were comparable and slightly larger than those of RCT benchmark. Gastroenterologists, IBD nurses and psychologists found CBT necessary for IBD patients with poor QoL, depression and/or anxiety disorders. 'IBD-specific CBT' can be successfully implemented. Regular supervision of psychologists performing 'IBD-specific CBT' treatment is needed.

Mindfulness-based cognitive therapy in functional dyspepsia: A pilot randomized trial

BACKGROUND AND AIM

Patients with functional dyspepsia (FD) often have concomitant anxiety and depression. Mindfulness-based cognitive therapy (MBCT) combines the principles of cognitive behavioral therapy and mindfulness. It is a group-based therapy and has been shown to be efficacious in functional gastrointestinal disorders. There are no randomized controlled trials (RCTs) evaluating MBCT in FD. We aimed to evaluate feasibility and efficacy of MBCT in FD management.

METHODS

We performed a mixed-method single-center pilot randomized trial of 28 patients fulfilling ROME-III criteria for FD. Fifteen patients were randomized to an 8-week MBCT program while 13 underwent treatment-as-usual (TAU). Patients completed questionnaires at baseline and at week 8. Two focus-groups were conducted. Feasibility of recruitment, acceptability of randomization, procedures and intervention, handout compliance and feasibility of quantitative measures were assessed. The primary outcome was subjective-clinical-assessment of FD symptoms (SCA-FD). Secondary outcome measures included Short-form Nepean Dyspepsia Index (SF-NDI), subjective-clinical-assessment of general health (SCA-GH), EuroQoL-Visual Analog Scale (EuroQoL-VAS), and Depression, Anxiety and Stress Scale-21 Items (DASS-21).

RESULTS

Twelve of 15 patients in the MBCT group completed the program. There was a trend towards symptom improvement, with 90% in the MBCT group reporting improvement in SCA-FD compared with 45% in TAU(P = 0.063). Patients who underwent MBCT reported greater improvement in SF-NDI (mean change: -8.8 (SD: 7.5) vs -0.7 (7.2), P = 0.018) and DASS-21 (-19.8 (29.5) vs -5.5 (6.6) P = 0.13) compared with TAU. There was no difference in SCA-GH and EuroQoL-VAS. Based on SCA-FD improvement, the eventual RCT will require 50 patients (25 in each group).

CONCLUSIONS

Mindfulness-based cognitive therapy is likely efficacious for FD, and it would be feasible to conduct a RCT.

Implementation Science is Imperative to the Optimization of Obstetric Care

In an effort aimed at improving outcomes, obstetric teams have enacted comprehensive care bundles and other clinical tools. Yet, these practices have had limited degrees of success on a national scale. Implementation science aims to bridge the divide between the development of evidence-based interventions and their real-world utilization. This emerging field takes into account key stakeholders at the clinician, institution, and health policy levels. Implementation science evaluates how well an intervention is or can be delivered, to whom, in which context, and how it may be up-scaled and sustained. Other medical disciplines have embraced these concepts with success. The frameworks and theories of implementation science can and should be incorporated into both obstetric research and practice. By doing so, we can increase widespread and timely adoption of evidence and further our common goal of decreasing maternal morbidity and mortality. KEY POINTS: · Evidence-based practices have been implemented in obstetrics with variable success.. · Implementation science aims to bridge the divide between the development of evidence-based interventions and their real-world utilization.. · The methodologies of implementation science may be helpful to obstetric research and practice..

Therapists' Experiences of Psychodynamic Therapy with and without Transference Interventions for Adolescents with Depression

Psychodynamic therapy is an effective treatment for depression. However, a large number of adolescent patients with depression do not respond and/or drop out of therapy and little is known about what therapists actually do in therapy with adolescents. Thus, more research is needed to explore the various actions that therapists do in therapy, so that therapists can tailor their therapy more specifically to each individual adolescent. The present study aimed to investigate how the experience of psychotherapists differs between two treatment modes for adolescents with depression: psychodynamic psychotherapy with and without transference interventions. In-depth interviews were conducted with six therapists. The data, which were analyzed using thematic analysis, generated three key themes: (1) The therapists experienced that transference interventions are often useful in therapies with adolescents with depression, (2) therapies without transference interventions can be challenging for therapists, but still helpful for patients, and (3) the experience contributed to the deepening recognition of therapists that they always need to adapt their techniques to the particular patient. The results enhance our knowledge of the significance of therapists’ actions in therapy with adolescents. The therapists highlighted issues that are important for identifying barriers to incorporating new knowledge into clinical practice.

Evidence-based practice in child and adolescent mental health services - The challenge of implementing national guidelines for treatment of depression and anxiety

BACKGROUND

Mental health problems are one of the most pressing public health concerns of our time. Sweden has seen a sharp increase in mental disorders among children and youth during the last decade. The evidence base for treatment of psychiatric conditions has developed strongly. Clinical practice guidelines aim to compile such evidence and support healthcare professionals in evidence-based clinical decision-making. In Sweden, the national guidelines for the treatment of depression and anxiety disorders in children and adolescents were launched in 2010. The aim of this study was two folded, (i) to explore to what extent these guidelines were known and adhered to by health professionals in Child and Adolescent Mental Health Services and (ii) to investigate factors influencing implementation of the guidelines informed by the Consolidated Framework for Implementation Research.

METHODS

A qualitative approach was used, and data were collected through interviews with 18 health professionals in Child Mental Health Services in Sweden and a combination of conventional and directed content analyses was used. The Consolidated Framework for Implementation Research guided and structured data collection and analysis.

RESULTS

The guidelines were largely unknown by health professionals in Child Mental Health Services in all the clinics investigated. Adherence to guideline recommendations was reported as very low. Barriers to implementation were found in relation to the characteristics of the intervention, outer setting, inner setting and characteristics of the individuals involved.

CONCLUSIONS

The government initiative to develop and disseminate the guidelines seems to have made very little impact on health professionals' clinical practice. The guidelines were poorly aligned with the health professionals' knowledge and beliefs about effective mental health services for children and youth with depression and anxiety disorders. Suggestions for future efforts to improve the development and implementation of guidelines in Child Mental Health Services settings are given.

The Implementation of Functional Family Therapy (FFT) as an Intervention for Youth Probationers in Singapore

Family functioning is predictive of youth recidivism in Singapore. However, there is a lack of family based interventions for youth offenders on community probation. Evidence-based family interventions developed in Western populations, such as Functional Family Therapy (FFT), have been found to be effective in mitigating subsequent youth criminal behavior. However, no study has examined whether such interventions can be implemented and adapted for use in Eastern cultures. Thus, this paper sought to detail the implementation of FFT in Singapore. Rationale for the adoption of FFT is discussed, and key activities undertaken during the first 18 months of implementation are described. Preliminary data suggest that initial implementation efforts were successful. Challenges encountered, and implications in relation to the broader literature are discussed.

Adaptive School-based Implementation of CBT (ASIC): clustered-SMART for building an optimized adaptive implementation intervention to improve uptake of mental health interventions in schools

Background

Depressive and anxiety disorders affect 20–30% of school-age youth, most of whom do not receive adequate services, contributing to poor developmental and academic outcomes. Evidence-based practices (EBPs) such as cognitive behavioral therapy (CBT) can improve outcomes, but numerous barriers limit access among affected youth. Many youth try to access mental health services in schools, but school professionals (SPs: counselors, psychologists, social workers) are rarely trained adequately in CBT methods. Further, SPs face organizational barriers to providing CBT, such as lack of administrative support. Three promising implementation strategies to address barriers to school-based CBT delivery include (1) Replicating Effective Programs (REP), which deploys customized CBT packaging, didactic training in CBT, and technical assistance; (2) coaching, which extends training via live supervision to improve SP competence in CBT delivery; and (3) facilitation, which employs an organizational expert who mentors SPs in strategic thinking to promote self-efficacy in garnering administrative support. REP is a relatively low-intensity/low-cost strategy, whereas coaching and facilitation require additional resources. However, not all schools will require all three strategies. The primary aim of this study is to compare the effectiveness of a school-level adaptive implementation intervention involving REP, coaching, and facilitation versus REP alone on the frequency of CBT delivered to students by SPs and student mental health outcomes. Secondary and exploratory aims examine cost-effectiveness, moderators, and mechanisms of implementation strategies.

Methods

Using a clustered, sequential multiple-assignment, randomized trial (SMART) design, ≥ 200 SPs from 100 schools across Michigan will be randomized initially to receive REP vs. REP+coaching. After 8 weeks, schools that do not meet a pre-specified implementation benchmark are re-randomized to continue with the initial strategy or to augment with facilitation.

Discussion

EBPs need to be implemented successfully and efficiently in settings where individuals are most likely to seek care in order to gain large-scale impact on public health. Adaptive implementation interventions hold the promise of providing cost-effective implementation support. This is the first study to test an adaptive implementation of CBT for school-age youth, at a statewide level, delivered by school staff, taking an EBP to large populations with limited mental health care access.

Trial registration

NCT03541317—Registered on 29 May 2018 on ClinicalTrials.gov PRS

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0808-8) contains supplementary material, which is available to authorized users.

Organizational and provider level factors in implementation of trauma-informed care after a city-wide training: an explanatory mixed methods assessment

Background

While there is increasing support for training youth-serving providers in trauma-informed care (TIC) as a means of addressing high prevalence of U.S. childhood trauma, we know little about the effects of TIC training on organizational culture and providers’ professional quality of life. This mixed-methods study evaluated changes in organizational- and provider-level factors following participation in a citywide TIC training.

Methods

Government workers and nonprofit professionals (N = 90) who participated in a nine-month citywide TIC training completed a survey before and after the training to assess organizational culture and professional quality of life. Survey data were analyzed using multiple regression analyses. A subset of participants (n = 16) was interviewed using a semi-structured format, and themes related to organizational and provider factors were identified using qualitative methods.

Results

Analysis of survey data indicated significant improvements in participants’ organizational culture and professional satisfaction at training completion. Participants’ perceptions of their own burnout and secondary traumatic stress also increased. Four themes emerged from analysis of the interview data, including “Implementation of more flexible, less-punitive policies towards clients,” “Adoption of trauma-informed workplace design,” “Heightened awareness of own traumatic stress and need for self-care,” and “Greater sense of camaraderie and empathy for colleagues.”

Conclusion

Use of a mixed-methods approach provided a nuanced understanding of the impact of TIC training and suggested potential benefits of the training on organizational and provider-level factors associated with implementation of trauma-informed policies and practices. Future trainings should explicitly address organizational factors such as safety climate and morale, managerial support, teamwork climate and collaboration, and individual factors including providers’ compassion satisfaction, burnout, and secondary traumatic stress, to better support TIC implementation.

Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation Research

Purposeful sampling is widely used in qualitative research for the identification and selection of information-rich cases related to the phenomenon of interest. Although there are several different purposeful sampling strategies, criterion sampling appears to be used most commonly in implementation research. However, combining sampling strategies may be more appropriate to the aims of implementation research and more consistent with recent developments in quantitative methods. This paper reviews the principles and practice of purposeful sampling in implementation research, summarizes types and categories of purposeful sampling strategies and provides a set of recommendations for use of single strategy or multistage strategy designs, particularly for state implementation research.

A qualitative analysis of the concepts of fidelity and adaptation in the implementation of an evidence-based HIV prevention intervention

Continued debate about the relative value of fidelity versus adaptation, and lack of clarity about the meaning of fidelity, raise concerns about how frontline service providers resolve similar issues in their daily practice. We use SISTA ('Sisters Informing Sisters on Topics about acquired immune deficiency syndrome'), an evidence-based human immunodeficiency virus (HIV) prevention intervention for African American women, to understand how facilitators and program directors interpret and enact implementation fidelity with the need for adaptation in real-world program delivery. We conducted 22 in-depth, semi-structured interviews with service providers from four agencies implementing SISTA. Facilitators valued their skills as group leaders and ability to emotionally engage participants as more critical to program effectiveness than delivering the intervention with strict fidelity. Consequently, they saw program manuals as guides rather than static texts that should never be changed and, moreover, viewed the prescriptive nature of manuals as undermining their efforts to fully engage with participants. Our findings suggest that greater consideration should be given to understanding the role of facilitators in program effectiveness over and above the question of whether they implement the program with fidelity. Moreover, training curricula should provide facilitators with transferable skills through general facilitator training rather than only program-specific or manual-specific training.

Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation Research

Purposeful sampling is widely used in qualitative research for the identification and selection of information-rich cases related to the phenomenon of interest. Although there are several different purposeful sampling strategies, criterion sampling appears to be used most commonly in implementation research. However, combining sampling strategies may be more appropriate to the aims of implementation research and more consistent with recent developments in quantitative methods. This paper reviews the principles and practice of purposeful sampling in implementation research, summarizes types and categories of purposeful sampling strategies and provides a set of recommendations for use of single strategy or multistage strategy designs, particularly for state implementation research.

Implementation of multi-family psychoeducational psychotherapy for childhood mood disorders in an outpatient community setting

Despite advances in evidence-based treatments (EBTs), research suggests these interventions are not utilized in practice settings. This study examined implementation of multi-family psychoeducational psychotherapy (MF-PEP), an EBT for childhood mood disorders, in two outpatient community clinics. Fifteen community therapists facilitated MF-PEP. Twenty community clinicians referred 40 children ages 8-12 with mood disorders and their parents who participated in MF-PEP. Preliminary descriptive findings based on observations and self-report questionnaires demonstrated implementation outcomes of acceptability, adoption, appropriateness, feasibility, implementation cost, penetration, and sustainability of MF-PEP at these clinics. Parents also demonstrated significant improvement in knowledge of mood disorders posttreatment. Preliminary results support implementation of MF-PEP in practice settings and suggest community-based MF-PEP may be associated with improvement in clinical outcomes.

A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions

OBJECTIVE

This systematic review examines experimental studies that test the effectiveness of strategies intended to integrate empirically supported mental health interventions into routine care settings. Our goal was to characterize the state of the literature and to provide direction for future implementation studies.

METHODS

A literature search was conducted using electronic databases and a manual search.

RESULTS

Eleven studies were identified that tested implementation strategies with a randomized (n = 10) or controlled clinical trial design (n = 1). The wide range of clinical interventions, implementation strategies, and outcomes evaluated precluded meta-analysis. However, the majority of studies (n = 7; 64%) found a statistically significant effect in the hypothesized direction for at least one implementation or clinical outcome.

CONCLUSIONS

There is a clear need for more rigorous research on the effectiveness of implementation strategies, and we provide several suggestions that could improve this research area.

Mixed method designs in implementation research

This paper describes the application of mixed method designs in implementation research in 22 mental health services research studies published in peer-reviewed journals over the last 5 years. Our analyses revealed 7 different structural arrangements of qualitative and quantitative methods, 5 different functions of mixed methods, and 3 different ways of linking quantitative and qualitative data together. Complexity of design was associated with number of aims or objectives, study context, and phase of implementation examined. The findings provide suggestions for the use of mixed method designs in implementation research.

Child and family therapy process: concordance of therapist and observational perspectives

The objective of this study is to examine the characteristics of outpatient mental health services delivered in community-based outpatient clinics, comparing information obtained from two different sources, therapists serving children and families, and observational coders viewing tapes of the same treatment sessions. Videotaped therapy sessions were rated by therapists and independent coders regarding goals and strategies pursued during each session. Sixty-three sessions were taped of outpatient care provided to 18 children and their caregivers by 11 therapists. Children were 4-13 years old and families were receiving services at least in part due to reported child behavior problems, confirmed by ratings from the Child Behavior Checklist and Conners Parent Rating Scale-Revised. Analyses assessed the frequency, type, and intensity of goals and strategies pursued in therapy sessions from both therapist and observational coders' perspectives. Reliability of observer ratings and correspondence between therapist and observer reports were also examined. The reliability of observational coding of goals and strategies was moderate to good, with 76% of 39 codes having ICCs of .5 or greater. Therapists reported pursuing 2.5 times more goals and strategies per session, on average, than identified by observational coders. Correspondence between therapists and coders about the occurrence of specific goals and strategies in treatment sessions was low, with 20.5% of codes having a Kappa of .4 or higher. Substantial differences exist in what therapists and independent coders report as occurring in outpatient treatment sessions. Both perspectives suggest major differences between the content of services provided in community-based outpatient clinics and the structure of evidence-based programs, which emphasize intense pursuit of a small number of goals and strategies in each treatment session. Implications of the findings for quality improvement efforts in community-based mental health care settings are discussed.

Are we there yet? Evaluation and the knowledge translation journey

INTRODUCTION

Critical to knowledge translation are organizations' efforts to evaluate their implementation of evidence-based practices (EBPs). Organizations face challenges in their ability to be aware of emerging practices, to measure their efforts against current evidence, and to adapt EBPs to their contextual environments. The Provincial Centre of Excellence for Child and Youth Mental Health has engaged in initiatives to increase the uptake of EBPs and mobilize knowledge by building capacity for evaluation and research in the sector.

METHODS

Consultation services and innovative grants to organizations with mental health programs and services, where the Centre acts as both knowledge and relationship broker, are contributing to organizations' capacity to do and use evaluation.

RESULTS

Case exemplars illustrate the processes, successes and challenges experienced by organizations in Centre-supported activities. The Centre's efforts to build organizations' skills in doing and using evaluation, promoting a learning-by-doing approach and fostering collaboration are described.

CONCLUSIONS

Organizations with the capacity to conduct effective evaluations are better able to implement and assess EBPs, conduct quality evaluations, and contribute to research in the child and youth mental health sector. Widespread gains in mental health organizations' evaluation capacities will contribute to system innovations and the fostering of collaborative partnerships.