Do clinical experience, formal cognitive behavioural therapy training, adherence, and competence predict outcome in cognitive behavioural therapy for anxiety disorders in youth?

Predicting fidelity and treatment outcomes in savoring interventions among mothers of young children

Savoring impacts parents' emotions and parent-child relationship quality. Using data from a randomized controlled trial (N = 164 mothers of 18-27-month-olds, 37 interveners) conducted with a community sample in the United States, this study examined predictors of fidelity and treatment outcomes across two savoring preventative interventions (relational savoring and personal savoring). Treatment outcome indicators were selected from a battery administered immediately post-intervention (maternal closeness to child) and at a 3-month follow-up (maternal sensitivity, reflective functioning). We examined whether intervener education level (bachelor's degree/no bachelor's degree) predicted fidelity (Research Question 1), whether intervener education level predicted treatment outcomes (Research Question 2), and whether fidelity predicted treatment outcomes (Research Question 3). In many cases, intervener education background was not related to fidelity or treatment outcome; however, interveners without bachelor's degrees showed greater adherence to the protocols on some scales (higher positivity, higher secure base, higher calm matching) and sessions with these interveners were associated with greater increases in maternal sensitivity. Regardless of the intervener education level, redirecting attention to the positive and calmly matching participants' tone were associated with higher maternal reflective functioning, and higher secure base scores were associated with greater closeness. Findings have implications for the training and implementation of prevention programs for parents.

Determining differences between therapists using an extended version of the facilitative interpersonal skills performance test

OBJECTIVES

The therapist-facilitative interpersonal skills (FIS) has shown to predict therapy outcomes, demonstrating that high FIS therapists are more effective than low FIS therapists. There is a need for more insight into the variability in strengths and weaknesses in therapist skills. This study investigates whether a revised and extended FIS-scoring leads to more differentiation in measuring therapists' interpersonal skills. Furthermore, we explorative examine whether subgroups of therapists can be distinguished in terms of differences in their interpersonal responses.

METHOD

Using secondary data analysis, 93 therapists were exposed to seven FIS-clips. Responses of therapists using the original and the extended FIS scoring were rated.

RESULTS

Three factors were found on the extended FIS scoring distinguishing supportive, expressive, and persuasive interpersonal responses of therapists. A latent profile analysis enlightened the presence of six subgroups of therapists.

CONCLUSION

Using the revised and extended FIS-scoring contributes to our understanding of the role of interpersonal skills in the therapeutic setting by unraveling the question what works for whom.

Matters of Fidelity: School Provider Adherence and Competence in a Clustered Study of Adaptive Implementation Strategies

Schools are a promising access point for youth with mental health concerns, but school-based mental health professionals (SPs) often need ongoing support to provide high-fidelity cognitive behavioral therapy (CBT). Adherence and competence, two critical elements of fidelity, were examined in a cluster-randomized implementation trial. We evaluated CBT adherence and then triangulated CBT adherence with end-of-study competence. We then evaluated the effects of two implementation supports, Coaching and (for slower-responding schools) Facilitation, on adherence and competence. By the end of the 43-week study period, 27.8% of SPs met adherence criteria. Adherent SPs scored higher on the competence measure, the CBT Competence Scale (t (116.2) = 3.71, p < .001). No significant difference in adherence was found among SPs at schools assigned to Coaching vs. not (Δ = 6.0%, p = .385), however SPs at schools randomized to Coaching scored significantly higher on two of the four competence subscales (Non-Behavioral and Behavioral skills). Among slower-responder schools, SPs at schools assigned to Facilitation were more likely to demonstrate adherence (Δ = 16.3%, p = .022), but there was no effect of Facilitation on competence. Approximately one quarter of SPs met adherence criteria in the trial; adequate delivery of exposure was a primary obstacle to reaching adherence. Facilitation may be especially suited to help SPs overcome barriers to delivery, whereas Coaching may be especially suited to help SPs improve CBT competence. Both are likely needed to build a mental health work force with the competence and ability to deliver EBPs in schools.

Adherence, Competence, and Alliance as Predictors of Long-term Outcomes of Cognitive Behavioral Therapy for Youth Anxiety Disorders

The present study investigated therapist adherence, therapist competence, and patient-therapist alliance as predictors of long-term outcomes of cognitive behavioral therapy (CBT) for anxiety disorders in youth. Potential differential effects for group versus individual CBT, for therapists with or without formal CBT training, and based on youth symptom severity were examined. Videotapes (n = 181) from treatment sessions in a randomized controlled effectiveness trial comprising youth (N = 170, M age = 11.6 years, SD = 2.1) with anxiety disorders were assessed for therapist adherence and competence. Alliance was rated by therapists and youth. Participants completed a diagnostic interview and an anxiety symptom measure at pre-treatment, post-treatment, one-year follow-up, and long-term follow-up (M = 3.9 years post-treatment, SD = 0.8, range = 2.2-5.9 years). The change in anxiety symptoms or diagnostic status from pre-treatment to long-term follow-up was not significantly related to any predictor variables. However, several interaction effects were found. For loss of principal diagnosis, therapist competence predicted positive outcome when therapist adherence also was high. Adherence was found to predict positive outcome if CBT was provided individually. Therapist-rated alliance was related to both loss of principal diagnosis and loss of all diagnoses when CBT was provided in groups. Interaction effects suggested that therapists displaying both high adherence and high competence produced better long-term outcomes. Further, the alliance may be particularly important for outcomes in group CBT, whereas adherence may be particularly important for outcomes in individual CBT.

A pilot practice-based outcomes evaluation of low-intensity cognitive behavioural interventions delivered by postgraduate trainees to children and young people with mild to moderate anxiety or low mood: an efficient way forward in mental health care?

Anxiety and depression affect a significant number of children and young people (CYP) and can have a far reaching and long-lasting impact. Cognitive behavioural (CB) interventions can be effective for treating anxiety and depression in CYP but are difficult to access. Recent government policy in England seeks to train a non-traditional graduate workforce to deliver a range of CB interventions for mild to moderate anxiety and depression to CYP, in community settings. This practice-based evaluation aimed to estimate the effectiveness of CB interventions delivered by postgraduate trainees undertaking training in a range of CB interventions for mild to moderate anxiety and depression whilst on placement in schools or community Child and Adolescent Mental Health Services (CAMHS). Self- and parent-reported routine outcome measures (ROMS) were completed pre- and post-intervention, including measures of symptom severity, symptom impact and goal achievement. Significant improvements were demonstrated across all self and parent-reported measures post-intervention, with mean scores falling firmly in the non-clinical range, a significant reduction in the proportion of CYP in the clinical range on measures, and predominantly medium to large effect sizes. Results are promising in terms of the capacity to train a graduate workforce to deliver a range of low-intensity CB interventions to CYP experiencing mild to moderate depression or anxiety-based difficulties in either CAMHS or school settings, increasing capacity across the system. The current practice-based evaluation also supports the potential effectiveness of current training models/programmes. Further research is needed in terms of long-term outcomes and to compare outcomes between settings, interventions, and demographic groups.

Key learning aims

(1)

Treatment Fidelity in Brief Versus Standard-Length School-Based Interventions for Youth with Anxiety

To examine treatment fidelity in a randomized controlled trial of indicated school-based cognitive-behavioral therapy (CBT) delivered in groups to youth with anxiety. We investigated whether adherence and competence (a) differed across brief and standard-length CBT, and (b) if adherence and competence predicted change in anxiety symptoms and impairment. Method: Sessions were observationally coded with the Competence and Adherence Scale for CBT for Anxiety Disorders in Youth. Coders (N = 7) rated 104 sessions from 52 groups delivered by 32 facilitators (M age = 43.2 years, SD = 8.1) to 295 youth (M age = 14.0 years, SD = 0.8). Outcomes were youth- and parent-reported anxiety symptoms and impairment at post-intervention and 1-year follow-up. Linear mixed effect models were used to analyze whether fidelity predicted clinical outcomes. Results: Levels of adherence and competence were adequate in both programs, but higher in brief compared to standard-length CBT p < .001 and p = .010, respectively). Neither adherence nor competence predicted clinical outcomes at any timepoints. Conclusion: Higher levels of adherence and competence in brief CBT suggest that it may be easier for novice CBT providers to achieve fidelity in simplified and less flexible interventions. Contrary to expectation, adherence and competence did not predict clinical outcomes.

Psychometric analysis of the Dutch language Facilitative Interpersonal Skills (FIS) video clips

With the motivation of investigating the replicability and transferability of the findings employing the Facilitative Interpersonal Skills (FIS) performance task beyond Anglophone countries, a set of Dutch FIS clips have been scripted and recorded. In this study the psychometric properties of the Dutch clips was tested. Furthermore, an additional set of FIS clips portraying a non-challenging client-therapist interaction was tested. 369 psychology students rated the interpersonal impact (IMI-C) and the affect (positive and negative affect schedule) displayed by the hypothetical client. Thirteen out of sixteen FIS clips were located in the same IMI-C quadrant as the US clips, indicating good content validity for all sets of FIS clips. Inter-rater reliability was reasonable for one set of Dutch language FIS clips (k=0.416). Visual inspection of quadrants showed the different character of the non-challenging set of FIS clips. The Dutch FIS clips are directly applicable for educational and research purposes.

Intervention Adherence and Self-Efficacy as Predictors of Child Outcomes in School Nurse-Delivered Interventions for Anxiety

This study examined the association between two implementation factors, nurse-reported intervention adherence and self-efficacy, and children's outcomes in school nurse-delivered anxiety interventions. Data were collected in a pilot randomized controlled effectiveness trial with 54 children and 21 school nurses. Nurses implemented either a cognitive behavioral or relaxation-skills-only intervention. Nurse questionnaires assessed implementation factors. Independent evaluators assessed changes in children's anxiety symptoms at postintervention and at 3-month follow-up using clinical improvement and global functioning scales. Regression analyses indicated that greater intervention adherence was associated with greater anxiety symptom improvement at follow-up. Nurse self-efficacy interacted with intervention group, such that nurses with higher self-efficacy who implemented the cognitive behavioral intervention tended to have children show improvement and higher postintervention functioning. The impact of implementation factors on children's outcomes may differ depending on intervention type. Self-efficacy may be important for nurses using relatively complex interventions. Intervention adherence should be supported through training and consultation.

The Value Equation: Three complementary propositions for reconciling fidelity and adaptation in evidence-based practice implementation

BACKGROUND

There has long been debate about the balance between fidelity to evidence-based interventions (EBIs) and the need for adaptation for specific contexts or particular patients. The debate is relevant to virtually all clinical areas. This paper synthesises arguments from both fidelity and adaptation perspectives to provide a comprehensive understanding of the challenges involved, and proposes a theoretical and practical approach for how fidelity and adaptation can optimally be managed.

DISCUSSION

There are convincing arguments in support of both fidelity and adaptations, representing the perspectives of intervention developers and internal validity on the one hand and users and external validity on the other. Instead of characterizing fidelity and adaptation as mutually exclusive, we propose that they may better be conceptualized as complimentary, representing two synergistic perspectives that can increase the relevance of research, and provide a practical way to approach the goal of optimizing patient outcomes. The theoretical approach proposed, the "Value Equation," provides a method for reconciling the fidelity and adaptation debate by putting it in relation to the value (V) that is produced. The equation involves three terms: intervention (IN), context (C), and implementation strategies (IS). Fidelity and adaptation determine how these terms are balanced and, in turn, the end product - the value it produces for patients, providers, organizations, and systems. The Value Equation summarizes three central propositions: 1) The end product of implementation efforts should emphasize overall value rather than only the intervention effects, 2) implementation strategies can be construed as a method to create fit between EBIs and context, and 3) transparency is vital; not only for the intervention but for all of the four terms of the equation. There are merits to arguments for both fidelity and adaptation. We propose a theoretical approach, a Value Equation, to reconciling the fidelity and adaptation debate. Although there are complexities in the equation and the propositions, we suggest that the Value Equation be used in developing and testing hypotheses that can help implementation science move toward a more granular understanding of the roles of fidelity and adaptation in the implementation process, and ultimately sustainability of practices that provide value to stakeholders.