Ongoing supervision as a method to implement Motivational interviewing: Results of a randomized controlled trial

Adapted motivational interviewing for brief healthcare consultations: A systematic review and meta-analysis of treatment fidelity in real-world evaluations of behaviour change counselling

BACKGROUND

Behaviour change counselling (BCC) is an adaptation of motivational interviewing (MI) designed to maximize the effectiveness of time-limited health behaviour change consultations. To improve intervention quality and understanding of treatment effects, it is recommended that evaluations of health behaviour change interventions incorporate existing fidelity frameworks (e.g. The National Institutes of Health [NIH] Behaviour Change Consortium) and ensure that treatment fidelity is assessed and reported.

PURPOSE

This systematic review was designed to examine (a) adherence to NIH fidelity recommendations, (b) provider fidelity to BCC and (c) impact of these variables on the real-world effectiveness of BCC for adult health behaviours and outcomes.

METHODS AND RESULTS

Searches of 10 electronic databases yielded 110 eligible publications describing 58 unique studies examining BCC delivered within real-world healthcare settings by existing providers. Mean study adherence to NIH fidelity recommendations was 63.31% (Range 26.83%-96.23%). Pooled effect size (Hedges g) for short-term and long-term outcomes was .19 (95% CI [.11, .27]) and .09 (95% CI [.04, .13]), respectively. In separate, random-effects meta-regressions, neither short-term nor long-term effect sizes were significantly modified by adherence to NIH fidelity recommendations. For the subgroup of short-term alcohol studies (n = 10), a significant inverse relationship was detected (Coefficient = -.0114, 95% CI [-.0187, -.0041], p = .0021). Inadequate and inconsistent reporting within the included studies precluded planned meta-regression between provider fidelity and BCC effect size.

CONCLUSIONS

Further evidence is needed to clarify whether adherence to fidelity recommendations modifies intervention effects. Efforts to promote transparent consideration, evaluation and reporting of fidelity are urgently needed. Research and clinical implications are discussed.

Correspondence between practitioners’ self-assessment and independent motivational interviewing treatment integrity ratings

As evaluation of practitioners’ competence is largely based on self-report, accuracy in practitioners’ self-assessment is essential for ensuring high quality treatment-delivery. The aim of this study was to assess the relationship between independent observers’ ratings and practitioners’ self-reported treatment integrity ratings of Motivational interviewing (MI). Practitioners (N = 134) were randomized to two types of supervision [i.e., regular institutional group supervision, or individual telephone supervision based on the MI Treatment Integrity (MITI) code]. The mean age was 43.2 years (SD = 10.2), and 62.7 percent were females. All sessions were recorded and evaluated with the MITI, and the MI skills were self-assessed with a questionnaire over a period of 12 months. The associations between self-reported and objectively assessed MI skills were overall weak, but increased slightly from baseline to the 12-months assessment. However, the self-ratings from the group that received monthly objective feedback were not more accurate than those participating in regular group supervision. These results expand findings from previous studies and have important implications for assessment of practitioners’ treatment fidelity: Practitioners may learn to improve the accuracy of self-assessment of competence, but to ensure that patients receive intended care, adherence and competence should be assessed objectively.

A Behavior-based Coding Tool for Assessing Supervisors' Adherence and Competence: Findings From a Motivational Interviewing Implementation Study

Supervision seems to be an essential part of therapist training, and thus also of implementing evidence-based practices. However, there is a shortage of valid and reliable instruments for objective assessment of supervision competence that include both global measures and frequency counts of behavior - two essential aspects of supervisory competence. This study tests the internal consistency and inter-rater reliability of an assessment tool that includes both these measures. Additionally, strategies and techniques used by ten supervisors in 35 Motivational interviewing supervision sessions are described. Codings were conducted after two separate coding training sessions. The internal consistency across the global measures was acceptable (α = 0.70; 0.71). After the second training, the inter-rater reliabilities for all frequency counts were in the moderate to good range, except for two that were in the poor range; inter-rater reliability for one of the four global measures was in the moderate range, and three were in the poor range. A prerequisite for identifying specific supervisor skills central to the development of therapist skills, teaching these skills to supervisors, and performing quality assurance of supervision, is to create instruments that can measure these behaviors. This study is a step in that direction.

In Search of the Common Elements of Clinical Supervision: A Systematic Review

The importance of clinical supervision for supporting effective implementation of evidence-based treatments (EBTs) is widely accepted; however, very little is known about which supervision practice elements contribute to implementation effectiveness. This systematic review aimed to generate a taxonomy of empirically-supported supervision practice elements that have been used in treatment trials and shown to independently predict improved EBT implementation. Supervision practice elements were identified using a two-phase, empirically-validated distillation process. In Phase I, a systematic review identified supervision protocols that had evidence of effectiveness based on (a) inclusion in one or more EBT trials, and (b) independent association with improved EBT implementation in one or more secondary studies. In Phase II, a hybrid deductive-inductive coding process was applied to the supervision protocols to characterize the nature and frequency of supervision practice elements across EBTs. Twenty-one of the 876 identified articles assessed the associations of supervision protocols with implementation or clinical outcomes, representing 13 separate studies. Coding and distillation of the supervision protocols resulted in a taxonomy of 21 supervision practice elements. The most frequently used elements were: reviewing supervisees' practice (92%; n = 12), clinical suggestions (85%; n = 11), behavioral rehearsal (77%; n = 10), elicitation (77%; n = 10), and fidelity assessment (77%; n = 10). This review identified supervision practice elements that could be targets for future research testing which elements are necessary and sufficient to support effective EBT implementation. Discrepancies between supervision practice elements observed in trials as compared to routine practice highlights the importance of research addressing supervision-focused implementation strategies.