Variability in motivational interviewing adherence across sessions, providers, sites, and research contexts

Learning & motivational talk in smoking cessation interventions: An examination of session language in two randomized trials

OBJECTIVES

Motivational Interviewing (MI), a client-centered approach that seeks to evoke and resolve ambivalence, and health education (HE), which provides health information and advice, may both provide some benefit to unmotivated smokers. In HE, it is possible that client language reflective of new learning, or "learning talk" (LT), and rejection of health advice, or "rejection talk," (RT), may uniquely reflect intent of subsequent behavior change.

METHODS

This project utilized MI and HE sessions from two randomized clinical trials (RCTs), one in a low-income, diverse community civilian sample of 255 unmotivated smokers, and the other in a sample of Veterans with mental illness who were unmotivated smokers (n = 55). Mixed methods approaches were utilized to reliably code sessions using the Motivational Interviewing Skill Code 2.5 (MISC 2.5)1 and a refined Learning Talk coding system2.

RESULTS

Reliability of LT and RT codes ranged from fair to excellent (ICCs from 0.43-0.93).

CONCLUSION

LT appears to be a unique construct and its impact on post-session changes in smoking is warranted.

PRACTICE IMPLICATIONS

This system can be used in a study to code existing interventions for smokers using both MI and HE techniques and relate in-session client LT to subsequent smoking behaviors.

Automated Behavioral Coding to Enhance the Effectiveness of Motivational Interviewing in a Chat-Based Suicide Prevention Helpline: Secondary Analysis of a Clinical Trial

BACKGROUND

With the rise of computer science and artificial intelligence, analyzing large data sets promises enormous potential in gaining insights for developing and improving evidence-based health interventions. One such intervention is the counseling strategy motivational interviewing (MI), which has been found effective in improving a wide range of health-related behaviors. Despite the simplicity of its principles, MI can be a challenging skill to learn and requires expertise to apply effectively.

OBJECTIVE

This study aims to investigate the performance of artificial intelligence models in classifying MI behavior and explore the feasibility of using these models in online helplines for mental health as an automated support tool for counselors in clinical practice.

METHODS

We used a coded data set of 253 MI counseling chat sessions from the 113 Suicide Prevention helpline. With 23,982 messages coded with the MI Sequential Code for Observing Process Exchanges codebook, we trained and evaluated 4 machine learning models and 1 deep learning model to classify client- and counselor MI behavior based on language use.

RESULTS

The deep learning model BERTje outperformed all machine learning models, accurately predicting counselor behavior (accuracy=0.72, area under the curve [AUC]=0.95, Cohen κ=0.69). It differentiated MI congruent and incongruent counselor behavior (AUC=0.92, κ=0.65) and evocative and nonevocative language (AUC=0.92, κ=0.66). For client behavior, the model achieved an accuracy of 0.70 (AUC=0.89, κ=0.55). The model's interpretable predictions discerned client change talk and sustain talk, counselor affirmations, and reflection types, facilitating valuable counselor feedback.

CONCLUSIONS

The results of this study demonstrate that artificial intelligence techniques can accurately classify MI behavior, indicating their potential as a valuable tool for enhancing MI proficiency in online helplines for mental health. Provided that the data set size is sufficiently large with enough training samples for each behavioral code, these methods can be trained and applied to other domains and languages, offering a scalable and cost-effective way to evaluate MI adherence, accelerate behavioral coding, and provide therapists with personalized, quick, and objective feedback.

Effects of Training in Cognitive Behavioural Therapy and Motivational Interviewing on Mental Health Practitioner Behaviour: A Systematic Review and Meta-Analysis

Effective training of mental health professionals is crucial for bridging the gap between research and practice when delivering cognitive behavioural therapy (CBT) and motivational interviewing (MI) within community settings. However, previous research has provided inconclusive evidence regarding the impact of training efforts. The current study aimed to systematically search, review and synthesize the literature on CBT and MI training to assess its effect on practitioner behavioural outcomes. Following prospective registration, a literature search was conducted for studies where mental health practitioners were exposed to training in face-to-face CBT or MI, reporting on at least one quantitative practitioner behavioural outcome. A total of 116 studies were eligible for the systematic review, and 20 studies were included in four meta-analyses. The systematic review highlights the need to establish psychometrically valid outcome measures for practitioner behaviour. Results of the meta-analyses suggest that training has a greater effect on practitioner behaviour change compared to receiving no training or reading a treatment manual. Training combined with consultation/supervision was found to be more effective than training alone, and no differences were found between face-to-face and online training. Results should be interpreted with caution due to methodological limitations in the primary studies, large heterogeneity, and small samples in the meta-analyses. Future directions are discussed.

Mixed-method evaluation of fidelity of motivational interviewing-based coaching in 5Minutes4Myself Wellness Program for caregivers of children with autism

Objective

This mixed method analysis examined fidelity of the motivational interviewing (MI) delivered during the 5Minutes4Myself wellness program for caregivers of children with Autism Spectrum Disorders.

Methods

Coaches used a manualized MI-approach to collaboratively design participants' individualized wellness programs, and then used it in monthly coaching sessions to support goal pursuit. Audio-recorded consultations and post-participation focus groups were transcribed verbatim. Consultation transcripts were rated for MI adherence using Motivational Interviewing Treatment Integrity Code. Focus group data was coded by the team to identify conceptual categories.

Results

Eighty-seven percent of consultations achieved a beginning (competent) level expert-derived MI standard. Caregivers noted that coaches' MI approach evoked deep emotions and understandings about their lives related to wellness goals, allowed for a permissive flexibility in goal pursuit, and fostered supportive accountability.

Conclusion

MI was used with high levels of fidelity. Participants described the MI approach as more productive, precise, and useful in addressing their needs compared to other available interventions.

Adapted motivational interviewing for brief healthcare consultations: A systematic review and meta-analysis of treatment fidelity in real-world evaluations of behaviour change counselling

BACKGROUND

Behaviour change counselling (BCC) is an adaptation of motivational interviewing (MI) designed to maximize the effectiveness of time-limited health behaviour change consultations. To improve intervention quality and understanding of treatment effects, it is recommended that evaluations of health behaviour change interventions incorporate existing fidelity frameworks (e.g. The National Institutes of Health [NIH] Behaviour Change Consortium) and ensure that treatment fidelity is assessed and reported.

PURPOSE

This systematic review was designed to examine (a) adherence to NIH fidelity recommendations, (b) provider fidelity to BCC and (c) impact of these variables on the real-world effectiveness of BCC for adult health behaviours and outcomes.

METHODS AND RESULTS

Searches of 10 electronic databases yielded 110 eligible publications describing 58 unique studies examining BCC delivered within real-world healthcare settings by existing providers. Mean study adherence to NIH fidelity recommendations was 63.31% (Range 26.83%-96.23%). Pooled effect size (Hedges g) for short-term and long-term outcomes was .19 (95% CI [.11, .27]) and .09 (95% CI [.04, .13]), respectively. In separate, random-effects meta-regressions, neither short-term nor long-term effect sizes were significantly modified by adherence to NIH fidelity recommendations. For the subgroup of short-term alcohol studies (n = 10), a significant inverse relationship was detected (Coefficient = -.0114, 95% CI [-.0187, -.0041], p = .0021). Inadequate and inconsistent reporting within the included studies precluded planned meta-regression between provider fidelity and BCC effect size.

CONCLUSIONS

Further evidence is needed to clarify whether adherence to fidelity recommendations modifies intervention effects. Efforts to promote transparent consideration, evaluation and reporting of fidelity are urgently needed. Research and clinical implications are discussed.

You never know what you are going to get: Large-scale assessment of therapists' supportive counseling skill use

Supportive counseling skills like empathy and active listening are critical ingredients of all psychotherapies, but most research relies on client or therapist reports of the treatment process. This study utilized machine-learning models trained to evaluate counseling skills to evaluate supportive skill use in 3,917 session recordings. We analyzed overall skill use and variation in practice patterns using a series of mixed effects models. On average, therapists scored moderately high on observer-rated empathy (i.e., 3.8 out of 5), 3.3% of the therapists' utterances in a session were open questions, and 12.9% of their utterances were reflections. However, there were substantial differences in skill use across therapists as well as across clients within-therapist caseloads. These findings highlight the substantial variability in the process of counseling that clients may experience when they access psychotherapy. We discuss findings in the context of both the need for therapists to be responsive and flexible with their clients, but also potential costs related to the lack of a more uniform experience of care. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Relations between provider adherence to a tailored motivational intervention protocol and competence in motivational interviewing

OBJECTIVES

To evaluate the association between provider adherence to Tailored Motivational Interviewing implementation strategy and motivational interviewing (MI) competence.

METHODS

156 youth-focused HIV providers enrolled in a parent implementation science trial completed: a) quarterly standardized patient assessments (SPI) during Baseline; b) a workshop, individual coaching sessions, and quarterly SPI plus feedback during Implementation; and c) quarterly SPI during Sustainment. Competence was measured using the MI-CRS and tracking data was used to assess adherence. We examined overall adherence as well as adherence to each implementation strategy in relation to MI competence.

RESULTS

Overall adherence was not associated with overall MI competence. MI competence significantly increased from Baseline to Implementation and Baseline to Sustainment. Some individual implementation strategies were associated with change in competence and the probability of achieving Intermediate/Advanced competence.

CONCLUSIONS

The results suggest that 100% percent adherence to all TMI implementation strategies may not be necessary. Completing some of the TMI implementation strategies yielded improvements in MI competence. The use of routine tracking data to measure adherence maybe more pragmatic than using observational coders and more objective than self-reports.

PRACTICE IMPLICATIONS

In busy HIV clinics, MI training should focus on strategies most directly associated with increased provider competence.

Intervention Fidelity of Telephone Motivational Interviewing On Physical Activity, Fruit Intake, and Vegetable Consumption in Dutch Outpatients With and Without Hypertension

BACKGROUND

In theory, Motivational Interviewing (MI) fidelity should be associated with client outcomes. Nevertheless, this fidelity-effectiveness association is rarely investigated. This study evaluated the extent to which Telephone Motivational Interviewing (TMI) fidelity is associated with change in self-reported physical activity (PA), fruit intake, and vegetable consumption.

METHOD

Adults in primary care (45-70 years) participated in a study that compared the effect of tailor print communication, telephone motivational interviewing (TMI), and a combination of the two on PA, fruit intake, and vegetable consumption. MI fidelity was assessed using the behavioral coding method "Motivational Interviewing Treatment Integrity Code (MITI)" in 409 randomly selected audio-recorded sessions, representing 232 participants of the TMI group. The associations between MI fidelity scores and the behavioral changes from baseline to 47-week follow-up were examined using backward multiple linear regression analyses (adjusted for covariates).

RESULTS

A significant and positive association between the percentage of MI adherent responses and improvements in PA and fruit consumption was found with respectively a small and medium effect size. The global rating "Spirit" (which resembles an all-at-once appraisal of the interviewer's MI competence) was significantly, but inversely associated with progress in vegetable intake with a medium effect size.

CONCLUSION

The finding that relatively lower MI competency was associated with higher vegetable consumption went against our expectations. Findings suggest that practicing MI-consistent skills was beneficial in promoting PA and fruit consumption, but moderated vegetable intake. This study contributes to the scientific confidence that TMI enables change in PA and fruit intake.

Cost-Effectiveness of Motivational Interviewing to Reduce Alcohol and Cannabis Use Among Patients With Depression

OBJECTIVE

Motivational interviewing (MI) is a promising intervention for helping patients with mental health problems reduce their substance use. Examining the cost-effectiveness of MI and associations between MI and the use of health services can inform appropriate intervention strategies for these patients.

METHOD

Kaiser Permanente adult patients with depression symptoms (Patient Health Questionnaire [PHQ-9] score > 5) seen in outpatient psychiatry (N = 302) who reported unhealthy alcohol use or other substance use (primarily cannabis) were randomized to three sessions of MI (intervention) or printed literature (control) with telephone follow-up interviews at 6 and 12 months. Cost-effectiveness analyses compared intervention costs associated with 30-day abstinence from unhealthy alcohol use (i.e., any days of ≥4/≥5 drinks for women/men) and cannabis use. Multivariable analyses examined associations between MI and healthcare utilization at 12 months (emergency department, primary care, psychiatry, and addiction treatment).

RESULTS

MI resulted in greater likelihood of abstaining from unhealthy alcohol use (70.0% vs. 60.2%, p < .01) and cannabis use (74.6% vs. 63.9%, p < .01) than the control at 6 months, but outcomes did not differ at 12 months. The 6-month incremental cost-effectiveness ratios were $1,207-$1,523 per abstinent patient for unhealthy drinking and $1,040-$1,313 per abstinent patient for cannabis. There were no differences between groups on health service utilization.

CONCLUSIONS

MI cost more than the control condition but yielded better outcomes at 6 months; MI had no relationship to health service utilization. Findings can inform implementation of substance use interventions through understanding MI's potential clinical and cost impact and its relationship to health services use.

Motivational Interviewing Effects on Positive Airway Pressure Therapy (PAP) Adherence: A Systematic Review and Meta-Analysis of Randomized Controlled Trials

OBJECTIVES

This systematic review and meta-analysis examined Motivational Interviewing (MI) effects on positive airway pressure (PAP) adherence and related outcomes.

METHOD

Medline, CIHANL, Psych Info, Web of Science, PubMed, and Cochrane Database of Systematic Reviews were searched for randomized controlled trials published from peer-reviewed journals in English from 1990 to 2021 that compared objective PAP adherence among adults with obstructive sleep apnea (OSA) in a MI and non-MI intervention. A random effects meta-analysis model was completed at the 1-to-2-week, and 1-, 2-, 3-, and 12-month follow-up, and risk of bias was analyzed with the Cochrane Risk of Bias Tool.

RESULTS

In 10 trials of naïve PAP users and one trial of non-naïve PAP users, 14 to 277 middle-aged adults with moderate-to-severe OSA generally engaged in a brief, individual, face-to-face, MI intervention with standard care or a control condition. Several trials of naïve PAP users demonstrated that MI increased PAP use 1-2.6 hours per night, but a similar number of trials showed comparable conditions. Secondary outcomes were mixed. Among non-naïve PAP users, MI did not significantly increase adherence or secondary outcomes. The meta-analysis of PAP-naïve participants revealed that MI had a small to moderate significant effect on PAP adherence at 1, 2, and 3 months after beginning PAP (Hedges' g = 0.38 to 0.48; 95% CI = 0.04, 0.75) compared to standard care alone.

CONCLUSIONS

Despite heterogeneity, MI moderately increased PAP adherence among PAP-naïve adults with moderate-to-severe OSA, suggesting an effective strategy for short-term (1-3 months) adherence.

Training Providers in Motivational Interviewing to Promote Behavior Change

Motivational Interviewing (MI) is a highly specified behavior change communication approach to improve patient-provider relationships, provider communication, and patient health outcomes. Because MI is built on a foundation of patient autonomy support, a feature known to positively influence behavior change during adolescence and emerging adulthood, MI is an evidence-based framework that can inform interventions targeting improvements in health outcomes among youth. MI can be difficult to implement with adequate fidelity, because learning MI requires time and commitment from busy providers with competing priorities. This review addresses best practices for implementing MI within adolescent serving medical settings (eg, pediatrics, family practices, rural health clinics, community health organizations, and so forth), including an orientation to MI, examples of efficacious interventions that were developed leveraging MI, and consideration for the design of training programs that include ongoing support to maximize the likelihood of sustainment.

Tailored Motivational Interviewing in Adolescent HIV Clinics: Primary Outcome Analysis of a Stepped Wedge Implementation Trial

BACKGROUND

Youth continue to have the poorest outcomes along the HIV prevention and care continua. Motivational Interviewing (MI) may promote behavior change and reduce perceived stigma, but providers often demonstrate inadequate MI competence. This study tested Tailored Motivational Interviewing (TMI), a set of implementation strategies designed to improve MI competence in youth HIV providers.

SETTING

Ten HIV clinics in the Adolescent Trials Network for HIV/AIDS Interventions.

METHODS

In a stepped wedge design, 10 clinics (N = 151 providers) were randomized in 5 clusters every 3 months to receive TMI for a 12-month implementation period. Sites were rerandomized within each cluster to receive communities of practice guidance with or without internal facilitator support in the sustainment period. Standard patient assessments were coded every 3 months for 36 months.

RESULTS

Nesting was addressed using mixed-effects regression models, with random effects for providers and sites. TMI resulted in significantly improved MI competence over baseline. Despite small reductions in competence in the sustainment window, competence was still significantly improved over baseline, with no difference between the 2 sustainment conditions.

CONCLUSIONS

TMI may be an important tool to capacitate the HIV HealthForce to end the HIV epidemic in young people.

Enhancing and assessing fidelity in the TANDEM (Tailored intervention for ANxiety and DEpression Management in COPD) trial: development of methods and recommendations for research design

BACKGROUND

Development of complex interventions for management of chronic conditions has become increasingly common, with guidance now provided. Fidelity (whether the intervention is designed, delivered and received as intended) is critical to understanding if, and how an intervention works (or not). However, methods for achieving this are still evolving. This study describes the methods used in the TANDEM trial - a large multicentre study evaluating the impact of a cognitive behavioural intervention preceding routine pulmonary rehabilitation for people with chronic obstructive pulmonary disease and anxiety and or depression. Results for enhancement and training aspects of fidelity, are presented.

METHODS

Using the National Institute for Health Behaviour Change Consortium (NIH BCC) framework of fidelity, a set of enhancement strategies and a fidelity measurement strategy were developed with input from a multidisciplinary team. The Cognitive First Aid Rating Scale (CFARS) was used to assess Facilitator (the respiratory professional delivering TANDEM) therapeutic competence at the end of the initial training and throughout treatment delivery (on a randomly selected set of cases). A TANDEM specific treatment adherence measure was developed following previously recommended procedures. Together these (the CFARS and adherence measure) comprised the TANDEM treatment delivery fidelity tool.

RESULTS

Hiring of respiratory professionals to the initial training programme was successful, with 44% of those expressing initial interest in being a Facilitator successfully completing the process. Video recordings of potential Facilitators conducting standardized patient role plays at the end of the initial training demonstrated fidelity of training.

CONCLUSIONS

Addressing fidelity in complex intervention trials is a time and resource intensive process but has significant potential to increase understanding of results and strengthen the evidence base for effective interventions. By defining a full fidelity assessment method prior to analysis we aimed to minimise bias when interpreting results.

TRIAL REGISTRATION

ISRCTN59537391 . Registered on 20 March 2017. Trial protocol version 6.0, 22 April 2018. Process evaluation protocol version 4.0, 1 November 2020.

Substance Use/Dependence in Psychiatric Emergency Setting Leading to Hospitalization: Predictors of Continuity of Care

Background: Poor adherence to treatment is a common clinical problem in individuals affected by mental illness and substance use/dependence. In Italy, mental care is organized in a psychiatric service and addiction unit (SERD), characterized by dual independent assets of treatment. This difference, in the Emergency Room setting, leads to a risk of discontinuity of treatment in case of hospitalization. In this study we clinically characterized individuals who decided to attend hospital post-discharge appointments at SERD, in accordance with medical advice. Methods: This is a retrospective study, based on two years of discharged records of patients entering “Versilia Hospital” (Viareggio, Italy) emergency room, with urinalyses testing positive for substance use, and hospitalization after psychiatric consultation. The sample was divided according to the presence or absence of SERD consultation after discharge. Results: In the 2-year period of the present study, 1005 individuals were hospitalized. Considering the inclusion criterion of the study, the sample consisted of 264 individuals. Of these, 128 patients attended post-discharge appointments at SERD showing urinalyses positive to cocaine, opiates, and poly use; they were more frequently diagnosed as personality disorder and less frequently as bipolar disorder. The prediction was higher for patients that had already been treated at SERD, for patients who received SERD consultation during hospitalization, and for patients with positive urinalyses to cocaine and opiates at treatment entry. Conversely, patients who did not attend SERD consultation after discharge were affected by bipolar disorders. Limitations: Small sample size. Demographical data are limited to gender and age due to paucity of data in hospital information systems. SERD is located far from the hospital and is open only on weekdays; thus, it cannot ensure a consultation with all inpatients. Conclusions: Mental illness diagnosis, the set of substance use positivity at hospitalization, and having received SERD consultation during hospitalization appeared to have a critical role in promoting continuity of care. Moreover, to reduce the gap between the need and the provision of the treatment, a more effective personalized individual program of care should be implemented.

Community Implementation of MI-Enhanced Behavior Therapy for Adolescent ADHD: Linking Fidelity to Effectiveness

Evidence-based behavior therapy for adolescent ADHD faces implementation challenges in real-world settings. The purpose of this trial was to investigate the relationship between implementation fidelity and outcomes among adolescents receiving services in the active treatment arm (N = 114; Motivational Interviewing [MI]-enhanced parent-teen behavior therapy) of a community-based randomized trial of adolescent ADHD treatment. Participants received therapy from community clinicians (N = 44) at four agencies in a large, ethnically diverse metropolitan setting. Therapists provided self-report of session-by-session adherence to content fidelity checklists and audio recordings of sample sessions that were coded for MI integrity. Parents provided report of ADHD symptoms and family impairment at baseline, posttreatment, and follow-up, while academic records were obtained directly from the local school district. Results indicated that content fidelity significantly waned across the 10 manualized sessions (d = -1.23); these trends were steepest when therapy was delivered outside the office-setting and parent attendance was low. Community therapist self-report of content fidelity predicted significantly greater improvements in academic impairment from baseline to follow-up. MI delivery quality was not associated with improved outcomes; contrary to hypotheses, lower MI relational scores predicted significantly greater improvements in family impairment over time. Findings indicate that community-based outcomes for evidence-based ADHD treatment are enhanced when treatment is implemented with fidelity. Future work should revise community-based implementation strategies for adolescent ADHD treatment to prevent declines in fidelity over time, thereby improving outcomes.

Integration of motivational interviewing and behavioral economic theories to enhance brief alcohol interventions: Rationale and preliminary examination of client language

Motivational interviewing (MI) is a widely disseminated evidence-based therapeutic approach for engaging clients and motivating health behavior change, especially risky substance use. Refinement of MI theory over the past few decades has provided empirical evidence that the technical component of MI (in-session client language) is a promising mechanism of behavior change (MOBC). However, heterogeneous and small to moderate effect sizes suggest the need for refinement of MOBC measurement and consideration of other types of client language. The current article presents a complementary integration of current MI theory and behavioral economic (BE) mechanisms to further understanding of in-session factors associated with subsequent behavior change. In this paper, we define some of the key MOBCs from MI and BE theories, describe our integrated framework, and present preliminary findings from a pilot study of the effectiveness and MOBCs of a novel BE-informed application of MI in risky college student drinkers. Results from preliminary coding development suggest that BE-informed measures of client language better predict response to a brief intervention in risky college students than traditional change talk measures. We posit that BE theory can offer insight into meaningful session content beyond the current MI constructs of change talk and sustain talk, which in turn may serve to enhance development of clinical practice and inform scientific investigations. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Differences in the delivery of motivational interviewing across three countries

We do not know if the delivery of Motivational Interviewing (MI) differs across countries. In an international study targeting Elderly people with Alcohol Use Disorder, The Elderly Study, MI was part of the treatment applied. Treatment delivery was measured by means of the Motivational Interviewing Treatment Integrity code version 4 (MITI 4). Mixed effects models explored potential differences in delivery of MI between the countries. Delivery of MI differed significantly between participating countries: Denmark, Germany and the US. These findings are important to consider when comparing measures of MI integrity across studies from different cultures.

Fidelity of Motivational Interviewing in School-Based Intervention and Research

Educational researchers and school-based practitioners are increasingly infusing motivational interviewing (MI) into new and existing intervention protocols to provide support to students, parents, teachers, and school administrators. To date, however, the majority of the research in this area has focused on feasibility of implementation rather than fidelity of implementation. In this manuscript, we will present MI fidelity data from 245 audio-recorded conversations with 113 unique caregivers and 20 coaches, who implemented a school-based, positive parenting intervention. The aggregate fidelity scores across coaches, parents, and sessions provide evidence the training and support procedures were effective in assisting school-based personnel to implement MI with reasonable levels of fidelity in practice settings. Further, results suggest that MI fidelity varied between sessions and coaches and that within-coach variation (e.g., session-level variation in the quality of MI delivered) greatly exceeded between-coach variation. Implications for practice and future research are discussed.

Motivational interviewing quality assurance: A systematic review of assessment tools across research contexts

The need for sustained skill development and quality assurance when executing behavioral interventions is best demonstrated in the empirical evolution of Motivational Interviewing (MI). As a brief behavioral intervention that identifies the therapeutic process as an active treatment ingredient, it is critical for researchers, trainers, and administrators to use psychometrically sound and theoretically congruent tools to evaluate provider skills and fidelity when executing MI. Yet, no prior work has evaluated the breadth of MI tools employed across research contexts. Therefore, this review identified MI fidelity and skill development tools across measurement, training and efficacy/effectiveness studies and evaluated their psychometric strength and fit with current MI theory. We identified 199 empirical studies that employed an MI fidelity/skill tool and we found 21 tools with varying degrees of empirical support and theoretical congruence. Specifically, we identified five observer-, two trainee- and one client-rated tool with strong empirical support, and nine observer- and two client-rated tools with preliminary empirical support. We detailed the empirical strength, including the extent to which tools were linked to trainee/client outcomes across research contexts and offer recommendations on which MI tools to use in training, efficacy, and effectiveness trials.

Assessing Adherence, Competence and Differentiation in a Stepped-Wedge Randomised Clinical Trial of a Complex Behaviour Change Intervention

BACKGROUND

A key challenge in behavioural medicine is developing interventions that can be delivered adequately (i.e., with fidelity) within real-world consultations. Accordingly, clinical trials should (but tend not to) report what is actually delivered (adherence), how well (competence) and the distinction between intervention and comparator conditions (differentiation).

PURPOSE

To address this important clinical and research priority, we apply best practice guidelines to evaluate fidelity within a real-world, stepped-wedge evaluation of "EAT: Eating As Treatment", a new dietitian delivered health behaviour change intervention designed to reduce malnutrition in head and neck cancer (HNC) patients undergoing radiotherapy.

METHODS

Dietitians (n = 18) from five Australian hospitals delivered a period of routine care and following a randomly determined order each site received training and began delivering the EAT Intervention. A 20% random stratified sample of audio-recorded consultations (control n = 196; intervention n = 194) was coded by trained, independent, raters using a study specific checklist and the Behaviour Change Counselling Inventory. Intervention adherence and competence were examined relative to apriori benchmarks. Differentiation was examined by comparing control and intervention sessions (adherence, competence, non-specific factors, and dose), via multiple linear regression, logistic regression, or mixed-models.

RESULTS

Achievement of adherence benchmarks varied. The majority of sessions attained competence. Post-training consultations were clearly distinct from routine care regarding motivational and behavioural, but not generic, skills.

CONCLUSIONS

Although what level of fidelity is "good enough" remains an important research question, findings support the real-world feasibility of integrating EAT into dietetic consultations with HNC patients and provide a foundation for interpreting treatment effects.

Discussing Drug Use With Health Care Providers Is Associated With Perceived Need and Receipt of Drug Treatment Among Adults in the United States: We Need to Talk

BACKGROUND

Drug treatment utilization is low despite a high public health burden of drug use disorders (DUDs). Engaging people at risk for DUDs across a broader range of health care settings may improve uptake of drug treatment.

OBJECTIVES

To estimate the prevalence of drug use screening/discussions between health care providers and individuals with past-year drug use, and to assess the associations between drug use screening/discussions and perceived need and use of drug treatment.

METHODS

We analyzed representative cross-sectional data from the 2015 to 2017 National Surveys on Drug Use and Health. The sample included adults aged 18 years and above reporting past-year drug use and ≥1 health care visit. We measured correlates of drug use screening/discussions using multinomial logistic regression. Overall and among adults meeting DUD criteria, we used logistic regression to estimate associations between drug use screening/discussions and (1) past-year drug treatment and (2) perceived need for treatment.

RESULTS

In the full sample (n=21,505), 34.50% reported no screening/discussions, 44.50% reported screening only, and 21.00% reported discussions with providers. Discussions were associated with significantly higher odds of receiving any drug treatment [adjusted odds ratio (aOR)=3.52 (2.66-4.65)], specialty drug treatment [aOR=4.13 (2.92-5.82)], and perceived treatment need [aOR=2.08 (1.21-3.59)]. Among people with DUD (n=3,834; 15.69%), discussions were associated with treatment use, but not with perceived need.

CONCLUSIONS

Discussing drug use with providers may impact people's perceptions of drug treatment need and use, indicating potential opportunities to engage people in addiction treatment. Addressing barriers to discussing drug use across care settings could increase treatment use, particularly among people with DUD.

Abstinence outcomes among women in reproductive health centers administered clinician or electronic brief interventions

Treatment of substance use in women seeking reproductive healthcare is crucial for the health of both women and their offspring. Although abstinence from all substance use during pregnancy is optimal, it is difficult to achieve. This secondary analysis reports abstinence outcomes from a randomized clinical trial of screening, brief intervention, and referral to treatment (SBIRT) for substance use among women seeking reproductive healthcare services. Women who screened positive for substance use were randomly assigned to either clinician-administered SBIRT, an electronically-administered brief intervention (e-SBIRT), or an enhanced usual care condition. At a 6-month follow-up assessment, compared to enhanced usual care, the clinician-administered SBIRT increased 1-month point prevalence of abstinence from the primary substance by 7.7%, and e-SBIRT increased abstinence by 12.8%. Both brief interventions were more useful than enhanced usual care and could increase substance use abstinence rates among women in reproductive healthcare clinics. The electronic brief intervention is particularly attractive given that it appears as efficacious as, but requires fewer resources than, clinician-delivered brief interventions.

Effectiveness of training methods for delivery of evidence-based psychotherapies: a systematic review

BACKGROUND

Extensive efforts have been made to train mental health providers in evidence-based psychotherapies (EBPs); there is increasing attention focused on the methods through which providers are trained to deliver EBPs. Evaluating EBP training methods is an important step in determining which methods are most effective in increasing provider skill and improving client outcomes.

METHODS

We searched MEDLINE (Ovid) and PsycINFO for randomized controlled trials published from 1990 through June 2019 that evaluated EBP training methods to determine the effectiveness of EBP training modalities on implementation (provider and cost) and client outcomes. Eligible studies (N = 28) were evaluated for risk of bias, and the overall strength of evidence was assessed for each outcome. Data was extracted by a single investigator and confirmed by a second; risk of bias and strength of evidence were independently rated by two investigators and determined by consensus.

RESULTS

Overall, EBP training improved short-term provider satisfaction, EBP knowledge, and adherence compared to no training or self-study of training materials (low to moderate strength of evidence). Training in an EBP did not increase treatment adoption compared to no training or self-study. No specific active EBP training modality was found to consistently increase provider EBP knowledge, skill acquisition/adherence, competence, adoption, or satisfaction compared to another active training modality. Findings were mixed regarding the additive benefit of post-training consultation on these outcomes. No studies evaluated changes in provider outcomes with regards to training costs and few studies reported on client outcomes.

LIMITATIONS

The majority of included studies had a moderate risk of bias and strength of evidence for the outcomes of interest was generally low or insufficient. Few studies reported effect sizes. The ability to identify the most effective EBP training methods was limited by low strength of evidence for the outcomes of interest and substantial heterogeneity among studies.

CONCLUSIONS

EBP training may have increased short-term provider satisfaction, EBP knowledge, and adherence though not adoption. Evidence was insufficient on training costs and client outcomes. Future research is needed on EBP training methods, implementation, sustainability, client outcomes, and costs to ensure efforts to train providers in EBPs are effective, efficient, and durable.

TRIAL REGISTRATION

The protocol for this review is registered in PROSPERO (CRD42018093381).

Evaluation of a Level I trauma center provider training in patient-centered alcohol brief interventions using the Behavior Change Counseling Index rated by standardized patients

Background

Traumatic injury requiring hospitalization is common in the USA and frequently related to alcohol consumption. The American College of Surgeons requires that Level I and II verified trauma centers implement universal alcohol screening and brief intervention for injured patients. We examined whether Level I trauma center provider skill in patient-centered alcohol brief interventions improved after training and whether professional role (eg, nursing, social work) and education were associated with these skills.

Methods

We present evaluation data collected as part of training in alcohol brief interventions embedded within a larger clinical trial of a collaborative care intervention targeting posttraumatic stress disorder and related comorbidities. Sixty-five providers from 25 US Level I trauma centers engaged in a 1-day workshop, with 2 hours dedicated to training in patient-centered alcohol brief interventions followed by 6 months of weekly coaching in a collaborative care model. Providers completed standardized patient role-plays prior to and 6 months after the workshop training. The standardized patient actors rated provider quality of alcohol brief interventions immediately after each role-play using the Behavior Change Counseling Index (BECCI), a pragmatic measure designed to assess the quality of behavior change counseling, an adaptation of motivational interviewing suitable for brief healthcare consultations about behavior change.

Results

Seventy-two percent of providers completed both standardized patient role-play assessments. A statistically significant improvement in overall BECCI scores (t(41)=−2.53, p=0.02, Cohen’s d=−0.39) was observed among those providers with available pre–post data. Provider professional role was associated with BECCI scores at pre-training (F(3, 58)=11.25, p<0.01) and post-training (F(3, 41)=8.10, p<0.01).

Discussion

Findings underscore the need for training in patient-centered alcohol brief interventions and suggest that even a modest training helps providers engage in a more patient-centered way during a role-play assessment.

Level of evidence

Level V, therapeutic/care management.

Changes in Hypothesized Mechanisms of Change Before and After Initiating Abstinence in Cognitive-Behavioral Therapy for Women With Alcohol Use Disorder

Abstinence self-efficacy, coping skills, and therapeutic alliance are hypothesized mechanisms of behavioral change (MOBCs) in cognitive-behavioral therapy (CBT) for alcohol use disorder (AUD). However, little is known about when these hypothesized MOBCs change during treatment or in relation to the initiation of abstinence from alcohol, which the current study investigated. Patient-reported abstinence self-efficacy, drinking-related coping skills, and therapeutic alliance were measured at every session throughout a 12-session clinical trial that previously showed equivalent drinking reductions in female-specific individual- and group-based CBT for AUD. Participants (N = 121 women) were classified into subgroups based on whether and when they first initiated 14 days of continuous abstinence from alcohol during treatment. Interrupted time-series analyses evaluated the magnitude and timing of change in MOBC variables in relation to the initiation of abstinence. All three MOBC measures showed gradual improvements throughout treatment (within-subjects d = 0.03 to 0.09 change per week). Participants who initiated abstinence during treatment experienced additional sudden improvements in abstinence self-efficacy (d = 0.47) and coping skills (d = 0.27), but not therapeutic alliance (d = -0.02), the same week they initiated abstinence. Participants who were already abstinent when treatment started maintained higher abstinence self-efficacy and coping skills, but not therapeutic alliance, throughout treatment compared to participants who never initiated abstinence. Initiating abstinence may help facilitate improvements in abstinence self-efficacy and drinking-related coping skills. Clinicians may help patients anticipate when and how much these variables are expected to improve during treatment and encourage initiation of abstinence to potentially help facilitate improvements in abstinence self-efficacy and coping skills.

Is fidelity to motivational interviewing associated with alcohol outcomes in treatment-seeking 60+ year-old citizens?

BACKGROUND

Part of the variability in treatment outcomes for Motivational Interviewing (MI) may be explained by differences in the fidelity to MI. The Motivational Interviewing Treatment Integrity manual version 4 (MITI 4) is an improved measure of fidelity to elements of MI. It is not known whether the fidelity to MI, as measured by the MITI 4, is related to treatment outcome.

OBJECTIVES

To examine whether fidelity to MI is associated with alcohol use outcomes - predictive validity of the MITI 4.

METHOD

Twenty percent of the recorded sessions at the Danish sites of the Elderly Study were randomly drawn and coded for fidelity to MI with the MITI 4. The Elderly Study was an international, randomized controlled trial, in which people 60 years or older with Alcohol Use Disorders received either four weeks of Motivational Enhancement Therapy (MET) or four weeks of MET combined with up to eight additional sessions of the Community Reinforcement Approach- Senior (MET+CRA-S). Elements of MI and summary scores of the MITI 4 were used as predictors in a mixed effects regression analysis. Treatment outcomes were use of alcohol and consequences of drinking at 26-weeks follow-up.

RESULTS

In total, 423 sessions representing 238 participants were randomly drawn and coded for fidelity to MI. Mean values of the treatment elements indicated high fidelity to MI, with higher fidelity to MI in the MET sessions, as compared to CRA-S sessions. None of the predictors in the multilevel model analyses were associated with outcome at follow-up. Exploratory analysis indicated reverse associations between one measure of MI-fidelity and drinking outcomes in the combined treatment (CRAS).

CONCLUSION

The fidelity of the MI intervention, received by participants in this study, did not predict better treatment outcomes. MI may be less effective in populations which are already committed to change behavior. As expected and validating for the MITI 4, fidelity to MI-elements was lower in the combination of MI with other treatment approaches. Additionally, the timing of MI in these combined settings might be important for effectiveness.

Improvement in therapist skills over sessions in brief motivational interventions predicts client language and alcohol use outcomes

Brief motivational interventions (BMIs) are widely used and efficacious interventions that address alcohol misuse in mandated college students. Consistent with motivational interviewing (MI; Miller & Rollnick, 2013) theory, within-therapist improvements in MI-consistent (MICO) skills over time-that is, as a therapist gains skill through repeated practice-may be associated with concurrent increases in client change language and subsequent changes in behavior. This study examined how therapist skill changed over time and whether within-therapist improvement in MICO skills impacted in-session client change language and subsequent alcohol-related outcomes. BMI sessions (N = 228) from 2 randomized clinical trials that had led to significant reductions in alcohol use and alcohol-related problems in mandated student drinkers were coded using the Motivational Interviewing Skills Code 2.0 (Miller, Moyers, Ernst, & Amrhein, 2003). In both studies, the BMI consisted of a single 45- to 60-min session. Analyses examined session-by-session changes in therapist MICO skills, client change language, and alcohol use outcomes. Therapist MICO skills improved over time, and there were significant increases in client change language and decreases in client discussion of topics other than personal alcohol use. Among relatively heavy-drinking clients, those treated by a more experienced therapist demonstrated greater reductions in alcohol use; however, this association was not mediated by client change language. Increased experience conducting BMIs improved therapist MICO skills over time, which in turn increased the focus on personal alcohol use during the session. However, it remains unclear how client language predicts behavior change following a BMI. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Modeling empathy as synchrony in clinician and patient vocally encoded emotional arousal: A failure to replicate

Empathy is a well-defined active ingredient in clinical encounters. To measure empathy, the current gold standard is behavioral coding (i.e., trained coders attribute overall ratings of empathy to clinician behaviors within an encounter), which is labor intensive and subject to important reliability challenges. Recently, an alternative measurement has been proposed: capturing empathy as synchrony in vocally encoded arousal, which can be measured as the mean fundamental frequency of the voice (mean F0). This method has received preliminary support by one study (Imel, Barco, et al., 2014). We aimed to replicate this study by using 2 large samples of clinical interactions (alcohol brief motivational interventions with young adults, N = 208; general practice consultations, N = 204). Audio files were segmented to identify respective speakers and mean F0 was measured using speech signal processing software. All sessions were independently rated by behavioral coders using 2 validated empathy scales. Synchrony between clinician and patient F0 was analyzed using multivariate multilevel models and compared with high and low levels of empathy derived from behavioral coding. Findings showed no support for our hypothesis that mean F0 synchrony between clinicians and patients would be higher in high-empathy sessions. This lack of replication was consistent for both clinical samples, both behavioral coding instruments, and using measures of F0 synchrony occurring at both the session-level and minute-level. We considered differences in culture and language, patients' characteristics, and setting as explanations for this failure to replicate. Further replication testing and new developments regarding measurement methods and modeling are needed. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Core Elements of Family Therapy for Adolescent Behavior Problems: Empirical Distillation of Three Manualized Treatments

Family therapy has the strongest evidence base for treating adolescent conduct and substance use problems, yet there remain substantial barriers to widespread delivery of this approach in community settings. This study aimed to promote the feasibility of implementing family-based interventions in usual care by empirically distilling the core practice elements of three manualized treatments. The study sampled 302 high-fidelity treatment sessions from 196 cases enrolled in 1 of 3 manualized family therapy models: multidimensional family therapy (102 sessions/56 cases), brief strategic family therapy (100 sessions/94 cases), or functional family therapy (100 sessions/46 cases). Adolescents were 57% male; 41% were African American, 31% White non-Hispanic, 9% Hispanic American, 6% another race/ethnicity, and 13% unknown. The observational fidelity measures of all three models were used to code all 302 sessions. Fidelity ratings were analyzed to derive model-shared treatment techniques via exploratory factor analyses on half the sample; the derived factors were then validated via confirmatory factor analyses supplemented by Bayesian structural equation modeling on the remaining half. Factor analyses distilled 4 clinically coherent practice elements with strong internal consistency: Interactional Change (6 treatment techniques; Cronbach's α = .93), Relational Reframe (7 techniques; α = .79), Adolescent Engagement (4 techniques; α = .68), and Relational Emphasis (4 techniques; α = .67). The 4 empirically derived factors represent the core elements of 3 manualized family therapy models for adolescent behavior problems, setting the foundation of a more sustainable option for delivering evidence-based family interventions in routine practice settings. Public Health Significance: Increasing implementation of high-fidelity family-based interventions would improve the quality of treatment services for adolescent conduct and substance use problems.

Mechanisms of behavior change in motivational interviewing: do we understand how MI works?

This work provides an overview of Motivational Interviewing (MI) theory, the nature of the evidence for its mechanisms of action, and considers future directions. There are three hypotheses purported to explain how MI works: The Technical Hypothesis, the Relational Hypothesis, and the Conflict Resolution Hypothesis. In contrast to the latter two hypotheses, the Technical Hypothesis has received the most empirical attention in the MI process literature. Research shows that clinician technical skills in MI are well-defined, they relate to the intended client mechanisms (i.e. change talk and sustain talk), but the evidence supporting client mechanisms as predictors of subsequent changes to behavior is less conclusive. Future research and clinical implications are briefly considered.

Motivational interviewing training of substance use treatment professionals: A systematic review

Background: Through evaluations of training programs, systematic reviews, and meta-analyses, advances in identifying best practices for disseminating motivational interviewing (MI) have emerged. To advance this work further, inclusion of thorough descriptions of the following is needed in research publications: study (design, trainee characteristics, setting characteristics), training and coaching methods (if applicable), trainer qualifications, and evaluation of MI skills. Methods: The purpose of this study was to systematically evaluate the research on MI training of substance use treatment professionals for the inclusion of such descriptions. Twenty-five studies were reviewed using a scoring rubric developed by the authors. Results: Just over two thirds of the studies (68%) were randomized controlled trials of MI training. The majority of studies provided information about (a) trainee characteristics (professional background = 76%, education = 60%, experience = 56%); (b) setting characteristics (80%); (c) training methods (format = 96%, length = 92%); (d) coaching (76%); and (e) evaluation of MI skills (92%). Conclusion: Findings suggest advancements in MI training studies since previous reviews, especially in regards to the inclusion of feedback and coaching. However, this review also found that inconsistencies in methods and reporting of training characteristics, as well as limited follow-up assessment of trainees' skill, continue to limit knowledge of effective training methods.