Informal discussions in substance abuse treatment sessions with Spanish-speaking clients

Mental Health Counseling From Conversational Content With Transformer-Based Machine Learning

Importance

Use of asynchronous text-based counseling is rapidly growing as an easy-to-access approach to behavioral health care. Similar to in-person treatment, it is challenging to reliably assess as measures of process and content do not scale.

Objective

To use machine learning to evaluate clinical content and client-reported outcomes in a large sample of text-based counseling episodes of care.

Design, Setting, and Participants

In this quality improvement study, participants received text-based counseling between 2014 and 2019; data analysis was conducted from September 22, 2022, to November 28, 2023. The deidentified content of messages was retained as a part of ongoing quality assurance. Treatment was asynchronous text-based counseling via an online and mobile therapy app (Talkspace). Therapists were licensed to provide mental health treatment and were either independent contractors or employees of the product company. Participants were self-referred via online sign-up and received services via their insurance or self-pay and were assigned a diagnosis from their health care professional.

Exposure

All clients received counseling services from a licensed mental health clinician.

Main Outcomes and Measures

The primary outcomes were client engagement in counseling (number of weeks), treatment satisfaction, and changes in client symptoms, measured via the 8-item version of Patient Health Questionnaire (PHQ-8). A previously trained, transformer-based, deep learning model automatically categorized messages into types of therapist interventions and summaries of clinical content.

Results

The total sample included 166 644 clients treated by 4973 therapists (20 600 274 messages). Participating clients were predominantly female (75.23%), aged 26 to 35 years (55.4%), single (37.88%), earned a bachelor's degree (59.13%), and were White (61.8%). There was substantial variability in intervention use and treatment content across therapists. A series of mixed-effects regressions indicated that collectively, interventions and clinical content were associated with key outcomes: engagement (multiple R = 0.43), satisfaction (multiple R = 0.46), and change in PHQ-8 score (multiple R = 0.13).

Conclusions and Relevance

This quality improvement study found associations between therapist interventions, clinical content, and client-reported outcomes. Consistent with traditional forms of counseling, higher amounts of supportive counseling were associated with improved outcomes. These findings suggest that machine learning-based evaluations of content may increase the scale and specificity of psychotherapy research.

Hispanic participants in the National Institute on Drug Abuse's Clinical Trials Network: A scoping review of two decades of research

INTRODUCTION

Hispanics significantly underutilize substance abuse treatment and are at greater risk for poor treatment outcomes and dropout. Two decades of research from the National Drug Abuse Treatment Clinical Trials Network (CTN) offers an opportunity to increase our understanding in how to address the disparities experienced by Hispanics in substance abuse treatment.

METHODS

A scoping review was utilized to determine what has been learned from the CTN about Hispanic populations with substance use disorder. A systematic search was conducted within the CTN Dissemination Library and nine databases. Potentially relevant studies were independently assessed by two reviewers for inclusion.

RESULTS

Twenty-four studies were included in the review. Results identified issues in measurement, characteristics of Hispanic substance use, effective interventions, and gaps for future research. Characteristics that interfere with treatment participation were also identified including low employment rates, less likelihood of having insurance, lower rates of internet access, and increased travel time to services, as were treatment issues such as high rates of alcohol and tobacco use. Effective interventions were identified; however, the effectiveness of these interventions may be limited to specific factors.

CONCLUSIONS

Despite efforts to improve inclusion of minority populations, Hispanics remain underrepresented in clinical trials. Future research including Hispanic populations should examine measurement equivalence and consider how cultural and historical experiences, as well as patient characteristics, influence utilization of services. Finally, more studies are needed that examine the impact of structural factors that act as barriers to treatment access and engagement and result in significant disparities in treatment outcomes.

Complexities with group therapy facilitation in substance use disorder specialty treatment settings

In spite of increased attention to research-based interventions for substance use disorders (SUDs), a formidable research-practice gap impedes the implementation of evidence-based treatments (EBTs). An underappreciated dimension of this gap is a mismatch in treatment modality: Whereas clinical trial and implementation research has focused primarily on individual therapy, the majority of SUD specialty treatment is in group format, with open-enrolling groups being most common. This study aims to narrow this research-practice gap by exploring clinicians' perspectives on complexities with group therapy facilitation in SUD specialty treatment settings. Semi-structured interviews were conducted with 13 group clinicians from among three outpatient SUD specialty clinics-diverse in their operational structures, treatment philosophies, clientele, and services-located in the same Midwestern U.S. metropolitan area. Interview questions addressed organizational characteristics, services provided, group therapy curricula, and use of EBTs or other structured treatments. Clinicians emphasized the importance of having flexibility in facilitating groups, through built-in group processes and clinicians' own adaptions and accommodations; this flexibility was especially emphasized for the use of EBTs or manualized interventions. Clinicians also had difficulties with group facilitation generally, as evidenced by their reported difficulty in managing complex group dynamics, their limited group therapy experience and training, and their reliance on educational groups. We discuss specific strategies for improved innovation and implementation of EBTs for SUD group therapy.

Group Therapy for Substance Use Disorders: A Survey of Clinician Practices

Substance use disorder (SUD) treatment is typically delivered in group format, but clinical research focuses on individual therapy. This exploratory study narrows this gap through a survey of 566 SUD group clinicians in the United States, concerning most commonly used group practices, attitudes about evidence-based treatments (EBTs), and beliefs about addiction. Clinicians reported high use of open groups, moderately high utilization of EBT practices, and moderate use of questionable practices. Clinicians' attitudes about EBTs and beliefs about addiction were correlated with the use of certain EBTs and questionable practices. Strategies for implementation of EBTs in group settings are discussed.

Therapist and client discussions of drinking and coping: a sequential analysis of therapy dialogues in three evidence-based alcohol use disorder treatments

BACKGROUND AND AIMS

Research into the active ingredients of behavioral interventions for alcohol use disorders (AUD) has focused upon treatment-specific factors, often yielding disappointing results. The present study examines common factors of change in motivational enhancement therapy, cognitive-behavioral therapy and 12-Step facilitation therapy by (1) estimating transitional probabilities between therapist behaviors and subsequent client Change (CT) and Sustain (ST) Talk and (2) examining therapist skillfulness as a potential predictor of transition probability magnitude.

DESIGN

Secondary data analysis examined temporal associations in therapy dialogues.

SETTING

United States: data were from Project MATCH (Matching Alcoholism Treatments to Client Homogeneity) (1997).

PARTICIPANTS

One hundred and twenty-six participants who received motivational enhancement therapy, cognitive-behavioral therapy or 12-Step facilitation therapy.

MEASUREMENTS

Therapist behaviors were measured in three categories (exploring, teaching, connecting) and client statements included five categories (CT-distal, ST-distal, CT-proximal, ST-proximal, neutral). Therapist skillfulness was measured using a five-point ordinal scale.

FINDINGS

Relative to chance, therapist exploratory behaviors predicted subsequent client discussion of distal, drinking behavior [odds ratio (OR) = 1.37-1.78, P < 0.001] while suppressing discussion of proximal coping and neutral content (OR = 0.83-0.90, P < 0.01). Unexpectedly, therapist teaching suppressed distal drinking language (OR = 0.48-0.53, P < 0.001) and predicted neutral content (OR = 1.45, P < 0.001). Connecting behaviors increased both drinking and coping language, particularly language in favor of change (CT OR = 1.15-1.84, P < 0.001). Analyses of exploring and connecting skillfulness revealed that high skillfulness maximized these behaviors effect on client responses, but not teaching skillfulness.

CONCLUSIONS

In motivational enhancement therapy, cognitive-behavioral therapy, and 12-Step facilitation therapy for alcohol use disorders, the therapists who explore and connect with clients appear to be more successful at eliciting discussion about change than therapists who engage in teaching behavior. Therapists who are more skilled achieve better results than those who are less skilled.

Measurement equivalence of the Revised Helping Alliance Questionnaire across African American and non-Latino White substance using adult outpatients

Analyses of the effectiveness of substance abuse treatments across racial/ethnic groups should ensure that outcome measures have the same conceptual meaning (i.e., measurement equivalence) across groups. Because racial groups differ in perceptions and experiences of the therapeutic alliance, this study investigated measurement equivalence properties of the Revised Helping Alliance Questionnaire (HAq-II) across racial groups. The sample included 138 African American and 133 non-Latino White participants, age 18-64 years, who participated in a randomized clinical trial investigating the effectiveness of Motivational Enhancement Therapy in the National Institute on Drug Abuse Clinical Trials Network. Results demonstrated configural invariance and two forms of metric invariance (weak and strong/scalar), suggesting that conceptualizations of therapeutic alliance and overall levels of endorsement of therapeutic alliance are comparable across racial groups. The groups indicated partial, strict metric nonequivalence. No studies to date reported measurement equivalence properties of the HAq-II. Findings support valid measurement and interpretation of HAq-II outcomes.

The Impact of Acculturation, Motivation and the Therapeutic Alliance on Treatment Retention and Outcomes for Hispanic Drug Involved Probationers

Factors associated with retention and outcomes for Hispanic offenders mandated to treatment for substance use disorders have been overlooked in the literature resulting in an impediment to providing evidence-based, culturally relevant treatment services. This project examined the roles of motivational factors, the therapeutic relationship, and acculturation in predicting treatment retention and recidivism among Hispanic male probationers mandated to residential treatment. By following a treatment cohort over one hundred and twenty days, this research identifies factors that may be targeted to improve interventions and policies. The following conclusions are supported: among Hispanic offenders, the number of days in treatment is positively related to motivation to change and level of acculturation.

Ten take home lessons from the first 10 years of the CTN and 10 recommendations for the future

BACKGROUND

The first 10 years of the National Institute on Drug Abuse's Clinical Trials Network (CTN) yielded a wealth of data on the effectiveness of a number of behavioral, pharmacological, and combined approaches in community-based settings.

METHODS

We summarize some of the methodological contributions and lessons learned from the behavioral trials conducted during its first ten years, including the capacity and enormous potential of this national research infrastructure.

RESULTS

The CTN made contributions to the methodology of effectiveness research; new insights from secondary analyses; the extent to which approaches with strong evidence bases, such as contingency management, extend their effectiveness to real world clinical settings; new data on 'standard treatment' as actually practiced in community programs, the extent to which retention remains a major issue in the field; important data on the safety of specific behavioral therapies for addiction; and heightened the importance of continued sustained attention to bridging the gap between treatment and research.

CONCLUSIONS

Areas of focus for the CTN's future include defining common outcome measures to be used in treatment outcome studies for illicit drugs; incorporating performance indicators and measures of clinical significance; conducting comparative outcome studies; contributing to the understanding of effective treatments of comorbidity; reaching underserved populations; building implementation science; understanding long-term outcomes of current treatments and sustaining treatment effects; and conducting future trials more efficiently.