Using Technology to Train Clinicians in Evidence-Based Treatment: A Systematic Review

Supporting Clinicians in Implementing Exposure Therapy for Anxiety and Related Disorders

PURPOSE OF REVIEW

Exposure therapy is the gold standard treatment for anxiety and related disorders. Despite its strong evidence, it is rarely delivered in routine clinical settings. A growing body of literature has identified factors that impede delivery of exposure therapy and strategies that can increase its use. This review of research from the past 5 years: (1) summarizes barriers to delivering exposure; (2) identifies evidence-based strategies to support clinicians in increasing their delivery of exposure; and (3) highlights emerging trends and challenges in supporting clinicians to use exposure.

RECENT FINDINGS

Barriers to delivering exposure occur at the clinician, client, and organizational levels. Clinician training and organizational policies need to directly address multi-level barriers to support clinicians in using exposure. Technology-related considerations (e.g., virtual reality, telehealth) should be considered and clinicians should receive support from others (e.g., bachelor's-level providers; family peer navigators) to address increasing rates of anxiety disorders.

Identifying Research Priorities in Digital Education for Health Care: Umbrella Review and Modified Delphi Method Study

BACKGROUND

In recent years, the use of digital technology in the education of health care professionals has surged, partly driven by the COVID-19 pandemic. However, there is still a need for focused research to establish evidence of its effectiveness.

OBJECTIVE

This study aimed to define the gaps in the evidence for the efficacy of digital education and to identify priority areas where future research has the potential to contribute to our understanding and use of digital education.

METHODS

We used a 2-stage approach to identify research priorities. First, an umbrella review of the recent literature (published between 2020 and 2023) was performed to identify and build on existing work. Second, expert consensus on the priority research questions was obtained using a modified Delphi method.

RESULTS

A total of 8857 potentially relevant papers were identified. Using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology, we included 217 papers for full review. All papers were either systematic reviews or meta-analyses. A total of 151 research recommendations were extracted from the 217 papers. These were analyzed, recategorized, and consolidated to create a final list of 63 questions. From these, a modified Delphi process with 42 experts was used to produce the top-five rated research priorities: (1) How do we measure the learning transfer from digital education into the clinical setting? (2) How can we optimize the use of artificial intelligence, machine learning, and deep learning to facilitate education and training? (3) What are the methodological requirements for high-quality rigorous studies assessing the outcomes of digital health education? (4) How does the design of digital education interventions (eg, format and modality) in health professionals' education and training curriculum affect learning outcomes? and (5) How should learning outcomes in the field of health professions' digital education be defined and standardized?

CONCLUSIONS

This review provides a prioritized list of research gaps in digital education in health care, which will be of use to researchers, educators, education providers, and funding agencies. Additional proposals are discussed regarding the next steps needed to advance this agenda, aiming to promote meaningful and practical research on the use of digital technologies and drive excellence in health care education.

A Web-Based Therapist Training Tutorial on Prolonged Grief Disorder Therapy: Pre-Post Assessment Study

BACKGROUND

Prolonged grief disorder (PGD) is a newly recognized mental disorder characterized by pervasive intense grief that persists longer than cultural or social expectations and interferes with functioning. The COVID-19 epidemic has resulted in increased rates of PGD, and few clinicians feel confident in treating this condition. PGD therapy (PGDT) is a simple, short-term, and evidence-based treatment developed in tandem with the validation of the PGD diagnosis. To facilitate the dissemination of PGDT training, we developed a web-based therapist tutorial that includes didactic training on PGDT concepts and principles as well as web-based multimedia patient scenarios and examples of clinical implementation of PGDT.

OBJECTIVE

We aimed to evaluate user satisfaction with the tutorial and whether the tutorial increased trainees' knowledge of PGDT principles and procedures. Moreover, we included a small number of pilot questions to evaluate the PGDT-related clinical skills.

METHODS

This study evaluated tutorial learning using a pre- and poststudy design. Participants were recruited from professional organization mailing lists, announcements to graduates of the Columbia School of Social Work, and through word of mouth. After signing consent, participants completed a brief demographic survey, a 55-item multiple-choice prestudy test on the concepts and principles of PGD and PGDT covered in the tutorial, and a 4-item pilot web-based prestudy test to gauge PGD clinical implementation skills. The link to the course content was then activated, and participants were given 8 weeks to complete the 11-module tutorial containing information, web-based exercises, simulated patient and video examples, and self-tests.

RESULTS

Overall, 406 clinicians signed consent, and 236 (58.1%) started the tutorial. Of these, 83.1% (196/236) completed all 11 modules. Trainee scores on our PDGT assessment improved substantially from pretraining to the postmodule assessment, with the total number of correct answers increasing from a mean of 29 (SD 5.5; 52.7% correct) to 36.7 (SD 5.2; 66.7% correct; t₁₉₅=18.93; P<.001). In addition, the trainee's implementation scores on 4 clinical vignettes increased from 2.6 (SD 0.7) correct out of 4 to 3.1 (SD 0.4) out of 4 (t₁₈₈=7.02; P<.001). Effect sizes (Cohen d) were 1.44 (95% CI 1.23-1.65) for PDGT assessment and 1.06 (95% CI 0.84-1.29) for implementation. Trainees found the tutorial interesting, enjoyable, clearly presented, and useful for professional development. They endorsed a mean score of 3.7 (SD 0.47) on a 1 to 4 scale of agreement with recommending the course to others and feeling satisfied with the tutorial, and a mean of 3.3 (SD 0.57) with feeling able to apply the skills with clients.

CONCLUSIONS

This pilot study provides support for the usefulness of this web-based training for teaching clinicians how to administer PGDT. The addition of patient scenarios for clinical implementation strategies holds promise for increasing the effectiveness of PGDT training and other evidence-based treatments.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05121792; https://www.clinicaltrials.gov/ct2/show/NCT05121792.

Assessing health worker competence to deliver a brief psychological treatment for depression: development and validation of a scalable measure

Increased interest in disseminating and implementing psychological treatments has focused on the need for evidence-based training programs for providers, especially those without specialized training. To evaluate provider-training programs, validated outcome measures are necessary; however, the scalable measurement of training outcomes has been largely overlooked. Current methods of assessing providers' ability to deliver psychological treatments are generally time-consuming and costly, representing a major bottleneck in scaling up mental health care for commonly occurring disorders such as depression. The present study describes the development and initial validation of a scalable measure for assessing provider competence in delivering a brief behavioral activation treatment for depression, called the Healthy Activity Program, adapted for primary care settings. The measure focuses on testing knowledge about the treatment and applied knowledge regarding how to skillfully deliver the treatment, both essential features of competence. The measure was tested on a sample of 531 respondents with a variety of educational levels and professional backgrounds and found to meet the requirements of the Rasch model. Three versions of the measure each of equal difficulty were derived to allow repeat testing of training outcomes over time. A scalable measure of provider competence is an essential first step towards supporting the wider dissemination and implementation of brief psychological interventions for depression, especially in low-resource settings.