1
|
Kopelovich SL, Slevin R, Brian RM, Shepard V, Baldwin SA, Ben-Zeev D, Tanana M, Imel Z. Preliminary investigation of an artificial intelligence-based cognitive behavioral therapy training tool. Psychotherapy (Chic) 2025; 62:12-21. [PMID: 39869688 PMCID: PMC11913585 DOI: 10.1037/pst0000550] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2025]
Abstract
We developed an asynchronous online cognitive behavioral therapy (CBT) training tool that provides artificial intelligence- (AI-) enabled feedback to learners across eight CBT skills. We sought to evaluate the technical reliability and to ascertain how practitioners would use the tool to inform product iteration and future deployment. We conducted a single-arm 2-week field trial among behavioral health practitioners who treat outpatients with psychosis. Practitioners (N = 21) were invited to use the AI-enabled CBT training tool over a 2-week (15 days, inclusive) period. To enable naturalistic observation, no adjustments were made to their workloads nor were prescriptions on use provided. We conducted daily assessments and collected backend analytics for all users. At end point, we assessed acceptability, appropriateness, feasibility of implementation, perceived usability, satisfaction, and perceived impact of training. We observed four types of technical issues: broken links, intermittent issues receiving AI-enabled feedback, video replay errors, and an HTML error. Participants averaged 6.57 logins over the 2 weeks, with more than half engaging daily. Most participants (44.7%) engaged for < 30-min increments. Usability scores exceeded industry standard and satisfaction scores indicated good promotion of the tool. All participants endorsed high feasibility, acceptability, and appropriateness. Twelve participants (57%) used the AI-enabled feedback feature; those who did tended to report improved satisfaction, feasibility, and perceived impact of the training. The training tool was used by practitioners in a routine care setting, met or exceeded conventional implementation benchmarks, and may support skill improvement; however, data suggest that practitioners may need support or accountability to fully leverage the training tool. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
Collapse
Affiliation(s)
- Sarah L Kopelovich
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine
| | | | - Rachel M Brian
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine
| | - Victoria Shepard
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine
| | | | - Dror Ben-Zeev
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine
| | | | | |
Collapse
|
2
|
Jiang Q, Deng Y, Perle J, Zheng W, Chandran D, Chen J, Liu F. Education and training of telemental health providers: a systematic review. Front Public Health 2024; 12:1385532. [PMID: 38841687 PMCID: PMC11152158 DOI: 10.3389/fpubh.2024.1385532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2024] [Accepted: 04/12/2024] [Indexed: 06/07/2024] Open
Abstract
Objective To conduct a systematic literature review of education and training (E&T) programs for telemental health (TMH) providers in the past 10 years to qualitatively clarify field offerings and methodologies, as well as identify areas for future growth. Methods We searched five major electronic databases: PubMed, PsycINFO, Scopus, CINAHL, and Web of Science for original publications on TMH E&T from January 2013 to May 2023. We extracted information from each publication and summarized key features of training programs including setting, target group, study aims, training modality, methods of assessing quality, and outcomes. Results A total of 20 articles were selected for the final review. Articles meeting inclusionary criteria were predominantly comprised of case studies and commentaries, focused on a TMH service/practice for a specific region/population, and were performed after 2020. All of the selected studies demonstrated a significant increase in the measured knowledge, skills, and abilities of the participants after TMH training. Nevertheless, there remains a lack of standardization of training methodologies, limited sample sizes and demographics, variability in study methodologies, and inconsistency of competency targets across studies. Conclusion This systematic review highlighted the diversity of methods for TMH E&T. Future research on this topic could include more varied and larger-scale studies to further validate and extend current findings, as well as explore potential long-term effects of TMH training programs on both provider attitudes and patient outcomes.
Collapse
Affiliation(s)
- Qiaoling Jiang
- Institute of Higher Education, Changsha University, Changsha, China
| | - Yongjia Deng
- West Virginia University School of Medicine, Morgantown, WV, United States
| | - Jonathan Perle
- Department of Behavioral Medicine and Psychiatry, West Virginia University School of Medicine, Morgantown, WV, United States
| | - Wanhong Zheng
- Department of Behavioral Medicine and Psychiatry, West Virginia University School of Medicine, Morgantown, WV, United States
| | - Dilip Chandran
- Department of Behavioral Medicine and Psychiatry, West Virginia University School of Medicine, Morgantown, WV, United States
| | - Jingru Chen
- Mental Health & Counseling, Yale Health, New Haven, CT, United States
| | - Feiyue Liu
- School of Economics and Management, Changsha University, Changsha, China
| |
Collapse
|
3
|
Kopelovich SL, Buck BE, Tauscher J, Lyon AR, Ben-Zeev D. Developing the Workforce of the Digital Future: mHealth Competency and Fidelity Measurement in Community-Based Care. JOURNAL OF TECHNOLOGY IN BEHAVIORAL SCIENCE 2024; 9:35-45. [PMID: 38571682 PMCID: PMC10984896 DOI: 10.1007/s41347-024-00385-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 01/01/2024] [Accepted: 01/04/2024] [Indexed: 04/05/2024]
Abstract
Integrating mobile health (mHealth) interventions into settings that serve diverse patient populations requires that prerequisite professional competencies are delineated and that standards for clinical quality assurance can be pragmatically assessed. Heretofore, proposed mHealth competencies have been broad and have lacked a framework to support specific applications. We outline the meta-competencies identified in the literature relevant to mHealth interventions and demonstrate how these meta-competencies can be integrated with population- and intervention-related competencies to help guide a pragmatic approach to competency assessment. We present a use case based on FOCUS-an evidence-based mHealth intervention designed for individuals with serious mental illness and currently being implemented in geographically and demographically diverse community behavioral health settings. Subsequent to identifying the cross-cutting competencies relevant to the target population (outpatients experiencing psychotic symptoms), substratal intervention (Cognitive Behavioral Therapy for psychosis), and treatment modality (mHealth), we detail the development process of an mHealth fidelity monitoring system (mHealth-FMS). We adhered to a published sequential 5-step process to design a fidelity monitoring system that aligns with our integrated mHealth competency framework and that was guided by best practices prescribed by the Treatment Fidelity Workgroup of the National Institutes of Health Behavior Change Consortium. The mHealth-FMS is intended to enhance both clinical and implementation outcomes by grounding the mHealth interventionist and the system of care in which they operate in the core functions, tasks, knowledge, and competencies associated with system-integrated mHealth delivery. Future research will explore acceptability and feasibility of the mHealth-FMS.
Collapse
Affiliation(s)
- Sarah L. Kopelovich
- Department of Psychiatry & Behavioral Sciences, University of Washington School of Medicine, 1959 NE Pacific Street, Box 356560, Seattle, WA 98195-6560 USA
| | - Benjamin E. Buck
- Department of Psychiatry & Behavioral Sciences, University of Washington School of Medicine, 1959 NE Pacific Street, Box 356560, Seattle, WA 98195-6560 USA
| | - Justin Tauscher
- Department of Psychiatry & Behavioral Sciences, University of Washington School of Medicine, 1959 NE Pacific Street, Box 356560, Seattle, WA 98195-6560 USA
| | - Aaron R. Lyon
- Department of Psychiatry & Behavioral Sciences, University of Washington School of Medicine, 1959 NE Pacific Street, Box 356560, Seattle, WA 98195-6560 USA
| | - Dror Ben-Zeev
- Department of Psychiatry & Behavioral Sciences, University of Washington School of Medicine, 1959 NE Pacific Street, Box 356560, Seattle, WA 98195-6560 USA
| |
Collapse
|
4
|
Perret S, Alon N, Carpenter-Song E, Myrick K, Thompson K, Li S, Sharma K, Torous J. Standardising the role of a digital navigator in behavioural health: a systematic review. Lancet Digit Health 2023; 5:e925-e932. [PMID: 38000876 DOI: 10.1016/s2589-7500(23)00152-8] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 07/26/2023] [Accepted: 07/28/2023] [Indexed: 11/26/2023]
Abstract
As the number and availability of digital mental health tools increases, patients and clinicians see benefit only when these tools are engaging and well integrated into care. Digital navigators-ie, members of health-care teams who are dedicated to supporting patient use of digital resources-offer one solution and continue to be piloted in behavioural health; however, little is known about the core features of this position. The aims of this systematic review were to assess how digital navigators are implemented in behavioural health, and to provide a standardised definition of this position. In January, 2023, we conducted a systematic literature search resulting in 48 articles included in this systematic review. Results showed high heterogeneity between four attributes of digital navigators: training specifications, educational background, frequency of communication, and method of communication with patients. Reported effect sizes for depression and anxiety were medium to large, but could not be synthesised due to study heterogeneity and small study sample size. This systematic review was registered with PROSPERO (CRD42023391696). Results suggest that digital navigator support can probably increase access to, engagement with, and clinical integration of digital health technology, with standards for training and defined responsibilities now emerging.
Collapse
Affiliation(s)
- Sarah Perret
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Noy Alon
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | | | - Keris Myrick
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Kennedy Thompson
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Sunnie Li
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Karuna Sharma
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - John Torous
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA.
| |
Collapse
|
5
|
Mavragani A, Eikey EV, De Leon C, Schueller SM, Schneider M, Stadnick NA, Zheng K, Wilson L, Caro D, Mukamel DB, Sorkin DH. Understanding the Role of Support in Digital Mental Health Programs With Older Adults: Users' Perspective and Mixed Methods Study. JMIR Form Res 2022; 6:e43192. [PMID: 36512387 PMCID: PMC9795392 DOI: 10.2196/43192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 11/08/2022] [Accepted: 11/18/2022] [Indexed: 11/20/2022] Open
Abstract
BACKGROUND Digital mental health interventions have the potential to increase mental health support among isolated older adults. However, the older adult population can experience several barriers to accessing and using digital health resources and may need extra support to experience its benefits. OBJECTIVE This paper aimed to understand what older adults experience as an important aspect of support during engagement in a digital mental health program. The program entailed 3 months of staff support to participate in digital literacy training and engage with the digital mental health platform myStrength, which offers support for a range of mental health challenges, including depression and anxiety. METHODS A total of 30 older adults participated in surveys and interviews to assess their experience of participating in a digital mental health program provided by county mental health services. As part of the program, participants attended 4 classes of digital literacy training, had access to the digital mental health platform myStrength for 2 months with staff support (and 10 months after the program without support), and received support from program staff during the entire 3-month program. Survey data were analyzed using descriptive statistics, and interview data were analyzed using thematic analysis. RESULTS A thematic analysis of the interview data revealed that participants valued ongoing support in 3 main areas: technical support to assist them in using technology, guided support to remind them to use myStrength and practice skills they had learned, and social support to enable them to connect with others through the program. Furthermore, participants reported that social connections was the most important aspect of the program and that they were mainly motivated to participate in the program because it was recommended to them by trusted others such as a community partner or because they believed it could potentially help others. CONCLUSIONS Our findings can be used to inform the design of future digital mental health programs for older adults who may have unique support needs in terms of dedicated technical support and ongoing guided support to use technology and social support to increase social connectedness.
Collapse
Affiliation(s)
| | - Elizabeth V Eikey
- Herbert Wertheim School of Public Health and Human Longevity Science, University of California, San Diego, La Jolla, CA, United States.,The Design Lab, University of California, San Diego, La Jolla, CA, United States
| | - Cinthia De Leon
- Department of Medicine, University of California, Irvine, Irvine, CA, United States
| | - Stephen M Schueller
- Department of Psychological Science, University of California, Irvine, Irvine, CA, United States.,Department of Informatics, University of California, Irvine, Irvine, CA, United States
| | - Margaret Schneider
- Department of Public Health, University of California, Irvine, Irvine, CA, United States
| | - Nicole A Stadnick
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, United States.,Dissemination and Implementation Science Center, Altman Clinical and Translational Research Institute, University of California, San Diego, La Jolla, CA, United States.,Child and Adolescent Services Research Center, San Diego, CA, United States
| | - Kai Zheng
- Department of Informatics, University of California, Irvine, Irvine, CA, United States
| | - Lorraine Wilson
- Department of Health and Human Services, County of Marin, San Rafael, CA, United States
| | - Damaris Caro
- Department of Health and Human Services, County of Marin, San Rafael, CA, United States
| | - Dana B Mukamel
- Department of Medicine, University of California, Irvine, Irvine, CA, United States
| | - Dara H Sorkin
- Department of Medicine, University of California, Irvine, Irvine, CA, United States
| |
Collapse
|