1
|
Zhu E, Wang J, Zhou G, Li C, Chen F, Ju K, Chen L, Yin Y, Chen Y, Zhang Y, Zhang X, Zhou X, Wang Z, Qiu J, Wang H, Shi W, Wang F, Wang D, Chen Z, Hou J, Li H, Ai Z. A highly scalable deep learning language model for common risks prediction among psychiatric inpatients. BMC Med 2025; 23:308. [PMID: 40437564 PMCID: PMC12121029 DOI: 10.1186/s12916-025-04150-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/12/2024] [Accepted: 05/19/2025] [Indexed: 06/01/2025] Open
Abstract
BACKGROUND There is a lack of studies exploring the performance of Transformers-based language models in common risks assessment among psychiatric inpatients. We aim to develop a scalable risk assessment model using multidimensional textualized data and test the stability, robustness, and benefit of this approach. METHODS In this real-world cohort study, a deep learning language model was developed and validated using first hospitalized cases diagnosed with schizophrenia, bipolar disorder, and depressive disorder between January 2016 and March 2023 in three hospitals. The algorithm was externally validated on an independent testing cohort comprising 1180 patients. A total of 140 features, including first medical records (FMR), laboratory examinations, medical orders, and psychological scales, were assessed for analysis. The outcomes were short- and long-term impulsivity (STI and LTI), risk of suicide (STSS and LTSS), and need of physical restraint (STPR and LTPR) assessed by qualified nurses or clinicians. Analysis was carried out between August 2024 and June 2024. Models with different architectures and input settings were compared with each other. The area under the receiver operating characteristic curve (AUROC) was used to assess the primary performance of models. The clinical utility was determined by the net benefit under Youden's threshold. RESULTS Of 7451 patients included in this study, 2982 (47.6%) were male, and the median (interquartile range) age was 42 (28-57) years. The overall incidence of outcomes was 635 (8.5%), 728 (10.5%), 659 (8.8%), 803 (10.8%), 588 (7.9%), and 728 (9.8%) for STPR, LTPR, STSS, LTSS, STI, and LTI, respectively. The multitask semi-structured Transformers-based language (SSTL) model showed more promising AUROCs (STPR: 0.915; LTPR: 0.844; STSS: 0.867; LTSS: 0.879; STI: 0.899; LTI: 0.894) in the prediction of these outcomes than single-tasked or multimodal language models and traditional structured data models. Combining FMR with other data from electronic health records led to significant improvements in the performance and clinical utility of SSTL models based on demographic, diagnosis, laboratory tests, treatment, and psychological scales. CONCLUSIONS The SSTL model shows potential advantages in prognostic evaluation. FMR is a strong predictor for common risks prediction and may benefit other tasks in psychiatry with minimum requirements for data and data processing.
Collapse
Affiliation(s)
- Enzhao Zhu
- School of Medicine, Tongji University, Shanghai, China
| | - Jiayi Wang
- School of Medicine, Tongji University, Shanghai, China
| | - Guoquan Zhou
- Shanghai Putuo Mental Health Center, Putuo District, Shanghai, China
| | - Chunbo Li
- Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, Shanghai, 200030, China
| | - Fazhan Chen
- Clinical Research Center for Mental Disorders, Shanghai Pudong New Area Mental Health Center, School of Medicine, Chinese-German Institute of Mental Health, Tongji University, Shanghai, China
| | - Kang Ju
- Shanghai Changning Mental Health Center, Changning District, Shanghai, China
| | - Liangliang Chen
- Shanghai Changning Mental Health Center, Changning District, Shanghai, China
| | - Yichao Yin
- Shanghai Changning Mental Health Center, Changning District, Shanghai, China
| | - Yi Chen
- Division of Gastrointestinal Surgery, Department of General Surgery, West China Hospital, Sichuan University, Chengdu, China
- Department of Infection Control, West China Hospital, Sichuan University, Chengdu, China
| | - Yanping Zhang
- Shanghai Jinshan District Mental Health Center, Jinshan District, Shanghai, China
| | - Xu Zhang
- School of Medicine, Tongji University, Shanghai, China
| | - Xinlin Zhou
- Lakefield College School, Lakefield, ON, Canada
| | - Zongyuan Wang
- School of Medicine, Tongji University, Shanghai, China
| | - Jianping Qiu
- Shanghai Putuo Mental Health Center, Putuo District, Shanghai, China
| | - Hui Wang
- Shanghai Putuo Mental Health Center, Putuo District, Shanghai, China
| | - Weizhong Shi
- Shanghai Hospital Development Center, Shanghai, China
| | - Feng Wang
- Clinical Research Center for Mental Disorders, Shanghai Pudong New Area Mental Health Center, School of Medicine, Chinese-German Institute of Mental Health, Tongji University, Shanghai, China
| | - Dong Wang
- Clinical Research Center for Mental Disorders, Shanghai Pudong New Area Mental Health Center, School of Medicine, Chinese-German Institute of Mental Health, Tongji University, Shanghai, China
| | - Zhihao Chen
- East China University of Science and Technology, Shanghai, China
| | - Jiaojiao Hou
- University Clinic of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, RWTH Aachen University, Aachen, 52074, Germany
| | - Hui Li
- Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, Shanghai, 200030, China.
| | - Zisheng Ai
- Department of Medical Statistics, School of Medicine, Tongji University, Shanghai, China.
| |
Collapse
|
2
|
Yocum AK, Friedman E, Bertram HS, Han P, McInnis MG. Comparative mortality risks in two independent bipolar cohorts. Psychiatry Res 2023; 330:115601. [PMID: 37976662 DOI: 10.1016/j.psychres.2023.115601] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 11/06/2023] [Accepted: 11/09/2023] [Indexed: 11/19/2023]
Abstract
OBJECTIVES To compare mortality rates in bipolar disorder with common causes of mortality. METHODS Observational data from the Prechter Longitudinal Study of Bipolar Disorder (PLS-BD) of 1128 participants including 281 controls was analyzed using logistical regression to quantify mortality rates in comparison with common comorbidities and causes of death. Outcome and treatment measures, including ASRM, GAD-7, PHQ-9 and medication use were used to stratify those with bipolar disorder (BD) that are alive or deceased. A larger cohort of 10,735 existing BD patients with 7,826 controls (no psychiatric diagnosis) from the University of Michigan Health (U-M Health) clinics was used as replication, observational secondary data analysis. RESULTS The mortality rates are significantly different between those with BD and controls in both PLS-BD and U-M Health. Those with BD and are deceased have a higher percentage of elevated depression measures but show no difference in mania or anxiety measures nor medication use patterns. In both cohorts, a diagnosis of BD increases the odds of mortality greater than history of smoking or being older than ≥ 60-years of age. CONCLUSION BD was found to increase odds of mortality significantly and beyond that of a history of smoking. This finding was replicated in an independent sample.
Collapse
Affiliation(s)
- Anastasia K Yocum
- Department of Psychiatry, University of Michigan, 4250 Plymouth Rd., Ann Arbor, MI 48109, USA.
| | - Emily Friedman
- Department of Biostatistics, University of Michigan, Ann Arbor, MI, USA
| | - Holli S Bertram
- Department of Psychiatry, University of Michigan, 4250 Plymouth Rd., Ann Arbor, MI 48109, USA
| | - Peisong Han
- Department of Biostatistics, University of Michigan, Ann Arbor, MI, USA
| | - Melvin G McInnis
- Department of Psychiatry, University of Michigan, 4250 Plymouth Rd., Ann Arbor, MI 48109, USA
| |
Collapse
|