1
|
Hofmann AB, Dörner M, Klassen PE, Machetanz L, Kirchebner J. RIPTOSO: The development of a screening tool for adverse events during forensic-psychiatric inpatient treatments of offenders with schizophrenia spectrum disorders. Psychiatry Res 2025; 350:116537. [PMID: 40373488 DOI: 10.1016/j.psychres.2025.116537] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/07/2025] [Revised: 04/30/2025] [Accepted: 05/08/2025] [Indexed: 05/17/2025]
Abstract
Adverse events such as compulsory measures, absconding, illicit substance use, self-harm, aggressive behavior, and prolonged hospitalization pose significant challenges in forensic psychiatric inpatient care. This study introduces a machine learning-based tool to predict these events in patients with schizophrenia spectrum disorders (SSD) upon admission. Data from 370 court-mandated forensic inpatients treated at an academic center in Zurich, Switzerland, were retrospectively analyzed. Twenty-seven variables, available upon admission in clinical settings, were tested using six machine learning algorithms (support vector machines (SVM), logistic regression, naive Bayes, gradient boosting, fine trees, and neural networks). Predictive performance was assessed using metrics such as area under the curve (AUC) and balanced accuracy. SVM demonstrated the highest performance, achieving an AUC of 0.79 and a balanced accuracy of 69.8 %. These results suggest that the tool can identify patients at higher risk for problematic treatment courses, enabling earlier interventions and more efficient resource allocation. The simplicity of the model, based on routinely collected data, enhances its clinical applicability. However, validation studies in multi-center and international settings are essential to confirm its robustness and generalizability. This tool represents a promising step toward integrating machine learning into forensic psychiatry to improve treatment outcomes and patient safety.
Collapse
Affiliation(s)
- Andreas B Hofmann
- Adult Psychiatry and Psychotherapy, University Hospital of Psychiatry Zurich, Faculty of Medicine, University of Zurich, Zurich, Switzerland.
| | - Marc Dörner
- Department of Consultation-Liaison-Psychiatry and Psychosomatic Medicine, University Hospital Zurich, University of Zurich, 8091 Zurich, Switzerland; German Center for Neurodegenerative Diseases (DZNE) within the Helmholtz Association, 39120 Magdeburg, Germany
| | | | - Lena Machetanz
- Adult Psychiatry and Psychotherapy, University Hospital of Psychiatry Zurich, Faculty of Medicine, University of Zurich, Zurich, Switzerland; Forensic Psychiatry and Psychotherapy, University Hospital of Psychiatry Zurich, Faculty of Medicine, University of Zurich, Zurich, Switzerland
| | - Johannes Kirchebner
- Forensic Psychiatry and Psychotherapy, University Hospital of Psychiatry Zurich, Faculty of Medicine, University of Zurich, Zurich, Switzerland
| |
Collapse
|
2
|
Di Stefano V, D’Angelo M, Monaco F, Vignapiano A, Martiadis V, Barone E, Fornaro M, Steardo L, Solmi M, Manchia M, Steardo L. Decoding Schizophrenia: How AI-Enhanced fMRI Unlocks New Pathways for Precision Psychiatry. Brain Sci 2024; 14:1196. [PMID: 39766395 PMCID: PMC11674252 DOI: 10.3390/brainsci14121196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2024] [Revised: 11/24/2024] [Accepted: 11/25/2024] [Indexed: 01/11/2025] Open
Abstract
Schizophrenia, a highly complex psychiatric disorder, presents significant challenges in diagnosis and treatment due to its multifaceted neurobiological underpinnings. Recent advancements in functional magnetic resonance imaging (fMRI) and artificial intelligence (AI) have revolutionized the understanding and management of this condition. This manuscript explores how the integration of these technologies has unveiled key insights into schizophrenia's structural and functional neural anomalies. fMRI research highlights disruptions in crucial brain regions like the prefrontal cortex and hippocampus, alongside impaired connectivity within networks such as the default mode network (DMN). These alterations correlate with the cognitive deficits and emotional dysregulation characteristic of schizophrenia. AI techniques, including machine learning (ML) and deep learning (DL), have enhanced the detection and analysis of these complex patterns, surpassing traditional methods in precision. Algorithms such as support vector machines (SVMs) and Vision Transformers (ViTs) have proven particularly effective in identifying biomarkers and aiding early diagnosis. Despite these advancements, challenges such as variability in methodologies and the disorder's heterogeneity persist, necessitating large-scale, collaborative studies for clinical translation. Moreover, ethical considerations surrounding data integrity, algorithmic transparency, and patient individuality must guide AI's integration into psychiatry. Looking ahead, AI-augmented fMRI holds promise for tailoring personalized interventions, addressing unique neural dysfunctions, and improving therapeutic outcomes for individuals with schizophrenia. This convergence of neuroimaging and computational innovation heralds a transformative era in precision psychiatry.
Collapse
Affiliation(s)
- Valeria Di Stefano
- Psychiatry Unit, Department of Health Sciences, University of Catanzaro Magna Graecia, 88100 Catanzaro, Italy; (V.D.S.); (L.S.J.)
| | - Martina D’Angelo
- Psychiatry Unit, Department of Health Sciences, University of Catanzaro Magna Graecia, 88100 Catanzaro, Italy; (V.D.S.); (L.S.J.)
| | - Francesco Monaco
- Department of Mental Health, Azienda Sanitaria Locale Salerno, 84125 Salerno, Italy; (F.M.); (A.V.)
- European Biomedical Research Institute of Salerno (EBRIS), 84125 Salerno, Italy
| | - Annarita Vignapiano
- Department of Mental Health, Azienda Sanitaria Locale Salerno, 84125 Salerno, Italy; (F.M.); (A.V.)
- European Biomedical Research Institute of Salerno (EBRIS), 84125 Salerno, Italy
| | - Vassilis Martiadis
- Department of Mental Health, Azienda Sanitaria Locale (ASL) Napoli 1 Centro, 80145 Naples, Italy;
| | - Eugenia Barone
- Department of Psychiatry, University of Campania “Luigi Vanvitelli”, 80138 Naples, Italy;
| | - Michele Fornaro
- Department of Neuroscience, Reproductive Science and Odontostomatology, University of Naples Federico II, 80138 Naples, Italy;
| | - Luca Steardo
- Department of Clinical Psychology, University Giustino Fortunato, 82100 Benevento, Italy;
- Department of Physiology and Pharmacology “Vittorio Erspamer”, SAPIENZA University of Rome, 00185 Rome, Italy
| | - Marco Solmi
- Department of Psychiatry, University of Ottawa, Ottawa, ON K1N 6N5, Canada;
- On Track: The Champlain First Episode Psychosis Program, Department of Mental Health, The Ottawa Hospital, Ottawa, ON K1H 8L6, Canada
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, University of Ottawa, Ottawa, ON K1N 6N5, Canada
- School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, ON K1N 6N5, Canada
- Department of Child and Adolescent Psychiatry, Charité-Universitätsmedizin, 10117 Berlin, Germany
| | - Mirko Manchia
- Section of Psychiatry, Department of Medical Sciences and Public Health, University of Cagliari, 09124 Cagliari, Italy;
- Unit of Clinical Psychiatry, University Hospital Agency of Cagliari, 09123 Cagliari, Italy
- Department of Pharmacology, Dalhousie University, Halifax, NS B3H 4R2, Canada
| | - Luca Steardo
- Psychiatry Unit, Department of Health Sciences, University of Catanzaro Magna Graecia, 88100 Catanzaro, Italy; (V.D.S.); (L.S.J.)
| |
Collapse
|
3
|
Gong Y, Tang X, Peng H. The effect of subjective understanding on patients' trust in AI pharmacy intravenous admixture services. Front Psychol 2024; 15:1437915. [PMID: 39301009 PMCID: PMC11412255 DOI: 10.3389/fpsyg.2024.1437915] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2024] [Accepted: 08/26/2024] [Indexed: 09/22/2024] Open
Abstract
Introduction Medical services are getting automated and intelligent. An emerging medical service is the AI pharmacy intravenous admixture service (PIVAS) that prepares infusions through robots. However, patients may distrust these robots. Therefore, this study aims to investigate the psychological mechanism of patients' trust in AI PIVAS. Methods We conducted one field study and four experimental studies to test our hypotheses. Study 1 and 2 investigated patients' trust of AI PIVAS. Study 3 and 4 examined the effect of subjective understanding on trust in AI PIVAS. Study 5 examined the moderating effect of informed consent. Results The results indicated that patients' reluctance to trust AI PIVAS (Studies 1-2) stems from their lack of subjective understanding (Study 3). Particularly, patients have an illusion of understanding humans and difficulty in understanding AI (Study 4). In addition, informed consent emerges as a moderating factor, which improves patients' subjective understanding of AI PIVAS, thereby increasing their trust (Study 5). Discussion The study contributes to the literature on algorithm aversion and cognitive psychology by providing insights into the mechanisms and boundary conditions of trust in the context of AI PIVAS. Findings suggest that medical service providers should explain the criteria or process to improve patients' subjective understanding of medical AI, thus increasing the trust in algorithm-based services.
Collapse
Affiliation(s)
- Yongzhi Gong
- School of Business Administration, Southwestern University of Finance and Economics, Chengdu, China
| | - Xiaofei Tang
- School of Business Administration, Southwestern University of Finance and Economics, Chengdu, China
| | - Haoyu Peng
- Graduate Institute of Science, University of Peradeniya, Peradeniya, Sri Lanka
| |
Collapse
|
4
|
Okpete UE, Byeon H. Challenges and prospects in bridging precision medicine and artificial intelligence in genomic psychiatric treatment. World J Psychiatry 2024; 14:1148-1164. [PMID: 39165556 PMCID: PMC11331387 DOI: 10.5498/wjp.v14.i8.1148] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/04/2024] [Revised: 06/13/2024] [Accepted: 07/09/2024] [Indexed: 08/12/2024] Open
Abstract
Precision medicine is transforming psychiatric treatment by tailoring personalized healthcare interventions based on clinical, genetic, environmental, and lifestyle factors to optimize medication management. This study investigates how artificial intelligence (AI) and machine learning (ML) can address key challenges in integrating pharmacogenomics (PGx) into psychiatric care. In this integration, AI analyzes vast genomic datasets to identify genetic markers linked to psychiatric conditions. AI-driven models integrating genomic, clinical, and demographic data demonstrated high accuracy in predicting treatment outcomes for major depressive disorder and bipolar disorder. This study also examines the pressing challenges and provides strategic directions for integrating AI and ML in genomic psychiatry, highlighting the importance of ethical considerations and the need for personalized treatment. Effective implementation of AI-driven clinical decision support systems within electronic health records is crucial for translating PGx into routine psychiatric care. Future research should focus on developing enhanced AI-driven predictive models, privacy-preserving data exchange, and robust informatics systems to optimize patient outcomes and advance precision medicine in psychiatry.
Collapse
Affiliation(s)
- Uchenna Esther Okpete
- Department of Digital Anti-aging Healthcare (BK21), Inje University, Gimhae 50834, South Korea
| | - Haewon Byeon
- Department of Digital Anti-aging Healthcare (BK21), Inje University, Gimhae 50834, South Korea
- Department of Medical Big Data, Inje University, Gimhae 50834, South Korea
| |
Collapse
|
5
|
Riedl R, Hogeterp SA, Reuter M. Do patients prefer a human doctor, artificial intelligence, or a blend, and is this preference dependent on medical discipline? Empirical evidence and implications for medical practice. Front Psychol 2024; 15:1422177. [PMID: 39188871 PMCID: PMC11345249 DOI: 10.3389/fpsyg.2024.1422177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Accepted: 07/18/2024] [Indexed: 08/28/2024] Open
Abstract
Today the doctor-patient relationship typically takes place in a face-to-face setting. However, with the advent of artificial intelligence (AI) systems, two further interaction scenarios are possible: an AI system supports the doctor's decision regarding diagnosis and/or treatment while interacting with the patient, or an AI system could even substitute the doctor and hence a patient interacts with a chatbot (i.e., a machine) alone. Against this background, we report on an online experiment in which we analyzed data from N = 1,183 people. The data was collected in German-speaking countries (Germany, Austria, Switzerland). The participants were asked to imagine they had been suffering from medical conditions of unknown origin for some time and that they were therefore visiting a health center to seek advice from a doctor. We developed descriptions of patient-doctor interactions (referred to as vignettes), thereby manipulating the patient's interaction partner: (i) human doctor, (ii) human doctor with an AI system, and (iii) an AI system only (i.e., chatbot). Furthermore, we manipulated medical discipline: (i) cardiology, (ii) orthopedics, (iii) dermatology, and (iv) psychiatry. Based on this 3 × 4 experimental within-subjects design, our results indicate that people prefer a human doctor, followed by a human doctor with an AI system, and an AI system alone came in last place. Specifically, based on these 12 hypothetical interaction situations, we found a significant main effect of a patient's interaction partner on trust, distrust, perceived privacy invasion, information disclosure, treatment adherence, and satisfaction. Moreover, perceptions of trust, distrust, and privacy invasion predicted information disclosure, treatment adherence, and satisfaction as a function of interaction partner and medical discipline. We found that the situation in psychiatry is different from the other three disciplines. Specifically, the six outcome variables differed strongly between psychiatry and the three other disciplines in the "human doctor with an AI system" condition, while this effect was not that strong in the other conditions (human doctor, chatbot). These findings have important implications for the use of AI in medical care and in the interaction between patients and their doctors.
Collapse
Affiliation(s)
- René Riedl
- Digital Business Institute, University of Applied Sciences Upper Austria, Steyr, Austria
- Institute of Business Informatics – Information Engineering, University of Linz, Linz, Austria
| | | | - Martin Reuter
- Institute of Psychology, University of Bonn, Bonn, Germany
| |
Collapse
|
6
|
Qiu T, Wang S, Hu D, Feng N, Cui L. Predicting Risk of Bullying Victimization among Primary and Secondary School Students: Based on a Machine Learning Model. Behav Sci (Basel) 2024; 14:73. [PMID: 38275356 PMCID: PMC10813723 DOI: 10.3390/bs14010073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Revised: 01/12/2024] [Accepted: 01/18/2024] [Indexed: 01/27/2024] Open
Abstract
School bullying among primary and secondary school students has received increasing attention, and identifying relevant factors is a crucial way to reduce the risk of bullying victimization. Machine learning methods can help researchers predict and identify individual risk behaviors. Through a machine learning approach (i.e., the gradient boosting decision tree model, GBDT), the present longitudinal study aims to systematically examine individual, family, and school environment factors that can predict the risk of bullying victimization among primary and secondary school students a year later. A total of 2767 participants (2065 secondary school students, 702 primary school students, 55.20% female students, mean age at T1 was 12.22) completed measures of 24 predictors at the first wave, including individual factors (e.g., self-control, gender, grade), family factors (family cohesion, parental control, parenting style), peer factor (peer relationship), and school factors (teacher-student relationship, learning capacity). A year later (i.e., T2), they completed the Olweus Bullying Questionnaire. The GBDT model predicted whether primary and secondary school students would be exposed to school bullying after one year by training a series of base learners and outputting the importance ranking of predictors. The GBDT model performed well. The GBDT model yielded the top 6 predictors: teacher-student relationship, peer relationship, family cohesion, negative affect, anxiety, and denying parenting style. The protective factors (i.e., teacher-student relationship, peer relationship, and family cohesion) and risk factors (i.e., negative affect, anxiety, and denying parenting style) associated with the risk of bullying victimization a year later among primary and secondary school students are identified by using a machine learning approach. The GBDT model can be used as a tool to predict the future risk of bullying victimization for children and adolescents and to help improve the effectiveness of school bullying interventions.
Collapse
Affiliation(s)
- Tian Qiu
- Shanghai Key Laboratory of Mental Health and Psychological Crisis Intervention, Institute of Brain and Education Innovation, School of Psychology and Cognitive Science, East China Normal University, Shanghai 200062, China;
| | - Sizhe Wang
- School of Statistics, East China Normal University, Shanghai 200062, China;
| | - Di Hu
- Sliver School of Social Work, New York University, New York, NY 10012, USA;
| | - Ningning Feng
- Shanghai Key Laboratory of Mental Health and Psychological Crisis Intervention, Institute of Brain and Education Innovation, School of Psychology and Cognitive Science, East China Normal University, Shanghai 200062, China;
- Shanghai Centre for Brain Science and Brain-Inspired Technology, Shanghai 200062, China
| | - Lijuan Cui
- Shanghai Key Laboratory of Mental Health and Psychological Crisis Intervention, Institute of Brain and Education Innovation, School of Psychology and Cognitive Science, East China Normal University, Shanghai 200062, China;
- Shanghai Centre for Brain Science and Brain-Inspired Technology, Shanghai 200062, China
| |
Collapse
|
7
|
He Y, Matsunaga M, Li Y, Kishi T, Tanihara S, Iwata N, Tabuchi T, Ota A. Classifying Schizophrenia Cases by Artificial Neural Network Using Japanese Web-Based Survey Data: Case-Control Study. JMIR Form Res 2023; 7:e50193. [PMID: 37966882 PMCID: PMC10687680 DOI: 10.2196/50193] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 09/18/2023] [Accepted: 10/08/2023] [Indexed: 11/16/2023] Open
Abstract
BACKGROUND In Japan, challenges were reported in accurately estimating the prevalence of schizophrenia among the general population. Retrieving previous studies, we investigated that patients with schizophrenia were more likely to experience poor subjective well-being and various physical, psychiatric, and social comorbidities. These factors might have great potential for precisely classifying schizophrenia cases in order to estimate the prevalence. Machine learning has shown a positive impact on many fields, including epidemiology, due to its high-precision modeling capability. It has been applied in research on mental disorders. However, few studies have applied machine learning technology to the precise classification of schizophrenia cases by variables of demographic and health-related backgrounds, especially using large-scale web-based surveys. OBJECTIVE The aim of the study is to construct an artificial neural network (ANN) model that can accurately classify schizophrenia cases from large-scale Japanese web-based survey data and to verify the generalizability of the model. METHODS Data were obtained from a large Japanese internet research pooled panel (Rakuten Insight, Inc) in 2021. A total of 223 individuals, aged 20-75 years, having schizophrenia, and 1776 healthy controls were included. Answers to the questions in a web-based survey were formatted as 1 response variable (self-report diagnosed with schizophrenia) and multiple feature variables (demographic, health-related backgrounds, physical comorbidities, psychiatric comorbidities, and social comorbidities). An ANN was applied to construct a model for classifying schizophrenia cases. Logistic regression (LR) was used as a reference. The performances of the models and algorithms were then compared. RESULTS The model trained by the ANN performed better than LR in terms of area under the receiver operating characteristic curve (0.86 vs 0.78), accuracy (0.93 vs 0.91), and specificity (0.96 vs 0.94), while the model trained by LR showed better sensitivity (0.63 vs 0.56). Comparing the performances of the ANN and LR, the ANN was better in terms of area under the receiver operating characteristic curve (bootstrapping: 0.847 vs 0.773 and cross-validation: 0.81 vs 0.72), while LR performed better in terms of accuracy (0.894 vs 0.856). Sleep medication use, age, household income, and employment type were the top 4 variables in terms of importance. CONCLUSIONS This study constructed an ANN model to classify schizophrenia cases using web-based survey data. Our model showed a high internal validity. The findings are expected to provide evidence for estimating the prevalence of schizophrenia in the Japanese population and informing future epidemiological studies.
Collapse
Affiliation(s)
- Yupeng He
- Department of Public Health, Fujita Health University School of Medicine, Toyoake, Japan
| | - Masaaki Matsunaga
- Department of Public Health, Fujita Health University School of Medicine, Toyoake, Japan
| | - Yuanying Li
- Department of Public Health and Health Systems, Nagoya University Graduate School of Medicine, Nagoya, Japan
| | - Taro Kishi
- Department of Psychiatry, Fujita Health University School of Medicine, Toyoake, Japan
| | - Shinichi Tanihara
- Department of Public Health, Kurume University School of Medicine, Kurume, Japan
| | - Nakao Iwata
- Department of Psychiatry, Fujita Health University School of Medicine, Toyoake, Japan
| | - Takahiro Tabuchi
- Cancer Control Center, Osaka International Cancer Institute, Osaka, Japan
| | - Atsuhiko Ota
- Department of Public Health, Fujita Health University School of Medicine, Toyoake, Japan
| |
Collapse
|
8
|
Gashkarimov VR, Sultanova RI, Efremov IS, Asadullin AR. Machine learning techniques in diagnostics and prediction of the clinical features of schizophrenia: a narrative review. CONSORTIUM PSYCHIATRICUM 2023; 4:43-53. [PMID: 38249535 PMCID: PMC10795943 DOI: 10.17816/cp11030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Accepted: 08/07/2023] [Indexed: 01/23/2024] Open
Abstract
BACKGROUND Schizophrenia is a severe psychiatric disorder associated with a significant negative impact. Early diagnosis and treatment of schizophrenia has a favorable effect on the clinical outcome and patients quality of life. In this context, machine learning techniques open up new opportunities for a more accurate diagnosis and prediction of the clinical features of this illness. AIM This literature review is aimed to search for information on the use of machine learning techniques in the prediction and diagnosis of schizophrenia and the determination of its clinical features. METHODS The Google Scholar, PubMed, and eLIBRARY.ru databases were used to search for relevant data. The review included articles that had been published not earlier than January 1, 2010, and not later than March 31, 2023. Combinations of the following keywords were applied for search queries: machine learning, deep learning, schizophrenia, neural network, predictors, artificial intelligence, diagnostics, suicide, depressive, insomnia, and cognitive. Original articles regardless of their design were included in the review. Descriptive analysis was used to summarize the retrieved data. RESULTS Machine learning techniques are widely used in the functional assessment of patients with schizophrenia. They are used for interpretation of MRI, EEG, and actigraphy findings. Also, models created using machine learning algorithms can analyze speech, behavior, and the creativity of people and these data can be used for the diagnosis of psychiatric disorders. It has been found that different machine learning-based models can help specialists predict and diagnose schizophrenia based on medical history and genetic data, as well as epigenetic information. Machine learning techniques can also be used to build effective models that can help specialists diagnose and predict clinical manifestations and complications of schizophrenia, such as insomnia, depressive symptoms, suicide risk, aggressive behavior, and changes in cognitive functions over time. CONCLUSION Machine learning techniques play an important role in psychiatry, as they have been used in models that help specialists in the diagnosis of schizophrenia and determination of its clinical features. The use of machine learning algorithms is one of the most promising direction in psychiatry, and it can significantly improve the effectiveness of the diagnosis and treatment of schizophrenia.
Collapse
Affiliation(s)
| | - Renata I Sultanova
- Moscow Research and Clinical Center for Neuropsychiatry of Moscow Healthcare Department
| | - Ilya S Efremov
- Bashkir State Medical University
- V.M. Bekhterev National Medical Research Centre for Psychiatry and Neurology
| | - Azat R Asadullin
- Bashkir State Medical University
- V.M. Bekhterev National Medical Research Centre for Psychiatry and Neurology
- Republican Clinical Psychotherapeutic Center
| |
Collapse
|
9
|
Okagbue HI, Ijezie OA, Ugwoke PO, Adeyemi-Kayode TM, Jonathan O. Single-label machine learning classification revealed some hidden but inter-related causes of five psychotic disorder diseases. Heliyon 2023; 9:e19422. [PMID: 37674848 PMCID: PMC10477489 DOI: 10.1016/j.heliyon.2023.e19422] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 08/04/2023] [Accepted: 08/22/2023] [Indexed: 09/08/2023] Open
Abstract
Psychotic disorder diseases (PDD) or mental illnesses are group of illnesses that affect the minds and impair the cognitive ability, retard emotional ability and obstruct the process of communication and relationship with others and are characterized by delusions, hallucinations and disoriented or disordered pattern of thinking. Prognosis of PDD is not sufficient because of the nature of the diseases and as such adequate form of diagnosis is required to detect, manage and treat the illness. This paper applied the single-label classification (SLC) machine learning approach in mining of electronic health records of people with PDD in Nigeria using eleven independent (demographic) variables and five PDD as target variables. The five PDDs are Insomnia, Schizophrenia, Minimal Brain dysfunction (MBD), which is also known as Attention-Deficit/Hyperactivity Disorder (ADHD), Vascular Dementia (VD) and Bipolar Disorder (BD). The aim of using SLC is that it would be easier to detect some PDDs that are related to each other without the loss of information, which is a plus over multi-label classification (MLC). ReliefF algorithm was used at each experiment to precipitate the order of importance of the independent variables and redundant variables were excluded from the analysis. The order of the variables in feature selection was matched with feature importance after the classifications and quantified using the Spearman rank correlation coefficient. The data was divided into: 70% for training and 30% for testing. Four new performance metrics adapted from the root mean square (RMSE) were proposed and used to measure the differences between the performance results of the 10 Machine learning models in terms of the training and testing and secondly, feature and without feature selection. The new metrics are close to zero which is an indication that the use of feature selection and cross validation may not greatly affects the accuracy of the SLC. When the PDDs are included as predictors for classifying others, there was a tremendous improvement as revealed by the four new metrics for classification accuracy (CA), precision and recall. Analysis of variance showed the four different metrics differs significantly for classification accuracy (CA) and precision. However, there were no significant difference between the CA and precision when the duo are compared together across the four evaluation metrics at p value less than 0.05.
Collapse
Affiliation(s)
| | - Ogochukwu A. Ijezie
- Faculty of Science and Technology, Bournemouth University, Poole, BH12 5BB, UK
| | - Paulinus O. Ugwoke
- Department of Computer Science, University of Nigeria, Nsukka, Nigeria
- Digital Bridge Institute, International Centre for Information & Communications Technology Studies, Abuja, Nigeria
| | | | - Oluranti Jonathan
- Department of Computer & Information Sciences, Covenant University, Ota, Nigeria
| |
Collapse
|
10
|
Starke G, D’Imperio A, Ienca M. Out of their minds? Externalist challenges for using AI in forensic psychiatry. Front Psychiatry 2023; 14:1209862. [PMID: 37692304 PMCID: PMC10483237 DOI: 10.3389/fpsyt.2023.1209862] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Accepted: 08/07/2023] [Indexed: 09/12/2023] Open
Abstract
Harnessing the power of machine learning (ML) and other Artificial Intelligence (AI) techniques promises substantial improvements across forensic psychiatry, supposedly offering more objective evaluations and predictions. However, AI-based predictions about future violent behaviour and criminal recidivism pose ethical challenges that require careful deliberation due to their social and legal significance. In this paper, we shed light on these challenges by considering externalist accounts of psychiatric disorders which stress that the presentation and development of psychiatric disorders is intricately entangled with their outward environment and social circumstances. We argue that any use of predictive AI in forensic psychiatry should not be limited to neurobiology alone but must also consider social and environmental factors. This thesis has practical implications for the design of predictive AI systems, especially regarding the collection and processing of training data, the selection of ML methods, and the determination of their explainability requirements.
Collapse
Affiliation(s)
- Georg Starke
- Faculty of Medicine, Institute for History and Ethics of Medicine, Technical University of Munich, Munich, Germany
- École Polytechnique Fédérale de Lausanne, College of Humanities, Lausanne, Switzerland
- Munich School of Philosophy, Munich, Germany
| | - Ambra D’Imperio
- Faculty of Medicine, Institute for History and Ethics of Medicine, Technical University of Munich, Munich, Germany
- Department of Psychiatry, Hôpitaux Universitaires de Genève, Geneva, Switzerland
- Service of Forensic Psychiatry CURML, Geneva University Hospitals, Geneva, Switzerland
| | - Marcello Ienca
- Faculty of Medicine, Institute for History and Ethics of Medicine, Technical University of Munich, Munich, Germany
- École Polytechnique Fédérale de Lausanne, College of Humanities, Lausanne, Switzerland
| |
Collapse
|
11
|
Liu XQ, Ji XY, Weng X, Zhang YF. Artificial intelligence ecosystem for computational psychiatry: Ideas to practice. World J Meta-Anal 2023; 11:79-91. [DOI: 10.13105/wjma.v11.i4.79] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Revised: 03/18/2023] [Accepted: 04/04/2023] [Indexed: 04/14/2023] Open
|
12
|
Chen J, Patil KR, Yeo BTT, Eickhoff SB. Leveraging Machine Learning for Gaining Neurobiological and Nosological Insights in Psychiatric Research. Biol Psychiatry 2023; 93:18-28. [PMID: 36307328 DOI: 10.1016/j.biopsych.2022.07.025] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/13/2022] [Revised: 07/06/2022] [Accepted: 07/28/2022] [Indexed: 11/18/2022]
Abstract
Much attention is currently devoted to developing diagnostic classifiers for mental disorders. Complementing these efforts, we highlight the potential of machine learning to gain biological insights into the psychopathology and nosology of mental disorders. Studies to this end have mainly used brain imaging data, which can be obtained noninvasively from large cohorts and have repeatedly been argued to reveal potentially intermediate phenotypes. This may become particularly relevant in light of recent efforts to identify magnetic resonance imaging-derived biomarkers that yield insight into pathophysiological processes as well as to refine the taxonomy of mental illness. In particular, the accuracy of machine learning models may be used as dependent variables to identify features relevant to pathophysiology. Moreover, such approaches may help disentangle the dimensional (within diagnosis) and often overlapping (across diagnoses) symptomatology of psychiatric illness. We also point out a multiview perspective that combines data from different sources, bridging molecular and system-level information. Finally, we summarize recent efforts toward a data-driven definition of subtypes or disease entities through unsupervised and semisupervised approaches. The latter, blending unsupervised and supervised concepts, may represent a particularly promising avenue toward dissecting heterogeneous categories. Finally, we raise several technical and conceptual aspects related to the reviewed approaches. In particular, we discuss common pitfalls pertaining to flawed input data or analytic procedures that would likely lead to unreliable outputs.
Collapse
Affiliation(s)
- Ji Chen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China; Department of Psychiatry, The Fourth Affiliated Hospital, Zhejiang University School of Medicine, Yiwu, Zhejiang, China; Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.
| | - Kaustubh R Patil
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany; Institute of Systems Neuroscience, Medical Faculty, Heinrich-Heine-universität Düsseldorf, Düsseldorf, Germany
| | - B T Thomas Yeo
- Centre for Sleep and Cognition & Centre for Translational MR Research, Yong Loo Lin School of Medicine, National University of Singapore, Singapore; Department of Electrical and Computer Engineering, National University of Singapore, Singapore; Integrative Sciences & Engineering Programme, National University of Singapore, Singapore; Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts
| | - Simon B Eickhoff
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany; Institute of Systems Neuroscience, Medical Faculty, Heinrich-Heine-universität Düsseldorf, Düsseldorf, Germany
| |
Collapse
|
13
|
Walker VG. Elder's life course theory and person-centered research: A lens for conducting ethical nursing research and mental health nursing practice with older adults aging with the diagnosis of schizophrenia. J Psychiatr Ment Health Nurs 2022; 29:904-914. [PMID: 35020244 DOI: 10.1111/jpm.12819] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Revised: 12/17/2021] [Accepted: 01/07/2022] [Indexed: 11/29/2022]
Abstract
INTRODUCTION Older adults diagnosed with schizophrenia are a vulnerable population owing to the manifestations of their illness, which can include decreased reality orientation, paranoia, hallucinations and delusions. This paper presents ethical principles of vulnerability, veracity, non-maleficence and autonomy for person-centered care in mental health nursing research and practice, focused with the lens of Elder's life course theory (LCT). AIM To present Elder's LCT as an ethical lens for person-centered care as nurses engage with older adults aging with the diagnosis of schizophrenia in clinical practice and/or research. METHOD Four ethical principles fundamental to nursing research and mental health practice are presented, with Elder's LCT as a theoretical lens for person-centered care. RESULTS A model for ethical research and mental health practice with older adults diagnosed with schizophrenia. DISCUSSION Nursing research and mental health nursing practice with an ethical LCT lens for person-centered can help nurses envision, explore and generate interventions to address the special needs of older adults aging with schizophrenia. IMPLICATIONS FOR PRACTICE The use of a LCT lens for person-centered care can encourage nurses in research and mental health practice to seek information collaboratively with older adults diagnosed with schizophrenia in a thoughtful, ethical manner, to inform the improvement of their health outcomes and health policy.
Collapse
|
14
|
Zeng J, Zhang W, Wu G, Wang X, Shah C, Li S, Xiao Y, Yao L, Cao H, Li Z, Sweeney JA, Lui S, Gong Q. Effects of Antipsychotic Medications and Illness Duration on Brain Features That Distinguish Schizophrenia Patients. Schizophr Bull 2022; 48:1354-1362. [PMID: 35925035 PMCID: PMC9673268 DOI: 10.1093/schbul/sbac094] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
BACKGROUND AND HYPOTHESIS Previous studies have reported effects of antipsychotic treatment and illness duration on brain features. This study used a machine learning approach to examine whether these factors in aggregate impacted the utility of MRI features for differentiating individual schizophrenia patients from healthy controls. STUDY DESIGN This case-control study used patients with never-treated first-episode schizophrenia (FES, n = 179) and long-term ill schizophrenia (LTSZ, n = 30), with follow-up of the FES group after treatment (n = 71), a group of patients who had received long-term antipsychotic treatment (n = 93) and age and sex-matched healthy controls (n = 373) for each patient group. A multiple kernel learning classifier combining both structural and functional brain features was used to discriminate individual patients from controls. STUDY RESULTS MRI features differentiated untreated FES (0.73) and LTSZ (0.83) patients from healthy controls with moderate accuracy, but accuracy was significantly higher in antipsychotic-treated FES (0.94) and LTSZ (0.98) patients. Treatment was associated with significantly increased accuracy of case identification in both early course and long-term ill patients (both p < .001). Effects of illness duration, examined separately in treated and untreated patients, were less robust. CONCLUSIONS Our results demonstrate that initiation of antipsychotic treatment alters brain features in ways that further distinguish individual schizophrenia patients from healthy individuals, and have a modest effect of illness duration. Intrinsic illness-related brain alterations in untreated patients, regardless of illness duration, are not sufficiently robust for accurate identification of schizophrenia patients.
Collapse
Affiliation(s)
- Jiaxin Zeng
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
| | - Wenjing Zhang
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
- Department of Radiology, Huaxi MR Research Center (HMRRC), Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
| | - Guorong Wu
- Key Laboratory of Cognition and Personality, Faculty of Psychology, Southwest University, Chongqing, China
| | - Xiaowan Wang
- Key Laboratory of Cognition and Personality, Faculty of Psychology, Southwest University, Chongqing, China
| | - Chandan Shah
- Department of Radiology, Huaxi MR Research Center (HMRRC), Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
| | - Siyi Li
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
| | - Yuan Xiao
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
| | - Li Yao
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
| | - Hengyi Cao
- Department of Radiology, Huaxi MR Research Center (HMRRC), Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
- Center for Psychiatry Neuroscience, Feinstein Institute for Medical Research, Manhasset, NY, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Glen Oaks, NY, USA
| | - Zhenlin Li
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
| | - John A Sweeney
- Department of Radiology, Huaxi MR Research Center (HMRRC), Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
- Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati College of Medicine, Cincinnati, OH, USA
| | - Su Lui
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
- Department of Radiology, Huaxi MR Research Center (HMRRC), Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
| | - Qiyong Gong
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
- Department of Radiology, Huaxi MR Research Center (HMRRC), Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
| |
Collapse
|
15
|
Trinhammer ML, Merrild ACH, Lotz JF, Makransky G. Predicting crime during or after psychiatric care: Evaluating machine learning for risk assessment using the Danish patient registries. J Psychiatr Res 2022; 152:194-200. [PMID: 35752071 DOI: 10.1016/j.jpsychires.2022.06.009] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Revised: 06/01/2022] [Accepted: 06/06/2022] [Indexed: 10/18/2022]
Abstract
BACKGROUND Structural changes in psychiatric systems have altered treatment opportunities for patients in need of mental healthcare. These changes are possibly associated with an increase in post-discharge crime, reported in the increase of forensic psychiatric populations. As current risk-assessment tools are time-consuming to administer and offer limited accuracy, this study aims to develop a predictive model designed to identify psychiatric patients at risk of committing crime leading to a future forensic psychiatric treatment course. METHOD We utilized the longitudinal quality of the Danish patient registries, identifying the 45.720 adult patients who had contact with the psychiatric system in 2014, of which 474 committed crime leading to a forensic psychiatric treatment course after discharge. Four machine learning models (Logistic Regression, Random Forest, XGBoost and LightGBM) were applied over a range of sociodemographic, judicial, and psychiatric variables. RESULTS This study achieves a F1-macro score of 76%, with precision = 57% and recall = 47% reported by the LightGBM algorithm. Our model was therefore able to identify 47% of future forensic psychiatric patients, while making correct predictions in 57% of cases. CONCLUSION The study demonstrates how a clinically useful initial risk-assessment can be achieved using machine learning on data from patient registries. The proposed approach offers the opportunity to flag potential future forensic psychiatric patients, while in contact with the general psychiatric system, hereby allowing early-intervention initiatives to be activated.
Collapse
Affiliation(s)
- M L Trinhammer
- Department of Psychology, University of Copenhagen, Øster Farimagsgade 2A, 1353, Copenhagen, Denmark.
| | - A C Holst Merrild
- DTU COMPUTE, Technical University of Denmark, Building 324, 2800, Kongens Lyngby, Denmark
| | - J F Lotz
- The ROCKWOOL Foundation, Ny Kongensgade 6, 1472, Copenhagen, Denmark; Department of Computer Science, University of Copenhagen, Universitetsparken 1, 2100, Copenhagen, Denmark
| | - G Makransky
- Department of Psychology, University of Copenhagen, Øster Farimagsgade 2A, 1353, Copenhagen, Denmark
| |
Collapse
|
16
|
Martin VP, Rouas JL, Philip P, Fourneret P, Micoulaud-Franchi JA, Gauld C. How Does Comparison With Artificial Intelligence Shed Light on the Way Clinicians Reason? A Cross-Talk Perspective. Front Psychiatry 2022; 13:926286. [PMID: 35757203 PMCID: PMC9218339 DOI: 10.3389/fpsyt.2022.926286] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Accepted: 05/13/2022] [Indexed: 11/16/2022] Open
Abstract
In order to create a dynamic for the psychiatry of the future, bringing together digital technology and clinical practice, we propose in this paper a cross-teaching translational roadmap comparing clinical reasoning with computational reasoning. Based on the relevant literature on clinical ways of thinking, we differentiate the process of clinical judgment into four main stages: collection of variables, theoretical background, construction of the model, and use of the model. We detail, for each step, parallels between: i) clinical reasoning; ii) the ML engineer methodology to build a ML model; iii) and the ML model itself. Such analysis supports the understanding of the empirical practice of each of the disciplines (psychiatry and ML engineering). Thus, ML does not only bring methods to the clinician, but also supports educational issues for clinical practice. Psychiatry can rely on developments in ML reasoning to shed light on its own practice in a clever way. In return, this analysis highlights the importance of subjectivity of the ML engineers and their methodologies.
Collapse
Affiliation(s)
- Vincent P Martin
- Université de Bordeaux, CNRS, Bordeaux INP, LaBRI, UMR5800, Talence, France.,Université de Bordeaux, CNRS, SANPSY, UMR6033, CHU de Bordeaux, Bordeaux, France
| | - Jean-Luc Rouas
- Université de Bordeaux, CNRS, Bordeaux INP, LaBRI, UMR5800, Talence, France
| | - Pierre Philip
- Université de Bordeaux, CNRS, SANPSY, UMR6033, CHU de Bordeaux, Bordeaux, France.,University Sleep Clinic, Services of Functional Exploration of the Nervous System, University Hospital of Bordeaux, Bordeaux, France
| | - Pierre Fourneret
- Department of Child Psychiatry, Hospices Civils de Lyon, Lyon, France
| | - Jean-Arthur Micoulaud-Franchi
- Université de Bordeaux, CNRS, SANPSY, UMR6033, CHU de Bordeaux, Bordeaux, France.,University Sleep Clinic, Services of Functional Exploration of the Nervous System, University Hospital of Bordeaux, Bordeaux, France
| | - Christophe Gauld
- Department of Child Psychiatry, Hospices Civils de Lyon, Lyon, France.,IHPST, CNRS UMR 8590, Sorbonne University, Paris, France
| |
Collapse
|
17
|
Schneider H. Artificial Intelligence in Schizophrenia. Artif Intell Med 2022. [DOI: 10.1007/978-3-030-64573-1_214] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
18
|
The PSYchiatric clinical outcome prediction (PSYCOP) cohort: leveraging the potential of electronic health records in the treatment of mental disorders. Acta Neuropsychiatr 2021; 33:323-330. [PMID: 34369330 DOI: 10.1017/neu.2021.22] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
BACKGROUND The quality of life and lifespan are greatly reduced among individuals with mental illness. To improve prognosis, the nascent field of precision psychiatry aims to provide personalised predictions for the course of illness and response to treatment. Unfortunately, the results of precision psychiatry studies are rarely externally validated, almost never implemented in clinical practice, and tend to focus on a few selected outcomes. To overcome these challenges, we have established the PSYchiatric Clinical Outcome Prediction (PSYCOP) cohort, which will form the basis for extensive studies in the upcoming years. METHODS PSYCOP is a retrospective cohort study that includes all patients with at least one contact with the psychiatric services of the Central Denmark Region in the period from January 1, 2011, to October 28, 2020 (n = 119 291). All data from the electronic health records (EHR) are included, spanning diagnoses, information on treatments, clinical notes, discharge summaries, laboratory tests, etc. Based on these data, machine learning methods will be used to make prediction models for a range of clinical outcomes, such as diagnostic shifts, treatment response, medical comorbidity, and premature mortality, with an explicit focus on clinical feasibility and implementation. DISCUSSIONS We expect that studies based on the PSYCOP cohort will advance the field of precision psychiatry through the use of state-of-the-art machine learning methods on a large and representative data set. Implementation of prediction models in clinical psychiatry will likely improve treatment and, hopefully, increase the quality of life and lifespan of those with mental illness.
Collapse
|
19
|
Barron DS. Commentary: the ethical challenges of machine learning in psychiatry: a focus on data, diagnosis, and treatment. Psychol Med 2021; 51:2522-2524. [PMID: 33975655 DOI: 10.1017/s0033291721001008] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
The clinical interview is the psychiatrist's data gathering procedure. However, the clinical interview is not a defined entity in the way that 'vitals' are defined as measurements of blood pressure, heart rate, respiration rate, temperature, and oxygen saturation. There are as many ways to approach a clinical interview as there are psychiatrists; and trainees can learn as many ways of performing and formulating the clinical interview as there are instructors (Nestler, 1990). Even in the same clinical setting, two clinicians might interview the same patient and conduct very different examinations and reach different treatment recommendations. From the perspective of data science, this mismatch is not one of personal style or idiosyncrasy but rather one of uncertain salience: neither the clinical interview nor the data thereby generated is operationalized and, therefore, neither can be rigorously evaluated, tested, or optimized.
Collapse
Affiliation(s)
- Daniel S Barron
- Department of Psychiatry, Yale University, New Haven, CT, USA
- Department of Anesthesiology and Pain Medicine, University of Washington, Seattle, WA, USA
- Department of Psychiatry, Brigham & Women's Hospital, Harvard University, Boston, MA, USA
- Department of Anesthesiology & Pain Medicine, Brigham & Women's Hospital, Harvard University, Boston, MA, USA
| |
Collapse
|
20
|
Starke G, De Clercq E, Borgwardt S, Elger BS. Why educating for clinical machine learning still requires attention to history: a rejoinder to Gauld et al. Psychol Med 2021; 51:2512-2513. [PMID: 33308336 DOI: 10.1017/s0033291720004766] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Affiliation(s)
- Georg Starke
- Institute for Biomedical Ethics, University of Basel, Basel, Switzerland
| | - Eva De Clercq
- Institute for Biomedical Ethics, University of Basel, Basel, Switzerland
| | - Stefan Borgwardt
- Department of Psychiatry, University of Basel, Basel, Switzerland
- Department of Psychiatry and Psychotherapy, University of Lübeck, Lübeck, Germany
| | - Bernice Simone Elger
- Institute for Biomedical Ethics, University of Basel, Basel, Switzerland
- University Center of Legal Medicine, University of Geneva, Geneva, Switzerland
| |
Collapse
|
21
|
Gauld C, Micoulaud-Franchi JA, Dumas G. Comment on Starke et al.: 'Computing schizophrenia: ethical challenges for machine learning in psychiatry': from machine learning to student learning: pedagogical challenges for psychiatry. Psychol Med 2021; 51:2509-2511. [PMID: 33087200 DOI: 10.1017/s0033291720003906] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Affiliation(s)
- Christophe Gauld
- Department of Psychiatry, University of Grenoble, Avenue du Maquis du Grésivaudan, 38 000Grenoble, France
- UMR CNRS 8590 IHPST, Sorbonne University, Paris1, France
| | - Jean-Arthur Micoulaud-Franchi
- University Sleep Clinic, Services of functional exploration of the nervous system, University Hospital of Bordeaux, Place Amélie Raba-Leon, 33 076Bordeaux, France
- USR CNRS 3413 SANPSY, University Hospital Pellegrin, University of Bordeaux, Bordeaux, France
| | - Guillaume Dumas
- Precision Psychiatry and Social Physiology Laboratory, CHU Sainte-Justine Research Center, Department of Psychiatry, University of Montreal, Quebec, Canada
- Human Brain and Behavior Laboratory, Center for Complex Systems and Brain Sciences, Florida Atlantic University, Boca Raton, Florida, USA
| |
Collapse
|
22
|
Martin VP, Rouas JL, Micoulaud-Franchi JA, Philip P, Krajewski J. How to Design a Relevant Corpus for Sleepiness Detection Through Voice? Front Digit Health 2021; 3:686068. [PMID: 34713156 PMCID: PMC8521834 DOI: 10.3389/fdgth.2021.686068] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Accepted: 08/19/2021] [Indexed: 12/27/2022] Open
Abstract
This article presents research on the detection of pathologies affecting speech through automatic analysis. Voice processing has indeed been used for evaluating several diseases such as Parkinson, Alzheimer, or depression. If some studies present results that seem sufficient for clinical applications, this is not the case for the detection of sleepiness. Even two international challenges and the recent advent of deep learning techniques have still not managed to change this situation. This article explores the hypothesis that the observed average performances of automatic processing find their cause in the design of the corpora. To this aim, we first discuss and refine the concept of sleepiness related to the ground-truth labels. Second, we present an in-depth study of four corpora, bringing to light the methodological choices that have been made and the underlying biases they may have induced. Finally, in light of this information, we propose guidelines for the design of new corpora.
Collapse
Affiliation(s)
- Vincent P. Martin
- Laboratoire Bordelais de Recherche en Informatique, University of Bordeaux, CNRS–UMR 5800, Bordeaux INP, Talence, France
| | - Jean-Luc Rouas
- Laboratoire Bordelais de Recherche en Informatique, University of Bordeaux, CNRS–UMR 5800, Bordeaux INP, Talence, France
| | | | - Pierre Philip
- Sommeil, Addiction et Neuropsychiatrie, University of Bordeaux, CNRS–USR 3413, CHU Pellegrin, Bordeaux, France
| | - Jarek Krajewski
- Engineering Psychology, Rhenish University of Applied Science, Cologne, Germany
| |
Collapse
|
23
|
de Nijs J, Burger TJ, Janssen RJ, Kia SM, van Opstal DPJ, de Koning MB, de Haan L, Cahn W, Schnack HG. Individualized prediction of three- and six-year outcomes of psychosis in a longitudinal multicenter study: a machine learning approach. NPJ SCHIZOPHRENIA 2021; 7:34. [PMID: 34215752 PMCID: PMC8253813 DOI: 10.1038/s41537-021-00162-3] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2020] [Accepted: 02/17/2021] [Indexed: 02/06/2023]
Abstract
Schizophrenia and related disorders have heterogeneous outcomes. Individualized prediction of long-term outcomes may be helpful in improving treatment decisions. Utilizing extensive baseline data of 523 patients with a psychotic disorder and variable illness duration, we predicted symptomatic and global outcomes at 3-year and 6-year follow-ups. We classified outcomes as (1) symptomatic: in remission or not in remission, and (2) global outcome, using the Global Assessment of Functioning (GAF) scale, divided into good (GAF ≥ 65) and poor (GAF < 65). Aiming for a robust and interpretable prediction model, we employed a linear support vector machine and recursive feature elimination within a nested cross-validation design to obtain a lean set of predictors. Generalization to out-of-study samples was estimated using leave-one-site-out cross-validation. Prediction accuracies were above chance and ranged from 62.2% to 64.7% (symptomatic outcome), and 63.5-67.6% (global outcome). Leave-one-site-out cross-validation demonstrated the robustness of our models, with a minor drop in predictive accuracies of 2.3% on average. Important predictors included GAF scores, psychotic symptoms, quality of life, antipsychotics use, psychosocial needs, and depressive symptoms. These robust, albeit modestly accurate, long-term prognostic predictions based on lean predictor sets indicate the potential of machine learning models complementing clinical judgment and decision-making. Future model development may benefit from studies scoping patient's and clinicians' needs in prognostication.
Collapse
Affiliation(s)
- Jessica de Nijs
- grid.5477.10000000120346234Department of Psychiatry, University Medical Center Utrecht, UMC Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| | - Thijs J. Burger
- grid.491093.60000 0004 0378 2028Arkin, Institute for Mental Health, Amsterdam, The Netherlands ,grid.7177.60000000084992262Department of Psychiatry, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands
| | - Ronald J. Janssen
- grid.5477.10000000120346234Department of Psychiatry, University Medical Center Utrecht, UMC Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| | - Seyed Mostafa Kia
- grid.5477.10000000120346234Department of Psychiatry, University Medical Center Utrecht, UMC Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| | - Daniël P. J. van Opstal
- grid.5477.10000000120346234Department of Psychiatry, University Medical Center Utrecht, UMC Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| | - Mariken B. de Koning
- grid.491093.60000 0004 0378 2028Arkin, Institute for Mental Health, Amsterdam, The Netherlands ,grid.7177.60000000084992262Department of Psychiatry, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands
| | - Lieuwe de Haan
- grid.491093.60000 0004 0378 2028Arkin, Institute for Mental Health, Amsterdam, The Netherlands ,grid.7177.60000000084992262Department of Psychiatry, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands
| | | | - Wiepke Cahn
- grid.5477.10000000120346234Department of Psychiatry, University Medical Center Utrecht, UMC Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands ,grid.413664.2Altrecht, General Mental Health Care, Utrecht, The Netherlands
| | - Hugo G. Schnack
- grid.5477.10000000120346234Department of Psychiatry, University Medical Center Utrecht, UMC Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
24
|
Chekroud AM, Bondar J, Delgadillo J, Doherty G, Wasil A, Fokkema M, Cohen Z, Belgrave D, DeRubeis R, Iniesta R, Dwyer D, Choi K. The promise of machine learning in predicting treatment outcomes in psychiatry. World Psychiatry 2021; 20:154-170. [PMID: 34002503 PMCID: PMC8129866 DOI: 10.1002/wps.20882] [Citation(s) in RCA: 220] [Impact Index Per Article: 55.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/14/2022] Open
Abstract
For many years, psychiatrists have tried to understand factors involved in response to medications or psychotherapies, in order to personalize their treatment choices. There is now a broad and growing interest in the idea that we can develop models to personalize treatment decisions using new statistical approaches from the field of machine learning and applying them to larger volumes of data. In this pursuit, there has been a paradigm shift away from experimental studies to confirm or refute specific hypotheses towards a focus on the overall explanatory power of a predictive model when tested on new, unseen datasets. In this paper, we review key studies using machine learning to predict treatment outcomes in psychiatry, ranging from medications and psychotherapies to digital interventions and neurobiological treatments. Next, we focus on some new sources of data that are being used for the development of predictive models based on machine learning, such as electronic health records, smartphone and social media data, and on the potential utility of data from genetics, electrophysiology, neuroimaging and cognitive testing. Finally, we discuss how far the field has come towards implementing prediction tools in real-world clinical practice. Relatively few retrospective studies to-date include appropriate external validation procedures, and there are even fewer prospective studies testing the clinical feasibility and effectiveness of predictive models. Applications of machine learning in psychiatry face some of the same ethical challenges posed by these techniques in other areas of medicine or computer science, which we discuss here. In short, machine learning is a nascent but important approach to improve the effectiveness of mental health care, and several prospective clinical studies suggest that it may be working already.
Collapse
Affiliation(s)
- Adam M Chekroud
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
- Spring Health, New York City, NY, USA
| | | | - Jaime Delgadillo
- Clinical Psychology Unit, Department of Psychology, University of Sheffield, Sheffield, UK
| | - Gavin Doherty
- School of Computer Science and Statistics, Trinity College Dublin, Dublin, Ireland
| | - Akash Wasil
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA
| | - Marjolein Fokkema
- Department of Methods and Statistics, Institute of Psychology, Leiden University, Leiden, The Netherlands
| | - Zachary Cohen
- Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, USA
| | | | - Robert DeRubeis
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA
| | - Raquel Iniesta
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neurosciences, King's College London, London, UK
| | - Dominic Dwyer
- Department of Psychiatry and Psychotherapy, Section for Neurodiagnostic Applications, Ludwig-Maximilian University, Munich, Germany
| | - Karmel Choi
- Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
25
|
Wiese W. [From the Ethics of AI to the Ethics of Consciousness: Ethical Aspects of Computational Psychiatry]. PSYCHIATRISCHE PRAXIS 2021; 48:S21-S25. [PMID: 33652483 DOI: 10.1055/a-1369-2824] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
OBJECTIVE Identifying ethical problems arising from AI research and Computational Psychiatry for psychiatric research and practice. METHODS Conceptual analysis and discussion of ethically relevant projects within Computational Psychiatry. RESULTS Computational Psychiatry promises a contribution to improving diagnostics and therapy (prediction). Ethical problems include dealing with data protection, consequences for our self-image, as well as the risk of biologization and the neglect of conscious experience. CONCLUSION It is necessary to consider possible applications of AI and Computational Psychiatry now in order to create the conditions for responsible use in the future. This requires a basic understanding of how AI applications work and of the associated ethical problems.
Collapse
Affiliation(s)
- Wanja Wiese
- Philosophisches Seminar, Johannes Gutenberg-Universität Mainz
| |
Collapse
|
26
|
Artificial Intelligence in Schizophrenia. Artif Intell Med 2021. [DOI: 10.1007/978-3-030-58080-3_214-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
27
|
Kelly DL, Spaderna M, Hodzic V, Nair S, Kitchen C, Werkheiser AE, Powell MM, Liu F, Coppersmith G, Chen S, Resnik P. Blinded Clinical Ratings of Social Media Data are Correlated with In-Person Clinical Ratings in Participants Diagnosed with Either Depression, Schizophrenia, or Healthy Controls. Psychiatry Res 2020; 294:113496. [PMID: 33065372 DOI: 10.1016/j.psychres.2020.113496] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/13/2020] [Accepted: 10/01/2020] [Indexed: 12/16/2022]
Abstract
This study investigates clinically valid signals about psychiatric symptoms in social media data, by rating severity of psychiatric symptoms in donated, de-identified Facebook posts and comparing to in-person clinical assessments. Participants with schizophrenia (N=8), depression (N=7), or who were healthy controls (N=8) also consented to the collection of their Facebook activity from three months before the in-person assessments to six weeks after this evaluation. Depressive symptoms were assessed in- person using the Montgomery-Åsberg Depression Rating Scale (MADRS), psychotic symptoms were assessed using the Brief Psychiatric Rating Scale (BPRS), and global functioning was assessed using the Community Assessment of Psychotic Experiences (CAPE-42). Independent raters (psychiatrists, non-psychiatrist mental health clinicians, and two staff members) rated depression, psychosis, and global functioning symptoms from the social media activity of deidentified participants. The correlations between in-person clinical ratings and blinded ratings based on social media data were evaluated. Significant correlations (and trends for significance in the mixed model controlling for multiple raters) were found for psychotic symptoms, global symptom ratings and depressive symptoms. Results like these, indicating the presence of clinically valid signal in social media, are an important step toward developing computational tools that could assist clinicians by providing additional data outside the context of clinical encounters.
Collapse
Affiliation(s)
- Deanna L Kelly
- University of Maryland Baltimore, School of Medicine, Baltimore, MD, USA.
| | - Max Spaderna
- University of Maryland Baltimore, School of Medicine, Baltimore, MD, USA
| | - Vedrana Hodzic
- University of Maryland Baltimore, School of Medicine, Baltimore, MD, USA
| | - Suraj Nair
- University of Maryland College Park, Department of Computer Science and Institute for Advanced Computer Studies, College Park, MD, USA
| | - Christopher Kitchen
- Center for Population Health IT, Johns Hopkins School of Public Health, Baltimore, MD, USA
| | - Anne E Werkheiser
- University of Maryland Baltimore, School of Medicine, Baltimore, MD, USA; Department of Psychology, Georgia State University, USA
| | | | - Fang Liu
- University of Maryland Baltimore, School of Medicine, Baltimore, MD, USA
| | | | - Shuo Chen
- University of Maryland Baltimore, School of Medicine, Baltimore, MD, USA
| | - Philip Resnik
- University of Maryland College Park, Department of Linguistics and Institute for Advanced Computer Studies, College Park, MD, USA
| |
Collapse
|