1
|
O'Connell S, Cannon DM, Broin PÓ. Predictive modelling of brain disorders with magnetic resonance imaging: A systematic review of modelling practices, transparency, and interpretability in the use of convolutional neural networks. Hum Brain Mapp 2023; 44:6561-6574. [PMID: 37909364 PMCID: PMC10681646 DOI: 10.1002/hbm.26521] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Revised: 09/28/2023] [Accepted: 10/10/2023] [Indexed: 11/03/2023] Open
Abstract
Brain disorders comprise several psychiatric and neurological disorders which can be characterized by impaired cognition, mood alteration, psychosis, depressive episodes, and neurodegeneration. Clinical diagnoses primarily rely on a combination of life history information and questionnaires, with a distinct lack of discriminative biomarkers in use for psychiatric disorders. Symptoms across brain conditions are associated with functional alterations of cognitive and emotional processes, which can correlate with anatomical variation; structural magnetic resonance imaging (MRI) data of the brain are therefore an important focus of research, particularly for predictive modelling. With the advent of large MRI data consortia (such as the Alzheimer's Disease Neuroimaging Initiative) facilitating a greater number of MRI-based classification studies, convolutional neural networks (CNNs)-deep learning models well suited to image processing tasks-have become increasingly popular for research into brain conditions. This has resulted in a myriad of studies reporting impressive predictive performances, demonstrating the potential clinical value of deep learning systems. However, methodologies can vary widely across studies, making them difficult to compare and/or reproduce, potentially limiting their clinical application. Here, we conduct a qualitative systematic literature review of 55 studies carrying out CNN-based predictive modelling of brain disorders using MRI data and evaluate them based on three principles-modelling practices, transparency, and interpretability. We propose several recommendations to enhance the potential for the integration of CNNs into clinical care.
Collapse
Affiliation(s)
- Shane O'Connell
- School of Mathematical and Statistical Sciences, College of Science and EngineeringUniversity of GalwayGalwayIreland
| | - Dara M. Cannon
- Clinical Neuroimaging Laboratory, Galway Neuroscience Centre, College of MedicineNursing and Health SciencesUniversity of GalwayGalwayIreland
| | - Pilib Ó. Broin
- School of Mathematical and Statistical Sciences, College of Science and EngineeringUniversity of GalwayGalwayIreland
| |
Collapse
|
2
|
de Lacy N, Ramshaw MJ, McCauley E, Kerr KF, Kaufman J, Nathan Kutz J. Predicting individual cases of major adolescent psychiatric conditions with artificial intelligence. Transl Psychiatry 2023; 13:314. [PMID: 37816706 PMCID: PMC10564881 DOI: 10.1038/s41398-023-02599-9] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 09/10/2023] [Accepted: 09/20/2023] [Indexed: 10/12/2023] Open
Abstract
Three-quarters of lifetime mental illness occurs by the age of 24, but relatively little is known about how to robustly identify youth at risk to target intervention efforts known to improve outcomes. Barriers to knowledge have included obtaining robust predictions while simultaneously analyzing large numbers of different types of candidate predictors. In a new, large, transdiagnostic youth sample and multidomain high-dimension data, we used 160 candidate predictors encompassing neural, prenatal, developmental, physiologic, sociocultural, environmental, emotional and cognitive features and leveraged three different machine learning algorithms optimized with a novel artificial intelligence meta-learning technique to predict individual cases of anxiety, depression, attention deficit, disruptive behaviors and post-traumatic stress. Our models tested well in unseen, held-out data (AUC ≥ 0.94). By utilizing a large-scale design and advanced computational approaches, we were able to compare the relative predictive ability of neural versus psychosocial features in a principled manner and found that psychosocial features consistently outperformed neural metrics in their relative ability to deliver robust predictions of individual cases. We found that deep learning with artificial neural networks and tree-based learning with XGBoost outperformed logistic regression with ElasticNet, supporting the conceptualization of mental illnesses as multifactorial disease processes with non-linear relationships among predictors that can be robustly modeled with computational psychiatry techniques. To our knowledge, this is the first study to test the relative predictive ability of these gold-standard algorithms from different classes across multiple mental health conditions in youth within the same study design in multidomain data utilizing >100 candidate predictors. Further research is suggested to explore these findings in longitudinal data and validate results in an external dataset.
Collapse
Affiliation(s)
- Nina de Lacy
- Huntsman Mental Health Institute, Salt Lake City, UT, 84103, USA.
- Department of Psychiatry, University of Utah, Salt Lake City, UT, 84103, USA.
| | - Michael J Ramshaw
- Huntsman Mental Health Institute, Salt Lake City, UT, 84103, USA
- Department of Psychiatry, University of Utah, Salt Lake City, UT, 84103, USA
| | - Elizabeth McCauley
- Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, USA
| | - Kathleen F Kerr
- Department of Biostatistics, University of Washington, Seattle, WA, USA
| | | | - J Nathan Kutz
- Department of Applied Mathematics, University of Washington, Seattle, WA, USA
- AI Institute for Dynamical Systems, Seattle, WA, USA
| |
Collapse
|
3
|
Chan L, Simmons C, Tillem S, Conley M, Brazil IA, Baskin-Sommers A. Classifying Conduct Disorder Using a Biopsychosocial Model and Machine Learning Method. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2023; 8:599-608. [PMID: 35217219 PMCID: PMC9393206 DOI: 10.1016/j.bpsc.2022.02.004] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/18/2021] [Revised: 01/10/2022] [Accepted: 02/08/2022] [Indexed: 05/11/2023]
Abstract
BACKGROUND Conduct disorder (CD) is a common syndrome with far-reaching effects. Risk factors for the development of CD span social, psychological, and biological domains. Researchers note that predictive models of CD are limited if the focus is on a single risk factor or even a single domain. Machine learning methods are optimized for the extraction of trends across multidomain data but have yet to be implemented in predicting the development of CD. METHODS Social (e.g., family, income), psychological (e.g., psychiatric, neuropsychological), and biological (e.g., resting-state graph metrics) risk factors were measured using data from the baseline visit of the Adolescent Brain Cognitive Development Study when youth were 9 to 10 years old (N = 2368). Applying a feed-forward neural network machine learning method, risk factors were used to predict CD diagnoses 2 years later. RESULTS A model with factors that included social, psychological, and biological domains outperformed models representing factors within any single domain, predicting the presence of a CD diagnosis with 91.18% accuracy. Within each domain, certain factors stood out in terms of their relationship to CD (social: lower parental monitoring, more aggression in the household, lower income; psychological: greater attention-deficit/hyperactivity disorder and oppositional defiant disorder symptoms, worse crystallized cognition and card sorting performance; biological: disruptions in the topology of subcortical and frontoparietal networks). CONCLUSIONS The development of an accurate, sensitive, and specific predictive model of CD has the potential to aid in prevention and intervention efforts. Key risk factors for CD appear best characterized as reflecting unpredictable, impulsive, deprived, and emotional external and internal contexts.
Collapse
Affiliation(s)
- Lena Chan
- Department of Psychology, Yale University, New Haven, Connecticut
| | - Cortney Simmons
- Department of Psychology, Yale University, New Haven, Connecticut
| | - Scott Tillem
- Department of Psychology, University of Michigan Ann Arbor, Ann Arbor, Michigan
| | - May Conley
- Department of Psychology, Yale University, New Haven, Connecticut
| | - Inti A Brazil
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands; Forensic Psychiatric Centre Pompestichting, Nijmegen, the Netherlands
| | | |
Collapse
|
4
|
Hu M, Nardi C, Zhang H, Ang KK. Applications of Deep Learning to Neurodevelopment in Pediatric Imaging: Achievements and Challenges. APPLIED SCIENCES 2023; 13:2302. [DOI: 10.3390/app13042302] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2025]
Abstract
Deep learning has achieved remarkable progress, particularly in neuroimaging analysis. Deep learning applications have also been extended from adult to pediatric medical images, and thus, this paper aims to present a systematic review of this recent research. We first introduce the commonly used deep learning methods and architectures in neuroimaging, such as convolutional neural networks, auto-encoders, and generative adversarial networks. A non-exhaustive list of commonly used publicly available pediatric neuroimaging datasets and repositories are included, followed by a categorical review of recent works in pediatric MRI-based deep learning studies in the past five years. These works are categorized into recognizing neurodevelopmental disorders, identifying brain and tissue structures, estimating brain age/maturity, predicting neurodevelopment outcomes, and optimizing MRI brain imaging and analysis. Finally, we also discuss the recent achievements and challenges on these applications of deep learning to pediatric neuroimaging.
Collapse
Affiliation(s)
- Mengjiao Hu
- Institute for Infocomm Research (I2R), Agency for Science, Technology and Research (A*STAR), Singapore 138632, Singapore
| | - Cosimo Nardi
- Department of Experimental and Clinical Biomedical Sciences, University of Florence—Azienda Ospedaliero-Universitaria Careggi, 50134 Florence, Italy
| | - Haihong Zhang
- Institute for Infocomm Research (I2R), Agency for Science, Technology and Research (A*STAR), Singapore 138632, Singapore
| | - Kai-Keng Ang
- Institute for Infocomm Research (I2R), Agency for Science, Technology and Research (A*STAR), Singapore 138632, Singapore
- School of Computer Science and Engineering, Nanyang Technological University, Singapore 639798, Singapore
| |
Collapse
|
5
|
The computational psychiatry of antisocial behaviour and psychopathy. Neurosci Biobehav Rev 2023; 145:104995. [PMID: 36535376 DOI: 10.1016/j.neubiorev.2022.104995] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2022] [Revised: 11/21/2022] [Accepted: 12/07/2022] [Indexed: 12/23/2022]
Abstract
Antisocial behaviours such as disobedience, lying, stealing, destruction of property, and aggression towards others are common to multiple disorders of childhood and adulthood, including conduct disorder, oppositional defiant disorder, psychopathy, and antisocial personality disorder. These disorders have a significant negative impact for individuals and for society, but whether they represent clinically different phenomena, or simply different approaches to diagnosing the same underlying psychopathology is highly debated. Computational psychiatry, with its dual focus on identifying different classes of disorder and health (data-driven) and latent cognitive and neurobiological mechanisms (theory-driven), is well placed to address these questions. The elucidation of mechanisms that might characterise latent processes across different disorders of antisocial behaviour can also provide important advances. In this review, we critically discuss the contribution of computational research to our understanding of various antisocial behaviour disorders, and highlight suggestions for how computational psychiatry can address important clinical and scientific questions about these disorders in the future.
Collapse
|
6
|
Tongue size and shape classification fusing segmentation features for traditional Chinese medicine diagnosis. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-08054-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
7
|
Chen ZS, Kulkarni P(P, Galatzer-Levy IR, Bigio B, Nasca C, Zhang Y. Modern views of machine learning for precision psychiatry. PATTERNS (NEW YORK, N.Y.) 2022; 3:100602. [PMID: 36419447 PMCID: PMC9676543 DOI: 10.1016/j.patter.2022.100602] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
In light of the National Institute of Mental Health (NIMH)'s Research Domain Criteria (RDoC), the advent of functional neuroimaging, novel technologies and methods provide new opportunities to develop precise and personalized prognosis and diagnosis of mental disorders. Machine learning (ML) and artificial intelligence (AI) technologies are playing an increasingly critical role in the new era of precision psychiatry. Combining ML/AI with neuromodulation technologies can potentially provide explainable solutions in clinical practice and effective therapeutic treatment. Advanced wearable and mobile technologies also call for the new role of ML/AI for digital phenotyping in mobile mental health. In this review, we provide a comprehensive review of ML methodologies and applications by combining neuroimaging, neuromodulation, and advanced mobile technologies in psychiatry practice. We further review the role of ML in molecular phenotyping and cross-species biomarker identification in precision psychiatry. We also discuss explainable AI (XAI) and neuromodulation in a closed human-in-the-loop manner and highlight the ML potential in multi-media information extraction and multi-modal data fusion. Finally, we discuss conceptual and practical challenges in precision psychiatry and highlight ML opportunities in future research.
Collapse
Affiliation(s)
- Zhe Sage Chen
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
- Department of Neuroscience and Physiology, New York University Grossman School of Medicine, New York, NY 10016, USA
- The Neuroscience Institute, New York University Grossman School of Medicine, New York, NY 10016, USA
- Department of Biomedical Engineering, New York University Tandon School of Engineering, Brooklyn, NY 11201, USA
| | | | - Isaac R. Galatzer-Levy
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
- Meta Reality Lab, New York, NY, USA
| | - Benedetta Bigio
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Carla Nasca
- Department of Psychiatry, New York University Grossman School of Medicine, New York, NY 10016, USA
- The Neuroscience Institute, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Yu Zhang
- Department of Bioengineering, Lehigh University, Bethlehem, PA 18015, USA
- Department of Electrical and Computer Engineering, Lehigh University, Bethlehem, PA 18015, USA
| |
Collapse
|
8
|
Shi D, Zhang H, Wang S, Wang G, Ren K. Application of Functional Magnetic Resonance Imaging in the Diagnosis of Parkinson's Disease: A Histogram Analysis. Front Aging Neurosci 2021; 13:624731. [PMID: 34045953 PMCID: PMC8144304 DOI: 10.3389/fnagi.2021.624731] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2020] [Accepted: 03/22/2021] [Indexed: 01/08/2023] Open
Abstract
This study aimed to investigate the value of amplitude of low-frequency fluctuation (ALFF)-based histogram analysis in the diagnosis of Parkinson's disease (PD) and to investigate the regions of the most important discriminative features and their contribution to classification discrimination. Patients with PD (n = 59) and healthy controls (HCs; n = 41) were identified and divided into a primary set (80 cases, including 48 patients with PD and 32 HCs) and a validation set (20 cases, including 11 patients with PD and nine HCs). The Automated Anatomical Labeling (AAL) 116 atlas was used to extract the histogram features of the regions of interest in the brain. Machine learning methods were used in the primary set for data dimensionality reduction, feature selection, model construction, and model performance evaluation. The model performance was further validated in the validation set. After feature data dimension reduction and feature selection, 23 of a total of 1,276 features were entered in the model. The brain regions of the selected features included the frontal, temporal, parietal, occipital, and limbic lobes, as well as the cerebellum and the thalamus. In the primary set, the area under the curve (AUC) of the model was 0.974, the sensitivity was 93.8%, the specificity was 90.6%, and the accuracy was 93.8%. In the validation set, the AUC, sensitivity, specificity, and accuracy were 0.980, 90.9%, 88.9%, and 90.0%, respectively. ALFF-based histogram analysis can be used to classify patients with PD and HCs and to effectively identify abnormal brain function regions in PD patients.
Collapse
Affiliation(s)
| | | | | | | | - Ke Ren
- Department of Radiology, Xiang’an Hospital of Xia Men University, Xiamen, China
| |
Collapse
|
9
|
Detection of Negative Stress through Spectral Features of Electroencephalographic Recordings and a Convolutional Neural Network. SENSORS 2021; 21:s21093050. [PMID: 33925583 PMCID: PMC8123772 DOI: 10.3390/s21093050] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Revised: 04/23/2021] [Accepted: 04/25/2021] [Indexed: 12/20/2022]
Abstract
In recent years, electroencephalographic (EEG) signals have been intensively used in the area of emotion recognition, partcularly in distress identification due to its negative impact on physical and mental health. Traditionally, brain activity has been studied from a frequency perspective by computing the power spectral density of the EEG recordings and extracting features from different frequency sub-bands. However, these features are often individually extracted from single EEG channels, such that each brain region is separately evaluated, even when it has been corroborated that mental processes are based on the coordination of different brain areas working simultaneously. To take advantage of the brain’s behaviour as a synchronized network, in the present work, 2-D and 3-D spectral images constructed from common 32 channel EEG signals are evaluated for the first time to discern between emotional states of calm and distress using a well-known deep-learning algorithm, such as AlexNet. The obtained results revealed a significant improvement in the classification performance regarding previous works, reaching an accuracy about 84%. Moreover, no significant differences between the results provided by the diverse approaches considered to reconstruct 2-D and 3-D spectral maps from the original location of the EEG channels over the scalp were noticed, thus suggesting that these kinds of images preserve original spatial brain information.
Collapse
|
10
|
Quaak M, van de Mortel L, Thomas RM, van Wingen G. Deep learning applications for the classification of psychiatric disorders using neuroimaging data: Systematic review and meta-analysis. Neuroimage Clin 2021; 30:102584. [PMID: 33677240 PMCID: PMC8209481 DOI: 10.1016/j.nicl.2021.102584] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2020] [Revised: 01/18/2021] [Accepted: 01/29/2021] [Indexed: 12/20/2022]
Abstract
Deep learning (DL) methods have been increasingly applied to neuroimaging data to identify patients with psychiatric and neurological disorders. This review provides an overview of the different DL applications within psychiatry and compares DL model accuracy to standard machine learning (SML). Fifty-three articles were included for qualitative analysis, primarily investigating autism spectrum disorder (ASD; n = 22), schizophrenia (SZ; n = 22) and attention-deficit/hyperactivity disorder (ADHD; n = 9). Thirty-two of the thirty-five studies that directly compared DL to SML reported a higher accuracy for DL. Only sixteen studies could be included in a meta-regression to quantitatively compare DL and SML performance. This showed a higher odds ratio for DL models, though the comparison attained significance only for ASD. Our results suggest that deep learning of neuroimaging data is a promising tool for the classification of individual psychiatric patients. However, it is not yet used to its full potential: most studies use pre-engineered features, whereas one of the main advantages of DL is its ability to learn representations of minimally processed data. Our current evaluation is limited by minimal reporting of performance measures to enable quantitative comparisons, and the restriction to ADHD, SZ and ASD as current research focusses on large publicly available datasets. To truly uncover the added value of DL, we need carefully designed comparisons of SML and DL models which are yet rarely performed.
Collapse
Affiliation(s)
- Mirjam Quaak
- Amsterdam UMC, University of Amsterdam, Department of Psychiatry, Meibergdreef 5, 1105 AZ Amsterdam, The Netherlands
| | - Laurens van de Mortel
- Amsterdam UMC, University of Amsterdam, Department of Psychiatry, Meibergdreef 5, 1105 AZ Amsterdam, The Netherlands
| | - Rajat Mani Thomas
- Amsterdam UMC, University of Amsterdam, Department of Psychiatry, Meibergdreef 5, 1105 AZ Amsterdam, The Netherlands
| | - Guido van Wingen
- Amsterdam UMC, University of Amsterdam, Department of Psychiatry, Meibergdreef 5, 1105 AZ Amsterdam, The Netherlands.
| |
Collapse
|
11
|
Quon JL, Jin MC, Seekins J, Yeom KW. Harnessing the potential of artificial neural networks for pediatric patient management. Artif Intell Med 2021. [DOI: 10.1016/b978-0-12-821259-2.00021-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
12
|
Burgos N, Bottani S, Faouzi J, Thibeau-Sutre E, Colliot O. Deep learning for brain disorders: from data processing to disease treatment. Brief Bioinform 2020; 22:1560-1576. [PMID: 33316030 DOI: 10.1093/bib/bbaa310] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2020] [Revised: 10/09/2020] [Accepted: 10/13/2020] [Indexed: 12/19/2022] Open
Abstract
In order to reach precision medicine and improve patients' quality of life, machine learning is increasingly used in medicine. Brain disorders are often complex and heterogeneous, and several modalities such as demographic, clinical, imaging, genetics and environmental data have been studied to improve their understanding. Deep learning, a subpart of machine learning, provides complex algorithms that can learn from such various data. It has become state of the art in numerous fields, including computer vision and natural language processing, and is also growingly applied in medicine. In this article, we review the use of deep learning for brain disorders. More specifically, we identify the main applications, the concerned disorders and the types of architectures and data used. Finally, we provide guidelines to bridge the gap between research studies and clinical routine.
Collapse
|