1
|
Todd E, Orr R, Gamage E, West E, Jabeen T, McGuinness AJ, George V, Phuong-Nguyen K, Voglsanger LM, Jennings L, Angwenyi L, Taylor S, Khosravi A, Jacka F, Dawson SL. Lifestyle factors and other predictors of common mental disorders in diagnostic machine learning studies: A systematic review. Comput Biol Med 2025; 185:109521. [PMID: 39667056 DOI: 10.1016/j.compbiomed.2024.109521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2024] [Revised: 11/28/2024] [Accepted: 12/02/2024] [Indexed: 12/14/2024]
Abstract
BACKGROUND Machine Learning (ML) models have been used to predict common mental disorders (CMDs) and may provide insights into the key modifiable factors that can identify and predict CMD risk and be targeted through interventions. This systematic review aimed to synthesise evidence from ML studies predicting CMDs, evaluate their performance, and establish the potential benefit of incorporating lifestyle data in ML models alongside biological and/or demographic-environmental factors. METHODS This systematic review adheres to the PRISMA statement (Prospero CRD42023401194). Databases searched included MEDLINE, EMBASE, PsycInfo, IEEE Xplore, Engineering Village, Web of Science, and Scopus from database inception to 28/08/24. Included studies used ML methods with feature importance to predict CMDs in adults. Risk of bias (ROB) was assessed using PROBAST. Model performance metrics were compared. The ten most important variables reported by each study were assigned to broader categories to evaluate their frequency across studies. RESULTS 117 studies were included (111 model development-only, 16 development and validation). Deep learning methods showed best accuracy for predicting CMD cases. Studies commonly incorporated features from multiple categories (n = 56), and frequently identified demographic-environmental predictors in their top ten most important variables (63/69 models). These tended to be in combination with psycho-social and biological variables (n = 15). Lifestyle data were infrequently examined as sole predictors of CMDs across included studies (4.27 %). Studies commonly had high heterogeneity and ROB ratings. CONCLUSION This review is the first to evaluate the utility of diagnostic ML for CMDs, assess their ROB, and evaluate predictor types. CMDs were able to be predicted, however studies had high ROB and lifestyle data were underutilised, precluding full identification of a robust predictor set.
Collapse
Affiliation(s)
- Emma Todd
- Deakin University, Food & Mood Centre, Institute for Mental and Physical Health and Clinical Translation (IMPACT), Health Education and Research Building, Ryrie Street, Geelong, Victoria, Australia; Deakin University, Institute for Mental and Physical Health and Clinical Translation (IMPACT), 75 Pigdons Rd, Waurn Ponds, Victoria, Australia
| | - Rebecca Orr
- Deakin University, Food & Mood Centre, Institute for Mental and Physical Health and Clinical Translation (IMPACT), Health Education and Research Building, Ryrie Street, Geelong, Victoria, Australia; Deakin University, Institute for Mental and Physical Health and Clinical Translation (IMPACT), 75 Pigdons Rd, Waurn Ponds, Victoria, Australia
| | - Elizabeth Gamage
- Deakin University, Food & Mood Centre, Institute for Mental and Physical Health and Clinical Translation (IMPACT), Health Education and Research Building, Ryrie Street, Geelong, Victoria, Australia; Deakin University, Institute for Mental and Physical Health and Clinical Translation (IMPACT), 75 Pigdons Rd, Waurn Ponds, Victoria, Australia
| | - Emma West
- Deakin University, Institute for Mental and Physical Health and Clinical Translation (IMPACT), 75 Pigdons Rd, Waurn Ponds, Victoria, Australia
| | - Tabinda Jabeen
- Deakin University, Food & Mood Centre, Institute for Mental and Physical Health and Clinical Translation (IMPACT), Health Education and Research Building, Ryrie Street, Geelong, Victoria, Australia; Deakin University, Institute for Mental and Physical Health and Clinical Translation (IMPACT), 75 Pigdons Rd, Waurn Ponds, Victoria, Australia
| | - Amelia J McGuinness
- Deakin University, Food & Mood Centre, Institute for Mental and Physical Health and Clinical Translation (IMPACT), Health Education and Research Building, Ryrie Street, Geelong, Victoria, Australia; Deakin University, Institute for Mental and Physical Health and Clinical Translation (IMPACT), 75 Pigdons Rd, Waurn Ponds, Victoria, Australia
| | - Victoria George
- Deakin University, Institute for Mental and Physical Health and Clinical Translation (IMPACT), 75 Pigdons Rd, Waurn Ponds, Victoria, Australia; University of Copenhagen, Novo Nordisk Foundation, Centre for Basic Metabolic Research, Blegdamsvej 3A, 2200, København, Denmark
| | - Kate Phuong-Nguyen
- Deakin University, Institute for Mental and Physical Health and Clinical Translation (IMPACT), 75 Pigdons Rd, Waurn Ponds, Victoria, Australia
| | - Lara M Voglsanger
- Deakin University, Institute for Mental and Physical Health and Clinical Translation (IMPACT), 75 Pigdons Rd, Waurn Ponds, Victoria, Australia
| | - Laura Jennings
- Deakin University, Food & Mood Centre, Institute for Mental and Physical Health and Clinical Translation (IMPACT), Health Education and Research Building, Ryrie Street, Geelong, Victoria, Australia; Deakin University, Institute for Mental and Physical Health and Clinical Translation (IMPACT), 75 Pigdons Rd, Waurn Ponds, Victoria, Australia
| | - Lisa Angwenyi
- Deakin University, Institute for Mental and Physical Health and Clinical Translation (IMPACT), 75 Pigdons Rd, Waurn Ponds, Victoria, Australia
| | - Sabine Taylor
- Macquarie University, Balaclava Rd, Macquarie Park, Sydney, NSW, Australia
| | - Abbas Khosravi
- Deakin University, Institute for Intelligent Systems Research and Innovation, 75 Pigdons Rd, Waurn Ponds, Australia
| | - Felice Jacka
- Deakin University, Food & Mood Centre, Institute for Mental and Physical Health and Clinical Translation (IMPACT), Health Education and Research Building, Ryrie Street, Geelong, Victoria, Australia; Deakin University, Institute for Mental and Physical Health and Clinical Translation (IMPACT), 75 Pigdons Rd, Waurn Ponds, Victoria, Australia
| | - Samantha L Dawson
- Deakin University, Food & Mood Centre, Institute for Mental and Physical Health and Clinical Translation (IMPACT), Health Education and Research Building, Ryrie Street, Geelong, Victoria, Australia; Deakin University, Institute for Mental and Physical Health and Clinical Translation (IMPACT), 75 Pigdons Rd, Waurn Ponds, Victoria, Australia.
| |
Collapse
|
3
|
Stolicyn A, Harris MA, Shen X, Barbu MC, Adams MJ, Hawkins EL, de Nooij L, Yeung HW, Murray AD, Lawrie SM, Steele JD, McIntosh AM, Whalley HC. Automated classification of depression from structural brain measures across two independent community-based cohorts. Hum Brain Mapp 2020; 41:3922-3937. [PMID: 32558996 PMCID: PMC7469862 DOI: 10.1002/hbm.25095] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2019] [Revised: 05/16/2020] [Accepted: 05/25/2020] [Indexed: 12/30/2022] Open
Abstract
Major depressive disorder (MDD) has been the subject of many neuroimaging case-control classification studies. Although some studies report accuracies ≥80%, most have investigated relatively small samples of clinically-ascertained, currently symptomatic cases, and did not attempt replication in larger samples. We here first aimed to replicate previously reported classification accuracies in a small, well-phenotyped community-based group of current MDD cases with clinical interview-based diagnoses (from STratifying Resilience and Depression Longitudinally cohort, 'STRADL'). We performed a set of exploratory predictive classification analyses with measures related to brain morphometry and white matter integrity. We applied three classifier types-SVM, penalised logistic regression or decision tree-either with or without optimisation, and with or without feature selection. We then determined whether similar accuracies could be replicated in a larger independent population-based sample with self-reported current depression (UK Biobank cohort). Additional analyses extended to lifetime MDD diagnoses-remitted MDD in STRADL, and lifetime-experienced MDD in UK Biobank. The highest cross-validation accuracy (75%) was achieved in the initial current MDD sample with a decision tree classifier and cortical surface area features. The most frequently selected decision tree split variables included surface areas of bilateral caudal anterior cingulate, left lingual gyrus, left superior frontal, right precentral and paracentral regions. High accuracy was not achieved in the larger samples with self-reported current depression (53.73%), with remitted MDD (57.48%), or with lifetime-experienced MDD (52.68-60.29%). Our results indicate that high predictive classification accuracies may not immediately translate to larger samples with broader criteria for depression, and may not be robust across different classification approaches.
Collapse
Affiliation(s)
- Aleks Stolicyn
- Division of Psychiatry, University of EdinburghKennedy Tower, Royal Edinburgh Hospital, Morningside ParkEdinburghUK
| | - Mathew A. Harris
- Division of Psychiatry, University of EdinburghKennedy Tower, Royal Edinburgh Hospital, Morningside ParkEdinburghUK
| | - Xueyi Shen
- Division of Psychiatry, University of EdinburghKennedy Tower, Royal Edinburgh Hospital, Morningside ParkEdinburghUK
| | - Miruna C. Barbu
- Division of Psychiatry, University of EdinburghKennedy Tower, Royal Edinburgh Hospital, Morningside ParkEdinburghUK
| | - Mark J. Adams
- Division of Psychiatry, University of EdinburghKennedy Tower, Royal Edinburgh Hospital, Morningside ParkEdinburghUK
| | - Emma L. Hawkins
- Division of Psychiatry, University of EdinburghKennedy Tower, Royal Edinburgh Hospital, Morningside ParkEdinburghUK
| | - Laura de Nooij
- Division of Psychiatry, University of EdinburghKennedy Tower, Royal Edinburgh Hospital, Morningside ParkEdinburghUK
| | - Hon Wah Yeung
- Division of Psychiatry, University of EdinburghKennedy Tower, Royal Edinburgh Hospital, Morningside ParkEdinburghUK
| | - Alison D. Murray
- Aberdeen Biomedical Imaging CentreUniversity of AberdeenLilian Sutton Building, ForesterhillAberdeenUK
| | - Stephen M. Lawrie
- Division of Psychiatry, University of EdinburghKennedy Tower, Royal Edinburgh Hospital, Morningside ParkEdinburghUK
| | - J. Douglas Steele
- School of Medicine (Division of Imaging Science and Technology)University of DundeeDundeeUK
| | - Andrew M. McIntosh
- Division of Psychiatry, University of EdinburghKennedy Tower, Royal Edinburgh Hospital, Morningside ParkEdinburghUK
| | - Heather C. Whalley
- Division of Psychiatry, University of EdinburghKennedy Tower, Royal Edinburgh Hospital, Morningside ParkEdinburghUK
| |
Collapse
|
4
|
Sun B, Zhang Y, He J, Xiao Y, Xiao R. An automatic diagnostic network using skew-robust adversarial discriminative domain adaptation to evaluate the severity of depression. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 173:185-195. [PMID: 30683543 DOI: 10.1016/j.cmpb.2019.01.006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2018] [Revised: 11/01/2018] [Accepted: 01/15/2019] [Indexed: 06/09/2023]
Abstract
BACKGROUND AND OBJECTIVE Deep learning provides an automatic and robust solution to depression severity evaluation. However, despite it is powerful, there is a trade-off between robust performance and the cost of manual annotation. METHODS Motivated by knowledge evolution and domain adaptation, we propose a deep evaluation network using skew-robust adversarial discriminative domain adaptation (SRADDA), which adaptively shifts its domain from a large-scale Twitter dataset to a small-scale depression interview dataset for evaluating the severity of depression. RESULTS Without top-down selection, SRADDA-based severity evaluation network achieves regression errors of 6.38 (Root Mean Square Error,RMSE) and 4.93 (Mean Absolute Error,MAE), which outperforms baselines provided by the Audio/Visual Emotion Challenge and Workshop(AVEC 2017). However, with top-down selection, the network achieves comparable results (RMSE = 5.13, MAE = 4.08). CONCLUSIONS Results show that SRADDA not only represents features robustly, but also performs comparably to state-of-the-art results on small-scale dataset, DAIC-WOZ.
Collapse
Affiliation(s)
- Bo Sun
- The Intelligent Computing and Software Research Center, Information Science and Technology College, Beijing Normal University, 19 xinjiekou street, Beijing 100875, China
| | - Yinghui Zhang
- The Intelligent Computing and Software Research Center, Information Science and Technology College, Beijing Normal University, 19 xinjiekou street, Beijing 100875, China; Smart financial research and development center, Hebei Finance University, China
| | - Jun He
- The Intelligent Computing and Software Research Center, Information Science and Technology College, Beijing Normal University, 19 xinjiekou street, Beijing 100875, China.
| | - Yongkang Xiao
- The Intelligent Computing and Software Research Center, Information Science and Technology College, Beijing Normal University, 19 xinjiekou street, Beijing 100875, China
| | - Rong Xiao
- The Intelligent Computing and Software Research Center, Information Science and Technology College, Beijing Normal University, 19 xinjiekou street, Beijing 100875, China
| |
Collapse
|
6
|
Kambeitz J, Cabral C, Sacchet MD, Gotlib IH, Zahn R, Serpa MH, Walter M, Falkai P, Koutsouleris N. Detecting Neuroimaging Biomarkers for Depression: A Meta-analysis of Multivariate Pattern Recognition Studies. Biol Psychiatry 2017; 82:330-338. [PMID: 28110823 PMCID: PMC11927514 DOI: 10.1016/j.biopsych.2016.10.028] [Citation(s) in RCA: 95] [Impact Index Per Article: 11.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/01/2016] [Revised: 09/27/2016] [Accepted: 10/20/2016] [Indexed: 12/24/2022]
Abstract
BACKGROUND Multiple studies have examined functional and structural brain alteration in patients diagnosed with major depressive disorder (MDD). The introduction of multivariate statistical methods allows investigators to utilize data concerning these brain alterations to generate diagnostic models that accurately differentiate patients with MDD from healthy control subjects (HCs). However, there is substantial heterogeneity in the reported results, the methodological approaches, and the clinical characteristics of participants in these studies. METHODS We conducted a meta-analysis of all studies using neuroimaging (volumetric measures derived from T1-weighted images, task-based functional magnetic resonance imaging [MRI], resting-state MRI, or diffusion tensor imaging) in combination with multivariate statistical methods to differentiate patients diagnosed with MDD from HCs. RESULTS Thirty-three (k = 33) samples including 912 patients with MDD and 894 HCs were included in the meta-analysis. Across all studies, patients with MDD were separated from HCs with 77% sensitivity and 78% specificity. Classification based on resting-state MRI (85% sensitivity, 83% specificity) and on diffusion tensor imaging data (88% sensitivity, 92% specificity) outperformed classifications based on structural MRI (70% sensitivity, 71% specificity) and task-based functional MRI (74% sensitivity, 77% specificity). CONCLUSIONS Our results demonstrate the high representational capacity of multivariate statistical methods to identify neuroimaging-based biomarkers of depression. Future studies are needed to elucidate whether multivariate neuroimaging analysis has the potential to generate clinically useful tools for the differential diagnosis of affective disorders and the prediction of both treatment response and functional outcome.
Collapse
Affiliation(s)
- Joseph Kambeitz
- Department of Psychiatry, Ludwig-Maximilians University Munich, Munich.
| | - Carlos Cabral
- Department of Psychiatry, Ludwig-Maximilians University Munich, Munich
| | - Matthew D Sacchet
- Neurosciences Program and Department of Psychology, Stanford University, Stanford, California
| | - Ian H Gotlib
- Neurosciences Program and Department of Psychology, Stanford University, Stanford, California
| | - Roland Zahn
- Institute of Psychiatry, King's College London, London, United Kingdom
| | - Mauricio H Serpa
- Laboratory of Psychiatric Neuroimaging, Institute and Department of Psychiatry, Sao Paulo, Brazil; Center for Interdisciplinary Research on Applied Neurosciences (NAPNA), University of Sao Paulo, Sao Paulo, Brazil
| | - Martin Walter
- Clinical Affective Neuroimaging Laboratory, Department of Behavioural Neurology, Leibniz Institute for Neurobiology, Magdeburg; Department of Psychiatry and Psychotherapy, Eberhard Karls University, Tubingen, Germany
| | - Peter Falkai
- Department of Psychiatry, Ludwig-Maximilians University Munich, Munich
| | | |
Collapse
|