1
|
Braggio D, Külsgaard HC, Vallejo-Azar M, Bendersky M, González P, Alba-Ferrara L, Orlando JI, Larrabide I. A Self-supervised Deep Learning Model for Diagonal Sulcus Detection with Limited Labeled Data. Neuroinformatics 2025; 23:13. [PMID: 39777603 DOI: 10.1007/s12021-024-09700-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/24/2024] [Indexed: 01/11/2025]
Abstract
Sulci are a fundamental part of brain morphology, closely linked to brain function, cognition, and behavior. Tertiary sulci, characterized as the shallowest and smallest subtype, pose a challenging task for detection. The diagonal sulcus (ds), located in a crucial area in language processing, has a prevalence between 50% and 60%. Automatic detection of the ds is an unexplored field: while some sulci segmenters include the ds, their accuracy is usually low. In this work, we present a deep learning based model for ds detection using a fine-tuning approach with limited training labeled data. A convolutional autoencoder was employed to learn specific features related to brain morphology with unlabeled data through self-supervised learning. Subsequently, the pre-trained network was fine-tuned to detect the ds using a less extensive labeled dataset. We achieved a mean F1-score of 0.7176 (SD=0.0736) for the test set and a F1-score of 0.72 for a second held-out set, surpassing the results of a standard software and other alternative deep learning models. We conducted an interpretability analysis of the results using occlusion maps and observed that the models focused on adjacent sulci to the ds for prediction, consistent with the approach taken by experts in manual annotation. We also analyzed the challenges of manual labeling by conducting a thorough examination of interrater agreement on a small dataset and its relationship with our model's performance. Finally, we applied our method on a population analysis and reported the prevalence of ds in a case study.
Collapse
Affiliation(s)
- Delfina Braggio
- Consejo Nacional de Investigaciones Científicas y Técnicas, CONICET, Buenos Aires, Argentina.
- Yatiris, PLADEMA, Facultad de Ciencias Exactas, UNICEN, Tandil, Buenos Aires, Argentina.
| | - Hernán C Külsgaard
- Consejo Nacional de Investigaciones Científicas y Técnicas, CONICET, Buenos Aires, Argentina
- Yatiris, PLADEMA, Facultad de Ciencias Exactas, UNICEN, Tandil, Buenos Aires, Argentina
| | - Mariana Vallejo-Azar
- Consejo Nacional de Investigaciones Científicas y Técnicas, CONICET, Buenos Aires, Argentina
- Unidad Ejecutora de Estudios en Neurociencias y Sistemas Complejos, CONICET, UNAJ, Hospital El Cruce, Florencio Varela, Argentina
| | - Mariana Bendersky
- Laboratorio de Anatomía Viviente, Facultad de Medicina, Universidad de Buenos Aires, Ciudad Autónoma de Buenos Aires, Buenos Aires, Argentina
| | - Paula González
- Consejo Nacional de Investigaciones Científicas y Técnicas, CONICET, Buenos Aires, Argentina
- Unidad Ejecutora de Estudios en Neurociencias y Sistemas Complejos, CONICET, UNAJ, Hospital El Cruce, Florencio Varela, Argentina
| | - Lucía Alba-Ferrara
- Unidad Ejecutora de Estudios en Neurociencias y Sistemas Complejos, CONICET, UNAJ, Hospital El Cruce, Florencio Varela, Argentina
- Facultad de Ciencias Biomédicas, Universidad Austral, Ciudad Autónoma de Buenos Aires, Buenos Aires, Argentina
| | - José Ignacio Orlando
- Consejo Nacional de Investigaciones Científicas y Técnicas, CONICET, Buenos Aires, Argentina
- Yatiris, PLADEMA, Facultad de Ciencias Exactas, UNICEN, Tandil, Buenos Aires, Argentina
| | - Ignacio Larrabide
- Consejo Nacional de Investigaciones Científicas y Técnicas, CONICET, Buenos Aires, Argentina
- Yatiris, PLADEMA, Facultad de Ciencias Exactas, UNICEN, Tandil, Buenos Aires, Argentina
| |
Collapse
|
2
|
Hastings Iii WL, Willbrand EH, Kelly JP, Washington ST, Tameilau P, Sathishkumar RN, Maboudian SA, Parker BJ, Elliott MV, Johnson SL, Weiner KS. Emotion-related impulsivity is related to orbitofrontal cortical sulcation. Cortex 2024; 181:140-154. [PMID: 39541920 PMCID: PMC11681932 DOI: 10.1016/j.cortex.2024.08.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2024] [Revised: 03/04/2024] [Accepted: 08/22/2024] [Indexed: 11/17/2024]
Abstract
BACKGROUND Emotion-related impulsivity (ERI) describes the trait-like tendency toward poor self-control when experiencing strong emotions. ERI has been shown to be elevated across psychiatric disorders and predictive of the onset and worsening of psychiatric syndromes. Recent work has correlated ERI scores with the region-level neuroanatomical properties of the orbitofrontal cortex (OFC), but not posteromedial cortex (PMC). Informed by a growing body of research indicating that examining the morphology of specific cortical folds (sulci) can produce unique insights into behavioral outcomes, the present study modeled the association between ERI and the morphology of sulci within OFC and PMC, which is a finer scale than previously conducted. METHODS Analyses were conducted in a transdiagnostic sample of 118 adult individuals with a broad range of psychiatric syndromes. First, we manually defined over 4,000 sulci across 236 cerebral hemispheres. Second, we implemented a model-based LASSO regression to relate OFC sulcal morphology to ERI. Third, we tested whether effects were specific to OFC sulci, sulcal depth, and ERI (as compared to PMC sulci, sulcal gray matter thickness, and non-emotion-related impulsivity). RESULTS The LASSO regression revealed bilateral associations of ERI with the depths of eight OFC sulci. These effects were strongest for OFC sulci, sulcal depth, and ERI in comparison to PMC sulci, sulcal gray matter thickness, and non-emotion-related impulsivity. In addition, we identified a new transverse component of the olfactory sulcus in every hemisphere that is dissociable from the longitudinal component based on anatomical features and correlation with behavior, which could serve as a new transdiagnostic biomarker. CONCLUSIONS The results of this data-driven investigation provide greater neuroanatomical and neurodevelopmental specificity on how OFC is related to ERI. As such, findings link neuroanatomical characteristics to a trait that is highly predictive of psychopathology.
Collapse
Affiliation(s)
| | - Ethan H Willbrand
- Medical Scientist Training Program, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, WI, USA.
| | - Joseph P Kelly
- Department of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, IL USA.
| | - Sydney T Washington
- Department of Psychology, California State University, Fullerton, Fullerton, CA, USA.
| | - Phyllis Tameilau
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA.
| | | | - Samira A Maboudian
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA; Department of Neuroscience, University of California, Berkeley, Berkeley, CA, USA.
| | - Benjamin J Parker
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA; Department of Neuroscience, University of California, Berkeley, Berkeley, CA, USA.
| | - Matthew V Elliott
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA.
| | - Sheri L Johnson
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA.
| | - Kevin S Weiner
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA; Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA; Department of Neuroscience, University of California, Berkeley, Berkeley, CA, USA.
| |
Collapse
|
3
|
Wang L, Yang Y, Hu X, Zhao S, Jiang X, Guo L, Han J, Liu T. Frequency-specific functional difference between gyri and sulci in naturalistic paradigm fMRI. Brain Struct Funct 2024; 229:431-442. [PMID: 38193918 DOI: 10.1007/s00429-023-02746-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Accepted: 12/04/2023] [Indexed: 01/10/2024]
Abstract
Disentangling functional difference between cortical folding patterns of gyri and sulci provides novel insights into the relationship between brain structure and function. Previous studies using resting-state functional magnetic resonance imaging (rsfMRI) have revealed that sulcal signals exhibit stronger high-frequency but weaker low-frequency components compared to gyral ones, suggesting that gyri may serve as functional integration centers while sulci are segregated local processing units. In this study, we utilize naturalistic paradigm fMRI (nfMRI) to explore the functional difference between gyri and sulci as it has proven to record stronger functional integrations compared to rsfMRI. We adopt a convolutional neural network (CNN) to classify gyral and sulcal fMRI signals in the whole brain (the global model) and within functional brain networks (the local models). The frequency-specific difference between gyri and sulci is then inferred from the power spectral density (PSD) profiles of the learned filters in the CNN model. Our experimental results show that nfMRI shows higher gyral-sulcal PSD contrast effect sizes in the global model compared to rsfMRI. In the local models, the effect sizes are either increased or decreased depending on frequency bands and functional complexity of the FBNs. This study highlights the advantages of nfMRI in depicting the functional difference between gyri and sulci, and provides novel insights into unraveling the relationship between brain structure and function.
Collapse
Affiliation(s)
- Liting Wang
- School of Automation, Northwestern Polytechnical University, Xi'an, Shaanxi, China
| | - Yang Yang
- School of Automation, Northwestern Polytechnical University, Xi'an, Shaanxi, China
| | - Xintao Hu
- School of Automation, Northwestern Polytechnical University, Xi'an, Shaanxi, China.
| | - Shijie Zhao
- School of Automation, Northwestern Polytechnical University, Xi'an, Shaanxi, China
| | - Xi Jiang
- School of Life Science and Technology, MOE Key Laboratory for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| | - Lei Guo
- School of Automation, Northwestern Polytechnical University, Xi'an, Shaanxi, China
| | - Junwei Han
- School of Automation, Northwestern Polytechnical University, Xi'an, Shaanxi, China
| | - Tianming Liu
- School of Computing, University of Georgia, Athens, USA
| |
Collapse
|
4
|
Willbrand EH, Bunge SA, Weiner KS. Neuroanatomical and Functional Dissociations between Variably Present Anterior Lateral Prefrontal Sulci. J Cogn Neurosci 2023; 35:1846-1867. [PMID: 37677051 PMCID: PMC10586811 DOI: 10.1162/jocn_a_02049] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/09/2023]
Abstract
The lateral prefrontal cortex (LPFC) is an evolutionarily expanded region in humans that is critical for numerous complex functions, many of which are largely hominoid specific. Although recent work shows that the presence or absence of specific sulci in anterior LPFC is associated with cognitive performance across age groups, it is unknown whether the presence of these structures relates to individual differences in the functional organization of LPFC. To fill this gap in knowledge, we leveraged multimodal neuroimaging data from two samples encompassing 82 young adult humans (aged 22-36 years) and show that the dorsal and ventral components of the paraintermediate frontal sulcus, or pimfs, present distinct morphological (surface area), architectural (thickness and myelination), and functional (resting-state connectivity networks) properties. We further contextualize the pimfs components within classic and modern cortical parcellations. Taken together, the dorsal and ventral pimfs components mark transitions in LPFC anatomy and function, across metrics and parcellations. These results emphasize that the pimfs is a critical structure to consider when examining individual differences in the anatomical and functional organization of LPFC and suggest that future individual-level parcellations could benefit from incorporating sulcal anatomy when delineating LPFC cortical regions.
Collapse
|
5
|
Willbrand EH, Bunge SA, Weiner KS. Neuroanatomical and functional dissociations between variably present anterior lateral prefrontal sulci. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.25.542301. [PMID: 37292839 PMCID: PMC10245924 DOI: 10.1101/2023.05.25.542301] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
The lateral prefrontal cortex (LPFC) is an evolutionarily expanded region in humans that is critical for numerous complex functions, many of which are largely hominoid-specific. While recent work shows that the presence or absence of specific sulci in anterior LPFC is associated with cognitive performance across age groups, it is unknown whether the presence of these structures relates to individual differences in the functional organization of LPFC. To fill this gap in knowledge, we leveraged multimodal neuroimaging data from 72 young adult humans aged 22-36 and show that dorsal and ventral components of the paraintermediate frontal sulcus (pimfs) present distinct morphological (surface area), architectural (thickness and myelination), and functional (resting-state connectivity networks) properties. We further contextualize the pimfs components within classic and modern cortical parcellations. Taken together, the dorsal and ventral pimfs components mark transitions in anatomy and function in LPFC, across metrics and parcellations. These results emphasize that the pimfs is a critical structure to consider when examining individual differences in the anatomical and functional organization of LPFC and highlight the importance of considering individual anatomy when investigating structural and functional features of the cortex.
Collapse
Affiliation(s)
- Ethan H. Willbrand
- Department of Psychology, University of California Berkeley, Berkeley, CA, 94720 USA
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA, 94720 USA
| | - Silvia A. Bunge
- Department of Psychology, University of California Berkeley, Berkeley, CA, 94720 USA
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA, 94720 USA
| | - Kevin S. Weiner
- Department of Psychology, University of California Berkeley, Berkeley, CA, 94720 USA
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA, 94720 USA
| |
Collapse
|
6
|
Zhu Z, Huang T, Zhen Z, Wang B, Wu X, Li S. From sMRI to task-fMRI: A unified geometric deep learning framework for cross-modal brain anatomo-functional mapping. Med Image Anal 2023; 83:102681. [PMID: 36459804 DOI: 10.1016/j.media.2022.102681] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2021] [Revised: 07/28/2022] [Accepted: 11/02/2022] [Indexed: 11/09/2022]
Abstract
Achieving predictions of brain functional activation patterns/task-fMRI maps from its underlying anatomy is an important yet challenging problem. Once successful, it will not only open up new ways to understand how brain anatomy influences functional organization of the brain, but also provide new technical support for the clinical use of anatomical information to guide the localization of cortical functional areas. However, due to the non-Euclidean complex architecture of brain anatomy and the inherent low signal-to-noise ratio (SNR) properties of fMRI signals, the key challenge in building such a cross-modal brain anatomo-functional mapping is how to effectively learn the context-aware information of brain anatomy and overcome the interference of noise-containing task-fMRI labels on the learning process. In this work, we propose a Unified Geometric Deep Learning framework (BrainUGDL) to perform the cross-modal brain anatomo-functional mapping task. Considering that both global and local structures of brain anatomy have an impact on brain functions from their respective perspectives, we innovatively propose the novel Global Graph Encoding (GGE) unit and Local Graph Attention (LGA) unit embedded into two parallel branches, focusing on learning the high-level global and local context information, respectively. Specifically, GGE learns the global context information of each mesh vertex by building and encoding global interactions, and LGA learns the local context information of each mesh vertex by selectively aggregating patch structure enhanced features from its spatial neighbors. The information learnt from the two branches is then fused to form a comprehensive representation of brain anatomical features for final brain function predictions. To address the inevitable measurement noise in task-fMRI labels, we further elaborate a novel uncertainty-filtered learning mechanism, which enables BrainUGDL to realize revised learning from the noise-containing labels through the estimated uncertainty. Experiments across seven open task-fMRI datasets from human connectome project (HCP) demonstrate the superiority of BrainUGDL. To our best knowledge, our proposed BrainUGDL is the first to achieve the prediction of individual task-fMRI maps solely based on brain sMRI data.
Collapse
Affiliation(s)
- Zhiyuan Zhu
- School of Artificial Intelligence, Beijing Normal University, Beijing, China; Engineering Research Center of Intelligent Technology and Educational Application (Beijing Normal University), Ministry of Education, Beijing, China
| | - Taicheng Huang
- Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Zonglei Zhen
- Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Boyu Wang
- Department of Computer Science, Western University, ON, Canada
| | - Xia Wu
- School of Artificial Intelligence, Beijing Normal University, Beijing, China; Engineering Research Center of Intelligent Technology and Educational Application (Beijing Normal University), Ministry of Education, Beijing, China.
| | - Shuo Li
- Department of Computer and Data Science, Case Western Reserve University, Ohio, USA; Department of Biomedical Engineering, Case Western Reserve University, Ohio, USA
| |
Collapse
|
7
|
Troiani V, Crist RC, Doyle GA, Ferraro TN, Beiler D, Ranck S, McBryan K, Jarvis MA, Barbour JS, Han JJ, Ness RJ, Berrettini WH, Robishaw JD. Genetics and prescription opioid use (GaPO): study design for consenting a cohort from an existing biobank to identify clinical and genetic factors influencing prescription opioid use and abuse. BMC Med Genomics 2021; 14:253. [PMID: 34702274 PMCID: PMC8547564 DOI: 10.1186/s12920-021-01100-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Accepted: 10/15/2021] [Indexed: 01/10/2023] Open
Abstract
BACKGROUND Prescription opioids (POs) are commonly used to treat moderate to severe chronic pain in the health system setting. Although they improve quality of life for many patients, more work is needed to identify both the clinical and genetic factors that put certain individuals at high risk for developing opioid use disorder (OUD) following use of POs for pain relief. With a greater understanding of important risk factors, physicians will be better able to identify patients at highest risk for developing OUD for whom non-opioid alternative therapies and treatments should be considered. METHODS We are conducting a prospective observational study that aims to identify the clinical and genetic factors most stongly associated with OUD. The study design leverages an existing biobank that includes whole exome sequencing and array genotyping. The biobank is maintained within an integrated health system, allowing for the large-scale capture and integration of genetic and non-genetic data. Participants are enrolled into the health system biobank via informed consent and then into a second study that focuses on opioid medication use. Data capture includes validated self-report surveys measuring addiction severity, depression, anxiety, and nicotine use, as well as additional clinical, prescription, and brain imaging data extracted from electronic health records. DISCUSSION We will harness this multimodal data capture to establish meaningful patient phenotypes in order to understand the genetic and non-genetic contributions to OUD.
Collapse
Affiliation(s)
- Vanessa Troiani
- Geisinger Clinic, Geisinger, Danville, PA, USA.
- Department of Translational Data Science and Informatics, Geisinger, Danville, PA, USA.
- Neuroscience Institute, Geisinger, Danville, PA, USA.
- Department of Basic Sciences, Geisinger Commonwealth School of Medicine, Scranton, PA, USA.
| | - Richard C Crist
- Center for Neurobiology and Behavior, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | - Glenn A Doyle
- Center for Neurobiology and Behavior, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | - Thomas N Ferraro
- Center for Neurobiology and Behavior, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
- Department of Biomedical Sciences, Cooper Medical School of Rowan University, Camden, NJ, USA
| | | | | | | | | | | | - John J Han
- Department of Pain Medicine, Geisinger Medical Center, Danville, PA, USA
| | - Ryan J Ness
- Department of Pain Medicine, Geisinger Medical Center, Danville, PA, USA
| | - Wade H Berrettini
- Geisinger Clinic, Geisinger, Danville, PA, USA
- Department of Biomedical Sciences, Cooper Medical School of Rowan University, Camden, NJ, USA
| | - Janet D Robishaw
- Department of Biomedical Science, Schmidt College of Medicine of Florida Atlantic University, Boca Raton, FL, USA
| |
Collapse
|
8
|
Jiang X, Zhang T, Zhang S, Kendrick KM, Liu T. Fundamental functional differences between gyri and sulci: implications for brain function, cognition, and behavior. PSYCHORADIOLOGY 2021; 1:23-41. [PMID: 38665307 PMCID: PMC10939337 DOI: 10.1093/psyrad/kkab002] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Revised: 01/24/2021] [Accepted: 02/02/2021] [Indexed: 04/28/2024]
Abstract
Folding of the cerebral cortex is a prominent characteristic of mammalian brains. Alterations or deficits in cortical folding are strongly correlated with abnormal brain function, cognition, and behavior. Therefore, a precise mapping between the anatomy and function of the brain is critical to our understanding of the mechanisms of brain structural architecture in both health and diseases. Gyri and sulci, the standard nomenclature for cortical anatomy, serve as building blocks to make up complex folding patterns, providing a window to decipher cortical anatomy and its relation with brain functions. Huge efforts have been devoted to this research topic from a variety of disciplines including genetics, cell biology, anatomy, neuroimaging, and neurology, as well as involving computational approaches based on machine learning and artificial intelligence algorithms. However, despite increasing progress, our understanding of the functional anatomy of gyro-sulcal patterns is still in its infancy. In this review, we present the current state of this field and provide our perspectives of the methodologies and conclusions concerning functional differentiation between gyri and sulci, as well as the supporting information from genetic, cell biology, and brain structure research. In particular, we will further present a proposed framework for attempting to interpret the dynamic mechanisms of the functional interplay between gyri and sulci. Hopefully, this review will provide a comprehensive summary of anatomo-functional relationships in the cortical gyro-sulcal system together with a consideration of how these contribute to brain function, cognition, and behavior, as well as to mental disorders.
Collapse
Affiliation(s)
- Xi Jiang
- School of Life Science and Technology, MOE Key Laboratory for Neuroinformation, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Tuo Zhang
- School of Automation, Northwestern Polytechnical University, Xi'an 710129, China
| | - Shu Zhang
- Center for Brain and Brain-Inspired Computing Research, School of Computer Science, Northwestern Polytechnical University, Xi'an 710129, China
| | - Keith M Kendrick
- School of Life Science and Technology, MOE Key Laboratory for Neuroinformation, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Tianming Liu
- Cortical Architecture Imaging and Discovery Laboratory, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, GA 30605, USA
| |
Collapse
|