1
|
Zhang M, Yu H, Cao G, Huang J, Cheng Y, Zhang W, Yuan X, Yang R, Li Q, Cai L, Kang G. Three-branch feature enhancement and fusion network for focal cortical dysplasia lesions segmentation using multimodal imaging. Brain Res Bull 2025; 222:111268. [PMID: 40010576 DOI: 10.1016/j.brainresbull.2025.111268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2024] [Revised: 02/17/2025] [Accepted: 02/21/2025] [Indexed: 02/28/2025]
Abstract
OBJECTIVE Conventional multimodal imaging, including MRI and fluorodeoxyglucose positron emission tomography (FDG-PET), has difficulty in accurately detecting subtle or blurred focal cortical dysplasia (FCD) lesions. Morphometric maps assist localization by highlighting abnormal regions, whereas wavelet-filtered images emphasize texture and edge details. Therefore, we propose a three-branch feature enhancement and fusion network (TBFEF-Net) that integrates conventional multimodal imaging, morphometric maps, and wavelet-filtered images to enhance the accuracy of FCD localization. METHODS The proposed TBFEF-Net comprises a semantic segmentation backbone, a cross-branch feature enhancement (CFE) module, and a multi-feature fusion (MFF) module. In the semantic segmentation backbone, three UNet-based branches separately extract semantic features from conventional multimodal imaging, morphometric maps, and wavelet-filtered images. In the encoding stage, the CFE incorporates a residual-based convolutional block attention module (CBAM) to aggregate features from all branches, enhancing the feature representation of FCD lesions. While in the decoding stage, the MFF integrates edge detail features from the wavelet-filtered imaging branch into the conventional multimodal imaging branch, enhancing the ability to capture lesion edges. As a result, this approach enables more precise segmentation. RESULTS Experimental results show that TBFEF-Net surpasses several state-of-the-art methods in FCD segmentation. In the primary cohort, the Dice and sensitivity reached 59.73 % and 67.13 %, respectively, while in the open cohort, the Dice and sensitivity were 54.67 % and 54.81 %, respectively. SIGNIFICANCE We introduced wavelet-filtered images for the first time in FCD segmentation, offering a novel approach and perspective for FCD lesions localization.
Collapse
Affiliation(s)
- Manli Zhang
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
| | - Hao Yu
- Pediatric Epilepsy Center, Peking University First Hospital, Beijing 102627, China
| | - Gongpeng Cao
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
| | - Jinguo Huang
- School of Intelligent Engineering and Automation, Beijing University of Posts and Telecommunications, Beijing 100876, China
| | - Yintao Cheng
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
| | - Wenjing Zhang
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
| | - Xiaotong Yuan
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
| | - Rui Yang
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
| | - Qiunan Li
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
| | - Lixin Cai
- Pediatric Epilepsy Center, Peking University First Hospital, Beijing 102627, China.
| | - Guixia Kang
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China.
| |
Collapse
|
2
|
Zhang L, Zhuang B, Wang M, Zhu J, Chen T, Yang Y, Shi H, Zhu X, Ma L. Delineating abnormal individual structural covariance brain network organization in pediatric epilepsy with unilateral resection of visual cortex. Epilepsy Behav Rep 2024; 27:100676. [PMID: 38826153 PMCID: PMC11137379 DOI: 10.1016/j.ebr.2024.100676] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2023] [Revised: 05/13/2024] [Accepted: 05/14/2024] [Indexed: 06/04/2024] Open
Abstract
Although several previous studies have used resting-state functional magnetic resonance imaging and diffusion tensor imaging to report topological changes in the brain in epilepsy, it remains unclear whether the individual structural covariance network (SCN) changes in epilepsy, especially in pediatric epilepsy with visual cortex resection but with normal functions. Herein, individual SCNs were mapped and analyzed for seven pediatric patients with epilepsy after surgery and 15 age-matched healthy controls. A whole-brain individual SCN was constructed based on an automated anatomical labeling template, and global and nodal network metrics were calculated for statistical analyses. Small-world properties were exhibited by pediatric patients after brain surgery and by healthy controls. After brain surgery, pediatric patients with epilepsy exhibited a higher shortest path length, lower global efficiency, and higher nodal efficiency in the cuneus than those in healthy controls. These results revealed that pediatric epilepsy after brain surgery, even with normal functions, showed altered topological organization of the individual SCNs, which revealed residual network topological abnormalities and may provide initial evidence for the underlying functional impairments in the brain of pediatric patients with epilepsy after surgery that can occur in the future.
Collapse
Affiliation(s)
- Liang Zhang
- Department of Neurosurgery, Wuxi Clinical College of Anhui Medical University (The 904th Hospital of PLA), Wuxi, Jiangsu Province 214044, China
| | - Bei Zhuang
- Department of Anesthesiology, Wuxi Clinical College of Anhui Medical University (The 904th Hospital of PLA), Wuxi, Jiangsu Province 214044, China
| | - Mengyuan Wang
- Department of Nursing, Wuxi Clinical College of Anhui Medical University (The 904th Hospital of PLA), Wuxi, Jiangsu Province 214044, China
| | - Jie Zhu
- Department of Neurosurgery, Wuxi Clinical College of Anhui Medical University (The 904th Hospital of PLA), Wuxi, Jiangsu Province 214044, China
| | - Tao Chen
- Department of Neurosurgery, Wuxi Clinical College of Anhui Medical University (The 904th Hospital of PLA), Wuxi, Jiangsu Province 214044, China
| | - Yang Yang
- Department of Neurosurgery, Wuxi Clinical College of Anhui Medical University (The 904th Hospital of PLA), Wuxi, Jiangsu Province 214044, China
| | - Haoting Shi
- Department of Neurosurgery, Wuxi Clinical College of Anhui Medical University (The 904th Hospital of PLA), Wuxi, Jiangsu Province 214044, China
| | - Xiaoming Zhu
- Department of Neurosurgery, Wuxi Clinical College of Anhui Medical University (The 904th Hospital of PLA), Wuxi, Jiangsu Province 214044, China
| | - Li Ma
- Department of Neurosurgery, Wuxi Clinical College of Anhui Medical University (The 904th Hospital of PLA), Wuxi, Jiangsu Province 214044, China
| |
Collapse
|
3
|
Guo Y, Kacker K, Chamanzar A, Grover P. EEG Source Imaging of Infarct Core and Penumbra for Ischemic Stroke Patients. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-5. [PMID: 38083009 DOI: 10.1109/embc40787.2023.10340954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
A quantitative method of analyzing EEG signals after stroke onset can help monitor disease progression and tailor treatments. In this work, we present an EEG-based imaging algorithm to estimate the location and size of the stroke infarct core and penumbra tissues. Building on recent advancements in localizing neural silences, we develop an algorithm that utilizes known spectral properties of the infarct core and penumbra to separately localize them. Our algorithm uses these properties to estimate source contributions to the scalp EEG recordings in different frequency bands. Subsequently, it utilizes optimization techniques to search for the affected brain sources iteratively. We test our algorithm on simulated datasets using a realistic MRI head model, achieving center-of-mass error of 12.80mm and 17.24mm, and size estimation error of 21.78% and 36.62% for infarct core and penumbra respectively.
Collapse
|
4
|
Bhadra S, Kelkar VA, Brooks FJ, Anastasio MA. On Hallucinations in Tomographic Image Reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:3249-3260. [PMID: 33950837 PMCID: PMC8673588 DOI: 10.1109/tmi.2021.3077857] [Citation(s) in RCA: 46] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
Tomographic image reconstruction is generally an ill-posed linear inverse problem. Such ill-posed inverse problems are typically regularized using prior knowledge of the sought-after object property. Recently, deep neural networks have been actively investigated for regularizing image reconstruction problems by learning a prior for the object properties from training images. However, an analysis of the prior information learned by these deep networks and their ability to generalize to data that may lie outside the training distribution is still being explored. An inaccurate prior might lead to false structures being hallucinated in the reconstructed image and that is a cause for serious concern in medical imaging. In this work, we propose to illustrate the effect of the prior imposed by a reconstruction method by decomposing the image estimate into generalized measurement and null components. The concept of a hallucination map is introduced for the general purpose of understanding the effect of the prior in regularized reconstruction methods. Numerical studies are conducted corresponding to a stylized tomographic imaging modality. The behavior of different reconstruction methods under the proposed formalism is discussed with the help of the numerical studies.
Collapse
|
5
|
Neural silences can be localized rapidly using noninvasive scalp EEG. Commun Biol 2021; 4:429. [PMID: 33785813 PMCID: PMC8010113 DOI: 10.1038/s42003-021-01768-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2020] [Accepted: 01/28/2021] [Indexed: 02/01/2023] Open
Abstract
A rapid and cost-effective noninvasive tool to detect and characterize neural silences can be of important benefit in diagnosing and treating many disorders. We propose an algorithm, SilenceMap, for uncovering the absence of electrophysiological signals, or neural silences, using noninvasive scalp electroencephalography (EEG) signals. By accounting for the contributions of different sources to the power of the recorded signals, and using a hemispheric baseline approach and a convex spectral clustering framework, SilenceMap permits rapid detection and localization of regions of silence in the brain using a relatively small amount of EEG data. SilenceMap substantially outperformed existing source localization algorithms in estimating the center-of-mass of the silence for three pediatric cortical resection patients, using fewer than 3 minutes of EEG recordings (13, 2, and 11mm vs. 25, 62, and 53 mm), as well for 100 different simulated regions of silence based on a real human head model (12 ± 0.7 mm vs. 54 ± 2.2 mm). SilenceMap paves the way towards accessible early diagnosis and continuous monitoring of altered physiological properties of human cortical function.
Collapse
|
6
|
Kelkar VA, Bhadra S, Anastasio MA. Compressible Latent-Space Invertible Networks for Generative Model-Constrained Image Reconstruction. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING 2021; 7:209-223. [PMID: 35989942 PMCID: PMC9387769 DOI: 10.1109/tci.2021.3049648] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
There remains an important need for the development of image reconstruction methods that can produce diagnostically useful images from undersampled measurements. In magnetic resonance imaging (MRI), for example, such methods can facilitate reductions in data-acquisition times. Deep learning-based methods hold potential for learning object priors or constraints that can serve to mitigate the effects of data-incompleteness on image reconstruction. One line of emerging research involves formulating an optimization-based reconstruction method in the latent space of a generative deep neural network. However, when generative adversarial networks (GANs) are employed, such methods can result in image reconstruction errors if the sought-after solution does not reside within the range of the GAN. To circumvent this problem, in this work, a framework for reconstructing images from incomplete measurements is proposed that is formulated in the latent space of invertible neural network-based generative models. A novel regularization strategy is introduced that takes advantage of the multiscale architecture of certain invertible neural networks, which can result in improved reconstruction performance over classical methods in terms of traditional metrics. The proposed method is investigated for reconstructing images from undersampled MRI data. The method is shown to achieve comparable performance to a state-of-the-art generative model-based reconstruction method while benefiting from a deterministic reconstruction procedure and easier control over regularization parameters.
Collapse
Affiliation(s)
- Varun A Kelkar
- Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801 USA
| | - Sayantan Bhadra
- Department of Computer Science and Engineering, Washington University in Saint Louis, Saint Louis, MO USA
| | - Mark A Anastasio
- Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL 61801 USA
| |
Collapse
|
7
|
Maallo AMS, Granovetter MC, Freud E, Kastner S, Pinsk MA, Glen D, Patterson C, Behrmann M. Large-scale resculpting of cortical circuits in children after surgical resection. Sci Rep 2020; 10:21589. [PMID: 33299002 PMCID: PMC7725819 DOI: 10.1038/s41598-020-78394-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2020] [Accepted: 11/24/2020] [Indexed: 11/09/2022] Open
Abstract
Despite the relative successes in the surgical treatment of pharmacoresistant epilepsy, there is rather little research on the neural (re)organization that potentially subserves behavioral compensation. Here, we examined the post-surgical functional connectivity (FC) in children and adolescents who have undergone unilateral cortical resection and, yet, display remarkably normal behavior. Conventionally, FC has been investigated in terms of the mean correlation of the BOLD time courses extracted from different brain regions. Here, we demonstrated the value of segregating the voxel-wise relationships into mutually exclusive populations that were either positively or negatively correlated. While, relative to controls, the positive correlations were largely normal, negative correlations among networks were increased. Together, our results point to reorganization in the contralesional hemisphere, possibly suggesting competition for cortical territory due to the demand for representation of function. Conceivably, the ubiquitous negative correlations enable the differentiation of function in the reduced cortical volume following a unilateral resection.
Collapse
Affiliation(s)
- Anne Margarette S Maallo
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University, Pittsburgh, USA
| | - Michael C Granovetter
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University, Pittsburgh, USA.,School of Medicine, University of Pittsburgh, Pittsburgh, USA
| | - Erez Freud
- Department of Psychology, The Centre for Vision Research, York University, Toronto, Canada
| | - Sabine Kastner
- Princeton Neuroscience Institute, Princeton University, Princeton, USA.,Department of Psychology, Princeton University, Princeton, USA
| | - Mark A Pinsk
- Princeton Neuroscience Institute, Princeton University, Princeton, USA
| | - Daniel Glen
- Scientific and Statistical Computing Core, National Institute of Mental Health, Bethesda, USA
| | | | - Marlene Behrmann
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University, Pittsburgh, USA.
| |
Collapse
|