1
|
Momi D, Wang Z, Parmigiani S, Mikulan E, Bastiaens SP, Oveisi MP, Kadak K, Gaglioti G, Waters AC, Hill S, Pigorini A, Keller CJ, Griffiths JD. Stimulation mapping and whole-brain modeling reveal gradients of excitability and recurrence in cortical networks. Nat Commun 2025; 16:3222. [PMID: 40185725 PMCID: PMC11971347 DOI: 10.1038/s41467-025-58187-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Accepted: 03/11/2025] [Indexed: 04/07/2025] Open
Abstract
The human brain exhibits a modular and hierarchical structure, spanning low-order sensorimotor to high-order cognitive/affective systems. What is the mechanistic significance of this organization for brain dynamics and information processing properties? We investigated this question using rare simultaneous multimodal electrophysiology (stereotactic and scalp electroencephalography - EEG) recordings in 36 patients with drug-resistant focal epilepsy during presurgical intracerebral electrical stimulation (iES) (323 stimulation sessions). Our analyses revealed an anatomical gradient of excitability across the cortex, with stronger iES-evoked EEG responses in high-order compared to low-order regions. Mathematical modeling further showed that this variation in excitability levels results from a differential dependence on recurrent feedback from non-stimulated regions across the anatomical hierarchy, and could be extinguished by suppressing those connections in-silico. High-order brain regions/networks thus show an activity pattern characterized by more inter-network functional integration than low-order ones, which manifests as a spatial gradient of excitability that is emergent from, and causally dependent on, the underlying hierarchical network structure. These findings offer new insights into how hierarchical brain organization influences cognitive functions and could inform strategies for targeted neuromodulation therapies.
Collapse
Affiliation(s)
- Davide Momi
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, Canada.
- Department of Psychiatry and Behavioral Sciences, Stanford University Medical Center, Stanford, CA, USA.
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA.
| | - Zheng Wang
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, Canada
| | - Sara Parmigiani
- Department of Psychiatry and Behavioral Sciences, Stanford University Medical Center, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Ezequiel Mikulan
- Department of Health Sciences, Università degli studi di Milano, Milan, Italy
| | - Sorenza P Bastiaens
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, Canada
- Institute of Medical Science, University of Toronto, Toronto, Canada
| | - Mohammad P Oveisi
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, Canada
| | - Kevin Kadak
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, Canada
- Institute of Medical Science, University of Toronto, Toronto, Canada
| | - Gianluca Gaglioti
- Department of Biomedical and Clinical Sciences "L.Sacco", Università degli Studi di Milano, Milan, Italy
| | - Allison C Waters
- Nash Family Center for Advanced Circuit Therapeutics, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Sean Hill
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, Canada
- Institute of Medical Science, University of Toronto, Toronto, Canada
- Department of Psychiatry, University of Toronto, Toronto, Canada
| | - Andrea Pigorini
- Department of Biomedical, Surgical and Dental Sciences, Università degli Studi di Milano, Milan, Italy
- UOC Maxillo-facial Surgery and dentistry, Fondazione IRCCS Cà Granda, Ospedale Maggiore Policlinico, Milan, Italy
| | - Corey J Keller
- Department of Psychiatry and Behavioral Sciences, Stanford University Medical Center, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Veterans Affairs Palo Alto Healthcare System, Palo Alto, CA, USA
| | - John D Griffiths
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health (CAMH), Toronto, Canada
- Institute of Medical Science, University of Toronto, Toronto, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, Canada
- Department of Psychiatry, University of Toronto, Toronto, Canada
| |
Collapse
|
2
|
Mitew S, Yeow LY, Ho CL, Bhanu PKN, Nickalls OJ. PyFaceWipe: a new defacing tool for almost any MRI contrast. MAGMA (NEW YORK, N.Y.) 2024; 37:993-1003. [PMID: 38904745 DOI: 10.1007/s10334-024-01170-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/23/2023] [Revised: 05/25/2024] [Accepted: 05/28/2024] [Indexed: 06/22/2024]
Abstract
RATIONALE AND OBJECTIVES Defacing research MRI brain scans is often a mandatory step. With current defacing software, there are issues with Windows compatibility and researcher doubt regarding the adequacy of preservation of brain voxels in non-T1w scans. To address this, we developed PyFaceWipe, a multiplatform software for multiple MRI contrasts, which was evaluated based on its anonymisation ability and effect on downstream processing. MATERIALS AND METHODS Multiple MRI brain scan contrasts from the OASIS-3 dataset were defaced with PyFaceWipe and PyDeface and manually assessed for brain voxel preservation, remnant facial features and effect on automated face detection. Original and PyFaceWipe-defaced data from locally acquired T1w structural scans underwent volumetry with FastSurfer and brain atlas generation with ANTS. RESULTS 214 MRI scans of several contrasts from OASIS-3 were successfully processed with both PyFaceWipe and PyDeface. PyFaceWipe maintained complete brain voxel preservation in all tested contrasts except ASL (45%) and DWI (90%), and PyDeface in all tested contrasts except ASL (95%), BOLD (25%), DWI (40%) and T2* (25%). Manual review of PyFaceWipe showed no failures of facial feature removal. Pinna removal was less successful (6% of T1 scans showed residual complete pinna). PyDeface achieved 5.1% failure rate. Automated detection found no faces in PyFaceWipe-defaced scans, 19 faces in PyDeface scans compared with 78 from the 224 original scans. Brain atlas generation showed no significant difference between atlases created from original and defaced data in both young adulthood and late elderly cohorts. Structural volumetry dice scores were ≥ 0.98 for all structures except for grey matter which had 0.93. PyFaceWipe output was identical across the tested operating systems. CONCLUSION PyFaceWipe is a promising multiplatform defacing tool, demonstrating excellent brain voxel preservation and competitive defacing in multiple MRI contrasts, performing favourably against PyDeface. ASL, BOLD, DWI and T2* scans did not produce recognisable 3D renders and hence should not require defacing. Structural volumetry dice scores (≥ 0.98) were higher than previously published FreeSurfer results, except for grey matter which were comparable. The effect is measurable and care should be exercised during studies. ANTS atlas creation showed no significant effect from PyFaceWipe defacing.
Collapse
Affiliation(s)
- Stanislaw Mitew
- Department of Radiology, Sengkang General Hospital, Singhealth, 110 Sengkang E Way, Singapore, 544886, Singapore
| | - Ling Yun Yeow
- Clinical Data Analytics & Radiomics Group, Bioinformatics Institute, Agency for Science, Technology and Research, Singapore, 30 Biopolis St, Matrix, Singapore, 138671, Singapore
| | - Chi Long Ho
- Department of Radiology, Sengkang General Hospital, Singhealth, 110 Sengkang E Way, Singapore, 544886, Singapore
| | - Prakash K N Bhanu
- Clinical Data Analytics & Radiomics Group, Bioinformatics Institute, Agency for Science, Technology and Research, Singapore, 30 Biopolis St, Matrix, Singapore, 138671, Singapore
| | - Oliver James Nickalls
- Department of Radiology, Sengkang General Hospital, Singhealth, 110 Sengkang E Way, Singapore, 544886, Singapore.
| |
Collapse
|
3
|
Yokoyama H, Kaneko N, Usuda N, Kato T, Khoo HM, Fukuma R, Oshino S, Tani N, Kishima H, Yanagisawa T, Nakazawa K. M/EEG source localization for both subcortical and cortical sources using a convolutional neural network with a realistic head conductivity model. APL Bioeng 2024; 8:046104. [PMID: 39502794 PMCID: PMC11537707 DOI: 10.1063/5.0226457] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2024] [Accepted: 10/14/2024] [Indexed: 11/08/2024] Open
Abstract
While electroencephalography (EEG) and magnetoencephalography (MEG) are well-established noninvasive methods in neuroscience and clinical medicine, they suffer from low spatial resolution. Electrophysiological source imaging (ESI) addresses this by noninvasively exploring the neuronal origins of M/EEG signals. Although subcortical structures are crucial to many brain functions and neuronal diseases, accurately localizing subcortical sources of M/EEG remains particularly challenging, and the feasibility is still a subject of debate. Traditional ESIs, which depend on explicitly defined regularization priors, have struggled to set optimal priors and accurately localize brain sources. To overcome this, we introduced a data-driven, deep learning-based ESI approach without the need for these priors. We proposed a four-layered convolutional neural network (4LCNN) designed to locate both subcortical and cortical sources underlying M/EEG signals. We also employed a sophisticated realistic head conductivity model using the state-of-the-art segmentation method of ten different head tissues from individual MRI data to generate realistic training data. This is the first attempt at deep learning-based ESI targeting subcortical regions. Our method showed excellent accuracy in source localization, particularly in subcortical areas compared to other methods. This was validated through M/EEG simulations, evoked responses, and invasive recordings. The potential for accurate source localization of the 4LCNNs demonstrated in this study suggests future contributions to various research endeavors such as the clinical diagnosis, understanding of the pathophysiology of various neuronal diseases, and basic brain functions.
Collapse
Affiliation(s)
| | - Naotsugu Kaneko
- Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo 153-8902, Japan
| | - Noboru Usuda
- Neural Prosthetics Project, Tokyo Metropolitan Institute of Medical Science, Setagaya, Tokyo 156-8506, Japan
| | | | - Hui Ming Khoo
- Department of Neurosurgery, Graduate School of Medicine, Osaka University, Suita, Osaka 565-0871, Japan
| | | | - Satoru Oshino
- Department of Neurosurgery, Graduate School of Medicine, Osaka University, Suita, Osaka 565-0871, Japan
| | - Naoki Tani
- Department of Neurosurgery, Graduate School of Medicine, Osaka University, Suita, Osaka 565-0871, Japan
| | - Haruhiko Kishima
- Department of Neurosurgery, Graduate School of Medicine, Osaka University, Suita, Osaka 565-0871, Japan
| | | | - Kimitaka Nakazawa
- Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo 153-8902, Japan
| |
Collapse
|
4
|
Zauli FM, Del Vecchio M, Pigorini A, Russo S, Massimini M, Sartori I, Cardinale F, d'Orio P, Mikulan E. Localizing hidden Interictal Epileptiform Discharges with simultaneous intracerebral and scalp high-density EEG recordings. J Neurosci Methods 2024; 409:110193. [PMID: 38871302 DOI: 10.1016/j.jneumeth.2024.110193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Revised: 05/02/2024] [Accepted: 06/08/2024] [Indexed: 06/15/2024]
Abstract
BACKGROUND Scalp EEG is one of the main tools in the clinical evaluation of epilepsy. In some cases intracranial Interictal Epileptiform Discharges (IEDs) are not visible from the scalp. Recent studies have shown the feasibility of revealing them in the EEG if their timings are extracted from simultaneous intracranial recordings, but their potential for the localization of the epileptogenic zone is not yet well defined. NEW METHOD We recorded simultaneous high-density EEG (HD-EEG) and stereo-electroencephalography (SEEG) during interictal periods in 8 patients affected by drug-resistant focal epilepsy. We identified IEDs in the SEEG and systematically analyzed the time-locked signals on the EEG by means of evoked potentials, topographical analysis and Electrical Source Imaging (ESI). The dataset has been standardized and is being publicly shared. RESULTS Our results showed that IEDs that were not clearly visible at single-trials could be uncovered by averaging, in line with previous reports. They also showed that their topographical voltage distributions matched the position of the SEEG electrode where IEDs had been identified, and that ESI techniques can reconstruct it with an accuracy of ∼2 cm. Finally, the present dataset provides a reference to test the accuracy of different methods and parameters. COMPARISON WITH EXISTING METHODS Our study is the first to systematically compare ESI methods on simultaneously recorded IEDs, and to share a public resource with in-vivo data for their evaluation. CONCLUSIONS Simultaneous HD-EEG and SEEG recordings can unveil hidden IEDs whose origins can be reconstructed using topographical and ESI analyses, but results depend on the selected methods and parameters.
Collapse
Affiliation(s)
- Flavia Maria Zauli
- Department of Philosophy "P. Martinetti", Università degli Studi di Milano, Milan, Italy; Department of Biomedical and Clinical Sciences "L. Sacco", Università degli Studi di Milano, Milan, Italy; ASST GOM Niguarda, Piazza dell'Ospedale Maggiore 3, Milan, Italy
| | - Maria Del Vecchio
- Institute of Neuroscience, Consiglio Nazionale delle Ricerche, Parma, Italy
| | - Andrea Pigorini
- Department of Biomedical, Surgical and Dental Sciences, Università degli Studi di Milano, Milan, Italy; UOC Maxillo-facial Surgery and dentistry, Fondazione IRCCS Cà Granda, Ospedale Maggiore Policlinico, Milan, Italy
| | - Simone Russo
- Department of Biomedical and Clinical Sciences "L. Sacco", Università degli Studi di Milano, Milan, Italy; Wallace H Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA, USA
| | - Marcello Massimini
- Department of Biomedical and Clinical Sciences "L. Sacco", Università degli Studi di Milano, Milan, Italy; Istituto Di Ricovero e Cura a Carattere Scientifico, Fondazione Don Carlo Gnocchi, Milan, Italy
| | - Ivana Sartori
- ASST GOM Niguarda, Piazza dell'Ospedale Maggiore 3, Milan, Italy
| | - Francesco Cardinale
- ASST GOM Niguarda, Piazza dell'Ospedale Maggiore 3, Milan, Italy; Institute of Neuroscience, Consiglio Nazionale delle Ricerche, Parma, Italy; Department of Medicine and Surgery, Unit of Neuroscience, Università degli Studi di Parma, Parma, Italy
| | - Piergiorgio d'Orio
- ASST GOM Niguarda, Piazza dell'Ospedale Maggiore 3, Milan, Italy; Institute of Neuroscience, Consiglio Nazionale delle Ricerche, Parma, Italy; Department of Medicine and Surgery, Unit of Neuroscience, Università degli Studi di Parma, Parma, Italy
| | - Ezequiel Mikulan
- Department of Health Sciences, Università degli Studi di Milano, Milan, Italy.
| |
Collapse
|
5
|
Lien CY, Deng RJ, Fuh JL, Ting YN, Yang AC. Enhancing facial feature de-identification in multiframe brain images: A generative adversarial network approach. PROGRESS IN BRAIN RESEARCH 2024; 290:141-156. [PMID: 39448110 DOI: 10.1016/bs.pbr.2024.07.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2024] [Revised: 07/17/2024] [Accepted: 07/24/2024] [Indexed: 10/26/2024]
Abstract
The collection of head images for public datasets in the field of brain science has grown remarkably in recent years, underscoring the need for robust de-identification methods to adhere with privacy regulations. This paper elucidates a novel deep learning-based approach to deidentifying facial features in brain images using a generative adversarial network to synthesize new facial features and contours. We employed the precision of the three-dimensional U-Net model to detect specific features such as the ears, nose, mouth, and eyes. Results: Our method diverges from prior studies by highlighting partial regions of the head image rather than comprehensive full-head images. We trained and tested our model on a dataset comprising 490 cases from a publicly available head computed tomography image dataset and an additional 70 cases with head MR images. Integrated data proved advantageous, with promising results. The nose, mouth, and eye detection achieved 100% accuracy, while ear detection reached 85.03% in the training dataset. In the testing dataset, ear detection accuracy was 65.98%, and the validation dataset ear detection attained 100%. Analysis of pixel value histograms demonstrated varying degrees of similarity, as measured by the Structural Similarity Index (SSIM), between raw and generated features across different facial features. The proposed methodology, tailored for partial head image processing, is well suited for real-world imaging examination scenarios and holds potential for future clinical applications contributing to the advancement of research in de-identification technologies, thus fortifying privacy safeguards.
Collapse
Affiliation(s)
- Chung-Yueh Lien
- Department of Information Management, National Taipei University of Nursing and Health Sciences, Taipei, Taiwan
| | - Rui-Jun Deng
- Department of Information Management, National Taipei University of Nursing and Health Sciences, Taipei, Taiwan
| | - Jong-Ling Fuh
- Department of Neurology, Neurological Institute, Taipei Veterans General Hospital, Taipei, Taiwan; School of Medicine, College of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan; Brain Research Center, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Yun-Ni Ting
- Department of Neurology, Neurological Institute, Taipei Veterans General Hospital, Taipei, Taiwan; Brain Research Center, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Albert C Yang
- School of Medicine, College of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan; Brain Research Center, National Yang Ming Chiao Tung University, Taipei, Taiwan; Digital Medicine and Smart Healthcare Research Center, National Yang Ming Chiao Tung University, Taipei, Taiwan; Department of Medical Research, Taipei Veterans General Hospital, Taipei, Taiwan.
| |
Collapse
|
6
|
Pigorini A, Avanzini P, Barborica A, Bénar CG, David O, Farisco M, Keller CJ, Manfridi A, Mikulan E, Paulk AC, Roehri N, Subramanian A, Vulliémoz S, Zelmann R. Simultaneous invasive and non-invasive recordings in humans: A novel Rosetta stone for deciphering brain activity. J Neurosci Methods 2024; 408:110160. [PMID: 38734149 DOI: 10.1016/j.jneumeth.2024.110160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 04/10/2024] [Accepted: 05/01/2024] [Indexed: 05/13/2024]
Abstract
Simultaneous noninvasive and invasive electrophysiological recordings provide a unique opportunity to achieve a comprehensive understanding of human brain activity, much like a Rosetta stone for human neuroscience. In this review we focus on the increasingly-used powerful combination of intracranial electroencephalography (iEEG) with scalp electroencephalography (EEG) or magnetoencephalography (MEG). We first provide practical insight on how to achieve these technically challenging recordings. We then provide examples from clinical research on how simultaneous recordings are advancing our understanding of epilepsy. This is followed by the illustration of how human neuroscience and methodological advances could benefit from these simultaneous recordings. We conclude with a call for open data sharing and collaboration, while ensuring neuroethical approaches and argue that only with a true collaborative approach the promises of simultaneous recordings will be fulfilled.
Collapse
Affiliation(s)
- Andrea Pigorini
- Department of Biomedical, Surgical and Dental Sciences, Università degli Studi di Milano, Milan, Italy; UOC Maxillo-facial Surgery and dentistry, Fondazione IRCCS Cà Granda, Ospedale Maggiore Policlinico, Milan, Italy.
| | - Pietro Avanzini
- Institute of Neuroscience, Consiglio Nazionale delle Ricerche, Parma, Italy
| | | | - Christian-G Bénar
- Aix Marseille Univ, Inserm, U1106, INS, Institut de Neurosciences des Systèmes, Marseille, France
| | - Olivier David
- Aix Marseille Univ, Inserm, U1106, INS, Institut de Neurosciences des Systèmes, Marseille, France
| | - Michele Farisco
- Centre for Research Ethics and Bioethics, Department of Public Health and Caring Sciences, Uppsala University, P.O. Box 256, Uppsala, SE 751 05, Sweden; Science and Society Unit Biogem, Biology and Molecular Genetics Institute, Via Camporeale snc, Ariano Irpino, AV 83031, Italy
| | - Corey J Keller
- Department of Psychiatry & Behavioral Sciences, Stanford University Medical Center, Stanford, CA 94305, USA; Wu Tsai Neurosciences Institute, Stanford University Medical Center, Stanford, CA 94305, USA; Veterans Affairs Palo Alto Healthcare System, and the Sierra Pacific Mental Illness, Research, Education, and Clinical Center (MIRECC), Palo Alto, CA 94394, USA
| | - Alfredo Manfridi
- Department of Pathophysiology and Transplantation, Università degli Studi di Milano, Milan, Italy
| | - Ezequiel Mikulan
- Department of Health Sciences, Università degli Studi di Milano, Milan, Italy
| | - Angelique C Paulk
- Department of Neurology and Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| | - Nicolas Roehri
- EEG and Epilepsy Unit, Dpt of Clinical Neurosciences, Geneva University Hospitals and University of Geneva, Switzerland
| | - Ajay Subramanian
- Department of Psychiatry & Behavioral Sciences, Stanford University Medical Center, Stanford, CA 94305, USA; Wu Tsai Neurosciences Institute, Stanford University Medical Center, Stanford, CA 94305, USA; Veterans Affairs Palo Alto Healthcare System, and the Sierra Pacific Mental Illness, Research, Education, and Clinical Center (MIRECC), Palo Alto, CA 94394, USA
| | - Serge Vulliémoz
- EEG and Epilepsy Unit, Dpt of Clinical Neurosciences, Geneva University Hospitals and University of Geneva, Switzerland
| | - Rina Zelmann
- Department of Neurology and Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA.
| |
Collapse
|
7
|
Molchanova N, Maréchal B, Thiran J, Kober T, Huelnhagen T, Richiardi J. Fast refacing of MR images with a generative neural network lowers re-identification risk and preserves volumetric consistency. Hum Brain Mapp 2024; 45:e26721. [PMID: 38899549 PMCID: PMC11187735 DOI: 10.1002/hbm.26721] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 04/09/2024] [Accepted: 05/06/2024] [Indexed: 06/21/2024] Open
Abstract
With the rise of open data, identifiability of individuals based on 3D renderings obtained from routine structural magnetic resonance imaging (MRI) scans of the head has become a growing privacy concern. To protect subject privacy, several algorithms have been developed to de-identify imaging data using blurring, defacing or refacing. Completely removing facial structures provides the best re-identification protection but can significantly impact post-processing steps, like brain morphometry. As an alternative, refacing methods that replace individual facial structures with generic templates have a lower effect on the geometry and intensity distribution of original scans, and are able to provide more consistent post-processing results by the price of higher re-identification risk and computational complexity. In the current study, we propose a novel method for anonymized face generation for defaced 3D T1-weighted scans based on a 3D conditional generative adversarial network. To evaluate the performance of the proposed de-identification tool, a comparative study was conducted between several existing defacing and refacing tools, with two different segmentation algorithms (FAST and Morphobox). The aim was to evaluate (i) impact on brain morphometry reproducibility, (ii) re-identification risk, (iii) balance between (i) and (ii), and (iv) the processing time. The proposed method takes 9 s for face generation and is suitable for recovering consistent post-processing results after defacing.
Collapse
Affiliation(s)
- Nataliia Molchanova
- Department of RadiologyLausanne University Hospital (CHUV)LausanneSwitzerland
- Institute of InformaticsUniversity of Applied Sciences and Arts of Western Switzerland (HES‐SO)SierreSwitzerland
- Faculty of Biology and MedicineUniversity of Lausanne (UNIL)LausanneSwitzerland
- Advanced Clinical Imaging TechnologySiemens Healthineers International AGLausanneSwitzerland
- Laboratory of Signal Processing 5Ecole Polytechnique Fédérale de Lausanne, (EPFL)LausanneSwitzerland
| | - Bénédicte Maréchal
- Department of RadiologyLausanne University Hospital (CHUV)LausanneSwitzerland
- Advanced Clinical Imaging TechnologySiemens Healthineers International AGLausanneSwitzerland
- Laboratory of Signal Processing 5Ecole Polytechnique Fédérale de Lausanne, (EPFL)LausanneSwitzerland
| | - Jean‐Philippe Thiran
- Department of RadiologyLausanne University Hospital (CHUV)LausanneSwitzerland
- Laboratory of Signal Processing 5Ecole Polytechnique Fédérale de Lausanne, (EPFL)LausanneSwitzerland
| | - Tobias Kober
- Department of RadiologyLausanne University Hospital (CHUV)LausanneSwitzerland
- Advanced Clinical Imaging TechnologySiemens Healthineers International AGLausanneSwitzerland
- Laboratory of Signal Processing 5Ecole Polytechnique Fédérale de Lausanne, (EPFL)LausanneSwitzerland
| | - Till Huelnhagen
- Department of RadiologyLausanne University Hospital (CHUV)LausanneSwitzerland
- Advanced Clinical Imaging TechnologySiemens Healthineers International AGLausanneSwitzerland
- Laboratory of Signal Processing 5Ecole Polytechnique Fédérale de Lausanne, (EPFL)LausanneSwitzerland
| | - Jonas Richiardi
- Department of RadiologyLausanne University Hospital (CHUV)LausanneSwitzerland
- Faculty of Biology and MedicineUniversity of Lausanne (UNIL)LausanneSwitzerland
| | | |
Collapse
|
8
|
Gao C, Landman BA, Prince JL, Carass A. Reproducibility evaluation of the effects of MRI defacing on brain segmentation. J Med Imaging (Bellingham) 2023; 10:064001. [PMID: 38074632 PMCID: PMC10704191 DOI: 10.1117/1.jmi.10.6.064001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 09/22/2023] [Accepted: 10/24/2023] [Indexed: 12/20/2023] Open
Abstract
Purpose Recent advances in magnetic resonance (MR) scanner quality and the rapidly improving nature of facial recognition software have necessitated the introduction of MR defacing algorithms to protect patient privacy. As a result, there are a number of MR defacing algorithms available to the neuroimaging community, with several appearing in just the last 5 years. While some qualities of these defacing algorithms, such as patient identifiability, have been explored in the previous works, the potential impact of defacing on neuroimage processing has yet to be explored. Approach We qualitatively evaluate eight MR defacing algorithms on 179 subjects from the OASIS-3 cohort and 21 subjects from the Kirby-21 dataset. We also evaluate the effects of defacing on two neuroimaging pipelines-SLANT and FreeSurfer-by comparing the segmentation consistency between the original and defaced images. Results Defacing can alter brain segmentation and even lead to catastrophic failures, which are more frequent with some algorithms, such as Quickshear, MRI_Deface, and FSL_deface. Compared to FreeSurfer, SLANT is less affected by defacing. On outputs that pass the quality check, the effects of defacing are less pronounced than those of rescanning, as measured by the Dice similarity coefficient. Conclusions The effects of defacing are noticeable and should not be disregarded. Extra attention, in particular, should be paid to the possibility of catastrophic failures. It is crucial to adopt a robust defacing algorithm and perform a thorough quality check before releasing defaced datasets. To improve the reliability of analysis in scenarios involving defaced MRIs, it is encouraged to include multiple brain segmentation pipelines.
Collapse
Affiliation(s)
- Chenyu Gao
- Vanderbilt University, Department of Electrical and Computer Engineering, Nashville, Tennessee, United States
| | - Bennett A. Landman
- Vanderbilt University, Department of Electrical and Computer Engineering, Nashville, Tennessee, United States
| | - Jerry L. Prince
- The Johns Hopkins University, Department of Electrical and Computer Engineering, Baltimore, Maryland, United States
| | - Aaron Carass
- The Johns Hopkins University, Department of Electrical and Computer Engineering, Baltimore, Maryland, United States
| |
Collapse
|
9
|
Gao C, Landman BA, Prince JL, Carass A. A reproducibility evaluation of the effects of MRI defacing on brain segmentation. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2023:2023.05.15.23289995. [PMID: 37293070 PMCID: PMC10246049 DOI: 10.1101/2023.05.15.23289995] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Purpose Recent advances in magnetic resonance (MR) scanner quality and the rapidly improving nature of facial recognition software have necessitated the introduction of MR defacing algorithms to protect patient privacy. As a result, there are a number of MR defacing algorithms available to the neuroimaging community, with several appearing in just the last five years. While some qualities of these defacing algorithms, such as patient identifiability, have been explored in previous works, the potential impact of defacing on neuroimage processing has yet to be explored. Approach We qualitatively evaluate eight MR defacing algorithms on 179 subjects from the OASIS-3 cohort and the 21 subjects from the Kirby-21 dataset. We also evaluate the effects of defacing on two neuroimaging pipelines-SLANT and FreeSurfer-by comparing the segmentation consistency between the original and defaced images. Results Defacing can alter brain segmentation and even lead to catastrophic failures, which are more frequent with some algorithms such as Quickshear, MRI_Deface, and FSL_deface. Compared to FreeSurfer, SLANT is less affected by defacing. On outputs that pass the quality check, the effects of defacing are less pronounced than those of rescanning, as measured by the Dice similarity coefficient. Conclusions The effects of defacing are noticeable and should not be disregarded. Extra attention, in particular, should be paid to the possibility of catastrophic failures. It is crucial to adopt a robust defacing algorithm and perform a thorough quality check before releasing defaced datasets. To improve the reliability of analysis in scenarios involving defaced MRIs, it's encouraged to include multiple brain segmentation pipelines.
Collapse
Affiliation(s)
- Chenyu Gao
- Vanderbilt University, Department of Electrical and Computer Engineering, Nashville, Tennessee, 37235
| | - Bennett A. Landman
- Vanderbilt University, Department of Electrical and Computer Engineering, Nashville, Tennessee, 37235
| | - Jerry L. Prince
- The Johns Hopkins University, Department of Electrical and Computer Engineering, Baltimore, Maryland, 21218
| | - Aaron Carass
- The Johns Hopkins University, Department of Electrical and Computer Engineering, Baltimore, Maryland, 21218
| |
Collapse
|
10
|
Marschik PB, Kulvicius T, Flügge S, Widmann C, Nielsen-Saines K, Schulte-Rüther M, Hüning B, Bölte S, Poustka L, Sigafoos J, Wörgötter F, Einspieler C, Zhang D. Open video data sharing in developmental science and clinical practice. iScience 2023; 26:106348. [PMID: 36994082 PMCID: PMC10040728 DOI: 10.1016/j.isci.2023.106348] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2022] [Revised: 12/19/2022] [Accepted: 03/02/2023] [Indexed: 03/08/2023] Open
Abstract
In behavioral research and clinical practice video data has rarely been shared or pooled across sites due to ethical concerns of confidentiality, although the need of shared large-scaled datasets remains increasing. This demand is even more imperative when data-heavy computer-based approaches are involved. To share data while abiding by privacy protection rules, a critical question arises whether efforts at data de-identification reduce data utility? We addressed this question by showcasing an established and video-based diagnostic tool for detecting neurological deficits. We demonstrated for the first time that, for analyzing infant neuromotor functions, pseudonymization by face-blurring video recordings is a viable approach. The redaction did not affect classification accuracy for either human assessors or artificial intelligence methods, suggesting an adequate and easy-to-apply solution for sharing behavioral video data. Our work shall encourage more innovative solutions to share and merge stand-alone video datasets into large data pools to advance science and public health.
Collapse
Affiliation(s)
- Peter B. Marschik
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, 37075 Göttingen, Germany
- Center of Neurodevelopmental Disorders (KIND), Centre for Psychiatry Research; Department of Women’s and Children’s Health, Karolinska Institutet, 11330 Stockholm, Sweden
- iDN – interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, 8036 Graz, Austria
- Leibniz-ScienceCampus Primate Cognition, 37075 Göttingen, Germany
| | - Tomas Kulvicius
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, 37075 Göttingen, Germany
- Department for Computational Neuroscience, Third Institute of Physics-Biophysics, Georg-August-University of Göttingen, 37077 Göttingen, Germany
| | - Sarah Flügge
- Department for Computational Neuroscience, Third Institute of Physics-Biophysics, Georg-August-University of Göttingen, 37077 Göttingen, Germany
| | - Claudius Widmann
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, 37075 Göttingen, Germany
| | - Karin Nielsen-Saines
- Division of Pediatric Infectious Diseases, David Geffen UCLA School of Medicine Los Angeles, CA 90095, USA
| | - Martin Schulte-Rüther
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, 37075 Göttingen, Germany
- Leibniz-ScienceCampus Primate Cognition, 37075 Göttingen, Germany
| | - Britta Hüning
- Department of Pediatrics I, Neonatology, University Children’s Hospital Essen, University Duisburg-Essen, 45147 Essen, Germany
| | - Sven Bölte
- Center of Neurodevelopmental Disorders (KIND), Centre for Psychiatry Research; Department of Women’s and Children’s Health, Karolinska Institutet, 11330 Stockholm, Sweden
- Child and Adolescent Psychiatry, Stockholm Health Care Services, Region Stockholm, 11861 Stockholm, Sweden
- Curtin Autism Research Group, Curtin School of Allied Health, Curtin University, 6102 Perth, WA
| | - Luise Poustka
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, 37075 Göttingen, Germany
- Leibniz-ScienceCampus Primate Cognition, 37075 Göttingen, Germany
| | - Jeff Sigafoos
- School of Education, Victoria University of Wellington, 6012 Wellington, New Zealand
| | - Florentin Wörgötter
- Leibniz-ScienceCampus Primate Cognition, 37075 Göttingen, Germany
- Department for Computational Neuroscience, Third Institute of Physics-Biophysics, Georg-August-University of Göttingen, 37077 Göttingen, Germany
| | - Christa Einspieler
- iDN – interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, 8036 Graz, Austria
| | - Dajie Zhang
- Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, 37075 Göttingen, Germany
- iDN – interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, 8036 Graz, Austria
- Leibniz-ScienceCampus Primate Cognition, 37075 Göttingen, Germany
| |
Collapse
|
11
|
Vinding MC, Oostenveld R. Sharing individualised template MRI data for MEG source reconstruction: A solution for open data while keeping subject confidentiality. Neuroimage 2022; 254:119165. [PMID: 35378289 DOI: 10.1016/j.neuroimage.2022.119165] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2021] [Revised: 03/12/2022] [Accepted: 03/30/2022] [Indexed: 01/10/2023] Open
Abstract
The increasing requirements for adoption of FAIR data management and sharing original research data from neuroimaging studies can be at odds with protecting the anonymity of the research participants due to the person-identifiable anatomical features in the data. We propose a solution to this dilemma for anatomical MRIs used in MEG source analysis. In MEG analysis, the channel-level data is reconstructed to the source-level using models derived from anatomical MRIs. Sharing data, therefore, requires sharing the anatomical MRI to replicate the analysis. The suggested solution is to replace the individual anatomical MRIs with individualised warped templates that can be used to carry out the MEG source analysis and that provide sufficient geometrical similarity to the original participants' MRIs. First, we demonstrate how the individualised template warping can be implemented with one of the leading open-source neuroimaging analysis toolboxes. Second, we compare results from four different MEG source reconstruction methods performed with an individualised warped template to those using the participant's original MRI. While the source reconstruction results are not numerically identical, there is a high similarity between the results for single dipole fits, dynamic imaging of coherent sources beamforming, and atlas-based virtual channel beamforming. There is a moderate similarity between minimum-norm estimates, as anticipated due to this method being anatomically constrained and dependent on the exact morphological features of the cortical sheet. We also compared the morphological features of the warped template to those of the original MRI. These showed a high similarity in grey matter volume and surface area, but a low similarity in the average cortical thickness and the mean folding index within cortical parcels. Taken together, this demonstrates that the results obtained by MEG source reconstruction can be preserved with the warped templates, whereas the anatomical and morphological fingerprint is sufficiently altered to protect the anonymity of research participants. In cases where participants consent to sharing anatomical MRI data, it remains preferable to share the original defaced data with an appropriate data use agreement. In cases where participants did not consent to share their MRIs, the individualised warped MRI template offers a good compromise in sharing data for reuse while retaining anonymity for research participants.
Collapse
Affiliation(s)
- Mikkel C Vinding
- NatMEG, Department of Clinical Neuroscience, Karolinska Institutet, Nobels väg 9, D2, Stockholm 171 77, Sweden; Danish Research Centre for Magnetic Resonance, Centre for Functional and Diagnostic Imaging and Research, Copenhagen University Hospital - Amager and Hvidovre, Copenhagen, Denmark.
| | - Robert Oostenveld
- NatMEG, Department of Clinical Neuroscience, Karolinska Institutet, Nobels väg 9, D2, Stockholm 171 77, Sweden; Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherland
| |
Collapse
|
12
|
Mikulan E, Russo S, Zauli FM, d'Orio P, Parmigiani S, Favaro J, Knight W, Squarza S, Perri P, Cardinale F, Avanzini P, Pigorini A. A comparative study between state-of-the-art MRI deidentification and AnonyMI, a new method combining re-identification risk reduction and geometrical preservation. Hum Brain Mapp 2021; 42:5523-5534. [PMID: 34520074 PMCID: PMC8559469 DOI: 10.1002/hbm.25639] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2020] [Revised: 08/11/2021] [Accepted: 08/12/2021] [Indexed: 01/03/2023] Open
Abstract
Deidentifying MRIs constitutes an imperative challenge, as it aims at precluding the possibility of re-identification of a research subject or patient, but at the same time it should preserve as much geometrical information as possible, in order to maximize data reusability and to facilitate interoperability. Although several deidentification methods exist, no comprehensive and comparative evaluation of deidentification performance has been carried out across them. Moreover, the possible ways these methods can compromise subsequent analysis has not been exhaustively tested. To tackle these issues, we developed AnonyMI, a novel MRI deidentification method, implemented as a user-friendly 3D Slicer plugin-in, which aims at providing a balance between identity protection and geometrical preservation. To test these features, we performed two series of analyses on which we compared AnonyMI to other two state-of-the-art methods, to evaluate, at the same time, how efficient they are at deidentifying MRIs and how much they affect subsequent analyses, with particular emphasis on source localization procedures. Our results show that all three methods significantly reduce the re-identification risk but AnonyMI provides the best geometrical conservation. Notably, it also offers several technical advantages such as a user-friendly interface, multiple input-output capabilities, the possibility of being tailored to specific needs, batch processing and efficient visualization for quality assurance.
Collapse
Affiliation(s)
- Ezequiel Mikulan
- Dipartimento di Scienze Biomediche e Cliniche "L.Sacco", Università degli Studi di Milano, Milano, Italy
| | - Simone Russo
- Dipartimento di Scienze Biomediche e Cliniche "L.Sacco", Università degli Studi di Milano, Milano, Italy
| | - Flavia Maria Zauli
- Dipartimento di Scienze Biomediche e Cliniche "L.Sacco", Università degli Studi di Milano, Milano, Italy
| | - Piergiorgio d'Orio
- "Claudio Munari" Epilepsy and Parkinson Surgery Center, ASST Grande Ospedale Metropolitano Niguarda, Milano, Italy
| | - Sara Parmigiani
- Dipartimento di Scienze Biomediche e Cliniche "L.Sacco", Università degli Studi di Milano, Milano, Italy
| | - Jacopo Favaro
- Department of Women's and Children's Health, Pediatric Neurology and Neurophysiology Unit, University of Padua, Padua, Italy
| | - William Knight
- Centre for Computing and Social Responsibility, De Montfort University, Leicester, UK
| | - Silvia Squarza
- Department of Neuroradiology, "Claudio Munari" Epilepsy and Parkinson Surgery Center, ASST Grande Ospedale Metropolitano Niguarda, Milano, Italy
| | - Pierluigi Perri
- Dipartimento di Scienze Giuridiche Cesare Beccaria, Università degli Studi di Milano, Milano, Italy
| | - Francesco Cardinale
- "Claudio Munari" Epilepsy and Parkinson Surgery Center, ASST Grande Ospedale Metropolitano Niguarda, Milano, Italy
| | - Pietro Avanzini
- Istituto di Neuroscienze, Consiglio Nazionale delle Ricerche, Parma, Italy
| | - Andrea Pigorini
- Dipartimento di Scienze Biomediche e Cliniche "L.Sacco", Università degli Studi di Milano, Milano, Italy
| |
Collapse
|