51
|
Mostapha M, Kim SH, Evans AC, Dager SR, Estes AM, McKinstry RC, Botteron KN, Gerig G, Pizer SM, Schultz RT, Hazlett HC, Piven J, Girault JB, Shen MD, Styner MA. A Novel Method for High-Dimensional Anatomical Mapping of Extra-Axial Cerebrospinal Fluid: Application to the Infant Brain. Front Neurosci 2020; 14:561556. [PMID: 33132824 PMCID: PMC7561674 DOI: 10.3389/fnins.2020.561556] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2020] [Accepted: 08/21/2020] [Indexed: 12/21/2022] Open
Abstract
Cerebrospinal fluid (CSF) plays an essential role in early postnatal brain development. Extra-axial CSF (EA-CSF) volume, which is characterized by CSF in the subarachnoid space surrounding the brain, is a promising marker in the early detection of young children at risk for neurodevelopmental disorders. Previous studies have focused on global EA-CSF volume across the entire dorsal extent of the brain, and not regionally-specific EA-CSF measurements, because no tools were previously available for extracting local EA-CSF measures suitable for localized cortical surface analysis. In this paper, we propose a novel framework for the localized, cortical surface-based analysis of EA-CSF. The proposed processing framework combines probabilistic brain tissue segmentation, cortical surface reconstruction, and streamline-based local EA-CSF quantification. The quantitative analysis of local EA-CSF was applied to a dataset of typically developing infants with longitudinal MRI scans from 6 to 24 months of age. There was a high degree of consistency in the spatial patterns of local EA-CSF across age using the proposed methods. Statistical analysis of local EA-CSF revealed several novel findings: several regions of the cerebral cortex showed reductions in EA-CSF from 6 to 24 months of age, and specific regions showed higher local EA-CSF in males compared to females. These age-, sex-, and anatomically-specific patterns of local EA-CSF would not have been observed if only a global EA-CSF measure were utilized. The proposed methods are integrated into a freely available, open-source, cross-platform, user-friendly software tool, allowing neuroimaging labs to quantify local extra-axial CSF in their neuroimaging studies to investigate its role in typical and atypical brain development.
Collapse
Affiliation(s)
- Mahmoud Mostapha
- Department of Computer Science, University of North Carolina, Chapel Hill, NC, United States
| | - Sun Hyung Kim
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
| | - Alan C. Evans
- Montreal Neurological Institute, McGill University, Montreal, QC, Canada
| | - Stephen R. Dager
- Department of Radiology, University of Washington, Seattle, WA, United States
| | - Annette M. Estes
- Department of Speech and Hearing Sciences, University of Washington, Seattle, WA, United States
| | - Robert C. McKinstry
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, United States
| | - Kelly N. Botteron
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, United States
- Department of Psychiatry, Washington University School of Medicine, St. Louis, MO, United States
| | - Guido Gerig
- Department of Computer Science and Engineering, New York University, New York, NY, United States
| | - Stephen M. Pizer
- Department of Computer Science, University of North Carolina, Chapel Hill, NC, United States
| | - Robert T. Schultz
- Department of Pediatrics, Center for Autism Research, Children's Hospital of Philadelphia, University of Pennsylvania, Philadelphia, PA, United States
| | - Heather C. Hazlett
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
- Carolina Institute for Developmental Disabilities, UNC School of Medicine, University of North Carolina-Chapel Hill, Chapel Hill, NC, United States
| | - Joseph Piven
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
- Carolina Institute for Developmental Disabilities, UNC School of Medicine, University of North Carolina-Chapel Hill, Chapel Hill, NC, United States
| | - Jessica B. Girault
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
- Carolina Institute for Developmental Disabilities, UNC School of Medicine, University of North Carolina-Chapel Hill, Chapel Hill, NC, United States
| | - Mark D. Shen
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
- Carolina Institute for Developmental Disabilities, UNC School of Medicine, University of North Carolina-Chapel Hill, Chapel Hill, NC, United States
- UNC Neuroscience Center, University of North Carolina-Chapel Hill, Chapel Hill, NC, United States
| | - Martin A. Styner
- Department of Computer Science, University of North Carolina, Chapel Hill, NC, United States
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
| |
Collapse
|
52
|
Classification of Alzheimer's Disease and Mild Cognitive Impairment Based on Cortical and Subcortical Features from MRI T1 Brain Images Utilizing Four Different Types of Datasets. JOURNAL OF HEALTHCARE ENGINEERING 2020; 2020:3743171. [PMID: 32952988 PMCID: PMC7482016 DOI: 10.1155/2020/3743171] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2019] [Revised: 07/09/2020] [Accepted: 07/14/2020] [Indexed: 01/18/2023]
Abstract
Alzheimer's disease (AD) is one of the most common neurodegenerative illnesses (dementia) among the elderly. Recently, researchers have developed a new method for the instinctive analysis of AD based on machine learning and its subfield, deep learning. Recent state-of-the-art techniques consider multimodal diagnosis, which has been shown to achieve high accuracy compared to a unimodal prognosis. Furthermore, many studies have used structural magnetic resonance imaging (MRI) to measure brain volumes and the volume of subregions, as well as to search for diffuse changes in white/gray matter in the brain. In this study, T1-weighted structural MRI was used for the early classification of AD. MRI results in high-intensity visible features, making preprocessing and segmentation easy. To use this image modality, we acquired four types of datasets from each dataset's server. In this work, we downloaded 326 subjects from the National Research Center for Dementia homepage, 123 subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI) homepage, 121 subjects from the Alzheimer's Disease Repository Without Borders homepage, and 131 subjects from the National Alzheimer's Coordinating Center homepage. In our experiment, we used the multiatlas label propagation with expectation–maximization-based refinement segmentation method. We segmented the images into 138 anatomical morphometry images (in which 40 features belonged to subcortical volumes and the remaining 98 features belonged to cortical thickness). The entire dataset was split into a 70 : 30 (training and testing) ratio before classifying the data. A principal component analysis was used for dimensionality reduction. Then, the support vector machine radial basis function classifier was used for classification between two groups—AD versus health control (HC) and early mild cognitive impairment (MCI) (EMCI) versus late MCI (LMCI). The proposed method performed very well for all four types of dataset. For instance, for the AD versus HC group, the classifier achieved an area under curve (AUC) of more than 89% for each dataset. For the EMCI versus LMCI group, the classifier achieved an AUC of more than 80% for every dataset. Moreover, we also calculated Cohen kappa and Jaccard index statistical values for all datasets to evaluate the classification reliability. Finally, we compared our results with those of recently published state-of-the-art methods.
Collapse
|
53
|
Alemán-Gómez Y, Najdenovska E, Roine T, Fartaria MJ, Canales-Rodríguez EJ, Rovó Z, Hagmann P, Conus P, Do KQ, Klauser P, Steullet P, Baumann PS, Bach Cuadra M. Partial-volume modeling reveals reduced gray matter in specific thalamic nuclei early in the time course of psychosis and chronic schizophrenia. Hum Brain Mapp 2020; 41:4041-4061. [PMID: 33448519 PMCID: PMC7469814 DOI: 10.1002/hbm.25108] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2020] [Revised: 04/22/2020] [Accepted: 06/14/2020] [Indexed: 12/20/2022] Open
Abstract
The structural complexity of the thalamus, due to its mixed composition of gray and white matter, make it challenging to disjoint and quantify each tissue contribution to the thalamic anatomy. This work promotes the use of partial‐volume‐based over probabilistic‐based tissue segmentation approaches to better capture thalamic gray matter differences between patients at different stages of psychosis (early and chronic) and healthy controls. The study was performed on a cohort of 23 patients with schizophrenia, 41 with early psychosis and 69 age and sex‐matched healthy subjects. Six tissue segmentation approaches were employed to obtain the gray matter concentration/probability images. The statistical tests were applied at three different anatomical scales: whole thalamus, thalamic subregions and voxel‐wise. The results suggest that the partial volume model estimation of gray matter is more sensitive to detect atrophies within the thalamus of patients with psychosis. However all the methods detected gray matter deficit in the pulvinar, particularly in early stages of psychosis. This study demonstrates also that the gray matter decrease varies nonlinearly with age and between nuclei. While a gray matter loss was found in the pulvinar of patients in both stages of psychosis, reduced gray matter in the mediodorsal was only observed in early psychosis subjects. Finally, our analyses point to alterations in a sub‐region comprising the lateral posterior and ventral posterior nuclei. The obtained results reinforce the hypothesis that thalamic gray matter assessment is more reliable when the tissues segmentation method takes into account the partial volume effect.
Collapse
Affiliation(s)
- Yasser Alemán-Gómez
- Center for Psychiatric Neuroscience, Department of Psychiatry, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland.,Department of Radiology, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland.,Medical Image Analysis Laboratory (MIAL), Centre d'Imagerie BioMédicale (CIBM), Switzerland
| | - Elena Najdenovska
- Department of Radiology, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland.,Medical Image Analysis Laboratory (MIAL), Centre d'Imagerie BioMédicale (CIBM), Switzerland.,Signal Processing Laboratory (LTS5), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Timo Roine
- Center for Psychiatric Neuroscience, Department of Psychiatry, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland.,Department of Radiology, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland.,Medical Image Analysis Laboratory (MIAL), Centre d'Imagerie BioMédicale (CIBM), Switzerland
| | - Mário João Fartaria
- Medical Image Analysis Laboratory (MIAL), Centre d'Imagerie BioMédicale (CIBM), Switzerland.,Signal Processing Laboratory (LTS5), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland.,Advanced Clinical Imaging Technology, Siemens Healthcare AG, Lausanne, Switzerland
| | - Erick J Canales-Rodríguez
- Department of Radiology, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland.,Signal Processing Laboratory (LTS5), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland.,FIDMAG Germanes Hospitalàries Research Foundation, Sant Boi de Llobregat, Barcelona, Spain
| | - Zita Rovó
- Center for Psychiatric Neuroscience, Department of Psychiatry, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland
| | - Patric Hagmann
- Department of Radiology, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland
| | - Philippe Conus
- Service of General Psychiatry, Department of Psychiatry, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland
| | - Kim Q Do
- Center for Psychiatric Neuroscience, Department of Psychiatry, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland
| | - Paul Klauser
- Center for Psychiatric Neuroscience, Department of Psychiatry, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland
| | - Pascal Steullet
- Center for Psychiatric Neuroscience, Department of Psychiatry, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland
| | - Philipp S Baumann
- Center for Psychiatric Neuroscience, Department of Psychiatry, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland.,Service of General Psychiatry, Department of Psychiatry, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland
| | - Meritxell Bach Cuadra
- Department of Radiology, Centre Hospitalier Universitaire Vaudois (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland.,Medical Image Analysis Laboratory (MIAL), Centre d'Imagerie BioMédicale (CIBM), Switzerland.,Signal Processing Laboratory (LTS5), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| |
Collapse
|
54
|
Meyerhoff DJ, Durazzo TC. Not All Is Lost for Relapsers: Relapsers With Low WHO Risk Drinking Levels and Complete Abstainers Have Comparable Regional Gray Matter Volumes. Alcohol Res 2020. [PMCID: PMC7383772 DOI: 10.1111/acer.14377] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022] Open
Affiliation(s)
- Dieter J. Meyerhoff
- From the Center for Imaging of Neurodegenerative Diseases (CIND) (DJM) San Francisco VA Medical Center San Francisco California
- Department of Radiology and Biomedical Imaging (DJM) University of California San Francisco California
| | - Timothy C. Durazzo
- Mental Illness Research and Education Clinical Centers (TCD) VA Palo Alto Health Care System Palo Alto California
- Department of Psychiatry and Behavioral Sciences (TCD) Stanford University School of Medicine Stanford California
| |
Collapse
|
55
|
Onofrey JA, Staib LH, Huang X, Zhang F, Papademetris X, Metaxas D, Rueckert D, Duncan JS. Sparse Data-Driven Learning for Effective and Efficient Biomedical Image Segmentation. Annu Rev Biomed Eng 2020; 22:127-153. [PMID: 32169002 PMCID: PMC9351438 DOI: 10.1146/annurev-bioeng-060418-052147] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Sparsity is a powerful concept to exploit for high-dimensional machine learning and associated representational and computational efficiency. Sparsity is well suited for medical image segmentation. We present a selection of techniques that incorporate sparsity, including strategies based on dictionary learning and deep learning, that are aimed at medical image segmentation and related quantification.
Collapse
Affiliation(s)
- John A Onofrey
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, Connecticut 06520, USA;
- Department of Urology, Yale School of Medicine, New Haven, Connecticut 06520, USA
| | - Lawrence H Staib
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, Connecticut 06520, USA;
- Department of Biomedical Engineering, Yale University, New Haven, Connecticut 06520, USA;
| | - Xiaojie Huang
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, Connecticut 06520, USA;
- Citadel Securities, Chicago, Illinois 60603, USA
| | - Fan Zhang
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, Connecticut 06520, USA;
| | - Xenophon Papademetris
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, Connecticut 06520, USA;
- Department of Biomedical Engineering, Yale University, New Haven, Connecticut 06520, USA;
| | - Dimitris Metaxas
- Department of Computer Science, Rutgers University, Piscataway, New Jersey 08854, USA
| | - Daniel Rueckert
- Department of Computing, Imperial College London, London SW7 2AZ, United Kingdom
| | - James S Duncan
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, Connecticut 06520, USA;
- Department of Biomedical Engineering, Yale University, New Haven, Connecticut 06520, USA;
| |
Collapse
|
56
|
Fiford CM, Sudre CH, Pemberton H, Walsh P, Manning E, Malone IB, Nicholas J, Bouvy WH, Carmichael OT, Biessels GJ, Cardoso MJ, Barnes J. Automated White Matter Hyperintensity Segmentation Using Bayesian Model Selection: Assessment and Correlations with Cognitive Change. Neuroinformatics 2020; 18:429-449. [PMID: 32062817 PMCID: PMC7338814 DOI: 10.1007/s12021-019-09439-6] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Abstract
Accurate, automated white matter hyperintensity (WMH) segmentations are needed for large-scale studies to understand contributions of WMH to neurological diseases. We evaluated Bayesian Model Selection (BaMoS), a hierarchical fully-unsupervised model selection framework for WMH segmentation. We compared BaMoS segmentations to semi-automated segmentations, and assessed whether they predicted longitudinal cognitive change in control, early Mild Cognitive Impairment (EMCI), late Mild Cognitive Impairment (LMCI), subjective/significant memory concern (SMC) and Alzheimer's (AD) participants. Data were downloaded from the Alzheimer's disease Neuroimaging Initiative (ADNI). Magnetic resonance images from 30 control and 30 AD participants were selected to incorporate multiple scanners, and were semi-automatically segmented by 4 raters and BaMoS. Segmentations were assessed using volume correlation, Dice score, and other spatial metrics. Linear mixed-effect models were fitted to 180 control, 107 SMC, 320 EMCI, 171 LMCI and 151 AD participants separately in each group, with the outcomes being cognitive change (e.g. mini-mental state examination; MMSE), and BaMoS WMH, age, sex, race and education used as predictors. There was a high level of agreement between BaMoS' WMH segmentation volumes and a consensus of rater segmentations, with a median Dice score of 0.74 and correlation coefficient of 0.96. BaMoS WMH predicted cognitive change in: control, EMCI, and SMC groups using MMSE; LMCI using clinical dementia rating scale; and EMCI using Alzheimer's disease assessment scale-cognitive subscale (p < 0.05, all tests). BaMoS compares well to semi-automated segmentation, is robust to different WMH loads and scanners, and can generate volumes which predict decline. BaMoS can be applicable to further large-scale studies.
Collapse
Affiliation(s)
- Cassidy M. Fiford
- Dementia Research Centre, Department of Neurodegenerative Disease, UCL Queen Square Institute of Neurology, London, UK
| | - Carole H. Sudre
- Dementia Research Centre, Department of Neurodegenerative Disease, UCL Queen Square Institute of Neurology, London, UK
- School of Biomedical Engineering and Imaging Sciences, King’s College London, London, UK
- Department of Medical Physics and Biomedical Engineering, University College London, London, UK
| | - Hugh Pemberton
- Dementia Research Centre, Department of Neurodegenerative Disease, UCL Queen Square Institute of Neurology, London, UK
| | - Phoebe Walsh
- Dementia Research Centre, Department of Neurodegenerative Disease, UCL Queen Square Institute of Neurology, London, UK
| | - Emily Manning
- Dementia Research Centre, Department of Neurodegenerative Disease, UCL Queen Square Institute of Neurology, London, UK
| | - Ian B. Malone
- Dementia Research Centre, Department of Neurodegenerative Disease, UCL Queen Square Institute of Neurology, London, UK
| | | | - Willem H Bouvy
- Department of Neurology and Neurosurgery, Brain Center Rudolf Magnus, University Medical Center Utrecht, Utrecht, the Netherlands
| | | | - Geert Jan Biessels
- Department of Neurology and Neurosurgery, Brain Center Rudolf Magnus, University Medical Center Utrecht, Utrecht, the Netherlands
| | - M. Jorge Cardoso
- Dementia Research Centre, Department of Neurodegenerative Disease, UCL Queen Square Institute of Neurology, London, UK
- School of Biomedical Engineering and Imaging Sciences, King’s College London, London, UK
- Department of Medical Physics and Biomedical Engineering, University College London, London, UK
| | - Josephine Barnes
- Dementia Research Centre, Department of Neurodegenerative Disease, UCL Queen Square Institute of Neurology, London, UK
| | - for the Alzheimer’s Disease Neuroimaging Initiative
- Dementia Research Centre, Department of Neurodegenerative Disease, UCL Queen Square Institute of Neurology, London, UK
- School of Biomedical Engineering and Imaging Sciences, King’s College London, London, UK
- Department of Medical Physics and Biomedical Engineering, University College London, London, UK
- London School of Hygiene and Tropical Medicine, London, UK
- Department of Neurology and Neurosurgery, Brain Center Rudolf Magnus, University Medical Center Utrecht, Utrecht, the Netherlands
- Pennington Biomedical Research Center, Baton Rouge, LA USA
| |
Collapse
|
57
|
Cespedes MI, McGree JM, Drovandi CC, Mengersen K, Fripp J, Doecke JD. Relative rate of change in cognitive score network dynamics via Bayesian hierarchical models reveal spatial patterns of neurodegeneration. Stat Med 2020; 39:2695-2713. [PMID: 32419227 DOI: 10.1002/sim.8568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2018] [Revised: 04/15/2020] [Accepted: 04/16/2020] [Indexed: 11/11/2022]
Abstract
The degeneration of the human brain is a complex process, which often affects certain brain regions due to healthy aging or disease. This degeneration can be evaluated on regions of interest (ROI) in the brain through probabilistic networks and morphological estimates. Current approaches for finding such networks are limited to analyses at discrete neuropsychological stages, which cannot appropriately account for connectivity dynamics over the onset of cognitive deterioration, and morphological changes are seldom unified with connectivity networks, despite known dependencies. To overcome these limitations, a probabilistic wombling model is proposed to simultaneously estimate ROI cortical thickness and covariance networks contingent on rates of change in cognitive decline. This proposed model was applied to analyze longitudinal data from healthy control (HC) and Alzheimer's disease (AD) groups and found connection differences pertaining to regions, which play a crucial role in lasting cognitive impairment, such as the entorhinal area and temporal regions. Moreover, HC cortical thickness estimates were significantly higher than those in the AD group across all ROIs. The analyses presented in this work will help practitioners jointly analyze brain tissue atrophy at the ROI-level conditional on neuropsychological networks, which could potentially allow for more targeted therapeutic interventions.
Collapse
Affiliation(s)
- Marcela I Cespedes
- CSIRO Health and Biosecurity, Australian E-Health Research Centre, Herston, Queensland, Australia
| | - James M McGree
- ARC Centre for Mathematical and Statistical Frontiers and School of Mathematical Sciences, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Christopher C Drovandi
- ARC Centre for Mathematical and Statistical Frontiers and School of Mathematical Sciences, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Kerrie Mengersen
- ARC Centre for Mathematical and Statistical Frontiers and School of Mathematical Sciences, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Jurgen Fripp
- CSIRO Health and Biosecurity, Australian E-Health Research Centre, Herston, Queensland, Australia
| | - James D Doecke
- CSIRO Health and Biosecurity, Australian E-Health Research Centre, Herston, Queensland, Australia
| |
Collapse
|
58
|
Pan D, Zeng A, Jia L, Huang Y, Frizzell T, Song X. Early Detection of Alzheimer's Disease Using Magnetic Resonance Imaging: A Novel Approach Combining Convolutional Neural Networks and Ensemble Learning. Front Neurosci 2020; 14:259. [PMID: 32477040 PMCID: PMC7238823 DOI: 10.3389/fnins.2020.00259] [Citation(s) in RCA: 88] [Impact Index Per Article: 17.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2019] [Accepted: 03/09/2020] [Indexed: 01/25/2023] Open
Abstract
Early detection is critical for effective management of Alzheimer's disease (AD) and screening for mild cognitive impairment (MCI) is common practice. Among several deep-learning techniques that have been applied to assessing structural brain changes on magnetic resonance imaging (MRI), convolutional neural network (CNN) has gained popularity due to its superb efficiency in automated feature learning with the use of a variety of multilayer perceptrons. Meanwhile, ensemble learning (EL) has shown to be beneficial in the robustness of learning-system performance via integrating multiple models. Here, we proposed a classifier ensemble developed by combining CNN and EL, i.e., the CNN-EL approach, to identify subjects with MCI or AD using MRI: i.e., classification between (1) AD and healthy cognition (HC), (2) MCIc (MCI patients who will convert to AD) and HC, and (3) MCIc and MCInc (MCI patients who will not convert to AD). For each binary classification task, a large number of CNN models were trained applying a set of sagittal, coronal, or transverse MRI slices; these CNN models were then integrated into a single ensemble. Performance of the ensemble was evaluated using stratified fivefold cross-validation method for 10 times. The number of the intersection points determined by the most discriminable slices separating two classes in a binary classification task among the sagittal, coronal, and transverse slice sets, transformed into the standard Montreal Neurological Institute (MNI) space, acted as an indicator to assess the ability of a brain region in which the points were located to classify AD. Thus, the brain regions with most intersection points were considered as those mostly contributing to the early diagnosis of AD. The result revealed an accuracy rate of 0.84 ± 0.05, 0.79 ± 0.04, and 0.62 ± 0.06, respectively, for classifying AD vs. HC, MCIc vs. HC, and MCIc vs. MCInc, comparable to previous reports and a 3D deep learning approach (3D-SENet) based on a more state-of-the-art and popular Squeeze-and-Excitation Networks model using channel attention mechanism. Notably, the intersection points accurately located the medial temporal lobe and several other structures of the limbic system, i.e., brain regions known to be struck early in AD. More interestingly, the classifiers disclosed multiple patterned MRI changes in the brain in AD and MCIc, involving these key regions. These results suggest that as a data-driven method, the combined CNN and EL approach can locate the most discriminable brain regions indicated by the trained ensemble model while the generalization ability of the ensemble model was maximized to successfully capture AD-related brain variations early in the disease process; it can also provide new insights into understanding the complex heterogeneity of whole-brain MRI changes in AD. Further research is needed to examine the clinical implication of the finding, capability of the advocated CNN-EL approach to help understand and evaluate an individual subject's disease status, symptom burden and progress, and the generalizability of the advocated CNN-EL approach to locate the most discriminable brain regions in the detection of other brain disorders such as schizophrenia, autism, and severe depression, in a data-driven way.
Collapse
Affiliation(s)
- Dan Pan
- School of Computers, Guangdong University of Technology, Guangzhou, China
| | - An Zeng
- School of Computers, Guangdong University of Technology, Guangzhou, China
- Guangdong Key Laboratory of Big Data Analysis and Processing, Guangzhou, China
| | - Longfei Jia
- School of Computers, Guangdong University of Technology, Guangzhou, China
| | - Yin Huang
- School of Computers, Guangdong University of Technology, Guangzhou, China
| | - Tory Frizzell
- SFU ImageTech Lab, Surrey Memorial Hospital, Fraser Health, Surrey, BC, Canada
| | - Xiaowei Song
- SFU ImageTech Lab, Surrey Memorial Hospital, Fraser Health, Surrey, BC, Canada
| |
Collapse
|
59
|
Sun L, Ma W, Ding X, Huang Y, Liang D, Paisley J. A 3D Spatially Weighted Network for Segmentation of Brain Tissue From MRI. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:898-909. [PMID: 31449009 DOI: 10.1109/tmi.2019.2937271] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
The segmentation of brain tissue in MRI is valuable for extracting brain structure to aid diagnosis, treatment and tracking the progression of different neurologic diseases. Medical image data are volumetric and some neural network models for medical image segmentation have addressed this using a 3D convolutional architecture. However, this volumetric spatial information has not been fully exploited to enhance the representative ability of deep networks, and these networks have not fully addressed the practical issues facing the analysis of multimodal MRI data. In this paper, we propose a spatially-weighted 3D network (SW-3D-UNet) for brain tissue segmentation of single-modality MRI, and extend it using multimodality MRI data. We validate our model on the MRBrainS13 and MALC12 datasets. This unpublished model ranked first on the leaderboard of the MRBrainS13 Challenge.
Collapse
|
60
|
Billot B, Robinson E, Dalca AV, Iglesias JE. Partial Volume Segmentation of Brain MRI Scans of Any Resolution and Contrast. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION – MICCAI 2020 2020. [DOI: 10.1007/978-3-030-59728-3_18] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
61
|
|
62
|
Dang C, Yassi N, Harrington KD, Xia Y, Lim YY, Ames D, Laws SM, Hickey M, Rainey-Smith S, Sohrabi HR, Doecke JD, Fripp J, Salvado O, Snyder PJ, Weinborn M, Villemagne VL, Rowe CC, Masters CL, Maruff P. Rates of age- and amyloid β-associated cortical atrophy in older adults with superior memory performance. ALZHEIMER'S & DEMENTIA (AMSTERDAM, NETHERLANDS) 2019; 11:566-575. [PMID: 31909172 PMCID: PMC6939054 DOI: 10.1016/j.dadm.2019.05.005] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
INTRODUCTION Superior cognitive performance in older adults may reflect underlying resistance to age-associated neurodegeneration. While elevated amyloid β (Aβ) deposition (Aβ+) has been associated with increased cortical atrophy, it remains unknown whether "SuperAgers" may be protected from Aβ-associated neurodegeneration. METHODS Neuropsychologically defined SuperAgers (n = 172) and cognitively normal for age (n = 172) older adults from the Australian Imaging, Biomarkers and Lifestyle study were case matched. Rates of cortical atrophy over 8 years were examined by SuperAger classification and Aβ status. RESULTS Of the case-matched SuperAgers and cognitively normal for age older adults, 40.7% and 40.1%, respectively, were Aβ+. Rates of age- and Aβ-associated atrophy did not differ between the groups on any measure. Aβ- individuals displayed the slowest rates of atrophy. DISCUSSION Maintenance of superior memory in late life does not reflect resistance to age- or Aβ-associated atrophy. However, those individuals who reached old age without cognitive impairment nor elevated Aβ deposition (i.e. Aβ-) displayed reduced rates of cortical atrophy.
Collapse
Affiliation(s)
- Christa Dang
- Department of Obstetrics and Gynaecology, Melbourne Medical School, The University of Melbourne, Parkville, Victoria, Australia
- The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Parkville, Victoria, Australia
| | - Nawaf Yassi
- The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Parkville, Victoria, Australia
- Department of Medicine and Neurology, Royal Melbourne Hospital, Melbourne, Victoria, Australia
| | - Karra D. Harrington
- The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Parkville, Victoria, Australia
- Cooperative Research Centre for Mental Health, Parkville, Victoria, Australia
| | - Ying Xia
- CSIRO Health and Biosecurity, the Australian eHealth Research Centre, Brisbane, Queensland, Australia
| | - Yen Ying Lim
- The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Parkville, Victoria, Australia
| | - David Ames
- Academic Unit for Psychiatry of Old Age, Department of Psychiatry, The University of Melbourne, Parkville, Victoria, Australia
- National Ageing Research Institute, Parkville, Victoria, Australia
| | - Simon M. Laws
- Cooperative Research Centre for Mental Health, Parkville, Victoria, Australia
- Collaborative Genomics Group, Centre of Excellence for Alzheimer's Disease Research and Care, School of Exercise, Biomedical and Health Sciences, Edith Cowan University, Perth, Western Australia, Australia
- School of Biomedical Sciences, Faculty of Health Sciences, Curtin Health Innovation Research Institute, Curtin University, Perth, Western Australia, Australia
| | - Martha Hickey
- Department of Obstetrics and Gynaecology, Melbourne Medical School, The University of Melbourne, Parkville, Victoria, Australia
| | - Stephanie Rainey-Smith
- Centre of Excellence for Alzheimer's Disease Research and Care, School of Exercise, Biomedical and Health Sciences, Edith Cowan University, Perth, Western Australia, Australia
- Australian Alzheimer's Disease Research Unit, Hollywood Private Hospital, Perth, Western Australia, Australia
| | - Hamid R. Sohrabi
- Centre of Excellence for Alzheimer's Disease Research and Care, School of Exercise, Biomedical and Health Sciences, Edith Cowan University, Perth, Western Australia, Australia
- School of Psychiatry and Clinical Neurosciences, University of Western Australia, Nedlands, Western Australia, Australia
| | - James D. Doecke
- CSIRO Health and Biosecurity, the Australian eHealth Research Centre, Brisbane, Queensland, Australia
| | - Jurgen Fripp
- CSIRO Health and Biosecurity, the Australian eHealth Research Centre, Brisbane, Queensland, Australia
| | - Olivier Salvado
- CSIRO Health and Biosecurity, the Australian eHealth Research Centre, Brisbane, Queensland, Australia
| | - Peter J. Snyder
- George & Anne Ryan Institute for Neuroscience, The University of Rhode Island, Kingston, RI, USA
| | - Michael Weinborn
- Centre of Excellence for Alzheimer's Disease Research and Care, School of Exercise, Biomedical and Health Sciences, Edith Cowan University, Perth, Western Australia, Australia
- Australian Alzheimer's Disease Research Unit, Hollywood Private Hospital, Perth, Western Australia, Australia
- School of Psychological Science, University of Western Australia, Crawley, Western Australia, Australia
| | - Victor L. Villemagne
- The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Parkville, Victoria, Australia
- Department of Molecular Imaging & Therapy, Austin Health, Melbourne, Victoria, Australia
- Department of Medicine, Austin Health, The University of Melbourne, Melbourne, Victoria, Australia
| | - Christopher C. Rowe
- Department of Molecular Imaging & Therapy, Austin Health, Melbourne, Victoria, Australia
- Department of Medicine, Austin Health, The University of Melbourne, Melbourne, Victoria, Australia
| | - Colin L. Masters
- The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Parkville, Victoria, Australia
| | - Paul Maruff
- The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Parkville, Victoria, Australia
- CogState Ltd., Melbourne, Victoria, Australia
| |
Collapse
|
63
|
Zhuang X. Multivariate Mixture Model for Myocardial Segmentation Combining Multi-Source Images. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2019; 41:2933-2946. [PMID: 30207950 DOI: 10.1109/tpami.2018.2869576] [Citation(s) in RCA: 85] [Impact Index Per Article: 14.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
The author proposes a method for simultaneous registration and segmentation of multi-source images, using the multivariate mixture model (MvMM) and maximum of log-likelihood (LL) framework. Specifically, the method is applied to the problem of myocardial segmentation combining the complementary information from multi-sequence (MS) cardiac magnetic resonance (CMR) images. For the image misalignment and incongruent data, the MvMM is formulated with transformations and is further generalized for dealing with the hetero-coverage multi-modality images (HC-MMIs). The segmentation of MvMM is performed in a virtual common space, to which all the images and misaligned slices are simultaneously registered. Furthermore, this common space can be divided into a number of sub-regions, each of which contains congruent data, thus the HC-MMIs can be modeled using a set of conventional MvMMs. Results show that MvMM obtained significantly better performance compared to the conventional approaches and demonstrated good potential for scar quantification as well as myocardial segmentation. The generalized MvMM has also demonstrated better robustness in the incongruent data, where some images may not fully cover the region of interest, and the full coverage can only be reconstructed combining the images from multiple sources.
Collapse
|
64
|
Multi-channeled MR brain image segmentation: A new automated approach combining BAT and clustering technique for better identification of heterogeneous tumors. Biocybern Biomed Eng 2019. [DOI: 10.1016/j.bbe.2019.05.007] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
65
|
Bermudez Noguera C, Bao S, Petersen KJ, Lopez AM, Reid J, Plassard AJ, Zald DH, Claassen DO, Dawant BM, Landman BA. Using deep learning for a diffusion-based segmentation of the dentate nucleus and its benefits over atlas-based methods. J Med Imaging (Bellingham) 2019; 6:044007. [PMID: 31824980 PMCID: PMC6895566 DOI: 10.1117/1.jmi.6.4.044007] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2019] [Accepted: 11/18/2019] [Indexed: 01/17/2023] Open
Abstract
The dentate nucleus (DN) is a gray matter structure deep in the cerebellum involved in motor coordination, sensory input integration, executive planning, language, and visuospatial function. The DN is an emerging biomarker of disease, informing studies that advance pathophysiologic understanding of neurodegenerative and related disorders. The main challenge in defining the DN radiologically is that, like many deep gray matter structures, it has poor contrast in T1-weighted magnetic resonance (MR) images and therefore requires specialized MR acquisitions for visualization. Manual tracing of the DN across multiple acquisitions is resource-intensive and does not scale well to large datasets. We describe a technique that automatically segments the DN using deep learning (DL) on common imaging sequences, such as T1-weighted, T2-weighted, and diffusion MR imaging. We trained a DL algorithm that can automatically delineate the DN and provide an estimate of its volume. The automatic segmentation achieved higher agreement to the manual labels compared to template registration, which is the current common practice in DN segmentation or multiatlas segmentation of manual labels. Across all sequences, the FA maps achieved the highest mean Dice similarity coefficient (DSC) of 0.83 compared to T1 imaging ( DSC = 0.76 ), T2 imaging ( DSC = 0.79 ), or a multisequence approach ( DSC = 0.80 ). A single atlas registration approach using the spatially unbiased atlas template of the cerebellum and brainstem template achieved a DSC of 0.23, and multi-atlas segmentation achieved a DSC of 0.33. Overall, we propose a method of delineating the DN on clinical imaging that can reproduce manual labels with higher accuracy than current atlas-based tools.
Collapse
Affiliation(s)
- Camilo Bermudez Noguera
- Vanderbilt University, Department of Biomedical Engineering, Nashville, Tennessee, United States
| | - Shunxing Bao
- Vanderbilt University, Department of Electrical Engineering and Computer Science, Nashville, Tennessee, United States
| | - Kalen J. Petersen
- Vanderbilt University, Department of Neurology, Nashville, Tennessee, United States
| | - Alexander M. Lopez
- Vanderbilt University, Department of Neurology, Nashville, Tennessee, United States
| | - Jacqueline Reid
- Vanderbilt University, Department of Neurology, Nashville, Tennessee, United States
| | - Andrew J. Plassard
- Vanderbilt University, Department of Electrical Engineering and Computer Science, Nashville, Tennessee, United States
| | - David H. Zald
- Vanderbilt University, Department of Psychology and Psychiatry, Nashville, Tennessee, United States
| | - Daniel O. Claassen
- Vanderbilt University, Department of Neurology, Nashville, Tennessee, United States
| | - Benoit M. Dawant
- Vanderbilt University, Department of Biomedical Engineering, Nashville, Tennessee, United States
- Vanderbilt University, Department of Electrical Engineering and Computer Science, Nashville, Tennessee, United States
| | - Bennett A. Landman
- Vanderbilt University, Department of Biomedical Engineering, Nashville, Tennessee, United States
- Vanderbilt University, Department of Electrical Engineering and Computer Science, Nashville, Tennessee, United States
- Vanderbilt University, Department of Psychology and Psychiatry, Nashville, Tennessee, United States
| |
Collapse
|
66
|
Dalca AV, Yu E, Golland P, Fischl B, Sabuncu MR, Iglesias JE. Unsupervised Deep Learning for Bayesian Brain MRI Segmentation. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2019; 11766:356-365. [PMID: 32432231 PMCID: PMC7235150 DOI: 10.1007/978-3-030-32248-9_40] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/05/2022]
Abstract
Probabilistic atlas priors have been commonly used to derive adaptive and robust brain MRI segmentation algorithms. Widely-used neuroimage analysis pipelines rely heavily on these techniques, which are often computationally expensive. In contrast, there has been a recent surge of approaches that leverage deep learning to implement segmentation tools that are computationally efficient at test time. However, most of these strategies rely on learning from manually annotated images. These supervised deep learning methods are therefore sensitive to the intensity profiles in the training dataset. To develop a deep learning-based segmentation model for a new image dataset (e.g., of different contrast), one usually needs to create a new labeled training dataset, which can be prohibitively expensive, or rely on suboptimal ad hoc adaptation or augmentation approaches. In this paper, we propose an alternative strategy that combines a conventional probabilistic atlas-based segmentation with deep learning, enabling one to train a segmentation model for new MRI scans without the need for any manually segmented images. Our experiments include thousands of brain MRI scans and demonstrate that the proposed method achieves good accuracy for a brain MRI segmentation task for different MRI contrasts, requiring only approximately 15 seconds at test time on a GPU.
Collapse
Affiliation(s)
- Adrian V Dalca
- Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School
- Computer Science and Artificial Intelligence Laboratory (CSAIL), Massachusetts Institute of Technology
| | - Evan Yu
- Meinig School of Biomedical Engineering, Cornell University
| | - Polina Golland
- Computer Science and Artificial Intelligence Laboratory (CSAIL), Massachusetts Institute of Technology
| | - Bruce Fischl
- Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School
| | - Mert R Sabuncu
- Meinig School of Biomedical Engineering, Cornell University
- School of Electrical and Computer Engineering, Cornell University
| | - Juan Eugenio Iglesias
- Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School
- Computer Science and Artificial Intelligence Laboratory (CSAIL), Massachusetts Institute of Technology
- Centre for Medical Image Computing (CMIC), University College London
| |
Collapse
|
67
|
Quantitative assessment of myelination patterns in preterm neonates using T2-weighted MRI. Sci Rep 2019; 9:12938. [PMID: 31506514 PMCID: PMC6736873 DOI: 10.1038/s41598-019-49350-3] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2019] [Accepted: 08/14/2019] [Indexed: 11/08/2022] Open
Abstract
Myelination is considered to be an important developmental process during human brain maturation and closely correlated with gestational age. Quantitative assessment of the myelination status requires dedicated imaging, but the conventional T2-weighted scans routinely acquired during clinical imaging of neonates carry signatures that are thought to be associated with myelination. In this work, we develop a quatitative marker of progressing myelination for assessment preterm neonatal brain maturation based on novel automatic segmentation method for myelin-like signals on T2-weighted magnetic resonance images. Firstly we define a segmentation protocol for myelin-like signals. We then develop an expectation-maximization framework to obtain the automatic segmentations of myelin-like signals with explicit class for partial volume voxels whose locations are configured in relation to the composing pure tissues via second-order Markov random fields. The proposed segmentation achieves high Dice overlaps of 0.83 with manual annotations. The automatic segmentations are then used to track volumes of myelinated tissues in the regions of the central brain structures and brainstem. Finally, we construct a spatio-temporal growth models for myelin-like signals, which allows us to predict gestational age at scan in preterm infants with root mean squared error 1.41 weeks.
Collapse
|
68
|
Automatic Human Brain Tumor Detection in MRI Image Using Template-Based K Means and Improved Fuzzy C Means Clustering Algorithm. BIG DATA AND COGNITIVE COMPUTING 2019. [DOI: 10.3390/bdcc3020027] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In recent decades, human brain tumor detection has become one of the most challenging issues in medical science. In this paper, we propose a model that includes the template-based K means and improved fuzzy C means (TKFCM) algorithm for detecting human brain tumors in a magnetic resonance imaging (MRI) image. In this proposed algorithm, firstly, the template-based K-means algorithm is used to initialize segmentation significantly through the perfect selection of a template, based on gray-level intensity of image; secondly, the updated membership is determined by the distances from cluster centroid to cluster data points using the fuzzy C-means (FCM) algorithm while it contacts its best result, and finally, the improved FCM clustering algorithm is used for detecting tumor position by updating membership function that is obtained based on the different features of tumor image including Contrast, Energy, Dissimilarity, Homogeneity, Entropy, and Correlation. Simulation results show that the proposed algorithm achieves better detection of abnormal and normal tissues in the human brain under small detachment of gray-level intensity. In addition, this algorithm detects human brain tumors within a very short time—in seconds compared to minutes with other algorithms.
Collapse
|
69
|
Automatic Segmentation and Detection of Small Bowel Angioectasias in WCE Images. Ann Biomed Eng 2019; 47:1446-1462. [DOI: 10.1007/s10439-019-02248-7] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2018] [Accepted: 03/14/2019] [Indexed: 12/21/2022]
|
70
|
|
71
|
|
72
|
Schlegl T, Seeböck P, Waldstein SM, Langs G, Schmidt-Erfurth U. f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks. Med Image Anal 2019; 54:30-44. [PMID: 30831356 DOI: 10.1016/j.media.2019.01.010] [Citation(s) in RCA: 235] [Impact Index Per Article: 39.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2018] [Revised: 11/24/2018] [Accepted: 01/30/2019] [Indexed: 01/11/2023]
Abstract
Obtaining expert labels in clinical imaging is difficult since exhaustive annotation is time-consuming. Furthermore, not all possibly relevant markers may be known and sufficiently well described a priori to even guide annotation. While supervised learning yields good results if expert labeled training data is available, the visual variability, and thus the vocabulary of findings, we can detect and exploit, is limited to the annotated lesions. Here, we present fast AnoGAN (f-AnoGAN), a generative adversarial network (GAN) based unsupervised learning approach capable of identifying anomalous images and image segments, that can serve as imaging biomarker candidates. We build a generative model of healthy training data, and propose and evaluate a fast mapping technique of new data to the GAN's latent space. The mapping is based on a trained encoder, and anomalies are detected via a combined anomaly score based on the building blocks of the trained model - comprising a discriminator feature residual error and an image reconstruction error. In the experiments on optical coherence tomography data, we compare the proposed method with alternative approaches, and provide comprehensive empirical evidence that f-AnoGAN outperforms alternative approaches and yields high anomaly detection accuracy. In addition, a visual Turing test with two retina experts showed that the generated images are indistinguishable from real normal retinal OCT images. The f-AnoGAN code is available at https://github.com/tSchlegl/f-AnoGAN.
Collapse
Affiliation(s)
- Thomas Schlegl
- Computational Imaging Research Lab, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria; Christian Doppler Laboratory for Ophthalmic Image Analysis, Department of Ophthalmology and Optometry, Medical University Vienna, Austria. https://www.github.com/tSchlegl/f-AnoGAN
| | - Philipp Seeböck
- Computational Imaging Research Lab, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria; Christian Doppler Laboratory for Ophthalmic Image Analysis, Department of Ophthalmology and Optometry, Medical University Vienna, Austria
| | - Sebastian M Waldstein
- Christian Doppler Laboratory for Ophthalmic Image Analysis, Department of Ophthalmology and Optometry, Medical University Vienna, Austria
| | - Georg Langs
- Computational Imaging Research Lab, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria. http://www.cir.meduniwien.ac.at
| | - Ursula Schmidt-Erfurth
- Christian Doppler Laboratory for Ophthalmic Image Analysis, Department of Ophthalmology and Optometry, Medical University Vienna, Austria
| |
Collapse
|
73
|
Ganzetti M, Liu Q, Mantini D. A Spatial Registration Toolbox for Structural MR Imaging of the Aging Brain. Neuroinformatics 2019; 16:167-179. [PMID: 29352390 DOI: 10.1007/s12021-018-9355-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
During aging the brain undergoes a series of structural changes, in size, shape as well as tissue composition. In particular, cortical atrophy and ventricular enlargement are often present in the brain of elderly individuals. This poses serious challenges in the spatial registration of structural MR images. In this study, we addressed this open issue by proposing an enhanced framework for MR registration and segmentation. Our solution was compared with other approaches based on the tools available in SPM12, a widely used software package. Performance of the different methods was assessed on 229 T1-weighted images collected in healthy individuals, with age ranging between 55 and 90 years old. Our method showed a consistent improvement as compared to other solutions, especially for subjects with enlarged lateral ventricles. It also provided a superior inter-subject alignment in cortical regions, with the most marked improvement in the frontal lobe. We conclude that our method is a valid alternative to standard approaches based on SPM12, and is particularly suitable for the processing of structural MR images of brains with cortical atrophy and ventricular enlargement. The method is integrated in our software toolbox MRTool, which is freely available to the scientific community.
Collapse
Affiliation(s)
- Marco Ganzetti
- Laboratory of Movement Control and Neuroplasticity, KU Leuven, Leuven, Belgium.
| | - Quanying Liu
- Laboratory of Movement Control and Neuroplasticity, KU Leuven, Leuven, Belgium.,Neural Control of Movement Lab, ETH Zurich, Zurich, Switzerland
| | - Dante Mantini
- Laboratory of Movement Control and Neuroplasticity, KU Leuven, Leuven, Belgium.,Neural Control of Movement Lab, ETH Zurich, Zurich, Switzerland.,Department of Experimental Psychology, Oxford University, Oxford, UK
| | | |
Collapse
|
74
|
Chang HH, Li CY. An automatic restoration framework based on GPU-accelerated collateral filtering in brain MR images. BMC Med Imaging 2019; 19:8. [PMID: 30660203 PMCID: PMC6339330 DOI: 10.1186/s12880-019-0305-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2017] [Accepted: 01/04/2019] [Indexed: 11/17/2022] Open
Abstract
BACKGROUND Image restoration is one of the fundamental and essential tasks within image processing. In medical imaging, developing an effective algorithm that can automatically remove random noise in brain magnetic resonance (MR) images is challenging. The collateral filter has been shown a more powerful algorithm than many existing methods. However, the computation of the collateral filter is more time-consuming and the selection of the filter parameters is also laborious. This paper proposes an automatic noise removal system based on the accelerated collateral filter for brain MR images. METHODS To solve these problems, we first accelerated the collateral filter with parallel computing using the graphics processing unit (GPU) architecture. We adopted the compute unified device architecture (CUDA), an application programming interface for the GPU by NVIDIA, to hasten the computation. Subsequently, the optimal filter parameters were selected and the automation was achieved by artificial neural networks. Specifically, an artificial neural network system associated with image feature analysis was adopted to establish the automatic image restoration framework. The best feature combination was selected by the paired t-test and the sequential forward floating selection (SFFS) methods. RESULTS Experimental results indicated that not only did the proposed automatic image restoration algorithm perform dramatically faster than the traditional collateral filter, but it also effectively removed the noise in a wide variety of brain MR images. A speed up gain of 34 was attained to process an MR image, which completed within 0.1 s. Representative illustrations of brain tumor images demonstrated the capability of identifying lesion boundaries, which outperformed many existing methods. CONCLUSIONS We believe that our accelerated and automated restoration framework is promising for achieving robust filtering in many brain MR image restoration applications.
Collapse
Affiliation(s)
- Herng-Hua Chang
- Computational Biomedical Engineering Laboratory (CBEL), Department of Engineering Science and Ocean Engineering, National Taiwan University, No. 1 Sec. 4 Roosevelt Road, Daan, 10617 Taipei, Taiwan
| | - Cheng-Yuan Li
- Computational Biomedical Engineering Laboratory (CBEL), Department of Engineering Science and Ocean Engineering, National Taiwan University, No. 1 Sec. 4 Roosevelt Road, Daan, 10617 Taipei, Taiwan
| |
Collapse
|
75
|
Maes F, Robben D, Vandermeulen D, Suetens P. The Role of Medical Image Computing and Machine Learning in Healthcare. Artif Intell Med Imaging 2019. [DOI: 10.1007/978-3-319-94878-2_2] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
|
76
|
Iglesias JE, Insausti R, Lerma-Usabiaga G, Bocchetta M, Van Leemput K, Greve DN, van der Kouwe A, Fischl B, Caballero-Gaudes C, Paz-Alonso PM. A probabilistic atlas of the human thalamic nuclei combining ex vivo MRI and histology. Neuroimage 2018; 183:314-326. [PMID: 30121337 PMCID: PMC6215335 DOI: 10.1016/j.neuroimage.2018.08.012] [Citation(s) in RCA: 348] [Impact Index Per Article: 49.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2018] [Revised: 07/27/2018] [Accepted: 08/09/2018] [Indexed: 01/18/2023] Open
Abstract
The human thalamus is a brain structure that comprises numerous, highly specific nuclei. Since these nuclei are known to have different functions and to be connected to different areas of the cerebral cortex, it is of great interest for the neuroimaging community to study their volume, shape and connectivity in vivo with MRI. In this study, we present a probabilistic atlas of the thalamic nuclei built using ex vivo brain MRI scans and histological data, as well as the application of the atlas to in vivo MRI segmentation. The atlas was built using manual delineation of 26 thalamic nuclei on the serial histology of 12 whole thalami from six autopsy samples, combined with manual segmentations of the whole thalamus and surrounding structures (caudate, putamen, hippocampus, etc.) made on in vivo brain MR data from 39 subjects. The 3D structure of the histological data and corresponding manual segmentations was recovered using the ex vivo MRI as reference frame, and stacks of blockface photographs acquired during the sectioning as intermediate target. The atlas, which was encoded as an adaptive tetrahedral mesh, shows a good agreement with previous histological studies of the thalamus in terms of volumes of representative nuclei. When applied to segmentation of in vivo scans using Bayesian inference, the atlas shows excellent test-retest reliability, robustness to changes in input MRI contrast, and ability to detect differential thalamic effects in subjects with Alzheimer's disease. The probabilistic atlas and companion segmentation tool are publicly available as part of the neuroimaging package FreeSurfer.
Collapse
Affiliation(s)
- Juan Eugenio Iglesias
- Centre for Medical Image Computing (CMIC), Department of Medical Physics and Biomedical Engineering, University College London, United Kingdom; BCBL. Basque Center on Cognition, Brain and Language, Spain.
| | - Ricardo Insausti
- Human Neuroanatomy Laboratory, University of Castilla-La Mancha, Spain
| | | | - Martina Bocchetta
- Dementia Research Centre, Department of Neurodegenerative Disease, Institute of Neurology, University College London, United Kingdom
| | - Koen Van Leemput
- Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, USA; Department of Applied Mathematics and Computer Science, Technical University of Denmark, Denmark
| | - Douglas N Greve
- Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, USA
| | - Andre van der Kouwe
- Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, USA
| | - Bruce Fischl
- Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, USA; MIT Computer Science and Artificial Intelligence Laboratory, USA
| | | | | |
Collapse
|
77
|
Carass A, Cuzzocreo JL, Han S, Hernandez-Castillo CR, Rasser PE, Ganz M, Beliveau V, Dolz J, Ben Ayed I, Desrosiers C, Thyreau B, Romero JE, Coupé P, Manjón JV, Fonov VS, Collins DL, Ying SH, Onyike CU, Crocetti D, Landman BA, Mostofsky SH, Thompson PM, Prince JL. Comparing fully automated state-of-the-art cerebellum parcellation from magnetic resonance images. Neuroimage 2018; 183:150-172. [PMID: 30099076 PMCID: PMC6271471 DOI: 10.1016/j.neuroimage.2018.08.003] [Citation(s) in RCA: 70] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2018] [Revised: 08/03/2018] [Accepted: 08/03/2018] [Indexed: 01/26/2023] Open
Abstract
The human cerebellum plays an essential role in motor control, is involved in cognitive function (i.e., attention, working memory, and language), and helps to regulate emotional responses. Quantitative in-vivo assessment of the cerebellum is important in the study of several neurological diseases including cerebellar ataxia, autism, and schizophrenia. Different structural subdivisions of the cerebellum have been shown to correlate with differing pathologies. To further understand these pathologies, it is helpful to automatically parcellate the cerebellum at the highest fidelity possible. In this paper, we coordinated with colleagues around the world to evaluate automated cerebellum parcellation algorithms on two clinical cohorts showing that the cerebellum can be parcellated to a high accuracy by newer methods. We characterize these various methods at four hierarchical levels: coarse (i.e., whole cerebellum and gross structures), lobe, subdivisions of the vermis, and the lobules. Due to the number of labels, the hierarchy of labels, the number of algorithms, and the two cohorts, we have restricted our analyses to the Dice measure of overlap. Under these conditions, machine learning based methods provide a collection of strategies that are efficient and deliver parcellations of a high standard across both cohorts, surpassing previous work in the area. In conjunction with the rank-sum computation, we identified an overall winning method.
Collapse
Affiliation(s)
- Aaron Carass
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, 21218, USA; Department of Computer Science, The Johns Hopkins University, Baltimore, MD, 21218, USA.
| | - Jennifer L Cuzzocreo
- Department of Radiology, The Johns Hopkins School of Medicine, Baltimore, MD, 21287, USA
| | - Shuo Han
- Department of Biomedical Engineering, The Johns Hopkins University, Baltimore, MD, 21218, USA; Laboratory of Behavioral Neuroscience, National Institute on Aging, National Institutes of Health, Baltimore, MD, 20892, USA
| | - Carlos R Hernandez-Castillo
- Consejo Nacional de Ciencia y Tecnología, Instituto de Neuroetología, Universidad Veracruzana, Xalapa, Mexico
| | - Paul E Rasser
- Priority Research Centre for Brain & Mental Health and Stroke & Brain Injury, University of Newcastle, Callaghan, NSW, Australia
| | - Melanie Ganz
- Neurobiology Research Unit, Rigshospitalet, Copenhagen, Denmark; Department of Computer Science, University of Copenhagen, Copenhagen, Denmark
| | - Vincent Beliveau
- Neurobiology Research Unit, Rigshospitalet, Copenhagen, Denmark; Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Jose Dolz
- Laboratory for Imagery, Vision, and Artificial Intelligence, École de Technologie Supérieure, Montreal, QC, Canada
| | - Ismail Ben Ayed
- Laboratory for Imagery, Vision, and Artificial Intelligence, École de Technologie Supérieure, Montreal, QC, Canada
| | - Christian Desrosiers
- Laboratory for Imagery, Vision, and Artificial Intelligence, École de Technologie Supérieure, Montreal, QC, Canada
| | - Benjamin Thyreau
- Institute of Development, Aging and Cancer, Tohoku University, Japan
| | - José E Romero
- Instituto Universitario de Tecnologías de la Información y Comunicaciones (ITACA), Universitat Politècnica de València, Camino de Vera s/n, 46022, Valencia, Spain
| | - Pierrick Coupé
- University of Bordeaux, LaBRI, UMR 5800, PICTURA, Talence, F-33400, France; CNRS, LaBRI, UMR 5800, PICTURA, Talence, F-33400, France
| | - José V Manjón
- Instituto Universitario de Tecnologías de la Información y Comunicaciones (ITACA), Universitat Politècnica de València, Camino de Vera s/n, 46022, Valencia, Spain
| | - Vladimir S Fonov
- Image Processing Laboratory, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | - D Louis Collins
- Image Processing Laboratory, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | - Sarah H Ying
- Department of Neurology, The Johns Hopkins School of Medicine, Baltimore, MD, 21287, USA
| | - Chiadi U Onyike
- Department of Psychiatry and Behavioral Sciences, The Johns Hopkins School of Medicine, Baltimore, MD, 21287, USA
| | - Deana Crocetti
- Center for Neurodevelopmental Medicine and Imaging Research, Kennedy Krieger Institute, Baltimore, MD, 21205, USA
| | - Bennett A Landman
- Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, 37235, USA
| | - Stewart H Mostofsky
- Center for Neurodevelopmental Medicine and Imaging Research, Kennedy Krieger Institute, Baltimore, MD, 21205, USA; Department of Neurology, The Johns Hopkins School of Medicine, Baltimore, MD, 21287, USA; Department of Psychiatry and Behavioral Sciences, The Johns Hopkins School of Medicine, Baltimore, MD, 21287, USA
| | - Paul M Thompson
- Imaging Genetics Center, Mark and Mary Stevens Institute for Neuroimaging and Informatics, Keck School of Medicine, University of Southern California, Marina del Rey, CA, 90292, USA; Departments of Neurology, Pediatrics, Psychiatry, Radiology, Engineering, and Ophthalmology, University of Southern California, Los Angeles, CA, 90033, USA
| | - Jerry L Prince
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, 21218, USA; Department of Computer Science, The Johns Hopkins University, Baltimore, MD, 21218, USA
| |
Collapse
|
78
|
Zou Y, Murray DE, Durazzo TC, Schmidt TP, Murray TA, Meyerhoff DJ. White matter microstructural correlates of relapse in alcohol dependence. Psychiatry Res Neuroimaging 2018; 281:92-100. [PMID: 30273793 PMCID: PMC6204088 DOI: 10.1016/j.pscychresns.2018.09.004] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/25/2017] [Revised: 09/14/2018] [Accepted: 09/14/2018] [Indexed: 12/15/2022]
Abstract
Identification of neural correlates of relapse to alcohol after treatment is clinically important as it may inform better substance abuse treatment. Few studies have specifically analyzed the white matter microstructure in treatment seekers as it might relate to relapse risk versus long-term abstinence. Using 4 Tesla diffusion tensor imaging, we compared two groups of one-month-abstinent treatment-seekers, who were classified based on their drinking status between six and nine months after treatment initiation. We hypothesized that subsequent relapsers had greater white matter microstructural deficits in specific brain regions than long-term abstainers. At one month of abstinence, 37 future relapsers versus 25 future abstainers had lower fractional anisotropy (a measure of axonal organization and membrane integrity) in the corpus callosum and right stria terminalis/fornix, higher diffusivity in the genu of the corpus callosum, left and right stria terminalis/fornix, and lower diffusivity in left anterior corona radiata. These differences existed despite similar lifetime and recent drinking and smoking histories in the groups. Longer smoking duration in relapsers was associated with lower fractional anisotropy in right stria terminalis/fornix. The study identified specific microstructural biomarkers of alcohol relapse risk in adults, contributing to the definition of a neurobiological relapse risk profile in alcohol use disorder.
Collapse
Affiliation(s)
- Yukai Zou
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN 47906, United States; College of Veterinary Medicine, Purdue University, West Lafayette, IN 47906, United States
| | - Donna E Murray
- Center for Imaging of Neurodegenerative Diseases (CIND), San Francisco VA Medical Center, San Francisco, CA 94121, United States; Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA 94143, United States
| | - Timothy C Durazzo
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA 94305, United States; Mental Illness Research Mental Illness Research and Education Clinical Centers, Sierra-Pacific War Related Illness and Injury Study Center, VA Palo Alto Health Care System, Palo Alto, CA 94304, United States
| | - Thomas P Schmidt
- Center for Imaging of Neurodegenerative Diseases (CIND), San Francisco VA Medical Center, San Francisco, CA 94121, United States
| | - Troy A Murray
- Center for Imaging of Neurodegenerative Diseases (CIND), San Francisco VA Medical Center, San Francisco, CA 94121, United States
| | - Dieter J Meyerhoff
- Center for Imaging of Neurodegenerative Diseases (CIND), San Francisco VA Medical Center, San Francisco, CA 94121, United States; Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA 94143, United States.
| |
Collapse
|
79
|
fMRI data processing in MRTOOL: to what extent does anatomical registration affect the reliability of functional results? Brain Imaging Behav 2018; 13:1538-1553. [PMID: 30467743 DOI: 10.1007/s11682-018-9986-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Spatial registration is an essential step in the analysis of fMRI data because it enables between-subject analyses of brain activity, measured either during task performance or in the resting state. In this study, we investigated how anatomical registration with MRTOOL affects the reliability of task-related fMRI activity. We used as a benchmark the results from two other spatial registration methods implemented in SPM12: the Unified Segmentation algorithm and the DARTEL toolbox. Structural alignment accuracy and the impact on functional activation maps were assessed with high-resolution T1-weighted images and a set of task-related functional volumes acquired in 10 healthy volunteers. Our findings confirmed that anatomical registration is a crucial step in fMRI data processing, contributing significantly to the total inter-subject variance of the activation maps. MRTOOL and DARTEL provided greater registration accuracy than Unified Segmentation. Although DARTEL had superior gray matter and white matter tissue alignment than MRTOOL, there were no significant differences between DARTEL and MRTOOL in test-retest reliability. Likewise, we found only limited differences in BOLD activation morphology between MRTOOL and DARTEL. The test-retest reliability of task-related responses was comparable between MRTOOL and DARTEL, and both proved superior to Unified Segmentation. We conclude that MRTOOL, which is suitable for single-subject processing of structural and functional MR images, is a valid alternative to other SPM12-based approaches that are intended for group analysis. MRTOOL now includes a normalization module for fMRI data and is freely available to the scientific community.
Collapse
|
80
|
A systematic review of structural MRI biomarkers in autism spectrum disorder: A machine learning perspective. Int J Dev Neurosci 2018; 71:68-82. [DOI: 10.1016/j.ijdevneu.2018.08.010] [Citation(s) in RCA: 69] [Impact Index Per Article: 9.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2018] [Revised: 08/28/2018] [Accepted: 08/28/2018] [Indexed: 11/19/2022] Open
|
81
|
Sanroma G, Benkarim OM, Piella G, Lekadir K, Hahner N, Eixarch E, González Ballester MA. Learning to combine complementary segmentation methods for fetal and 6-month infant brain MRI segmentation. Comput Med Imaging Graph 2018; 69:52-59. [PMID: 30176518 DOI: 10.1016/j.compmedimag.2018.08.007] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2017] [Revised: 05/21/2018] [Accepted: 08/22/2018] [Indexed: 02/06/2023]
Abstract
Segmentation of brain structures during the pre-natal and early post-natal periods is the first step for subsequent analysis of brain development. Segmentation techniques can be roughly divided into two families. The first, which we denote as registration-based techniques, rely on initial estimates derived by registration to one (or several) templates. The second family, denoted as learning-based techniques, relate imaging (and spatial) features to their corresponding anatomical labels. Each approach has its own qualities and both are complementary to each other. In this paper, we explore two ensembling strategies, namely, stacking and cascading to combine the strengths of both families. We present experiments on segmentation of 6-month infant brains and a cohort of fetuses with isolated non-severe ventriculomegaly (INSVM). INSVM is diagnosed when ventricles are mildly enlarged and no other anomalies are apparent. Prognosis is difficult based solely on the degree of ventricular enlargement. In order to find markers for a more reliable prognosis, we use the resulting segmentations to find abnormalities in the cortical folding of INSVM fetuses. Segmentation results show that either combination strategy outperform all of the individual methods, thus demonstrating the capability of learning systematic combinations that lead to an overall improvement. In particular, the cascading strategy outperforms the ensembling one, the former one obtaining top 5, 7 and 13 results (out of 21 teams) in the segmentation of white matter, gray matter and cerebro-spinal fluid in the iSeg2017 MICCAI Segmentation Challenge. The resulting segmentations reveal that INSVM fetuses have a less convoluted cortex. This points to cortical folding abnormalities as potential markers of later neurodevelopmental outcomes.
Collapse
Affiliation(s)
- Gerard Sanroma
- Universitat Pompeu Fabra, Dept. of Information and Communication Technologies, Tànger 122-140, 08018 Barcelona, Spain.
| | - Oualid M Benkarim
- Universitat Pompeu Fabra, Dept. of Information and Communication Technologies, Tànger 122-140, 08018 Barcelona, Spain
| | - Gemma Piella
- Universitat Pompeu Fabra, Dept. of Information and Communication Technologies, Tànger 122-140, 08018 Barcelona, Spain
| | - Karim Lekadir
- Universitat Pompeu Fabra, Dept. of Information and Communication Technologies, Tànger 122-140, 08018 Barcelona, Spain
| | - Nadine Hahner
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Déu), IDIBAPS, University of Barcelona, Spain
| | - Elisenda Eixarch
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Déu), IDIBAPS, University of Barcelona, Spain
| | - Miguel A González Ballester
- Universitat Pompeu Fabra, Dept. of Information and Communication Technologies, Tànger 122-140, 08018 Barcelona, Spain; ICREA, Pg. Lluis Companys 23, 08010 Barcelona, Spain
| |
Collapse
|
82
|
Cespedes MI, McGree J, Drovandi CC, Mengersen K, Doecke JD, Fripp J. An efficient algorithm for estimating brain covariance networks. PLoS One 2018; 13:e0198583. [PMID: 30001336 PMCID: PMC6042721 DOI: 10.1371/journal.pone.0198583] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2017] [Accepted: 05/22/2018] [Indexed: 12/25/2022] Open
Abstract
Often derived from partial correlations or many pairwise analyses, covariance networks represent the inter-relationships among regions and can reveal important topological structures in brain measures from healthy and pathological subjects. However both approaches are not consistent network estimators and are sensitive to the value of the tuning parameters. Here, we propose a consistent covariance network estimator by maximising the network likelihood (MNL) which is robust to the tuning parameter. We validate the consistency of our algorithm theoretically and via a simulation study, and contrast these results against two well-known approaches: the graphical LASSO (gLASSO) and Pearson pairwise correlations (PPC) over a range of tuning parameters. The MNL algorithm had a specificity equal to and greater than 0.94 for all sample sizes in the simulation study, and the sensitivity was shown to increase as the sample size increased. The gLASSO and PPC demonstrated a specificity-sensitivity trade-off over a range of values of tuning parameters highlighting the discrepancy in the results for misspecified values. Application of the MNL algorithm to the case study data showed a loss of connections between healthy and impaired groups, and improved ability to identify between lobe connectivity in contrast to gLASSO networks. In this work, we propose the MNL algorithm as an effective approach to find covariance brain networks, which can inform the organisational features in brain-wide analyses, particularly for large sample sizes.
Collapse
Affiliation(s)
- Marcela I. Cespedes
- School of Mathematical Sciences, Queensland University of Technology, Brisbane, Queensland, Australia
- Health and Biosecurity/ Australian e-Health Research Centre, CSIRO, Herston, Queensland, Australia
- * E-mail:
| | - James McGree
- School of Mathematical Sciences, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Christopher C. Drovandi
- School of Mathematical Sciences, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Kerrie Mengersen
- School of Mathematical Sciences, Queensland University of Technology, Brisbane, Queensland, Australia
| | - James D. Doecke
- Health and Biosecurity/ Australian e-Health Research Centre, CSIRO, Herston, Queensland, Australia
| | - Jurgen Fripp
- Health and Biosecurity/ Australian e-Health Research Centre, CSIRO, Herston, Queensland, Australia
| | | |
Collapse
|
83
|
Barry DN, Chadwick MJ, Maguire EA. Nonmonotonic recruitment of ventromedial prefrontal cortex during remote memory recall. PLoS Biol 2018; 16:e2005479. [PMID: 29965966 PMCID: PMC6044544 DOI: 10.1371/journal.pbio.2005479] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2018] [Revised: 07/13/2018] [Accepted: 06/18/2018] [Indexed: 11/25/2022] Open
Abstract
Systems-level consolidation refers to the time-dependent reorganisation of memory traces in the neocortex, a process in which the ventromedial prefrontal cortex (vmPFC) has been implicated. Capturing the precise temporal evolution of this crucial process in humans has long proved elusive. Here, we used multivariate methods and a longitudinal functional magnetic resonance imaging (fMRI) design to detect, with high granularity, the extent to which autobiographical memories of different ages were represented in vmPFC and how this changed over time. We observed an unexpected time course of vmPFC recruitment during retrieval, rising and falling around an initial peak of 8-12 months, before reengaging for older 2- and 5-year-old memories. This pattern was replicated in 2 independent sets of memories. Moreover, it was further replicated in a follow-up study 8 months later with the same participants and memories, for which the individual memory representations had undergone their hypothesised strengthening or weakening over time. We conclude that the temporal engagement of vmPFC in memory retrieval seems to be nonmonotonic, revealing a complex relationship between systems-level consolidation and prefrontal cortex recruitment that is unaccounted for by current theories.
Collapse
Affiliation(s)
- Daniel N. Barry
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London, United Kingdom
| | - Martin J. Chadwick
- Institute of Behavioural Neuroscience, Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London, London, United Kingdom
| | - Eleanor A. Maguire
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London, United Kingdom
| |
Collapse
|
84
|
Zhou Z, Tu J, Geng C, Hu J, Tong B, Ji J, Dai Y. Accurate and Robust Non-rigid Point Set Registration using Student's-t Mixture Model with Prior Probability Modeling. Sci Rep 2018; 8:8742. [PMID: 29880859 PMCID: PMC5992220 DOI: 10.1038/s41598-018-26288-6] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2018] [Accepted: 04/16/2018] [Indexed: 11/21/2022] Open
Abstract
A new accurate and robust non-rigid point set registration method, named DSMM, is proposed for non-rigid point set registration in the presence of significant amounts of missing correspondences and outliers. The key idea of this algorithm is to consider the relationship between the point sets as random variables and model the prior probabilities via Dirichlet distribution. We assign the various prior probabilities of each point to its correspondences in the Student's-t mixture model. We later incorporate the local spatial representation of the point sets by representing the posterior probabilities in a linear smoothing filter and get closed-form mixture proportions, leading to a computationally efficient registration algorithm comparing to other Student's-t mixture model based methods. Finally, by introducing the hidden random variables in the Bayesian framework, we propose a general mixture model family for generalizing the mixture-model-based point set registration, where the existing methods can be considered as members of the proposed family. We evaluate DSMM and other state-of-the-art finite mixture models based point set registration algorithms on both artificial point set and various 2D and 3D point sets, where DSMM demonstrates its statistical accuracy and robustness, outperforming the competing algorithms.
Collapse
Affiliation(s)
- Zhiyong Zhou
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China
| | - Jianfei Tu
- Lishui Central Hospital, Lishui, 323000, China
| | - Chen Geng
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China
| | - Jisu Hu
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China
| | - Baotong Tong
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China
| | - Jiansong Ji
- Lishui Central Hospital, Lishui, 323000, China.
| | - Yakang Dai
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China.
| |
Collapse
|
85
|
Gordon S, Dolgopyat I, Kahn I, Riklin Raviv T. Multidimensional co-segmentation of longitudinal brain MRI ensembles in the presence of a neurodegenerative process. Neuroimage 2018; 178:346-369. [PMID: 29723637 DOI: 10.1016/j.neuroimage.2018.04.039] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2018] [Revised: 04/14/2018] [Accepted: 04/18/2018] [Indexed: 11/25/2022] Open
Abstract
MRI Segmentation of a pathological brain poses a significant challenge, as the available anatomical priors that provide top-down information to aid segmentation are inadequate in the presence of abnormalities. This problem is further complicated for longitudinal data capturing impaired brain development or neurodegenerative conditions, since the dynamic of brain atrophies has to be considered as well. For these cases, the absence of compatible annotated training examples renders the commonly used multi-atlas or machine-learning approaches impractical. We present a novel segmentation approach that accounts for the lack of labeled data via multi-region multi-subject co-segmentation (MMCoSeg) of longitudinal MRI sequences. The underlying, unknown anatomy is learned throughout an iterative process, in which the segmentation of a region is supported both by the segmentation of the neighboring regions, which share common boundaries, and by the segmentation of corresponding regions, in the other jointly segmented images. A 4D multi-region atlas that models the spatio-temporal deformations and can be adapted to different subjects undergoing similar degeneration processes is reconstructed concurrently. An inducible mouse model of p25 accumulation (the CK-p25 mouse) that displays key pathological hallmarks of Alzheimer disease (AD) is used as a gold-standard to test the proposed algorithm by providing a conditional control of rapid neurodegeneration. Applying the MMCoSeg to a cohort of CK-p25 mice and littermate controls yields promising segmentation results that demonstrate high compatibility with expertise manual annotations. An extensive comparative analysis with respect to current well-established, atlas-based segmentation methods highlights the advantage of the proposed approach, which provides accurate segmentation of longitudinal brain MRIs in pathological conditions, where only very few annotated examples are available.
Collapse
Affiliation(s)
- Shiri Gordon
- Electrical and Computer Engineering Department and the Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Irit Dolgopyat
- Rappaport Faculty of Medicine, Technion - Israel Institute of Technology, Haifa, Israel
| | - Itamar Kahn
- Rappaport Faculty of Medicine, Technion - Israel Institute of Technology, Haifa, Israel
| | - Tammy Riklin Raviv
- Electrical and Computer Engineering Department and the Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer-Sheva, Israel.
| |
Collapse
|
86
|
Makropoulos A, Counsell SJ, Rueckert D. A review on automatic fetal and neonatal brain MRI segmentation. Neuroimage 2018; 170:231-248. [DOI: 10.1016/j.neuroimage.2017.06.074] [Citation(s) in RCA: 100] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2016] [Revised: 03/06/2017] [Accepted: 06/26/2017] [Indexed: 01/18/2023] Open
|
87
|
Liu J, Zhuang X, Wu L, An D, Xu J, Peters T, Gu L. Myocardium Segmentation From DE MRI Using Multicomponent Gaussian Mixture Model and Coupled Level Set. IEEE Trans Biomed Eng 2018; 64:2650-2661. [PMID: 28129147 DOI: 10.1109/tbme.2017.2657656] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Objective: In this paper, we propose a fully automatic framework for myocardium segmentation of delayed-enhancement (DE) MRI images without relying on prior patient-specific information. Methods: We employ a multicomponent Gaussian mixture model to deal with the intensity heterogeneity of myocardium caused by the infarcts. To differentiate the myocardium from other tissues with similar intensities, while at the same time maintain spatial continuity, we introduce a coupled level set (CLS) to regularize the posterior probability. The CLS, as a spatial regularization, can be adapted to the image characteristics dynamically. We also introduce an image intensity gradient based term into the CLS, adding an extra force to the posterior probability based framework, to improve the accuracy of myocardium boundary delineation. The prebuilt atlases are propagated to the target image to initialize the framework. Results: The proposed method was tested on datasets of 22 clinical cases, and achieved Dice similarity coefficients of 87.43 ± 5.62% (endocardium), 90.53 ± 3.20% (epicardium) and 73.58 ± 5.58% (myocardium), which have outperformed three variants of the classic segmentation methods. Conclusion: The results can provide a benchmark for the myocardial segmentation in the literature. Significance: DE MRI provides an important tool to assess the viability of myocardium. The accurate segmentation of myocardium, which is a prerequisite for further quantitative analysis of myocardial infarction (MI) region, can provide important support for the diagnosis and treatment management for MI patients.Objective: In this paper, we propose a fully automatic framework for myocardium segmentation of delayed-enhancement (DE) MRI images without relying on prior patient-specific information. Methods: We employ a multicomponent Gaussian mixture model to deal with the intensity heterogeneity of myocardium caused by the infarcts. To differentiate the myocardium from other tissues with similar intensities, while at the same time maintain spatial continuity, we introduce a coupled level set (CLS) to regularize the posterior probability. The CLS, as a spatial regularization, can be adapted to the image characteristics dynamically. We also introduce an image intensity gradient based term into the CLS, adding an extra force to the posterior probability based framework, to improve the accuracy of myocardium boundary delineation. The prebuilt atlases are propagated to the target image to initialize the framework. Results: The proposed method was tested on datasets of 22 clinical cases, and achieved Dice similarity coefficients of 87.43 ± 5.62% (endocardium), 90.53 ± 3.20% (epicardium) and 73.58 ± 5.58% (myocardium), which have outperformed three variants of the classic segmentation methods. Conclusion: The results can provide a benchmark for the myocardial segmentation in the literature. Significance: DE MRI provides an important tool to assess the viability of myocardium. The accurate segmentation of myocardium, which is a prerequisite for further quantitative analysis of myocardial infarction (MI) region, can provide important support for the diagnosis and treatment management for MI patients.
Collapse
Affiliation(s)
- Jie Liu
- School of Biomedical EngineeringShanghai Jiao Tong University
| | | | - Lianming Wu
- Department of RadiologyRenji HospitalShanghai Jiao Tong University School of Medicine
| | - Dongaolei An
- Department of RadiologyRenji HospitalShanghai Jiao Tong University School of Medicine
| | - Jianrong Xu
- Department of RadiologyRenji HospitalShanghai Jiao Tong University School of Medicine
| | - Terry Peters
- Robarts Research InstituteUniversity of Western Ontario
| | - Lixu Gu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
88
|
Garcia E, Diez Y, Diaz O, Llado X, Gubern-Merida A, Marti R, Marti J, Oliver A. Multimodal Breast Parenchymal Patterns Correlation Using a Patient-Specific Biomechanical Model. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:712-723. [PMID: 28885152 DOI: 10.1109/tmi.2017.2749685] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
In this paper, we aim to produce a realistic 2-D projection of the breast parenchymal distribution from a 3-D breast magnetic resonance image (MRI). To evaluate the accuracy of our simulation, we compare our results with the local breast density (i.e., density map) obtained from the complementary full-field digital mammogram. To achieve this goal, we have developed a fully automatic framework, which registers MRI volumes to X-ray mammograms using a subject-specific biomechanical model of the breast. The optimization step modifies the position, orientation, and elastic parameters of the breast model to perform the alignment between the images. When the model reaches an optimal solution, the MRI glandular tissue is projected and compared with the one obtained from the corresponding mammograms. To reduce the loss of information during the ray-casting, we introduce a new approach that avoids resampling the MRI volume. In the results, we focus our efforts on evaluating the agreement of the distributions of glandular tissue, the degree of structural similarity, and the correlation between the real and synthetic density maps. Our approach obtained a high-structural agreement regardless the glandularity of the breast, whilst the similarity of the glandular tissue distributions and correlation between both images increase in denser breasts. Furthermore, the synthetic images show continuity with respect to large structures in the density maps.
Collapse
|
89
|
Makropoulos A, Robinson EC, Schuh A, Wright R, Fitzgibbon S, Bozek J, Counsell SJ, Steinweg J, Vecchiato K, Passerat-Palmbach J, Lenz G, Mortari F, Tenev T, Duff EP, Bastiani M, Cordero-Grande L, Hughes E, Tusor N, Tournier JD, Hutter J, Price AN, Teixeira RPAG, Murgasova M, Victor S, Kelly C, Rutherford MA, Smith SM, Edwards AD, Hajnal JV, Jenkinson M, Rueckert D. The developing human connectome project: A minimal processing pipeline for neonatal cortical surface reconstruction. Neuroimage 2018. [PMID: 29409960 DOI: 10.1101/125526] [Citation(s) in RCA: 36] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
The Developing Human Connectome Project (dHCP) seeks to create the first 4-dimensional connectome of early life. Understanding this connectome in detail may provide insights into normal as well as abnormal patterns of brain development. Following established best practices adopted by the WU-MINN Human Connectome Project (HCP), and pioneered by FreeSurfer, the project utilises cortical surface-based processing pipelines. In this paper, we propose a fully automated processing pipeline for the structural Magnetic Resonance Imaging (MRI) of the developing neonatal brain. This proposed pipeline consists of a refined framework for cortical and sub-cortical volume segmentation, cortical surface extraction, and cortical surface inflation, which has been specifically designed to address considerable differences between adult and neonatal brains, as imaged using MRI. Using the proposed pipeline our results demonstrate that images collected from 465 subjects ranging from 28 to 45 weeks post-menstrual age (PMA) can be processed fully automatically; generating cortical surface models that are topologically correct, and correspond well with manual evaluations of tissue boundaries in 85% of cases. Results improve on state-of-the-art neonatal tissue segmentation models and significant errors were found in only 2% of cases, where these corresponded to subjects with high motion. Downstream, these surfaces will enhance comparisons of functional and diffusion MRI datasets, supporting the modelling of emerging patterns of brain connectivity.
Collapse
Affiliation(s)
- Antonios Makropoulos
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Emma C Robinson
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom; Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom.
| | - Andreas Schuh
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Robert Wright
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Sean Fitzgibbon
- Wellcome Centre for Integrative Neuroimaging, FMRIB Centre, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Jelena Bozek
- Faculty of Electrical Engineering and Computing, University of Zagreb, Zagreb, Croatia
| | - Serena J Counsell
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Johannes Steinweg
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Katy Vecchiato
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Jonathan Passerat-Palmbach
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Gregor Lenz
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Filippo Mortari
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Tencho Tenev
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Eugene P Duff
- Wellcome Centre for Integrative Neuroimaging, FMRIB Centre, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Matteo Bastiani
- Wellcome Centre for Integrative Neuroimaging, FMRIB Centre, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Lucilio Cordero-Grande
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Emer Hughes
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Nora Tusor
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Jacques-Donald Tournier
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Jana Hutter
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Anthony N Price
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Rui Pedro A G Teixeira
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Maria Murgasova
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Suresh Victor
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Christopher Kelly
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Mary A Rutherford
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Stephen M Smith
- Wellcome Centre for Integrative Neuroimaging, FMRIB Centre, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - A David Edwards
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Joseph V Hajnal
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Mark Jenkinson
- Wellcome Centre for Integrative Neuroimaging, FMRIB Centre, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Daniel Rueckert
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| |
Collapse
|
90
|
Shao M, Carass A, Li X, Dewey BE, Blitz AM, Prince JL, Ellingsen LM. Multi-atlas segmentation of the hydrocephalus brain using an adaptive ventricle atlas. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2018; 10578:105780F. [PMID: 34376903 PMCID: PMC8351536 DOI: 10.1117/12.2295613] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Normal pressure hydrocephalus (NPH) is a brain disorder caused by disruption of the flow of cerebrospinal fluid (CSF). The dementia-like symptoms of NPH are often mistakenly attributed to Alzheimer's disease. However, if correctly diagnosed, NPH patients can potentially be treated and their symptoms reversed through surgery. Observing the dilated ventricles through magnetic resonance imaging (MRI) is one element in diagnosing NPH. Diagnostic accuracy therefore benefits from accurate, automatic parcellation of the ventricular system into its sub-compartments. We present an improvement to a whole brain segmentation approach designed for subjects with enlarged and deformed ventricles. Our method incorporates an adaptive ventricle atlas from an NPH-atlas-based segmentation as a prior and uses a more robust relaxation scheme for the multi-atlas label fusion approach that accurately labels the four sub-compartments of the ventricular system. We validated our method on NPH patients, demonstrating improvement over state-of-the-art segmentation techniques.
Collapse
Affiliation(s)
- Muhan Shao
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218
| | - Aaron Carass
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218
- Department of Computer Science, The Johns Hopkins University, Baltimore, MD 21218
| | - Xiang Li
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218
| | - Blake E Dewey
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218
| | - Ari M Blitz
- Department of Radiology and Radiological Science, The Johns Hopkins University, Baltimore, MD 21287
| | - Jerry L Prince
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218
- Department of Computer Science, The Johns Hopkins University, Baltimore, MD 21218
| | - Lotta M Ellingsen
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD 21218
- Department of Electrical and Computer Engineering, University of Iceland, Reykjavik, Iceland
| |
Collapse
|
91
|
Makropoulos A, Robinson EC, Schuh A, Wright R, Fitzgibbon S, Bozek J, Counsell SJ, Steinweg J, Vecchiato K, Passerat-Palmbach J, Lenz G, Mortari F, Tenev T, Duff EP, Bastiani M, Cordero-Grande L, Hughes E, Tusor N, Tournier JD, Hutter J, Price AN, Teixeira RPAG, Murgasova M, Victor S, Kelly C, Rutherford MA, Smith SM, Edwards AD, Hajnal JV, Jenkinson M, Rueckert D. The developing human connectome project: A minimal processing pipeline for neonatal cortical surface reconstruction. Neuroimage 2018; 173:88-112. [PMID: 29409960 DOI: 10.1016/j.neuroimage.2018.01.054] [Citation(s) in RCA: 274] [Impact Index Per Article: 39.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2017] [Revised: 01/19/2018] [Accepted: 01/21/2018] [Indexed: 12/11/2022] Open
Abstract
The Developing Human Connectome Project (dHCP) seeks to create the first 4-dimensional connectome of early life. Understanding this connectome in detail may provide insights into normal as well as abnormal patterns of brain development. Following established best practices adopted by the WU-MINN Human Connectome Project (HCP), and pioneered by FreeSurfer, the project utilises cortical surface-based processing pipelines. In this paper, we propose a fully automated processing pipeline for the structural Magnetic Resonance Imaging (MRI) of the developing neonatal brain. This proposed pipeline consists of a refined framework for cortical and sub-cortical volume segmentation, cortical surface extraction, and cortical surface inflation, which has been specifically designed to address considerable differences between adult and neonatal brains, as imaged using MRI. Using the proposed pipeline our results demonstrate that images collected from 465 subjects ranging from 28 to 45 weeks post-menstrual age (PMA) can be processed fully automatically; generating cortical surface models that are topologically correct, and correspond well with manual evaluations of tissue boundaries in 85% of cases. Results improve on state-of-the-art neonatal tissue segmentation models and significant errors were found in only 2% of cases, where these corresponded to subjects with high motion. Downstream, these surfaces will enhance comparisons of functional and diffusion MRI datasets, supporting the modelling of emerging patterns of brain connectivity.
Collapse
Affiliation(s)
- Antonios Makropoulos
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Emma C Robinson
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom; Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom.
| | - Andreas Schuh
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Robert Wright
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Sean Fitzgibbon
- Wellcome Centre for Integrative Neuroimaging, FMRIB Centre, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Jelena Bozek
- Faculty of Electrical Engineering and Computing, University of Zagreb, Zagreb, Croatia
| | - Serena J Counsell
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Johannes Steinweg
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Katy Vecchiato
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Jonathan Passerat-Palmbach
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Gregor Lenz
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Filippo Mortari
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Tencho Tenev
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| | - Eugene P Duff
- Wellcome Centre for Integrative Neuroimaging, FMRIB Centre, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Matteo Bastiani
- Wellcome Centre for Integrative Neuroimaging, FMRIB Centre, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Lucilio Cordero-Grande
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Emer Hughes
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Nora Tusor
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Jacques-Donald Tournier
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Jana Hutter
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Anthony N Price
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Rui Pedro A G Teixeira
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Maria Murgasova
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Suresh Victor
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Christopher Kelly
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Mary A Rutherford
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Stephen M Smith
- Wellcome Centre for Integrative Neuroimaging, FMRIB Centre, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - A David Edwards
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Joseph V Hajnal
- Centre for the Developing Brain, School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Mark Jenkinson
- Wellcome Centre for Integrative Neuroimaging, FMRIB Centre, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Daniel Rueckert
- Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, United Kingdom
| |
Collapse
|
92
|
Fazlollahi A, Ayton S, Bourgeat P, Diouf I, Raniga P, Fripp J, Doecke J, Ames D, Masters CL, Rowe CC, Villemagne VL, Bush AI, Salvado O. A Framework to Objectively Identify Reference Regions for Normalizing Quantitative Imaging. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION – MICCAI 2018 2018. [DOI: 10.1007/978-3-030-00928-1_8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
|
93
|
Castillo-Barnes D, Peis I, Martínez-Murcia FJ, Segovia F, Illán IA, Górriz JM, Ramírez J, Salas-Gonzalez D. A Heavy Tailed Expectation Maximization Hidden Markov Random Field Model with Applications to Segmentation of MRI. Front Neuroinform 2017; 11:66. [PMID: 29209194 PMCID: PMC5702363 DOI: 10.3389/fninf.2017.00066] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2017] [Accepted: 11/03/2017] [Indexed: 11/28/2022] Open
Abstract
A wide range of segmentation approaches assumes that intensity histograms extracted from magnetic resonance images (MRI) have a distribution for each brain tissue that can be modeled by a Gaussian distribution or a mixture of them. Nevertheless, intensity histograms of White Matter and Gray Matter are not symmetric and they exhibit heavy tails. In this work, we present a hidden Markov random field model with expectation maximization (EM-HMRF) modeling the components using the α-stable distribution. The proposed model is a generalization of the widely used EM-HMRF algorithm with Gaussian distributions. We test the α-stable EM-HMRF model in synthetic data and brain MRI data. The proposed methodology presents two main advantages: Firstly, it is more robust to outliers. Secondly, we obtain similar results than using Gaussian when the Gaussian assumption holds. This approach is able to model the spatial dependence between neighboring voxels in tomographic brain MRI.
Collapse
Affiliation(s)
- Diego Castillo-Barnes
- Signal Processing and Biomedical Applications, University of Granada, Granada, Spain
| | - Ignacio Peis
- Signal Processing Group, Carlos III University, Madrid, Spain
| | | | - Fermín Segovia
- Signal Processing and Biomedical Applications, University of Granada, Granada, Spain
| | - Ignacio A Illán
- Signal Processing and Biomedical Applications, University of Granada, Granada, Spain.,Department of Scientific Computing, Florida State University, Tallahassee, FL, United States
| | - Juan M Górriz
- Signal Processing and Biomedical Applications, University of Granada, Granada, Spain.,Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom
| | - Javier Ramírez
- Signal Processing and Biomedical Applications, University of Granada, Granada, Spain
| | - Diego Salas-Gonzalez
- Signal Processing and Biomedical Applications, University of Granada, Granada, Spain
| |
Collapse
|
94
|
Ji Z, Huang Y, Xia Y, Zheng Y. A robust modified Gaussian mixture model with rough set for image segmentation. Neurocomputing 2017. [DOI: 10.1016/j.neucom.2017.05.069] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
95
|
Wang L, Labrosse F, Zwiggelaar R. Comparison of image intensity, local, and multi-atlas priors in brain tissue classification. Med Phys 2017; 44:5782-5794. [PMID: 28795429 DOI: 10.1002/mp.12511] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2016] [Revised: 07/28/2017] [Accepted: 07/28/2017] [Indexed: 11/11/2022] Open
Abstract
PURPOSE Automated and accurate tissue classification in three-dimensional brain magnetic resonance images is essential in volumetric morphometry or as a preprocessing step for diagnosing brain diseases. However, noise, intensity in homogeneity, and partial volume effects limit the classification accuracy of existing methods. This paper provides a comparative study on the contributions of three commonly used image information priors for tissue classification in normal brains: image intensity, local, and multi-atlas priors. METHODS We compared the effectiveness of the three priors by comparing the four methods modeling them: K-Means (KM), KM combined with a Markov Random Field (KM-MRF), multi-atlas segmentation (MAS), and the combination of KM, MRF, and MAS (KM-MRF-MAS). The key parameters and factors in each of the four methods are analyzed, and the performance of all the models is compared quantitatively and qualitatively on both simulated and real data. RESULTS The KM-MRF-MAS model that combines the three image information priors performs best. CONCLUSIONS The image intensity prior is insufficient to generate reasonable results for a few images. Introducing local and multi-atlas priors results in improved brain tissue classification. This study provides a general guide on what image information priors can be used for effective brain tissue classification.
Collapse
Affiliation(s)
- Liping Wang
- Department of Computer Science, Aberystwyth University, Aberystwyth, SY23 3DB, UK
| | - Frédéric Labrosse
- Department of Computer Science, Aberystwyth University, Aberystwyth, SY23 3DB, UK
| | - Reyer Zwiggelaar
- Department of Computer Science, Aberystwyth University, Aberystwyth, SY23 3DB, UK
| |
Collapse
|
96
|
Alves GS, de Carvalho LDA, Sudo FK, Briand L, Laks J, Engelhardt E. A panel of clinical and neuropathological features of cerebrovascular disease through the novel neuroimaging methods. Dement Neuropsychol 2017; 11:343-355. [PMID: 29354214 PMCID: PMC5769992 DOI: 10.1590/1980-57642016dn11-040003] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
UNLABELLED The last decade has witnessed substantial progress in acquiring diagnostic biomarkers for the diagnostic workup of cerebrovascular disease (CVD). Advanced neuroimaging methods not only provide a strategic contribution for the differential diagnosis of vascular dementia (VaD) and vascular cognitive impairment (VCI), but also help elucidate the pathophysiological mechanisms ultimately leading to small vessel disease (SVD) throughout its course. OBJECTIVE In this review, the novel imaging methods, both structural and metabolic, were summarized and their impact on the diagnostic workup of age-related CVD was analysed. Methods: An electronic search between January 2010 and 2017 was carried out on PubMed/MEDLINE, Institute for Scientific Information Web of Knowledge and EMBASE. RESULTS The use of full functional multimodality in simultaneous Magnetic Resonance (MR)/Positron emission tomography (PET) may potentially improve the clinical characterization of VCI-VaD; for structural imaging, MRI at 3.0 T enables higher-resolution scanning with greater imaging matrices, thinner slices and more detail on the anatomical structure of vascular lesions. CONCLUSION Although the importance of most of these techniques in the clinical setting has yet to be recognized, there is great expectancy in achieving earlier and more refined therapeutic interventions for the effective management of VCI-VaD.
Collapse
Affiliation(s)
| | | | - Felipe Kenji Sudo
- Departamento de Psicologia, Pontifícia Universidade Católica do Rio de Janeiro, RJ, Brazil
- Instituto D'Or de Ensino e Pesquisa, Rio de Janeiro, RJ, Brazil
| | - Lucas Briand
- Departamento de Medicina Interna, Universidade Federal do Ceará, CE, Brazil
| | - Jerson Laks
- Instituto de Psiquiatria, Universidade Federal do Rio de Janeiro, RJ, Brazil
- Programa de Pós-Graduação em Biomedicina Translacional (BIOTRANS), Unigranrio, Duque de Caxias, RJ, Brazil
| | - Eliasz Engelhardt
- Setor de Neurologia Cognitiva e do Comportamento, Instituto de Neurologia Deolindo Couto (INDC-CDA/IPUB), Rio de Janeiro, RJ, Brazil
| |
Collapse
|
97
|
Balbastre Y, Rivière D, Souedet N, Fischer C, Hérard AS, Williams S, Vandenberghe ME, Flament J, Aron-Badin R, Hantraye P, Mangin JF, Delzescaux T. Primatologist: A modular segmentation pipeline for macaque brain morphometry. Neuroimage 2017; 162:306-321. [PMID: 28899745 DOI: 10.1016/j.neuroimage.2017.09.007] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2017] [Revised: 08/10/2017] [Accepted: 09/04/2017] [Indexed: 02/08/2023] Open
Abstract
Because they bridge the genetic gap between rodents and humans, non-human primates (NHPs) play a major role in therapy development and evaluation for neurological disorders. However, translational research success from NHPs to patients requires an accurate phenotyping of the models. In patients, magnetic resonance imaging (MRI) combined with automated segmentation methods has offered the unique opportunity to assess in vivo brain morphological changes. Meanwhile, specific challenges caused by brain size and high field contrasts make existing algorithms hard to use routinely in NHPs. To tackle this issue, we propose a complete pipeline, Primatologist, for multi-region segmentation. Tissue segmentation is based on a modular statistical model that includes random field regularization, bias correction and denoising and is optimized by expectation-maximization. To deal with the broad variety of structures with different relaxing times at 7 T, images are segmented into 17 anatomical classes, including subcortical regions. Pre-processing steps insure a good initialization of the parameters and thus the robustness of the pipeline. It is validated on 10 T2-weighted MRIs of healthy macaque brains. Classification scores are compared with those of a non-linear atlas registration, and the impact of each module on classification scores is thoroughly evaluated.
Collapse
Affiliation(s)
- Yaël Balbastre
- UMR9199, CNRS, CEA, Paris-Sud Univ., Univ. Paris-Saclay, Fontenay-aux-Roses, France; MIRCen, Institut de biologie François Jacob, DRF, CEA, Fontenay-aux-Roses, France; UNATI, NeuroSpin, Institut des sciences du vivant Frédéric Joliot, DRF, CEA, Univ. Paris-Saclay, Gif-sur-Yvette, France
| | - Denis Rivière
- UNATI, NeuroSpin, Institut des sciences du vivant Frédéric Joliot, DRF, CEA, Univ. Paris-Saclay, Gif-sur-Yvette, France; CATI Multicenter Neuroimaging Platform, France
| | - Nicolas Souedet
- UMR9199, CNRS, CEA, Paris-Sud Univ., Univ. Paris-Saclay, Fontenay-aux-Roses, France; MIRCen, Institut de biologie François Jacob, DRF, CEA, Fontenay-aux-Roses, France
| | - Clara Fischer
- UNATI, NeuroSpin, Institut des sciences du vivant Frédéric Joliot, DRF, CEA, Univ. Paris-Saclay, Gif-sur-Yvette, France; CATI Multicenter Neuroimaging Platform, France
| | - Anne-Sophie Hérard
- UMR9199, CNRS, CEA, Paris-Sud Univ., Univ. Paris-Saclay, Fontenay-aux-Roses, France; MIRCen, Institut de biologie François Jacob, DRF, CEA, Fontenay-aux-Roses, France
| | - Susannah Williams
- UMR9199, CNRS, CEA, Paris-Sud Univ., Univ. Paris-Saclay, Fontenay-aux-Roses, France; MIRCen, Institut de biologie François Jacob, DRF, CEA, Fontenay-aux-Roses, France
| | - Michel E Vandenberghe
- UMR9199, CNRS, CEA, Paris-Sud Univ., Univ. Paris-Saclay, Fontenay-aux-Roses, France; MIRCen, Institut de biologie François Jacob, DRF, CEA, Fontenay-aux-Roses, France
| | - Julien Flament
- MIRCen, Institut de biologie François Jacob, DRF, CEA, Fontenay-aux-Roses, France; US27, INSERM, Fontenay-aux-Roses, France
| | - Romina Aron-Badin
- UMR9199, CNRS, CEA, Paris-Sud Univ., Univ. Paris-Saclay, Fontenay-aux-Roses, France; MIRCen, Institut de biologie François Jacob, DRF, CEA, Fontenay-aux-Roses, France
| | - Philippe Hantraye
- UMR9199, CNRS, CEA, Paris-Sud Univ., Univ. Paris-Saclay, Fontenay-aux-Roses, France; MIRCen, Institut de biologie François Jacob, DRF, CEA, Fontenay-aux-Roses, France; US27, INSERM, Fontenay-aux-Roses, France
| | - Jean-François Mangin
- UNATI, NeuroSpin, Institut des sciences du vivant Frédéric Joliot, DRF, CEA, Univ. Paris-Saclay, Gif-sur-Yvette, France; CATI Multicenter Neuroimaging Platform, France
| | - Thierry Delzescaux
- UMR9199, CNRS, CEA, Paris-Sud Univ., Univ. Paris-Saclay, Fontenay-aux-Roses, France; MIRCen, Institut de biologie François Jacob, DRF, CEA, Fontenay-aux-Roses, France; Sorbonne Universités, Université Pierre and Marie Curie, Paris, France.
| |
Collapse
|
98
|
Discriminative confidence estimation for probabilistic multi-atlas label fusion. Med Image Anal 2017; 42:274-287. [PMID: 28888171 DOI: 10.1016/j.media.2017.08.008] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2017] [Revised: 06/26/2017] [Accepted: 08/29/2017] [Indexed: 12/31/2022]
Abstract
Quantitative neuroimaging analyses often rely on the accurate segmentation of anatomical brain structures. In contrast to manual segmentation, automatic methods offer reproducible outputs and provide scalability to study large databases. Among existing approaches, multi-atlas segmentation has recently shown to yield state-of-the-art performance in automatic segmentation of brain images. It consists in propagating the labelmaps from a set of atlases to the anatomy of a target image using image registration, and then fusing these multiple warped labelmaps into a consensus segmentation on the target image. Accurately estimating the contribution of each atlas labelmap to the final segmentation is a critical step for the success of multi-atlas segmentation. Common approaches to label fusion either rely on local patch similarity, probabilistic statistical frameworks or a combination of both. In this work, we propose a probabilistic label fusion framework based on atlas label confidences computed at each voxel of the structure of interest. Maximum likelihood atlas confidences are estimated using a supervised approach, explicitly modeling the relationship between local image appearances and segmentation errors produced by each of the atlases. We evaluate different spatial pooling strategies for modeling local segmentation errors. We also present a novel type of label-dependent appearance features based on atlas labelmaps that are used during confidence estimation to increase the accuracy of our label fusion. Our approach is evaluated on the segmentation of seven subcortical brain structures from the MICCAI 2013 SATA Challenge dataset and the hippocampi from the ADNI dataset. Overall, our results indicate that the proposed label fusion framework achieves superior performance to state-of-the-art approaches in the majority of the evaluated brain structures and shows more robustness to registration errors.
Collapse
|
99
|
Doran SJ, Hipwell JH, Denholm R, Eiben B, Busana M, Hawkes DJ, Leach MO, Silva IDS. Breast MRI segmentation for density estimation: Do different methods give the same results and how much do differences matter? Med Phys 2017; 44:4573-4592. [PMID: 28477346 PMCID: PMC5697622 DOI: 10.1002/mp.12320] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2016] [Revised: 03/02/2017] [Accepted: 04/03/2017] [Indexed: 11/20/2022] Open
Abstract
PURPOSE To compare two methods of automatic breast segmentation with each other and with manual segmentation in a large subject cohort. To discuss the factors involved in selecting the most appropriate algorithm for automatic segmentation and, in particular, to investigate the appropriateness of overlap measures (e.g., Dice and Jaccard coefficients) as the primary determinant in algorithm selection. METHODS Two methods of breast segmentation were applied to the task of calculating MRI breast density in 200 subjects drawn from the Avon Longitudinal Study of Parents and Children, a large cohort study with an MRI component. A semiautomated, bias-corrected, fuzzy C-means (BC-FCM) method was combined with morphological operations to segment the overall breast volume from in-phase Dixon images. The method makes use of novel, problem-specific insights. The resulting segmentation mask was then applied to the corresponding Dixon water and fat images, which were combined to give Dixon MRI density values. Contemporaneously acquired T1 - and T2 -weighted image datasets were analyzed using a novel and fully automated algorithm involving image filtering, landmark identification, and explicit location of the pectoral muscle boundary. Within the region found, fat-water discrimination was performed using an Expectation Maximization-Markov Random Field technique, yielding a second independent estimate of MRI density. RESULTS Images are presented for two individual women, demonstrating how the difficulty of the problem is highly subject-specific. Dice and Jaccard coefficients comparing the semiautomated BC-FCM method, operating on Dixon source data, with expert manual segmentation are presented. The corresponding results for the method based on T1 - and T2 -weighted data are slightly lower in the individual cases shown, but scatter plots and interclass correlations for the cohort as a whole show that both methods do an excellent job in segmenting and classifying breast tissue. CONCLUSIONS Epidemiological results demonstrate that both methods of automated segmentation are suitable for the chosen application and that it is important to consider a range of factors when choosing a segmentation algorithm, rather than focus narrowly on a single metric such as the Dice coefficient.
Collapse
Affiliation(s)
- Simon J. Doran
- Division of Radiotherapy and Imaging, The Institute of Cancer ResearchCancer Research UK Cancer Imaging CentreLondonSM2 5NGUK
| | - John H. Hipwell
- Department of Medical Physics and BioengineeringUCL, Centre for Medical Image Computing (CMIC)LondonWC1E 7JEUK
| | - Rachel Denholm
- Department of Non‐Communicable Disease EpidemiologyLondon School of Hygiene & Tropical MedicineLondonWC1E 7HTUK
| | - Björn Eiben
- Department of Medical Physics and BioengineeringUCL, Centre for Medical Image Computing (CMIC)LondonWC1E 7JEUK
| | - Marta Busana
- Department of Non‐Communicable Disease EpidemiologyLondon School of Hygiene & Tropical MedicineLondonWC1E 7HTUK
| | - David J. Hawkes
- Department of Medical Physics and BioengineeringUCL, Centre for Medical Image Computing (CMIC)LondonWC1E 7JEUK
| | - Martin O. Leach
- Division of Radiotherapy and Imaging, The Institute of Cancer ResearchCancer Research UK Cancer Imaging CentreLondonSM2 5NGUK
| | - Isabel dos Santos Silva
- Department of Non‐Communicable Disease EpidemiologyLondon School of Hygiene & Tropical MedicineLondonWC1E 7HTUK
| |
Collapse
|
100
|
Durazzo TC, Mon A, Gazdzinski S, Meyerhoff DJ. Regional brain volume changes in alcohol-dependent individuals during early abstinence: associations with relapse following treatment. Addict Biol 2017; 22:1416-1425. [PMID: 27329647 DOI: 10.1111/adb.12420] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2016] [Revised: 04/26/2016] [Accepted: 05/13/2016] [Indexed: 12/15/2022]
Abstract
Cross-sectional structural magnetic resonance (MR) imaging studies of individuals with an alcohol use disorder (AUD) report that those who relapse after treatment, relative to individuals who maintain a period of extended abstinence, show greater morphological abnormalities in multiple brain regions near the inception of treatment, particularly in the frontal lobe. However, given the cross-sectional design of previous studies, it is unclear if the baseline morphological differences between future abstainers and relapsers were maintained over the course of early recovery. The primary goal of this study was to determine if frontal lobe tissue volume recovery during early abstinence is associated with long-term abstinence from alcohol. We compared frontal, parietal, temporal and occipital grey matter (GM) and white matter (WM) volumes, at 1 and 4 weeks of abstinence, among individuals who resumed alcohol consumption within 12 months of treatment (Relapsers) and those who showed sustained abstinence over 12 months following treatment (Abstainers). At 1 and 4 weeks of sobriety, both Abstainers and Relapsers demonstrated significantly smaller GM volumes than Controls in the majority of ROIs, but Relapsers exhibited significantly smaller bilateral frontal GM volumes than Abstainers. No significant group differences were observed for any WM region of interest. The persistent bilateral frontal GM volume deficits in Relapsers over 4 weeks from last alcohol use may represent an endophenotype that differentiates those who respond more favorably to the typical psychosocial and pharmacological interventions provided for AUD.
Collapse
Affiliation(s)
- Timothy C. Durazzo
- Department of Psychiatry and Behavioral Sciences; Stanford University School of Medicine; USA
- Mental Illness Research and Education Clinical Centers and Sierra-Pacific War Related Illness and Injury Study Center; VA Palo Alto Health Care System; USA
| | - Anderson Mon
- Department of Biomedical Engineering; School of Engineering Sciences University of Ghana; Legon Ghana
| | | | - Dieter J. Meyerhoff
- Department of Radiology and Biomedical Imaging; University of California; San Francisco USA
- Center for Imaging of Neurodegenerative Diseases; San Francisco VA Medical Center; USA
| |
Collapse
|