1
|
Sundaresan V, Zamboni G, Rothwell PM, Jenkinson M, Griffanti L. Triplanar ensemble U-Net model for white matter hyperintensities segmentation on MR images. Med Image Anal 2021; 73:102184. [PMID: 34325148 PMCID: PMC8505759 DOI: 10.1016/j.media.2021.102184] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Revised: 03/10/2021] [Accepted: 07/16/2021] [Indexed: 01/05/2023]
Abstract
White matter hyperintensities (WMHs) have been associated with various cerebrovascular and neurodegenerative diseases. Reliable quantification of WMHs is essential for understanding their clinical impact in normal and pathological populations. Automated segmentation of WMHs is highly challenging due to heterogeneity in WMH characteristics between deep and periventricular white matter, presence of artefacts and differences in the pathology and demographics of populations. In this work, we propose an ensemble triplanar network that combines the predictions from three different planes of brain MR images to provide an accurate WMH segmentation. In the loss functions the network uses anatomical information regarding WMH spatial distribution in loss functions, to improve the efficiency of segmentation and to overcome the contrast variations between deep and periventricular WMHs. We evaluated our method on 5 datasets, of which 3 are part of a publicly available dataset (training data for MICCAI WMH Segmentation Challenge 2017 - MWSC 2017) consisting of subjects from three different cohorts, and we also submitted our method to MWSC 2017 to be evaluated on the unseen test datasets. On evaluating our method separately in deep and periventricular regions, we observed robust and comparable performance in both regions. Our method performed better than most of the existing methods, including FSL BIANCA, and on par with the top ranking deep learning methods of MWSC 2017.
Collapse
Affiliation(s)
- Vaanathi Sundaresan
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
- Oxford-Nottingham Centre for Doctoral Training in Biomedical Imaging, University of Oxford, UK
- Oxford India Centre for Sustainable Development, Somerville College, University of Oxford, UK
| | - Giovanna Zamboni
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
- Centre for Prevention of Stroke and Dementia, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
- Dipartimento di Scienze Biomediche, Metaboliche e Neuroscienze, Universitá di Modena e Reggio Emilia, Italy
| | - Peter M. Rothwell
- Centre for Prevention of Stroke and Dementia, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| | - Mark Jenkinson
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
- Australian Institute for Machine Learning (AIML), School of Computer Science, The University of Adelaide, Adelaide, Australia
| | - Ludovica Griffanti
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Human Brain Activity, Department of Psychiatry, University of Oxford, Oxford, UK
| |
Collapse
|
2
|
Mishro PK, Agrawal S, Panda R, Abraham A. A Novel Type-2 Fuzzy C-Means Clustering for Brain MR Image Segmentation. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:3901-3912. [PMID: 32568716 DOI: 10.1109/tcyb.2020.2994235] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
The fuzzy C -means (FCM) clustering procedure is an unsupervised form of grouping the homogenous pixels of an image in the feature space into clusters. A brain magnetic resonance (MR) image is affected by noise and intensity inhomogeneity (IIH) during the acquisition process. FCM has been used in MR brain tissue segmentation. However, it does not consider the neighboring pixels for computing the membership values, thereby misclassifying the noisy pixels. The inaccurate cluster centers obtained in FCM do not address the problem of IIH. A fixed value of the fuzzifier ( m ) used in FCM brings uncertainty in controlling the fuzziness of the extracted clusters. To resolve these issues, we suggest a novel type-2 adaptive weighted spatial FCM (AWSFCM) clustering algorithm for MR brain tissue segmentation. The idea of type-2 FCM applied to the problem on hand is new and is reported in this article. The application of the proposed technique to the problem of MR brain tissue segmentation replaces the fixed fuzzifier value with a fuzzy linguistic fuzzifier value ( M ). The introduction of the spatial information in the membership function reduces the misclassification of noisy pixels. Furthermore, the incorporation of adaptive weights into the cluster center update function improves the accuracy of the final cluster centers, thereby reducing the effect of IIH. The suggested algorithm is evaluated using T1-w, T2-w, and proton density (PD) brain MR image slices. The performance is justified in terms of qualitative and quantitative measures followed by statistical analysis. The outcomes demonstrate the superiority and robustness of the algorithm in comparison to the state-of-the-art methods. This article is useful for the cybernetics application.
Collapse
|
3
|
DiGregorio J, Arezza G, Gibicar A, Moody AR, Tyrrell PN, Khademi A. Intracranial volume segmentation for neurodegenerative populations using multicentre FLAIR MRI. NEUROIMAGE: REPORTS 2021. [DOI: 10.1016/j.ynirp.2021.100006] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
|
4
|
Gryska E, Schneiderman J, Björkman-Burtscher I, Heckemann RA. Automatic brain lesion segmentation on standard magnetic resonance images: a scoping review. BMJ Open 2021; 11:e042660. [PMID: 33514580 PMCID: PMC7849889 DOI: 10.1136/bmjopen-2020-042660] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/11/2020] [Revised: 01/09/2021] [Accepted: 01/12/2021] [Indexed: 12/11/2022] Open
Abstract
OBJECTIVES Medical image analysis practices face challenges that can potentially be addressed with algorithm-based segmentation tools. In this study, we map the field of automatic MR brain lesion segmentation to understand the clinical applicability of prevalent methods and study designs, as well as challenges and limitations in the field. DESIGN Scoping review. SETTING Three databases (PubMed, IEEE Xplore and Scopus) were searched with tailored queries. Studies were included based on predefined criteria. Emerging themes during consecutive title, abstract, methods and whole-text screening were identified. The full-text analysis focused on materials, preprocessing, performance evaluation and comparison. RESULTS Out of 2990 unique articles identified through the search, 441 articles met the eligibility criteria, with an estimated growth rate of 10% per year. We present a general overview and trends in the field with regard to publication sources, segmentation principles used and types of lesions. Algorithms are predominantly evaluated by measuring the agreement of segmentation results with a trusted reference. Few articles describe measures of clinical validity. CONCLUSIONS The observed reporting practices leave room for improvement with a view to studying replication, method comparison and clinical applicability. To promote this improvement, we propose a list of recommendations for future studies in the field.
Collapse
Affiliation(s)
- Emilia Gryska
- Medical Radiation Sciences, Goteborgs universitet Institutionen for kliniska vetenskaper, Goteborg, Sweden
| | - Justin Schneiderman
- Sektionen för klinisk neurovetenskap, Goteborgs Universitet Institutionen for Neurovetenskap och fysiologi, Goteborg, Sweden
| | | | - Rolf A Heckemann
- Medical Radiation Sciences, Goteborgs universitet Institutionen for kliniska vetenskaper, Goteborg, Sweden
| |
Collapse
|
5
|
Narayana PA, Coronado I, Sujit SJ, Sun X, Wolinsky JS, Gabr RE. Are multi-contrast magnetic resonance images necessary for segmenting multiple sclerosis brains? A large cohort study based on deep learning. Magn Reson Imaging 2020; 65:8-14. [PMID: 31670238 PMCID: PMC6918476 DOI: 10.1016/j.mri.2019.10.003] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2019] [Revised: 08/19/2019] [Accepted: 10/08/2019] [Indexed: 01/17/2023]
Abstract
BACKGROUND Magnetic resonance images with multiple contrasts or sequences are commonly used for segmenting brain tissues, including lesions, in multiple sclerosis (MS). However, acquisition of images with multiple contrasts increases the scan time and complexity of the analysis, possibly introducing factors that could compromise segmentation quality. OBJECTIVE To investigate the effect of various combinations of multi-contrast images as input on the segmented volumes of gray (GM) and white matter (WM), cerebrospinal fluid (CSF), and lesions using a deep neural network. METHODS U-net, a fully convolutional neural network was used to automatically segment GM, WM, CSF, and lesions in 1000 MS patients. The input to the network consisted of 15 combinations of FLAIR, T1-, T2-, and proton density-weighted images. The Dice similarity coefficient (DSC) was evaluated to assess the segmentation performance. For lesions, true positive rate (TPR) and false positive rate (FPR) were also evaluated. In addition, the effect of lesion size on lesion segmentation was investigated. RESULTS Highest DSC was observed for all the tissue volumes, including lesions, when the input was combination of all four image contrasts. All other input combinations that included FLAIR also provided high DSC for all tissue classes. However, the quality of lesion segmentation showed strong dependence on the input images. The DSC and TPR values for inputs with the four contrast combination and FLAIR alone were very similar, but FLAIR showed a moderately higher FPR for lesion size <100 μl. For lesions smaller than 20 μl all image combinations resulted in poor performance. The segmentation quality improved with lesion size. CONCLUSIONS Best performance for segmented tissue volumes was obtained with all four image contrasts as the input, and comparable performance was attainable with FLAIR only as the input, albeit with a moderate increase in FPR for small lesions. This implies that acquisition of only FLAIR images provides satisfactory tissue segmentation. Lesion segmentation was poor for very small lesions and improved rapidly with lesion size.
Collapse
Affiliation(s)
- Ponnada A Narayana
- Department of Diagnostic and Interventional Imaging, McGovern Medical School, University of Texas Health Science Center, Houston, TX 77030, United States of America.
| | - Ivan Coronado
- Department of Diagnostic and Interventional Imaging, McGovern Medical School, University of Texas Health Science Center, Houston, TX 77030, United States of America
| | - Sheeba J Sujit
- Department of Diagnostic and Interventional Imaging, McGovern Medical School, University of Texas Health Science Center, Houston, TX 77030, United States of America
| | - Xiaojun Sun
- Department of Diagnostic and Interventional Imaging, McGovern Medical School, University of Texas Health Science Center, Houston, TX 77030, United States of America
| | - Jerry S Wolinsky
- Department of Neurology, McGovern Medical School, University of Texas Health Science Center, Houston, TX 77030, United States of America
| | - Refaat E Gabr
- Department of Diagnostic and Interventional Imaging, McGovern Medical School, University of Texas Health Science Center, Houston, TX 77030, United States of America
| |
Collapse
|
6
|
Duchesne S, Dieumegarde L, Chouinard I, Farokhian F, Badhwar A, Bellec P, Tétreault P, Descoteaux M, Boré A, Houde JC, Beaulieu C, Potvin O. Structural and functional multi-platform MRI series of a single human volunteer over more than fifteen years. Sci Data 2019; 6:245. [PMID: 31672977 PMCID: PMC6823440 DOI: 10.1038/s41597-019-0262-8] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2019] [Accepted: 09/06/2019] [Indexed: 11/16/2022] Open
Abstract
We present MRI data from a single human volunteer consisting in over 599 multi-contrast MR images (T1-weighted, T2-weighted, proton density, fluid-attenuated inversion recovery, T2* gradient-echo, diffusion, susceptibility-weighted, arterial-spin labelled, and resting state BOLD functional connectivity imaging) acquired in over 73 sessions on 36 different scanners (13 models, three manufacturers) over the course of 15+ years (cf. Data records). Data included planned data collection acquired within the Consortium pour l'identification précoce de la maladie Alzheimer - Québec (CIMA-Q) and Canadian Consortium on Neurodegeneration in Aging (CCNA) studies, as well as opportunistic data collection from various protocols. These multiple within- and between-centre scans over a substantial time course of a single, cognitively healthy volunteer can be useful to answer a number of methodological questions of interest to the community.
Collapse
Affiliation(s)
- Simon Duchesne
- Department of Radiology, Université Laval, Québec, Canada.
- CERVO Brain Research Centre, Institut universitaire de santé mentale de Québec, Québec, Canada.
| | - Louis Dieumegarde
- CERVO Brain Research Centre, Institut universitaire de santé mentale de Québec, Québec, Canada
| | - Isabelle Chouinard
- CERVO Brain Research Centre, Institut universitaire de santé mentale de Québec, Québec, Canada
| | - Farnaz Farokhian
- CERVO Brain Research Centre, Institut universitaire de santé mentale de Québec, Québec, Canada
| | - Amanpreet Badhwar
- Centre de recherche de l'Institut universitaire en gériatrie de Montréal, Québec, Canada
| | - Pierre Bellec
- Centre de recherche de l'Institut universitaire en gériatrie de Montréal, Québec, Canada
| | - Pascal Tétreault
- Department of Biomedical Engineering, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Canada
| | - Maxime Descoteaux
- Sherbrooke Connectivity Imaging Lab (SCIL), Université de Sherbrooke, Sherbrooke, Canada
| | - Arnaud Boré
- Centre de recherche de l'Institut universitaire en gériatrie de Montréal, Québec, Canada
- Sherbrooke Connectivity Imaging Lab (SCIL), Université de Sherbrooke, Sherbrooke, Canada
| | - Jean-Christophe Houde
- Sherbrooke Connectivity Imaging Lab (SCIL), Université de Sherbrooke, Sherbrooke, Canada
| | - Christian Beaulieu
- Department of Biomedical Engineering, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Canada
| | - Olivier Potvin
- CERVO Brain Research Centre, Institut universitaire de santé mentale de Québec, Québec, Canada
| |
Collapse
|
7
|
Reiche B, Moody A, Khademi A. Pathology-preserving intensity standardization framework for multi-institutional FLAIR MRI datasets. Magn Reson Imaging 2019; 62:59-69. [DOI: 10.1016/j.mri.2019.05.001] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2018] [Revised: 05/01/2019] [Accepted: 05/01/2019] [Indexed: 10/26/2022]
|
8
|
Khademi A, Reiche B, DiGregorio J, Arezza G, Moody AR. Whole volume brain extraction for multi-centre, multi-disease FLAIR MRI datasets. Magn Reson Imaging 2019; 66:116-130. [PMID: 31472262 DOI: 10.1016/j.mri.2019.08.022] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2019] [Revised: 05/01/2019] [Accepted: 08/15/2019] [Indexed: 11/19/2022]
Abstract
Automatic segmentation of the brain from magnetic resonance images (MRI) is a fundamental step in many neuroimaging processing frameworks. There are mature technologies for this task for T1- and T2-weighted MRI; however, a widely-accepted brain extraction method for Fluid-Attenuated Inversion Recovery (FLAIR) MRI has yet to be established. FLAIR MRI are becoming increasingly important for the analysis of neurodegenerative diseases and tools developed for this sequence would have clinical value. To maximize translation opportunities and for large scale research studies, algorithms for brain extraction in FLAIR MRI should generalize to multi-centre (MC) data. To this end, this work proposes a fully automated, whole volume brain extraction methodology for MC FLAIR MRI datasets. The framework is built using a novel standardization framework which reduces acquisition artifacts, standardizes the intensities of tissues and normalizes the spatial coordinates of brain tissue across MC datasets. Using the standardized datasets, an intuitive set of features based on intensity, spatial location and gradients are extracted and classified using a random forest (RF) classifier to segment the brain tissue class. A series of experiments were conducted to optimize classifier parameters, and to determine segmentation accuracy for standardized and unstandardized (original) data, as a function of scanner vendor, feature type and disease type. The models are trained, tested and validated on 156 image volumes (∼8000 image slices) from two multi-centre, multi-disease datasets, acquired with varying imaging parameters from 30 centres and three scanner vendors. The image datasets, denoted as CAIN and ADNI for vascular and dementia disease, respectively, represent a diverse collection of MC data to test the generalization capabilities of the proposed design. Results demonstrate the importance of standardization for segmentation of MC data, as models trained on standardized data yielded a drastic improvement in brain extraction accuracy compared to the original, unstandardized data (CAIN: DSC = 91% and ADNI: DSC = 86% vs. CAIN: 78% and ADNI: 65%). It was also found that models created from one scanner vendor based on unstandardized data yielded poor segmentation results in data acquired from other scanner vendors, which was improved through standardization. These results demonstrate that to create consistency in segmentations from multi-institutional datasets it is paramount that MC variability be mitigated to improve stability and to ensure generalization of machine learning algorithms for MRI.
Collapse
Affiliation(s)
- April Khademi
- Image Analysis in Medicine Lab (IAMLAB), Department of Electrical, Computer and Biomedical Engineering, Ryerson University, Toronto, ON M5B 2K3, Canada.
| | | | - Justin DiGregorio
- Image Analysis in Medicine Lab (IAMLAB), Department of Electrical, Computer and Biomedical Engineering, Ryerson University, Toronto, ON M5B 2K3, Canada
| | - Giordano Arezza
- Image Analysis in Medicine Lab (IAMLAB), Department of Electrical, Computer and Biomedical Engineering, Ryerson University, Toronto, ON M5B 2K3, Canada
| | - Alan R Moody
- Department of Medical Imaging, University of Toronto, Toronto M5S 1A1, Canada
| |
Collapse
|
9
|
Potvin O, Khademi A, Chouinard I, Farokhian F, Dieumegarde L, Leppert I, Hoge R, Rajah MN, Bellec P, Duchesne S. Measurement Variability Following MRI System Upgrade. Front Neurol 2019; 10:726. [PMID: 31379704 PMCID: PMC6648007 DOI: 10.3389/fneur.2019.00726] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2019] [Accepted: 06/19/2019] [Indexed: 12/02/2022] Open
Abstract
Major hardware/software changes to MRI platforms, either planned or unplanned, will almost invariably occur in longitudinal studies. Our objective was to assess the resulting variability on relevant imaging measurements in such context, specifically for three Siemens Healthcare Magnetom Trio upgrades to the Prismafit platform. We report data acquired on three healthy volunteers scanned before and after three different platform upgrades. We assessed differences in image signal [contrast-to-noise ratio (CNR)] on T1-weighted images (T1w) and fluid-attenuated inversion recovery images (FLAIR); brain morphometry on T1w image; and small vessel disease (white matter hyperintensities; WMH) on FLAIR image. Prismafit upgrade resulted in higher (30%) and more variable neocortical CNR and larger brain volume and thickness mainly in frontal areas. A significant relationship was observed between neocortical CNR and neocortical volume. For FLAIR images, no significant CNR difference was observed, but WMH volumes were significantly smaller (-68%) after Prismafit upgrade, when compared to results on the Magnetom Trio. Together, these results indicate that Prismafit upgrade significantly influenced image signal, brain morphometry measures and small vessel diseases measures and that these effects need to be taken into account when analyzing results from any longitudinal study undergoing similar changes.
Collapse
Affiliation(s)
| | - April Khademi
- Image Analysis in Medicine Lab, Ryerson University, Toronto, ON, Canada
| | | | | | | | - Ilana Leppert
- McGill University, Montreal, QC, Canada.,Montreal Neurological Institute, Montreal, QC, Canada
| | - Rick Hoge
- McGill University, Montreal, QC, Canada.,Montreal Neurological Institute, Montreal, QC, Canada
| | - Maria Natasha Rajah
- McGill University, Montreal, QC, Canada.,Douglas Mental Health University Institute, Montreal, QC, Canada
| | - Pierre Bellec
- Institut Universitaire en Gériatrie de Montréal, Montreal, QC, Canada.,Département de Psychologie, Université de Montréal, Montreal, QC, Canada
| | - Simon Duchesne
- Centre de Recherche CERVO, Quebec, QC, Canada.,Département de Radiologie et de Médecine Nucléaire, Université Laval, Quebec, QC, Canada
| | | | | |
Collapse
|
10
|
Wu D, Albert M, Soldan A, Pettigrew C, Oishi K, Tomogane Y, Ye C, Ma T, Miller MI, Mori S. Multi-atlas based detection and localization (MADL) for location-dependent quantification of white matter hyperintensities. NEUROIMAGE-CLINICAL 2019; 22:101772. [PMID: 30927606 PMCID: PMC6444296 DOI: 10.1016/j.nicl.2019.101772] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/18/2018] [Revised: 02/05/2019] [Accepted: 03/10/2019] [Indexed: 02/07/2023]
Abstract
The extent and spatial location of white matter hyperintensities (WMH) on brain MRI may be relevant to the development of cognitive decline in older persons. Here, we introduce a new method, known as the Multi-atlas based Detection and Localization (MADL), to evaluate WMH on fluid-attenuated inversion recovery (FLAIR) data. This method simultaneously parcellates the whole brain into 143 structures and labels hyperintense areas within each WM structure. First, a multi-atlas library was established with FLAIR data of normal elderly brains; and then a multi-atlas fusion algorithm was developed by which voxels with locally abnormal intensities were detected as WMH. At the same time, brain segmentation maps were generated from the multi-atlas fusion process to determine the anatomical location of WMH. Areas identified using the MADL method agreed well with manual delineation, with an interclass correlation of 0.97 and similarity index (SI) between 0.55 and 0.72, depending on the total WMH load. Performance was compared to other state-of-the-art WMH detection methods, such as BIANCA and LST. MADL-based analyses of WMH in an older population revealed a significant association between age and WMH load in deep WM but not subcortical WM. The findings also suggested increased WMH load in selective brain regions in subjects with mild cognitive impairment compared to controls, including the inferior deep WM and occipital subcortical WM. The proposed MADL approach may facilitate location-dependent characterization of WMH in older individuals with memory impairment. We proposed a multi-atlas based method for simultaneous detection and location of WMH on FLAIR images. The method generates whole-brain segmentation for location-dependent WMH analysis. The method showed reasonably high detection accuracy in comparison with other methods. Results revealed a selective association between deep brain WMH and subject age. Results suggested increased WMH in the inferior white matter in MCI patients.
Collapse
Affiliation(s)
- Dan Wu
- Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, China; Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| | - Marilyn Albert
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Anja Soldan
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Corinne Pettigrew
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Kenichi Oishi
- Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Yusuke Tomogane
- Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Chenfei Ye
- Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Ting Ma
- Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Michael I Miller
- Department of Biomedicine Engineering, Johns Hopkins University, Baltimore, MD, USA; Center of Imaging Science, Johns Hopkins University, Baltimore, MD, USA; Institute for Computational Medicine, Johns Hopkins University, Baltimore, MD, USA
| | - Susumu Mori
- Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, USA; F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, USA
| |
Collapse
|
11
|
Danelakis A, Theoharis T, Verganelakis DA. Survey of automated multiple sclerosis lesion segmentation techniques on magnetic resonance imaging. Comput Med Imaging Graph 2018; 70:83-100. [DOI: 10.1016/j.compmedimag.2018.10.002] [Citation(s) in RCA: 55] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2018] [Revised: 09/05/2018] [Accepted: 10/02/2018] [Indexed: 01/18/2023]
|
12
|
Diniz PHB, Valente TLA, Diniz JOB, Silva AC, Gattass M, Ventura N, Muniz BC, Gasparetto EL. Detection of white matter lesion regions in MRI using SLIC0 and convolutional neural network. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 167:49-63. [PMID: 29706405 DOI: 10.1016/j.cmpb.2018.04.011] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/01/2017] [Revised: 02/12/2018] [Accepted: 04/17/2018] [Indexed: 05/06/2023]
Abstract
BACKGROUND AND OBJECTIVE White matter lesions are non-static brain lesions that have a prevalence rate up to 98% in the elderly population. Because they may be associated with several brain diseases, it is important that they are detected as soon as possible. Magnetic Resonance Imaging (MRI) provides three-dimensional data with the possibility to detect and emphasize contrast differences in soft tissues, providing rich information about the human soft tissue anatomy. However, the amount of data provided for these images is far too much for manual analysis/interpretation, representing a difficult and time-consuming task for specialists. This work presents a computational methodology capable of detecting regions of white matter lesions of the brain in MRI of FLAIR modality. The techniques highlighted in this methodology are SLIC0 clustering for candidate segmentation and convolutional neural networks for candidate classification. METHODS The methodology proposed here consists of four steps: (1) images acquisition, (2) images preprocessing, (3) candidates segmentation and (4) candidates classification. RESULTS The methodology was applied on 91 magnetic resonance images provided by DASA, and achieved an accuracy of 98.73%, specificity of 98.77% and sensitivity of 78.79% with 0.005 of false positives, without any false positives reduction technique, in detection of white matter lesion regions. CONCLUSIONS It is demonstrated the feasibility of the analysis of brain MRI using SLIC0 and convolutional neural network techniques to achieve success in detection of white matter lesions regions.
Collapse
Affiliation(s)
- Pedro Henrique Bandeira Diniz
- Pontifical Catholic University of Rio de Janeiro - PUC - RioR. São Vicente, 225, Gávea, RJ, Rio de Janeiro, 22453-900, Brazil.
| | - Thales Levi Azevedo Valente
- Pontifical Catholic University of Rio de Janeiro - PUC - RioR. São Vicente, 225, Gávea, RJ, Rio de Janeiro, 22453-900, Brazil.
| | - João Otávio Bandeira Diniz
- Federal University of Maranhão - UFMA Applied Computing Group - NCA Av. dos Portugueses, SN, Bacanga, MA, São Luís, 65085-580, Brazil.
| | - Aristófanes Corrêa Silva
- Federal University of Maranhão - UFMA Applied Computing Group - NCA Av. dos Portugueses, SN, Bacanga, MA, São Luís, 65085-580, Brazil.
| | - Marcelo Gattass
- Pontifical Catholic University of Rio de Janeiro - PUC - RioR. São Vicente, 225, Gávea, RJ, Rio de Janeiro, 22453-900, Brazil.
| | - Nina Ventura
- Paulo Niemeyer State Brain Institute - IECR. Lobo Júnior, 2293, Penha -RJ, 21070-060, Brazil.
| | - Bernardo Carvalho Muniz
- Paulo Niemeyer State Brain Institute - IECR. Lobo Júnior, 2293, Penha -RJ, 21070-060, Brazil.
| | | |
Collapse
|
13
|
Duchesne S, Chouinard I, Potvin O, Fonov VS, Khademi A, Bartha R, Bellec P, Collins DL, Descoteaux M, Hoge R, McCreary CR, Ramirez J, Scott CJ, Smith EE, Strother SC, Black SE. The Canadian Dementia Imaging Protocol: Harmonizing National Cohorts. J Magn Reson Imaging 2018; 49:456-465. [DOI: 10.1002/jmri.26197] [Citation(s) in RCA: 39] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2017] [Accepted: 04/30/2018] [Indexed: 10/28/2022] Open
Affiliation(s)
- Simon Duchesne
- Department of Radiology; Université Laval; Québec Canada
- Centre CERVO; Institut universitaire de santé mentale de Québec; Québec Canada
| | - Isabelle Chouinard
- Centre CERVO; Institut universitaire de santé mentale de Québec; Québec Canada
| | - Olivier Potvin
- Centre CERVO; Institut universitaire de santé mentale de Québec; Québec Canada
| | - Vladimir S. Fonov
- McConnell Brain imaging Center, Montreal Neurological Institute; McGill University; Montréal Canada
| | - April Khademi
- Image Analysis in Medicine Lab; Ryerson University; Toronto Canada
| | - Robert Bartha
- Centre for Functional and Metabolic Mapping, Robarts Research Institute, Department of Medical Biophysics; University of Western Ontario; London Canada
| | | | - D. Louis Collins
- McConnell Brain imaging Center, Montreal Neurological Institute; McGill University; Montréal Canada
| | - Maxime Descoteaux
- Sherbrooke Connectivity Imaging Lab; Université de Sherbrooke; Sherbrooke Canada
| | - Rick Hoge
- McConnell Brain imaging Center, Montreal Neurological Institute; McGill University; Montréal Canada
| | - Cheryl R. McCreary
- Department of Clinical Neurosciences; University of Calgary; Calgary Canada
| | - Joel Ramirez
- LC Campbell Cognitive Neurology Research, Sunnybrook Research Institute; University of Toronto; Toronto Canada
| | - Christopher J.M. Scott
- LC Campbell Cognitive Neurology Research, Sunnybrook Research Institute; University of Toronto; Toronto Canada
| | - Eric E. Smith
- Department of Clinical Neurosciences; University of Calgary; Calgary Canada
| | - Stephen C. Strother
- Rotman Research Institute, Baycrest Medical Biophysics; University of Toronto; Toronto Canada
| | - Sandra E. Black
- LC Campbell Cognitive Neurology Research, Sunnybrook Research Institute; University of Toronto; Toronto Canada
| | | |
Collapse
|
14
|
Knight J, Taylor GW, Khademi A. Voxel-Wise Logistic Regression and Leave-One-Source-Out Cross Validation for white matter hyperintensity segmentation. Magn Reson Imaging 2018; 54:119-136. [PMID: 29932970 DOI: 10.1016/j.mri.2018.06.009] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2018] [Revised: 06/11/2018] [Accepted: 06/13/2018] [Indexed: 12/21/2022]
Abstract
Many algorithms have been proposed for automated segmentation of white matter hyperintensities (WMH) in brain MRI. Yet, broad uptake of any particular algorithm has not been observed. In this work, we argue that this may be due to variable and suboptimal validation data and frameworks, precluding direct comparison of methods on heterogeneous data. As a solution, we present Leave-One-Source-Out Cross Validation (LOSO-CV), which leverages all available data for performance estimation, and show that this gives more realistic (lower) estimates of segmentation algorithm performance on data from different scanners. We also develop a FLAIR-only WMH segmentation algorithm: Voxel-Wise Logistic Regression (VLR), inspired by the open-source Lesion Prediction Algorithm (LPA). Our variant facilitates more accurate parameter estimation, and permits intuitive interpretation of model parameters. We illustrate the performance of the VLR algorithm using the LOSO-CV framework with a dataset comprising freely available data from several recent competitions (96 images from 7 scanners). The performance of the VLR algorithm (median Similarity Index of 0.69) is compared to its LPA predecessor (0.58), and the results of the VLR algorithm in the 2017 WMH Segmentation Competition are also presented.
Collapse
Affiliation(s)
- Jesse Knight
- University of Guelph, 50 Stone Rd E, Guelph, Canada.
| | - Graham W Taylor
- University of Guelph, 50 Stone Rd E, Guelph, Canada; Vector Institute, 101 College Street, Toronto, Suite HL30B, Canada
| | - April Khademi
- Ryerson University, 350 Victoria St, Toronto, Canada
| |
Collapse
|
15
|
Rachmadi MF, Valdés-Hernández MDC, Agan MLF, Di Perri C, Komura T. Segmentation of white matter hyperintensities using convolutional neural networks with global spatial information in routine clinical brain MRI with none or mild vascular pathology. Comput Med Imaging Graph 2018. [DOI: 10.1016/j.compmedimag.2018.02.002] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
|
16
|
Rincón M, Díaz-López E, Selnes P, Vegge K, Altmann M, Fladby T, Bjørnerud A. Improved Automatic Segmentation of White Matter Hyperintensities in MRI Based on Multilevel Lesion Features. Neuroinformatics 2018; 15:231-245. [PMID: 28378263 DOI: 10.1007/s12021-017-9328-y] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Brain white matter hyperintensities (WMHs) are linked to increased risk of cerebrovascular and neurodegenerative diseases among the elderly. Consequently, detection and characterization of WMHs are of significant clinical importance. We propose a novel approach for WMH segmentation from multi-contrast MRI where both voxel-based and lesion-based information are used to improve overall performance in both volume-oriented and object-oriented metrics. Our segmentation method (AMOS-2D) consists of four stages following a "generate-and-test" approach: pre-processing, Gaussian white matter (WM) modelling, hierarchical multi-threshold WMH segmentation and object-based WMH filtering using support vector machines. Data from 28 subjects was used in this study covering a wide range of lesion loads. Volumetric T1-weighted images and 2D fluid attenuated inversion recovery (FLAIR) images were used as basis for the WM model and lesion masks defined manually in each subject by experts were used for training and evaluating the proposed method. The method obtained an average agreement (in terms of the Dice similarity coefficient, DSC) with experts equivalent to inter-expert agreement both in terms of WMH number (DSC = 0.637 vs. 0.651) and volume (DSC = 0.743 vs. 0.781). It allowed higher accuracy in detecting WMH compared to alternative methods tested and was further found to be insensitive to WMH lesion burden. Good agreement with expert annotations combined with stable performance largely independent of lesion burden suggests that AMOS-2D will be a valuable tool for fully automated WMH segmentation in patients with cerebrovascular and neurodegenerative pathologies.
Collapse
Affiliation(s)
- M Rincón
- Department of Artificial Intelligence, UNED, Madrid, Spain.
| | - E Díaz-López
- Department of Artificial Intelligence, UNED, Madrid, Spain
| | - P Selnes
- Department of Neurology, Akershus University Hospital, Oslo, Norway
| | - K Vegge
- Department of Radiology, Akershus University Hospital, Oslo, Norway
| | - M Altmann
- Department of Neurology, Akershus University Hospital, Oslo, Norway
| | - T Fladby
- Department of Neurology, Akershus University Hospital, Oslo, Norway
| | - A Bjørnerud
- The Intervention Centre, Oslo University Hospital, Oslo, Norway
- Department of Physics, University of Oslo, Oslo, Norway
| |
Collapse
|
17
|
Subudhi A, Jena S, Sabut S. Delineation of the ischemic stroke lesion based on watershed and relative fuzzy connectedness in brain MRI. Med Biol Eng Comput 2017; 56:795-807. [DOI: 10.1007/s11517-017-1726-7] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2017] [Accepted: 09/14/2017] [Indexed: 10/18/2022]
|
18
|
Ghafoorian M, Karssemeijer N, Heskes T, van Uden IWM, Sanchez CI, Litjens G, de Leeuw FE, van Ginneken B, Marchiori E, Platel B. Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities. Sci Rep 2017; 7:5110. [PMID: 28698556 PMCID: PMC5505987 DOI: 10.1038/s41598-017-05300-5] [Citation(s) in RCA: 115] [Impact Index Per Article: 14.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2016] [Accepted: 05/26/2017] [Indexed: 02/06/2023] Open
Abstract
The anatomical location of imaging features is of crucial importance for accurate diagnosis in many medical tasks. Convolutional neural networks (CNN) have had huge successes in computer vision, but they lack the natural ability to incorporate the anatomical location in their decision making process, hindering success in some medical image analysis tasks. In this paper, to integrate the anatomical location information into the network, we propose several deep CNN architectures that consider multi-scale patches or take explicit location features while training. We apply and compare the proposed architectures for segmentation of white matter hyperintensities in brain MR images on a large dataset. As a result, we observe that the CNNs that incorporate location information substantially outperform a conventional segmentation method with handcrafted features as well as CNNs that do not integrate location information. On a test set of 50 scans, the best configuration of our networks obtained a Dice score of 0.792, compared to 0.805 for an independent human observer. Performance levels of the machine and the independent human observer were not statistically significantly different (p-value = 0.06).
Collapse
Affiliation(s)
- Mohsen Ghafoorian
- Institute for Computing and Information Sciences, Radboud University, Nijmegen, The Netherlands.
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands.
| | - Nico Karssemeijer
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Tom Heskes
- Institute for Computing and Information Sciences, Radboud University, Nijmegen, The Netherlands
| | - Inge W M van Uden
- Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Clara I Sanchez
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Geert Litjens
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Frank-Erik de Leeuw
- Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Bram van Ginneken
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Elena Marchiori
- Institute for Computing and Information Sciences, Radboud University, Nijmegen, The Netherlands
| | - Bram Platel
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| |
Collapse
|
19
|
Ghafoorian M, Karssemeijer N, van Uden IWM, de Leeuw FE, Heskes T, Marchiori E, Platel B. Automated detection of white matter hyperintensities of all sizes in cerebral small vessel disease. Med Phys 2017; 43:6246. [PMID: 27908171 DOI: 10.1118/1.4966029] [Citation(s) in RCA: 49] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023] Open
Abstract
PURPOSE White matter hyperintensities (WMH) are seen on FLAIR-MRI in several neurological disorders, including multiple sclerosis, dementia, Parkinsonism, stroke and cerebral small vessel disease (SVD). WMHs are often used as biomarkers for prognosis or disease progression in these diseases, and additionally longitudinal quantification of WMHs is used to evaluate therapeutic strategies. Human readers show considerable disagreement and inconsistency on detection of small lesions. A multitude of automated detection algorithms for WMHs exists, but since most of the current automated approaches are tuned to optimize segmentation performance according to Jaccard or Dice scores, smaller WMHs often go undetected in these approaches. In this paper, the authors propose a method to accurately detect all WMHs, large as well as small. METHODS A two-stage learning approach was used to discriminate WMHs from normal brain tissue. Since small and larger WMHs have quite a different appearance, the authors have trained two probabilistic classifiers: one for the small WMHs (⩽3 mm effective diameter) and one for the larger WMHs (>3 mm in-plane effective diameter). For each size-specific classifier, an Adaboost is trained for five iterations, with random forests as the basic classifier. The feature sets consist of 22 features including intensities, location information, blob detectors, and second order derivatives. The outcomes of the two first-stage classifiers were combined into a single WMH likelihood by a second-stage classifier. Their method was trained and evaluated on a dataset with MRI scans of 362 SVD patients (312 subjects for training and validation annotated by one and 50 for testing annotated by two trained raters). To analyze performance on the separate test set, the authors performed a free-response receiving operating characteristic (FROC) analysis, instead of using segmentation based methods that tend to ignore the contribution of small WMHs. RESULTS Experimental results based on FROC analysis demonstrated a close performance of the proposed computer aided detection (CAD) system to human readers. While an independent reader had 0.78 sensitivity with 28 false positives per volume on average, their proposed CAD system reaches a sensitivity of 0.73 with the same number of false positives. CONCLUSIONS The authors have developed a CAD system with all its ingredients being optimized for a better detection of WMHs of all size, which shows performance close to an independent reader.
Collapse
Affiliation(s)
- Mohsen Ghafoorian
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen 6525, The Netherlands and Institute for Computing and Information Sciences, Radboud University, Nijmegen 6525 GA, The Netherlands
| | - Nico Karssemeijer
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen 6525, The Netherlands
| | - Inge W M van Uden
- Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Radboud University Medical Center, Nijmegen 6525 EN, The Netherlands
| | - Frank-Erik de Leeuw
- Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Radboud University Medical Center, Nijmegen 6525 EN, The Netherlands
| | - Tom Heskes
- Institute for Computing and Information Sciences, Radboud University, Nijmegen 6525 EC, The Netherlands
| | - Elena Marchiori
- Institute for Computing and Information Sciences, Radboud University, Nijmegen 6525 EC, The Netherlands
| | - Bram Platel
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen 6525, The Netherlands
| |
Collapse
|
20
|
Griffanti L, Zamboni G, Khan A, Li L, Bonifacio G, Sundaresan V, Schulz UG, Kuker W, Battaglini M, Rothwell PM, Jenkinson M. BIANCA (Brain Intensity AbNormality Classification Algorithm): A new tool for automated segmentation of white matter hyperintensities. Neuroimage 2016; 141:191-205. [PMID: 27402600 PMCID: PMC5035138 DOI: 10.1016/j.neuroimage.2016.07.018] [Citation(s) in RCA: 281] [Impact Index Per Article: 31.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2016] [Revised: 07/06/2016] [Accepted: 07/07/2016] [Indexed: 12/21/2022] Open
Abstract
Reliable quantification of white matter hyperintensities of presumed vascular origin (WMHs) is increasingly needed, given the presence of these MRI findings in patients with several neurological and vascular disorders, as well as in elderly healthy subjects. We present BIANCA (Brain Intensity AbNormality Classification Algorithm), a fully automated, supervised method for WMH detection, based on the k-nearest neighbour (k-NN) algorithm. Relative to previous k-NN based segmentation methods, BIANCA offers different options for weighting the spatial information, local spatial intensity averaging, and different options for the choice of the number and location of the training points. BIANCA is multimodal and highly flexible so that the user can adapt the tool to their protocol and specific needs. We optimised and validated BIANCA on two datasets with different MRI protocols and patient populations (a "predominantly neurodegenerative" and a "predominantly vascular" cohort). BIANCA was first optimised on a subset of images for each dataset in terms of overlap and volumetric agreement with a manually segmented WMH mask. The correlation between the volumes extracted with BIANCA (using the optimised set of options), the volumes extracted from the manual masks and visual ratings showed that BIANCA is a valid alternative to manual segmentation. The optimised set of options was then applied to the whole cohorts and the resulting WMH volume estimates showed good correlations with visual ratings and with age. Finally, we performed a reproducibility test, to evaluate the robustness of BIANCA, and compared BIANCA performance against existing methods. Our findings suggest that BIANCA, which will be freely available as part of the FSL package, is a reliable method for automated WMH segmentation in large cross-sectional cohort studies.
Collapse
Affiliation(s)
- Ludovica Griffanti
- Centre for the Functional MRI of the Brain (FMRIB), Nuffield Department of Clinical Neurosciences, University of Oxford, UK.
| | - Giovanna Zamboni
- Centre for the Functional MRI of the Brain (FMRIB), Nuffield Department of Clinical Neurosciences, University of Oxford, UK; Centre for Prevention of Stroke and Dementia, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| | - Aamira Khan
- Centre for the Functional MRI of the Brain (FMRIB), Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| | - Linxin Li
- Centre for Prevention of Stroke and Dementia, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| | - Guendalina Bonifacio
- Centre for the Functional MRI of the Brain (FMRIB), Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| | - Vaanathi Sundaresan
- Centre for the Functional MRI of the Brain (FMRIB), Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| | - Ursula G Schulz
- Centre for Prevention of Stroke and Dementia, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| | - Wilhelm Kuker
- Centre for Prevention of Stroke and Dementia, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| | - Marco Battaglini
- Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy
| | - Peter M Rothwell
- Centre for Prevention of Stroke and Dementia, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| | - Mark Jenkinson
- Centre for the Functional MRI of the Brain (FMRIB), Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| |
Collapse
|
21
|
Automatic Detection of White Matter Hyperintensities in Healthy Aging and Pathology Using Magnetic Resonance Imaging: A Review. Neuroinformatics 2016; 13:261-76. [PMID: 25649877 PMCID: PMC4468799 DOI: 10.1007/s12021-015-9260-y] [Citation(s) in RCA: 96] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Abstract
White matter hyperintensities (WMH) are commonly seen in the brain of healthy elderly subjects and patients with several neurological and vascular disorders. A truly reliable and fully automated method for quantitative assessment of WMH on magnetic resonance imaging (MRI) has not yet been identified. In this paper, we review and compare the large number of automated approaches proposed for segmentation of WMH in the elderly and in patients with vascular risk factors. We conclude that, in order to avoid artifacts and exclude the several sources of bias that may influence the analysis, an optimal method should comprise a careful preprocessing of the images, be based on multimodal, complementary data, take into account spatial information about the lesions and correct for false positives. All these features should not exclude computational leanness and adaptability to available data.
Collapse
|
22
|
Sudre CH, Cardoso MJ, Bouvy WH, Biessels GJ, Barnes J, Ourselin S. Bayesian model selection for pathological neuroimaging data applied to white matter lesion segmentation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2015; 34:2079-2102. [PMID: 25850086 DOI: 10.1109/tmi.2015.2419072] [Citation(s) in RCA: 105] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
In neuroimaging studies, pathologies can present themselves as abnormal intensity patterns. Thus, solutions for detecting abnormal intensities are currently under investigation. As each patient is unique, an unbiased and biologically plausible model of pathological data would have to be able to adapt to the subject's individual presentation. Such a model would provide the means for a better understanding of the underlying biological processes and improve one's ability to define pathologically meaningful imaging biomarkers. With this aim in mind, this work proposes a hierarchical fully unsupervised model selection framework for neuroimaging data which enables the distinction between different types of abnormal image patterns without pathological a priori knowledge. Its application on simulated and clinical data demonstrated the ability to detect abnormal intensity clusters, resulting in a competitive to improved behavior in white matter lesion segmentation when compared to three other freely-available automated methods.
Collapse
|
23
|
Automatic white matter lesion segmentation using contrast enhanced FLAIR intensity and Markov Random Field. Comput Med Imaging Graph 2015; 45:102-11. [PMID: 26398564 DOI: 10.1016/j.compmedimag.2015.08.005] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2014] [Revised: 08/08/2015] [Accepted: 08/18/2015] [Indexed: 11/24/2022]
Abstract
White matter lesions (WMLs) are small groups of dead cells that clump together in the white matter of brain. In this paper, we propose a reliable method to automatically segment WMLs. Our method uses a novel filter to enhance the intensity of WMLs. Then a feature set containing enhanced intensity, anatomical and spatial information is used to train a random forest classifier for the initial segmentation of WMLs. Following that a reliable and robust edge potential function based Markov Random Field (MRF) is proposed to obtain the final segmentation by removing false positive WMLs. Quantitative evaluation of the proposed method is performed on 24 subjects of ENVISion study. The segmentation results are validated against the manual segmentation, performed under the supervision of an expert neuroradiologist. The results show a dice similarity index of 0.76 for severe lesion load, 0.73 for moderate lesion load and 0.61 for mild lesion load. In addition to that we have compared our method with three state of the art methods on 20 subjects of Medical Image Computing and Computer Aided Intervention Society's (MICCAI's) MS lesion challenge dataset, where our method shows better segmentation accuracy compare to the state of the art methods. These results indicate that the proposed method can assist the neuroradiologists in assessing the WMLs in clinical practice.
Collapse
|
24
|
Tohka J. Partial volume effect modeling for segmentation and tissue classification of brain magnetic resonance images: A review. World J Radiol 2014; 6:855-864. [PMID: 25431640 PMCID: PMC4241492 DOI: 10.4329/wjr.v6.i11.855] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/23/2014] [Revised: 09/03/2014] [Accepted: 09/24/2014] [Indexed: 02/06/2023] Open
Abstract
Quantitative analysis of magnetic resonance (MR) brain images are facilitated by the development of automated segmentation algorithms. A single image voxel may contain of several types of tissues due to the finite spatial resolution of the imaging device. This phenomenon, termed partial volume effect (PVE), complicates the segmentation process, and, due to the complexity of human brain anatomy, the PVE is an important factor for accurate brain structure quantification. Partial volume estimation refers to a generalized segmentation task where the amount of each tissue type within each voxel is solved. This review aims to provide a systematic, tutorial-like overview and categorization of methods for partial volume estimation in brain MRI. The review concentrates on the statistically based approaches for partial volume estimation and also explains differences to other, similar image segmentation approaches.
Collapse
|
25
|
Gao J, Li C, Feng C, Xie M, Yin Y, Davatzikos C. Non-locally regularized segmentation of multiple sclerosis lesion from multi-channel MRI data. Magn Reson Imaging 2014; 32:1058-66. [PMID: 24948583 DOI: 10.1016/j.mri.2014.03.006] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2013] [Revised: 01/20/2014] [Accepted: 03/07/2014] [Indexed: 11/28/2022]
Abstract
Segmentation of multiple sclerosis (MS) lesion is important for many neuroimaging studies. In this paper, we propose a novel algorithm for automatic segmentation of MS lesions from multi-channel MR images (T1W, T2W and FLAIR images). The proposed method is an extension of Li et al.'s algorithm in [1], which only segments the normal tissues from T1W images. The proposed method is aimed to segment MS lesions, while normal tissues are also segmented and bias field is estimated to handle intensity inhomogeneities in the images. Another contribution of this paper is the introduction of a nonlocal means technique to achieve spatially regularized segmentation, which overcomes the influence of noise. Experimental results have demonstrated the effectiveness and advantages of the proposed algorithm.
Collapse
Affiliation(s)
- Jingjing Gao
- School of Electronic Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan 611731, China; Center of Biomedical Image Computing and Analytics, University of PA, Philadelphia 19104, USA
| | - Chunming Li
- Center of Biomedical Image Computing and Analytics, University of PA, Philadelphia 19104, USA; Department of Radiology, University of Pennsylvania, Philadelphia, PA 19104, USA.
| | - Chaolu Feng
- Key Laboratory of Medical Image Computing of Ministry of Education, Northeastern University, Shenyang, Liaoning 110819, China
| | - Mei Xie
- School of Electronic Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan 611731, China
| | - Yilong Yin
- School of Computer Science and Technology, Shandong University, Jinan, Shandong 250100, China
| | - Christos Davatzikos
- Center of Biomedical Image Computing and Analytics, University of PA, Philadelphia 19104, USA; Department of Radiology, University of Pennsylvania, Philadelphia, PA 19104, USA
| |
Collapse
|
26
|
Madai VI, Galinovic I, Grittner U, Zaro-Weber O, Schneider A, Martin SZ, Samson-Himmelstjerna FCV, Stengl KL, Mutke MA, Moeller-Hartmann W, Ebinger M, Fiebach JB, Sobesky J. DWI intensity values predict FLAIR lesions in acute ischemic stroke. PLoS One 2014; 9:e92295. [PMID: 24658092 PMCID: PMC3962388 DOI: 10.1371/journal.pone.0092295] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2013] [Accepted: 02/21/2014] [Indexed: 12/03/2022] Open
Abstract
Background and Purpose In acute stroke, the DWI-FLAIR mismatch allows for the allocation of patients to the thrombolysis window (<4.5 hours). FLAIR-lesions, however, may be challenging to assess. In comparison, DWI may be a useful bio-marker owing to high lesion contrast. We investigated the performance of a relative DWI signal intensity (rSI) threshold to predict the presence of FLAIR-lesions in acute stroke and analyzed its association with time-from-stroke-onset. Methods In a retrospective, dual-center MR-imaging study we included patients with acute stroke and time-from-stroke-onset ≤12 hours (group A: n = 49, 1.5T; group B: n = 48, 3T). DW- and FLAIR-images were coregistered. The largest lesion extent in DWI defined the slice for further analysis. FLAIR-lesions were identified by 3 raters, delineated as regions-of-interest (ROIs) and copied on the DW-images. Circular ROIs were placed within the DWI-lesion and labeled according to the FLAIR-pattern (FLAIR+ or FLAIR−). ROI-values were normalized to the unaffected hemisphere. Adjusted and nonadjusted receiver-operating-characteristics (ROC) curve analysis on patient level was performed to analyze the ability of a DWI- and ADC-rSI threshold to predict the presence of FLAIR-lesions. Spearman correlation and adjusted linear regression analysis was performed to assess the relationship between DWI-intensity and time-from-stroke-onset. Results DWI-rSI performed well in predicting lesions in FLAIR-imaging (mean area under the curve (AUC): group A: 0.84; group B: 0.85). An optimal mean DWI-rSI threshold was identified (A: 162%; B: 161%). ADC-maps performed worse (mean AUC: A: 0.58; B: 0.77). Adjusted regression models confirmed the superior performance of DWI-rSI. Correlation coefficents and linear regression showed a good association with time-from-stroke-onset for DWI-rSI, but not for ADC-rSI. Conclusion An easily assessable DWI-rSI threshold identifies the presence of lesions in FLAIR-imaging with good accuracy and is associated with time-from-stroke-onset in acute stroke. This finding underlines the potential of a DWI-rSI threshold as a marker of lesion age.
Collapse
Affiliation(s)
- Vince I. Madai
- Center for Stroke Research Berlin (CSB), Charité-Universitätsmedizin, Berlin, Germany
- Department of Neurology, Charité-Universtitätsmedizin, Berlin, Germany
| | - Ivana Galinovic
- Center for Stroke Research Berlin (CSB), Charité-Universitätsmedizin, Berlin, Germany
| | - Ulrike Grittner
- Center for Stroke Research Berlin (CSB), Charité-Universitätsmedizin, Berlin, Germany
- Department for Biostatistics and Clinical Epidemiology, Charité-Universitätsmedizin, Berlin, Germany
| | - Olivier Zaro-Weber
- Center for Stroke Research Berlin (CSB), Charité-Universitätsmedizin, Berlin, Germany
- Max-Planck-Institute for Neurological Research, Cologne, Germany
| | - Alice Schneider
- Center for Stroke Research Berlin (CSB), Charité-Universitätsmedizin, Berlin, Germany
- Department for Biostatistics and Clinical Epidemiology, Charité-Universitätsmedizin, Berlin, Germany
| | - Steve Z. Martin
- Center for Stroke Research Berlin (CSB), Charité-Universitätsmedizin, Berlin, Germany
| | | | - Katharina L. Stengl
- Center for Stroke Research Berlin (CSB), Charité-Universitätsmedizin, Berlin, Germany
- Department of Neurology, Charité-Universtitätsmedizin, Berlin, Germany
| | - Matthias A. Mutke
- Center for Stroke Research Berlin (CSB), Charité-Universitätsmedizin, Berlin, Germany
- Department of Neurology, Charité-Universtitätsmedizin, Berlin, Germany
| | | | - Martin Ebinger
- Center for Stroke Research Berlin (CSB), Charité-Universitätsmedizin, Berlin, Germany
- Department of Neurology, Charité-Universtitätsmedizin, Berlin, Germany
| | - Jochen B. Fiebach
- Center for Stroke Research Berlin (CSB), Charité-Universitätsmedizin, Berlin, Germany
| | - Jan Sobesky
- Center for Stroke Research Berlin (CSB), Charité-Universitätsmedizin, Berlin, Germany
- Department of Neurology, Charité-Universtitätsmedizin, Berlin, Germany
- * E-mail:
| |
Collapse
|
27
|
Galinovic I, Puig J, Neeb L, Guibernau J, Kemmling A, Siemonsen S, Pedraza S, Cheng B, Thomalla G, Fiehler J, Fiebach JB. Visual and region of interest-based inter-rater agreement in the assessment of the diffusion-weighted imaging- fluid-attenuated inversion recovery mismatch. Stroke 2014; 45:1170-2. [PMID: 24558091 DOI: 10.1161/strokeaha.113.002661] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND AND PURPOSE WAKE-UP is a randomized, placebo-controlled MRI-based trial of thrombolysis in wake-up stroke using the mismatch between a lesion's visibility in diffusion-weighted imaging and fluid-attenuated inversion recovery (FLAIR) sequences as its main imaging inclusion criterion. Visual judgment of lesion conspicuity on FLAIR is however methodically limited by moderate inter-rater agreement. We therefore sought to improve rating homogeneity by incorporating quantitative signal intensity measurements. METHODS One hundred forty-three data sets of patients with acute ischemic stroke were visually rated by 8 raters with respect to WAKE-UP study inclusion and exclusion criteria, and inter-rater agreement was calculated. A subanalysis was performed on 45 cases to determine a threshold value of relative signal intensity (rSI) between the ischemic lesion and contralateral healthy tissue which best corresponded to a visually established verdict of FLAIR positivity. The usefulness of this threshold in improving inter-rater agreement was evaluated in an additional sample of 50 patients. RESULTS Inter-rater agreement for inclusion into the WAKE-UP trial was 73% with a free-marginal κ of 0.46. A threshold of rSI which best correlated with the visual rating of lesions as FLAIR positive was 1.20. The addition of rSI measurements to visual evaluation did not change the inter-rater agreement. CONCLUSIONS Introducing a semiquantitative measure for FLAIR rSI did not improve the agreement between individual raters. However, enhancing visual assessment with rSI measurements can provide reassurance to local investigators in cases of uncertainty.
Collapse
Affiliation(s)
- Ivana Galinovic
- From the Center for Stroke Research Berlin (CSB), Charité-Universitätsmedizin Berlin, Berlin, Germany (I.G., L.N., J.B.F.); Department of Radiology (IDI), Girona Biomedical Research Institute (IDIBGI), Hospital Universitari de Girona Dr Josep Trueta, Girona, Spain (J.P., J.G., S.P.); and Departments of Neurology (A.K., S.S., B.C., G.T.) and Diagnostic and Interventional Neuroradiology (J.F.), University-Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
28
|
Automatic segmentation of cerebral white matter hyperintensities using only 3D FLAIR images. Magn Reson Imaging 2013; 31:1182-9. [PMID: 23684961 DOI: 10.1016/j.mri.2012.12.004] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2012] [Revised: 11/30/2012] [Accepted: 12/24/2012] [Indexed: 11/23/2022]
Abstract
Magnetic Resonance (MR) white matter hyperintensities have been shown to predict an increased risk of developing cognitive decline. However, their actual role in the conversion to dementia is still not fully understood. Automatic segmentation methods can help in the screening and monitoring of Mild Cognitive Impairment patients who take part in large population-based studies. Most existing segmentation approaches use multimodal MR images. However, multiple acquisitions represent a limitation in terms of both patient comfort and computational complexity of the algorithms. In this work, we propose an automatic lesion segmentation method that uses only three-dimensional fluid-attenuation inversion recovery (FLAIR) images. We use a modified context-sensitive Gaussian mixture model to determine voxel class probabilities, followed by correction of FLAIR artifacts. We evaluate the method against the manual segmentation performed by an experienced neuroradiologist and compare the results with other unimodal segmentation approaches. Finally, we apply our method to the segmentation of multiple sclerosis lesions by using a publicly available benchmark dataset. Results show a similar performance to other state-of-the-art multimodal methods, as well as to the human rater.
Collapse
|