1
|
Demuth S, Paris J, Faddeenkov I, De Sèze J, Gourraud PA. Clinical applications of deep learning in neuroinflammatory diseases: A scoping review. Rev Neurol (Paris) 2024:S0035-3787(24)00522-8. [PMID: 38772806 DOI: 10.1016/j.neurol.2024.04.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2024] [Revised: 03/26/2024] [Accepted: 04/09/2024] [Indexed: 05/23/2024]
Abstract
BACKGROUND Deep learning (DL) is an artificial intelligence technology that has aroused much excitement for predictive medicine due to its ability to process raw data modalities such as images, text, and time series of signals. OBJECTIVES Here, we intend to give the clinical reader elements to understand this technology, taking neuroinflammatory diseases as an illustrative use case of clinical translation efforts. We reviewed the scope of this rapidly evolving field to get quantitative insights about which clinical applications concentrate the efforts and which data modalities are most commonly used. METHODS We queried the PubMed database for articles reporting DL algorithms for clinical applications in neuroinflammatory diseases and the radiology.healthairegister.com website for commercial algorithms. RESULTS The review included 148 articles published between 2018 and 2024 and five commercial algorithms. The clinical applications could be grouped as computer-aided diagnosis, individual prognosis, functional assessment, the segmentation of radiological structures, and the optimization of data acquisition. Our review highlighted important discrepancies in efforts. The segmentation of radiological structures and computer-aided diagnosis currently concentrate most efforts with an overrepresentation of imaging. Various model architectures have addressed different applications, relatively low volume of data, and diverse data modalities. We report the high-level technical characteristics of the algorithms and synthesize narratively the clinical applications. Predictive performances and some common a priori on this topic are finally discussed. CONCLUSION The currently reported efforts position DL as an information processing technology, enhancing existing modalities of paraclinical investigations and bringing perspectives to make innovative ones actionable for healthcare.
Collapse
Affiliation(s)
- S Demuth
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France; Inserm U1119 : biopathologie de la myéline, neuroprotection et stratégies thérapeutiques, University of Strasbourg, 1, rue Eugène-Boeckel - CS 60026, 67084 Strasbourg, France.
| | - J Paris
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France
| | - I Faddeenkov
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France
| | - J De Sèze
- Inserm U1119 : biopathologie de la myéline, neuroprotection et stratégies thérapeutiques, University of Strasbourg, 1, rue Eugène-Boeckel - CS 60026, 67084 Strasbourg, France; Department of Neurology, University Hospital of Strasbourg, 1, avenue Molière, 67200 Strasbourg, France; Inserm CIC 1434 Clinical Investigation Center, University Hospital of Strasbourg, 1, avenue Molière, 67200 Strasbourg, France
| | - P-A Gourraud
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France; "Data clinic", Department of Public Health, University Hospital of Nantes, Nantes, France
| |
Collapse
|
2
|
Mao A, Flassbeck S, Assländer J. Bias-reduced neural networks for parameter estimation in quantitative MRI. Magn Reson Med 2024. [PMID: 38703042 DOI: 10.1002/mrm.30135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 04/09/2024] [Accepted: 04/11/2024] [Indexed: 05/06/2024]
Abstract
PURPOSE To develop neural network (NN)-based quantitative MRI parameter estimators with minimal bias and a variance close to the Cramér-Rao bound. THEORY AND METHODS We generalize the mean squared error loss to control the bias and variance of the NN's estimates, which involves averaging over multiple noise realizations of the same measurements during training. Bias and variance properties of the resulting NNs are studied for two neuroimaging applications. RESULTS In simulations, the proposed strategy reduces the estimates' bias throughout parameter space and achieves a variance close to the Cramér-Rao bound. In vivo, we observe good concordance between parameter maps estimated with the proposed NNs and traditional estimators, such as nonlinear least-squares fitting, while state-of-the-art NNs show larger deviations. CONCLUSION The proposed NNs have greatly reduced bias compared to those trained using the mean squared error and offer significantly improved computational efficiency over traditional estimators with comparable or better accuracy.
Collapse
Affiliation(s)
- Andrew Mao
- Bernard and Irene Schwartz Center for Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, New York, USA
- Center for Advanced Imaging Innovation and Research (CAI2R), Department of Radiology, New York University Grossman School of Medicine, New York, New York, USA
- Vilcek Institute of Graduate Biomedical Sciences, New York University Grossman School of Medicine, New York, New York, USA
| | - Sebastian Flassbeck
- Bernard and Irene Schwartz Center for Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, New York, USA
- Center for Advanced Imaging Innovation and Research (CAI2R), Department of Radiology, New York University Grossman School of Medicine, New York, New York, USA
| | - Jakob Assländer
- Bernard and Irene Schwartz Center for Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, New York, USA
- Center for Advanced Imaging Innovation and Research (CAI2R), Department of Radiology, New York University Grossman School of Medicine, New York, New York, USA
| |
Collapse
|
3
|
Lu Q, Li J, Lian Z, Zhang X, Feng Q, Chen W, Ma J, Feng Y. A model-based MR parameter mapping network robust to substantial variations in acquisition settings. Med Image Anal 2024; 94:103148. [PMID: 38554550 DOI: 10.1016/j.media.2024.103148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Revised: 12/03/2023] [Accepted: 03/20/2024] [Indexed: 04/01/2024]
Abstract
Deep learning methods show great potential for the efficient and precise estimation of quantitative parameter maps from multiple magnetic resonance (MR) images. Current deep learning-based MR parameter mapping (MPM) methods are mostly trained and tested using data with specific acquisition settings. However, scan protocols usually vary with centers, scanners, and studies in practice. Thus, deep learning methods applicable to MPM with varying acquisition settings are highly required but still rarely investigated. In this work, we develop a model-based deep network termed MMPM-Net for robust MPM with varying acquisition settings. A deep learning-based denoiser is introduced to construct the regularization term in the nonlinear inversion problem of MPM. The alternating direction method of multipliers is used to solve the optimization problem and then unrolled to construct MMPM-Net. The variation in acquisition parameters can be addressed by the data fidelity component in MMPM-Net. Extensive experiments are performed on R2 mapping and R1 mapping datasets with substantial variations in acquisition settings, and the results demonstrate that the proposed MMPM-Net method outperforms other state-of-the-art MR parameter mapping methods both qualitatively and quantitatively.
Collapse
Affiliation(s)
- Qiqi Lu
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510000, China; Guangdong Provincial Key Laboratory of Medical Image Processing & Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou 510000, China; Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence & Key Laboratory of Mental Health of the Ministry of Education & Guangdong-Hong Kong Joint Laboratory for Psychiatric Disorders, Southern Medical University, Guangzhou 510000, China; Department of Radiology, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), Foshan 528000, China
| | - Jialong Li
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510000, China; Guangdong Provincial Key Laboratory of Medical Image Processing & Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou 510000, China; Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence & Key Laboratory of Mental Health of the Ministry of Education & Guangdong-Hong Kong Joint Laboratory for Psychiatric Disorders, Southern Medical University, Guangzhou 510000, China; Department of Radiology, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), Foshan 528000, China
| | - Zifeng Lian
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510000, China; Guangdong Provincial Key Laboratory of Medical Image Processing & Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou 510000, China; Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence & Key Laboratory of Mental Health of the Ministry of Education & Guangdong-Hong Kong Joint Laboratory for Psychiatric Disorders, Southern Medical University, Guangzhou 510000, China; Department of Radiology, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), Foshan 528000, China
| | - Xinyuan Zhang
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510000, China; Guangdong Provincial Key Laboratory of Medical Image Processing & Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou 510000, China
| | - Qianjin Feng
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510000, China; Guangdong Provincial Key Laboratory of Medical Image Processing & Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou 510000, China
| | - Wufan Chen
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510000, China; Guangdong Provincial Key Laboratory of Medical Image Processing & Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou 510000, China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510000, China; Guangdong Provincial Key Laboratory of Medical Image Processing & Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou 510000, China
| | - Yanqiu Feng
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510000, China; Guangdong Provincial Key Laboratory of Medical Image Processing & Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou 510000, China; Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence & Key Laboratory of Mental Health of the Ministry of Education & Guangdong-Hong Kong Joint Laboratory for Psychiatric Disorders, Southern Medical University, Guangzhou 510000, China; Department of Radiology, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde, Foshan), Foshan 528000, China.
| |
Collapse
|
4
|
Vasylechko SD, Warfield SK, Kurugol S, Afacan O. Improved myelin water fraction mapping with deep neural networks using synthetically generated 3D data. Med Image Anal 2024; 91:102966. [PMID: 37844473 PMCID: PMC10847969 DOI: 10.1016/j.media.2023.102966] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 07/14/2023] [Accepted: 09/11/2023] [Indexed: 10/18/2023]
Abstract
We introduce a generative model for synthesis of large scale 3D datasets for quantitative parameter mapping of myelin water fraction (MWF). Our model combines a MR physics signal decay model with an accurate probabilistic multi-component parametric T2 model. We synthetically generate a wide variety of high quality signals and corresponding parameters from a wide range of naturally occurring prior parameter values. To capture spatial variation, the generative signal decay model is combined with a generative spatial model conditioned on generic tissue segmentations. Synthesized 3D datasets can be used to train any convolutional neural network (CNN) based architecture for MWF estimation. Our source code is available at: https://github.com/quin-med-harvard-edu/synthmap Reduction of acquisition time at the expense of lower SNR, as well as accuracy and repeatability of MWF estimation techniques, are key factors that affect the adoption of MWF mapping in clinical practice. We demonstrate that the synthetically trained CNN provides superior accuracy over the competing methods under the constraints of naturally occurring noise levels as well as on the synthetically generated images at low SNR levels. Normalized root mean squared error (nRMSE) is less than 7% on synthetic data, which is significantly lower than competing methods. Additionally, the proposed method yields a coefficient of variation (CoV) that is at least 4x better than the competing method on intra-session test-retest reference dataset.
Collapse
Affiliation(s)
- Serge Didenko Vasylechko
- Computational Radiology Laboratory, Boston Children's Hospital, Boston 02115, MA, USA; Harvard Medical School, Boston 02115, MA, USA.
| | - Simon K Warfield
- Computational Radiology Laboratory, Boston Children's Hospital, Boston 02115, MA, USA; Harvard Medical School, Boston 02115, MA, USA
| | - Sila Kurugol
- Computational Radiology Laboratory, Boston Children's Hospital, Boston 02115, MA, USA; Harvard Medical School, Boston 02115, MA, USA
| | - Onur Afacan
- Computational Radiology Laboratory, Boston Children's Hospital, Boston 02115, MA, USA; Harvard Medical School, Boston 02115, MA, USA
| |
Collapse
|
5
|
Gong Z, Khattar N, Kiely M, Triebswetter C, Bouhrara M. REUSED: A deep neural network method for rapid whole-brain high-resolution myelin water fraction mapping from extremely under-sampled MRI. Comput Med Imaging Graph 2023; 108:102282. [PMID: 37586261 PMCID: PMC10528830 DOI: 10.1016/j.compmedimag.2023.102282] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2023] [Revised: 07/23/2023] [Accepted: 07/24/2023] [Indexed: 08/18/2023]
Abstract
Changes in myelination are a cardinal feature of brain development and the pathophysiology of several central nervous system diseases, including multiple sclerosis and dementias. Advanced magnetic resonance imaging (MRI) methods have been developed to probe myelin content through the measurement of myelin water fraction (MWF). However, the prolonged data acquisition and post-processing times of current MWF mapping methods pose substantial hurdles to their clinical implementation. Recently, fast steady-state MRI sequences have been implemented to produce high-spatial resolution whole-brain MWF mapping within ∼20 min. Despite the subsequent significant advances in the inversion algorithm to derive MWF maps from steady-state MRI, the high-dimensional nature of such inversion does not permit further reduction of the acquisition time by data under-sampling. In this work, we present an unprecedented reduction in the computation (∼30 s) and the acquisition time (∼7 min) required for whole-brain high-resolution MWF mapping through a new Neural Network (NN)-based approach, named NN-Relaxometry of Extremely Under-SamplEd Data (NN-REUSED). Our analyses demonstrate virtually similar accuracy and precision in derived MWF values using NN-REUSED compared to results derived from the fully sampled reference method. The reduction in the acquisition and computation times represents a breakthrough toward clinically practical MWF mapping.
Collapse
Affiliation(s)
- Zhaoyuan Gong
- Magnetic Resonance Physics of Aging and Dementia Unit, National Institute on Aging, National Institutes of Health, Baltimore, MD 21224, USA.
| | | | - Matthew Kiely
- Magnetic Resonance Physics of Aging and Dementia Unit, National Institute on Aging, National Institutes of Health, Baltimore, MD 21224, USA
| | - Curtis Triebswetter
- Magnetic Resonance Physics of Aging and Dementia Unit, National Institute on Aging, National Institutes of Health, Baltimore, MD 21224, USA
| | - Mustapha Bouhrara
- Magnetic Resonance Physics of Aging and Dementia Unit, National Institute on Aging, National Institutes of Health, Baltimore, MD 21224, USA.
| |
Collapse
|
6
|
Ben-Atya H, Freiman M. P 2T 2: A physically-primed deep-neural-network approach for robust T 2 distribution estimation from quantitative T 2-weighted MRI. Comput Med Imaging Graph 2023; 107:102240. [PMID: 37224742 DOI: 10.1016/j.compmedimag.2023.102240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Revised: 04/27/2023] [Accepted: 04/27/2023] [Indexed: 05/26/2023]
Abstract
Estimating T2 relaxation time distributions from multi-echo T2-weighted MRI (T2W) data can provide valuable biomarkers for assessing inflammation, demyelination, edema, and cartilage composition in various pathologies, including neurodegenerative disorders, osteoarthritis, and tumors. Deep neural network (DNN) based methods have been proposed to address the complex inverse problem of estimating T2 distributions from MRI data, but they are not yet robust enough for clinical data with low Signal-to-Noise ratio (SNR) and are highly sensitive to distribution shifts such as variations in echo-times (TE) used during acquisition. Consequently, their application is hindered in clinical practice and large-scale multi-institutional trials with heterogeneous acquisition protocols. We propose a physically-primed DNN approach, called P2T2, that incorporates the signal decay forward model in addition to the MRI signal into the DNN architecture to improve the accuracy and robustness of T2 distribution estimation. We evaluated our P2T2 model in comparison to both DNN-based methods and classical methods for T2 distribution estimation using 1D and 2D numerical simulations along with clinical data. Our model improved the baseline model's accuracy for low SNR levels (SNR<80) which are common in the clinical setting. Further, our model achieved a ∼35% improvement in robustness against distribution shifts in the acquisition process compared to previously proposed DNN models. Finally, Our P2T2 model produces the most detailed Myelin-Water fraction maps compared to baseline approaches when applied to real human MRI data. Our P2T2 model offers a reliable and precise means of estimating T2 distributions from MRI data and shows promise for use in large-scale multi-institutional trials with heterogeneous acquisition protocols. Our source code is available at: https://github.com/Hben-atya/P2T2-Robust-T2-estimation.git.
Collapse
Affiliation(s)
- Hadas Ben-Atya
- Faculty of Biomedical Engineering, Technion - Israel Institute of Technology, Haifa, Israel.
| | - Moti Freiman
- Faculty of Biomedical Engineering, Technion - Israel Institute of Technology, Haifa, Israel
| |
Collapse
|
7
|
Snyder J, Seres P, Stobbe RW, Grenier JG, Smyth P, Blevins G, Wilman AH. Inline dual-echo T2 quantification in brain using a fast mapping reconstruction technique. NMR IN BIOMEDICINE 2023; 36:e4811. [PMID: 35934839 DOI: 10.1002/nbm.4811] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Revised: 07/06/2022] [Accepted: 07/17/2022] [Indexed: 06/15/2023]
Abstract
T2 mapping from 2D proton density and T2-weighted images (PD-T2) using Bloch equation simulations can be time consuming and introduces a latency between image acquisition and T2 map production. A fast T2 mapping reconstruction method is investigated and compared with a previous modeling approach to reduce computation time and allow inline T2 maps on the MRI console. Brain PD-T2 images from five multiple sclerosis patients were used to compare T2 map reconstruction times between the new subtraction method and the Euclidean norm minimization technique. Bloch equation simulations were used to create the lookup table for decay curve matching in both cases. Agreement of the two techniques used Bland-Altman analysis for investigating individual subsets of data and all image points in the five volumes (meta-analysis). The subtraction method resulted in an average reduction of computation time for single slices from 134 s (minimization method) to 0.44 s. Comparing T2 values between the subtraction and minimization methods resulted in a confidence interval ranging from -0.06 to 0.06 ms (95% of values were within ± 0.06 ms between the techniques). Using identical reconstruction code based on the subtraction method, inline T2 maps were produced from PD-T2 images directly on the scanner console. The excellent agreement between the two methods permits the subtraction technique to be interchanged with the previous method, reducing computation time and allowing inline T2 map reconstruction based on Bloch simulations directly on the scanner.
Collapse
Affiliation(s)
- Jeff Snyder
- Department of Biomedical Engineering, University of Alberta, Edmonton, Canada
| | - Peter Seres
- Department of Biomedical Engineering, University of Alberta, Edmonton, Canada
| | - Robert W Stobbe
- Department of Biomedical Engineering, University of Alberta, Edmonton, Canada
| | - Justin G Grenier
- Department of Biomedical Engineering, University of Alberta, Edmonton, Canada
| | - Penelope Smyth
- Department of Medicine, Division of Neurology, University of Alberta, Edmonton, Canada
| | - Gregg Blevins
- Department of Medicine, Division of Neurology, University of Alberta, Edmonton, Canada
| | - Alan H Wilman
- Department of Biomedical Engineering, University of Alberta, Edmonton, Canada
| |
Collapse
|
8
|
Liu H, Grouza V, Tuznik M, Siminovitch KA, Bagheri H, Peterson A, Rudko DA. Self-labelled encoder-decoder (SLED) for multi-echo gradient echo-based myelin water imaging. Neuroimage 2022; 264:119717. [PMID: 36367497 DOI: 10.1016/j.neuroimage.2022.119717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2022] [Revised: 10/07/2022] [Accepted: 10/27/2022] [Indexed: 11/09/2022] Open
Abstract
PURPOSE Reconstruction of high quality myelin water imaging (MWI) maps is challenging, particularly for data acquired using multi-echo gradient echo (mGRE) sequences. A non-linear least squares fitting (NLLS) approach has often been applied for MWI. However, this approach may produce maps with limited detail and, in some cases, sub-optimal signal to noise ratio (SNR), due to the nature of the voxel-wise fitting. In this study, we developed a novel, unsupervised learning method called self-labelled encoder-decoder (SLED) to improve gradient echo-based MWI data fitting. METHODS Ultra-high resolution, MWI data was collected from five mouse brains with variable levels of myelination, using a mGRE sequence. Imaging data was acquired using a 7T preclinical MRI system. A self-labelled, encoder-decoder network was implemented in TensorFlow for calculation of myelin water fraction (MWF) based on the mGRE signal decay. A simulated MWI phantom was also created to evaluate the performance of MWF estimation. RESULTS Compared to NLLS, SLED demonstrated improved MWF estimation, in terms of both stability and accuracy in phantom tests. In addition, SLED produced less noisy MWF maps from high resolution MR microscopy images of mouse brain tissue. It specifically resulted in lower noise amplification for all mouse genotypes that were imaged and yielded mean MWF values in white matter ROIs that were highly correlated with those derived from standard NLLS fitting. Lastly, SLED also exhibited higher tolerance to low SNR data. CONCLUSION Due to its unsupervised and self-labeling nature, SLED offers a unique alternative to analyze gradient echo-based MWI data, providing accurate and stable MWF estimations.
Collapse
Affiliation(s)
- Hanwen Liu
- McConnell Brain Imaging Centre, Montreal Neurological Institute and Hospital, Montreal, QC, Canada; Department of Neurology and Neurosurgery, McGill University, Montreal, QC, Canada
| | - Vladimir Grouza
- McConnell Brain Imaging Centre, Montreal Neurological Institute and Hospital, Montreal, QC, Canada; Department of Neurology and Neurosurgery, McGill University, Montreal, QC, Canada
| | - Marius Tuznik
- McConnell Brain Imaging Centre, Montreal Neurological Institute and Hospital, Montreal, QC, Canada; Department of Neurology and Neurosurgery, McGill University, Montreal, QC, Canada
| | - Katherine A Siminovitch
- Departments of Medicine and Immunology, University of Toronto, Toronto, ON, Canada; Lunenfeld Tanenbaum Research Institute, Mount Sinai Hospital, Toronto, ON, Canada
| | - Hooman Bagheri
- Department of Human Genetics, McGill University, Montreal, QC, Canada
| | - Alan Peterson
- Department of Neurology and Neurosurgery, McGill University, Montreal, QC, Canada; Department of Human Genetics, McGill University, Montreal, QC, Canada; Gerald Bronfman Department of Oncology, McGill University, Montreal, QC, Canada
| | - David A Rudko
- McConnell Brain Imaging Centre, Montreal Neurological Institute and Hospital, Montreal, QC, Canada; Department of Neurology and Neurosurgery, McGill University, Montreal, QC, Canada; Department of Biomedical Engineering, McGill University, Montreal, QC, Canada.
| |
Collapse
|
9
|
Rozowski M, Palumbo J, Bisen J, Bi C, Bouhrara M, Czaja W, Spencer RG. Input layer regularization for magnetic resonance relaxometry biexponential parameter estimation. MAGNETIC RESONANCE IN CHEMISTRY : MRC 2022; 60:1076-1086. [PMID: 35593385 PMCID: PMC10185331 DOI: 10.1002/mrc.5289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Revised: 04/22/2022] [Accepted: 05/17/2022] [Indexed: 05/17/2023]
Abstract
Many methods have been developed for estimating the parameters of biexponential decay signals, which arise throughout magnetic resonance relaxometry (MRR) and the physical sciences. This is an intrinsically ill-posed problem so that estimates can depend strongly on noise and underlying parameter values. Regularization has proven to be a remarkably efficient procedure for providing more reliable solutions to ill-posed problems, while, more recently, neural networks have been used for parameter estimation. We re-address the problem of parameter estimation in biexponential models by introducing a novel form of neural network regularization which we call input layer regularization (ILR). Here, inputs to the neural network are composed of a biexponential decay signal augmented by signals constructed from parameters obtained from a regularized nonlinear least-squares estimate of the two decay time constants. We find that ILR results in a reduction in the error of time constant estimates on the order of 15%-50% or more, depending on the metric used and signal-to-noise level, with greater improvement seen for the time constant of the more rapidly decaying component. ILR is compatible with existing regularization techniques and should be applicable to a wide range of parameter estimation problems.
Collapse
Affiliation(s)
- Michael Rozowski
- Applied Mathematics and Statistics, and Scientific Computation, University of Maryland, College Park, Maryland, USA
- Department of Mathematics, University of Maryland, College Park, Maryland, USA
| | - Jonathan Palumbo
- National Institute on Aging, National Institutes of Health, Baltimore, Maryland, USA
| | - Jay Bisen
- National Institute on Aging, National Institutes of Health, Baltimore, Maryland, USA
| | - Chuan Bi
- National Institute on Aging, National Institutes of Health, Baltimore, Maryland, USA
| | - Mustapha Bouhrara
- National Institute on Aging, National Institutes of Health, Baltimore, Maryland, USA
| | - Wojciech Czaja
- Department of Mathematics, University of Maryland, College Park, Maryland, USA
| | - Richard G. Spencer
- National Institute on Aging, National Institutes of Health, Baltimore, Maryland, USA
| |
Collapse
|
10
|
Combes AJ, Clarke MA, O'Grady KP, Schilling KG, Smith SA. Advanced spinal cord MRI in multiple sclerosis: Current techniques and future directions. Neuroimage Clin 2022; 36:103244. [PMID: 36306717 PMCID: PMC9668663 DOI: 10.1016/j.nicl.2022.103244] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 09/02/2022] [Accepted: 10/19/2022] [Indexed: 11/11/2022]
Abstract
Spinal cord magnetic resonance imaging (MRI) has a central role in multiple sclerosis (MS) clinical practice for diagnosis and disease monitoring. Advanced MRI sequences capable of visualizing and quantifying tissue macro- and microstructure and reflecting different pathological disease processes have been used in MS research; however, the spinal cord remains under-explored, partly due to technical obstacles inherent to imaging this structure. We propose that the study of the spinal cord merits equal ambition in overcoming technical challenges, and that there is much information to be exploited to make valuable contributions to our understanding of MS. We present a narrative review on the latest progress in advanced spinal cord MRI in MS, covering in the first part structural, functional, metabolic and vascular imaging methods. We focus on recent studies of MS and those making significant technical steps, noting the challenges that remain to be addressed and what stands to be gained from such advances. Throughout we also refer to other works that presend more in-depth review on specific themes. In the second part, we present several topics that, in our view, hold particular potential. The need for better imaging of gray matter is discussed. We stress the importance of developing imaging beyond the cervical spinal cord, and explore the use of ultra-high field MRI. Finally, some recommendations are given for future research, from study design to newer developments in analysis, and the need for harmonization of sequences and methods within the field. This review is aimed at researchers and clinicians with an interest in gaining an overview of the current state of advanced MRI research in this field and what is primed to be the future of spinal cord imaging in MS research.
Collapse
Affiliation(s)
- Anna J.E. Combes
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, 1161 21st Avenue South, Medical Center North, AA-1105, Nashville, TN 37232-2310, United States,Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Medical Center North, 1161 21st Ave. South, Nashville, TN 37232, United States,Corresponding author at: 1161 21st Ave S, MCN AA1105, Nashville, TN 37232, USA.
| | - Margareta A. Clarke
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, 1161 21st Avenue South, Medical Center North, AA-1105, Nashville, TN 37232-2310, United States
| | - Kristin P. O'Grady
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, 1161 21st Avenue South, Medical Center North, AA-1105, Nashville, TN 37232-2310, United States,Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Medical Center North, 1161 21st Ave. South, Nashville, TN 37232, United States,Department of Biomedical Engineering, Vanderbilt University, 2301 Vanderbilt Place, PMB 351826, Nashville, TN 37235-1826, United States
| | - Kurt G. Schilling
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, 1161 21st Avenue South, Medical Center North, AA-1105, Nashville, TN 37232-2310, United States,Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Medical Center North, 1161 21st Ave. South, Nashville, TN 37232, United States
| | - Seth A. Smith
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, 1161 21st Avenue South, Medical Center North, AA-1105, Nashville, TN 37232-2310, United States,Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Medical Center North, 1161 21st Ave. South, Nashville, TN 37232, United States,Department of Biomedical Engineering, Vanderbilt University, 2301 Vanderbilt Place, PMB 351826, Nashville, TN 37235-1826, United States
| |
Collapse
|
11
|
Role of artificial intelligence in MS clinical practice. Neuroimage Clin 2022; 35:103065. [PMID: 35661470 PMCID: PMC9163993 DOI: 10.1016/j.nicl.2022.103065] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2021] [Revised: 05/04/2022] [Accepted: 05/26/2022] [Indexed: 11/24/2022]
Abstract
For medical applications, machine learning (including deep learning) are the most commonly used artificial intelligence (AI) approaches. It can improve multiple sclerosis (MS) diagnosis, prognostication and treatment monitoring. Thanks to AI, MRI and cognitive phenotypes of MS patients were identified. AI can shorten MRI protocols for MS, allowing the application of advanced techniques. It can reduce the human effort for MRI analysis, especially for lesion segmentation.
Machine learning (ML) and its subset, deep learning (DL), are branches of artificial intelligence (AI) showing promising findings in the medical field, especially when applied to imaging data. Given the substantial role of MRI in the diagnosis and management of patients with multiple sclerosis (MS), this disease is an ideal candidate for the application of AI techniques. In this narrative review, we are going to discuss the potential applications of AI for MS clinical practice, together with their limitations. Among their several advantages, ML algorithms are able to automate repetitive tasks, to analyze more data in less time and to achieve higher accuracy and reproducibility than the human counterpart. To date, these algorithms have been applied to MS diagnosis, prognosis, disease and treatment monitoring. Other fields of application have been improvement of MRI protocols as well as automated lesion and tissue segmentation. However, several challenges remain, including a better understanding of the information selected by AI algorithms, appropriate multicenter and longitudinal validations of results and practical aspects regarding hardware and software integration. Finally, one cannot overemphasize the paramount importance of human supervision, in order to optimize the use and take full advantage of the potential of AI approaches.
Collapse
|
12
|
Stabilization of parameter estimates from multiexponential decay through extension into higher dimensions. Sci Rep 2022; 12:5773. [PMID: 35388008 PMCID: PMC8986819 DOI: 10.1038/s41598-022-08638-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2021] [Accepted: 03/07/2022] [Indexed: 11/23/2022] Open
Abstract
Analysis of multiexponential decay has remained a topic of active research for over 200 years. This attests to the widespread importance of this problem and to the profound difficulties in characterizing the underlying monoexponential decays. Here, we demonstrate the fundamental improvement in stability and conditioning of this classic problem through extension to a second dimension; we present statistical analysis, Monte-Carlo simulations, and experimental magnetic resonance relaxometry data to support this remarkable fact. Our results are readily generalizable to higher dimensions and provide a potential means of circumventing conventional limits on multiexponential parameter estimation.
Collapse
|
13
|
Jung S, Yun J, Kim DY, Kim D. Improved multi‐echo gradient echo myelin water fraction mapping using complex‐valued neural network analysis. Magn Reson Med 2022; 88:492-500. [DOI: 10.1002/mrm.29192] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2021] [Revised: 01/19/2022] [Accepted: 01/19/2022] [Indexed: 01/20/2023]
Affiliation(s)
- Soozy Jung
- Department of Electrical and Electronic Engineering Yonsei University Seoul Republic of Korea
| | - JiSu Yun
- Department of Electrical and Electronic Engineering Yonsei University Seoul Republic of Korea
| | - Deog Young Kim
- Department and Research Institute of Rehabilitation Medicine Yonsei University College of Medicine Seoul Republic of Korea
| | - Dong‐Hyun Kim
- Department of Electrical and Electronic Engineering Yonsei University Seoul Republic of Korea
| |
Collapse
|
14
|
Kim J, Nguyen TD, Zhang J, Gauthier SA, Marcille M, Zhang H, Cho J, Spincemaille P, Wang Y. Subsecond accurate myelin water fraction reconstruction from FAST-T 2 data with 3D UNET. Magn Reson Med 2022; 87:2979-2988. [PMID: 35092094 DOI: 10.1002/mrm.29176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2021] [Revised: 12/31/2021] [Accepted: 01/08/2022] [Indexed: 11/10/2022]
Abstract
PURPOSE To develop a 3D UNET convolutional neural network for rapid extraction of myelin water fraction (MWF) maps from six-echo fast acquisition with spiral trajectory and T2 -prep data and to evaluate its accuracy in comparison with multilayer perceptron (MLP) network. METHODS The MWF maps were extracted from 138 patients with multiple sclerosis using an iterative three-pool nonlinear least-squares algorithm (NLLS) without and with spatial regularization (srNLLS), which were used as ground-truth labels to train, validate, and test UNET and MLP networks as a means to accelerate data fitting. Network testing was performed in 63 patients with multiple sclerosis and a numerically simulated brain phantom at SNR of 200, 100 and 50. RESULTS Simulations showed that UNET reduced the MWF mean absolute error by 30.1% to 56.4% and 16.8% to 53.6% over the whole brain and by 41.2% to 54.4% and 21.4% to 49.4% over the lesions for predicting srNLLS and NLLS MWF, respectively, compared to MLP, with better performance at lower SNRs. UNET also outperformed MLP for predicting srNLLS MWF in the in vivo multiple-sclerosis brain data, reducing mean absolute error over the whole brain by 61.9% and over the lesions by 67.5%. However, MLP yielded 41.1% and 51.7% lower mean absolute error for predicting in vivo NLLS MWF over the whole brain and the lesions, respectively, compared with UNET. The whole-brain MWF processing time using a GPU was 0.64 seconds for UNET and 0.74 seconds for MLP. CONCLUSION Subsecond whole-brain MWF extraction from fast acquisition with spiral trajectory and T2 -prep data using UNET is feasible and provides better accuracy than MLP for predicting MWF output of srNLLS algorithm.
Collapse
Affiliation(s)
- Jeremy Kim
- Department of Computer Science, Stanford University, Stanford, California, USA
| | - Thanh D Nguyen
- Department of Radiology, Weill Cornell Medicine, New York, New York, USA
| | - Jinwei Zhang
- Department of Radiology, Weill Cornell Medicine, New York, New York, USA.,Meinig School of Biomedical Engineering, Cornell University, Ithaca, New York, USA
| | - Susan A Gauthier
- Department of Neurology, Weill Cornell Medicine, New York, New York, USA
| | - Melanie Marcille
- Department of Neurology, Weill Cornell Medicine, New York, New York, USA
| | - Hang Zhang
- Meinig School of Biomedical Engineering, Cornell University, Ithaca, New York, USA
| | - Junghun Cho
- Department of Radiology, Weill Cornell Medicine, New York, New York, USA
| | | | - Yi Wang
- Department of Radiology, Weill Cornell Medicine, New York, New York, USA.,Meinig School of Biomedical Engineering, Cornell University, Ithaca, New York, USA
| |
Collapse
|
15
|
Zhou X, Wang X, Liu E, Zhang L, Zhang H, Zhang X, Zhu Y, Kuai Z. An Unsupervised Deep Learning Approach for
Dynamic‐Exponential
Intravoxel Incoherent Motion
MRI
Modeling and Parameter Estimation in the Liver. J Magn Reson Imaging 2022; 56:848-859. [PMID: 35064945 DOI: 10.1002/jmri.28074] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2021] [Revised: 01/09/2022] [Accepted: 01/10/2022] [Indexed: 12/18/2022] Open
Affiliation(s)
- Xin‐Xiang Zhou
- Imaging Center Harbin Medical University Cancer Hospital Harbin China
| | - Xin‐Yu Wang
- Imaging Center Harbin Medical University Cancer Hospital Harbin China
| | - En‐Hui Liu
- Imaging Center Harbin Medical University Cancer Hospital Harbin China
| | - Lan Zhang
- Imaging Center Harbin Medical University Cancer Hospital Harbin China
| | - Hong‐Xia Zhang
- Imaging Center Harbin Medical University Cancer Hospital Harbin China
| | - Xiu‐Shi Zhang
- Imaging Center Harbin Medical University Cancer Hospital Harbin China
| | - Yue‐Min Zhu
- CREATIS CNRS UMR 5220‐INSERM U1206‐University Lyon 1‐INSA Lyon‐University Jean Monnet Saint‐Etienne Lyon France
| | - Zi‐Xiang Kuai
- Imaging Center Harbin Medical University Cancer Hospital Harbin China
| |
Collapse
|
16
|
Vrenken H, Jenkinson M, Pham DL, Guttmann CRG, Pareto D, Paardekooper M, de Sitter A, Rocca MA, Wottschel V, Cardoso MJ, Barkhof F. Opportunities for Understanding MS Mechanisms and Progression With MRI Using Large-Scale Data Sharing and Artificial Intelligence. Neurology 2021; 97:989-999. [PMID: 34607924 PMCID: PMC8610621 DOI: 10.1212/wnl.0000000000012884] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2020] [Accepted: 09/09/2021] [Indexed: 11/15/2022] Open
Abstract
Patients with multiple sclerosis (MS) have heterogeneous clinical presentations, symptoms, and progression over time, making MS difficult to assess and comprehend in vivo. The combination of large-scale data sharing and artificial intelligence creates new opportunities for monitoring and understanding MS using MRI. First, development of validated MS-specific image analysis methods can be boosted by verified reference, test, and benchmark imaging data. Using detailed expert annotations, artificial intelligence algorithms can be trained on such MS-specific data. Second, understanding disease processes could be greatly advanced through shared data of large MS cohorts with clinical, demographic, and treatment information. Relevant patterns in such data that may be imperceptible to a human observer could be detected through artificial intelligence techniques. This applies from image analysis (lesions, atrophy, or functional network changes) to large multidomain datasets (imaging, cognition, clinical disability, genetics). After reviewing data sharing and artificial intelligence, we highlight 3 areas that offer strong opportunities for making advances in the next few years: crowdsourcing, personal data protection, and organized analysis challenges. Difficulties as well as specific recommendations to overcome them are discussed, in order to best leverage data sharing and artificial intelligence to improve image analysis, imaging, and the understanding of MS.
Collapse
Affiliation(s)
- Hugo Vrenken
- From the MS Center Amsterdam (H.V., A.d.S., V.W.), Amsterdam Neuroscience, Department of Radiology and Nuclear Medicine, Amsterdam UMC (M.P.), the Netherlands; Wellcome Centre for Integrative Neuroimaging (WIN), FMRIB (M.J.), Nuffield Department of Clinical Neurosciences (NDCN), University of Oxford, UK; Human Imaging and Image Processing Core (D.L.P.), Center for Neuroscience and Regenerative Medicine, The Henry M. Jackson Foundation, Bethesda, MD; Center for Neurological Imaging (C.R.G.G.), Department of Radiology, Brigham and Women's Hospital, Boston, MA; Section of Neuroradiology (Department of Radiology) (D.P.), Vall d'Hebron University Hospital and Research Institute (VHIR), Autonomous University Barcelona, Spain; Neuroimaging Research Unit (M.A.R.), Institute of Experimental Neurology, Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy; AMIGO (M.J.C.), School of Biomedical Engineering and Imaging Sciences, King's College London; and Institutes of Neurology & Healthcare Engineering (F.B.), UCL London, UK.
| | - Mark Jenkinson
- From the MS Center Amsterdam (H.V., A.d.S., V.W.), Amsterdam Neuroscience, Department of Radiology and Nuclear Medicine, Amsterdam UMC (M.P.), the Netherlands; Wellcome Centre for Integrative Neuroimaging (WIN), FMRIB (M.J.), Nuffield Department of Clinical Neurosciences (NDCN), University of Oxford, UK; Human Imaging and Image Processing Core (D.L.P.), Center for Neuroscience and Regenerative Medicine, The Henry M. Jackson Foundation, Bethesda, MD; Center for Neurological Imaging (C.R.G.G.), Department of Radiology, Brigham and Women's Hospital, Boston, MA; Section of Neuroradiology (Department of Radiology) (D.P.), Vall d'Hebron University Hospital and Research Institute (VHIR), Autonomous University Barcelona, Spain; Neuroimaging Research Unit (M.A.R.), Institute of Experimental Neurology, Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy; AMIGO (M.J.C.), School of Biomedical Engineering and Imaging Sciences, King's College London; and Institutes of Neurology & Healthcare Engineering (F.B.), UCL London, UK
| | - Dzung L Pham
- From the MS Center Amsterdam (H.V., A.d.S., V.W.), Amsterdam Neuroscience, Department of Radiology and Nuclear Medicine, Amsterdam UMC (M.P.), the Netherlands; Wellcome Centre for Integrative Neuroimaging (WIN), FMRIB (M.J.), Nuffield Department of Clinical Neurosciences (NDCN), University of Oxford, UK; Human Imaging and Image Processing Core (D.L.P.), Center for Neuroscience and Regenerative Medicine, The Henry M. Jackson Foundation, Bethesda, MD; Center for Neurological Imaging (C.R.G.G.), Department of Radiology, Brigham and Women's Hospital, Boston, MA; Section of Neuroradiology (Department of Radiology) (D.P.), Vall d'Hebron University Hospital and Research Institute (VHIR), Autonomous University Barcelona, Spain; Neuroimaging Research Unit (M.A.R.), Institute of Experimental Neurology, Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy; AMIGO (M.J.C.), School of Biomedical Engineering and Imaging Sciences, King's College London; and Institutes of Neurology & Healthcare Engineering (F.B.), UCL London, UK
| | - Charles R G Guttmann
- From the MS Center Amsterdam (H.V., A.d.S., V.W.), Amsterdam Neuroscience, Department of Radiology and Nuclear Medicine, Amsterdam UMC (M.P.), the Netherlands; Wellcome Centre for Integrative Neuroimaging (WIN), FMRIB (M.J.), Nuffield Department of Clinical Neurosciences (NDCN), University of Oxford, UK; Human Imaging and Image Processing Core (D.L.P.), Center for Neuroscience and Regenerative Medicine, The Henry M. Jackson Foundation, Bethesda, MD; Center for Neurological Imaging (C.R.G.G.), Department of Radiology, Brigham and Women's Hospital, Boston, MA; Section of Neuroradiology (Department of Radiology) (D.P.), Vall d'Hebron University Hospital and Research Institute (VHIR), Autonomous University Barcelona, Spain; Neuroimaging Research Unit (M.A.R.), Institute of Experimental Neurology, Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy; AMIGO (M.J.C.), School of Biomedical Engineering and Imaging Sciences, King's College London; and Institutes of Neurology & Healthcare Engineering (F.B.), UCL London, UK
| | - Deborah Pareto
- From the MS Center Amsterdam (H.V., A.d.S., V.W.), Amsterdam Neuroscience, Department of Radiology and Nuclear Medicine, Amsterdam UMC (M.P.), the Netherlands; Wellcome Centre for Integrative Neuroimaging (WIN), FMRIB (M.J.), Nuffield Department of Clinical Neurosciences (NDCN), University of Oxford, UK; Human Imaging and Image Processing Core (D.L.P.), Center for Neuroscience and Regenerative Medicine, The Henry M. Jackson Foundation, Bethesda, MD; Center for Neurological Imaging (C.R.G.G.), Department of Radiology, Brigham and Women's Hospital, Boston, MA; Section of Neuroradiology (Department of Radiology) (D.P.), Vall d'Hebron University Hospital and Research Institute (VHIR), Autonomous University Barcelona, Spain; Neuroimaging Research Unit (M.A.R.), Institute of Experimental Neurology, Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy; AMIGO (M.J.C.), School of Biomedical Engineering and Imaging Sciences, King's College London; and Institutes of Neurology & Healthcare Engineering (F.B.), UCL London, UK
| | - Michel Paardekooper
- From the MS Center Amsterdam (H.V., A.d.S., V.W.), Amsterdam Neuroscience, Department of Radiology and Nuclear Medicine, Amsterdam UMC (M.P.), the Netherlands; Wellcome Centre for Integrative Neuroimaging (WIN), FMRIB (M.J.), Nuffield Department of Clinical Neurosciences (NDCN), University of Oxford, UK; Human Imaging and Image Processing Core (D.L.P.), Center for Neuroscience and Regenerative Medicine, The Henry M. Jackson Foundation, Bethesda, MD; Center for Neurological Imaging (C.R.G.G.), Department of Radiology, Brigham and Women's Hospital, Boston, MA; Section of Neuroradiology (Department of Radiology) (D.P.), Vall d'Hebron University Hospital and Research Institute (VHIR), Autonomous University Barcelona, Spain; Neuroimaging Research Unit (M.A.R.), Institute of Experimental Neurology, Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy; AMIGO (M.J.C.), School of Biomedical Engineering and Imaging Sciences, King's College London; and Institutes of Neurology & Healthcare Engineering (F.B.), UCL London, UK
| | - Alexandra de Sitter
- From the MS Center Amsterdam (H.V., A.d.S., V.W.), Amsterdam Neuroscience, Department of Radiology and Nuclear Medicine, Amsterdam UMC (M.P.), the Netherlands; Wellcome Centre for Integrative Neuroimaging (WIN), FMRIB (M.J.), Nuffield Department of Clinical Neurosciences (NDCN), University of Oxford, UK; Human Imaging and Image Processing Core (D.L.P.), Center for Neuroscience and Regenerative Medicine, The Henry M. Jackson Foundation, Bethesda, MD; Center for Neurological Imaging (C.R.G.G.), Department of Radiology, Brigham and Women's Hospital, Boston, MA; Section of Neuroradiology (Department of Radiology) (D.P.), Vall d'Hebron University Hospital and Research Institute (VHIR), Autonomous University Barcelona, Spain; Neuroimaging Research Unit (M.A.R.), Institute of Experimental Neurology, Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy; AMIGO (M.J.C.), School of Biomedical Engineering and Imaging Sciences, King's College London; and Institutes of Neurology & Healthcare Engineering (F.B.), UCL London, UK
| | - Maria A Rocca
- From the MS Center Amsterdam (H.V., A.d.S., V.W.), Amsterdam Neuroscience, Department of Radiology and Nuclear Medicine, Amsterdam UMC (M.P.), the Netherlands; Wellcome Centre for Integrative Neuroimaging (WIN), FMRIB (M.J.), Nuffield Department of Clinical Neurosciences (NDCN), University of Oxford, UK; Human Imaging and Image Processing Core (D.L.P.), Center for Neuroscience and Regenerative Medicine, The Henry M. Jackson Foundation, Bethesda, MD; Center for Neurological Imaging (C.R.G.G.), Department of Radiology, Brigham and Women's Hospital, Boston, MA; Section of Neuroradiology (Department of Radiology) (D.P.), Vall d'Hebron University Hospital and Research Institute (VHIR), Autonomous University Barcelona, Spain; Neuroimaging Research Unit (M.A.R.), Institute of Experimental Neurology, Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy; AMIGO (M.J.C.), School of Biomedical Engineering and Imaging Sciences, King's College London; and Institutes of Neurology & Healthcare Engineering (F.B.), UCL London, UK
| | - Viktor Wottschel
- From the MS Center Amsterdam (H.V., A.d.S., V.W.), Amsterdam Neuroscience, Department of Radiology and Nuclear Medicine, Amsterdam UMC (M.P.), the Netherlands; Wellcome Centre for Integrative Neuroimaging (WIN), FMRIB (M.J.), Nuffield Department of Clinical Neurosciences (NDCN), University of Oxford, UK; Human Imaging and Image Processing Core (D.L.P.), Center for Neuroscience and Regenerative Medicine, The Henry M. Jackson Foundation, Bethesda, MD; Center for Neurological Imaging (C.R.G.G.), Department of Radiology, Brigham and Women's Hospital, Boston, MA; Section of Neuroradiology (Department of Radiology) (D.P.), Vall d'Hebron University Hospital and Research Institute (VHIR), Autonomous University Barcelona, Spain; Neuroimaging Research Unit (M.A.R.), Institute of Experimental Neurology, Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy; AMIGO (M.J.C.), School of Biomedical Engineering and Imaging Sciences, King's College London; and Institutes of Neurology & Healthcare Engineering (F.B.), UCL London, UK
| | - M Jorge Cardoso
- From the MS Center Amsterdam (H.V., A.d.S., V.W.), Amsterdam Neuroscience, Department of Radiology and Nuclear Medicine, Amsterdam UMC (M.P.), the Netherlands; Wellcome Centre for Integrative Neuroimaging (WIN), FMRIB (M.J.), Nuffield Department of Clinical Neurosciences (NDCN), University of Oxford, UK; Human Imaging and Image Processing Core (D.L.P.), Center for Neuroscience and Regenerative Medicine, The Henry M. Jackson Foundation, Bethesda, MD; Center for Neurological Imaging (C.R.G.G.), Department of Radiology, Brigham and Women's Hospital, Boston, MA; Section of Neuroradiology (Department of Radiology) (D.P.), Vall d'Hebron University Hospital and Research Institute (VHIR), Autonomous University Barcelona, Spain; Neuroimaging Research Unit (M.A.R.), Institute of Experimental Neurology, Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy; AMIGO (M.J.C.), School of Biomedical Engineering and Imaging Sciences, King's College London; and Institutes of Neurology & Healthcare Engineering (F.B.), UCL London, UK
| | - Frederik Barkhof
- From the MS Center Amsterdam (H.V., A.d.S., V.W.), Amsterdam Neuroscience, Department of Radiology and Nuclear Medicine, Amsterdam UMC (M.P.), the Netherlands; Wellcome Centre for Integrative Neuroimaging (WIN), FMRIB (M.J.), Nuffield Department of Clinical Neurosciences (NDCN), University of Oxford, UK; Human Imaging and Image Processing Core (D.L.P.), Center for Neuroscience and Regenerative Medicine, The Henry M. Jackson Foundation, Bethesda, MD; Center for Neurological Imaging (C.R.G.G.), Department of Radiology, Brigham and Women's Hospital, Boston, MA; Section of Neuroradiology (Department of Radiology) (D.P.), Vall d'Hebron University Hospital and Research Institute (VHIR), Autonomous University Barcelona, Spain; Neuroimaging Research Unit (M.A.R.), Institute of Experimental Neurology, Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy; AMIGO (M.J.C.), School of Biomedical Engineering and Imaging Sciences, King's College London; and Institutes of Neurology & Healthcare Engineering (F.B.), UCL London, UK
| | | |
Collapse
|
17
|
Gyori NG, Palombo M, Clark CA, Zhang H, Alexander DC. Training data distribution significantly impacts the estimation of tissue microstructure with machine learning. Magn Reson Med 2021; 87:932-947. [PMID: 34545955 DOI: 10.1002/mrm.29014] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Revised: 08/30/2021] [Accepted: 08/30/2021] [Indexed: 12/18/2022]
Abstract
PURPOSE Supervised machine learning (ML) provides a compelling alternative to traditional model fitting for parameter mapping in quantitative MRI. The aim of this work is to demonstrate and quantify the effect of different training data distributions on the accuracy and precision of parameter estimates when supervised ML is used for fitting. METHODS We fit a two- and three-compartment biophysical model to diffusion measurements from in-vivo human brain, as well as simulated diffusion data, using both traditional model fitting and supervised ML. For supervised ML, we train several artificial neural networks, as well as random forest regressors, on different distributions of ground truth parameters. We compare the accuracy and precision of parameter estimates obtained from the different estimation approaches using synthetic test data. RESULTS When the distribution of parameter combinations in the training set matches those observed in healthy human data sets, we observe high precision, but inaccurate estimates for atypical parameter combinations. In contrast, when training data is sampled uniformly from the entire plausible parameter space, estimates tend to be more accurate for atypical parameter combinations but may have lower precision for typical parameter combinations. CONCLUSION This work highlights that estimation of model parameters using supervised ML depends strongly on the training-set distribution. We show that high precision obtained using ML may mask strong bias, and visual assessment of the parameter maps is not sufficient for evaluating the quality of the estimates.
Collapse
Affiliation(s)
- Noemi G Gyori
- Centre for Medical Image Computing, Department of Computer Science, University College London, London, UK.,Great Ormond Street Institute of Child Health, University College London, London, UK
| | - Marco Palombo
- Centre for Medical Image Computing, Department of Computer Science, University College London, London, UK
| | - Christopher A Clark
- Great Ormond Street Institute of Child Health, University College London, London, UK
| | - Hui Zhang
- Centre for Medical Image Computing, Department of Computer Science, University College London, London, UK
| | - Daniel C Alexander
- Centre for Medical Image Computing, Department of Computer Science, University College London, London, UK
| |
Collapse
|
18
|
Kontopodis EE, Papadaki E, Trivizakis E, Maris TG, Simos P, Papadakis GZ, Tsatsakis A, Spandidos DA, Karantanas A, Marias K. Emerging deep learning techniques using magnetic resonance imaging data applied in multiple sclerosis and clinical isolated syndrome patients (Review). Exp Ther Med 2021; 22:1149. [PMID: 34504594 PMCID: PMC8393268 DOI: 10.3892/etm.2021.10583] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Accepted: 07/29/2021] [Indexed: 12/18/2022] Open
Abstract
Computer-aided diagnosis systems aim to assist clinicians in the early identification of abnormal signs in order to optimize the interpretation of medical images and increase diagnostic precision. Multiple sclerosis (MS) and clinically isolated syndrome (CIS) are chronic inflammatory, demyelinating diseases affecting the central nervous system. Recent advances in deep learning (DL) techniques have led to novel computational paradigms in MS and CIS imaging designed for automatic segmentation and detection of areas of interest and automatic classification of anatomic structures, as well as optimization of neuroimaging protocols. To this end, there are several publications presenting artificial intelligence-based predictive models aiming to increase diagnostic accuracy and to facilitate optimal clinical management in patients diagnosed with MS and/or CIS. The current study presents a thorough review covering DL techniques that have been applied in MS and CIS during recent years, shedding light on their current advances and limitations.
Collapse
Affiliation(s)
- Eleftherios E Kontopodis
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Radiology, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Efrosini Papadaki
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Radiology, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Eleftherios Trivizakis
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Radiology, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Thomas G Maris
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Radiology, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Panagiotis Simos
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Psychiatry and Behavioral Sciences, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Georgios Z Papadakis
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Radiology, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Aristidis Tsatsakis
- Centre of Toxicology Science and Research, Faculty of Medicine, University of Crete, 71003 Heraklion, Greece
| | - Demetrios A Spandidos
- Laboratory of Clinical Virology, Medical School, University of Crete, 71003 Heraklion, Greece
| | - Apostolos Karantanas
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Radiology, Medical School, University of Crete, 70013 Heraklion, Greece
| | - Kostas Marias
- Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Greece.,Department of Electrical and Computer Engineering, Hellenic Mediterranean University, 71410 Heraklion, Greece
| |
Collapse
|
19
|
Liu H, Joseph TS, Xiang QS, Tam R, Kozlowski P, Li DKB, MacKay AL, Kramer JLK, Laule C. A data-driven T 2 relaxation analysis approach for myelin water imaging: Spectrum analysis for multiple exponentials via experimental condition oriented simulation (SAME-ECOS). Magn Reson Med 2021; 87:915-931. [PMID: 34490909 DOI: 10.1002/mrm.29000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Revised: 08/16/2021] [Accepted: 08/17/2021] [Indexed: 11/08/2022]
Abstract
PURPOSE The decomposition of multi-exponential decay data into a T2 spectrum poses substantial challenges for conventional fitting algorithms, including non-negative least squares (NNLS). Based on a combination of the resolution limit constraint and machine learning neural network algorithm, a data-driven and highly tailorable analysis method named spectrum analysis for multiple exponentials via experimental condition oriented simulation (SAME-ECOS) was proposed. THEORY AND METHODS The theory of SAME-ECOS was derived. Then, a paradigm was presented to demonstrate the SAME-ECOS workflow, consisting of a series of calculation, simulation, and model training operations. The performance of the trained SAME-ECOS model was evaluated using simulations and six in vivo brain datasets. The code is available at https://github.com/hanwencat/SAME-ECOS. RESULTS Using NNLS as the baseline, SAME-ECOS achieved over 15% higher overall cosine similarity scores in producing the T2 spectrum, and more than 10% lower mean absolute error in calculating the myelin water fraction (MWF), as well as demonstrated better robustness to noise in the simulation tests. Applying to in vivo data, MWF from SAME-ECOS and NNLS was highly correlated among all study participants. However, a distinct separation of the myelin water peak and the intra/extra-cellular water peak was only observed in the mean T2 spectra determined using SAME-ECOS. In terms of data processing speed, SAME-ECOS is approximately 30 times faster than NNLS, achieving a whole-brain analysis in 3 min. CONCLUSION Compared with NNLS, the SAME-ECOS method yields much more reliable T2 spectra in a dramatically shorter time, increasing the feasibility of multi-component T2 decay analysis in clinical settings.
Collapse
Affiliation(s)
- Hanwen Liu
- Physics & Astronomy, University of British Columbia, Vancouver, British Columbia, Canada.,International Collaboration on Repair Discoveries, University of British Columbia, Vancouver, British Columbia, Canada
| | - Tigris S Joseph
- Physics & Astronomy, University of British Columbia, Vancouver, British Columbia, Canada.,International Collaboration on Repair Discoveries, University of British Columbia, Vancouver, British Columbia, Canada
| | - Qing-San Xiang
- Physics & Astronomy, University of British Columbia, Vancouver, British Columbia, Canada.,Radiology, University of British Columbia, Vancouver, British Columbia, Canada
| | - Roger Tam
- Radiology, University of British Columbia, Vancouver, British Columbia, Canada.,Biomedical Engineering, University of British Columbia, Vancouver, British Columbia, Canada
| | - Piotr Kozlowski
- International Collaboration on Repair Discoveries, University of British Columbia, Vancouver, British Columbia, Canada.,Radiology, University of British Columbia, Vancouver, British Columbia, Canada
| | - David K B Li
- Radiology, University of British Columbia, Vancouver, British Columbia, Canada
| | - Alex L MacKay
- Physics & Astronomy, University of British Columbia, Vancouver, British Columbia, Canada.,Radiology, University of British Columbia, Vancouver, British Columbia, Canada
| | - John L K Kramer
- International Collaboration on Repair Discoveries, University of British Columbia, Vancouver, British Columbia, Canada.,Kinesiology, University of British Columbia, Vancouver, British Columbia, Canada
| | - Cornelia Laule
- Physics & Astronomy, University of British Columbia, Vancouver, British Columbia, Canada.,International Collaboration on Repair Discoveries, University of British Columbia, Vancouver, British Columbia, Canada.,Radiology, University of British Columbia, Vancouver, British Columbia, Canada.,Pathology & Laboratory Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
20
|
Li Y, Xiong J, Guo R, Zhao Y, Li Y, Liang ZP. Improved estimation of myelin water fractions with learned parameter distributions. Magn Reson Med 2021; 86:2795-2809. [PMID: 34216050 DOI: 10.1002/mrm.28889] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Revised: 05/20/2021] [Accepted: 05/21/2021] [Indexed: 11/07/2022]
Abstract
PURPOSE To improve estimation of myelin water fraction (MWF) in the brain from multi-echo gradient-echo imaging data. METHODS A systematic sensitivity analysis was first conducted to characterize the conventional exponential models used for MWF estimation. A new estimation method was then proposed for improved estimation of MWF from practical gradient-echo imaging data. The proposed method uses an extended signal model that includes a finite impulse response filter to compensate for practical signal variations. This new model also enables the use of prelearned parameter distributions as well as low-rank signal structures to improve parameter estimation. The resulting parameter estimation problem was solved optimally in the Bayesian sense. RESULTS Our sensitivity analysis results showed that the conventional exponential models were very sensitive to measurement noise and modeling errors. Our simulation and experimental results showed that our proposed method provided a substantial improvement in reliability, reproducibility, and robustness of MWF estimates over the conventional methods. Clinical results obtained from stroke patients indicated that the proposed method, with its improved capability, could reveal the loss of myelin in lesions, demonstrating its translational potentials. CONCLUSION This paper addressed the problem of robust MWF estimation from gradient-echo imaging data. A new method was proposed to provide improved MWF estimation in the presence of significant noise and modeling errors. The performance of the proposed method has been evaluated using both simulated and experimental data, showing significantly improved robustness over the existing methods. The proposed method may prove useful for quantitative myelin imaging in clinical applications.
Collapse
Affiliation(s)
- Yudu Li
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA.,Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Jiahui Xiong
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA.,Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Rong Guo
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA.,Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Yibo Zhao
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA.,Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Yao Li
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Zhi-Pei Liang
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA.,Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| |
Collapse
|
21
|
Yu T, Canales-Rodríguez EJ, Pizzolato M, Piredda GF, Hilbert T, Fischi-Gomez E, Weigel M, Barakovic M, Bach Cuadra M, Granziera C, Kober T, Thiran JP. Model-informed machine learning for multi-component T 2 relaxometry. Med Image Anal 2020; 69:101940. [PMID: 33422828 DOI: 10.1016/j.media.2020.101940] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2020] [Revised: 12/09/2020] [Accepted: 12/10/2020] [Indexed: 02/06/2023]
Abstract
Recovering the T2 distribution from multi-echo T2 magnetic resonance (MR) signals is challenging but has high potential as it provides biomarkers characterizing the tissue micro-structure, such as the myelin water fraction (MWF). In this work, we propose to combine machine learning and aspects of parametric (fitting from the MRI signal using biophysical models) and non-parametric (model-free fitting of the T2 distribution from the signal) approaches to T2 relaxometry in brain tissue by using a multi-layer perceptron (MLP) for the distribution reconstruction. For training our network, we construct an extensive synthetic dataset derived from biophysical models in order to constrain the outputs with a priori knowledge of in vivo distributions. The proposed approach, called Model-Informed Machine Learning (MIML), takes as input the MR signal and directly outputs the associated T2 distribution. We evaluate MIML in comparison to a Gaussian Mixture Fitting (parametric) and Regularized Non-Negative Least Squares algorithms (non-parametric) on synthetic data, an ex vivo scan, and high-resolution scans of healthy subjects and a subject with Multiple Sclerosis. In synthetic data, MIML provides more accurate and noise-robust distributions. In real data, MWF maps derived from MIML exhibit the greatest conformity to anatomical scans, have the highest correlation to a histological map of myelin volume, and the best unambiguous lesion visualization and localization, with superior contrast between lesions and normal appearing tissue. In whole-brain analysis, MIML is 22 to 4980 times faster than the non-parametric and parametric methods, respectively.
Collapse
Affiliation(s)
- Thomas Yu
- Signal Processing Lab 5 (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland; Medical Image Analysis Laboratory, Center for Biomedical Imaging (CIBM), University of Lausanne, Switzerland
| | - Erick Jorge Canales-Rodríguez
- Signal Processing Lab 5 (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland; FIDMAG Germanes Hospitalàries Research Foundation, Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Barcelona, Spain.
| | - Marco Pizzolato
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Kongens Lyngby, Denmark; Signal Processing Lab 5 (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Gian Franco Piredda
- Advanced Clinical Imaging Technology, Siemens Healthcare AG, Lausanne, Switzerland; Department of Radiology, Lausanne University Hospital and University of Lausanne, Switzerland; Signal Processing Lab 5 (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Tom Hilbert
- Advanced Clinical Imaging Technology, Siemens Healthcare AG, Lausanne, Switzerland; Department of Radiology, Lausanne University Hospital and University of Lausanne, Switzerland; Signal Processing Lab 5 (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Elda Fischi-Gomez
- Signal Processing Lab 5 (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland; Translational Imaging in Neurology Basel, Department of Medicine and Biomedical Engineering, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Matthias Weigel
- Translational Imaging in Neurology Basel, Department of Medicine and Biomedical Engineering, University Hospital Basel and University of Basel, Basel, Switzerland; Neurologic Clinic and Policlinic, Departments of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland; Division of Radiological Physics, Department of Radiology, University Hospital of Basel, Basel, Switzerland
| | - Muhamed Barakovic
- Translational Imaging in Neurology Basel, Department of Medicine and Biomedical Engineering, University Hospital Basel and University of Basel, Basel, Switzerland; Neurologic Clinic and Policlinic, Departments of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Meritxell Bach Cuadra
- Medical Image Analysis Laboratory, Center for Biomedical Imaging (CIBM), University of Lausanne, Switzerland; Signal Processing Lab 5 (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland; Department of Radiology, Lausanne University Hospital and University of Lausanne, Switzerland
| | - Cristina Granziera
- Translational Imaging in Neurology Basel, Department of Medicine and Biomedical Engineering, University Hospital Basel and University of Basel, Basel, Switzerland; Neurologic Clinic and Policlinic, Departments of Medicine, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Tobias Kober
- Advanced Clinical Imaging Technology, Siemens Healthcare AG, Lausanne, Switzerland; Department of Radiology, Lausanne University Hospital and University of Lausanne, Switzerland; Signal Processing Lab 5 (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Jean-Philippe Thiran
- Signal Processing Lab 5 (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland; Department of Radiology, Lausanne University Hospital and University of Lausanne, Switzerland
| |
Collapse
|
22
|
Drenthen GS, Backes WH, Jansen JFA. Estimating myelin-water content from anatomical and diffusion images using spatially undersampled myelin-water imaging through machine learning. Neuroimage 2020; 226:117626. [PMID: 33301943 DOI: 10.1016/j.neuroimage.2020.117626] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Revised: 11/15/2020] [Accepted: 11/28/2020] [Indexed: 12/28/2022] Open
Abstract
Myelin is vital for healthy neuronal development, and can therefore provide valuable information regarding neuronal maturation. Anatomical and diffusion weighted images (DWI) possess information related to the myelin content and the current study investigates whether quantitative myelin markers can be extracted from anatomical and DWI using neural networks. Thirteen volunteers (mean age 29y) are included, and for each subject, a residual neural network was trained using spatially undersampled reference myelin-water markers. The network is trained on a voxel-by-voxel basis, resulting in a large amount of training data for each volunteer. The inputs used are the anatomical contrasts (cT1w, cT2w), the standardized T1w/T2w ratio, estimates of the relaxation times (T1, T2) and their ratio (T1/T2), and common DWI metrics (FA, RD, MD, λ1, λ2, λ3). Furthermore, to estimate the added value of the DWI metrics, neural networks were trained using either the combined set (DWI, T1w and T2w) or only the anatomical (T1w and T2w) images. The reconstructed myelin-water maps are in good agreement with the reference myelin-water content in terms of the coefficient of variation (CoV) and the intraclass correlation coefficient (ICC). A 6-fold undersampling using both anatomical and DWI metrics resulted in ICC = 0.68 and CoV = 5.9%. Moreover, using twice the training data (3-fold undersampling) resulted in an ICC that is comparable to the reproducibility of the myelin-water imaging itself (CoV = 5.5% vs. CoV = 6.7% and ICC = 0.74 vs ICC = 0.80). To achieve this, beside the T1w, T2w images, DWI is required. This preliminary study shows the potential of machine learning approaches to extract specific myelin-content from anatomical and diffusion-weighted scans.
Collapse
Affiliation(s)
- Gerhard S Drenthen
- School for Mental Health and Neuroscience, Maastricht University Medical Center, P. Debyelaan 25, Maastricht, the Netherlands; Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, P. Debyelaan 25, Maastricht, the Netherlands; Department of Electrical Engineering, Eindhoven University of Technology, De Rondom 70, Eindhoven, the Netherlands.
| | - Walter H Backes
- School for Mental Health and Neuroscience, Maastricht University Medical Center, P. Debyelaan 25, Maastricht, the Netherlands; Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, P. Debyelaan 25, Maastricht, the Netherlands; Cardiovascular Research Institute Maastricht (CARIM), Maastricht University Medical Center, P. Debyelaan 25, Maastricht, the Netherlands
| | - Jacobus F A Jansen
- School for Mental Health and Neuroscience, Maastricht University Medical Center, P. Debyelaan 25, Maastricht, the Netherlands; Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, P. Debyelaan 25, Maastricht, the Netherlands; Department of Electrical Engineering, Eindhoven University of Technology, De Rondom 70, Eindhoven, the Netherlands
| |
Collapse
|
23
|
Imaging of the Spinal Cord in Multiple Sclerosis: Past, Present, Future. Brain Sci 2020; 10:brainsci10110857. [PMID: 33202821 PMCID: PMC7696997 DOI: 10.3390/brainsci10110857] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2020] [Revised: 10/30/2020] [Accepted: 11/11/2020] [Indexed: 11/17/2022] Open
Abstract
Spinal cord imaging in multiple sclerosis (MS) plays a significant role in diagnosing and tracking disease progression. The spinal cord is one of four key areas of the central nervous system where documenting the dissemination in space in the McDonald criteria for diagnosing MS. Spinal cord lesion load and the severity of cord atrophy are believed to be more relevant to disability than white matter lesions in the brain in different phenotypes of MS. Axonal loss contributes to spinal cord atrophy in MS and its degree correlates with disease severity and prognosis. Therefore, measures of axonal loss are often reliable biomarkers for monitoring disease progression. With recent technical advances, more and more qualitative and quantitative MRI techniques have been investigated in an attempt to provide objective and reliable diagnostic and monitoring biomarkers in MS. In this article, we discuss the role of spinal cord imaging in the diagnosis and prognosis of MS and, additionally, we review various techniques that may improve our understanding of the disease.
Collapse
|