1
|
Szekely-Kohn AC, Castellani M, Espino DM, Baronti L, Ahmed Z, Manifold WGK, Douglas M. Machine learning for refining interpretation of magnetic resonance imaging scans in the management of multiple sclerosis: a narrative review. ROYAL SOCIETY OPEN SCIENCE 2025; 12:241052. [PMID: 39845718 PMCID: PMC11750376 DOI: 10.1098/rsos.241052] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Revised: 10/23/2024] [Accepted: 11/17/2024] [Indexed: 01/24/2025]
Abstract
Multiple sclerosis (MS) is an autoimmune disease of the brain and spinal cord with both inflammatory and neurodegenerative features. Although advances in imaging techniques, particularly magnetic resonance imaging (MRI), have improved the process of diagnosis, its cause is unknown, a cure remains elusive and the evidence base to guide treatment is lacking. Computational techniques like machine learning (ML) have started to be used to understand MS. Published MS MRI-based computational studies can be divided into five categories: automated diagnosis; differentiation between lesion types and/or MS stages; differential diagnosis; monitoring and predicting disease progression; and synthetic MRI dataset generation. Collectively, these approaches show promise in assisting with MS diagnosis, monitoring of disease activity and prediction of future progression, all potentially contributing to disease management. Analysis quality using ML is highly dependent on the dataset size and variability used for training. Wider public access would mean larger datasets for experimentation, resulting in higher-quality analysis, permitting for more conclusive research. This narrative review provides an outline of the fundamentals of MS pathology and pathogenesis, diagnostic techniques and data types in computational analysis, as well as collating literature pertaining to the application of computational techniques to MRI towards developing a better understanding of MS.
Collapse
Affiliation(s)
- Adam C. Szekely-Kohn
- School of Engineering, University of Birmingham, Edgbaston, BirminghamB15 2TT, UK
| | - Marco Castellani
- School of Engineering, University of Birmingham, Edgbaston, BirminghamB15 2TT, UK
| | - Daniel M. Espino
- School of Engineering, University of Birmingham, Edgbaston, BirminghamB15 2TT, UK
| | - Luca Baronti
- School of Computer Science, University of Birmingham, Edgbaston, BirminghamB15 2TT, UK
| | - Zubair Ahmed
- University Hospitals Birmingham NHS Foundation Trust, Edgbaston, BirminghamB15 2GW, UK
- Institute of Inflammation and Ageing, University of Birmingham, Edgbaston, BirminghamB15 2TT, UK
| | | | - Michael Douglas
- University Hospitals Birmingham NHS Foundation Trust, Edgbaston, BirminghamB15 2GW, UK
- Institute of Inflammation and Ageing, University of Birmingham, Edgbaston, BirminghamB15 2TT, UK
- Department of Neurology, Dudley Group NHS Foundation Trust, Russells Hall Hospital, BirminghamDY1 2HQ, UK
- School of Life and Health Sciences, Aston University, Birmingham, UK
| |
Collapse
|
2
|
Sadeghibakhi M, Pourreza H, Mahyar H. Multiple Sclerosis Lesions Segmentation Using Attention-Based CNNs in FLAIR Images. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2022; 10:1800411. [PMID: 35711337 PMCID: PMC9191687 DOI: 10.1109/jtehm.2022.3172025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Revised: 03/05/2022] [Accepted: 04/08/2022] [Indexed: 11/17/2022]
Abstract
Objective: Multiple Sclerosis (MS) is an autoimmune and demyelinating disease that leads to lesions in the central nervous system. This disease can be tracked and diagnosed using Magnetic Resonance Imaging (MRI). A multitude of multimodality automatic biomedical approaches are used to segment lesions that are not beneficial for patients in terms of cost, time, and usability. The authors of the present paper propose a method employing just one modality (FLAIR image) to segment MS lesions accurately. Methods: A patch-based Convolutional Neural Network (CNN) is designed, inspired by 3D-ResNet and spatial-channel attention module, to segment MS lesions. The proposed method consists of three stages: (1) the Contrast-Limited Adaptive Histogram Equalization (CLAHE) is applied to the original images and concatenated to the extracted edges to create 4D images; (2) the patches of size [Formula: see text] are randomly selected from the 4D images; and (3) the extracted patches are passed into an attention-based CNN which is used to segment the lesions. Finally, the proposed method was compared to previous studies of the same dataset. Results: The current study evaluates the model with a test set of ISIB challenge data. Experimental results illustrate that the proposed approach significantly surpasses existing methods of Dice similarity and Absolute Volume Difference while the proposed method uses just one modality (FLAIR) to segment the lesions. Conclusion: The authors have introduced an automated approach to segment the lesions, which is based on, at most, two modalities as an input. The proposed architecture comprises convolution, deconvolution, and an SCA-VoxRes module as an attention module. The results show, that the proposed method outperforms well compared to other methods.
Collapse
Affiliation(s)
- Mehdi Sadeghibakhi
- MV LaboratoryDepartment of Computer Engineering, Faculty of EngineeringFerdowsi University of MashhadMashhad9177948974Iran
| | - Hamidreza Pourreza
- MV LaboratoryDepartment of Computer Engineering, Faculty of EngineeringFerdowsi University of MashhadMashhad9177948974Iran
| | - Hamidreza Mahyar
- Faculty of Engineering, W Booth School of Engineering Practice and TechnologyMcMaster UniversityHamiltonONL8S 4L8Canada
| |
Collapse
|
3
|
Martin D, Tong E, Kelly B, Yeom K, Yedavalli V. Current Perspectives of Artificial Intelligence in Pediatric Neuroradiology: An Overview. FRONTIERS IN RADIOLOGY 2021; 1:713681. [PMID: 37492174 PMCID: PMC10365125 DOI: 10.3389/fradi.2021.713681] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/23/2021] [Accepted: 07/21/2021] [Indexed: 07/27/2023]
Abstract
Artificial Intelligence, Machine Learning, and myriad related techniques are becoming ever more commonplace throughout industry and society, and radiology is by no means an exception. It is essential for every radiologists of every subspecialty to gain familiarity and confidence with these techniques as they become increasingly incorporated into the routine practice in both academic and private practice settings. In this article, we provide a brief review of several definitions and techniques that are commonly used in AI, and in particular machine vision, and examples of how they are currently being applied to the setting of clinical neuroradiology. We then review the unique challenges that the adoption and application of faces within the subspecialty of pediatric neuroradiology, and how these obstacles may be overcome. We conclude by presenting specific examples of how AI is currently being applied within the field of pediatric neuroradiology and the potential opportunities that are available for future applications.
Collapse
Affiliation(s)
- Dann Martin
- Vanderbilt University, Nashville, TN, United States
| | - Elizabeth Tong
- Department of Neuroradiology, Stanford Health Care, Stanford, CA, United States
| | - Brendan Kelly
- Insight Centre for Data Analytics, University College Dublin, Dublin, Ireland
| | - Kristen Yeom
- Department of Neuroradiology, Stanford Health Care, Stanford, CA, United States
| | | |
Collapse
|
4
|
Koley S, Dutta PK, Aganj I. Radius-optimized efficient template matching for lesion detection from brain images. Sci Rep 2021; 11:11586. [PMID: 34078935 PMCID: PMC8172536 DOI: 10.1038/s41598-021-90147-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2020] [Accepted: 05/07/2021] [Indexed: 11/09/2022] Open
Abstract
Computer-aided detection of brain lesions from volumetric magnetic resonance imaging (MRI) is in demand for fast and automatic diagnosis of neural diseases. The template-matching technique can provide satisfactory outcome for automatic localization of brain lesions; however, finding the optimal template size that maximizes similarity of the template and the lesion remains challenging. This increases the complexity of the algorithm and the requirement for computational resources, while processing large MRI volumes with three-dimensional (3D) templates. Hence, reducing the computational complexity of template matching is needed. In this paper, we first propose a mathematical framework for computing the normalized cross-correlation coefficient (NCCC) as the similarity measure between the MRI volume and approximated 3D Gaussian template with linear time complexity, [Formula: see text], as opposed to the conventional fast Fourier transform (FFT) based approach with the complexity [Formula: see text], where [Formula: see text] is the number of voxels in the image and [Formula: see text] is the number of tried template radii. We then propose a mathematical formulation to analytically estimate the optimal template radius for each voxel in the image and compute the NCCC with the location-dependent optimal radius, reducing the complexity to [Formula: see text]. We test our methods on one synthetic and two real multiple-sclerosis databases, and compare their performances in lesion detection with FFT and a state-of-the-art lesion prediction algorithm. We demonstrate through our experiments the efficiency of the proposed methods for brain lesion detection and their comparable performance with existing techniques.
Collapse
Affiliation(s)
- Subhranil Koley
- School of Medical Science and Technology, Indian Institute of Technology Kharagpur, Kharagpur, WB, 721302, India.
| | - Pranab K Dutta
- Electrical Engineering Department, Indian Institute of Technology Kharagpur, Kharagpur, WB, 721302, India
| | - Iman Aganj
- Athinoula A. Martinos Center for Biomedical Imaging, Radiology Department, Massachusetts General Hospital, Harvard Medical School, 149 13th St., Suite 2301, Charlestown, MA, 02129, USA.,Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, 32 Vassar St., Cambridge, MA, 02139, USA
| |
Collapse
|
5
|
Gryska E, Schneiderman J, Björkman-Burtscher I, Heckemann RA. Automatic brain lesion segmentation on standard magnetic resonance images: a scoping review. BMJ Open 2021; 11:e042660. [PMID: 33514580 PMCID: PMC7849889 DOI: 10.1136/bmjopen-2020-042660] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/11/2020] [Revised: 01/09/2021] [Accepted: 01/12/2021] [Indexed: 12/11/2022] Open
Abstract
OBJECTIVES Medical image analysis practices face challenges that can potentially be addressed with algorithm-based segmentation tools. In this study, we map the field of automatic MR brain lesion segmentation to understand the clinical applicability of prevalent methods and study designs, as well as challenges and limitations in the field. DESIGN Scoping review. SETTING Three databases (PubMed, IEEE Xplore and Scopus) were searched with tailored queries. Studies were included based on predefined criteria. Emerging themes during consecutive title, abstract, methods and whole-text screening were identified. The full-text analysis focused on materials, preprocessing, performance evaluation and comparison. RESULTS Out of 2990 unique articles identified through the search, 441 articles met the eligibility criteria, with an estimated growth rate of 10% per year. We present a general overview and trends in the field with regard to publication sources, segmentation principles used and types of lesions. Algorithms are predominantly evaluated by measuring the agreement of segmentation results with a trusted reference. Few articles describe measures of clinical validity. CONCLUSIONS The observed reporting practices leave room for improvement with a view to studying replication, method comparison and clinical applicability. To promote this improvement, we propose a list of recommendations for future studies in the field.
Collapse
Affiliation(s)
- Emilia Gryska
- Medical Radiation Sciences, Goteborgs universitet Institutionen for kliniska vetenskaper, Goteborg, Sweden
| | - Justin Schneiderman
- Sektionen för klinisk neurovetenskap, Goteborgs Universitet Institutionen for Neurovetenskap och fysiologi, Goteborg, Sweden
| | | | - Rolf A Heckemann
- Medical Radiation Sciences, Goteborgs universitet Institutionen for kliniska vetenskaper, Goteborg, Sweden
| |
Collapse
|
6
|
Ghribi O, Maalej A, Sellami L, Ben Slima M, Maalej MA, Ben Mahfoudh K, Dammak M, Mhiri C, Ben Hamida A. Advanced methodology for multiple sclerosis lesion exploring: Towards a computer aided diagnosis system. Biomed Signal Process Control 2019. [DOI: 10.1016/j.bspc.2018.12.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
7
|
Danelakis A, Theoharis T, Verganelakis DA. Survey of automated multiple sclerosis lesion segmentation techniques on magnetic resonance imaging. Comput Med Imaging Graph 2018; 70:83-100. [DOI: 10.1016/j.compmedimag.2018.10.002] [Citation(s) in RCA: 55] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2018] [Revised: 09/05/2018] [Accepted: 10/02/2018] [Indexed: 01/18/2023]
|
8
|
Tatano R, Berkels B, Ehrlich EE, Deserno TM, Fritz UB. Spatial agreement of demineralized areas in quantitative light-induced fluorescence images and digital photographs. Dentomaxillofac Radiol 2018; 47:20180099. [PMID: 29851354 DOI: 10.1259/dmfr.20180099] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022] Open
Abstract
OBJECTIVES Previous work has shown qualitatively that detection of demineralized tooth areas (white spot lesions, WSLs) is more reliable in digital photographs (DP) as in quantitative light-induced fluorescence (QLF) images. Based on non-rigid, multimodal image registration, we now quantitatively compare manual and automatic markings in both modalities. METHODS After braces removal, pairs of DP and QLF were acquired from 124 teeth of 31 patients. Three experienced raters marked the WSL on both DP and QLF images, each of which was presented twice in randomized order. For each tooth and each modality, a ground truth (GT) was established using the simultaneous truth and performance level estimation algorithm on the total of six manual markings per image. DP and QLF image pairs were spatially registered, by aligning the outline of the tooth area in DPs to that of the corresponding tooth area in QLF. Between all pairs of markings for all teeth, position and size were compared quantitatively by the Dice coefficient and the novel coefficient of inclusion. RESULTS Our hypotheses: (i) the clinical inspection supported by DP is more sensitive to WSL as that by QLF, disregarding whether the automatic analysis or the experts' manual assessment of QLF is applied, and (ii) detected lesions in QLF are included in those of DP, were confirmed and not confirmed, respectively. CONCLUSION DP and QLF are valuable methods to detect WSL in demineralized teeth. Combining both modalities can provide additional information on early lesion assessment.
Collapse
Affiliation(s)
- Rosalia Tatano
- 1 Aachen Institute for Advanced Study in Computational Engineering Science (AICES), RWTH Aachen University , Aachen , Germany
| | - Benjamin Berkels
- 1 Aachen Institute for Advanced Study in Computational Engineering Science (AICES), RWTH Aachen University , Aachen , Germany
| | - Eva E Ehrlich
- 2 Klinik für Kieferorthopädie, Uniklinik RWTH Aachen , Aachen , Germany
| | - Thomas M Deserno
- 3 Peter L. Reichertz Institute for Medical Informatics, University of Braunschweig - Institute of Technology and Hannover Medical School , Braunschweig , Germany
| | - Ulrike B Fritz
- 2 Klinik für Kieferorthopädie, Uniklinik RWTH Aachen , Aachen , Germany
| |
Collapse
|
9
|
Storelli L, Pagani E, Rocca MA, Horsfield MA, Gallo A, Bisecco A, Battaglini M, De Stefano N, Vrenken H, Thomas DL, Mancini L, Ropele S, Enzinger C, Preziosa P, Filippi M. A Semiautomatic Method for Multiple Sclerosis Lesion Segmentation on Dual-Echo MR Imaging: Application in a Multicenter Context. AJNR Am J Neuroradiol 2016; 37:2043-2049. [PMID: 27444938 DOI: 10.3174/ajnr.a4874] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2016] [Accepted: 05/11/2016] [Indexed: 11/07/2022]
Abstract
BACKGROUND AND PURPOSE The automatic segmentation of MS lesions could reduce time required for image processing together with inter- and intraoperator variability for research and clinical trials. A multicenter validation of a proposed semiautomatic method for hyperintense MS lesion segmentation on dual-echo MR imaging is presented. MATERIALS AND METHODS The classification technique used is based on a region-growing approach starting from manual lesion identification by an expert observer with a final segmentation-refinement step. The method was validated in a cohort of 52 patients with relapsing-remitting MS, with dual-echo images acquired in 6 different European centers. RESULTS We found a mathematic expression that made the optimization of the method independent of the need for a training dataset. The automatic segmentation was in good agreement with the manual segmentation (dice similarity coefficient = 0.62 and root mean square error = 2 mL). Assessment of the segmentation errors showed no significant differences in algorithm performance between the different MR scanner manufacturers (P > .05). CONCLUSIONS The method proved to be robust, and no center-specific training of the algorithm was required, offering the possibility for application in a clinical setting. Adoption of the method should lead to improved reliability and less operator time required for image analysis in research and clinical trials in MS.
Collapse
Affiliation(s)
- L Storelli
- From the Neuroimaging Research Unit (L.S., E.P., M.A.R., P.P., M.F.)
| | - E Pagani
- From the Neuroimaging Research Unit (L.S., E.P., M.A.R., P.P., M.F.)
| | - M A Rocca
- From the Neuroimaging Research Unit (L.S., E.P., M.A.R., P.P., M.F.)
- Institute of Experimental Neurology, Division of Neuroscience, Department of Neurology (M.A.R., P.P., M.F.), San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
| | - M A Horsfield
- Xinapse Systems (M.A.H.), Colchester, United Kingdom
| | - A Gallo
- MRI Center "SUN-FISM" and Institute of Diagnosis and Care "Hermitage-Capodimonte" (A.G., A.B.)
- I Division of Neurology, Department of Medical, Surgical, Neurological, Metabolic and Aging Sciences (A.G., A.B.), Second University of Naples, Naples, Italy
| | - A Bisecco
- MRI Center "SUN-FISM" and Institute of Diagnosis and Care "Hermitage-Capodimonte" (A.G., A.B.)
- I Division of Neurology, Department of Medical, Surgical, Neurological, Metabolic and Aging Sciences (A.G., A.B.), Second University of Naples, Naples, Italy
| | - M Battaglini
- Department of Neurological and Behavioral Sciences (M.B., N.D.S.), University of Siena, Italy
| | - N De Stefano
- Department of Neurological and Behavioral Sciences (M.B., N.D.S.), University of Siena, Italy
| | - H Vrenken
- Department of Radiology and Nuclear Medicine, MS Centre Amsterdam (H.V.), VU Medical Centre, Amsterdam, the Netherlands
| | - D L Thomas
- Neuroradiological Academic Unit (D.L.T., L.M.), UCL Institute of Neurology, London, United Kingdom
| | - L Mancini
- Neuroradiological Academic Unit (D.L.T., L.M.), UCL Institute of Neurology, London, United Kingdom
| | - S Ropele
- Department of Neurology (S.R., C.E.)
| | - C Enzinger
- Department of Neurology (S.R., C.E.)
- Clinical Division of Neuroradiology, Vascular and Interventional Radiology, Department of Radiology (C.E.), Medical University of Graz, Austria
| | - P Preziosa
- From the Neuroimaging Research Unit (L.S., E.P., M.A.R., P.P., M.F.)
- Institute of Experimental Neurology, Division of Neuroscience, Department of Neurology (M.A.R., P.P., M.F.), San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
| | - M Filippi
- From the Neuroimaging Research Unit (L.S., E.P., M.A.R., P.P., M.F.)
- Institute of Experimental Neurology, Division of Neuroscience, Department of Neurology (M.A.R., P.P., M.F.), San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
| |
Collapse
|