1
|
Verma P, Kumar H, Shukla DK, Satpathy S, Alsekait DM, Khalaf OI, Alzoubi A, Alqadi BS, AbdElminaam DS, Kushwaha A, Singh J. V3DQutrit a volumetric medical image segmentation based on 3D qutrit optimized modified tensor ring model. Sci Rep 2025; 15:15785. [PMID: 40328837 DOI: 10.1038/s41598-025-00537-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2024] [Accepted: 04/29/2025] [Indexed: 05/08/2025] Open
Abstract
This paper introduces 3D-QTRNet, a novel quantum-inspired neural network for volumetric medical image segmentation. Unlike conventional CNNs, which suffer from slow convergence and high complexity, and QINNs, which are limited to grayscale segmentation, our approach leverages qutrit encoding and tensor ring decomposition. These techniques improve segmentation accuracy, optimize memory usage, and accelerate model convergence. The proposed model demonstrates superior performance on the BRATS19 and Spleen datasets, outperforming state-of-the-art CNN and quantum models in terms of Dice similarity and segmentation precision. This work bridges the gap between quantum computing and medical imaging, offering a scalable solution for real-world applications.
Collapse
Affiliation(s)
| | - Harish Kumar
- CSE Department, NIT Kurukhetra, Kurukhetra, Hariyana, India
| | | | - Sambit Satpathy
- CSE Department, Galgotias College of Engineering and Technology, Greater Noida, Uttar Pradesh, India
| | - Deema Mohammed Alsekait
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, P.O. Box 84428, 11671, Riyadh, Saudi Arabia.
| | - Osamah Ibrahim Khalaf
- Department of Solar, Al-Nahrain Research Center for Renewable Energy, Al-Nahrain University, Jadriya, Baghdad, Iraq
| | - Ala Alzoubi
- Faculty of Information Technology, Applied Science Private University, Amman, 11931, Jordan
| | - Basma S Alqadi
- Computer Science Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University, Riyadh, Saudi Arabia
| | - Diaa Salama AbdElminaam
- Jadara Research Center, Jadara University, Irbid, 21110, Jordan
- Faculty of Computers and Artificial Inellgence, Benha University, Benha, Egypt
| | - Arvinda Kushwaha
- CSE Department, Galgotias College of Engineering and Technology, Greater Noida, Uttar Pradesh, India
| | | |
Collapse
|
2
|
Konar D, Bhattacharyya S, Gandhi TK, Panigrahi BK, Jiang R. 3-D Quantum-Inspired Self-Supervised Tensor Network for Volumetric Segmentation of Medical Images. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:10312-10325. [PMID: 37022399 DOI: 10.1109/tnnls.2023.3240238] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
This article introduces a novel shallow 3-D self-supervised tensor neural network in quantum formalism for volumetric segmentation of medical images with merits of obviating training and supervision. The proposed network is referred to as the 3-D quantum-inspired self-supervised tensor neural network (3-D-QNet). The underlying architecture of 3-D-QNet is composed of a trinity of volumetric layers, viz., input, intermediate, and output layers interconnected using an S -connected third-order neighborhood-based topology for voxelwise processing of 3-D medical image data, suitable for semantic segmentation. Each of the volumetric layers contains quantum neurons designated by qubits or quantum bits. The incorporation of tensor decomposition in quantum formalism leads to faster convergence of network operations to preclude the inherent slow convergence problems faced by the classical supervised and self-supervised networks. The segmented volumes are obtained once the network converges. The suggested 3-D-QNet is tailored and tested on the BRATS 2019 Brain MR image dataset and the Liver Tumor Segmentation Challenge (LiTS17) dataset extensively in our experiments. The 3-D-QNet has achieved promising dice similarity (DS) as compared with the time-intensive supervised convolutional neural network (CNN)-based models, such as 3-D-UNet, voxelwise residual network (VoxResNet), Dense-Res-Inception Net (DRINet), and 3-D-ESPNet, thereby showing a potential advantage of our self-supervised shallow network on facilitating semantic segmentation.
Collapse
|
3
|
Batool A, Byun YC. Brain tumor detection with integrating traditional and computational intelligence approaches across diverse imaging modalities - Challenges and future directions. Comput Biol Med 2024; 175:108412. [PMID: 38691914 DOI: 10.1016/j.compbiomed.2024.108412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Revised: 03/18/2024] [Accepted: 04/02/2024] [Indexed: 05/03/2024]
Abstract
Brain tumor segmentation and classification play a crucial role in the diagnosis and treatment planning of brain tumors. Accurate and efficient methods for identifying tumor regions and classifying different tumor types are essential for guiding medical interventions. This study comprehensively reviews brain tumor segmentation and classification techniques, exploring various approaches based on image processing, machine learning, and deep learning. Furthermore, our study aims to review existing methodologies, discuss their advantages and limitations, and highlight recent advancements in this field. The impact of existing segmentation and classification techniques for automated brain tumor detection is also critically examined using various open-source datasets of Magnetic Resonance Images (MRI) of different modalities. Moreover, our proposed study highlights the challenges related to segmentation and classification techniques and datasets having various MRI modalities to enable researchers to develop innovative and robust solutions for automated brain tumor detection. The results of this study contribute to the development of automated and robust solutions for analyzing brain tumors, ultimately aiding medical professionals in making informed decisions and providing better patient care.
Collapse
Affiliation(s)
- Amreen Batool
- Department of Electronic Engineering, Institute of Information Science & Technology, Jeju National University, Jeju, 63243, South Korea
| | - Yung-Cheol Byun
- Department of Computer Engineering, Major of Electronic Engineering, Jeju National University, Institute of Information Science Technology, Jeju, 63243, South Korea.
| |
Collapse
|
4
|
Raghavendra U, Gudigar A, Paul A, Goutham TS, Inamdar MA, Hegde A, Devi A, Ooi CP, Deo RC, Barua PD, Molinari F, Ciaccio EJ, Acharya UR. Brain tumor detection and screening using artificial intelligence techniques: Current trends and future perspectives. Comput Biol Med 2023; 163:107063. [PMID: 37329621 DOI: 10.1016/j.compbiomed.2023.107063] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Revised: 05/16/2023] [Accepted: 05/19/2023] [Indexed: 06/19/2023]
Abstract
A brain tumor is an abnormal mass of tissue located inside the skull. In addition to putting pressure on the healthy parts of the brain, it can lead to significant health problems. Depending on the region of the brain tumor, it can cause a wide range of health issues. As malignant brain tumors grow rapidly, the mortality rate of individuals with this cancer can increase substantially with each passing week. Hence it is vital to detect these tumors early so that preventive measures can be taken at the initial stages. Computer-aided diagnostic (CAD) systems, in coordination with artificial intelligence (AI) techniques, have a vital role in the early detection of this disorder. In this review, we studied 124 research articles published from 2000 to 2022. Here, the challenges faced by CAD systems based on different modalities are highlighted along with the current requirements of this domain and future prospects in this area of research.
Collapse
Affiliation(s)
- U Raghavendra
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - Anjan Gudigar
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India.
| | - Aritra Paul
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - T S Goutham
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - Mahesh Anil Inamdar
- Department of Mechatronics, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - Ajay Hegde
- Consultant Neurosurgeon Manipal Hospitals, Sarjapur Road, Bangalore, India
| | - Aruna Devi
- School of Education and Tertiary Access, University of the Sunshine Coast, Caboolture Campus, Australia
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore, 599494, Singapore
| | - Ravinesh C Deo
- School of Mathematics, Physics, and Computing, University of Southern Queensland, Springfield, QLD, 4300, Australia
| | - Prabal Datta Barua
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW, 2010, Australia; School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD, 4350, Australia; Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, 2007, Australia
| | - Filippo Molinari
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129, Torino, Italy
| | - Edward J Ciaccio
- Department of Medicine, Columbia University Medical Center, New York, NY, 10032, USA
| | - U Rajendra Acharya
- School of Mathematics, Physics, and Computing, University of Southern Queensland, Springfield, QLD, 4300, Australia; International Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto, 860-8555, Japan
| |
Collapse
|
5
|
Rana MM, Moon MAM, Hossain MS, Rahman MN, Zehadi MNN, Tithy TA, Hasan MM. Exploring the Effectiveness of Various Machine Learning Algorithms for Detecting Brain Tumors in MRI Images. LECTURE NOTES IN NETWORKS AND SYSTEMS 2023:367-378. [DOI: 10.1007/978-981-99-3878-0_31] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2025]
|
6
|
Leena B, Jayanthi AN. Automatic Brain Tumor Classification via Lion Plus Dragonfly Algorithm. J Digit Imaging 2022; 35:1382-1408. [PMID: 35711072 PMCID: PMC9582188 DOI: 10.1007/s10278-022-00635-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2021] [Revised: 04/01/2022] [Accepted: 04/09/2022] [Indexed: 10/18/2022] Open
Abstract
Denoising, skull stripping, segmentation, feature extraction, and classification are five important processes in this paper's development of a brain tumor classification model. The brain tumor image will be imposed first using the entropy-based trilateral filter to de-noising and this image is imposed to skull stripping by means of morphological partition and Otsu thresholding. Adaptive contrast limited fuzzy adaptive histogram equalization (CLFAHE) is also used in the segmentation process. The gray-level co-occurrence matrix (GLCM) characteristics are derived from the segmented image. The collected GLCM features are used in a hybrid classifier that combines the neural network (NN) and deep belief network (DBN) ideas. As an innovation, the hidden neurons of the two classifiers are modified ideally to improve the prediction model's accuracy. The hidden neurons are optimized using a unique hybrid optimization technique known as lion with dragonfly separation update (L-DSU), which integrates the approaches from both DA and LA. Finally, the suggested model's performance is compared to that of the standard models concerning certain performance measures.
Collapse
Affiliation(s)
- B Leena
- KGiSL Institute of Technology, Coimbatore, India.
| | - A N Jayanthi
- Sri Ramakrishna Institute of Technology, Coimbatore, India
| |
Collapse
|
7
|
Khorasani A, Kafieh R, Saboori M, Tavakoli MB. Glioma segmentation with DWI weighted images, conventional anatomical images, and post-contrast enhancement magnetic resonance imaging images by U-Net. Phys Eng Sci Med 2022; 45:925-934. [PMID: 35997927 DOI: 10.1007/s13246-022-01164-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Accepted: 07/16/2022] [Indexed: 11/24/2022]
Abstract
Glioma segmentation is believed to be one of the most important stages of treatment management. Recent developments in magnetic resonance imaging (MRI) protocols have led to a renewed interest in using automatic glioma segmentation with different MRI image weights. U-Net is a major area of interest within the field of automatic glioma segmentation. This paper examines the impact of different input MRI image-weight on the U-Net output performance for glioma segmentation. One hundred forty-nine glioma patients were scanned with a 1.5T MRI scanner. The main MRI image-weights acquired are diffusion-weighted imaging (DWI) weighted images (b50, b500, b1000, Apparent diffusion coefficient (ADC) map, Exponential apparent diffusion coefficient (eADC) map), anatomical image-weights (T2, T1, T2-FLAIR), and post enhancement image-weights (T1Gd). The U-Net and data augmentation are used to segment the glioma tumors. Having the Dice coefficient and accuracy enabled us to compare our results with the previous study. The first set of analyses examined the impact of epoch number on the accuracy of U-Net, and n_epoch = 20 was selected for U-Net training. The mean Dice coefficient for b50, b500, b1000, ADC map, eADC map, T2, T1, T2-FLAIR, and T1Gd image weights for glioma segmentation with U-Net were calculated 0.892, 0.872, 0.752, 0.931, 0.944, 0.762, 0.721, 0.896, 0.694 respectively. This study has found that, DWI image-weights have a higher diagnostic value for glioma segmentation with U-Net in comparison with anatomical image-weights and post enhancement image-weights. The results of this investigation show that ADC and eADC maps have higher performance for glioma segmentation with U-Net.
Collapse
Affiliation(s)
- Amir Khorasani
- Department of Medical Physics, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Rahele Kafieh
- Medical Image and Signal Processing Research Center, School of Advanced Technologies in Medicine, Isfahan University of Medical Sciences, Isfahan, Iran.,Department of Engineering, Durham University, Durham, UK
| | - Masih Saboori
- Department of Neurosurgery, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Mohamad Bagher Tavakoli
- Department of Medical Physics, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran.
| |
Collapse
|
8
|
Cao J, Lai H, Zhang J, Zhang J, Xie T, Wang H, Bu J, Feng Q, Huang M. 2D-3D cascade network for glioma segmentation in multisequence MRI images using multiscale information. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 221:106894. [PMID: 35613498 DOI: 10.1016/j.cmpb.2022.106894] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/01/2021] [Revised: 04/21/2022] [Accepted: 05/14/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND AND OBJECTIVE Glioma segmentation is an important procedure for the treatment plan and follow-up evaluation of patients with glioma. UNet-based networks are widely used in medical image segmentation tasks and have achieved state-of-the-art performance. However, context information along the third dimension is ignored in 2D convolutions, whereas difference between z-axis and in-plane resolutions is large in 3D convolutions. Moreover, an original UNet structure cannot capture fine details because of the reduced resolution of feature maps near bottleneck layers. METHODS To address these issues, a novel 2D-3D cascade network with multiscale information module is proposed for the multiclass segmentation of gliomas in multisequence MRI images. First, a 2D network is applied to fully exploit potential intra-slice features. A variational autoencoder module is incorporated into 2D DenseUNet to regularize a shared encoder, extract useful information, and represent glioma heterogeneity. Second, we integrated 3D DenseUNet with the 2D network in cascade mode to extract useful inter-slice features and alleviate the influence of large difference between z-axis and in-plane resolutions. Moreover, a multiscale information module is used in the 2D and 3D networks to further capture the fine details of gliomas. Finally, the whole 2D-3D cascade network is trained in an end-to-end manner, where the intra-slice and inter-slice features are fused and optimized jointly to take full advantage of 3D image information. RESULTS Our method is evaluated on publicly available and clinical datasets and achieves competitive performance in these two datasets. CONCLUSIONS These results indicate that the proposed method may be a useful tool for glioma segmentation.
Collapse
Affiliation(s)
- Jianyun Cao
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China; Zhujiang Hospital, Southern Medical University, Guangzhou 510282, China
| | - Haoran Lai
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| | - Jiawei Zhang
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
| | - Junde Zhang
- Zhujiang Hospital, Southern Medical University, Guangzhou 510282, China
| | - Tao Xie
- Zhujiang Hospital, Southern Medical University, Guangzhou 510282, China
| | - Heqing Wang
- Zhujiang Hospital, Southern Medical University, Guangzhou 510282, China
| | - Junguo Bu
- Zhujiang Hospital, Southern Medical University, Guangzhou 510282, China
| | - Qianjin Feng
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou 510515, China.
| | - Meiyan Huang
- School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China; Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, China; Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou 510515, China.
| |
Collapse
|
9
|
Anitha V. An Operative Acute Brain Tumor Recognition by Jointure Inward Unswerving Probabilistic Neural Network Classifier. JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS 2022. [DOI: 10.1166/jmihi.2022.3935] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Brain tumors have to be predicted earlier to avoid the risk of being mortal. For an effective detection an adaptive segmentation with two-tier tumors region extraction is needed. This framework offers preprocessing to avoid noise occurrence by fusing median and wiener filter also utilizes
adaptive pillar C-means algorithm for obtaining the essential feature set thus the processing time is reduced. Thus the attained essential feature sets are then classified by means of unswerving PNN (Probabilistic Neural network) classifier where classification is done twice initially to classify
whether benign or malignant, Sub sequently to classify different sorts of brain tumor such as Astrocytoma, Meningioma, Glioblastoma and Medulloblastoma. Since the non-linearity of PNN due to distance factor consumes more computation time which is tackled by intruding the radial basis function
resulted in LS-SVM (Least Square-Support Vector Machine) as a distance factor which is linear one. Thus computation time is further reduced.
Collapse
Affiliation(s)
- V. Anitha
- Department of Electronics and Communication Engineering, Sri Muthukumaran Institute of Technology, Chikkarayapuram, Near Mangadu, Chennai 600069, Tamil Nadu, India
| |
Collapse
|
10
|
Brain tumor identification and classification of MRI images using data augmented support vector machine. Cogn Neurodyn 2022; 16:973. [PMID: 35847533 PMCID: PMC9279539 DOI: 10.1007/s11571-021-09774-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Revised: 11/26/2021] [Accepted: 12/13/2021] [Indexed: 11/24/2022] Open
|
11
|
Abstract
AbstractBrain tumor occurs owing to uncontrolled and rapid growth of cells. If not treated at an initial phase, it may lead to death. Despite many significant efforts and promising outcomes in this domain, accurate segmentation and classification remain a challenging task. A major challenge for brain tumor detection arises from the variations in tumor location, shape, and size. The objective of this survey is to deliver a comprehensive literature on brain tumor detection through magnetic resonance imaging to help the researchers. This survey covered the anatomy of brain tumors, publicly available datasets, enhancement techniques, segmentation, feature extraction, classification, and deep learning, transfer learning and quantum machine learning for brain tumors analysis. Finally, this survey provides all important literature for the detection of brain tumors with their advantages, limitations, developments, and future trends.
Collapse
|
12
|
Kaur A, Kaur L, Singh A. GA-UNet: UNet-based framework for segmentation of 2D and 3D medical images applicable on heterogeneous datasets. Neural Comput Appl 2021. [DOI: 10.1007/s00521-021-06134-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
|
13
|
Brain Tumor Detection and Classification on MR Images by a Deep Wavelet Auto-Encoder Model. Diagnostics (Basel) 2021; 11:diagnostics11091589. [PMID: 34573931 PMCID: PMC8471235 DOI: 10.3390/diagnostics11091589] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2021] [Revised: 08/18/2021] [Accepted: 08/18/2021] [Indexed: 11/16/2022] Open
Abstract
The process of diagnosing brain tumors is very complicated for many reasons, including the brain's synaptic structure, size, and shape. Machine learning techniques are employed to help doctors to detect brain tumor and support their decisions. In recent years, deep learning techniques have made a great achievement in medical image analysis. This paper proposed a deep wavelet autoencoder model named "DWAE model", employed to divide input data slice as a tumor (abnormal) or no tumor (normal). This article used a high pass filter to show the heterogeneity of the MRI images and their integration with the input images. A high median filter was utilized to merge slices. We improved the output slices' quality through highlight edges and smoothened input MR brain images. Then, we applied the seed growing method based on 4-connected since the thresholding cluster equal pixels with input MR data. The segmented MR image slices provide two two-layer using the proposed deep wavelet auto-encoder model. We then used 200 hidden units in the first layer and 400 hidden units in the second layer. The softmax layer testing and training are performed for the identification of the MR image normal and abnormal. The contribution of the deep wavelet auto-encoder model is in the analysis of pixel pattern of MR brain image and the ability to detect and classify the tumor with high accuracy, short time, and low loss validation. To train and test the overall performance of the proposed model, we utilized 2500 MR brain images from BRATS2012, BRATS2013, BRATS2014, BRATS2015, 2015 challenge, and ISLES, which consists of normal and abnormal images. The experiments results show that the proposed model achieved an accuracy of 99.3%, loss validation of 0.1, low FPR and FNR values. This result demonstrates that the proposed DWAE model can facilitate the automatic detection of brain tumors.
Collapse
|
14
|
Buchlak QD, Esmaili N, Leveque JC, Bennett C, Farrokhi F, Piccardi M. Machine learning applications to neuroimaging for glioma detection and classification: An artificial intelligence augmented systematic review. J Clin Neurosci 2021; 89:177-198. [PMID: 34119265 DOI: 10.1016/j.jocn.2021.04.043] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2020] [Accepted: 04/30/2021] [Indexed: 12/13/2022]
Abstract
Glioma is the most common primary intraparenchymal tumor of the brain and the 5-year survival rate of high-grade glioma is poor. Magnetic resonance imaging (MRI) is essential for detecting, characterizing and monitoring brain tumors but definitive diagnosis still relies on surgical pathology. Machine learning has been applied to the analysis of MRI data in glioma research and has the potential to change clinical practice and improve patient outcomes. This systematic review synthesizes and analyzes the current state of machine learning applications to glioma MRI data and explores the use of machine learning for systematic review automation. Various datapoints were extracted from the 153 studies that met inclusion criteria and analyzed. Natural language processing (NLP) analysis involved keyword extraction, topic modeling and document classification. Machine learning has been applied to tumor grading and diagnosis, tumor segmentation, non-invasive genomic biomarker identification, detection of progression and patient survival prediction. Model performance was generally strong (AUC = 0.87 ± 0.09; sensitivity = 0.87 ± 0.10; specificity = 0.0.86 ± 0.10; precision = 0.88 ± 0.11). Convolutional neural network, support vector machine and random forest algorithms were top performers. Deep learning document classifiers yielded acceptable performance (mean 5-fold cross-validation AUC = 0.71). Machine learning tools and data resources were synthesized and summarized to facilitate future research. Machine learning has been widely applied to the processing of MRI data in glioma research and has demonstrated substantial utility. NLP and transfer learning resources enabled the successful development of a replicable method for automating the systematic review article screening process, which has potential for shortening the time from discovery to clinical application in medicine.
Collapse
Affiliation(s)
- Quinlan D Buchlak
- School of Medicine, The University of Notre Dame Australia, Sydney, NSW, Australia.
| | - Nazanin Esmaili
- School of Medicine, The University of Notre Dame Australia, Sydney, NSW, Australia; Faculty of Engineering and IT, University of Technology Sydney, Ultimo, NSW, Australia
| | | | - Christine Bennett
- School of Medicine, The University of Notre Dame Australia, Sydney, NSW, Australia
| | - Farrokh Farrokhi
- Neuroscience Institute, Virginia Mason Medical Center, Seattle, WA, USA
| | - Massimo Piccardi
- Faculty of Engineering and IT, University of Technology Sydney, Ultimo, NSW, Australia
| |
Collapse
|
15
|
El Kader IA, Xu G, Shuai Z, Saminu S. Brain Tumor Detection and Classification by Hybrid CNN-DWA Model Using MR Images. Curr Med Imaging 2021; 17:1248-1255. [PMID: 33655844 DOI: 10.2174/1573405617666210224113315] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 12/24/2020] [Accepted: 12/29/2020] [Indexed: 11/22/2022]
Abstract
OBJECTIVE Medical image processing is an exciting research area. In this paper, we proposed new brain tumor detection and classification model using MR brain images to help the doctors in early detection and classification of the brain tumor with high performance and best Accuracy. MATERIALS we trained and validated our model using five databases, including BRATS2012, BRATS2013, BRATS2014, BRATS2015, and ISLES-SISS 2015. METHODS The advantage of the hybrid model proposed is its novelty that is used for the first time; our new method is based on a hybrid deep convolution neural network and deep watershed auto-encoder (CNN-DWA) model. The method consists of six phases, first phase is input MR images, second phase is preprocessing using filter and morphology operation, third phase is matrix that represents MR brain images, fourth is applying the hybrid CNN-DWA, fifth is brain tumor classification, and detection, while sixth phase is the performance of the model using five values. RESULTS AND CONCLUSIONS The novelty of our hybrid CNN-DWA model showed the best results and high performance with Accuracy around 98% and loss validation 0, 1. Hybrid model can classify and detect the Tumor clearly using MR images; comparing with other models like CNN, DNN, and DWA, we discover that the proposed model performs better than the above-mentioned models. Depending on the better performance of the proposed hybrid model, this helps in developing computer-aided system for early detection of brain tumors and helps the doctors to diagnose the patients better.
Collapse
Affiliation(s)
- Isselmou Abd El Kader
- Hebei University of Technology, State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Department of Biomedical Engineering, Tianjin 300130. China
| | - Guizhi Xu
- Hebei University of Technology, State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Department of Biomedical Engineering, Tianjin 300130. China
| | - Zhang Shuai
- Hebei University of Technology, State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Department of Biomedical Engineering, Tianjin 300130. China
| | - Sani Saminu
- Hebei University of Technology, State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Department of Biomedical Engineering, Tianjin 300130. China
| |
Collapse
|
16
|
Muhammad K, Khan S, Ser JD, Albuquerque VHCD. Deep Learning for Multigrade Brain Tumor Classification in Smart Healthcare Systems: A Prospective Survey. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:507-522. [PMID: 32603291 DOI: 10.1109/tnnls.2020.2995800] [Citation(s) in RCA: 94] [Impact Index Per Article: 23.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
Brain tumor is one of the most dangerous cancers in people of all ages, and its grade recognition is a challenging problem for radiologists in health monitoring and automated diagnosis. Recently, numerous methods based on deep learning have been presented in the literature for brain tumor classification (BTC) in order to assist radiologists for a better diagnostic analysis. In this overview, we present an in-depth review of the surveys published so far and recent deep learning-based methods for BTC. Our survey covers the main steps of deep learning-based BTC methods, including preprocessing, features extraction, and classification, along with their achievements and limitations. We also investigate the state-of-the-art convolutional neural network models for BTC by performing extensive experiments using transfer learning with and without data augmentation. Furthermore, this overview describes available benchmark data sets used for the evaluation of BTC. Finally, this survey does not only look into the past literature on the topic but also steps on it to delve into the future of this area and enumerates some research directions that should be followed in the future, especially for personalized and smart healthcare.
Collapse
|
17
|
Gryska E, Schneiderman J, Björkman-Burtscher I, Heckemann RA. Automatic brain lesion segmentation on standard magnetic resonance images: a scoping review. BMJ Open 2021; 11:e042660. [PMID: 33514580 PMCID: PMC7849889 DOI: 10.1136/bmjopen-2020-042660] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/11/2020] [Revised: 01/09/2021] [Accepted: 01/12/2021] [Indexed: 12/11/2022] Open
Abstract
OBJECTIVES Medical image analysis practices face challenges that can potentially be addressed with algorithm-based segmentation tools. In this study, we map the field of automatic MR brain lesion segmentation to understand the clinical applicability of prevalent methods and study designs, as well as challenges and limitations in the field. DESIGN Scoping review. SETTING Three databases (PubMed, IEEE Xplore and Scopus) were searched with tailored queries. Studies were included based on predefined criteria. Emerging themes during consecutive title, abstract, methods and whole-text screening were identified. The full-text analysis focused on materials, preprocessing, performance evaluation and comparison. RESULTS Out of 2990 unique articles identified through the search, 441 articles met the eligibility criteria, with an estimated growth rate of 10% per year. We present a general overview and trends in the field with regard to publication sources, segmentation principles used and types of lesions. Algorithms are predominantly evaluated by measuring the agreement of segmentation results with a trusted reference. Few articles describe measures of clinical validity. CONCLUSIONS The observed reporting practices leave room for improvement with a view to studying replication, method comparison and clinical applicability. To promote this improvement, we propose a list of recommendations for future studies in the field.
Collapse
Affiliation(s)
- Emilia Gryska
- Medical Radiation Sciences, Goteborgs universitet Institutionen for kliniska vetenskaper, Goteborg, Sweden
| | - Justin Schneiderman
- Sektionen för klinisk neurovetenskap, Goteborgs Universitet Institutionen for Neurovetenskap och fysiologi, Goteborg, Sweden
| | | | - Rolf A Heckemann
- Medical Radiation Sciences, Goteborgs universitet Institutionen for kliniska vetenskaper, Goteborg, Sweden
| |
Collapse
|
18
|
Bajaj AS, Chouhan U. A Review of Various Machine Learning Techniques for Brain Tumor Detection from MRI Images. Curr Med Imaging 2020; 16:937-945. [PMID: 33081656 DOI: 10.2174/1573405615666190903144419] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2019] [Revised: 07/26/2019] [Accepted: 08/17/2019] [Indexed: 11/22/2022]
Abstract
BACKGROUND This paper endeavors to identify an expedient approach for the detection of the brain tumor in MRI images. The detection of tumor is based on i) review of the machine learning approach for the identification of brain tumor and ii) review of a suitable approach for brain tumor detection. DISCUSSION This review focuses on different imaging techniques such as X-rays, PET, CT- Scan, and MRI. This survey identifies a different approach with better accuracy for tumor detection. This further includes the image processing method. In most applications, machine learning shows better performance than manual segmentation of the brain tumors from MRI images as it is a difficult and time-consuming task. For fast and better computational results, radiology used a different approach with MRI, CT-scan, X-ray, and PET. Furthermore, summarizing the literature, this paper also provides a critical evaluation of the surveyed literature which reveals new facets of research. CONCLUSION The problem faced by the researchers during brain tumor detection techniques and machine learning applications for clinical settings have also been discussed.
Collapse
Affiliation(s)
- Aaishwarya Sanjay Bajaj
- Department of Mathematics, Bioinformatics and Computer Application, (Branch: Computational and Systems Biology), Maulana Azad National Institute of Technology, Bhopal, India
| | - Usha Chouhan
- Department of Mathematics, Bioinformatics and Computer Application, (Branch: Computational and Systems Biology), Maulana Azad National Institute of Technology, Bhopal, India
| |
Collapse
|
19
|
Geetha A, Gomathi N. A robust grey wolf-based deep learning for brain tumour detection in MR images. ACTA ACUST UNITED AC 2020; 65:191-207. [DOI: 10.1515/bmt-2018-0244] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2018] [Accepted: 08/06/2019] [Indexed: 11/15/2022]
Abstract
AbstractIn recent times, the detection of brain tumours has become more common. Generally, a brain tumour is an abnormal mass of tissue where the cells grow uncontrollably and are apparently unregulated by the mechanisms that control cells. A number of techniques have been developed thus far; however, the time needed in a detecting brain tumour is still a challenge in the field of image processing. This article proposes a new accurate detection model. The model includes certain processes such as preprocessing, segmentation, feature extraction and classification. Particularly, two extreme processes such as contrast enhancement and skull stripping are processed under the initial phase. In the segmentation process, we used the fuzzy means clustering (FCM) algorithm. Both the grey co-occurrence matrix (GLCM) as well as the grey-level run-length matrix (GRLM) features were extracted in the feature extraction phase. Moreover, this paper uses a deep belief network (DBN) for classification. The optimized DBN concept is used here, for which grey wolf optimisation (GWO) is used. The proposed model is termed the GW-DBN model. The proposed model compares its performance over other conventional methods in terms of accuracy, specificity, sensitivity, precision, negative predictive value (NPV), the F1Score and Matthews correlation coefficient (MCC), false negative rate (FNR), false positive rate (FPR) and false discovery rate (FDR), and proves the superiority of the proposed work.
Collapse
Affiliation(s)
- A. Geetha
- VelTech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Velachery, Chennai 600042, Tamil Nadu, India
| | - N. Gomathi
- VelTech Dr. Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Avadi, Chennai 600062, Tamil Nadu, India
| |
Collapse
|
20
|
Xia H, Sun W, Song S, Mou X. Md-Net: Multi-scale Dilated Convolution Network for CT Images Segmentation. Neural Process Lett 2020. [DOI: 10.1007/s11063-020-10230-x] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
21
|
Wu S, Li H, Quang D, Guan Y. Three-Plane-assembled Deep Learning Segmentation of Gliomas. Radiol Artif Intell 2020; 2:e190011. [PMID: 32280947 PMCID: PMC7104789 DOI: 10.1148/ryai.2020190011] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2019] [Revised: 10/09/2019] [Accepted: 10/18/2019] [Indexed: 12/15/2022]
Abstract
PURPOSE To design a computational method for automatic brain glioma segmentation of multimodal MRI scans with high efficiency and accuracy. MATERIALS AND METHODS The 2018 Multimodal Brain Tumor Segmentation Challenge (BraTS) dataset was used in this study, consisting of routine clinically acquired preoperative multimodal MRI scans. Three subregions of glioma-the necrotic and nonenhancing tumor core, the peritumoral edema, and the contrast-enhancing tumor-were manually labeled by experienced radiologists. Two-dimensional U-Net models were built using a three-plane-assembled approach to segment three subregions individually (three-region model) or to segment only the whole tumor (WT) region (WT-only model). The term three-plane-assembled means that coronal and sagittal images were generated by reformatting the original axial images. The model performance for each case was evaluated in three classes: enhancing tumor (ET), tumor core (TC), and WT. RESULTS On the internal unseen testing dataset split from the 2018 BraTS training dataset, the proposed models achieved mean Sørensen-Dice scores of 0.80, 0.84, and 0.91, respectively, for ET, TC, and WT. On the BraTS validation dataset, the proposed models achieved mean 95% Hausdorff distances of 3.1 mm, 7.0 mm, and 5.0 mm, respectively, for ET, TC, and WT and mean Sørensen-Dice scores of 0.80, 0.83, and 0.91, respectively, for ET, TC, and WT. On the BraTS testing dataset, the proposed models ranked fourth out of 61 teams. The source code is available at https://github.com/GuanLab/Brain_Glioma. CONCLUSION This deep learning method consistently segmented subregions of brain glioma with high accuracy, efficiency, reliability, and generalization ability on screening images from a large population, and it can be efficiently implemented in clinical practice to assist neuro-oncologists or radiologists. Supplemental material is available for this article. © RSNA, 2020.
Collapse
Affiliation(s)
- Shaocheng Wu
- From the Department of Computational Medicine and Bioinformatics, University of Michigan, 100 Washtenaw Ave, Ann Arbor, MI 48109
| | - Hongyang Li
- From the Department of Computational Medicine and Bioinformatics, University of Michigan, 100 Washtenaw Ave, Ann Arbor, MI 48109
| | - Daniel Quang
- From the Department of Computational Medicine and Bioinformatics, University of Michigan, 100 Washtenaw Ave, Ann Arbor, MI 48109
| | - Yuanfang Guan
- From the Department of Computational Medicine and Bioinformatics, University of Michigan, 100 Washtenaw Ave, Ann Arbor, MI 48109
| |
Collapse
|
22
|
Hamid MAA, Khan NA. Investigation and Classification of MRI Brain Tumors Using Feature Extraction Technique. J Med Biol Eng 2020. [DOI: 10.1007/s40846-020-00510-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
|
23
|
|
24
|
|
25
|
Sharif M, Amin J, Raza M, Yasmin M, Satapathy SC. An integrated design of particle swarm optimization (PSO) with fusion of features for detection of brain tumor. Pattern Recognit Lett 2020. [DOI: 10.1016/j.patrec.2019.11.017] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
26
|
Sharif M, Amin J, Nisar MW, Anjum MA, Muhammad N, Ali Shad S. A unified patch based method for brain tumor detection using features fusion. COGN SYST RES 2020. [DOI: 10.1016/j.cogsys.2019.10.001] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
27
|
Brain Tumor Detection by Using Stacked Autoencoders in Deep Learning. J Med Syst 2019; 44:32. [PMID: 31848728 DOI: 10.1007/s10916-019-1483-2] [Citation(s) in RCA: 45] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2019] [Accepted: 10/14/2019] [Indexed: 10/25/2022]
Abstract
Brain tumor detection depicts a tough job because of its shape, size and appearance variations. In this manuscript, a deep learning model is deployed to predict input slices as a tumor (unhealthy)/non-tumor (healthy). This manuscript employs a high pass filter image to prominent the inhomogeneities field effect of the MR slices and fused with the input slices. Moreover, the median filter is applied to the fused slices. The resultant slices quality is improved with smoothen and highlighted edges of the input slices. After that, based on these slices' intensity, a 4-connected seed growing algorithm is applied, where optimal threshold clusters the similar pixels from the input slices. The segmented slices are then supplied to the fine-tuned two layers proposed stacked sparse autoencoder (SSAE) model. The hyperparameters of the model are selected after extensive experiments. At the first layer, 200 hidden units and at the second layer 400 hidden units are utilized. The testing is performed on the softmax layer for the prediction of the images having tumors and no tumors. The suggested model is trained and checked on BRATS datasets i.e., 2012(challenge and synthetic), 2013, and 2013 Leaderboard, 2014, and 2015 datasets. The presented model is evaluated with a number of performance metrics which demonstrates the improved performance.
Collapse
|
28
|
Differentiation of Recurrence from Radiation Necrosis in Gliomas Based on the Radiomics of Combinational Features and Multimodality MRI Images. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2019; 2019:2893043. [PMID: 31871484 PMCID: PMC6913337 DOI: 10.1155/2019/2893043] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Revised: 10/16/2019] [Accepted: 10/31/2019] [Indexed: 12/30/2022]
Abstract
Purpose To classify radiation necrosis versus recurrence in glioma patients using a radiomics model based on combinational features and multimodality MRI images. Methods Fifty-one glioma patients who underwent radiation treatments after surgery were enrolled in this study. Sixteen patients revealed radiation necrosis while 35 patients showed tumor recurrence during the follow-up period. After treatment, all patients underwent T1-weighted, T1-weighted postcontrast, T2-weighted, and fluid-attenuated inversion recovery scans. A total of 41,284 handcrafted and 24,576 deep features were extracted for each patient. The 0.623 + bootstrap method and the area under the curve (denoted as 0.632 + bootstrap AUC) metric were used to select the features. The stepwise forward method was applied to construct 10 logistic regression models based on different combinations of image features. Results For handcrafted features on multimodality MRI, model 7 with seven features yielded the highest AUC of 0.9624, sensitivity of 0.8497, and specificity of 0.9083 in the validation set. These values were higher than the accuracy of using handcrafted features on single-modality MRI (paired t-test, p < 0.05, except sensitivity). For combined handcrafted and AlexNet features on multimodality MRI, model 6 with six features achieved the highest AUC of 0.9982, sensitivity of 0.9941, and specificity of 0.9755 in the validation set. These values were higher than the accuracy of using handcrafted features on multimodality MRI (paired t-test, p < 0.05). Conclusions Handcrafted and deep features extracted from multimodality MRI images reflecting the heterogeneity of gliomas can provide useful information for glioma necrosis/recurrence classification.
Collapse
|
29
|
Lei T, Jia X, Liu T, Liu S, Meng H, Nandi AK. Adaptive Morphological Reconstruction for Seeded Image Segmentation. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2019; 28:5510-5523. [PMID: 31180855 DOI: 10.1109/tip.2019.2920514] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Morphological reconstruction (MR) is often employed by seeded image segmentation algorithms such as watershed transform and power watershed, as it is able to filter out seeds (regional minima) to reduce over-segmentation. However, the MR might mistakenly filter meaningful seeds that are required for generating accurate segmentation and it is also sensitive to the scale because a single-scale structuring element is employed. In this paper, a novel adaptive morphological reconstruction (AMR) operation is proposed that has three advantages. First, AMR can adaptively filter out useless seeds while preserving meaningful ones. Second, AMR is insensitive to the scale of structuring elements because multiscale structuring elements are employed. Finally, the AMR has two attractive properties: monotonic increasingness and convergence that help seeded segmentation algorithms to achieve a hierarchical segmentation. Experiments clearly demonstrate that the AMR is useful for improving performance of algorithms of seeded image segmentation and seed-based spectral segmentation. Compared to several state-of-the-art algorithms, the proposed algorithms provide better segmentation results requiring less computing time.
Collapse
|
30
|
Gu Z, Cheng J, Fu H, Zhou K, Hao H, Zhao Y, Zhang T, Gao S, Liu J. CE-Net: Context Encoder Network for 2D Medical Image Segmentation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:2281-2292. [PMID: 30843824 DOI: 10.1109/tmi.2019.2903562] [Citation(s) in RCA: 774] [Impact Index Per Article: 129.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
Medical image segmentation is an important step in medical image analysis. With the rapid development of a convolutional neural network in image processing, deep learning has been used for medical image segmentation, such as optic disc segmentation, blood vessel detection, lung segmentation, cell segmentation, and so on. Previously, U-net based approaches have been proposed. However, the consecutive pooling and strided convolutional operations led to the loss of some spatial information. In this paper, we propose a context encoder network (CE-Net) to capture more high-level information and preserve spatial information for 2D medical image segmentation. CE-Net mainly contains three major components: a feature encoder module, a context extractor, and a feature decoder module. We use the pretrained ResNet block as the fixed feature extractor. The context extractor module is formed by a newly proposed dense atrous convolution block and a residual multi-kernel pooling block. We applied the proposed CE-Net to different 2D medical image segmentation tasks. Comprehensive results show that the proposed method outperforms the original U-Net method and other state-of-the-art methods for optic disc segmentation, vessel detection, lung segmentation, cell contour segmentation, and retinal optical coherence tomography layer segmentation.
Collapse
|
31
|
Multi-channeled MR brain image segmentation: A new automated approach combining BAT and clustering technique for better identification of heterogeneous tumors. Biocybern Biomed Eng 2019. [DOI: 10.1016/j.bbe.2019.05.007] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
32
|
Preethi S, Aishwarya P. Combining Wavelet Texture Features and Deep Neural Network for Tumor Detection and Segmentation Over MRI. JOURNAL OF INTELLIGENT SYSTEMS 2019. [DOI: 10.1515/jisys-2017-0090] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
Abstract
A brain tumor is one of the main reasons for death among other kinds of cancer because the brain is a very sensitive, complex, and central portion of the body. Proper and timely diagnosis can prolong the life of a person to some extent. Consequently, in this paper, we have proposed a brain tumor classification scheme on the basis of combining wavelet texture features and deep neural networks (DNNs). Normally, the system comprises four modules: (i) feature extraction, (ii) feature selection, (iii) tumor classification, and (iv) segmentation. Primarily, we eliminate the noise from the image. Then, the feature matrix is produced by combining wavelet texture features [gray-level co-occurrence matrix (GLCM)+wavelet GLCM]. Following that, we select the relevant features with the help of the oppositional flower pollination algorithm (OFPA) because a high number of features are major obstacles for classification. Then, we categorize the brain image based on the selected features using the DNN. After the classification procedure, the projected scheme extracts the tumor region from the tumor images with the help of the possibilistic fuzzy c-means clustering (PFCM) algorithm. The experimentation results show that the proposed system attains the better result associated with the available methods.
Collapse
|
33
|
Pang S, Su Z, Leung S, Nachum IB, Chen B, Feng Q, Li S. Direct automated quantitative measurement of spine by cascade amplifier regression network with manifold regularization. Med Image Anal 2019; 55:103-115. [DOI: 10.1016/j.media.2019.04.012] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2018] [Revised: 02/25/2019] [Accepted: 04/17/2019] [Indexed: 11/30/2022]
|
34
|
Abd-Ellah MK, Awad AI, Khalaf AAM, Hamed HFA. A review on brain tumor diagnosis from MRI images: Practical implications, key achievements, and lessons learned. Magn Reson Imaging 2019; 61:300-318. [PMID: 31173851 DOI: 10.1016/j.mri.2019.05.028] [Citation(s) in RCA: 85] [Impact Index Per Article: 14.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2018] [Revised: 05/20/2019] [Accepted: 05/20/2019] [Indexed: 12/21/2022]
Abstract
The successful early diagnosis of brain tumors plays a major role in improving the treatment outcomes and thus improving patient survival. Manually evaluating the numerous magnetic resonance imaging (MRI) images produced routinely in the clinic is a difficult process. Thus, there is a crucial need for computer-aided methods with better accuracy for early tumor diagnosis. Computer-aided brain tumor diagnosis from MRI images consists of tumor detection, segmentation, and classification processes. Over the past few years, many studies have focused on traditional or classical machine learning techniques for brain tumor diagnosis. Recently, interest has developed in using deep learning techniques for diagnosing brain tumors with better accuracy and robustness. This study presents a comprehensive review of traditional machine learning techniques and evolving deep learning techniques for brain tumor diagnosis. This review paper identifies the key achievements reflected in the performance measurement metrics of the applied algorithms in the three diagnosis processes. In addition, this study discusses the key findings and draws attention to the lessons learned as a roadmap for future research.
Collapse
Affiliation(s)
- Mahmoud Khaled Abd-Ellah
- Electronics and Communications Department, Al-Madina Higher Institute for Engineering and Technology, Giza, Egypt.
| | - Ali Ismail Awad
- Department of Computer Science, Electrical and Space Engineering, Luleå University of Technology, Luleå 97187, Sweden; Faculty of Engineering, Al-Azhar University, P.O. Box 83513, Qena, Egypt.
| | - Ashraf A M Khalaf
- Electronics and Communications Department, Faculty of Engineering, Minia University, Minia, Egypt.
| | - Hesham F A Hamed
- Electronics and Communications Department, Faculty of Engineering, Minia University, Minia, Egypt.
| |
Collapse
|
35
|
An Enhancement of Deep Learning Algorithm for Brain Tumor Segmentation Using Kernel Based CNN with M-SVM. J Med Syst 2019; 43:84. [PMID: 30810822 DOI: 10.1007/s10916-019-1223-7] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2018] [Accepted: 02/21/2019] [Indexed: 01/09/2023]
Abstract
The brain tumor can be created by uncontrollable increase of abnormal cells in tissue of brain and it has two kinds of tumors: one is benign and another one is malignant tumor. The benign brain tumor does not affect the adjacent normal and healthy tissue but the malignant tumor can affect the neighboring tissues of brain that can lead to the death of person. An early detection of brain tumor can be required to protect the survival of patients. Usually, the brain tumor is detected using MRI scanning method. However, the radiologists are not providing the effective tumor segmentation in MRI image due to the irregular shape of tumors and position of tumor in the brain. Accurate brain tumor segmentation is needed to locate the tumor and it is used to give the correct treatment for a patient and it provides the key to the doctor who must execute the surgery for patient. In this paper, a novel deep learning algorithm (kernel based CNN) with M-SVM is presented to segment the tumor automatically and efficiently. This presented work contains several steps that are preprocessing, feature extraction, image classification and tumor segmentation of brain. The MRI image is smoothed and enhanced by Laplacian of Gaussian filtering method (LoG) with Contrast Limited Adaptive Histrogram Equalization (CLAHE) and feature can be extracted from it based on tumor shape position, shape and surface features in brain. Consequently, the image classification is done using M-SVM depending on the selected features. From MRI image, the tumor is segmented with help of kernel based CNN method.. Experimental results of proposed method can show that this presented technique can executes brain tumor segmentation accurately reaching almost 84% in evaluation with existing algorithms.
Collapse
|
36
|
Abstract
The brain tumors, are the most common and aggressive disease, leading to a very short life expectancy in their highest grade. Thus, treatment planning is a key stage to improve the quality of life of patients. Generally, various image techniques such as Computed Tomography (CT), Magnetic Resonance Imaging (MRI) and ultrasound image are used to evaluate the tumor in a brain, lung, liver, breast, prostate…etc. Especially, in this work MRI images are used to diagnose tumor in the brain. However the huge amount of data generated by MRI scan thwarts manual classification of tumor vs non-tumor in a particular time. But it having some limitation (i.e) accurate quantitative measurements is provided for limited number of images. Hence trusted and automatic classification scheme are essential to prevent the death rate of human. The automatic brain tumor classification is very challenging task in large spatial and structural variability of surrounding region of brain tumor. In this work, automatic brain tumor detection is proposed by using Convolutional Neural Networks (CNN) classification. The deeper architecture design is performed by using small kernels. The weight of the neuron is given as small. Experimental results show that the CNN archives rate of 97.5% accuracy with low complexity and compared with the all other state of arts methods.
Collapse
Affiliation(s)
- J. Seetha
- Department of Computer Science and Engineering, Sathyabama University, Chennai, India
| | - S. Selvakumar Raja
- Kakatiya Institute of Tech and Science for Women, Nizamabad-503 003. Telangana, India
| |
Collapse
|
37
|
黄 奕, 冯 前. [Segmentation of brain tumor on magnetic resonance images using 3D full-convolutional densely connected convolutional networks]. NAN FANG YI KE DA XUE XUE BAO = JOURNAL OF SOUTHERN MEDICAL UNIVERSITY 2018; 38:661-668. [PMID: 29997087 PMCID: PMC6765705 DOI: 10.3969/j.issn.1673-4254.2018.06.04] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 11/15/2017] [Indexed: 06/08/2023]
Abstract
Accurate segmentation of multiple gliomas from multimodal MRI is a prerequisite for many precision medical procedures. To effectively use the characteristics of glioma MRI and im-prove the segmentation accuracy, we proposes a multi-Dice loss function structure and used pre-experiments to select the good hyperparameters (i.e. data dimension, image fusion step, and the implementation of loss function) to construct a 3D full convolution DenseNet-based image feature learning network. This study included 274 segmented training sets of glioma MRI and 110 test sets without segmentation. After grayscale normalization of the image, the 3D image block was extracted as a network input, and the network output used the image block fusion method to obtain the final segmentation result. The proposed structure improved the accuracy of glioma segmentation compared to a general structure. In the on-line assessment of the open BraTS2015 data set, the Dice values for the entire tumor area, tumor core area, and enhanced tumor area were 0.85, 0.71, and 0.63, respectively.
Collapse
Affiliation(s)
- 奕晖 黄
- 南方医科大学生物医学工程学院//School of Biomedical Engineering
- 广东省医学图像处理重点实验室,广东 广州 510515GuangdongProvincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, China
| | - 前进 冯
- 南方医科大学生物医学工程学院//School of Biomedical Engineering
- 广东省医学图像处理重点实验室,广东 广州 510515GuangdongProvincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, China
| |
Collapse
|
38
|
Herskovits EH. Brain tumor image segmentation using kernel dictionary learning. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2018; 2015:658-61. [PMID: 26736348 DOI: 10.1109/embc.2015.7318448] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Automated brain tumor image segmentation with high accuracy and reproducibility holds a big potential to enhance the current clinical practice. Dictionary learning (DL) techniques have been applied successfully to various image processing tasks recently. In this work, kernel extensions of the DL approach are adopted. Both reconstructive and discriminative versions of the kernel DL technique are considered, which can efficiently incorporate multi-modal nonlinear feature mappings based on the kernel trick. Our novel discriminative kernel DL formulation allows joint learning of a task-driven kernel-based dictionary and a linear classifier using a K-SVD-type algorithm. The proposed approaches were tested using real brain magnetic resonance (MR) images of patients with high-grade glioma. The obtained preliminary performances are competitive with the state of the art. The discriminative kernel DL approach is seen to reduce computational burden without much sacrifice in performance.
Collapse
|
39
|
Ilunga–Mbuyamba E, Avina–Cervantes JG, Cepeda–Negrete J, Ibarra–Manzano MA, Chalopin C. Automatic selection of localized region-based active contour models using image content analysis applied to brain tumor segmentation. Comput Biol Med 2017; 91:69-79. [DOI: 10.1016/j.compbiomed.2017.10.003] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2017] [Revised: 10/05/2017] [Accepted: 10/05/2017] [Indexed: 11/30/2022]
|
40
|
Lakshmi A, Arivoli T, Pallikonda Rajasekaran M. A Novel M-ACA-Based Tumor Segmentation and DAPP Feature Extraction with PPCSO-PKC-Based MRI Classification. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2017. [DOI: 10.1007/s13369-017-2966-4] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
41
|
A professional estimate on the computed tomography brain tumor images using SVM-SMO for classification and MRG-GWO for segmentation. Pattern Recognit Lett 2017. [DOI: 10.1016/j.patrec.2017.03.026] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
42
|
Low-Grade Glioma Segmentation Based on CNN with Fully Connected CRF. JOURNAL OF HEALTHCARE ENGINEERING 2017; 2017:9283480. [PMID: 29065666 PMCID: PMC5485483 DOI: 10.1155/2017/9283480] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/04/2016] [Revised: 02/21/2017] [Accepted: 03/20/2017] [Indexed: 11/17/2022]
Abstract
This work proposed a novel automatic three-dimensional (3D) magnetic resonance imaging (MRI) segmentation method which would be widely used in the clinical diagnosis of the most common and aggressive brain tumor, namely, glioma. The method combined a multipathway convolutional neural network (CNN) and fully connected conditional random field (CRF). Firstly, 3D information was introduced into the CNN which makes more accurate recognition of glioma with low contrast. Then, fully connected CRF was added as a postprocessing step which purposed more delicate delineation of glioma boundary. The method was applied to T2flair MRI images of 160 low-grade glioma patients. With 59 cases of data training and manual segmentation as the ground truth, the Dice similarity coefficient (DSC) of our method was 0.85 for the test set of 101 MRI images. The results of our method were better than those of another state-of-the-art CNN method, which gained the DSC of 0.76 for the same dataset. It proved that our method could produce better results for the segmentation of low-grade gliomas.
Collapse
|
43
|
Pei L, Reza SMS, Li W, Davatzikos C, Iftekharuddin KM. Improved brain tumor segmentation by utilizing tumor growth model in longitudinal brain MRI. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2017; 10134:101342L. [PMID: 28642629 PMCID: PMC5476314 DOI: 10.1117/12.2254034] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
In this work, we propose a novel method to improve texture based tumor segmentation by fusing cell density patterns that are generated from tumor growth modeling. In order to model tumor growth, we solve the reaction-diffusion equation by using Lattice-Boltzmann method (LBM). Computational tumor growth modeling obtains the cell density distribution that potentially indicates the predicted tissue locations in the brain over time. The density patterns is then considered as novel features along with other texture (such as fractal, and multifractal Brownian motion (mBm)), and intensity features in MRI for improved brain tumor segmentation. We evaluate the proposed method with about one hundred longitudinal MRI scans from five patients obtained from public BRATS 2015 data set, validated by the ground truth. The result shows significant improvement of complete tumor segmentation using ANOVA analysis for five patients in longitudinal MR images.
Collapse
Affiliation(s)
- Linmin Pei
- Vision Lab, Electrical & Computer Engineering, Old Dominion University
| | - Syed M S Reza
- Vision Lab, Electrical & Computer Engineering, Old Dominion University
| | - Wei Li
- Department of Mathematics & Statistics, Old Dominion University
| | | | | |
Collapse
|
44
|
Singh NP, Dixit S, Akshaya AS, Khodanpur BI. Gradient Magnitude Based Watershed Segmentation for Brain Tumor Segmentation and Classification. ADVANCES IN INTELLIGENT SYSTEMS AND COMPUTING 2017. [DOI: 10.1007/978-981-10-3156-4_65] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/11/2023]
|
45
|
Liu Y, Stojadinovic S, Hrycushko B, Wardak Z, Lu W, Yan Y, Jiang SB, Timmerman R, Abdulrahman R, Nedzi L, Gu X. Automatic metastatic brain tumor segmentation for stereotactic radiosurgery applications. Phys Med Biol 2016; 61:8440-8461. [PMID: 27845915 DOI: 10.1088/0031-9155/61/24/8440] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Abstract
The objective of this study is to develop an automatic segmentation strategy for efficient and accurate metastatic brain tumor delineation on contrast-enhanced T1-weighted (T1c) magnetic resonance images (MRI) for stereotactic radiosurgery (SRS) applications. The proposed four-step automatic brain metastases segmentation strategy is comprised of pre-processing, initial contouring, contour evolution, and contour triage. First, T1c brain images are preprocessed to remove the skull. Second, an initial tumor contour is created using a multi-scaled adaptive threshold-based bounding box and a super-voxel clustering technique. Third, the initial contours are evolved to the tumor boundary using a regional active contour technique. Fourth, all detected false-positive contours are removed with geometric characterization. The segmentation process was validated on a realistic virtual phantom containing Gaussian or Rician noise. For each type of noise distribution, five different noise levels were tested. Twenty-one cases from the multimodal brain tumor image segmentation (BRATS) challenge dataset and fifteen clinical metastases cases were also included in validation. Segmentation performance was quantified by the Dice coefficient (DC), normalized mutual information (NMI), structural similarity (SSIM), Hausdorff distance (HD), mean value of surface-to-surface distance (MSSD) and standard deviation of surface-to-surface distance (SDSSD). In the numerical phantom study, the evaluation yielded a DC of 0.98 ± 0.01, an NMI of 0.97 ± 0.01, an SSIM of 0.999 ± 0.001, an HD of 2.2 ± 0.8 mm, an MSSD of 0.1 ± 0.1 mm, and an SDSSD of 0.3 ± 0.1 mm. The validation on the BRATS data resulted in a DC of 0.89 ± 0.08, which outperform the BRATS challenge algorithms. Evaluation on clinical datasets gave a DC of 0.86 ± 0.09, an NMI of 0.80 ± 0.11, an SSIM of 0.999 ± 0.001, an HD of 8.8 ± 12.6 mm, an MSSD of 1.5 ± 3.2 mm, and an SDSSD of 1.8 ± 3.4 mm when comparing to the physician drawn ground truth. The result indicated that the developed automatic segmentation strategy yielded accurate brain tumor delineation and presented as a useful clinical tool for SRS applications.
Collapse
Affiliation(s)
- Yan Liu
- College of Electrical Engineering and Information Technology, Sichuan University, Chengdu 610065, People's Republic of China. Department of Radiation Oncology, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
46
|
Vorontsov E, Tang A, Roy D, Pal CJ, Kadoury S. Metastatic liver tumour segmentation with a neural network-guided 3D deformable model. Med Biol Eng Comput 2016; 55:127-139. [DOI: 10.1007/s11517-016-1495-8] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2015] [Accepted: 03/24/2016] [Indexed: 01/08/2023]
|
47
|
Multimodal brain-tumor segmentation based on Dirichlet process mixture model with anisotropic diffusion and Markov random field prior. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2014; 2014:717206. [PMID: 25254064 PMCID: PMC4164260 DOI: 10.1155/2014/717206] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/14/2014] [Revised: 07/15/2014] [Accepted: 08/01/2014] [Indexed: 11/24/2022]
Abstract
Brain-tumor segmentation is an important clinical requirement for brain-tumor diagnosis and radiotherapy planning. It is well-known that the number of clusters is one of the most important parameters for automatic segmentation. However, it is difficult to define owing to the high diversity in appearance of tumor tissue among different patients and the ambiguous boundaries of lesions. In this study, a nonparametric mixture of Dirichlet process (MDP) model is applied to segment the tumor images, and the MDP segmentation can be performed without the initialization of the number of clusters. Because the classical MDP segmentation cannot be applied for real-time diagnosis, a new nonparametric segmentation algorithm combined with anisotropic diffusion and a Markov random field (MRF) smooth constraint is proposed in this study. Besides the segmentation of single modal brain-tumor images, we developed the algorithm to segment multimodal brain-tumor images by the magnetic resonance (MR) multimodal features and obtain the active tumor and edema in the same time. The proposed algorithm is evaluated using 32 multimodal MR glioma image sequences, and the segmentation results are compared with other approaches. The accuracy and computation time of our algorithm demonstrates very impressive performance and has a great potential for practical real-time clinical use.
Collapse
|