51
|
MR image normalization dilemma and the accuracy of brain tumor classification model. JOURNAL OF RADIATION RESEARCH AND APPLIED SCIENCES 2022. [DOI: 10.1016/j.jrras.2022.05.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
52
|
Haq EU, Jianjun H, Huarong X, Li K, Weng L. A Hybrid Approach Based on Deep CNN and Machine Learning Classifiers for the Tumor Segmentation and Classification in Brain MRI. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:6446680. [PMID: 36035291 PMCID: PMC9400402 DOI: 10.1155/2022/6446680] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/13/2022] [Revised: 04/13/2022] [Accepted: 04/20/2022] [Indexed: 11/17/2022]
Abstract
Conventional medical imaging and machine learning techniques are not perfect enough to correctly segment the brain tumor in MRI as the proper identification and segmentation of tumor borders are one of the most important criteria of tumor extraction. The existing approaches are time-consuming, incursive, and susceptible to human mistake. These drawbacks highlight the importance of developing a completely automated deep learning-based approach for segmentation and classification of brain tumors. The expedient and prompt segmentation and classification of a brain tumor are critical for accurate clinical diagnosis and adequately treatment. As a result, deep learning-based brain tumor segmentation and classification algorithms are extensively employed. In the deep learning-based brain tumor segmentation and classification technique, the CNN model has an excellent brain segmentation and classification effect. In this work, an integrated and hybrid approach based on deep convolutional neural network and machine learning classifiers is proposed for the accurate segmentation and classification of brain MRI tumor. A CNN is proposed in the first stage to learn the feature map from image space of brain MRI into the tumor marker region. In the second step, a faster region-based CNN is developed for the localization of tumor region followed by region proposal network (RPN). In the last step, a deep convolutional neural network and machine learning classifiers are incorporated in series in order to further refine the segmentation and classification process to obtain more accurate results and findings. The proposed model's performance is assessed based on evaluation metrics extensively used in medical image processing. The experimental results validate that the proposed deep CNN and SVM-RBF classifier achieved an accuracy of 98.3% and a dice similarity coefficient (DSC) of 97.8% on the task of classifying brain tumors as gliomas, meningioma, or pituitary using brain dataset-1, while on Figshare dataset, it achieved an accuracy of 98.0% and a DSC of 97.1% on classifying brain tumors as gliomas, meningioma, or pituitary. The segmentation and classification results demonstrate that the proposed model outperforms state-of-the-art techniques by a significant margin.
Collapse
Affiliation(s)
- Ejaz Ul Haq
- Guangdong Key Laboratory of Intelligent Information Processing, School of Electronics and Information Engineering, Shenzhen University, China
- School of Computer and Information Engineering, Xiamen University of Technology, China
| | - Huang Jianjun
- Guangdong Key Laboratory of Intelligent Information Processing, School of Electronics and Information Engineering, Shenzhen University, China
| | - Xu Huarong
- School of Computer and Information Engineering, Xiamen University of Technology, China
| | - Kang Li
- Guangdong Key Laboratory of Intelligent Information Processing, School of Electronics and Information Engineering, Shenzhen University, China
| | - Lifen Weng
- School of Computer and Information Engineering, Xiamen University of Technology, China
| |
Collapse
|
53
|
Almalki YE, Ali MU, Kallu KD, Masud M, Zafar A, Alduraibi SK, Irfan M, Basha MAA, Alshamrani HA, Alduraibi AK, Aboualkheir M. Isolated Convolutional-Neural-Network-Based Deep-Feature Extraction for Brain Tumor Classification Using Shallow Classifier. Diagnostics (Basel) 2022; 12:diagnostics12081793. [PMID: 35892504 PMCID: PMC9331664 DOI: 10.3390/diagnostics12081793] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2022] [Revised: 07/13/2022] [Accepted: 07/21/2022] [Indexed: 11/29/2022] Open
Abstract
In today’s world, a brain tumor is one of the most serious diseases. If it is detected at an advanced stage, it might lead to a very limited survival rate. Therefore, brain tumor classification is crucial for appropriate therapeutic planning to improve patient life quality. This research investigates a deep-feature-trained brain tumor detection and differentiation model using classical/linear machine learning classifiers (MLCs). In this study, transfer learning is used to obtain deep brain magnetic resonance imaging (MRI) scan features from a constructed convolutional neural network (CNN). First, multiple layers (19, 22, and 25) of isolated CNNs are constructed and trained to evaluate the performance. The developed CNN models are then utilized for training the multiple MLCs by extracting deep features via transfer learning. The available brain MRI datasets are employed to validate the proposed approach. The deep features of pre-trained models are also extracted to evaluate and compare their performance with the proposed approach. The proposed CNN deep-feature-trained support vector machine model yielded higher accuracy than other commonly used pre-trained deep-feature MLC training models. The presented approach detects and distinguishes brain tumors with 98% accuracy. It also has a good classification rate (97.2%) for an unknown dataset not used to train the model. Following extensive testing and analysis, the suggested technique might be helpful in assisting doctors in diagnosing brain tumors.
Collapse
Affiliation(s)
- Yassir Edrees Almalki
- Division of Radiology, Department of Internal Medicine, Medical College, Najran University, Najran 61441, Saudi Arabia;
| | - Muhammad Umair Ali
- Department of Unmanned Vehicle Engineering, Sejong University, Seoul 05006, Korea;
| | - Karam Dad Kallu
- Department of Robotics and Intelligent Machine Engineering (RIME), School of Mechanical and Manufacturing Engineering (SMME), National University of Sciences and Technology (NUST) H−12, Islamabad 44000, Pakistan;
| | - Manzar Masud
- Department of Mechanical Engineering, Capital University of Science and Technology (CUST), Islamabad 44000, Pakistan;
| | - Amad Zafar
- Department of Electrical Engineering, The Ibadat International University, Islamabad 54590, Pakistan
- Correspondence:
| | - Sharifa Khalid Alduraibi
- Department of Radiology, College of Medicine, Qassim University, Buraidah 52571, Saudi Arabia; (S.K.A.); (A.K.A.)
| | - Muhammad Irfan
- Electrical Engineering Department, College of Engineering, Najran University, Najran 61441, Saudi Arabia;
| | | | - Hassan A. Alshamrani
- Radiological Sciences Department, College of Applied Medical Sciences, Najran University, Najran 61441, Saudi Arabia;
| | - Alaa Khalid Alduraibi
- Department of Radiology, College of Medicine, Qassim University, Buraidah 52571, Saudi Arabia; (S.K.A.); (A.K.A.)
| | - Mervat Aboualkheir
- Department of Radiology and Medical Imaging, College of Medicine, Taibah University, Madinah 42353, Saudi Arabia;
| |
Collapse
|
54
|
Almalki YE, Ali MU, Ahmed W, Kallu KD, Zafar A, Alduraibi SK, Irfan M, Basha MAA, Alshamrani HA, Alduraibi AK. Robust Gaussian and Nonlinear Hybrid Invariant Clustered Features Aided Approach for Speeded Brain Tumor Diagnosis. LIFE (BASEL, SWITZERLAND) 2022; 12:life12071084. [PMID: 35888172 PMCID: PMC9315657 DOI: 10.3390/life12071084] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Revised: 07/14/2022] [Accepted: 07/17/2022] [Indexed: 11/16/2022]
Abstract
Brain tumors reduce life expectancy due to the lack of a cure. Moreover, their diagnosis involves complex and costly procedures such as magnetic resonance imaging (MRI) and lengthy, careful examination to determine their severity. However, the timely diagnosis of brain tumors in their early stages may save a patient's life. Therefore, this work utilizes MRI with a machine learning approach to diagnose brain tumor severity (glioma, meningioma, no tumor, and pituitary) in a timely manner. MRI Gaussian and nonlinear scale features are extracted due to their robustness over rotation, scaling, and noise issues, which are common in image processing features such as texture, local binary patterns, histograms of oriented gradient, etc. For the features, each MRI is broken down into multiple small 8 × 8-pixel MR images to capture small details. To counter memory issues, the strongest features based on variance are selected and segmented into 400 Gaussian and 400 nonlinear scale features, and these features are hybridized against each MRI. Finally, classical machine learning classifiers are utilized to check the performance of the proposed hybrid feature vector. An available online brain MRI image dataset is utilized to validate the proposed approach. The results show that the support vector machine-trained model has the highest classification accuracy of 95.33%, with a low computational time. The results are also compared with the recent literature, which shows that the proposed model can be helpful for clinicians/doctors for the early diagnosis of brain tumors.
Collapse
Affiliation(s)
- Yassir Edrees Almalki
- Division of Radiology, Department of Internal Medicine, Medical College, Najran University, Najran 61441, Saudi Arabia;
| | - Muhammad Umair Ali
- Department of Unmanned Vehicle Engineering, Sejong University, Seoul 05006, Korea;
| | - Waqas Ahmed
- Secret Minds, Entrepreneurial Organization, Islamabad 44000, Pakistan;
| | - Karam Dad Kallu
- Department of Robotics and Intelligent Machine Engineering (RIME), School of Mechanical and Manufacturing Engineering (SMME), National University of Sciences and Technology (NUST), H-12, Islamabad 44000, Pakistan;
| | - Amad Zafar
- Department of Electrical Engineering, The Ibadat International University, Islamabad 54590, Pakistan
- Correspondence:
| | - Sharifa Khalid Alduraibi
- Department of Radiology, College of Medicine, Qassim University, Buraidah 52571, Saudi Arabia; (S.K.A.); (A.K.A.)
| | - Muhammad Irfan
- Electrical Engineering Department, College of Engineering, Najran University, Najran 61441, Saudi Arabia;
| | | | - Hassan A. Alshamrani
- Radiological Sciences Department, College of Applied Medical Sciences, Najran University, Najran 61441, Saudi Arabia;
| | - Alaa Khalid Alduraibi
- Department of Radiology, College of Medicine, Qassim University, Buraidah 52571, Saudi Arabia; (S.K.A.); (A.K.A.)
| |
Collapse
|
55
|
Arivazhagan N, Venkatesh J, Somasundaram K, Vijayalakshmi K, Priya SS, Suresh Thangakrishnan M, Senthamilselvan K, Lakshmi Dhevi B, Vijendra Babu D, Chandragandhi S, Ashine Chamato F. An Improved Machine Learning Model for Diagnostic Cancer Recognition Using Artificial Intelligence. EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE : ECAM 2022; 2022:1078056. [PMID: 35845582 PMCID: PMC9283038 DOI: 10.1155/2022/1078056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/18/2022] [Accepted: 05/10/2022] [Indexed: 12/02/2022]
Abstract
In the medical field, some specialized applications are currently being used to treat various ailments. These activities are being carried out with extra care, especially for cancer patients. Physicians are seeking the help of technology to help diagnose cancer, its dosage, its current status, cancer classification, and appropriate treatment. The machine learning method developed by an artificial intelligence is proposed here in order to effectively assist the doctors in that regard. Its design methods obtain highly complex cancerous inputs and clearly describe its type and dosage. It is also recommending the effects of cancer and appropriate medical procedures to the doctors. This method ensures that a lot of doctors' time is saved. In a saturation point, the proposed model achieved 93.31% of image recognition, 6.69% of image rejection, 94.22% accuracy, 92.42% of precision, 93.94% of recall rate, 92.6% of F1-score, and 2178 ms of computational speed. This shows that the proposed model performs well while compared with the existing methods.
Collapse
Affiliation(s)
- N. Arivazhagan
- Department of Computational Intelligence, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur 603203, India
| | - J. Venkatesh
- Department of Computer Science and Engineering, Chennai Institute of Technology, Kundrathur, Chennai 600069, Tamilnadu, India
| | - K. Somasundaram
- Institute of Information of Technology, Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Chennai 602105, Tamilnadu, India
| | - K. Vijayalakshmi
- Department of CSE, Ramco Institute of Technology, Rajapalayam, Tamilnadu, India
| | - S. Sathiya Priya
- Department of Electronics and Communication Engineering, Panimalar Institute of Technology, Chennai, Tamilnadu, India
| | - M. Suresh Thangakrishnan
- Department of Computer Science and Engineering, Einstein College of Engineering, Tirunelveli 627012, Tamilnadu, India
| | - K. Senthamilselvan
- Department of Electronics and communication Engineering, Prince Shri Venkateshwara Padmavathy Engineering College, Ponmar, Chennai, Tamilnadu, India
| | - B. Lakshmi Dhevi
- Institute of Artificial Intelligence and Machine Learning, Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Chennai 602105, Tamilnadu, India
| | - D. Vijendra Babu
- Department of Electronics and Communication Engineering, Aarupadai Veedu Institute of Technology, Vinayaka Mission's Research Foundation, Chennai, Tamilnadu, India
| | - S. Chandragandhi
- AP/CSE, JCT College of Engineering and Technology, Pichanur, Tamilnadu, India
| | - Fekadu Ashine Chamato
- Department of Chemical Engineering, College of Biological and Chemical Engineering, Addis Ababa Science and Technology University, Addis Ababa, Ethiopia
| |
Collapse
|
56
|
Kouli O, Hassane A, Badran D, Kouli T, Hossain-Ibrahim K, Steele JD. Automated brain tumour identification using magnetic resonance imaging: a systematic review and meta-analysis. Neurooncol Adv 2022; 4:vdac081. [PMID: 35769411 PMCID: PMC9234754 DOI: 10.1093/noajnl/vdac081] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
Background Automated brain tumor identification facilitates diagnosis and treatment planning. We evaluate the performance of traditional machine learning (TML) and deep learning (DL) in brain tumor detection and segmentation, using MRI. Methods A systematic literature search from January 2000 to May 8, 2021 was conducted. Study quality was assessed using the Checklist for Artificial Intelligence in Medical Imaging (CLAIM). Detection meta-analysis was performed using a unified hierarchical model. Segmentation studies were evaluated using a random effects model. Sensitivity analysis was performed for externally validated studies. Results Of 224 studies included in the systematic review, 46 segmentation and 38 detection studies were eligible for meta-analysis. In detection, DL achieved a lower false positive rate compared to TML; 0.018 (95% CI, 0.011 to 0.028) and 0.048 (0.032 to 0.072) (P < .001), respectively. In segmentation, DL had a higher dice similarity coefficient (DSC), particularly for tumor core (TC); 0.80 (0.77 to 0.83) and 0.63 (0.56 to 0.71) (P < .001), persisting on sensitivity analysis. Both manual and automated whole tumor (WT) segmentation had “good” (DSC ≥ 0.70) performance. Manual TC segmentation was superior to automated; 0.78 (0.69 to 0.86) and 0.64 (0.53 to 0.74) (P = .014), respectively. Only 30% of studies reported external validation. Conclusions The comparable performance of automated to manual WT segmentation supports its integration into clinical practice. However, manual outperformance for sub-compartmental segmentation highlights the need for further development of automated methods in this area. Compared to TML, DL provided superior performance for detection and sub-compartmental segmentation. Improvements in the quality and design of studies, including external validation, are required for the interpretability and generalizability of automated models.
Collapse
Affiliation(s)
- Omar Kouli
- School of Medicine, University of Dundee , Dundee UK
- NHS Greater Glasgow and Clyde , Dundee UK
| | | | | | - Tasnim Kouli
- School of Medicine, University of Dundee , Dundee UK
| | | | - J Douglas Steele
- Division of Imaging Science and Technology, School of Medicine, University of Dundee , UK
| |
Collapse
|
57
|
El Kader IA, Xu G, Shuai Z, Brahim EMS, Saminu S. An Efficient Convolutional Neural Network Model for Brain MRI Segmentation. WSEAS TRANSACTIONS ON BIOLOGY AND BIOMEDICINE 2022; 19:77-84. [DOI: 10.37394/23208.2022.19.10] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
Abstract
Medical image analysis is a very interesting research area, and it is a significant challenge for researchers. Due to the complexity of the brain structure, accurate diagnosis of brain tumors is extremely difficult. In recent years, research focused on medical image processing to solve this problem by relying on deep learning techniques, and it has achieved good results in this field. This paper proposes an efficient convolutional neural network model for MR brain image segmentation and analysis. The novel model consists of segmentation efficient-CNN and pre-efficient-CNN blocks for dataset diminution and improvement blocks. The unique efficient-CNN is specially designed according to the model proposed by ASCNN (application) CNN-specific) to perform unidirectional and transverse feature extraction and tumor and pixel classification. The recommended Full-ReLU activation feature halves the number of cores in a high-coil filtered winding layer without reducing process quality. In this specific efficient-CNN consists of 8 convolutional layers and 110 kernels. The experiment results were done using the MR brain database from the Arizona university, including eluding with and without tumor images. The proposal model achieved an accuracy of 97.2% to 98%, which proves the efficiency of the model and its ability to assist in the early diagnosis of brain tumors with sufficient accuracy to support the doctors' decision during diagnosis.
Collapse
Affiliation(s)
- Isselmou Abd El Kader
- School of Health Science and Biomedical Engineering, Hebei University of Technology. Tianjin City, CHINA
| | - Guizhi Xu
- School of Health Science and Biomedical Engineering, Hebei University of Technology. Tianjin City, CHINA
| | - Zhang Shuai
- School of Health Science and Biomedical Engineering, Hebei University of Technology. Tianjin City, CHINA
| | | | - Sani Saminu
- School of Health Science and Biomedical Engineering, Hebei University of Technology. Tianjin City, CHINA
| |
Collapse
|
58
|
A New Model for Brain Tumor Detection Using Ensemble Transfer Learning and Quantum Variational Classifier. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:3236305. [PMID: 35463245 PMCID: PMC9023211 DOI: 10.1155/2022/3236305] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/28/2021] [Revised: 02/03/2022] [Accepted: 03/14/2022] [Indexed: 12/14/2022]
Abstract
A brain tumor is an abnormal enlargement of cells if not properly diagnosed. Early detection of a brain tumor is critical for clinical practice and survival rates. Brain tumors arise in a variety of shapes, sizes, and features, with variable treatment options. Manual detection of tumors is difficult, time-consuming, and error-prone. Therefore, a significant requirement for computerized diagnostics systems for accurate brain tumor detection is present. In this research, deep features are extracted from the inceptionv3 model, in which score vector is acquired from softmax and supplied to the quantum variational classifier (QVR) for discrimination between glioma, meningioma, no tumor, and pituitary tumor. The classified tumor images have been passed to the proposed Seg-network where the actual infected region is segmented to analyze the tumor severity level. The outcomes of the reported research have been evaluated on three benchmark datasets such as Kaggle, 2020-BRATS, and local collected images. The model achieved greater than 90% detection scores to prove the proposed model's effectiveness.
Collapse
|
59
|
A Novel Data Augmentation-Based Brain Tumor Detection Using Convolutional Neural Network. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12083773] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Brain tumor is a severe cancer and a life-threatening disease. Thus, early detection is crucial in the process of treatment. Recent progress in the field of deep learning has contributed enormously to the health industry medical diagnosis. Convolutional neural networks (CNNs) have been intensively used as a deep learning approach to detect brain tumors using MRI images. Due to the limited dataset, deep learning algorithms and CNNs should be improved to be more efficient. Thus, one of the most known techniques used to improve model performance is Data Augmentation. This paper presents a detailed review of various CNN architectures and highlights the characteristics of particular models such as ResNet, AlexNet, and VGG. After that, we provide an efficient method for detecting brain tumors using magnetic resonance imaging (MRI) datasets based on CNN and data augmentation. Evaluation metrics values of the proposed solution prove that it succeeded in being a contribution to previous studies in terms of both deep architectural design and high detection success.
Collapse
|
60
|
Abstract
Brain tumors (BTs) are spreading very rapidly across the world. Every year, thousands of people die due to deadly brain tumors. Therefore, accurate detection and classification are essential in the treatment of brain tumors. Numerous research techniques have been introduced for BT detection as well as classification based on traditional machine learning (ML) and deep learning (DL). The traditional ML classifiers require hand-crafted features, which is very time-consuming. On the contrary, DL is very robust in feature extraction and has recently been widely used for classification and detection purposes. Therefore, in this work, we propose a hybrid deep learning model called DeepTumorNet for three types of brain tumors (BTs)—glioma, meningioma, and pituitary tumor classification—by adopting a basic convolutional neural network (CNN) architecture. The GoogLeNet architecture of the CNN model was used as a base. While developing the hybrid DeepTumorNet approach, the last 5 layers of GoogLeNet were removed, and 15 new layers were added instead of these 5 layers. Furthermore, we also utilized a leaky ReLU activation function in the feature map to increase the expressiveness of the model. The proposed model was tested on a publicly available research dataset for evaluation purposes, and it obtained 99.67% accuracy, 99.6% precision, 100% recall, and a 99.66% F1-score. The proposed methodology obtained the highest accuracy compared with the state-of-the-art classification results obtained with Alex net, Resnet50, darknet53, Shufflenet, GoogLeNet, SqueezeNet, ResNet101, Exception Net, and MobileNetv2. The proposed model showed its superiority over the existing models for BT classification from the MRI images.
Collapse
|
61
|
Zahoor MM, Qureshi SA, Bibi S, Khan SH, Khan A, Ghafoor U, Bhutta MR. A New Deep Hybrid Boosted and Ensemble Learning-Based Brain Tumor Analysis Using MRI. SENSORS (BASEL, SWITZERLAND) 2022; 22:2726. [PMID: 35408340 PMCID: PMC9002515 DOI: 10.3390/s22072726] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 03/24/2022] [Accepted: 03/28/2022] [Indexed: 02/05/2023]
Abstract
Brain tumor analysis is essential to the timely diagnosis and effective treatment of patients. Tumor analysis is challenging because of tumor morphology factors like size, location, texture, and heteromorphic appearance in medical images. In this regard, a novel two-phase deep learning-based framework is proposed to detect and categorize brain tumors in magnetic resonance images (MRIs). In the first phase, a novel deep-boosted features space and ensemble classifiers (DBFS-EC) scheme is proposed to effectively detect tumor MRI images from healthy individuals. The deep-boosted feature space is achieved through customized and well-performing deep convolutional neural networks (CNNs), and consequently, fed into the ensemble of machine learning (ML) classifiers. While in the second phase, a new hybrid features fusion-based brain-tumor classification approach is proposed, comprised of both static and dynamic features with an ML classifier to categorize different tumor types. The dynamic features are extracted from the proposed brain region-edge net (BRAIN-RENet) CNN, which is able to learn the heteromorphic and inconsistent behavior of various tumors. In contrast, the static features are extracted by using a histogram of gradients (HOG) feature descriptor. The effectiveness of the proposed two-phase brain tumor analysis framework is validated on two standard benchmark datasets, which were collected from Kaggle and Figshare and contain different types of tumors, including glioma, meningioma, pituitary, and normal images. Experimental results suggest that the proposed DBFS-EC detection scheme outperforms the standard and achieved accuracy (99.56%), precision (0.9991), recall (0.9899), F1-Score (0.9945), MCC (0.9892), and AUC-PR (0.9990). The classification scheme, based on the fusion of feature spaces of proposed BRAIN-RENet and HOG, outperform state-of-the-art methods significantly in terms of recall (0.9913), precision (0.9906), accuracy (99.20%), and F1-Score (0.9909) in the CE-MRI dataset.
Collapse
Affiliation(s)
- Mirza Mumtaz Zahoor
- Department of Computer & Information Sciences (DCIS), Pakistan Institute of Engineering and Applied Sciences (PIEAS), Islamabad 45650, Pakistan; (M.M.Z.); (S.A.Q.); (S.H.K.); (A.K.)
- Pattern Recognition Lab, (DCIS), PIEAS, Islamabad 45650, Pakistan
- Faculty of Computer Science, Ibadat International University, Islamabad 54590, Pakistan
| | - Shahzad Ahmad Qureshi
- Department of Computer & Information Sciences (DCIS), Pakistan Institute of Engineering and Applied Sciences (PIEAS), Islamabad 45650, Pakistan; (M.M.Z.); (S.A.Q.); (S.H.K.); (A.K.)
- Pattern Recognition Lab, (DCIS), PIEAS, Islamabad 45650, Pakistan
| | - Sameena Bibi
- Department of Mathematics, Air University, Islamabad 44000, Pakistan;
| | - Saddam Hussain Khan
- Department of Computer & Information Sciences (DCIS), Pakistan Institute of Engineering and Applied Sciences (PIEAS), Islamabad 45650, Pakistan; (M.M.Z.); (S.A.Q.); (S.H.K.); (A.K.)
- Pattern Recognition Lab, (DCIS), PIEAS, Islamabad 45650, Pakistan
- Department of Computer System Engineering, University of Engineering and Applied Science (UEAS), Swat 19060, Pakistan
| | - Asifullah Khan
- Department of Computer & Information Sciences (DCIS), Pakistan Institute of Engineering and Applied Sciences (PIEAS), Islamabad 45650, Pakistan; (M.M.Z.); (S.A.Q.); (S.H.K.); (A.K.)
- Pattern Recognition Lab, (DCIS), PIEAS, Islamabad 45650, Pakistan
- PIEAS Artificial Intelligence Center (PAIC), PIEAS, Islamabad 45650, Pakistan
| | - Usman Ghafoor
- Department of Mechanical Engineering, Institute of Space Technology, Islamabad 44000, Pakistan
- School of Mechanical Engineering, Pusan National University, Busan 46241, Korea
| | | |
Collapse
|
62
|
Detecting acute bilirubin encephalopathy in neonates based on multimodal MRI with deep learning. Pediatr Res 2022; 91:1168-1175. [PMID: 34091603 DOI: 10.1038/s41390-021-01560-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/16/2020] [Revised: 04/09/2021] [Accepted: 04/20/2021] [Indexed: 12/29/2022]
Abstract
BACKGROUND Differentiating acute bilirubin encephalopathy (ABE) from non-ABE in neonates with hyperbilirubinemia (HB) from routine magnetic resonance imaging (MRI) is extremely challenging since both conditions demonstrate similar T1 hyperintensities. To this end, we investigated whether the integration of multimodal MRI from routine clinical scans with deep-learning approaches could improve diagnostic performance. METHODS A total of 75 neonates with ABE and 75 neonates with HB (non-ABE) were included in the study. Each patient had three types of multimodal images taken, i.e., a T1-weighted image (T1WI), a T2-weighted image (T2WI), and an apparent diffusion coefficient (ADC) map. The three types of MRI contrasts and their combination were fed into two deep convolutional neural networks (CNNs), i.e., ResNet18 and DenseNet201. The performance of CNNs was compared with a traditional statistical method named logistic regression. RESULTS We demonstrated that diagnostic methods with the multimodal data were better than any of the single-modal data. Both CNN models outperformed the logistic regression method. The best performance was achieved by DenseNet201 with the combination of three modalities of T1WI, T2WI, and ADC, with an accuracy of 0.929 ± 0.042 and an area under the curve (AUC) of 0.991 ± 0.007. CONCLUSIONS Our study demonstrated that CNN models with multimodal MRI significantly improve the accuracy of diagnosing ABE. IMPACT We proposed an efficient strategy of detecting ABE in neonates based on multimodal MRI with deep learning, which achieved an accuracy of 0.929 ± 0.042 and an AUC of 0.991 ± 0.007. We demonstrated the advantage of integrating multimodal MRI in detecting ABE in neonates with HB, using deep-learning models. Our strategy of diagnosing ABE using deep-learning techniques with multimodal MRI from routine clinical scans is potentially applicable to clinical practice.
Collapse
|
63
|
An Efficient Method for Diagnosing Brain Tumors Based on MRI Images Using Deep Convolutional Neural Networks. APPLIED COMPUTATIONAL INTELLIGENCE AND SOFT COMPUTING 2022. [DOI: 10.1155/2022/2092985] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
This paper proposes a system to effectively identify brain tumors on MRI images using artificial intelligence algorithms and ADAS optimization function. This system is developed with the aim of assisting doctors in diagnosing one of the most dangerous diseases for humans. The data used in the study is patient image data collected from Bach Mai Hospital, Vietnam. The proposed approach includes two main steps. First, we propose the normalization method for brain MRI images to remove unnecessary components without affecting their information content. In the next step, Deep Convolutional Neural Networks are used and then we propose to apply ADAS optimization function to build predictive models based on that normalized dataset. From there, the results will be compared to choose the most optimal method. Those results of the evaluated algorithms through the coefficient F1-score are greater than 94% and the highest value is 97.65%.
Collapse
|
64
|
A Novel MRI Diagnosis Method for Brain Tumor Classification Based on CNN and Bayesian Optimization. Healthcare (Basel) 2022; 10:healthcare10030494. [PMID: 35326972 PMCID: PMC8949584 DOI: 10.3390/healthcare10030494] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Revised: 02/21/2022] [Accepted: 03/02/2022] [Indexed: 12/04/2022] Open
Abstract
Brain tumor is one of the most aggressive diseases nowadays, resulting in a very short life span if it is diagnosed at an advanced stage. The treatment planning phase is thus essential for enhancing the quality of life for patients. The use of Magnetic Resonance Imaging (MRI) in the diagnosis of brain tumors is extremely widespread, but the manual interpretation of large amounts of images requires considerable effort and is prone to human errors. Hence, an automated method is necessary to identify the most common brain tumors. Convolutional Neural Network (CNN) architectures are successful in image classification due to their high layer count, which enables them to conceive the features effectively on their own. The tuning of CNN hyperparameters is critical in every dataset since it has a significant impact on the efficiency of the training model. Given the high dimensionality and complexity of the data, manual hyperparameter tuning would take an inordinate amount of time, with the possibility of failing to identify the optimal hyperparameters. In this paper, we proposed a Bayesian Optimization-based efficient hyperparameter optimization technique for CNN. This method was evaluated by classifying 3064 T-1-weighted CE-MRI images into three types of brain tumors (Glioma, Meningioma, and Pituitary). Based on Transfer Learning, the performance of five well-recognized deep pre-trained models is compared with that of the optimized CNN. After using Bayesian Optimization, our CNN was able to attain 98.70% validation accuracy at best without data augmentation or cropping lesion techniques, while VGG16, VGG19, ResNet50, InceptionV3, and DenseNet201 achieved 97.08%, 96.43%, 89.29%, 92.86%, and 94.81% validation accuracy, respectively. Moreover, the proposed model outperforms state-of-the-art methods on the CE-MRI dataset, demonstrating the feasibility of automating hyperparameter optimization.
Collapse
|
65
|
Parida PK, Dora L, Swain M, Agrawal S, Panda R. Data science methodologies in smart healthcare: a review. HEALTH AND TECHNOLOGY 2022. [DOI: 10.1007/s12553-022-00648-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
66
|
Alanazi MF, Ali MU, Hussain SJ, Zafar A, Mohatram M, Irfan M, AlRuwaili R, Alruwaili M, Ali NH, Albarrak AM. Brain Tumor/Mass Classification Framework Using Magnetic-Resonance-Imaging-Based Isolated and Developed Transfer Deep-Learning Model. SENSORS (BASEL, SWITZERLAND) 2022; 22:372. [PMID: 35009911 PMCID: PMC8749789 DOI: 10.3390/s22010372] [Citation(s) in RCA: 56] [Impact Index Per Article: 18.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Revised: 12/20/2021] [Accepted: 12/31/2021] [Indexed: 05/13/2023]
Abstract
With the advancement in technology, machine learning can be applied to diagnose the mass/tumor in the brain using magnetic resonance imaging (MRI). This work proposes a novel developed transfer deep-learning model for the early diagnosis of brain tumors into their subclasses, such as pituitary, meningioma, and glioma. First, various layers of isolated convolutional-neural-network (CNN) models are built from scratch to check their performances for brain MRI images. Then, the 22-layer, binary-classification (tumor or no tumor) isolated-CNN model is re-utilized to re-adjust the neurons' weights for classifying brain MRI images into tumor subclasses using the transfer-learning concept. As a result, the developed transfer-learned model has a high accuracy of 95.75% for the MRI images of the same MRI machine. Furthermore, the developed transfer-learned model has also been tested using the brain MRI images of another machine to validate its adaptability, general capability, and reliability for real-time application in the future. The results showed that the proposed model has a high accuracy of 96.89% for an unseen brain MRI dataset. Thus, the proposed deep-learning framework can help doctors and radiologists diagnose brain tumors early.
Collapse
Affiliation(s)
- Muhannad Faleh Alanazi
- Radiology, Department of Internal Medicine, College of Medicine, Jouf University, Sakaka 72388, Saudi Arabia; (M.F.A.); (R.A.); (M.A.)
| | - Muhammad Umair Ali
- Department of Unmanned Vehicle Engineering, Sejong University, Seoul 05006, Korea;
| | - Shaik Javeed Hussain
- Department of Electrical and Electronics, Global College of Engineering and Technology, Muscat 112, Oman;
| | - Amad Zafar
- Department of Electrical Engineering, The Ibadat International University, Islamabad 54590, Pakistan
| | - Mohammed Mohatram
- Department of Electrical and Electronics, Global College of Engineering and Technology, Muscat 112, Oman;
| | - Muhammad Irfan
- Electrical Engineering Department, College of Engineering, Najran University, Najran 61441, Saudi Arabia;
| | - Raed AlRuwaili
- Radiology, Department of Internal Medicine, College of Medicine, Jouf University, Sakaka 72388, Saudi Arabia; (M.F.A.); (R.A.); (M.A.)
| | - Mubarak Alruwaili
- Radiology, Department of Internal Medicine, College of Medicine, Jouf University, Sakaka 72388, Saudi Arabia; (M.F.A.); (R.A.); (M.A.)
| | - Naif H. Ali
- Department of Internal Medicine, Medical College, Najran University, Najran 61441, Saudi Arabia;
| | - Anas Mohammad Albarrak
- Department of Internal Medicine, College of Medicine, Prince Sattam Bin Abdulaziz University, Alkharj 16278, Saudi Arabia;
| |
Collapse
|
67
|
Cengil E, Çınar A. The effect of deep feature concatenation in the classification problem: An approach on COVID-19 disease detection. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2022; 32:26-40. [PMID: 34898851 PMCID: PMC8653237 DOI: 10.1002/ima.22659] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Revised: 08/04/2021] [Accepted: 09/16/2021] [Indexed: 06/01/2023]
Abstract
In image classification applications, the most important thing is to obtain useful features. Convolutional neural networks automatically learn the extracted features during training. The classification process is carried out with the obtained features. Therefore, obtaining successful features is critical to achieving high classification success. This article focuses on providing effective features to enhance classification performance. For this purpose, the success of the process of concatenating features in classification is taken as basis. At first, the features acquired by feature transfer method are extracted from AlexNet, Xception, NASNETLarge, and EfficientNet-B0 architectures, which are known to be successful in classification problems. Concatenating the features results in the creation of a new feature set. The method is completed by subjecting the features to various classification algorithms. The proposed pipeline is applied to the three datasets: "COVID-19 Image Dataset," "COVID-19 Pneumonia Normal Chest X-ray (PA) Dataset," and "COVID-19 Radiography Database" for COVID-19 disease detection. The whole datasets contain three classes (normal, COVID, and pneumonia). The best classification accuracies for the three datasets are 98.8%, 95.9%, and 99.6%, respectively. Performance metrics are given such as: sensitivity, precision, specificity, and F1-score values, as well. Contribution of paper is as follows: COVID-19 disease is similar to other lung infections. This situation makes diagnosis difficult. Furthermore, the virus's rapid spread necessitates the need to detect cases as soon as possible. There has been an increased curiosity in computer-aided deep learning models to provide the requirements. The use of the proposed method will be beneficial as it provides high accuracy.
Collapse
Affiliation(s)
- Emine Cengil
- Department of Computer Engineering, Faculty of EngineeringFirat UniversityElazigTurkey
| | - Ahmet Çınar
- Department of Computer Engineering, Faculty of EngineeringFirat UniversityElazigTurkey
| |
Collapse
|
68
|
Fayaz M, Torokeldiev N, Turdumamatov S, Qureshi MS, Qureshi MB, Gwak J. An Efficient Methodology for Brain MRI Classification Based on DWT and Convolutional Neural Network. SENSORS 2021; 21:s21227480. [PMID: 34833556 PMCID: PMC8619601 DOI: 10.3390/s21227480] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/17/2021] [Revised: 11/01/2021] [Accepted: 11/08/2021] [Indexed: 12/21/2022]
Abstract
In this paper, a model based on discrete wavelet transform and convolutional neural network for brain MR image classification has been proposed. The proposed model is comprised of three main stages, namely preprocessing, feature extraction, and classification. In the preprocessing, the median filter has been applied to remove salt-and-pepper noise from the brain MRI images. In the discrete wavelet transform, discrete Harr wavelet transform has been used. In the proposed model, 3-level Harr wavelet decomposition has been applied on the images to remove low-level detail and reduce the size of the images. Next, the convolutional neural network has been used for classifying the brain MR images into normal and abnormal. The convolutional neural network is also a prevalent classification method and has been widely used in different areas. In this study, the convolutional neural network has been used for brain MRI classification. The proposed methodology has been applied to the standard dataset, and for performance evaluation, we have used different performance evaluation measures. The results indicate that the proposed method provides good results with 99% accuracy. The proposed method results are then presented for comparison with some state-of-the-art algorithms where simply the proposed method outperforms the counterpart algorithms. The proposed model has been developed to be used for practical applications.
Collapse
Affiliation(s)
- Muhammad Fayaz
- Department of Computer Science, University of Central Asia, 310 Lenin Street, Naryn 722918, Kyrgyzstan; (M.F.); (M.S.Q.)
| | - Nurlan Torokeldiev
- Department of Mathematics and Natural Sciences, University of Central Asia, Khorog 736, Tajikistan;
| | - Samat Turdumamatov
- Department of Mathematics and Natural Sciences, University of Central Asia, 310 Lenin Street, Naryn 722918, Kyrgyzstan;
| | - Muhammad Shuaib Qureshi
- Department of Computer Science, University of Central Asia, 310 Lenin Street, Naryn 722918, Kyrgyzstan; (M.F.); (M.S.Q.)
| | - Muhammad Bilal Qureshi
- Department of Computer Science and IT, University of Lakki Marwat, Lakki Marwat 28420, KPK, Pakistan;
| | - Jeonghwan Gwak
- Department of Software, Korea National University of Transportation, Chungju 27469, Korea
- Department of Biomedical Engineering, Korea National University of Transportation, Chungju 27469, Korea
- Department of AI Robotics Engineering, Korea National University of Transportation, Chungju 27469, Korea
- Department of IT & Energy Convergence (BK21 FOUR), Korea National University of Transportation, Chungju 27469, Korea
- Correspondence: ; Tel.: +82-43-841-5852
| |
Collapse
|
69
|
Rai HM, Chatterjee K. 2D MRI image analysis and brain tumor detection using deep learning CNN model LeU-Net. MULTIMEDIA TOOLS AND APPLICATIONS 2021; 80:36111-36141. [DOI: 10.1007/s11042-021-11504-9] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2020] [Revised: 07/03/2021] [Accepted: 08/19/2021] [Indexed: 08/08/2023]
|
70
|
Brain Tumor Segmentation of MRI Images Using Processed Image Driven U-Net Architecture. COMPUTERS 2021. [DOI: 10.3390/computers10110139] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Brain tumor segmentation seeks to separate healthy tissue from tumorous regions. This is an essential step in diagnosis and treatment planning to maximize the likelihood of successful treatment. Magnetic resonance imaging (MRI) provides detailed information about brain tumor anatomy, making it an important tool for effective diagnosis which is requisite to replace the existing manual detection system where patients rely on the skills and expertise of a human. In order to solve this problem, a brain tumor segmentation & detection system is proposed where experiments are tested on the collected BraTS 2018 dataset. This dataset contains four different MRI modalities for each patient as T1, T2, T1Gd, and FLAIR, and as an outcome, a segmented image and ground truth of tumor segmentation, i.e., class label, is provided. A fully automatic methodology to handle the task of segmentation of gliomas in pre-operative MRI scans is developed using a U-Net-based deep learning model. The first step is to transform input image data, which is further processed through various techniques—subset division, narrow object region, category brain slicing, watershed algorithm, and feature scaling was done. All these steps are implied before entering data into the U-Net Deep learning model. The U-Net Deep learning model is used to perform pixel label segmentation on the segment tumor region. The algorithm reached high-performance accuracy on the BraTS 2018 training, validation, as well as testing dataset. The proposed model achieved a dice coefficient of 0.9815, 0.9844, 0.9804, and 0.9954 on the testing dataset for sets HGG-1, HGG-2, HGG-3, and LGG-1, respectively.
Collapse
|
71
|
Eroglu Y, Yildirim K, Çinar A, Yildirim M. Diagnosis and grading of vesicoureteral reflux on voiding cystourethrography images in children using a deep hybrid model. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 210:106369. [PMID: 34474195 DOI: 10.1016/j.cmpb.2021.106369] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Accepted: 08/17/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND OBJECTIVE Vesicoureteral reflux is the leakage of urine from the bladder into the ureter. As a result, urinary tract infections and kidney scarring can occur in children. Voiding cystourethrography is the primary radiological imaging method used to diagnose vesicoureteral reflux in children with a history of recurrent urinary tract infection. Besides the diagnosis of reflux, it is graded with voiding cystourethrography. In this study, we aimed to diagnose and grade vesicoureteral reflux in Voiding cystourethrography images using hybrid CNN in deep learning methods. METHODS Images of pediatric patients diagnosed with VUR between 2016 and 2021 in our hospital (Firat University Hospital) were graded according to the international vesicoureteral reflux radiographic grading system. VCUG images of 236 normal and 992 with vesicoureteral reflux pediatric patients were available. A total of 6 classes were created as normal and graded 1-5 patients. RESULTS In this study, a hybrid-based mRMR (Minimum Redundancy Maximum Relevance) using CNN (Convolutional Neural Networks) model is developed for the diagnosis and grading of vesicoureteral reflux on voiding cystourethrography images. Googlenet, MobilenetV2, and Densenet201 models are used as a part of the hybrid architecture. The obtained features from these architectures are examined in concatenating process. Then, these features are classified in machine learning classifiers after optimizing with the mRMR method. Among the models used in the study, the highest accuracy value was obtained in the proposed model with an accuracy rate of 96.9%. CONCLUSIONS It shows that the hybrid model developed according to the findings of our study can be used in the diagnosis and grading of vesicoureteral reflux in voiding cystourethrography images.
Collapse
Affiliation(s)
- Yesim Eroglu
- Department of Radiology, Firat University School of Medicine, Elazig, Turkey.
| | - Kadir Yildirim
- Department of Urology, Turgut Ozal University, Malatya, Turkey.
| | - Ahmet Çinar
- Department of Computer Engineering, Firat University, Elazig, Turkey.
| | - Muhammed Yildirim
- Department of Computer Engineering, Firat University, Elazig, Turkey.
| |
Collapse
|
72
|
Hashemzehi R, Seyyed Mahdavi SJ, Kheirabadi M, Kamel SR. Y-net: a reducing gaussian noise convolutional neural network for MRI brain tumor classification with NADE concatenation. Biomed Phys Eng Express 2021; 7. [PMID: 34198284 DOI: 10.1088/2057-1976/ac107b] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Accepted: 07/01/2021] [Indexed: 11/11/2022]
Abstract
Brain tumors are among the most serious cancers that can have a negative impact on a person's quality of life. The magnetic resonance imaging (MRI) analysis detects abnormal cell growth in the skull. Recently, machine learning models such as artificial neural networks have been used to detect brain tumors more quickly. To classify brain tumors, this research introduces the Y-net, a new convolutional neural network (CNN) based on the convolutional U-net architecture. We apply a NADE concatenation method in pre-processing the MR images for enhanced Y-net performance. We put our approach to the test using two MRI datasets of brain tumors. The first dataset contains three different types of brain tumors, while the second dataset includes a separate category for healthy brains. We show that our model is resistant to white noise and can obtain excellent classification accuracy with a limited number of medical images.
Collapse
Affiliation(s)
- Raheleh Hashemzehi
- Department of Computer Science, Neyshabur Branch, Islamic Azad University, Neyshabur, Iran
| | | | - Maryam Kheirabadi
- Department of Computer Science, Neyshabur Branch, Islamic Azad University, Neyshabur, Iran
| | - Seyed Reza Kamel
- Department of Software Engineering, Mashhad Branch, Islamic Azad University, Mashhad, Iran
| |
Collapse
|
73
|
Kassania SH, Kassanib PH, Wesolowskic MJ, Schneidera KA, Detersa R. Automatic Detection of Coronavirus Disease (COVID-19) in X-ray and CT Images: A Machine Learning Based Approach. Biocybern Biomed Eng 2021; 41:867-879. [PMID: 34108787 PMCID: PMC8179118 DOI: 10.1016/j.bbe.2021.05.013] [Citation(s) in RCA: 91] [Impact Index Per Article: 22.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2020] [Accepted: 05/13/2021] [Indexed: 12/23/2022]
Abstract
The newly identified Coronavirus pneumonia, subsequently termed COVID-19, is highly transmittable and pathogenic with no clinically approved antiviral drug or vaccine available for treatment. The most common symptoms of COVID-19 are dry cough, sore throat, and fever. Symptoms can progress to a severe form of pneumonia with critical complications, including septic shock, pulmonary edema, acute respiratory distress syndrome and multi-organ failure. While medical imaging is not currently recommended in Canada for primary diagnosis of COVID-19, computer-aided diagnosis systems could assist in the early detection of COVID-19 abnormalities and help to monitor the progression of the disease, potentially reduce mortality rates. In this study, we compare popular deep learning-based feature extraction frameworks for automatic COVID-19 classification. To obtain the most accurate feature, which is an essential component of learning, MobileNet, DenseNet, Xception, ResNet, InceptionV3, InceptionResNetV2, VGGNet, NASNet were chosen amongst a pool of deep convolutional neural networks. The extracted features were then fed into several machine learning classifiers to classify subjects as either a case of COVID-19 or a control. This approach avoided task-specific data pre-processing methods to support a better generalization ability for unseen data. The performance of the proposed method was validated on a publicly available COVID-19 dataset of chest X-ray and CT images. The DenseNet121 feature extractor with Bagging tree classifier achieved the best performance with 99% classification accuracy. The second-best learner was a hybrid of the a ResNet50 feature extractor trained by LightGBM with an accuracy of 98.
Collapse
Affiliation(s)
| | | | | | | | - Ralph Detersa
- Department of Computer Science, University of Saskatchewan, Canada
| |
Collapse
|
74
|
Nazir M, Shakil S, Khurshid K. Role of deep learning in brain tumor detection and classification (2015 to 2020): A review. Comput Med Imaging Graph 2021; 91:101940. [PMID: 34293621 DOI: 10.1016/j.compmedimag.2021.101940] [Citation(s) in RCA: 52] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2020] [Revised: 04/14/2021] [Accepted: 05/10/2021] [Indexed: 02/06/2023]
Abstract
During the last decade, computer vision and machine learning have revolutionized the world in every way possible. Deep Learning is a sub field of machine learning that has shown remarkable results in every field especially biomedical field due to its ability of handling huge amount of data. Its potential and ability have also been applied and tested in the detection of brain tumor using MRI images for effective prognosis and has shown remarkable performance. The main objective of this research work is to present a detailed critical analysis of the research and findings already done to detect and classify brain tumor through MRI images in the recent past. This analysis is specifically beneficial for the researchers who are experts of deep learning and are interested to apply their expertise for brain tumor detection and classification. As a first step, a brief review of the past research papers using Deep Learning for brain tumor classification and detection is carried out. Afterwards, a critical analysis of Deep Learning techniques proposed in these research papers (2015-2020) is being carried out in the form of a Table. Finally, the conclusion highlights the merits and demerits of deep neural networks. The results formulated in this paper will provide a thorough comparison of recent studies to the future researchers, along with the idea of the effectiveness of various deep learning approaches. We are confident that this study would greatly assist in advancement of brain tumor research.
Collapse
Affiliation(s)
- Maria Nazir
- iVision Lab, Electrical Engineering Department, Institute of Space Technology, Islamabad, Pakistan.
| | - Sadia Shakil
- iVision Lab, Electrical Engineering Department, Institute of Space Technology, Islamabad, Pakistan; Turner Institute for Brain and Mental Health, Monash University, Melbourne, Australia
| | - Khurram Khurshid
- iVision Lab, Electrical Engineering Department, Institute of Space Technology, Islamabad, Pakistan
| |
Collapse
|
75
|
Eroğlu Y, Yildirim M, Çinar A. Convolutional Neural Networks based classification of breast ultrasonography images by hybrid method with respect to benign, malignant, and normal using mRMR. Comput Biol Med 2021; 133:104407. [PMID: 33901712 DOI: 10.1016/j.compbiomed.2021.104407] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2021] [Revised: 04/08/2021] [Accepted: 04/13/2021] [Indexed: 12/25/2022]
Abstract
Early diagnosis of breast lesions and differentiation of malignant lesions from benign lesions are important for the prognosis of breast cancer. In the diagnosis of this disease ultrasound is an extremely important radiological imaging method because it enables biopsy as well as lesion characterization. Since ultrasonographic diagnosis depends on the expert, the knowledge level and experience of the user is very important. In addition, the contribution of computer aided systems is quite high, as these systems can reduce the workload of radiologists and reinforce their knowledge and experience when considered together with a dense patient population in hospital conditions. In this paper, a hybrid based CNN system is developed for diagnosing breast cancer lesions with respect to benign, malignant and normal. Alexnet, MobilenetV2, and Resnet50 models are used as the base for the Hybrid structure. The features of these models used are obtained and concatenated separately. Thus, the number of features used are increased. Later, the most valuable of these features are selected by the mRMR (Minimum Redundancy Maximum Relevance) feature selection method and classified with machine learning classifiers such as SVM, KNN. The highest rate is obtained in the SVM classifier with 95.6% in accuracy.
Collapse
Affiliation(s)
- Yeşim Eroğlu
- Department of Radiology, Firat University School of Medicine, Elazig, Turkey.
| | | | - Ahmet Çinar
- Computer Engineering Department, Firat University, Elazig, Turkey.
| |
Collapse
|
76
|
Rai HM, Chatterjee K, Dashkevich S. Automatic and accurate abnormality detection from brain MR images using a novel hybrid UnetResNext-50 deep CNN model. Biomed Signal Process Control 2021; 66:102477. [DOI: 10.1016/j.bspc.2021.102477] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
77
|
Kang J, Ullah Z, Gwak J. MRI-Based Brain Tumor Classification Using Ensemble of Deep Features and Machine Learning Classifiers. SENSORS 2021; 21:s21062222. [PMID: 33810176 PMCID: PMC8004778 DOI: 10.3390/s21062222] [Citation(s) in RCA: 107] [Impact Index Per Article: 26.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Revised: 03/13/2021] [Accepted: 03/17/2021] [Indexed: 11/21/2022]
Abstract
Brain tumor classification plays an important role in clinical diagnosis and effective treatment. In this work, we propose a method for brain tumor classification using an ensemble of deep features and machine learning classifiers. In our proposed framework, we adopt the concept of transfer learning and uses several pre-trained deep convolutional neural networks to extract deep features from brain magnetic resonance (MR) images. The extracted deep features are then evaluated by several machine learning classifiers. The top three deep features which perform well on several machine learning classifiers are selected and concatenated as an ensemble of deep features which is then fed into several machine learning classifiers to predict the final output. To evaluate the different kinds of pre-trained models as a deep feature extractor, machine learning classifiers, and the effectiveness of an ensemble of deep feature for brain tumor classification, we use three different brain magnetic resonance imaging (MRI) datasets that are openly accessible from the web. Experimental results demonstrate that an ensemble of deep features can help improving performance significantly, and in most cases, support vector machine (SVM) with radial basis function (RBF) kernel outperforms other machine learning classifiers, especially for large datasets.
Collapse
Affiliation(s)
- Jaeyong Kang
- Department of Software, Korea National University of Transportation, Chungju 27469, Korea; (J.K.); (Z.U.)
| | - Zahid Ullah
- Department of Software, Korea National University of Transportation, Chungju 27469, Korea; (J.K.); (Z.U.)
| | - Jeonghwan Gwak
- Department of Software, Korea National University of Transportation, Chungju 27469, Korea; (J.K.); (Z.U.)
- Department of Biomedical Engineering, Korea National University of Transportation, Chungju 27469, Korea
- Department of AI Robotics Engineering, Korea National University of Transportation, Chungju 27469, Korea
- Department of IT Convergence (Brain Korea PLUS 21), Korea National University of Transportation, Chungju 27469, Korea
- Correspondence: ; Tel.: +82-43-841-5852
| |
Collapse
|
78
|
Abd El Kader I, Xu G, Shuai Z, Saminu S, Javaid I, Salim Ahmad I. Differential Deep Convolutional Neural Network Model for Brain Tumor Classification. Brain Sci 2021; 11:352. [PMID: 33801994 PMCID: PMC8001442 DOI: 10.3390/brainsci11030352] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2021] [Revised: 03/01/2021] [Accepted: 03/03/2021] [Indexed: 02/02/2023] Open
Abstract
The classification of brain tumors is a difficult task in the field of medical image analysis. Improving algorithms and machine learning technology helps radiologists to easily diagnose the tumor without surgical intervention. In recent years, deep learning techniques have made excellent progress in the field of medical image processing and analysis. However, there are many difficulties in classifying brain tumors using magnetic resonance imaging; first, the difficulty of brain structure and the intertwining of tissues in it; and secondly, the difficulty of classifying brain tumors due to the high density nature of the brain. We propose a differential deep convolutional neural network model (differential deep-CNN) to classify different types of brain tumor, including abnormal and normal magnetic resonance (MR) images. Using differential operators in the differential deep-CNN architecture, we derived the additional differential feature maps in the original CNN feature maps. The derivation process led to an improvement in the performance of the proposed approach in accordance with the results of the evaluation parameters used. The advantage of the differential deep-CNN model is an analysis of a pixel directional pattern of images using contrast calculations and its high ability to classify a large database of images with high accuracy and without technical problems. Therefore, the proposed approach gives an excellent overall performance. To test and train the performance of this model, we used a dataset consisting of 25,000 brain magnetic resonance imaging (MRI) images, which includes abnormal and normal images. The experimental results showed that the proposed model achieved an accuracy of 99.25%. This study demonstrates that the proposed differential deep-CNN model can be used to facilitate the automatic classification of brain tumors.
Collapse
Affiliation(s)
- Isselmou Abd El Kader
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300130, China; (Z.S.); (S.S.); (I.J.); (I.S.A.)
| | - Guizhi Xu
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300130, China; (Z.S.); (S.S.); (I.J.); (I.S.A.)
| | | | | | | | | |
Collapse
|
79
|
Irmak E. Multi-Classification of Brain Tumor MRI Images Using Deep Convolutional Neural Network with Fully Optimized Framework. IRANIAN JOURNAL OF SCIENCE AND TECHNOLOGY, TRANSACTIONS OF ELECTRICAL ENGINEERING 2021; 45. [PMCID: PMC8061452 DOI: 10.1007/s40998-021-00426-9] [Citation(s) in RCA: 65] [Impact Index Per Article: 16.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Brain tumor diagnosis and classification still rely on histopathological analysis of biopsy specimens today. The current method is invasive, time-consuming and prone to manual errors. These disadvantages show how essential it is to perform a fully automated method for multi-classification of brain tumors based on deep learning. This paper aims to make multi-classification of brain tumors for the early diagnosis purposes using convolutional neural network (CNN). Three different CNN models are proposed for three different classification tasks. Brain tumor detection is achieved with 99.33% accuracy using the first CNN model. The second CNN model can classify the brain tumor into five brain tumor types as normal, glioma, meningioma, pituitary and metastatic with an accuracy of 92.66%. The third CNN model can classify the brain tumors into three grades as Grade II, Grade III and Grade IV with an accuracy of 98.14%. All the important hyper-parameters of CNN models are automatically designated using the grid search optimization algorithm. To the best of author’s knowledge, this is the first study for multi-classification of brain tumor MRI images using CNN whose almost all hyper-parameters are tuned by the grid search optimizer. The proposed CNN models are compared with other popular state-of-the-art CNN models such as AlexNet, Inceptionv3, ResNet-50, VGG-16 and GoogleNet. Satisfactory classification results are obtained using large and publicly available clinical datasets. The proposed CNN models can be employed to assist physicians and radiologists in validating their initial screening for brain tumor multi-classification purposes.
Collapse
Affiliation(s)
- Emrah Irmak
- Electrical-Electronics Engineering Department, Alanya Alaaddin Keykubat University, 07425 Alanya, Antalya, Turkey
| |
Collapse
|