1
|
Chen C, Mat Isa NA, Liu X. A review of convolutional neural network based methods for medical image classification. Comput Biol Med 2025; 185:109507. [PMID: 39631108 DOI: 10.1016/j.compbiomed.2024.109507] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2024] [Revised: 11/20/2024] [Accepted: 11/28/2024] [Indexed: 12/07/2024]
Abstract
This study systematically reviews CNN-based medical image classification methods. We surveyed 149 of the latest and most important papers published to date and conducted an in-depth analysis of the methods used therein. Based on the selected literature, we organized this review systematically. First, the development and evolution of CNN in the field of medical image classification are analyzed. Subsequently, we provide an in-depth overview of the main techniques of CNN applied to medical image classification, which is also the current research focus in this field, including data preprocessing, transfer learning, CNN architectures, and explainability, and their role in improving classification accuracy and efficiency. In addition, this overview summarizes the main public datasets for various diseases. Although CNN has great potential in medical image classification tasks and has achieved good results, clinical application is still difficult. Therefore, we conclude by discussing the main challenges faced by CNNs in medical image analysis and pointing out future research directions to address these challenges. This review will help researchers with their future studies and can promote the successful integration of deep learning into clinical practice and smart medical systems.
Collapse
Affiliation(s)
- Chao Chen
- School of Electrical and Electronic Engineering, Engineering Campus, Universiti Sains Malaysia, 14300, Nibong Tebal, Pulau Pinang, Malaysia; School of Automation and Information Engineering, Sichuan University of Science and Engineering, Yibin, 644000, China
| | - Nor Ashidi Mat Isa
- School of Electrical and Electronic Engineering, Engineering Campus, Universiti Sains Malaysia, 14300, Nibong Tebal, Pulau Pinang, Malaysia.
| | - Xin Liu
- School of Electrical and Electronic Engineering, Engineering Campus, Universiti Sains Malaysia, 14300, Nibong Tebal, Pulau Pinang, Malaysia
| |
Collapse
|
2
|
Amjad U, Raza A, Fahad M, Farid D, Akhunzada A, Abubakar M, Beenish H. Context aware machine learning techniques for brain tumor classification and detection - A review. Heliyon 2025; 11:e41835. [PMID: 39906822 PMCID: PMC11791217 DOI: 10.1016/j.heliyon.2025.e41835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 01/07/2025] [Accepted: 01/08/2025] [Indexed: 02/06/2025] Open
Abstract
Background Machine learning has tremendous potential in acute medical care, particularly in the field of precise medical diagnosis, prediction, and classification of brain tumors. Malignant gliomas, due to their aggressive growth and dismal prognosis, stand out among various brain tumor types. Recent advancements in understanding the genetic abnormalities that underlie these tumors have shed light on their histo-pathological and biological characteristics, which support in better classification and prognosis. Objectives This review aims to predict gene alterations and establish structured correlations among various tumor types, extending the prediction of genetic mutations and structures using the latest machine learning techniques. Specifically, it focuses on multi-modalities of Magnetic Resonance Imaging (MRI) and histopathology, utilizing Convolutional Neural Networks (CNN) for image processing and analysis. Methods The review encompasses the most recent developments in MRI, and histology image processing methods across multiple tumor classes, including Glioma, Meningioma, Pituitary, Oligodendroglioma, and Astrocytoma. It identifies challenges in tumor classification, segmentation, datasets, and modalities, employing various neural network architectures. A competitive analysis assesses the performance of CNN. Furthermore it also implies K-MEANS clustering to predict Genetic structure, Genes Clusters prediction and Molecular Alteration of various types and grades of tumors e.g. Glioma, Meningioma, Pituitary, Oligodendroglioma, and Astrocytoma. Results CNN and KNN structures, with their ability to extract highlights in image-based information, prove effective in tumor classification and segmentation, surmounting challenges in image analysis. Competitive analysis reveals that CNN and outperform others algorithms on publicly available datasets, suggesting their potential for precise tumor diagnosis and treatment planning. Conclusion Machine learning, especially through CNN and SVM algorithms, demonstrates significant potential in the accurate diagnosis and classification of brain tumors based on imaging and histo-pathological data. Further advancements in this area hold promise for improving the accuracy and efficiency of intra-operative tumor diagnosis and treatment.
Collapse
Affiliation(s)
- Usman Amjad
- NED University of Engineering and Technology, Karachi, Pakistan
| | - Asif Raza
- Sir Syed University of Engineering and Technology, Karachi, Pakistan
| | - Muhammad Fahad
- Karachi Institute of Economics and Technology, Karachi, Pakistan
| | | | - Adnan Akhunzada
- College of Computing and IT, University of Doha for Science and Technology, Qatar
| | - Muhammad Abubakar
- Muhammad Nawaz Shareef University of Engineering and Technology, Multan, Pakistan
| | - Hira Beenish
- Karachi Institute of Economics and Technology, Karachi, Pakistan
| |
Collapse
|
3
|
Rai HM, Yoo J, Dashkevych S. Transformative Advances in AI for Precise Cancer Detection: A Comprehensive Review of Non-Invasive Techniques. ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING 2025. [DOI: 10.1007/s11831-024-10219-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Accepted: 12/07/2024] [Indexed: 03/02/2025]
|
4
|
Basthikodi M, Chaithrashree M, Ahamed Shafeeq BM, Gurpur AP. Enhancing multiclass brain tumor diagnosis using SVM and innovative feature extraction techniques. Sci Rep 2024; 14:26023. [PMID: 39472515 PMCID: PMC11522397 DOI: 10.1038/s41598-024-77243-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2024] [Accepted: 10/21/2024] [Indexed: 11/02/2024] Open
Abstract
In the field of medical imaging, accurately classifying brain tumors remains a significant challenge because of the visual similarities among different tumor types. This research addresses the challenge of multiclass categorization by employing Support Vector Machine (SVM) as the core classification algorithm and analyzing its performance in conjunction with feature extraction techniques such as Histogram of Oriented Gradients (HOG) and Local Binary Pattern (LBP), as well as the dimensionality reduction technique, Principal Component Analysis (PCA). The study utilizes a dataset sourced from Kaggle, comprising MRI images classified into four classes, with images captured from various anatomical planes. Initially, the SVM model alone attained an accuracy(acc_val) of 86.57% on unseen test data, establishing a baseline for performance. To enhance this, PCA was incorporated for dimensionality reduction, which improved the acc_val to 94.20%, demonstrating the effectiveness of reducing feature dimensionality in mitigating overfitting and enhancing model generalization. Further performance gains were realized by applying feature extraction techniques-HOG and LBP-in conjunction with SVM, resulting in an acc_val of 95.95%. The most substantial improvement was observed when combining SVM with both HOG, LBP, and PCA, achieving an impressive acc_val of 96.03%, along with an F1 score(F1_val) of 96.00%, precision(prec_val) of 96.02%, and recall(rec_val) of 96.03%. This approach will not only improves categorization performance but also improves efficacy of computation, making it a robust and effective method for multiclass brain tumor prediction.
Collapse
Affiliation(s)
- Mustafa Basthikodi
- Department of Computer Science & Engineering, Sahyadri College of Engineering & Management, Mangaluru, India.
| | - M Chaithrashree
- Department of Computer Science & Engineering, Sahyadri College of Engineering & Management, Mangaluru, India
| | - B M Ahamed Shafeeq
- Department of Computer Science and Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, Karnataka, India.
| | - Ananth Prabhu Gurpur
- Department of Computer Science & Engineering, Sahyadri College of Engineering & Management, Mangaluru, India
| |
Collapse
|
5
|
Rao KN, Khalaf OI, Krishnasree V, Kumar AS, Alsekait DM, Priyanka SS, Alattas AS, AbdElminaam DS. An efficient brain tumor detection and classification using pre-trained convolutional neural network models. Heliyon 2024; 10:e36773. [PMID: 39281484 PMCID: PMC11401085 DOI: 10.1016/j.heliyon.2024.e36773] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Revised: 08/21/2024] [Accepted: 08/22/2024] [Indexed: 09/18/2024] Open
Abstract
In cases of brain tumors, some brain cells experience abnormal and rapid growth, leading to the development of tumors. Brain tumors represent a significant source of illness affecting the brain. Magnetic Resonance Imaging (MRI) stands as a well-established and coherent diagnostic method for brain cancer detection. However, the resulting MRI scans produce a vast number of images, which require thorough examination by radiologists. Manual assessment of these images consumes considerable time and may result in inaccuracies in cancer detection. Recently, deep learning has emerged as a reliable tool for decision-making tasks across various domains, including finance, medicine, cybersecurity, agriculture, and forensics. In the context of brain cancer diagnosis, Deep Learning and Machine Learning algorithms applied to MRI data enable rapid prognosis. However, achieving higher accuracy is crucial for providing appropriate treatment to patients and facilitating prompt decision-making by radiologists. To address this, we propose the use of Convolutional Neural Networks (CNN) for brain tumor detection. Our approach utilizes a dataset consisting of two classes: three representing different tumor types and one representing non-tumor samples. We present a model that leverages pre-trained CNNs to categorize brain cancer cases. Additionally, data augmentation techniques are employed to augment the dataset size. The effectiveness of our proposed CNN model is evaluated through various metrics, including validation loss, confusion matrix, and overall loss. The proposed approach employing ResNet50 and EfficientNet demonstrated higher levels of accuracy, precision, and recall in detecting brain tumors.
Collapse
Affiliation(s)
- K Nishanth Rao
- Department of ECE, MLR Institute of Technology, Hyderabad, India
| | - Osamah Ibrahim Khalaf
- Department of Solar, Al-Nahrain Research Center for Renewable Energy, Al-Nahrain University, Jadriya, Baghdad, Iraq
| | - V Krishnasree
- Department of ECE, VNR Vignana Jyothi Institute of Engineering and Technology, Telangana, India
| | - Aruru Sai Kumar
- Department of ECE, VNR Vignana Jyothi Institute of Engineering and Technology, Telangana, India
| | - Deema Mohammed Alsekait
- Department of Computer Science and Information Technology, Applied College, Princess Nourah Bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
| | - S Siva Priyanka
- Department of ECE, Chaitanya Bharathi Institute of Technology, Telangana, India
| | - Ahmed Saleh Alattas
- Information Science Department, Faculty of Arts & Humanities, King Abdul-Aziz University, Jeddah, Saudi Arabia
| | - Diaa Salama AbdElminaam
- MEU Research Unit, Middle East University, Amman 11831, Jordan
- Jadara Research Center, Jadara University, Irbid, 21110, Jordan
| |
Collapse
|
6
|
Aziz N, Minallah N, Frnda J, Sher M, Zeeshan M, Durrani AH. Precision meets generalization: Enhancing brain tumor classification via pretrained DenseNet with global average pooling and hyperparameter tuning. PLoS One 2024; 19:e0307825. [PMID: 39241003 PMCID: PMC11379197 DOI: 10.1371/journal.pone.0307825] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Accepted: 07/04/2024] [Indexed: 09/08/2024] Open
Abstract
Brain tumors pose significant global health concerns due to their high mortality rates and limited treatment options. These tumors, arising from abnormal cell growth within the brain, exhibits various sizes and shapes, making their manual detection from magnetic resonance imaging (MRI) scans a subjective and challenging task for healthcare professionals, hence necessitating automated solutions. This study investigates the potential of deep learning, specifically the DenseNet architecture, to automate brain tumor classification, aiming to enhance accuracy and generalizability for clinical applications. We utilized the Figshare brain tumor dataset, comprising 3,064 T1-weighted contrast-enhanced MRI images from 233 patients with three prevalent tumor types: meningioma, glioma, and pituitary tumor. Four pre-trained deep learning models-ResNet, EfficientNet, MobileNet, and DenseNet-were evaluated using transfer learning from ImageNet. DenseNet achieved the highest test set accuracy of 96%, outperforming ResNet (91%), EfficientNet (91%), and MobileNet (93%). Therefore, we focused on improving the performance of the DenseNet, while considering it as base model. To enhance the generalizability of the base DenseNet model, we implemented a fine-tuning approach with regularization techniques, including data augmentation, dropout, batch normalization, and global average pooling, coupled with hyperparameter optimization. This enhanced DenseNet model achieved an accuracy of 97.1%. Our findings demonstrate the effectiveness of DenseNet with transfer learning and fine-tuning for brain tumor classification, highlighting its potential to improve diagnostic accuracy and reliability in clinical settings.
Collapse
Affiliation(s)
- Najam Aziz
- Department of Computer Systems Engineering, University of Engineering and Technology(UET), Peshawar, Khyber Pakhtunkhwa, Pakistan
- National Center for Big Data and Cloud Computing (NCBC), University of Engineering and Technology, Peshawar, Khyber Pakhtunkhwa, Pakistan
| | - Nasru Minallah
- Department of Computer Systems Engineering, University of Engineering and Technology(UET), Peshawar, Khyber Pakhtunkhwa, Pakistan
- National Center for Big Data and Cloud Computing (NCBC), University of Engineering and Technology, Peshawar, Khyber Pakhtunkhwa, Pakistan
| | - Jaroslav Frnda
- Department of Quantitative Methods and Economic Informatics, Faculty of Operation and Economics of Transport and Communication, University of Zilina, Zilina, Slovakia
- Department of Telecommunications, Faculty of Electrical Engineering and Computer Science, VSB - Technical University, Ostrava-Poruba, Czechia
| | - Madiha Sher
- Department of Computer Systems Engineering, University of Engineering and Technology(UET), Peshawar, Khyber Pakhtunkhwa, Pakistan
| | - Muhammad Zeeshan
- National Center for Big Data and Cloud Computing (NCBC), University of Engineering and Technology, Peshawar, Khyber Pakhtunkhwa, Pakistan
| | | |
Collapse
|
7
|
Yuan J. Brain tumor image segmentation method using hybrid attention module and improved mask RCNN. Sci Rep 2024; 14:20615. [PMID: 39232028 PMCID: PMC11375165 DOI: 10.1038/s41598-024-71250-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Accepted: 08/26/2024] [Indexed: 09/06/2024] Open
Abstract
To meet the needs of automated medical analysis of brain tumor magnetic resonance imaging, this study introduces an enhanced instance segmentation method built upon mask region-based convolutional neural network. By incorporating squeeze-and-excitation networks, a channel attention mechanism, and concatenated attention neural network, a spatial attention mechanism, the model can more adeptly focus on the critical regions and finer details of brain tumors. Residual network-50 combined attention module and feature pyramid network as the backbone network to effectively capture multi-scale characteristics of brain tumors. At the same time, the region proposal network and region of interest align technology were used to ensure that the segmentation area matched the actual tumor morphology. The originality of the research lies in the deep residual network that combines attention mechanism with feature pyramid network to replace the backbone based on mask region convolutional neural network, achieving an improvement in the efficiency of brain tumor feature extraction. After a series of experiments, the precision of the model is 90.72%, which is 0.76% higher than that of the original model. Recall was 91.68%, an increase of 0.95%; Mean Intersection over Union was 94.56%, an increase of 1.39%. This method achieves precise segmentation of brain tumor magnetic resonance imaging, and doctors can easily and accurately locate the tumor area through the segmentation results, thereby quickly measuring the diameter, area, and other information of the tumor, providing doctors with more comprehensive diagnostic information.
Collapse
Affiliation(s)
- Jinglin Yuan
- School of Applied Science, Macao Polytechnic University, Macau, 999078, China.
| |
Collapse
|
8
|
Kaur J, Kaur P. A systematic literature analysis of multi-organ cancer diagnosis using deep learning techniques. Comput Biol Med 2024; 179:108910. [PMID: 39032244 DOI: 10.1016/j.compbiomed.2024.108910] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2024] [Revised: 07/14/2024] [Accepted: 07/15/2024] [Indexed: 07/23/2024]
Abstract
Cancer is becoming the most toxic ailment identified among individuals worldwide. The mortality rate has been increasing rapidly every year, which causes progression in the various diagnostic technologies to handle this illness. The manual procedure for segmentation and classification with a large set of data modalities can be a challenging task. Therefore, a crucial requirement is to significantly develop the computer-assisted diagnostic system intended for the initial cancer identification. This article offers a systematic review of Deep Learning approaches using various image modalities to detect multi-organ cancers from 2012 to 2023. It emphasizes the detection of five supreme predominant tumors, i.e., breast, brain, lung, skin, and liver. Extensive review has been carried out by collecting research and conference articles and book chapters from reputed international databases, i.e., Springer Link, IEEE Xplore, Science Direct, PubMed, and Wiley that fulfill the criteria for quality evaluation. This systematic review summarizes the overview of convolutional neural network model architectures and datasets used for identifying and classifying the diverse categories of cancer. This study accomplishes an inclusive idea of ensemble deep learning models that have achieved better evaluation results for classifying the different images into cancer or healthy cases. This paper will provide a broad understanding to the research scientists within the domain of medical imaging procedures of which deep learning technique perform best over which type of dataset, extraction of features, different confrontations, and their anticipated solutions for the complex problems. Lastly, some challenges and issues which control the health emergency have been discussed.
Collapse
Affiliation(s)
- Jaspreet Kaur
- Department of Computer Engineering & Technology, Guru Nanak Dev University, Amritsar, Punjab, India.
| | - Prabhpreet Kaur
- Department of Computer Engineering & Technology, Guru Nanak Dev University, Amritsar, Punjab, India.
| |
Collapse
|
9
|
Gürsoy E, Kaya Y. Brain-GCN-Net: Graph-Convolutional Neural Network for brain tumor identification. Comput Biol Med 2024; 180:108971. [PMID: 39106672 DOI: 10.1016/j.compbiomed.2024.108971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Revised: 07/29/2024] [Accepted: 07/29/2024] [Indexed: 08/09/2024]
Abstract
BACKGROUND The intersection of artificial intelligence and medical image analysis has ushered in a new era of innovation and changed the landscape of brain tumor detection and diagnosis. Correct detection and classification of brain tumors based on medical images is crucial for early diagnosis and effective treatment. Convolutional Neural Network (CNN) models are widely used for disease detection. However, they are sometimes unable to sufficiently recognize the complex features of medical images. METHODS This paper proposes a fused Deep Learning (DL) model that combines Graph Neural Networks (GNN), which recognize relational dependencies of image regions, and CNN, which captures spatial features, is proposed to improve brain tumor detection. By integrating these two architectures, our model achieves a more comprehensive representation of brain tumor images and improves classification performance. The proposed model is evaluated on a public dataset of 10847 MRI images. The results show that the proposed model outperforms the existing pre-trained models and traditional CNN architectures. RESULTS The fused DL model achieves 93.68% accuracy in brain tumor classification. The results indicate that the proposed model outperforms the existing pre-trained models and traditional CNN architectures. CONCLUSION The numerical results suggest that the model should be further investigated for potential use in clinical trials to improve clinical decision-making.
Collapse
Affiliation(s)
- Ercan Gürsoy
- Department of Computer Engineering, Adana Alparslan Turkes Science and Technology University, Adana, 01250, Turkey.
| | - Yasin Kaya
- Department of Artificial Intelligence Engineering, Adana Alparslan Turkes Science and Technology University, Adana, 01250, Turkey.
| |
Collapse
|
10
|
Basha NK, Ananth C, Muthukumaran K, Sudhamsu G, Mittal V, Gared F. Mask region-based convolutional neural network and VGG-16 inspired brain tumor segmentation. Sci Rep 2024; 14:17615. [PMID: 39080324 PMCID: PMC11289405 DOI: 10.1038/s41598-024-66554-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2024] [Accepted: 07/02/2024] [Indexed: 08/02/2024] Open
Abstract
The process of brain tumour segmentation entails locating the tumour precisely in images. Magnetic Resonance Imaging (MRI) is typically used by doctors to find any brain tumours or tissue abnormalities. With the use of region-based Convolutional Neural Network (R-CNN) masks, Grad-CAM and transfer learning, this work offers an effective method for the detection of brain tumours. Helping doctors make extremely accurate diagnoses is the goal. A transfer learning-based model has been suggested that offers high sensitivity and accuracy scores for brain tumour detection when segmentation is done using R-CNN masks. To train the model, the Inception V3, VGG-16, and ResNet-50 architectures were utilised. The Brain MRI Images for Brain Tumour Detection dataset was utilised to develop this method. This work's performance is evaluated and reported in terms of recall, specificity, sensitivity, accuracy, precision, and F1 score. A thorough analysis has been done comparing the proposed model operating with three distinct architectures: VGG-16, Inception V3, and Resnet-50. Comparing the proposed model, which was influenced by the VGG-16, to related works also revealed its performance. Achieving high sensitivity and accuracy percentages was the main goal. Using this approach, an accuracy and sensitivity of around 99% were obtained, which was much greater than current efforts.
Collapse
Affiliation(s)
- Niha Kamal Basha
- School of Computer Science and Engineering, Vellore Institute of Technology (VIT), Vellore, Tamil Nadu, India
| | - Christo Ananth
- Samarkand State University, Samarkand, Uzbekistan
- Samarkand branch, Tashkent State University of Economics, Samarkand, Uzbekistan
| | - K Muthukumaran
- Department of BioMedical Engineering, Dhanalakshmi Srinivasan College of Engineering and Technology, Anna University, Chennai, Tamilnadu, India
| | - Gadug Sudhamsu
- Department of Computer Science and Engineering, School of Engineering and Technology, JAIN University, Bangalore, Karnataka, India
| | - Vikas Mittal
- Department of Electronics and Communication Engineering, Chandigarh University, Mohali, Punjab, 140413, India
| | - Fikreselam Gared
- Faculty of Electrical and Computer Engineering, Bahir Dar University, Bahir Dar, Ethiopia.
| |
Collapse
|
11
|
Kadhim YA, Guzel MS, Mishra A. A Novel Hybrid Machine Learning-Based System Using Deep Learning Techniques and Meta-Heuristic Algorithms for Various Medical Datatypes Classification. Diagnostics (Basel) 2024; 14:1469. [PMID: 39061605 PMCID: PMC11275302 DOI: 10.3390/diagnostics14141469] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Revised: 06/27/2024] [Accepted: 07/02/2024] [Indexed: 07/28/2024] Open
Abstract
Medicine is one of the fields where the advancement of computer science is making significant progress. Some diseases require an immediate diagnosis in order to improve patient outcomes. The usage of computers in medicine improves precision and accelerates data processing and diagnosis. In order to categorize biological images, hybrid machine learning, a combination of various deep learning approaches, was utilized, and a meta-heuristic algorithm was provided in this research. In addition, two different medical datasets were introduced, one covering the magnetic resonance imaging (MRI) of brain tumors and the other dealing with chest X-rays (CXRs) of COVID-19. These datasets were introduced to the combination network that contained deep learning techniques, which were based on a convolutional neural network (CNN) or autoencoder, to extract features and combine them with the next step of the meta-heuristic algorithm in order to select optimal features using the particle swarm optimization (PSO) algorithm. This combination sought to reduce the dimensionality of the datasets while maintaining the original performance of the data. This is considered an innovative method and ensures highly accurate classification results across various medical datasets. Several classifiers were employed to predict the diseases. The COVID-19 dataset found that the highest accuracy was 99.76% using the combination of CNN-PSO-SVM. In comparison, the brain tumor dataset obtained 99.51% accuracy, the highest accuracy derived using the combination method of autoencoder-PSO-KNN.
Collapse
Affiliation(s)
- Yezi Ali Kadhim
- College of Engineering, University of Baghdad, Jadriyah, Baghdad 10071, Iraq;
- Department of Modeling and Design of Engineering Systems (MODES), Atilim University, Ankara 06830, Turkey
- Department of Electrical and Electronics Engineering, Atilim University, Incek, Ankara 06830, Turkey
| | - Mehmet Serdar Guzel
- Department of Computer Engineering, Ankara University, Yenimahalle, Ankara 06100, Turkey;
| | - Alok Mishra
- Faculty of Engineering, Norwegian University of Science and Technology, 7034 Trondheim, Norway
- Department of Software Engineering, Atilim University, Incek, Ankara 06830, Turkey
| |
Collapse
|
12
|
Li C, Zhang F, Du Y, Li H. Classification of brain tumor types through MRIs using parallel CNNs and firefly optimization. Sci Rep 2024; 14:15057. [PMID: 38956224 PMCID: PMC11219740 DOI: 10.1038/s41598-024-65714-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2024] [Accepted: 06/24/2024] [Indexed: 07/04/2024] Open
Abstract
Image segmentation is a critical and challenging endeavor in the field of medicine. A magnetic resonance imaging (MRI) scan is a helpful method for locating any abnormal brain tissue these days. It is a difficult undertaking for radiologists to diagnose and classify the tumor from several pictures. This work develops an intelligent method for accurately identifying brain tumors. This research investigates the identification of brain tumor types from MRI data using convolutional neural networks and optimization strategies. Two novel approaches are presented: the first is a novel segmentation technique based on firefly optimization (FFO) that assesses segmentation quality based on many parameters, and the other is a combination of two types of convolutional neural networks to categorize tumor traits and identify the kind of tumor. These upgrades are intended to raise the general efficacy of the MRI scan technique and increase identification accuracy. Using MRI scans from BBRATS2018, the testing is carried out, and the suggested approach has shown improved performance with an average accuracy of 98.6%.
Collapse
Affiliation(s)
- Chen Li
- Department of Neurosurgery, Shandong Provincial Third Hospital, Shandong University, No.12 Wuyingshan Middle Road, Jinan, 250031, Shandong, China
| | - Faxue Zhang
- Department of Neurosurgery, Shandong Provincial Third Hospital, Shandong University, No.12 Wuyingshan Middle Road, Jinan, 250031, Shandong, China
| | - Yongjian Du
- Department of Neurosurgery, The Fifth People's Hospital of Jinan, No.24297, Jingshi Road, Jinan, 250022, Shandong, China
| | - Huachao Li
- Department of Neurosurgery, Shandong Provincial Third Hospital, Shandong University, No.12 Wuyingshan Middle Road, Jinan, 250031, Shandong, China.
| |
Collapse
|
13
|
Rai HM, Yoo J, Dashkevych S. Two-headed UNetEfficientNets for parallel execution of segmentation and classification of brain tumors: incorporating postprocessing techniques with connected component labelling. J Cancer Res Clin Oncol 2024; 150:220. [PMID: 38684578 PMCID: PMC11058623 DOI: 10.1007/s00432-024-05718-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Accepted: 03/21/2024] [Indexed: 05/02/2024]
Abstract
PURPOSE The purpose of this study is to develop accurate and automated detection and segmentation methods for brain tumors, given their significant fatality rates, with aggressive malignant tumors like Glioblastoma Multiforme (GBM) having a five-year survival rate as low as 5 to 10%. This underscores the urgent need to improve diagnosis and treatment outcomes through innovative approaches in medical imaging and deep learning techniques. METHODS In this work, we propose a novel approach utilizing the two-headed UNetEfficientNets model for simultaneous segmentation and classification of brain tumors from Magnetic Resonance Imaging (MRI) images. The model combines the strengths of EfficientNets and a modified two-headed Unet model. We utilized a publicly available dataset consisting of 3064 brain MR images classified into three tumor classes: Meningioma, Glioma, and Pituitary. To enhance the training process, we performed 12 types of data augmentation on the training dataset. We evaluated the methodology using six deep learning models, ranging from UNetEfficientNet-B0 to UNetEfficientNet-B5, optimizing the segmentation and classification heads using binary cross entropy (BCE) loss with Dice and BCE with focal loss, respectively. Post-processing techniques such as connected component labeling (CCL) and ensemble models were applied to improve segmentation outcomes. RESULTS The proposed UNetEfficientNet-B4 model achieved outstanding results, with an accuracy of 99.4% after postprocessing. Additionally, it obtained high scores for DICE (94.03%), precision (98.67%), and recall (99.00%) after post-processing. The ensemble technique further improved segmentation performance, with a global DICE score of 95.70% and Jaccard index of 91.20%. CONCLUSION Our study demonstrates the high efficiency and accuracy of the proposed UNetEfficientNet-B4 model in the automatic and parallel detection and segmentation of brain tumors from MRI images. This approach holds promise for improving diagnosis and treatment planning for patients with brain tumors, potentially leading to better outcomes and prognosis.
Collapse
Affiliation(s)
- Hari Mohan Rai
- School of Computing, Gachon University, 1342 Seongnam-daero, Sujeong-Gu, Seongnam-Si, 13120, Gyeonggi-Do, Republic of Korea.
| | - Joon Yoo
- School of Computing, Gachon University, 1342 Seongnam-daero, Sujeong-Gu, Seongnam-Si, 13120, Gyeonggi-Do, Republic of Korea
| | - Serhii Dashkevych
- Department of Computer Engineering, Vistula University, Stokłosy 3, 02-787, Warszawa, Poland
| |
Collapse
|
14
|
Asiri AA, Shaf A, Ali T, Pasha MA, Khan A, Irfan M, Alqahtani S, Alghamdi A, Alghamdi AH, Alshamrani AFA, Alelyani M, Alamri S. Advancing brain tumor detection: harnessing the Swin Transformer's power for accurate classification and performance analysis. PeerJ Comput Sci 2024; 10:e1867. [PMID: 38435590 PMCID: PMC10909192 DOI: 10.7717/peerj-cs.1867] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Accepted: 01/19/2024] [Indexed: 03/05/2024]
Abstract
The accurate detection of brain tumors through medical imaging is paramount for precise diagnoses and effective treatment strategies. In this study, we introduce an innovative and robust methodology that capitalizes on the transformative potential of the Swin Transformer architecture for meticulous brain tumor image classification. Our approach handles the classification of brain tumors across four distinct categories: glioma, meningioma, non-tumor, and pituitary, leveraging a dataset comprising 2,870 images. Employing the Swin Transformer architecture, our method intricately integrates a multifaceted pipeline encompassing sophisticated preprocessing, intricate feature extraction mechanisms, and a highly nuanced classification framework. Utilizing 21 matrices for performance evaluation across all four classes, these matrices provide a detailed insight into the model's behavior throughout the learning process, furthermore showcasing a graphical representation of confusion matrix, training and validation loss and accuracy. The standout performance parameter, accuracy, stands at an impressive 97%. This achievement outperforms established models like CNN, DCNN, ViT, and their variants in brain tumor classification. Our methodology's robustness and exceptional accuracy showcase its potential as a pioneering model in this domain, promising substantial advancements in accurate tumor identification and classification, thereby contributing significantly to the landscape of medical image analysis.
Collapse
Affiliation(s)
- Abdullah A. Asiri
- Radiological Sciences Department, College of Applied Medical Sciences, Najran University, Najran, Saudi Arabia
| | - Ahmad Shaf
- Department of Computer Science, COMSATS University Islamabad, Sahiwal Campus, Sahiwal, Pakistan
| | - Tariq Ali
- Department of Computer Science, COMSATS University Islamabad, Sahiwal Campus, Sahiwal, Pakistan
| | - Muhammad Ahmad Pasha
- Department of Computer Science, COMSATS University Islamabad, Sahiwal Campus, Sahiwal, Pakistan
| | - Aiza Khan
- Department of Computer Science, COMSATS University Islamabad, Sahiwal Campus, Sahiwal, Pakistan
| | - Muhammad Irfan
- Faculty of Electrical Engineering, Najran University, Najran, Saudi Arabia
| | - Saeed Alqahtani
- Radiological Sciences Department, College of Applied Medical Sciences, Najran University, Najran, Saudi Arabia
| | - Ahmad Alghamdi
- Radiological Sciences Department, College of Applied Medical Sciences, Taif University, Taif, Saudi Arabia
| | - Ali H. Alghamdi
- Department of Radiological Sciences, Faculty of Applied Medical Sciences, University of Tabuk, Tabuk, Saudi Arabia
| | - Abdullah Fahad A. Alshamrani
- Department of Diagnostic Radiology Technology, College of Applied Medical Sciences, Taibah University, Taibah, Saudi Arabia
| | - Magbool Alelyani
- Department of Radiological Sciences, College of Applied Medical Science, King Khalid University, Abha, Saudi Arabia
| | - Sultan Alamri
- Radiological Sciences Department, College of Applied Medical Sciences, Taif University, Taif, Saudi Arabia
| |
Collapse
|
15
|
Bhatt A, Nigam VS. Highly accurate brain tumor detection with high sensitivity using transform-based functions and machine learning algorithms. Technol Health Care 2024; 32:4239-4256. [PMID: 39177617 PMCID: PMC11612949 DOI: 10.3233/thc-240052] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2024] [Accepted: 04/16/2024] [Indexed: 08/24/2024]
Abstract
BACKGROUND Brain tumor is an extremely dangerous disease with a very high mortality rate worldwide. Detecting brain tumors accurately is crucial due to the varying appearance of tumor cells and the dimensional irregularities in their growth. This poses a significant challenge for detection algorithms. Currently, there are numerous algorithms utilized for this purpose, ranging from transform-based methods to those rooted in machine learning techniques. These algorithms aim to enhance the accuracy of detection despite the complexities involved in identifying brain tumor cells. The major limitation of these algorithms is the mapping of extracted features of a brain tumor in the classification algorithms. OBJECTIVE To employ a combination of transform methods to extract texture feature from brain tumor images. METHODS This paper employs a combination of transform methods based on sub band decomposition for texture feature extraction from MRI scans, hybrid feature optimization methods using firefly and glow-worm algorithms for selection of feature, employment of MKSVM algorithm and stacking ensemble classifier for classification and application of the feature of fusion of different feature extraction methods. RESULTS The algorithm under consideration has been put into practice using MATLAB, utilizing datasets from BRATS (Brain Tumor Segmentation) for the years 2013, 2015, and 2018. These datasets serve as the foundation for testing and validating the algorithm's performance across different time periods, providing a comprehensive assessment of its effectiveness in detecting brain tumors. The proposed algorithm achieves maximum detection accuracy, detection sensitivity and specificity up to 98%, 99% and 99.5% respectively. The experimental outcomes showcase the efficiency of the algorithm in detection of brain tumor. CONCLUSION The proposed work mainly contributes in brain tumor detection in the following aspects: a) use of combination of transform methods for texture feature extraction from MRI scans b) hybrid feature selection methods using firefly and glow-worm optimization algorithms for selection of feature c) employment of MKSVM algorithm and stacking ensemble classifier for classification and application of the feature of fusion of different feature extraction methods.
Collapse
Affiliation(s)
- Ashish Bhatt
- University Institute of Technology, Rajiv Gandhi Proudyogiki Vishwavidyalaya (RGPV), Bhopal, India
| | - Vineeta Saxena Nigam
- University Institute of Technology, Rajiv Gandhi Proudyogiki Vishwavidyalaya (RGPV), Bhopal, India
| |
Collapse
|
16
|
Rai HM, Yoo J. A comprehensive analysis of recent advancements in cancer detection using machine learning and deep learning models for improved diagnostics. J Cancer Res Clin Oncol 2023; 149:14365-14408. [PMID: 37540254 DOI: 10.1007/s00432-023-05216-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Accepted: 07/26/2023] [Indexed: 08/05/2023]
Abstract
PURPOSE There are millions of people who lose their life due to several types of fatal diseases. Cancer is one of the most fatal diseases which may be due to obesity, alcohol consumption, infections, ultraviolet radiation, smoking, and unhealthy lifestyles. Cancer is abnormal and uncontrolled tissue growth inside the body which may be spread to other body parts other than where it has originated. Hence it is very much required to diagnose the cancer at an early stage to provide correct and timely treatment. Also, manual diagnosis and diagnostic error may cause of the death of many patients hence much research are going on for the automatic and accurate detection of cancer at early stage. METHODS In this paper, we have done the comparative analysis of the diagnosis and recent advancement for the detection of various cancer types using traditional machine learning (ML) and deep learning (DL) models. In this study, we have included four types of cancers, brain, lung, skin, and breast and their detection using ML and DL techniques. In extensive review we have included a total of 130 pieces of literature among which 56 are of ML-based and 74 are from DL-based cancer detection techniques. Only the peer reviewed research papers published in the recent 5-year span (2018-2023) have been included for the analysis based on the parameters, year of publication, feature utilized, best model, dataset/images utilized, and best accuracy. We have reviewed ML and DL-based techniques for cancer detection separately and included accuracy as the performance evaluation metrics to maintain the homogeneity while verifying the classifier efficiency. RESULTS Among all the reviewed literatures, DL techniques achieved the highest accuracy of 100%, while ML techniques achieved 99.89%. The lowest accuracy achieved using DL and ML approaches were 70% and 75.48%, respectively. The difference in accuracy between the highest and lowest performing models is about 28.8% for skin cancer detection. In addition, the key findings, and challenges for each type of cancer detection using ML and DL techniques have been presented. The comparative analysis between the best performing and worst performing models, along with overall key findings and challenges, has been provided for future research purposes. Although the analysis is based on accuracy as the performance metric and various parameters, the results demonstrate a significant scope for improvement in classification efficiency. CONCLUSION The paper concludes that both ML and DL techniques hold promise in the early detection of various cancer types. However, the study identifies specific challenges that need to be addressed for the widespread implementation of these techniques in clinical settings. The presented results offer valuable guidance for future research in cancer detection, emphasizing the need for continued advancements in ML and DL-based approaches to improve diagnostic accuracy and ultimately save more lives.
Collapse
Affiliation(s)
- Hari Mohan Rai
- School of Computing, Gachon University, 1342 Seongnam-daero, Sujeong-gu, Seongnam-si, 13120, Gyeonggi-do, Republic of Korea.
| | - Joon Yoo
- School of Computing, Gachon University, 1342 Seongnam-daero, Sujeong-gu, Seongnam-si, 13120, Gyeonggi-do, Republic of Korea
| |
Collapse
|
17
|
Sun H, Yang S, Chen L, Liao P, Liu X, Liu Y, Wang N. Brain tumor image segmentation based on improved FPN. BMC Med Imaging 2023; 23:172. [PMID: 37904116 PMCID: PMC10617057 DOI: 10.1186/s12880-023-01131-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Accepted: 10/19/2023] [Indexed: 11/01/2023] Open
Abstract
PURPOSE Automatic segmentation of brain tumors by deep learning algorithm is one of the research hotspots in the field of medical image segmentation. An improved FPN network for brain tumor segmentation is proposed to improve the segmentation effect of brain tumor. MATERIALS AND METHODS Aiming at the problem that the traditional full convolutional neural network (FCN) has weak processing ability, which leads to the loss of details in tumor segmentation, this paper proposes a brain tumor image segmentation method based on the improved feature pyramid networks (FPN) convolutional neural network. In order to improve the segmentation effect of brain tumors, we improved the model, introduced the FPN structure into the U-Net structure, captured the context multi-scale information by using the different scale information in the U-Net model and the multi receptive field high-level features in the FPN convolutional neural network, and improved the adaptability of the model to different scale features. RESULTS Performance evaluation indicators show that the proposed improved FPN model has 99.1% accuracy, 92% DICE rating and 86% Jaccard index. The performance of the proposed method outperforms other segmentation models in each metric. In addition, the schematic diagram of the segmentation results shows that the segmentation results of our algorithm are closer to the ground truth, showing more brain tumour details, while the segmentation results of other algorithms are smoother. CONCLUSIONS The experimental results show that this method can effectively segment brain tumor regions and has certain generalization, and the segmentation effect is better than other networks. It has positive significance for clinical diagnosis of brain tumors.
Collapse
Affiliation(s)
- Haitao Sun
- Department of Radiotherapy Room, Zhongshan Hospital of Traditional Chinese Medicine, ZhongShanGuangdong Province, 528400, China
| | - Shuai Yang
- Department of Radiotherapy and Minimally Invasive Surgery, The Cancer Center of The Fifth Affiliated Hospital of Sun Yat-Sen University, Zhuhai, 519020, China
| | - Lijuan Chen
- Department of Radiotherapy Room, Zhongshan Hospital of Traditional Chinese Medicine, ZhongShanGuangdong Province, 528400, China
| | - Pingyan Liao
- Department of Radiotherapy Room, Zhongshan Hospital of Traditional Chinese Medicine, ZhongShanGuangdong Province, 528400, China
| | - Xiangping Liu
- Department of Radiotherapy Room, Zhongshan Hospital of Traditional Chinese Medicine, ZhongShanGuangdong Province, 528400, China
| | - Ying Liu
- Department of the Radiotherapy, The Fifth Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510060, China
| | - Ning Wang
- Department of Radiotherapy Room, Zhongshan Hospital of Traditional Chinese Medicine, ZhongShanGuangdong Province, 528400, China.
| |
Collapse
|
18
|
Ahmed MAO, Abbas IA, AbdelSatar Y. HDSNE a new unsupervised multiple image database fusion learning algorithm with flexible and crispy production of one database: a proof case study of lung infection diagnose In chest X-ray images. BMC Med Imaging 2023; 23:134. [PMID: 37718458 PMCID: PMC10506286 DOI: 10.1186/s12880-023-01078-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Accepted: 08/16/2023] [Indexed: 09/19/2023] Open
Abstract
Continuous release of image databases with fully or partially identical inner categories dramatically deteriorates the production of autonomous Computer-Aided Diagnostics (CAD) systems for true comprehensive medical diagnostics. The first challenge is the frequent massive bulk release of medical image databases, which often suffer from two common drawbacks: image duplication and corruption. The many subsequent releases of the same data with the same classes or categories come with no clear evidence of success in the concatenation of those identical classes among image databases. This issue stands as a stumbling block in the path of hypothesis-based experiments for the production of a single learning model that can successfully classify all of them correctly. Removing redundant data, enhancing performance, and optimizing energy resources are among the most challenging aspects. In this article, we propose a global data aggregation scale model that incorporates six image databases selected from specific global resources. The proposed valid learner is based on training all the unique patterns within any given data release, thereby creating a unique dataset hypothetically. The Hash MD5 algorithm (MD5) generates a unique hash value for each image, making it suitable for duplication removal. The T-Distributed Stochastic Neighbor Embedding (t-SNE), with a tunable perplexity parameter, can represent data dimensions. Both the Hash MD5 and t-SNE algorithms are applied recursively, producing a balanced and uniform database containing equal samples per category: normal, pneumonia, and Coronavirus Disease of 2019 (COVID-19). We evaluated the performance of all proposed data and the new automated version using the Inception V3 pre-trained model with various evaluation metrics. The performance outcome of the proposed scale model showed more respectable results than traditional data aggregation, achieving a high accuracy of 98.48%, along with high precision, recall, and F1-score. The results have been proved through a statistical t-test, yielding t-values and p-values. It's important to emphasize that all t-values are undeniably significant, and the p-values provide irrefutable evidence against the null hypothesis. Furthermore, it's noteworthy that the Final dataset outperformed all other datasets across all metric values when diagnosing various lung infections with the same factors.
Collapse
Affiliation(s)
- Muhammad Atta Othman Ahmed
- Department of Computer Science, Faculty of Computers and Information, Luxor University, Luxor, 85951, Egypt.
| | - Ibrahim A Abbas
- Mathematics Department, Faculty of Science, Sohag University, Sohag, 82511, Egypt
| | - Yasser AbdelSatar
- Mathematics Department, Faculty of Science, Sohag University, Sohag, 82511, Egypt
| |
Collapse
|
19
|
Dasari Y, Duffin J, Sayin ES, Levine HT, Poublanc J, Para AE, Mikulis DJ, Fisher JA, Sobczyk O, Khamesee MB. Convolutional Neural Networks to Assess Steno-Occlusive Disease Using Cerebrovascular Reactivity. Healthcare (Basel) 2023; 11:2231. [PMID: 37628429 PMCID: PMC10454585 DOI: 10.3390/healthcare11162231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 07/31/2023] [Accepted: 08/05/2023] [Indexed: 08/27/2023] Open
Abstract
Cerebrovascular Reactivity (CVR) is a provocative test used with Blood oxygenation level-dependent (BOLD) Magnetic Resonance Imaging (MRI) studies, where a vasoactive stimulus is applied and the corresponding changes in the cerebral blood flow (CBF) are measured. The most common clinical application is the assessment of cerebral perfusion insufficiency in patients with steno-occlusive disease (SOD). Globally, millions of people suffer from cerebrovascular diseases, and SOD is the most common cause of ischemic stroke. Therefore, CVR analyses can play a vital role in early diagnosis and guiding clinical treatment. This study develops a convolutional neural network (CNN)-based clinical decision support system to facilitate the screening of SOD patients by discriminating between healthy and unhealthy CVR maps. The networks were trained on a confidential CVR dataset with two classes: 68 healthy control subjects, and 163 SOD patients. This original dataset was distributed in a ratio of 80%-10%-10% for training, validation, and testing, respectively, and image augmentations were applied to the training and validation sets. Additionally, some popular pre-trained networks were imported and customized for the objective classification task to conduct transfer learning experiments. Results indicate that a customized CNN with a double-stacked convolution layer architecture produces the best results, consistent with expert clinical readings.
Collapse
Affiliation(s)
- Yashesh Dasari
- Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada;
| | - James Duffin
- Department of Physiology, University of Toronto, Toronto, ON M5S 1A8, Canada
- Department of Anesthesia and Pain Management, University Health Network, Toronto, ON M5G 2C4, Canada
| | - Ece Su Sayin
- Department of Physiology, University of Toronto, Toronto, ON M5S 1A8, Canada
- Department of Anesthesia and Pain Management, University Health Network, Toronto, ON M5G 2C4, Canada
| | - Harrison T. Levine
- Department of Physiology, University of Toronto, Toronto, ON M5S 1A8, Canada
- Department of Anesthesia and Pain Management, University Health Network, Toronto, ON M5G 2C4, Canada
| | - Julien Poublanc
- Joint Department of Medical Imaging and the Functional Neuroimaging Laboratory, University Health Network, Toronto, ON M5G 2C4, Canada
| | - Andrea E. Para
- Joint Department of Medical Imaging and the Functional Neuroimaging Laboratory, University Health Network, Toronto, ON M5G 2C4, Canada
| | - David J. Mikulis
- Joint Department of Medical Imaging and the Functional Neuroimaging Laboratory, University Health Network, Toronto, ON M5G 2C4, Canada
- Institute of Medical Sciences, University of Toronto, Toronto, ON M5S 1A8, Canada
| | - Joseph A. Fisher
- Department of Physiology, University of Toronto, Toronto, ON M5S 1A8, Canada
- Department of Anesthesia and Pain Management, University Health Network, Toronto, ON M5G 2C4, Canada
- Institute of Medical Sciences, University of Toronto, Toronto, ON M5S 1A8, Canada
| | - Olivia Sobczyk
- Department of Anesthesia and Pain Management, University Health Network, Toronto, ON M5G 2C4, Canada
- Joint Department of Medical Imaging and the Functional Neuroimaging Laboratory, University Health Network, Toronto, ON M5G 2C4, Canada
| | - Mir Behrad Khamesee
- Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada;
| |
Collapse
|
20
|
Hammad M, ElAffendi M, Ateya AA, Abd El-Latif AA. Efficient Brain Tumor Detection with Lightweight End-to-End Deep Learning Model. Cancers (Basel) 2023; 15:2837. [PMID: 37345173 PMCID: PMC10216217 DOI: 10.3390/cancers15102837] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 04/25/2023] [Accepted: 04/28/2023] [Indexed: 06/23/2023] Open
Abstract
In the field of medical imaging, deep learning has made considerable strides, particularly in the diagnosis of brain tumors. The Internet of Medical Things (IoMT) has made it possible to combine these deep learning models into advanced medical devices for more accurate and efficient diagnosis. Convolutional neural networks (CNNs) are a popular deep learning technique for brain tumor detection because they can be trained on vast medical imaging datasets to recognize cancers in new images. Despite its benefits, which include greater accuracy and efficiency, deep learning has disadvantages, such as high computing costs and the possibility of skewed findings due to inadequate training data. Further study is needed to fully understand the potential and limitations of deep learning in brain tumor detection in the IoMT and to overcome the obstacles associated with real-world implementation. In this study, we propose a new CNN-based deep learning model for brain tumor detection. The suggested model is an end-to-end model, which reduces the system's complexity in comparison to earlier deep learning models. In addition, our model is lightweight, as it is built from a small number of layers compared to other previous models, which makes the model suitable for real-time applications. The optimistic findings of a rapid increase in accuracy (99.48% for binary class and 96.86% for multi-class) demonstrate that the new framework model has excelled in the competition. This study demonstrates that the suggested deep model outperforms other CNNs for detecting brain tumors. Additionally, the study provides a framework for secure data transfer of medical lab results with security recommendations to ensure security in the IoMT.
Collapse
Affiliation(s)
- Mohamed Hammad
- EIAS Data Science Lab, College of Computer and Information Sciences, Prince Sultan University, Riyadh 11586, Saudi Arabia; (M.E.); (A.A.A.)
- Department of Information Technology, Faculty of Computers and Information, Menoufia University, Shibin El Kom 32511, Egypt
| | - Mohammed ElAffendi
- EIAS Data Science Lab, College of Computer and Information Sciences, Prince Sultan University, Riyadh 11586, Saudi Arabia; (M.E.); (A.A.A.)
| | - Abdelhamied A. Ateya
- EIAS Data Science Lab, College of Computer and Information Sciences, Prince Sultan University, Riyadh 11586, Saudi Arabia; (M.E.); (A.A.A.)
- Department of Electronics and Communications Engineering, Zagazig University, Zagazig 44519, Egypt
| | - Ahmed A. Abd El-Latif
- EIAS Data Science Lab, College of Computer and Information Sciences, Prince Sultan University, Riyadh 11586, Saudi Arabia; (M.E.); (A.A.A.)
- Department of Mathematics and Computer Science, Faculty of Science, Menoufia University, Shebin El Koom 32511, Egypt
| |
Collapse
|
21
|
Srinivasan S, Bai PSM, Mathivanan SK, Muthukumaran V, Babu JC, Vilcekova L. Grade Classification of Tumors from Brain Magnetic Resonance Images Using a Deep Learning Technique. Diagnostics (Basel) 2023; 13:diagnostics13061153. [PMID: 36980463 PMCID: PMC10046932 DOI: 10.3390/diagnostics13061153] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 02/14/2023] [Accepted: 03/14/2023] [Indexed: 03/22/2023] Open
Abstract
To improve the accuracy of tumor identification, it is necessary to develop a reliable automated diagnostic method. In order to precisely categorize brain tumors, researchers developed a variety of segmentation algorithms. Segmentation of brain images is generally recognized as one of the most challenging tasks in medical image processing. In this article, a novel automated detection and classification method was proposed. The proposed approach consisted of many phases, including pre-processing MRI images, segmenting images, extracting features, and classifying images. During the pre-processing portion of an MRI scan, an adaptive filter was utilized to eliminate background noise. For feature extraction, the local-binary grey level co-occurrence matrix (LBGLCM) was used, and for image segmentation, enhanced fuzzy c-means clustering (EFCMC) was used. After extracting the scan features, we used a deep learning model to classify MRI images into two groups: glioma and normal. The classifications were created using a convolutional recurrent neural network (CRNN). The proposed technique improved brain image classification from a defined input dataset. MRI scans from the REMBRANDT dataset, which consisted of 620 testing and 2480 training sets, were used for the research. The data demonstrate that the newly proposed method outperformed its predecessors. The proposed CRNN strategy was compared against BP, U-Net, and ResNet, which are three of the most prevalent classification approaches currently being used. For brain tumor classification, the proposed system outcomes were 98.17% accuracy, 91.34% specificity, and 98.79% sensitivity.
Collapse
Affiliation(s)
- Saravanan Srinivasan
- Department of Computer Science and Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Chennai 600062, India
| | | | - Sandeep Kumar Mathivanan
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore 632014, India
| | - Venkatesan Muthukumaran
- Department of Mathematics, College of Engineering and Technology, SRM Institute of Science and Technology, Kattankulathur 603203, India
| | - Jyothi Chinna Babu
- Department of Electronics and Communications Engineering, Annamacharya Institute of Technology and Sciences, Rajampet 516126, India
| | - Lucia Vilcekova
- Faculty of Management, Comenius University Bratislava, Odbojarov 10, 820 05 Bratislava, Slovakia
- Correspondence:
| |
Collapse
|
22
|
M G, K PL, Arumugam SR, N S. Conditional random field-recurrent neural network segmentation with optimized deep learning for brain tumour classification using magnetic resonance imaging. THE IMAGING SCIENCE JOURNAL 2023. [DOI: 10.1080/13682199.2023.2178611] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2023]
Affiliation(s)
- Geetha M
- Department of Computer Science and Engineering, Chennai Institute of Technology, Chennai, India
| | - Prasanna Lakshmi K
- Department of Information Technology, Gokaraju Rangaraju Institute of Engineering and Technology, Hyderabad, India
| | - Sajeev Ram Arumugam
- Department of Computer Science and Engineering, Sri Krishna College of Engineering and Technology, Coimbatore, India
| | - Sandhya N
- Department of CSE, VNR Vignana Jyothi Institute of Engineering and Technology, Hyderabad, India
| |
Collapse
|
23
|
Madhavan MV, Khamparia A, Pande SD. An augmented customized deep learning approach for brain tumour identification. THE IMAGING SCIENCE JOURNAL 2023. [DOI: 10.1080/13682199.2023.2182382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2023]
Affiliation(s)
- Mangena Venu Madhavan
- School of Computer Science and Engineering, Lovely Professional University, Phagwara, India
| | - Aditya Khamparia
- Department of Computer Science, Babasaheb Bhimrao Ambedkar University, Satellite Center, Amethi, India
| | - Sagar Dhanraj Pande
- School of Computer Science and Engineering (SCOPE), VIT-AP University, Amaravati, India
| |
Collapse
|
24
|
Maurya S, Tiwari S, Mothukuri MC, Tangeda CM, Nandigam RNS, Addagiri DC. A review on recent developments in cancer detection using Machine Learning and Deep Learning models. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
25
|
Rana MM, Moon MAM, Hossain MS, Rahman MN, Zehadi MNN, Tithy TA, Hasan MM. Exploring the Effectiveness of Various Machine Learning Algorithms for Detecting Brain Tumors in MRI Images. LECTURE NOTES IN NETWORKS AND SYSTEMS 2023:367-378. [DOI: 10.1007/978-981-99-3878-0_31] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2025]
|
26
|
Semantic segmentation in medical images through transfused convolution and transformer networks. APPL INTELL 2023; 53:1132-1148. [PMID: 35498554 PMCID: PMC9035506 DOI: 10.1007/s10489-022-03642-w] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/15/2022] [Indexed: 01/06/2023]
Abstract
Recent decades have witnessed rapid development in the field of medical image segmentation. Deep learning-based fully convolution neural networks have played a significant role in the development of automated medical image segmentation models. Though immensely effective, such networks only take into account localized features and are unable to capitalize on the global context of medical image. In this paper, two deep learning based models have been proposed namely USegTransformer-P and USegTransformer-S. The proposed models capitalize upon local features and global features by amalgamating the transformer-based encoders and convolution-based encoders to segment medical images with high precision. Both the proposed models deliver promising results, performing better than the previous state of the art models in various segmentation tasks such as Brain tumor, Lung nodules, Skin lesion and Nuclei segmentation. The authors believe that the ability of USegTransformer-P and USegTransformer-S to perform segmentation with high precision could remarkably benefit medical practitioners and radiologists around the world.
Collapse
|
27
|
Akyol K. Automatic classification of brain magnetic resonance images with hypercolumn deep features and machine learning. Phys Eng Sci Med 2022; 45:935-947. [PMID: 35997926 DOI: 10.1007/s13246-022-01166-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Accepted: 07/24/2022] [Indexed: 11/26/2022]
Abstract
Brain tumours are life-threatening and their early detection is very important in a patient's life. At the present time, magnetic resonance imaging is one of the methods used for detecting brain tumours. Expert decision support systems serve specialist physicians to make more accurate diagnoses by minimizing the errors arising from their subjective opinions in real clinical settings. The model proposed in this study detects important keypoints and then extracts hypercolumn deep features of these keypoints from some convolutional layers of VGG16. Finally, Random Forest and Logistic Regression classifiers are fed with a set of these features. Random Forest classifier offered the best performance with 94.51% accuracy, 91.61% sensitivity, 8.39% false-negative rate, 97.42% specificity, and 97.29% precision using fivefold cross-validation in this study. Consequently, it is thought that the proposed model could contribute to field experts by integrating it into computer-aided brain magnetic resonance imaging diagnosis systems.
Collapse
Affiliation(s)
- Kemal Akyol
- Department of Computer Engineering, Kastamonu University, Kastamonu, Turkey.
| |
Collapse
|
28
|
Zhao X, Lai JW, Wah Ho AF, Liu N, Hock Ong ME, Cheong KH. Predicting hospital emergency department visits with deep learning approaches. Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2022.07.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
29
|
Mary SR, Kumar V, Venkatesan KJP, Kumar RS, Jagini NP, Srinivas A. Vulture-Based AdaBoost-Feedforward Neural Frame Work for COVID-19 Prediction and Severity Analysis System. Interdiscip Sci 2022; 14:582-595. [PMID: 35192173 PMCID: PMC8861288 DOI: 10.1007/s12539-022-00505-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2021] [Revised: 01/20/2022] [Accepted: 01/28/2022] [Indexed: 11/20/2022]
Abstract
In today's scenario, many scientists and medical researchers have been involved in deep research for discovering the desired medicine to reduce the spread of COVID-19 disease. However, still, it is not the end. Hence, predicting the COVID possibility in an early stage is the most required matter to reduce the death risks. Therefore, many researchers have focused on designing an early prediction mechanism in the basis of deep learning (DL), machine learning (Ml), etc., on detecting the COVID virus and severity in the human body in an earlier stage. However, the complexity of X-ray images has made it difficult to attain the finest prediction accuracy. Hence, the present research work has aimed to develop a novel Vulture Based Adaboost-Feedforward Neural (VbAFN) scheme to forecast the COVID-19 severity early. Here, the chest X-ray images were employed to identify the COVID risk feature in humans. The preprocessing function is done in the initial phase; the error-free data is imported to the classification layer for the feature extraction and segmentation process. This investigation aims to track and segment the affected parts from the trained X-ray images by the vulture fitness and to segment them with a good exactness rate. Subsequently, the designed model has gained a better segmentation accuracy of 99.9% and a lower error rate of 0.0145, which is better than other compared models. Hence, this proposed model in medical applications will offer the finest results.
Collapse
|
30
|
Early Diagnosis of Brain Tumour MRI Images Using Hybrid Techniques between Deep and Machine Learning. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:8330833. [PMID: 35633922 PMCID: PMC9132638 DOI: 10.1155/2022/8330833] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/27/2021] [Revised: 04/15/2022] [Accepted: 04/23/2022] [Indexed: 01/01/2023]
Abstract
Cancer is considered one of the most aggressive and destructive diseases that shortens the average lives of patients. Misdiagnosed brain tumours lead to false medical intervention, which reduces patients' chance of survival. Accurate early medical diagnoses of brain tumour are an essential point for starting treatment plans that improve the survival of patients with brain tumours. Computer-aided diagnostic systems have provided consecutive successes for helping medical doctors make accurate diagnoses and have conducted positive strides in the field of deep and machine learning. Deep convolutional layers extract strong distinguishing features from the regions of interest compared with those extracted using traditional methods. In this study, different experiments are performed for brain tumour diagnosis by combining deep learning and traditional machine learning techniques. AlexNet and ResNet-18 are used with the support vector machine (SVM) algorithm for brain tumour classification and diagnosis. Brain tumour magnetic resonance imaging (MRI) images are enhanced using the average filter technique. Then, deep learning techniques are applied to extract robust and important deep features via deep convolutional layers. The process of combining deep and machine learning techniques starts, where features are extracted using deep learning techniques, namely, AlexNet and ResNet-18. These features are then classified using SoftMax and SVM. The MRI dataset contains 3,060 images divided into four classes, which are three tumours and one normal. All systems have achieved superior results. Specifically, the AlexNet+SVM hybrid technique exhibits the best performance, with 95.10% accuracy, 95.25% sensitivity, and 98.50% specificity.
Collapse
|
31
|
Agalya V, Kandasamy M, Venugopal E, Maram B. CPRO: Competitive Poor and Rich Optimizer-Enabled Deep Learning Model and Holoentropy Weighted-Power K-Means Clustering for Brain Tumor Classification Using MRI. INT J PATTERN RECOGN 2022. [DOI: 10.1142/s0218001422520085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
A brain tumor is a collection of irregular and needless cell development in the brain region, and it is considered a life-threatening disease. Therefore, early level segmentation and brain tumor detection with Magnetic Resonance Imaging (MRI) is more important to save the patient’s life. Moreover, MRI is more effective in identifying patients with brain tumors since the recognition of this modality is moderately larger than considering other imaging modalities. The classification of brain tumors is the most important, difficult task in medical imaging systems because of size, appearance and shape variations. In this paper, Competitive Poor and Rich Optimization (CPRO)-based Deep Quantum Neural Network (Deep QNN) is proposed for brain tumor classification. Additionally, the pre-processing process assists in eradicating noises and uses image intensity to eliminate the artifacts. The significant features are extracted from pre-processed image to perform a productive classification process. The Deep QNN classifier is employed for classifying the brain tumor regions. Besides, the Deep QNN classifier is trained by the developed CPRO approach, which is newly designed by integrating Poor and Rich Optimization (PRO) and Competitive Swarm Optimizer (CSO). The developed brain tumor detection model outperformed other existing models with accuracy, sensitivity and specificity of 94.44%, 97.60% and 93.78%.
Collapse
Affiliation(s)
- V. Agalya
- Department of Electrical & Electronics Engineering, New Horizon College of Engineering (Autonomous), Bengaluru 560103, Karnataka, India
| | - Manivel Kandasamy
- Unitedworld School of Computational Intelligence Karnavati University, Uvarsad, Gandhinagar 382422, Gujarat, India
| | - Ellappan Venugopal
- Department of Electronics and Communication Engineering, School of Electrical Engineering & Computing, Adama Science and Technology University Adama, Oromia Region, Ethiopia
| | - Balajee Maram
- Department of Computer Science and Engineering, GMR Institute of Technology Rajam, Srikakulam 532127, Andhra Pradesh, India
| |
Collapse
|
32
|
Joel MZ, Umrao S, Chang E, Choi R, Yang DX, Duncan JS, Omuro A, Herbst R, Krumholz HM, Aneja S. Using Adversarial Images to Assess the Robustness of Deep Learning Models Trained on Diagnostic Images in Oncology. JCO Clin Cancer Inform 2022; 6:e2100170. [PMID: 35271304 PMCID: PMC8932490 DOI: 10.1200/cci.21.00170] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023] Open
Abstract
Deep learning (DL) models have rapidly become a popular and cost-effective tool for image classification within oncology. A major limitation of DL models is their vulnerability to adversarial images, manipulated input images designed to cause misclassifications by DL models. The purpose of the study is to investigate the robustness of DL models trained on diagnostic images using adversarial images and explore the utility of an iterative adversarial training approach to improve the robustness of DL models against adversarial images. Exploring vulnerabilities of deep learning algorithms to adversarial images across oncologic imaging modalities.![]()
Collapse
Affiliation(s)
- Marina Z Joel
- Department of Therapeutic Radiology, Yale School of Medicine, New Haven, CT
| | - Sachin Umrao
- Department of Therapeutic Radiology, Yale School of Medicine, New Haven, CT
| | - Enoch Chang
- Department of Therapeutic Radiology, Yale School of Medicine, New Haven, CT
| | - Rachel Choi
- Department of Therapeutic Radiology, Yale School of Medicine, New Haven, CT
| | - Daniel X Yang
- Department of Therapeutic Radiology, Yale School of Medicine, New Haven, CT
| | - James S Duncan
- Department of Biomedical Engineering, Yale University, New Haven, CT
| | - Antonio Omuro
- Department of Neurology, Yale School of Medicine, New Haven, CT
| | - Roy Herbst
- Department of Medicine, Yale School of Medicine, New Haven, CT
| | - Harlan M Krumholz
- Department of Medicine, Yale School of Medicine, New Haven, CT.,Center for Outcomes Research and Evaluation at Yale (CORE), New Haven, CT
| | - Sanjay Aneja
- Department of Therapeutic Radiology, Yale School of Medicine, New Haven, CT.,Center for Outcomes Research and Evaluation at Yale (CORE), New Haven, CT
| |
Collapse
|
33
|
Sathies Kumar T, Arun C, Ezhumalai P. An approach for brain tumor detection using optimal feature selection and optimized deep belief network. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103440] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
34
|
Parida PK, Dora L, Swain M, Agrawal S, Panda R. Data science methodologies in smart healthcare: a review. HEALTH AND TECHNOLOGY 2022. [DOI: 10.1007/s12553-022-00648-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
35
|
Automated Structural Analysis and Quantitative Characterization of Scar Tissue Using Machine Learning. Diagnostics (Basel) 2022; 12:diagnostics12020534. [PMID: 35204623 PMCID: PMC8871086 DOI: 10.3390/diagnostics12020534] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Revised: 02/17/2022] [Accepted: 02/17/2022] [Indexed: 11/17/2022] Open
Abstract
An analysis of scar tissue is necessary to understand the pathological tissue conditions during or after the wound healing process. Hematoxylin and eosin (HE) staining has conventionally been applied to understand the morphology of scar tissue. However, the scar lesions cannot be analyzed from a whole slide image. The current study aimed to develop a method for the rapid and automatic characterization of scar lesions in HE-stained scar tissues using a supervised and unsupervised learning algorithm. The supervised learning used a Mask region-based convolutional neural network (RCNN) to train a pattern from a data representation using MMDetection tools. The K-means algorithm characterized the HE-stained tissue and extracted the main features, such as the collagen density and directional variance of the collagen. The Mask RCNN model effectively predicted scar images using various backbone networks (e.g., ResNet50, ResNet101, ResNeSt50, and ResNeSt101) with high accuracy. The K-means clustering method successfully characterized the HE-stained tissue by separating the main features in terms of the collagen fiber and dermal mature components, namely, the glands, hair follicles, and nuclei. A quantitative analysis of the scar tissue in terms of the collagen density and directional variance of the collagen confirmed 50% differences between the normal and scar tissues. The proposed methods were utilized to characterize the pathological features of scar tissue for an objective histological analysis. The trained model is time-efficient when used for detection in place of a manual analysis. Machine learning-assisted analysis is expected to aid in understanding scar conditions, and to help establish an optimal treatment plan.
Collapse
|
36
|
Bansal T, Jindal N. An improved hybrid classification of brain tumor MRI images based on conglomeration feature extraction techniques. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-06929-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
37
|
Abstract
Brain tumors are most common in children and the elderly. It is a serious form of cancer caused by uncontrollable brain cell growth inside the skull. Tumor cells are notoriously difficult to classify due to their heterogeneity. Convolutional neural networks (CNNs) are the most widely used machine learning algorithm for visual learning and brain tumor recognition. This study proposed a CNN-based dense EfficientNet using min-max normalization to classify 3260 T1-weighted contrast-enhanced brain magnetic resonance images into four categories (glioma, meningioma, pituitary, and no tumor). The developed network is a variant of EfficientNet with dense and drop-out layers added. Similarly, the authors combined data augmentation with min-max normalization to increase the contrast of tumor cells. The benefit of the dense CNN model is that it can accurately categorize a limited database of pictures. As a result, the proposed approach provides exceptional overall performance. The experimental results indicate that the proposed model was 99.97% accurate during training and 98.78% accurate during testing. With high accuracy and a favorable F1 score, the newly designed EfficientNet CNN architecture can be a useful decision-making tool in the study of brain tumor diagnostic tests.
Collapse
|
38
|
Application of artificial intelligence and radiomics in pituitary neuroendocrine and sellar tumors: a quantitative and qualitative synthesis. Neuroradiology 2021; 64:647-668. [PMID: 34839380 DOI: 10.1007/s00234-021-02845-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2021] [Accepted: 10/21/2021] [Indexed: 01/03/2023]
Abstract
PURPOSE To systematically review the literature regarding the application of machine learning (ML) of magnetic resonance imaging (MRI) radiomics in common sellar tumors. To identify future directions for application of ML in sellar tumor MRI. METHODS PubMed, Medline, Embase, Google Scholar, Scopus, ArxIV, and bioRxiv were searched to identify relevant studies published between 2010 and September 2021. Studies were included if they specifically involved ML of MRI radiomics in the analysis of sellar masses. Risk of bias assessment was performed using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) Tool. RESULTS Fifty-eight articles were identified for review. All papers utilized retrospective data, and a quantitative systematic review was performed for thirty-one studies utilizing a public dataset which compared pituitary adenomas, meningiomas, and gliomas. One of the analyzed architectures yielded the highest classification accuracy of 0.996. The remaining twenty-seven articles were qualitatively reviewed and showed promising findings in predicting specific tumor characteristics such as tumor consistency, Ki-67 proliferative index, and post-surgical recurrence. CONCLUSION This review highlights the potential clinical application of ML using MRI radiomic data of the sellar region in diagnosis and predicting treatment outcomes. We describe future directions for practical application in the clinical care of patients with pituitary neuroendocrine and other sellar tumors.
Collapse
|
39
|
Maurya R, Pathak VK, Dutta MK. Deep learning based microscopic cell images classification framework using multi-level ensemble. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 211:106445. [PMID: 34627021 DOI: 10.1016/j.cmpb.2021.106445] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/01/2021] [Accepted: 09/26/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND OBJECTIVES Advancement of the ultra-fast microscopic images acquisition and generation techniques give rise to the automated artificial intelligence (AI)-based microscopic images classification systems. The earlier cell classification systems classify the cell images of a specific type captured using a specific microscopy technique, therefore the motivation behind the present study is to develop a generic framework that can be used for the classification of cell images of multiple types captured using a variety of microscopic techniques. METHODS The proposed framework for microscopic cell images classification is based on the transfer learning-based multi-level ensemble approach. The ensemble is made by training the same base model with different optimisation methods and different learning rates. An important contribution of the proposed framework lies in its ability to capture different granularities of features extracted from multiple scales of an input microscopic cell image. The base learners used in the proposed ensemble encapsulates the aggregation of low-level coarse features and high-level semantic features, thus, represent the different granular microscopic cell image features present at different scales of input cell images. The batch normalisation layer has been added to the base models for the fast convergence in the proposed ensemble for microscopic cell images classification. RESULTS The general applicability of the proposed framework for microscopic cell image classification has been tested with five different public datasets. The proposed method has outperformed the experimental results obtained in several other similar works. CONCLUSIONS The proposed framework for microscopic cell classification outperforms the other state-of-the-art classification methods in the same domain with a comparatively lesser amount of training data.
Collapse
Affiliation(s)
- Ritesh Maurya
- Centre for Advanced Studies, Dr. A.P.J. Abdul Kalam Technical University, Lucknow, India.
| | | | - Malay Kishore Dutta
- Centre for Advanced Studies, Dr. A.P.J. Abdul Kalam Technical University, Lucknow, India.
| |
Collapse
|
40
|
Akyol K, Şen B. Automatic Detection of Covid-19 with Bidirectional LSTM Network Using Deep Features Extracted from Chest X-ray Images. Interdiscip Sci 2021; 14:89-100. [PMID: 34313974 PMCID: PMC8313418 DOI: 10.1007/s12539-021-00463-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2021] [Revised: 07/08/2021] [Accepted: 07/12/2021] [Indexed: 12/23/2022]
Abstract
Coronavirus disease, which comes up in China at the end of 2019 and showed different symptoms in people infected, affected millions of people. Computer-aided expert systems are needed due to the inadequacy of the reverse transcription-polymerase chain reaction kit, which is widely used in the diagnosis of this disease. Undoubtedly, expert systems that provide effective solutions to many problems will be very useful in the detection of Covid-19 disease, especially when unskilled personnel and financial deficiencies in underdeveloped countries are taken into consideration. In the literature, there are numerous machine learning approaches built with different classifiers in the detection of this disease. This paper proposes an approach based on deep learning which detects Covid-19 and no-finding cases using chest X-ray images. Here, the classification performance of the Bi-LSTM network on the deep features was compared with the Deep Neural Network within the frame of the fivefold cross-validation technique. Accuracy, sensitivity, specificity and precision metrics were used to evaluate the classification performance of the trained models. Bi-LSTM network presented better performance compare to DNN with 97.6% value of high accuracy despite the few numbers of Covid-19 images in the dataset. In addition, it is understood that concatenated deep features more meaningful than deep features obtained with pre-trained networks by one by, as well. Consequently, it is thought that the proposed study based on the Bi-LSTM network and concatenated deep features will be noteworthy in the design of highly sensitive automated Covid-19 monitoring systems.
Collapse
Affiliation(s)
- Kemal Akyol
- Department of Computer Engineering, Faculty of Engineering and Architecture, Kastamonu University, Kastamonu, Turkey.
| | - Baha Şen
- Department of Computer Engineering, Faculty of Engineering and Natural Sciences, Ankara Yıldırım Beyazıt University, Ankara, Turkey
| |
Collapse
|
41
|
Hashemzehi R, Seyyed Mahdavi SJ, Kheirabadi M, Kamel SR. Y-net: a reducing gaussian noise convolutional neural network for MRI brain tumor classification with NADE concatenation. Biomed Phys Eng Express 2021; 7. [PMID: 34198284 DOI: 10.1088/2057-1976/ac107b] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Accepted: 07/01/2021] [Indexed: 11/11/2022]
Abstract
Brain tumors are among the most serious cancers that can have a negative impact on a person's quality of life. The magnetic resonance imaging (MRI) analysis detects abnormal cell growth in the skull. Recently, machine learning models such as artificial neural networks have been used to detect brain tumors more quickly. To classify brain tumors, this research introduces the Y-net, a new convolutional neural network (CNN) based on the convolutional U-net architecture. We apply a NADE concatenation method in pre-processing the MR images for enhanced Y-net performance. We put our approach to the test using two MRI datasets of brain tumors. The first dataset contains three different types of brain tumors, while the second dataset includes a separate category for healthy brains. We show that our model is resistant to white noise and can obtain excellent classification accuracy with a limited number of medical images.
Collapse
Affiliation(s)
- Raheleh Hashemzehi
- Department of Computer Science, Neyshabur Branch, Islamic Azad University, Neyshabur, Iran
| | | | - Maryam Kheirabadi
- Department of Computer Science, Neyshabur Branch, Islamic Azad University, Neyshabur, Iran
| | - Seyed Reza Kamel
- Department of Software Engineering, Mashhad Branch, Islamic Azad University, Mashhad, Iran
| |
Collapse
|
42
|
Rai HM, Chatterjee K, Dashkevich S. Automatic and accurate abnormality detection from brain MR images using a novel hybrid UnetResNext-50 deep CNN model. Biomed Signal Process Control 2021; 66:102477. [DOI: 10.1016/j.bspc.2021.102477] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
43
|
Zadeh Shirazi A, Fornaciari E, McDonnell MD, Yaghoobi M, Cevallos Y, Tello-Oquendo L, Inca D, Gomez GA. The Application of Deep Convolutional Neural Networks to Brain Cancer Images: A Survey. J Pers Med 2020; 10:E224. [PMID: 33198332 PMCID: PMC7711876 DOI: 10.3390/jpm10040224] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Revised: 11/10/2020] [Accepted: 11/10/2020] [Indexed: 12/15/2022] Open
Abstract
In recent years, improved deep learning techniques have been applied to biomedical image processing for the classification and segmentation of different tumors based on magnetic resonance imaging (MRI) and histopathological imaging (H&E) clinical information. Deep Convolutional Neural Networks (DCNNs) architectures include tens to hundreds of processing layers that can extract multiple levels of features in image-based data, which would be otherwise very difficult and time-consuming to be recognized and extracted by experts for classification of tumors into different tumor types, as well as segmentation of tumor images. This article summarizes the latest studies of deep learning techniques applied to three different kinds of brain cancer medical images (histology, magnetic resonance, and computed tomography) and highlights current challenges in the field for the broader applicability of DCNN in personalized brain cancer care by focusing on two main applications of DCNNs: classification and segmentation of brain cancer tumors images.
Collapse
Affiliation(s)
- Amin Zadeh Shirazi
- Centre for Cancer Biology, SA Pathology and the University of South of Australia, Adelaide, SA 5000, Australia;
- Computational Learning Systems Laboratory, UniSA STEM, University of South Australia, Mawson Lakes, SA 5095, Australia;
| | - Eric Fornaciari
- Department of Mathematics of Computation, University of California, Los Angeles (UCLA), Los Angeles, CA 90095, USA;
| | - Mark D. McDonnell
- Computational Learning Systems Laboratory, UniSA STEM, University of South Australia, Mawson Lakes, SA 5095, Australia;
| | - Mahdi Yaghoobi
- Electrical and Computer Engineering Department, Islamic Azad University, Mashhad Branch, Mashad 917794-8564, Iran;
| | - Yesenia Cevallos
- College of Engineering, Universidad Nacional de Chimborazo, Riobamba 060150, Ecuador; (Y.C.); (L.T.-O.); (D.I.)
| | - Luis Tello-Oquendo
- College of Engineering, Universidad Nacional de Chimborazo, Riobamba 060150, Ecuador; (Y.C.); (L.T.-O.); (D.I.)
| | - Deysi Inca
- College of Engineering, Universidad Nacional de Chimborazo, Riobamba 060150, Ecuador; (Y.C.); (L.T.-O.); (D.I.)
| | - Guillermo A. Gomez
- Centre for Cancer Biology, SA Pathology and the University of South of Australia, Adelaide, SA 5000, Australia;
| |
Collapse
|