1
|
Iftikhar S, Anjum N, Siddiqui AB, Ur Rehman M, Ramzan N. Explainable CNN for brain tumor detection and classification through XAI based key features identification. Brain Inform 2025; 12:10. [PMID: 40304860 DOI: 10.1186/s40708-025-00257-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2024] [Accepted: 04/01/2025] [Indexed: 05/02/2025] Open
Abstract
Despite significant advancements in brain tumor classification, many existing models suffer from complex structures that make them difficult to interpret. This complexity can hinder the transparency of the decision-making process, causing models to rely on irrelevant features or normal soft tissues. Besides, these models often include additional layers and parameters, which further complicate the classification process. Our work addresses these limitations by introducing a novel methodology that combines Explainable AI (XAI) techniques with a Convolutional Neural Network (CNN) architecture. The major contribution of this paper is ensuring that the model focuses on the most relevant features for tumor detection and classification, while simultaneously reducing complexity, by minimizing the number of layers. This approach enhances the model's transparency and robustness, giving clear insights into its decision-making process through XAI techniques such as Gradient-weighted Class Activation Mapping (Grad-Cam), Shapley Additive explanations (Shap), and Local Interpretable Model-agnostic Explanations (LIME). Additionally, the approach demonstrates better performance, achieving 99% accuracy on seen data and 95% on unseen data, highlighting its generalizability and reliability. This balance of simplicity, interpretability, and high accuracy represents a significant advancement in the classification of brain tumor.
Collapse
Affiliation(s)
- Shagufta Iftikhar
- Department of Computer Science, Capital University of Science and Technology, Islamabad, Pakistan
| | - Nadeem Anjum
- Department of Computer Science, Capital University of Science and Technology, Islamabad, Pakistan
| | - Abdul Basit Siddiqui
- Department of Computer Science, Capital University of Science and Technology, Islamabad, Pakistan
| | - Masood Ur Rehman
- James Watt School of Engineering, University of Glasgow, Glasgow, G12 8QQ, UK
| | - Naeem Ramzan
- School of Computing, Engineering and Physical Sciences, University of the West of Scotland, Paisley, PA1 2BE, UK.
| |
Collapse
|
2
|
Yuan Z, Li J, Na Q. Recent advances in biomimetic nanodelivery systems for the treatment of glioblastoma. Colloids Surf B Biointerfaces 2025; 252:114668. [PMID: 40168694 DOI: 10.1016/j.colsurfb.2025.114668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2025] [Revised: 03/24/2025] [Accepted: 03/26/2025] [Indexed: 04/03/2025]
Abstract
Glioblastoma remain one of the deadliest malignant tumors in the central nervous system, largely due to their aggressiveness, high degree of heterogeneity, and the protective barrier of the blood-brain barrier (BBB). Conventional therapies including surgery, chemotherapy and radiotherapy often fail to improve patient prognosis due to limited drug penetration and non-specific toxicity. We then present recent advances in biomimetic nanodelivery systems, focusing on cell membrane coatings, nanoenzymes, and exosome-based carriers. By mimicking endogenous biological functions, these systems demonstrate improved immune evasion, enhanced BBB traversal, and selective drug release within the tumor microenvironment. Nevertheless, we acknowledge unresolved bottlenecks related to large-scale production, stability, and the intricacies of regulatory compliance. Looking forward, we propose an interdisciplinary roadmap that combines materials engineering, cellular biology, and clinical expertise. Through this collaborative approach, this work aims to optimize biomimetic nanodelivery for glioma therapy and ultimately improve patient outcomes.
Collapse
Affiliation(s)
- Zhenru Yuan
- General Hospital of Northern Theater Command, Liaoning 110016, China
| | - Jing Li
- General Hospital of Northern Theater Command, Liaoning 110016, China
| | - Qi Na
- General Hospital of Northern Theater Command, Liaoning 110016, China.
| |
Collapse
|
3
|
Amjad U, Raza A, Fahad M, Farid D, Akhunzada A, Abubakar M, Beenish H. Context aware machine learning techniques for brain tumor classification and detection - A review. Heliyon 2025; 11:e41835. [PMID: 39906822 PMCID: PMC11791217 DOI: 10.1016/j.heliyon.2025.e41835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 01/07/2025] [Accepted: 01/08/2025] [Indexed: 02/06/2025] Open
Abstract
Background Machine learning has tremendous potential in acute medical care, particularly in the field of precise medical diagnosis, prediction, and classification of brain tumors. Malignant gliomas, due to their aggressive growth and dismal prognosis, stand out among various brain tumor types. Recent advancements in understanding the genetic abnormalities that underlie these tumors have shed light on their histo-pathological and biological characteristics, which support in better classification and prognosis. Objectives This review aims to predict gene alterations and establish structured correlations among various tumor types, extending the prediction of genetic mutations and structures using the latest machine learning techniques. Specifically, it focuses on multi-modalities of Magnetic Resonance Imaging (MRI) and histopathology, utilizing Convolutional Neural Networks (CNN) for image processing and analysis. Methods The review encompasses the most recent developments in MRI, and histology image processing methods across multiple tumor classes, including Glioma, Meningioma, Pituitary, Oligodendroglioma, and Astrocytoma. It identifies challenges in tumor classification, segmentation, datasets, and modalities, employing various neural network architectures. A competitive analysis assesses the performance of CNN. Furthermore it also implies K-MEANS clustering to predict Genetic structure, Genes Clusters prediction and Molecular Alteration of various types and grades of tumors e.g. Glioma, Meningioma, Pituitary, Oligodendroglioma, and Astrocytoma. Results CNN and KNN structures, with their ability to extract highlights in image-based information, prove effective in tumor classification and segmentation, surmounting challenges in image analysis. Competitive analysis reveals that CNN and outperform others algorithms on publicly available datasets, suggesting their potential for precise tumor diagnosis and treatment planning. Conclusion Machine learning, especially through CNN and SVM algorithms, demonstrates significant potential in the accurate diagnosis and classification of brain tumors based on imaging and histo-pathological data. Further advancements in this area hold promise for improving the accuracy and efficiency of intra-operative tumor diagnosis and treatment.
Collapse
Affiliation(s)
- Usman Amjad
- NED University of Engineering and Technology, Karachi, Pakistan
| | - Asif Raza
- Sir Syed University of Engineering and Technology, Karachi, Pakistan
| | - Muhammad Fahad
- Karachi Institute of Economics and Technology, Karachi, Pakistan
| | | | - Adnan Akhunzada
- College of Computing and IT, University of Doha for Science and Technology, Qatar
| | - Muhammad Abubakar
- Muhammad Nawaz Shareef University of Engineering and Technology, Multan, Pakistan
| | - Hira Beenish
- Karachi Institute of Economics and Technology, Karachi, Pakistan
| |
Collapse
|
4
|
Tandel GS, Tiwari A, Kakde OG. Multi-Class Brain Tumor Grades Classification Using a Deep Learning-Based Majority Voting Algorithm and Its Validation Using Explainable-AI. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2025:10.1007/s10278-024-01368-4. [PMID: 39779641 DOI: 10.1007/s10278-024-01368-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/05/2024] [Revised: 11/14/2024] [Accepted: 12/02/2024] [Indexed: 01/11/2025]
Abstract
Biopsy is considered the gold standard for diagnosing brain tumors, but its invasive nature can pose risks to patients. Additionally, tissue analysis can be cumbersome and inconsistent among observers. This research aims to develop a cost-effective, non-invasive, MRI-based computer-aided diagnosis tool that can reliably, accurately and swiftly identify brain tumor grades. Our system employs ensemble deep learning (EDL) within an MRI multiclass framework that includes five datasets: two-class (C2), three-class (C3), four-class (C4), five-class (C5) and six-class (C6). The EDL utilizes a majority voting algorithm to classify brain tumors by combining seven renowned deep learning (DL) models-EfficientNet, VGG16, ResNet18, GoogleNet, ResNet50, Inception-V3 and DarkNet-and seven machine learning (ML) models, including support vector machine, K-nearest neighbour, Naïve Bayes, decision tree, linear discriminant analysis, artificial neural network and random forest. Additionally, local interpretable model-agnostic explanations (LIME) are employed as an explainable AI algorithm, providing a visual representation of the CNN's internal workings to enhance the credibility of the results. Through extensive five-fold cross-validation experiments, the DL-based majority voting algorithm outperformed the ML-based majority voting algorithm, achieving the highest average accuracies of 100 ± 0.00%, 98.55 ± 0.35%, 98.47 ± 0.63%, 95.34 ± 1.17% and 96.61 ± 0.85% for the C2, C3, C4, C5 and C6 datasets, respectively. Majority voting algorithms typically yield consistent results across different folds of the brain tumor data and enhance performance compared to any individual deep learning and machine learning models.
Collapse
Affiliation(s)
- Gopal Singh Tandel
- Department of Computer Science, Allahabad Degree College, University of Allahabad, Prayagraj, India.
| | - Ashish Tiwari
- Department of Computer Science and Engineering, Visvesvaraya National Institute of Technology, Nagpur, India
| | - Omprakash G Kakde
- Department of Computer Science and Engineering, Visvesvaraya National Institute of Technology, Nagpur, India
| |
Collapse
|
5
|
Disci R, Gurcan F, Soylu A. Advanced Brain Tumor Classification in MR Images Using Transfer Learning and Pre-Trained Deep CNN Models. Cancers (Basel) 2025; 17:121. [PMID: 39796749 PMCID: PMC11719945 DOI: 10.3390/cancers17010121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2024] [Revised: 12/29/2024] [Accepted: 01/01/2025] [Indexed: 01/13/2025] Open
Abstract
BACKGROUND/OBJECTIVES Brain tumor classification is a crucial task in medical diagnostics, as early and accurate detection can significantly improve patient outcomes. This study investigates the effectiveness of pre-trained deep learning models in classifying brain MRI images into four categories: Glioma, Meningioma, Pituitary, and No Tumor, aiming to enhance the diagnostic process through automation. METHODS A publicly available Brain Tumor MRI dataset containing 7023 images was used in this research. The study employs state-of-the-art pre-trained models, including Xception, MobileNetV2, InceptionV3, ResNet50, VGG16, and DenseNet121, which are fine-tuned using transfer learning, in combination with advanced preprocessing and data augmentation techniques. Transfer learning was applied to fine-tune the models and optimize classification accuracy while minimizing computational requirements, ensuring efficiency in real-world applications. RESULTS Among the tested models, Xception emerged as the top performer, achieving a weighted accuracy of 98.73% and a weighted F1 score of 95.29%, demonstrating exceptional generalization capabilities. These models proved particularly effective in addressing class imbalances and delivering consistent performance across various evaluation metrics, thus demonstrating their suitability for clinical adoption. However, challenges persist in improving recall for the Glioma and Meningioma categories, and the black-box nature of deep learning models requires further attention to enhance interpretability and trust in medical settings. CONCLUSIONS The findings underscore the transformative potential of deep learning in medical imaging, offering a pathway toward more reliable, scalable, and efficient diagnostic tools. Future research will focus on expanding dataset diversity, improving model explainability, and validating model performance in real-world clinical settings to support the widespread adoption of AI-driven systems in healthcare and ensure their integration into clinical workflows.
Collapse
Affiliation(s)
- Rukiye Disci
- Department of Management Information Systems, Faculty of Economics and Administrative Sciences, Karadeniz Technical University, 61080 Trabzon, Turkey
| | - Fatih Gurcan
- Department of Management Information Systems, Faculty of Economics and Administrative Sciences, Karadeniz Technical University, 61080 Trabzon, Turkey
| | - Ahmet Soylu
- Department of Computer Science, Faculty of Information Technology and Electrical Engineering, Norwegian University of Science and Technology, 2815 Gjøvik, Norway
| |
Collapse
|
6
|
Berghout T. The Neural Frontier of Future Medical Imaging: A Review of Deep Learning for Brain Tumor Detection. J Imaging 2024; 11:2. [PMID: 39852315 PMCID: PMC11766058 DOI: 10.3390/jimaging11010002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2024] [Revised: 12/21/2024] [Accepted: 12/23/2024] [Indexed: 01/26/2025] Open
Abstract
Brain tumor detection is crucial in medical research due to high mortality rates and treatment challenges. Early and accurate diagnosis is vital for improving patient outcomes, however, traditional methods, such as manual Magnetic Resonance Imaging (MRI) analysis, are often time-consuming and error-prone. The rise of deep learning has led to advanced models for automated brain tumor feature extraction, segmentation, and classification. Despite these advancements, comprehensive reviews synthesizing recent findings remain scarce. By analyzing over 100 research papers over past half-decade (2019-2024), this review fills that gap, exploring the latest methods and paradigms, summarizing key concepts, challenges, datasets, and offering insights into future directions for brain tumor detection using deep learning. This review also incorporates an analysis of previous reviews and targets three main aspects: feature extraction, segmentation, and classification. The results revealed that research primarily focuses on Convolutional Neural Networks (CNNs) and their variants, with a strong emphasis on transfer learning using pre-trained models. Other methods, such as Generative Adversarial Networks (GANs) and Autoencoders, are used for feature extraction, while Recurrent Neural Networks (RNNs) are employed for time-sequence modeling. Some models integrate with Internet of Things (IoT) frameworks or federated learning for real-time diagnostics and privacy, often paired with optimization algorithms. However, the adoption of eXplainable AI (XAI) remains limited, despite its importance in building trust in medical diagnostics. Finally, this review outlines future opportunities, focusing on image quality, underexplored deep learning techniques, expanding datasets, and exploring deeper learning representations and model behavior such as recurrent expansion to advance medical imaging diagnostics.
Collapse
Affiliation(s)
- Tarek Berghout
- Laboratory of Automation and Manufacturing Engineering, Department of Industrial Engineering, Batna 2 University, Batna 05000, Algeria
| |
Collapse
|
7
|
Jia H, Tang S, Guo W, Pan P, Qian Y, Hu D, Dai Y, Yang Y, Geng C, Lv H. Differential diagnosis of congenital ventricular septal defect and atrial septal defect in children using deep learning-based analysis of chest radiographs. BMC Pediatr 2024; 24:661. [PMID: 39407181 PMCID: PMC11476512 DOI: 10.1186/s12887-024-05141-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Accepted: 10/09/2024] [Indexed: 10/20/2024] Open
Abstract
BACKGROUND Children with atrial septal defect (ASD) and ventricular septal defect (VSD) are frequently examined for respiratory symptoms, even when the underlying disease is not found. Chest radiographs often serve as the primary imaging modality. It is crucial to differentiate between ASD and VSD due to their distinct treatment. PURPOSE To assess whether deep learning analysis of chest radiographs can more effectively differentiate between ASD and VSD in children. METHODS In this retrospective study, chest radiographs and corresponding radiology reports from 1,194 patients were analyzed. The cases were categorized into a training set and a validation set, comprising 480 cases of ASD and 480 cases of VSD, and a test set with 115 cases of ASD and 119 cases of VSD. Four deep learning network models-ResNet-CBAM, InceptionV3, EfficientNet, and ViT-were developed for training, and a fivefold cross-validation method was employed to optimize the models. Receiver operating characteristic (ROC) curve analyses were conducted to assess the performance of each model. The most effective algorithm was compared with the interpretations provided by two radiologists on 234 images from the test group. RESULTS The average accuracy, sensitivity, and specificity of the four deep learning models in the differential diagnosis of VSD and ASD were higher than 70%. The AUC values of ResNet-CBAM, IncepetionV3, EfficientNet, and ViT were 0.87, 0.91, 0.90, and 0.66, respectively. Statistical analysis showed that the differential diagnosis efficiency of InceptionV3 was the highest, reaching 87% classification accuracy. The accuracy of InceptionV3 in the differential diagnosis of VSD and ASD was higher than that of the radiologists. CONCLUSIONS Deep learning methods such as IncepetionV3 based on chest radiographs in the study showed good performance for differential diagnosis of congenital VSD and ASD, which may be able to assist radiologists in diagnosis, education, and training, and reduce missed diagnosis and misdiagnosis.
Collapse
Affiliation(s)
- Huihui Jia
- Department of Radiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China
| | - Songqiao Tang
- School of Electronic & Information Engineering, Suzhou University of Science and Technology, 215009, Suzhou, China
| | - Wanliang Guo
- Department of Radiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China
| | - Peng Pan
- Department of Radiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China
| | - Yufeng Qian
- Department of Radiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China
| | - Dongliang Hu
- Department of Radiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China
| | - Yakang Dai
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, 215163, Suzhou, China
| | - Yang Yang
- Department of Radiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China
| | - Chen Geng
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, 215163, Suzhou, China.
- Jinan Guoke Medical Technology Development Co., Ltd, 250102, Shandong, China.
| | - Haitao Lv
- Department of Pediatric Cardiology, Children ' s Hospital of Soochow University, 215025, Suzhou, P. R. China.
| |
Collapse
|
8
|
Beser-Robles M, Castellá-Malonda J, Martínez-Gironés PM, Galiana-Bordera A, Ferrer-Lozano J, Ribas-Despuig G, Teruel-Coll R, Cerdá-Alberich L, Martí-Bonmatí L. Deep learning automatic semantic segmentation of glioblastoma multiforme regions on multimodal magnetic resonance images. Int J Comput Assist Radiol Surg 2024; 19:1743-1751. [PMID: 38849632 DOI: 10.1007/s11548-024-03205-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Accepted: 05/30/2024] [Indexed: 06/09/2024]
Abstract
OBJECTIVES In patients having naïve glioblastoma multiforme (GBM), this study aims to assess the efficacy of Deep Learning algorithms in automating the segmentation of brain magnetic resonance (MR) images to accurately determine 3D masks for 4 distinct regions: enhanced tumor, peritumoral edema, non-enhanced/necrotic tumor, and total tumor. MATERIAL AND METHODS A 3D U-Net neural network algorithm was developed for semantic segmentation of GBM. The training dataset was manually delineated by a group of expert neuroradiologists on MR images from the Brain Tumor Segmentation Challenge 2021 (BraTS2021) image repository, as ground truth labels for diverse glioma (GBM and low-grade glioma) subregions across four MR sequences (T1w, T1w-contrast enhanced, T2w, and FLAIR) in 1251 patients. The in-house test was performed on 50 GBM patients from our cohort (PerProGlio project). By exploring various hyperparameters, the network's performance was optimized, and the most optimal parameter configuration was identified. The assessment of the optimized network's performance utilized Dice scores, precision, and sensitivity metrics. RESULTS Our adaptation of the 3D U-net with additional residual blocks demonstrated reliable performance on both the BraTS2021 dataset and the in-house PerProGlio cohort, employing only T1w-ce sequences for enhancement and non-enhanced/necrotic tumor models and T1w-ce + T2w + FLAIR for peritumoral edema and total tumor. The mean Dice scores (training and test) were 0.89 and 0.75; 0.75 and 0.64; 0.79 and 0.71; and 0.60 and 0.55, for total tumor, edema, enhanced tumor, and non-enhanced/necrotic tumor, respectively. CONCLUSIONS The results underscore the high precision with which our network can effectively segment GBM tumors and their distinct subregions. The level of accuracy achieved agrees with the coefficients recorded in previous GBM studies. In particular, our approach allows model specialization for each of the different tumor subregions employing only those MR sequences that provide value for segmentation.
Collapse
Affiliation(s)
- Maria Beser-Robles
- Biomedical Imaging Research Group (GIBI230), Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106, 46026, Valencia, Spain.
| | | | - Pedro Miguel Martínez-Gironés
- Biomedical Imaging Research Group (GIBI230), Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106, 46026, Valencia, Spain
| | - Adrián Galiana-Bordera
- Biomedical Imaging Research Group (GIBI230), Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106, 46026, Valencia, Spain
| | - Jaime Ferrer-Lozano
- Department of Pathology, Hospital Universitario y Politécnico de La Fe, Valencia, Spain
| | - Gloria Ribas-Despuig
- Biomedical Imaging Research Group (GIBI230), Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106, 46026, Valencia, Spain
| | - Regina Teruel-Coll
- Department of Radiology, Hospital Universitario y Politécnico de La Fe, Valencia, Spain
| | - Leonor Cerdá-Alberich
- Biomedical Imaging Research Group (GIBI230), Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106, 46026, Valencia, Spain
| | - Luis Martí-Bonmatí
- Biomedical Imaging Research Group (GIBI230), Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106, 46026, Valencia, Spain
- Department of Radiology, Hospital Universitario y Politécnico de La Fe, Valencia, Spain
| |
Collapse
|
9
|
Abbas T, Fatima A, Shahzad T, Alharbi M, Khan MA, Ahmed A. Multidisciplinary cancer disease classification using adaptive FL in healthcare industry 5.0. Sci Rep 2024; 14:18643. [PMID: 39128933 PMCID: PMC11317485 DOI: 10.1038/s41598-024-68919-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Accepted: 07/29/2024] [Indexed: 08/13/2024] Open
Abstract
Emerging Industry 5.0 designs promote artificial intelligence services and data-driven applications across multiple places with varying ownership that need special data protection and privacy considerations to prevent the disclosure of private information to outsiders. Due to this, federated learning offers a method for improving machine-learning models without accessing the train data at a single manufacturing facility. We provide a self-adaptive framework for federated machine learning of healthcare intelligent systems in this research. Our method takes into account the participating parties at various levels of healthcare ecosystem abstraction. Each hospital trains its local model internally in a self-adaptive style and transmits it to the centralized server for universal model optimization and communication cycle reduction. To represent a multi-task optimization issue, we split the dataset into as many subsets as devices. Each device selects the most advantageous subset for every local iteration of the model. On a training dataset, our initial study demonstrates the algorithm's ability to converge various hospital and device counts. By merging a federated machine-learning approach with advanced deep machine-learning models, we can simply and accurately predict multidisciplinary cancer diseases in the human body. Furthermore, in the smart healthcare industry 5.0, the results of federated machine learning approaches are used to validate multidisciplinary cancer disease prediction. The proposed adaptive federated machine learning methodology achieved 90.0%, while the conventional federated learning approach achieved 87.30%, both of which were higher than the previous state-of-the-art methodologies for cancer disease prediction in the smart healthcare industry 5.0.
Collapse
Affiliation(s)
- Tahir Abbas
- School of Computer Science, National College of Business Administration and Economics, Lahore, 54000, Pakistan
| | - Areej Fatima
- Department of Computer Science, Lahore Garrison University, Lahore, 54000, Pakistan
| | - Tariq Shahzad
- Department of Computer Sciences, COMSATS University Islamabad, Sahiwal Campus, Sahiwal, 57000, Pakistan
| | - Meshal Alharbi
- Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, 11, 11942, Alkharj, Saudi Arabia
| | - Muhammad Adnan Khan
- Department of Software, Faculty of Artificial Intelligence and Software, Gachon University, Seongnam-si, 13557, South Korea.
| | - Arfan Ahmed
- AI Center for Precision Health, Weill Cornell Medicine-Qatar, P.O. Box 24144, Doha, Qatar.
| |
Collapse
|
10
|
El Hachimy I, Kabelma D, Echcharef C, Hassani M, Benamar N, Hajji N. A comprehensive survey on the use of deep learning techniques in glioblastoma. Artif Intell Med 2024; 154:102902. [PMID: 38852314 DOI: 10.1016/j.artmed.2024.102902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Revised: 04/28/2024] [Accepted: 06/02/2024] [Indexed: 06/11/2024]
Abstract
Glioblastoma, characterized as a grade 4 astrocytoma, stands out as the most aggressive brain tumor, often leading to dire outcomes. The challenge of treating glioblastoma is exacerbated by the convergence of genetic mutations and disruptions in gene expression, driven by alterations in epigenetic mechanisms. The integration of artificial intelligence, inclusive of machine learning algorithms, has emerged as an indispensable asset in medical analyses. AI is becoming a necessary tool in medicine and beyond. Current research on Glioblastoma predominantly revolves around non-omics data modalities, prominently including magnetic resonance imaging, computed tomography, and positron emission tomography. Nonetheless, the assimilation of omic data-encompassing gene expression through transcriptomics and epigenomics-offers pivotal insights into patients' conditions. These insights, reciprocally, hold significant value in refining diagnoses, guiding decision- making processes, and devising efficacious treatment strategies. This survey's core objective encompasses a comprehensive exploration of noteworthy applications of machine learning methodologies in the domain of glioblastoma, alongside closely associated research pursuits. The study accentuates the deployment of artificial intelligence techniques for both non-omics and omics data, encompassing a range of tasks. Furthermore, the survey underscores the intricate challenges posed by the inherent heterogeneity of Glioblastoma, delving into strategies aimed at addressing its multifaceted nature.
Collapse
Affiliation(s)
| | | | | | - Mohamed Hassani
- Cancer Division, Faculty of medicine, Department of Biomolecular Medicine, Imperial College, London, United Kingdom
| | - Nabil Benamar
- Moulay Ismail University of Meknes, Meknes, Morocco; Al Akhawayn University in Ifrane, Ifrane, Morocco.
| | - Nabil Hajji
- Cancer Division, Faculty of medicine, Department of Biomolecular Medicine, Imperial College, London, United Kingdom; Department of Medical Biochemistry, Molecular Biology and Immunology, School of Medicine, Virgen Macarena University Hospital, University of Seville, Seville, Spain
| |
Collapse
|
11
|
Abdusalomov A, Rakhimov M, Karimberdiyev J, Belalova G, Cho YI. Enhancing Automated Brain Tumor Detection Accuracy Using Artificial Intelligence Approaches for Healthcare Environments. Bioengineering (Basel) 2024; 11:627. [PMID: 38927863 PMCID: PMC11201188 DOI: 10.3390/bioengineering11060627] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2024] [Revised: 06/09/2024] [Accepted: 06/17/2024] [Indexed: 06/28/2024] Open
Abstract
Medical imaging and deep learning models are essential to the early identification and diagnosis of brain cancers, facilitating timely intervention and improving patient outcomes. This research paper investigates the integration of YOLOv5, a state-of-the-art object detection framework, with non-local neural networks (NLNNs) to improve brain tumor detection's robustness and accuracy. This study begins by curating a comprehensive dataset comprising brain MRI scans from various sources. To facilitate effective fusion, the YOLOv5 and NLNNs, K-means+, and spatial pyramid pooling fast+ (SPPF+) modules are integrated within a unified framework. The brain tumor dataset is used to refine the YOLOv5 model through the application of transfer learning techniques, adapting it specifically to the task of tumor detection. The results indicate that the combination of YOLOv5 and other modules results in enhanced detection capabilities in comparison to the utilization of YOLOv5 exclusively, proving recall rates of 86% and 83% respectively. Moreover, the research explores the interpretability aspect of the combined model. By visualizing the attention maps generated by the NLNNs module, the regions of interest associated with tumor presence are highlighted, aiding in the understanding and validation of the decision-making procedure of the methodology. Additionally, the impact of hyperparameters, such as NLNNs kernel size, fusion strategy, and training data augmentation, is investigated to optimize the performance of the combined model.
Collapse
Affiliation(s)
- Akmalbek Abdusalomov
- Department of Computer Engineering, Gachon University, Sujeong-gu, Seongnam-si 13120, Gyeonggi-do, Republic of Korea;
| | - Mekhriddin Rakhimov
- Department of Artificial Intelligence, Tashkent University of Information Technologies Named after Muhammad Al-Khwarizmi, Tashkent 100200, Uzbekistan; (M.R.); (J.K.)
| | - Jakhongir Karimberdiyev
- Department of Artificial Intelligence, Tashkent University of Information Technologies Named after Muhammad Al-Khwarizmi, Tashkent 100200, Uzbekistan; (M.R.); (J.K.)
| | - Guzal Belalova
- Department of Information Systems and Technologies, Tashkent State University of Economics, Tashkent 100066, Uzbekistan;
| | - Young Im Cho
- Department of Computer Engineering, Gachon University, Sujeong-gu, Seongnam-si 13120, Gyeonggi-do, Republic of Korea;
- Department of Information Systems and Technologies, Tashkent State University of Economics, Tashkent 100066, Uzbekistan;
| |
Collapse
|
12
|
Usha MP, Kannan G, Ramamoorthy M. Multimodal Brain Tumor Classification Using Convolutional Tumnet Architecture. Behav Neurol 2024; 2024:4678554. [PMID: 38882177 PMCID: PMC11178426 DOI: 10.1155/2024/4678554] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 12/22/2023] [Accepted: 01/10/2024] [Indexed: 06/18/2024] Open
Abstract
The most common and aggressive tumor is brain malignancy, which has a short life span in the fourth grade of the disease. As a result, the medical plan may be a crucial step toward improving the well-being of a patient. Both diagnosis and therapy are part of the medical plan. Brain tumors are commonly imaged with magnetic resonance imaging (MRI), positron emission tomography (PET), and computed tomography (CT). In this paper, multimodal fused imaging with classification and segmentation for brain tumors was proposed using the deep learning method. The MRI and CT brain tumor images of the same slices (308 slices of meningioma and sarcoma) are combined using three different types of pixel-level fusion methods. The presence/absence of a tumor is classified using the proposed Tumnet technique, and the tumor area is found accordingly. In the other case, Tumnet is also applied for single-modal MRI/CT (561 image slices) for classification. The proposed Tumnet was modeled with 5 convolutional layers, 3 pooling layers with ReLU activation function, and 3 fully connected layers. The first-order statistical fusion metrics for an average method of MRI-CT images are obtained as SSIM tissue at 83%, SSIM bone at 84%, accuracy at 90%, sensitivity at 96%, and specificity at 95%, and the second-order statistical fusion metrics are obtained as the standard deviation of fused images at 79% and entropy at 0.99. The entropy value confirms the presence of additional features in the fused image. The proposed Tumnet yields a sensitivity of 96%, an accuracy of 98%, a specificity of 99%, normalized values of the mean of 0.75, a standard deviation of 0.4, a variance of 0.16, and an entropy of 0.90.
Collapse
Affiliation(s)
- M Padma Usha
- Department of Electronics and Communication Engineering B.S. Abdur Rahman Crescent Institute of Science and Technology, Vandalur, Chennai, India
| | - G Kannan
- Department of Electronics and Communication Engineering B.S. Abdur Rahman Crescent Institute of Science and Technology, Vandalur, Chennai, India
| | - M Ramamoorthy
- Department of Artificial Intelligence and Machine Learning Saveetha School of Engineering SIMATS, Chennai, 600124, India
| |
Collapse
|
13
|
Khodadadi Shoushtari F, Dehkordi ANV, Sina S. Quantitative and Visual Analysis of Data Augmentation and Hyperparameter Optimization in Deep Learning-Based Segmentation of Low-Grade Glioma Tumors Using Grad-CAM. Ann Biomed Eng 2024; 52:1359-1377. [PMID: 38409433 DOI: 10.1007/s10439-024-03461-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Accepted: 01/29/2024] [Indexed: 02/28/2024]
Abstract
This study executes a quantitative and visual investigation on the effectiveness of data augmentation and hyperparameter optimization on the accuracy of deep learning-based segmentation of LGG tumors. The study employed the MobileNetV2 and ResNet backbones with atrous convolution in DeepLabV3+ structure. The Grad-CAM tool was also used to interpret the effect of augmentation and network optimization on segmentation performance. A wide investigation was performed to optimize the network hyperparameters. In addition, the study examined 35 different models to evaluate different data augmentation techniques. The results of the study indicated that incorporating data augmentation techniques and optimization can improve the performance of segmenting brain LGG tumors up to 10%. Our extensive investigation of the data augmentation techniques indicated that enlargement of data from 90° and 225° rotated data,up to down and left to right flipping are the most effective techniques. MobilenetV2 as the backbone,"Focal Loss" as the loss function and "Adam" as the optimizer showed the superior results. The optimal model (DLG-Net) achieved an overall accuracy of 96.1% with a loss value of 0.006. Specifically, the segmentation performance for Whole Tumor (WT), Tumor Core (TC), and Enhanced Tumor (ET) reached a Dice Similarity Coefficient (DSC) of 89.4%, 70.1%, and 49.9%, respectively. Simultaneous visual and quantitative assessment of data augmentation and network optimization can lead to an optimal model with a reasonable performance in segmenting the LGG tumors.
Collapse
Affiliation(s)
| | - Azimeh N V Dehkordi
- Department of Physics, Faculty of Computer Engineering, Najafabad Branch, Islamic Azad University, Najafabad, Iran.
- Najafabad Branch, Islamic Azad University, Najafabad, 8514143131, Iran.
| | - Sedigheh Sina
- Nuclear Engineering Department, Shiraz University, Shiraz, Iran
- Radiation Research Center, Shiraz University, Shiraz, Iran
| |
Collapse
|
14
|
Mehmood Y, Bajwa UI. Brain tumor grade classification using the ConvNext architecture. Digit Health 2024; 10:20552076241284920. [PMID: 39372816 PMCID: PMC11452878 DOI: 10.1177/20552076241284920] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2024] [Accepted: 09/02/2024] [Indexed: 10/08/2024] Open
Abstract
Objective Brain tumor grade is an important aspect of brain tumor diagnosis and helps to plan for treatment. Traditional methods of diagnosis, including biopsy and manual examination of medical images, are either invasive or may result in inaccurate diagnoses. This study proposes a brain tumor grade classification technique using a modern convolutional neural network (CNN) architecture called ConvNext that inputs magnetic resonance imaging (MRI) data. Methods Deep learning-based techniques are replacing invasive procedures for consistent, accurate, and non-invasive diagnosis of brain tumors. A well-known challenge of using deep learning architectures in medical imaging is data scarcity. Modern-day architectures have huge trainable parameters and require massive datasets to achieve the desired accuracy and avoid overfitting. Therefore, transfer learning is popular among researchers using medical imaging data. Recently, transformer-based architectures have surpassed CNNs for image data. However, recently proposed CNNs have achieved superior accuracy by introducing some tweaks inspired by vision transformers. This study proposed a technique to extract features from the ConvNext architecture and feed these features to a fully connected neural network for final classification. Results The proposed study achieved state-of-the-art performance on the BraTS 2019 dataset using pre-trained ConvNext. The best accuracy of 99.5% was achieved when three MRI sequences were input as three channels of the pre-trained CNN. Conclusion The study demonstrated the efficacy of the representations learned by a modern CNN architecture, which has a higher inductive bias for the image data than vision transformers for brain tumor grade classification.
Collapse
Affiliation(s)
- Yasar Mehmood
- Department of Computer Science, COMSATS University Islamabad, Lahore Campus, Lahore, Punjab, Pakistan
| | - Usama Ijaz Bajwa
- Department of Computer Science, COMSATS University Islamabad, Lahore Campus, Lahore, Punjab, Pakistan
| |
Collapse
|
15
|
Liu CH, Fu LW, Chen HH, Huang SL. Toward cell nuclei precision between OCT and H&E images translation using signal-to-noise ratio cycle-consistency. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 242:107824. [PMID: 37832427 DOI: 10.1016/j.cmpb.2023.107824] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Revised: 08/31/2023] [Accepted: 09/19/2023] [Indexed: 10/15/2023]
Abstract
Medical image-to-image translation is often difficult and of limited effectiveness due to the differences in image acquisition mechanisms and the diverse structure of biological tissues. This work presents an unpaired image translation model between in-vivo optical coherence tomography (OCT) and ex-vivo Hematoxylin and eosin (H&E) stained images without the need for image stacking, registration, post-processing, and annotation. The model can generate high-quality and highly accurate virtual medical images, and is robust and bidirectional. Our framework introduces random noise to (1) blur redundant features, (2) defend against self-adversarial attacks, (3) stabilize inverse conversion, and (4) mitigate the impact of OCT speckles. We also demonstrate that our model can be pre-trained and then fine-tuned using images from different OCT systems in just a few epochs. Qualitative and quantitative comparisons with traditional image-to-image translation models show the robustness of our proposed signal-to-noise ratio (SNR) cycle-consistency method.
Collapse
Affiliation(s)
- Chih-Hao Liu
- Graduate Institute of Photonics and Optoelectronics, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan.
| | - Li-Wei Fu
- Graduate Institute of Communication Engineering, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan.
| | - Homer H Chen
- Graduate Institute of Communication Engineering, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan; Department of Electrical Engineering, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan; Graduate Institute of Networking and Multimedia, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan.
| | - Sheng-Lung Huang
- Graduate Institute of Photonics and Optoelectronics, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan; Department of Electrical Engineering, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan; All Vista Healthcare Center, National Taiwan University, No.1, Sec. 4, Roosevelt Road, Taipei, 10617, Taiwan.
| |
Collapse
|
16
|
Chaudhury S, Sau K. A blockchain-enabled internet of medical things system for breast cancer detection in healthcare. HEALTHCARE ANALYTICS 2023; 4:100221. [DOI: 10.1016/j.health.2023.100221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/19/2023]
|
17
|
Gultekin MA, Peker AA, Oktay AB, Turk HM, Cesme DH, Shbair ATM, Yilmaz TF, Kaya A, Yasin AI, Seker M, Mayadagli A, Alkan A. Differentiation of lung and breast cancer brain metastases: Comparison of texture analysis and deep convolutional neural networks. JOURNAL OF CLINICAL ULTRASOUND : JCU 2023; 51:1579-1586. [PMID: 37688435 DOI: 10.1002/jcu.23558] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/30/2023] [Revised: 08/29/2023] [Accepted: 08/30/2023] [Indexed: 09/10/2023]
Abstract
PURPOSE Metastases are the most common neoplasm in the adult brain. In order to initiate the treatment, an extensive diagnostic workup is usually required. Radiomics is a discipline aimed at transforming visual data in radiological images into reliable diagnostic information. We aimed to examine the capability of deep learning methods to classify the origin of metastatic lesions in brain MRIs and compare the deep Convolutional Neural Network (CNN) methods with image texture based features. METHODS One hundred forty three patients with 157 metastatic brain tumors were included in the study. The statistical and texture based image features were extracted from metastatic tumors after manual segmentation process. Three powerful pre-trained CNN architectures and the texture-based features on both 2D and 3D tumor images were used to differentiate lung and breast metastases. Ten-fold cross-validation was used for evaluation. Accuracy, precision, recall, and area under curve (AUC) metrics were calculated to analyze the diagnostic performance. RESULTS The texture-based image features on 3D volumes achieved better discrimination results than 2D image features. The overall performance of CNN architectures with 3D inputs was higher than the texture-based features. Xception architecture, with 3D volumes as input, yielded the highest accuracy (0.85) while the AUC value was 0.84. The AUC values of VGG19 and the InceptionV3 architectures were 0.82 and 0.81, respectively. CONCLUSION CNNs achieved superior diagnostic performance in differentiating brain metastases from lung and breast malignancies than texture-based image features. Differentiation using 3D volumes as input exhibited a higher success rate than 2D sagittal images.
Collapse
Affiliation(s)
- Mehmet Ali Gultekin
- Department of Radiology, Faculty of Medicine, Bezmialem Vakif University, Istanbul, Turkey
| | - Abdusselim Adil Peker
- Department of Radiology, Faculty of Medicine, Bezmialem Vakif University, Istanbul, Turkey
| | - Ayse Betul Oktay
- Department of Computer Engineering, Yildiz Technical University, Istanbul, Turkey
| | - Haci Mehmet Turk
- Department of Medical Oncology, Faculty of Medicine, Bezmialem Vakif University, Istanbul, Turkey
| | - Dilek Hacer Cesme
- Department of Radiology, Faculty of Medicine, Bezmialem Vakif University, Istanbul, Turkey
| | - Abdallah T M Shbair
- Department of Medical Oncology, Faculty of Medicine, Bezmialem Vakif University, Istanbul, Turkey
| | - Temel Fatih Yilmaz
- Department of Radiology, Faculty of Medicine, Bezmialem Vakif University, Istanbul, Turkey
| | - Ahmet Kaya
- Department of Radiology, Faculty of Medicine, Bezmialem Vakif University, Istanbul, Turkey
| | - Ayse Irem Yasin
- Department of Medical Oncology, Faculty of Medicine, Bezmialem Vakif University, Istanbul, Turkey
| | - Mesut Seker
- Department of Medical Oncology, Faculty of Medicine, Bezmialem Vakif University, Istanbul, Turkey
| | - Alpaslan Mayadagli
- Department of Radiation Oncology, Faculty of Medicine, Bezmialem Vakif University, Istanbul, Turkey
| | - Alpay Alkan
- Department of Radiology, Faculty of Medicine, Bezmialem Vakif University, Istanbul, Turkey
| |
Collapse
|
18
|
Raghavendra U, Gudigar A, Paul A, Goutham TS, Inamdar MA, Hegde A, Devi A, Ooi CP, Deo RC, Barua PD, Molinari F, Ciaccio EJ, Acharya UR. Brain tumor detection and screening using artificial intelligence techniques: Current trends and future perspectives. Comput Biol Med 2023; 163:107063. [PMID: 37329621 DOI: 10.1016/j.compbiomed.2023.107063] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Revised: 05/16/2023] [Accepted: 05/19/2023] [Indexed: 06/19/2023]
Abstract
A brain tumor is an abnormal mass of tissue located inside the skull. In addition to putting pressure on the healthy parts of the brain, it can lead to significant health problems. Depending on the region of the brain tumor, it can cause a wide range of health issues. As malignant brain tumors grow rapidly, the mortality rate of individuals with this cancer can increase substantially with each passing week. Hence it is vital to detect these tumors early so that preventive measures can be taken at the initial stages. Computer-aided diagnostic (CAD) systems, in coordination with artificial intelligence (AI) techniques, have a vital role in the early detection of this disorder. In this review, we studied 124 research articles published from 2000 to 2022. Here, the challenges faced by CAD systems based on different modalities are highlighted along with the current requirements of this domain and future prospects in this area of research.
Collapse
Affiliation(s)
- U Raghavendra
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - Anjan Gudigar
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India.
| | - Aritra Paul
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - T S Goutham
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - Mahesh Anil Inamdar
- Department of Mechatronics, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - Ajay Hegde
- Consultant Neurosurgeon Manipal Hospitals, Sarjapur Road, Bangalore, India
| | - Aruna Devi
- School of Education and Tertiary Access, University of the Sunshine Coast, Caboolture Campus, Australia
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore, 599494, Singapore
| | - Ravinesh C Deo
- School of Mathematics, Physics, and Computing, University of Southern Queensland, Springfield, QLD, 4300, Australia
| | - Prabal Datta Barua
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW, 2010, Australia; School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD, 4350, Australia; Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, 2007, Australia
| | - Filippo Molinari
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129, Torino, Italy
| | - Edward J Ciaccio
- Department of Medicine, Columbia University Medical Center, New York, NY, 10032, USA
| | - U Rajendra Acharya
- School of Mathematics, Physics, and Computing, University of Southern Queensland, Springfield, QLD, 4300, Australia; International Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto, 860-8555, Japan
| |
Collapse
|
19
|
Wang M, Zhang L, Yu H, Chen S, Zhang X, Zhang Y, Gao D. A deep learning network based on CNN and sliding window LSTM for spike sorting. Comput Biol Med 2023; 159:106879. [PMID: 37080004 DOI: 10.1016/j.compbiomed.2023.106879] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Revised: 02/08/2023] [Accepted: 03/30/2023] [Indexed: 04/05/2023]
Abstract
Spike sorting plays an essential role to obtain electrophysiological activity of single neuron in the fields of neural signal decoding. With the development of electrode array, large numbers of spikes are recorded simultaneously, which rises the need for accurate automatic and generalization algorithms. Hence, this paper proposes a spike sorting model with convolutional neural network (CNN) and a spike classification model with combination of CNN and Long-Short Term Memory (LSTM). The recall rate of our detector could reach 94.40% in low noise level dataset. Although the recall declined with the increasing noise level, our model still presented higher feasibility and better robustness than other models. In addition, the results of our classification model presented an accuracy of greater than 99% in simulated data and an average accuracy of about 95% in experimental data, suggesting our classifier outperforms the current "WMsorting" and other deep learning models. Moreover, the performance of our whole algorithm was evaluated through simulated data and the results shows that the accuracy of spike sorting reached about 97%. It is noteworthy to say that, this proposed algorithm could be used to achieve accurate and robust automated spike detection and spike classification.
Collapse
Affiliation(s)
- Manqing Wang
- School of Computer Science, Chengdu University of Information Technology, Chengdu, 610225, China; School of Life Sciences and Technology, University of Electronic Science and Technology of China, Chengdu, 611731, China.
| | - Liangyu Zhang
- School of Computer Science, Chengdu University of Information Technology, Chengdu, 610225, China
| | - Haixiang Yu
- School of Computer Science, Chengdu University of Information Technology, Chengdu, 610225, China
| | - Siyu Chen
- School of Computer Science, Chengdu University of Information Technology, Chengdu, 610225, China
| | - Xiaomeng Zhang
- Gingko College of Hospitality Management, Chengdu, 611730, China
| | - Yongqing Zhang
- School of Computer Science, Chengdu University of Information Technology, Chengdu, 610225, China
| | - Dongrui Gao
- School of Computer Science, Chengdu University of Information Technology, Chengdu, 610225, China; School of Life Sciences and Technology, University of Electronic Science and Technology of China, Chengdu, 611731, China.
| |
Collapse
|
20
|
Kibriya H, Amin R, Kim J, Nawaz M, Gantassi R. A Novel Approach for Brain Tumor Classification Using an Ensemble of Deep and Hand-Crafted Features. SENSORS (BASEL, SWITZERLAND) 2023; 23:4693. [PMID: 37430604 PMCID: PMC10221077 DOI: 10.3390/s23104693] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Revised: 04/24/2023] [Accepted: 05/08/2023] [Indexed: 07/12/2023]
Abstract
One of the most severe types of cancer caused by the uncontrollable proliferation of brain cells inside the skull is brain tumors. Hence, a fast and accurate tumor detection method is critical for the patient's health. Many automated artificial intelligence (AI) methods have recently been developed to diagnose tumors. These approaches, however, result in poor performance; hence, there is a need for an efficient technique to perform precise diagnoses. This paper suggests a novel approach for brain tumor detection via an ensemble of deep and hand-crafted feature vectors (FV). The novel FV is an ensemble of hand-crafted features based on the GLCM (gray level co-occurrence matrix) and in-depth features based on VGG16. The novel FV contains robust features compared to independent vectors, which improve the suggested method's discriminating capabilities. The proposed FV is then classified using SVM or support vector machines and the k-nearest neighbor classifier (KNN). The framework achieved the highest accuracy of 99% on the ensemble FV. The results indicate the reliability and efficacy of the proposed methodology; hence, radiologists can use it to detect brain tumors through MRI (magnetic resonance imaging). The results show the robustness of the proposed method and can be deployed in the real environment to detect brain tumors from MRI images accurately. In addition, the performance of our model was validated via cross-tabulated data.
Collapse
Affiliation(s)
- Hareem Kibriya
- Department of Computer Sciences, University of Engineering and Technology, Taxila 47050, Pakistan
| | - Rashid Amin
- Department of Computer Sciences, University of Chakwal, Chakwal 48800, Pakistan
| | - Jinsul Kim
- School of Electronics and Computer Engineering, Chonnam National University, 300 Yongbong-dong, Buk-gu, Gwangju 500757, Republic of Korea
| | - Marriam Nawaz
- Department of Software Engineering, University of Engineering and Technology, Taxila 47050, Pakistan
| | - Rahma Gantassi
- Department of Electrical Engineering, Chonnam National University, Gwangju 61186, Republic of Korea
| |
Collapse
|
21
|
Taşcı B. Attention Deep Feature Extraction from Brain MRIs in Explainable Mode: DGXAINet. Diagnostics (Basel) 2023; 13:859. [PMID: 36900004 PMCID: PMC10000758 DOI: 10.3390/diagnostics13050859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Revised: 02/09/2023] [Accepted: 02/17/2023] [Indexed: 03/07/2023] Open
Abstract
Artificial intelligence models do not provide information about exactly how the predictions are reached. This lack of transparency is a major drawback. Particularly in medical applications, interest in explainable artificial intelligence (XAI), which helps to develop methods of visualizing, explaining, and analyzing deep learning models, has increased recently. With explainable artificial intelligence, it is possible to understand whether the solutions offered by deep learning techniques are safe. This paper aims to diagnose a fatal disease such as a brain tumor faster and more accurately using XAI methods. In this study, we preferred datasets that are widely used in the literature, such as the four-class kaggle brain tumor dataset (Dataset I) and the three-class figshare brain tumor dataset (Dataset II). To extract features, a pre-trained deep learning model is chosen. DenseNet201 is used as the feature extractor in this case. The proposed automated brain tumor detection model includes five stages. First, training of brain MR images with DenseNet201, the tumor area was segmented with GradCAM. The features were extracted from DenseNet201 trained using the exemplar method. Extracted features were selected with iterative neighborhood component (INCA) feature selector. Finally, the selected features were classified using support vector machine (SVM) with 10-fold cross-validation. An accuracy of 98.65% and 99.97%, were obtained for Datasets I and II, respectively. The proposed model obtained higher performance than the state-of-the-art methods and can be used to aid radiologists in their diagnosis.
Collapse
Affiliation(s)
- Burak Taşcı
- Vocational School of Technical Sciences, Firat University, Elazig 23119, Turkey
| |
Collapse
|
22
|
Role of Ensemble Deep Learning for Brain Tumor Classification in Multiple Magnetic Resonance Imaging Sequence Data. Diagnostics (Basel) 2023; 13:diagnostics13030481. [PMID: 36766587 PMCID: PMC9914433 DOI: 10.3390/diagnostics13030481] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Revised: 01/24/2023] [Accepted: 01/26/2023] [Indexed: 01/31/2023] Open
Abstract
The biopsy is a gold standard method for tumor grading. However, due to its invasive nature, it has sometimes proved fatal for brain tumor patients. As a result, a non-invasive computer-aided diagnosis (CAD) tool is required. Recently, many magnetic resonance imaging (MRI)-based CAD tools have been proposed for brain tumor grading. The MRI has several sequences, which can express tumor structure in different ways. However, a suitable MRI sequence for brain tumor classification is not yet known. The most common brain tumor is 'glioma', which is the most fatal form. Therefore, in the proposed study, to maximize the classification ability between low-grade versus high-grade glioma, three datasets were designed comprising three MRI sequences: T1-Weighted (T1W), T2-weighted (T2W), and fluid-attenuated inversion recovery (FLAIR). Further, five well-established convolutional neural networks, AlexNet, VGG16, ResNet18, GoogleNet, and ResNet50 were adopted for tumor classification. An ensemble algorithm was proposed using the majority vote of above five deep learning (DL) models to produce more consistent and improved results than any individual model. Five-fold cross validation (K5-CV) protocol was adopted for training and testing. For the proposed ensembled classifier with K5-CV, the highest test accuracies of 98.88 ± 0.63%, 97.98 ± 0.86%, and 94.75 ± 0.61% were achieved for FLAIR, T2W, and T1W-MRI data, respectively. FLAIR-MRI data was found to be most significant for brain tumor classification, where it showed a 4.17% and 0.91% improvement in accuracy against the T1W-MRI and T2W-MRI sequence data, respectively. The proposed ensembled algorithm (MajVot) showed significant improvements in the average accuracy of three datasets of 3.60%, 2.84%, 1.64%, 4.27%, and 1.14%, respectively, against AlexNet, VGG16, ResNet18, GoogleNet, and ResNet50.
Collapse
|
23
|
Kurdi SZ, Ali MH, Jaber MM, Saba T, Rehman A, Damaševičius R. Brain Tumor Classification Using Meta-Heuristic Optimized Convolutional Neural Networks. J Pers Med 2023; 13:jpm13020181. [PMID: 36836415 PMCID: PMC9965936 DOI: 10.3390/jpm13020181] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2022] [Revised: 01/08/2023] [Accepted: 01/17/2023] [Indexed: 01/22/2023] Open
Abstract
The field of medical image processing plays a significant role in brain tumor classification. The survival rate of patients can be increased by diagnosing the tumor at an early stage. Several automatic systems have been developed to perform the tumor recognition process. However, the existing systems could be more efficient in identifying the exact tumor region and hidden edge details with minimum computation complexity. The Harris Hawks optimized convolution network (HHOCNN) is used in this work to resolve these issues. The brain magnetic resonance (MR) images are pre-processed, and the noisy pixels are eliminated to minimize the false tumor recognition rate. Then, the candidate region process is applied to identify the tumor region. The candidate region method investigates the boundary regions with the help of the line segments concept, which reduces the loss of hidden edge details. Various features are extracted from the segmented region, which is classified by applying a convolutional neural network (CNN). The CNN computes the exact region of the tumor with fault tolerance. The proposed HHOCNN system was implemented using MATLAB, and performance was evaluated using pixel accuracy, error rate, accuracy, specificity, and sensitivity metrics. The nature-inspired Harris Hawks optimization algorithm minimizes the misclassification error rate and improves the overall tumor recognition accuracy to 98% achieved on the Kaggle dataset.
Collapse
Affiliation(s)
- Sarah Zuhair Kurdi
- Medical College, Kufa University, Al.Najaf Teaching Hospital M.B.ch.B/F.I.C.M Neurosurgery, Baghdad 54001, Iraq
| | - Mohammed Hasan Ali
- Computer Techniques Engineering Department, Faculty of Information Technology, Imam Ja’afar Al-Sadiq University, Baghdad 10021, Iraq
- College of Computer Science and Mathematics, University of Kufa, Najaf 540011, Iraq
| | - Mustafa Musa Jaber
- Department of Medical Instruments Engineering Techniques, Dijlah University College, Baghdad 00964, Iraq
- Department of Medical Instruments Engineering Techniques, Al-Turath University College, Baghdad 10021, Iraq
| | - Tanzila Saba
- Artificial Intelligence & Data Analytics Lab, CCIS Prince Sultan University, Riyadh 11586, Saudi Arabia
| | - Amjad Rehman
- Artificial Intelligence & Data Analytics Lab, CCIS Prince Sultan University, Riyadh 11586, Saudi Arabia
| | - Robertas Damaševičius
- Faculty of Applied Mathematics, Silesian University of Technology, 44-100 Gliwice, Poland
- Correspondence:
| |
Collapse
|
24
|
Zhu Y, Wang M, Yin X, Zhang J, Meijering E, Hu J. Deep Learning in Diverse Intelligent Sensor Based Systems. SENSORS (BASEL, SWITZERLAND) 2022; 23:62. [PMID: 36616657 PMCID: PMC9823653 DOI: 10.3390/s23010062] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Revised: 12/06/2022] [Accepted: 12/14/2022] [Indexed: 05/27/2023]
Abstract
Deep learning has become a predominant method for solving data analysis problems in virtually all fields of science and engineering. The increasing complexity and the large volume of data collected by diverse sensor systems have spurred the development of deep learning methods and have fundamentally transformed the way the data are acquired, processed, analyzed, and interpreted. With the rapid development of deep learning technology and its ever-increasing range of successful applications across diverse sensor systems, there is an urgent need to provide a comprehensive investigation of deep learning in this domain from a holistic view. This survey paper aims to contribute to this by systematically investigating deep learning models/methods and their applications across diverse sensor systems. It also provides a comprehensive summary of deep learning implementation tips and links to tutorials, open-source codes, and pretrained models, which can serve as an excellent self-contained reference for deep learning practitioners and those seeking to innovate deep learning in this space. In addition, this paper provides insights into research topics in diverse sensor systems where deep learning has not yet been well-developed, and highlights challenges and future opportunities. This survey serves as a catalyst to accelerate the application and transformation of deep learning in diverse sensor systems.
Collapse
Affiliation(s)
- Yanming Zhu
- School of Computer Science and Engineering, University of New South Wales, Sydney, NSW 2052, Australia
| | - Min Wang
- School of Engineering and Information Technology, University of New South Wales, Canberra, ACT 2612, Australia
| | - Xuefei Yin
- School of Engineering and Information Technology, University of New South Wales, Canberra, ACT 2612, Australia
| | - Jue Zhang
- School of Engineering and Information Technology, University of New South Wales, Canberra, ACT 2612, Australia
| | - Erik Meijering
- School of Computer Science and Engineering, University of New South Wales, Sydney, NSW 2052, Australia
| | - Jiankun Hu
- School of Engineering and Information Technology, University of New South Wales, Canberra, ACT 2612, Australia
| |
Collapse
|
25
|
Kaothanthong N, Atsavasirilert K, Sarampakhul S, Chantangphol P, Songsaeng D, Makhanov S. Artificial intelligence for localization of the acute ischemic stroke by non-contrast computed tomography. PLoS One 2022; 17:e0277573. [PMID: 36454916 PMCID: PMC9714826 DOI: 10.1371/journal.pone.0277573] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2022] [Accepted: 10/29/2022] [Indexed: 12/03/2022] Open
Abstract
A non-contrast cranial computer tomography (ncCT) is often employed for the diagnosis of the early stage of the ischemic stroke. However, the number of false negatives is high. More accurate results are obtained by an MRI. However, the MRI is not available in every hospital. Moreover, even if it is available in the clinic for the routine tests, emergency often does not have it. Therefore, this paper proposes an end-to-end framework for detection and segmentation of the brain infarct on the ncCT. The computer tomography perfusion (CTp) is used as the ground truth. The proposed ensemble model employs three deep convolution neural networks (CNNs) to process three end-to-end feature maps and a hand-craft features characterized by specific contra-lateral features. To improve the accuracy of the detected infarct area, the spatial dependencies between neighboring slices are employed at the postprocessing step. The numerical experiments have been performed on 18 ncCT-CTp paired stroke cases (804 image-pairs). The leave-one-out approach is applied for evaluating the proposed method. The model achieves 91.16% accuracy, 65.15% precision, 77.44% recall, 69.97% F1 score, and 0.4536 IoU.
Collapse
Affiliation(s)
- Natsuda Kaothanthong
- Sirindhorn International Institute of Technology, Thammasat University, Pathum Thani, Thailand
| | - Kamin Atsavasirilert
- Sirindhorn International Institute of Technology, Thammasat University, Pathum Thani, Thailand
| | - Soawapot Sarampakhul
- Division of Diagnostic Radiology, Department of Radiology, Faculty of Medicine, Siriraj Hospital, Mahidol University, Bangkok, Thailand
| | - Pantid Chantangphol
- Sirindhorn International Institute of Technology, Thammasat University, Pathum Thani, Thailand
| | - Dittapong Songsaeng
- Division of Diagnostic Radiology, Department of Radiology, Faculty of Medicine, Siriraj Hospital, Mahidol University, Bangkok, Thailand
| | - Stanislav Makhanov
- Sirindhorn International Institute of Technology, Thammasat University, Pathum Thani, Thailand
| |
Collapse
|
26
|
Brain tumor segmentation and classification using hybrid deep CNN with LuNetClassifier. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07934-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
|
27
|
Zhang L, Xu F, Li Y, Zhang H, Xi Z, Xiang J, Wang B. A lightweight convolutional neural network model with receptive field block for C-shaped root canal detection in mandibular second molars. Sci Rep 2022; 12:17373. [PMID: 36253430 PMCID: PMC9576767 DOI: 10.1038/s41598-022-20411-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Accepted: 09/13/2022] [Indexed: 01/10/2023] Open
Abstract
Rapid and accurate detection of a C-shaped root canal on mandibular second molars can assist dentists in diagnosis and treatment. Oral panoramic radiography is one of the most effective methods of determining the root canal of teeth. There are already some traditional methods based on deep learning to learn the characteristics of C-shaped root canal tooth images. However, previous studies have shown that the accuracy of detecting the C-shaped root canal still needs to be improved. And it is not suitable for implementing these network structures with limited hardware resources. In this paper, a new lightweight convolutional neural network is designed, which combined with receptive field block (RFB) for optimizing feature extraction. In order to optimize the hardware resource requirements of the model, a lightweight, multi-branch, convolutional neural network model was developed in this study. To improve the feature extraction ability of the model for C-shaped root canal tooth images, RFB has been merged with this model. RFB has achieved excellent results in target detection and classification. In the multiscale receptive field block, some small convolution kernels are used to replace the large convolution kernels, which allows the model to extract detailed features and reduce the computational complexity. Finally, the accuracy and area under receiver operating characteristics curve (AUC) values of C-shaped root canals on the image data of our mandibular second molars were 0.9838 and 0.996, respectively. The results show that the deep learning model proposed in this paper is more accurate and has lower computational complexity than many other similar studies. In addition, score-weighted class activation maps (Score-CAM) were generated to localize the internal structure that contributed to the predictions.
Collapse
Affiliation(s)
- Lijuan Zhang
- grid.464423.3Department of Oral Medicine, Shanxi Provincial People’s Hospital, Taiyuan, China
| | - Feng Xu
- grid.440656.50000 0000 9491 9632College of Information and Computer, Taiyuan University of Technology, No. 79, Yingze West Street, Taiyuan, 030024 Shanxi China
| | - Ying Li
- grid.440656.50000 0000 9491 9632College of Information and Computer, Taiyuan University of Technology, No. 79, Yingze West Street, Taiyuan, 030024 Shanxi China
| | - Huimin Zhang
- grid.440656.50000 0000 9491 9632College of Information and Computer, Taiyuan University of Technology, No. 79, Yingze West Street, Taiyuan, 030024 Shanxi China
| | - Ziyi Xi
- grid.440656.50000 0000 9491 9632College of Information and Computer, Taiyuan University of Technology, No. 79, Yingze West Street, Taiyuan, 030024 Shanxi China
| | - Jie Xiang
- grid.440656.50000 0000 9491 9632College of Information and Computer, Taiyuan University of Technology, No. 79, Yingze West Street, Taiyuan, 030024 Shanxi China
| | - Bin Wang
- grid.440656.50000 0000 9491 9632College of Information and Computer, Taiyuan University of Technology, No. 79, Yingze West Street, Taiyuan, 030024 Shanxi China
| |
Collapse
|
28
|
Superlative Feature Selection Based Image Classification Using Deep Learning in Medical Imaging. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:7028717. [PMID: 36199372 PMCID: PMC9529489 DOI: 10.1155/2022/7028717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Revised: 09/06/2022] [Accepted: 09/17/2022] [Indexed: 11/30/2022]
Abstract
Medical image recognition plays an essential role in the forecasting and early identification of serious diseases in the field of identification. Medical pictures are essential to a patient's health record since they may be used to control, manage, and treat illnesses. On the other hand, image categorization is a difficult problem in diagnostics. This paper provides an enhanced classifier based on the outstanding Feature Selection oriented Clinical Classifier using the Deep Learning (DL) model, which incorporates preprocessing, extraction of features, and classifying. The paper aims to develop an optimum feature extraction model for successful medical imaging categorization. The proposed methodology is based on feature extraction with the pretrained EfficientNetB0 model. The optimum features enhanced the classifier performance and raised the precision, recall, F1 score, accuracy, and detection of medical pictures to improve the effectiveness of the DL classifier. The paper aims to develop an optimum feature extraction model for successful medical imaging categorization. The optimum features enhanced the classifier performance and raised the result parameters for detecting medical pictures to improve the effectiveness of the DL classifier. Experiment findings reveal that our presented approach outperforms and achieves 98% accuracy.
Collapse
|
29
|
Nadeem MW, Goh HG, Hussain M, Liew SY, Andonovic I, Khan MA. Deep Learning for Diabetic Retinopathy Analysis: A Review, Research Challenges, and Future Directions. SENSORS (BASEL, SWITZERLAND) 2022; 22:6780. [PMID: 36146130 PMCID: PMC9505428 DOI: 10.3390/s22186780] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 08/02/2022] [Accepted: 08/08/2022] [Indexed: 05/12/2023]
Abstract
Deep learning (DL) enables the creation of computational models comprising multiple processing layers that learn data representations at multiple levels of abstraction. In the recent past, the use of deep learning has been proliferating, yielding promising results in applications across a growing number of fields, most notably in image processing, medical image analysis, data analysis, and bioinformatics. DL algorithms have also had a significant positive impact through yielding improvements in screening, recognition, segmentation, prediction, and classification applications across different domains of healthcare, such as those concerning the abdomen, cardiac, pathology, and retina. Given the extensive body of recent scientific contributions in this discipline, a comprehensive review of deep learning developments in the domain of diabetic retinopathy (DR) analysis, viz., screening, segmentation, prediction, classification, and validation, is presented here. A critical analysis of the relevant reported techniques is carried out, and the associated advantages and limitations highlighted, culminating in the identification of research gaps and future challenges that help to inform the research community to develop more efficient, robust, and accurate DL models for the various challenges in the monitoring and diagnosis of DR.
Collapse
Affiliation(s)
- Muhammad Waqas Nadeem
- Faculty of Information and Communication Technology (FICT), Universiti Tunku Abdul Rahman (UTAR), Kampar 31900, Malaysia
| | - Hock Guan Goh
- Faculty of Information and Communication Technology (FICT), Universiti Tunku Abdul Rahman (UTAR), Kampar 31900, Malaysia
| | - Muzammil Hussain
- Department of Computer Science, School of Systems and Technology, University of Management and Technology, Lahore 54000, Pakistan
| | - Soung-Yue Liew
- Faculty of Information and Communication Technology (FICT), Universiti Tunku Abdul Rahman (UTAR), Kampar 31900, Malaysia
| | - Ivan Andonovic
- Department of Electronic and Electrical Engineering, Royal College Building, University of Strathclyde, 204 George St., Glasgow G1 1XW, UK
| | - Muhammad Adnan Khan
- Pattern Recognition and Machine Learning Lab, Department of Software, Gachon University, Seongnam 13557, Korea
- Faculty of Computing, Riphah School of Computing and Innovation, Riphah International University, Lahore Campus, Lahore 54000, Pakistan
| |
Collapse
|
30
|
Khodadadi Shoushtari F, Sina S, Dehkordi ANV. Automatic segmentation of glioblastoma multiform brain tumor in MRI images: Using Deeplabv3+ with pre-trained Resnet18 weights. Phys Med 2022; 100:51-63. [PMID: 35732092 DOI: 10.1016/j.ejmp.2022.06.007] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/19/2021] [Revised: 06/05/2022] [Accepted: 06/11/2022] [Indexed: 10/17/2022] Open
Abstract
PURPOSE To assess the effectiveness of deep learning algorithms in automated segmentation of magnetic resonance brain images for determining the enhanced tumor, the peri-tumoral edema, the necrotic/ non-enhancing tumor, and Normal tissue volumes. METHODS AND MATERIALS A new deep neural network algorithm, Deep-Net, was developed for semantic segmentation of the glioblastoma tumors in MR images, using the Deeplabv3+ architecture, and the pre-trained Resnet18 initial weights. The MR image Dataset used for training the network was taken from the BraTS 2020 training set, with the ground truth labels for different tumor subregions manually drawn by a group of expert neuroradiologists. In this work, two multi-modal MRI scans, i.e., T1ce and FLAIR of 293 patients with high-grade glioma (HGG), were used for deep network training (Deep-Net). The performance of the network was assessed for different hyper-parameters, to obtain the optimum set of parameters. The similarity scores were used for the evaluation of the optimized network. RESULTS According to the results of this study, epoch #37 is the optimum epoch giving the best global accuracy (97.53%), and loss function (0.14). The Deep-Net sensitivity in the delineation of the enhanced tumor is more than 90%. CONCLUSIONS The results indicate that the Deep-Net was able to segment GBM tumors with high accuracy.
Collapse
Affiliation(s)
| | - Sedigheh Sina
- Nuclear Engineering Department, Shiraz University, Shiraz, Iran; Radiation Research Center, Shiraz University, Shiraz, Iran
| | - Azimeh N V Dehkordi
- Department of Physics, Najafabad Branch, Islamic Azad University, Najafabad, Iran.
| |
Collapse
|
31
|
Modified Artificial Bee Colony Algorithm-Based Strategy for Brain Tumor Segmentation. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:5465279. [PMID: 35602633 PMCID: PMC9117055 DOI: 10.1155/2022/5465279] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Revised: 04/09/2022] [Accepted: 04/27/2022] [Indexed: 11/18/2022]
Abstract
Medical image segmentation is a technique for detecting boundaries in a 2D or 3D image automatically or semiautomatically. The enormous range of the medical image is a considerable challenge for image segmentation. Magnetic resonance imaging (MRI) scans to aid in the detection and existence of brain tumors. This approach, however, requires exact delineation of the tumor location inside the brain scan. To solve this, an optimization algorithm will be one of the most successful techniques for distinguishing pixels of interest from the background, but its performance is reliant on the starting values of the centroids. The primary goal of this work is to segment tumor areas within brain MRI images. After converting the gray MRI image to a color image, a multiobjective modified ABC algorithm is utilized to separate the tumor from the brain. The intensity determines the RGB color generated in the image. The simulation results are assessed in terms of performance metrics such as accuracy, precision, specificity, recall, F-measure, and the time in seconds required by the system to segment the tumor from the brain. The performance of the proposed algorithm is computed with other algorithms like the single-objective ABC algorithm and multiobjective ABC algorithm. The results prove that the proposed multiobjective modified ABC algorithm is efficient in analyzing and segmenting the tumor from brain images.
Collapse
|
32
|
Battalapalli D, Rao BVVSNP, Yogeeswari P, Kesavadas C, Rajagopalan V. An optimal brain tumor segmentation algorithm for clinical MRI dataset with low resolution and non-contiguous slices. BMC Med Imaging 2022; 22:89. [PMID: 35568820 PMCID: PMC9107172 DOI: 10.1186/s12880-022-00812-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2021] [Accepted: 04/20/2022] [Indexed: 11/27/2022] Open
Abstract
Background Segmenting brain tumor and its constituent regions from magnetic resonance images (MRI) is important for planning diagnosis and treatment. In clinical routine often an experienced radiologist delineates the tumor regions using multimodal MRI. But this manual segmentation is prone to poor reproducibility and is time consuming. Also, routine clinical scans are usually of low resolution. To overcome these limitations an automated and precise segmentation algorithm based on computer vision is needed. Methods We investigated the performance of three widely used segmentation methods namely region growing, fuzzy C means and deep neural networks (deepmedic). We evaluated these algorithms on the BRATS 2018 dataset by choosing randomly 48 patients data (high grade, n = 24 and low grade, n = 24) and on our routine clinical MRI brain tumor dataset (high grade, n = 15 and low grade, n = 28). We measured their performance using dice similarity coefficient, Hausdorff distance and volume measures. Results Region growing method performed very poorly when compared to fuzzy C means (fcm) and deepmedic network. Dice similarity coefficient scores for FCM and deepmedic algorithms were close to each other for BRATS and clinical dataset. The accuracy was below 70% for both these methods in general. Conclusion Even though the deepmedic network showed very high accuracy in BRATS challenge for brain tumor segmentation, it has to be custom trained for the low resolution routine clinical scans. It also requires large training data to be used as a stand-alone algorithm for clinical applications. Nevertheless deepmedic may be a better algorithm for brain tumor segmentation when compared to region growing or FCM.
Collapse
Affiliation(s)
- Dheerendranath Battalapalli
- Department of Electrical and Electronics Engineering, Birla Institute of Technology and Science Pilani, Hyderabad Campus, Hyderabad, 500078, India
| | - B V V S N Prabhakar Rao
- Department of Electrical and Electronics Engineering, Birla Institute of Technology and Science Pilani, Hyderabad Campus, Hyderabad, 500078, India
| | - P Yogeeswari
- Department of Pharmacy, Birla Institute of Technology and Science Pilani, Hyderabad Campus, Hyderabad, 500078, India
| | - C Kesavadas
- Department of Imaging Sciences and Interventional Radiology, Sree Chitra Tirunal Institute for Medical Sciences and Technology, Trivandrum, 695011, India
| | - Venkateswaran Rajagopalan
- Department of Electrical and Electronics Engineering, Birla Institute of Technology and Science Pilani, Hyderabad Campus, Hyderabad, 500078, India.
| |
Collapse
|
33
|
Saleem M, Abbas S, Ghazal TM, Adnan Khan M, Sahawneh N, Ahmad M. Smart cities: Fusion-based intelligent traffic congestion control system for vehicular networks using machine learning techniques. EGYPTIAN INFORMATICS JOURNAL 2022. [DOI: 10.1016/j.eij.2022.03.003] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
34
|
Lima AA, Mridha MF, Das SC, Kabir MM, Islam MR, Watanobe Y. A Comprehensive Survey on the Detection, Classification, and Challenges of Neurological Disorders. BIOLOGY 2022; 11:469. [PMID: 35336842 PMCID: PMC8945195 DOI: 10.3390/biology11030469] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/13/2022] [Revised: 03/12/2022] [Accepted: 03/14/2022] [Indexed: 01/19/2023]
Abstract
Neurological disorders (NDs) are becoming more common, posing a concern to pregnant women, parents, healthy infants, and children. Neurological disorders arise in a wide variety of forms, each with its own set of origins, complications, and results. In recent years, the intricacy of brain functionalities has received a better understanding due to neuroimaging modalities, such as magnetic resonance imaging (MRI), magnetoencephalography (MEG), and positron emission tomography (PET), etc. With high-performance computational tools and various machine learning (ML) and deep learning (DL) methods, these modalities have discovered exciting possibilities for identifying and diagnosing neurological disorders. This study follows a computer-aided diagnosis methodology, leading to an overview of pre-processing and feature extraction techniques. The performance of existing ML and DL approaches for detecting NDs is critically reviewed and compared in this article. A comprehensive portion of this study also shows various modalities and disease-specified datasets that detect and records images, signals, and speeches, etc. Limited related works are also summarized on NDs, as this domain has significantly fewer works focused on disease and detection criteria. Some of the standard evaluation metrics are also presented in this study for better result analysis and comparison. This research has also been outlined in a consistent workflow. At the conclusion, a mandatory discussion section has been included to elaborate on open research challenges and directions for future work in this emerging field.
Collapse
Affiliation(s)
- Aklima Akter Lima
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh; (A.A.L.); (M.F.M.); (S.C.D.); (M.M.K.)
| | - M. Firoz Mridha
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh; (A.A.L.); (M.F.M.); (S.C.D.); (M.M.K.)
| | - Sujoy Chandra Das
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh; (A.A.L.); (M.F.M.); (S.C.D.); (M.M.K.)
| | - Muhammad Mohsin Kabir
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh; (A.A.L.); (M.F.M.); (S.C.D.); (M.M.K.)
| | - Md. Rashedul Islam
- Department of Computer Science and Engineering, University of Asia Pacific, Dhaka 1216, Bangladesh
| | - Yutaka Watanobe
- Department of Computer Science and Engineering, University of Aizu, Aizu-Wakamatsu 965-8580, Japan;
| |
Collapse
|
35
|
Akatsuka J, Numata Y, Morikawa H, Sekine T, Kayama S, Mikami H, Yanagi M, Endo Y, Takeda H, Toyama Y, Yamaguchi R, Kimura G, Kondo Y, Yamamoto Y. A data-driven ultrasound approach discriminates pathological high grade prostate cancer. Sci Rep 2022; 12:860. [PMID: 35039648 PMCID: PMC8764059 DOI: 10.1038/s41598-022-04951-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Accepted: 01/04/2022] [Indexed: 12/14/2022] Open
Abstract
Accurate prostate cancer screening is imperative for reducing the risk of cancer death. Ultrasound imaging, although easy, tends to have low resolution and high inter-observer variability. Here, we show that our integrated machine learning approach enabled the detection of pathological high-grade cancer by the ultrasound procedure. Our study included 772 consecutive patients and 2899 prostate ultrasound images obtained at the Nippon Medical School Hospital. We applied machine learning analyses using ultrasound imaging data and clinical data to detect high-grade prostate cancer. The area under the curve (AUC) using clinical data was 0.691. On the other hand, the AUC when using clinical data and ultrasound imaging data was 0.835 (p = 0.007). Our data-driven ultrasound approach offers an efficient tool to triage patients with high-grade prostate cancers and expands the possibility of ultrasound imaging for the prostate cancer detection pathway.
Collapse
Affiliation(s)
- Jun Akatsuka
- Department of Urology, Nippon Medical School Hospital, Tokyo, 113-8603, Japan
- Pathology Informatics Team, RIKEN Center for Advanced Intelligence Project, Tokyo, 103-0027, Japan
| | - Yasushi Numata
- Pathology Informatics Team, RIKEN Center for Advanced Intelligence Project, Tokyo, 103-0027, Japan
| | - Hiromu Morikawa
- Pathology Informatics Team, RIKEN Center for Advanced Intelligence Project, Tokyo, 103-0027, Japan
| | - Tetsuro Sekine
- Department of Radiology, Nippon Medical School Hospital, Tokyo, 113-8603, Japan
| | - Shigenori Kayama
- Department of Urology, Nippon Medical School Hospital, Tokyo, 113-8603, Japan
| | - Hikaru Mikami
- Department of Urology, Nippon Medical School Hospital, Tokyo, 113-8603, Japan
| | - Masato Yanagi
- Department of Urology, Nippon Medical School Hospital, Tokyo, 113-8603, Japan
| | - Yuki Endo
- Department of Urology, Nippon Medical School Hospital, Tokyo, 113-8603, Japan
| | - Hayato Takeda
- Department of Urology, Nippon Medical School Hospital, Tokyo, 113-8603, Japan
| | - Yuka Toyama
- Department of Urology, Nippon Medical School Hospital, Tokyo, 113-8603, Japan
| | - Ruri Yamaguchi
- Pathology Informatics Team, RIKEN Center for Advanced Intelligence Project, Tokyo, 103-0027, Japan
| | - Go Kimura
- Department of Urology, Nippon Medical School Hospital, Tokyo, 113-8603, Japan
| | - Yukihiro Kondo
- Department of Urology, Nippon Medical School Hospital, Tokyo, 113-8603, Japan
| | - Yoichiro Yamamoto
- Pathology Informatics Team, RIKEN Center for Advanced Intelligence Project, Tokyo, 103-0027, Japan.
| |
Collapse
|
36
|
Sh. Daoud M, Fatima A, Ahmad Khan W, Adnan Khan M, Abbas S, Ihnaini B, Ahmad M, Sheraz Javeid M, Aftab S. Joint Channel and Multi-User Detection Empowered with Machine Learning. COMPUTERS, MATERIALS & CONTINUA 2022; 70:109-121. [DOI: 10.32604/cmc.2022.019295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/09/2021] [Accepted: 05/10/2021] [Indexed: 08/21/2023]
|
37
|
AIM in Neurology. Artif Intell Med 2022. [DOI: 10.1007/978-3-030-64573-1_189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
38
|
Saeed F, Al-Sarem M, Al-Mohaimeed M, Emara A, Boulila W, Alasli M, Ghabban F. Enhancing Parkinson's Disease Prediction Using Machine Learning and Feature Selection Methods. COMPUTERS, MATERIALS & CONTINUA 2022; 71:5639-5658. [DOI: 10.32604/cmc.2022.023124] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/29/2021] [Accepted: 11/19/2021] [Indexed: 06/15/2023]
|
39
|
Blockchain-Based IoT Devices in Supply Chain Management: A Systematic Literature Review. SUSTAINABILITY 2021. [DOI: 10.3390/su132413646] [Citation(s) in RCA: 45] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
Through recent progress, the forms of modern supply chains have evolved into complex networks. The supply chain management systems face a variety of challenges. These include lack of visibility of the upstream party (Provider) to the downstream party (Client); lack of flexibility in the face of sudden variations in demand and control of operating costs; lack of reliance on safety stakeholders; ineffective management of supply chain risks. Blockchain (BC) is used in the supply chain to overcome the growing demands for items. The Internet of Things (IoT) is a profoundly encouraging innovation that can help companies observe, track, and monitor products, activities, and processes within their respective value chain networks. Research establishments and logical gatherings are ceaselessly attempting to answer IoT gadgets in supply chain management. This paper presents orderly writing on and reviewing of Blockchain-based IoT advances and their current usage. We discuss the smart devices used in this system and which device is the most appropriate in the supply chain. This paper also looks at future examination themes in blockchain-based IoT, referred to as the executive’s framework production network. The essential deliberate writing audit has been consolidated by surveying research articles circulated in highly reputable publications between 2016 and 2021. Lastly, current issues and challenges are present to provide researchers with promising future directions in IoT supply chain management systems.
Collapse
|
40
|
Application of artificial intelligence and radiomics in pituitary neuroendocrine and sellar tumors: a quantitative and qualitative synthesis. Neuroradiology 2021; 64:647-668. [PMID: 34839380 DOI: 10.1007/s00234-021-02845-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2021] [Accepted: 10/21/2021] [Indexed: 01/03/2023]
Abstract
PURPOSE To systematically review the literature regarding the application of machine learning (ML) of magnetic resonance imaging (MRI) radiomics in common sellar tumors. To identify future directions for application of ML in sellar tumor MRI. METHODS PubMed, Medline, Embase, Google Scholar, Scopus, ArxIV, and bioRxiv were searched to identify relevant studies published between 2010 and September 2021. Studies were included if they specifically involved ML of MRI radiomics in the analysis of sellar masses. Risk of bias assessment was performed using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) Tool. RESULTS Fifty-eight articles were identified for review. All papers utilized retrospective data, and a quantitative systematic review was performed for thirty-one studies utilizing a public dataset which compared pituitary adenomas, meningiomas, and gliomas. One of the analyzed architectures yielded the highest classification accuracy of 0.996. The remaining twenty-seven articles were qualitatively reviewed and showed promising findings in predicting specific tumor characteristics such as tumor consistency, Ki-67 proliferative index, and post-surgical recurrence. CONCLUSION This review highlights the potential clinical application of ML using MRI radiomic data of the sellar region in diagnosis and predicting treatment outcomes. We describe future directions for practical application in the clinical care of patients with pituitary neuroendocrine and other sellar tumors.
Collapse
|
41
|
Ubaid MT, Kiran A, Raja MT, Asim UA, Darboe A, Arshed MA. Automatic Helmet Detection using EfficientDet. 2021 INTERNATIONAL CONFERENCE ON INNOVATIVE COMPUTING (ICIC) 2021. [DOI: 10.1109/icic53490.2021.9693093] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|
42
|
Wahab A, Alam TM, Raza MM. Usability Evaluation of FinTech Mobile Applications: A Statistical Approach. 2021 INTERNATIONAL CONFERENCE ON INNOVATIVE COMPUTING (ICIC) 2021. [DOI: 10.1109/icic53490.2021.9691512] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|
43
|
Nadeem MW, Goh HG, Ponnusamy V, Andonovic I, Khan MA, Hussain M. A Fusion-Based Machine Learning Approach for the Prediction of the Onset of Diabetes. Healthcare (Basel) 2021; 9:1393. [PMID: 34683073 PMCID: PMC8535299 DOI: 10.3390/healthcare9101393] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2021] [Revised: 10/08/2021] [Accepted: 10/09/2021] [Indexed: 12/03/2022] Open
Abstract
A growing portfolio of research has been reported on the use of machine learning-based architectures and models in the domain of healthcare. The development of data-driven applications and services for the diagnosis and classification of key illness conditions is challenging owing to issues of low volume, low-quality contextual data for the training, and validation of algorithms, which, in turn, compromises the accuracy of the resultant models. Here, a fusion machine learning approach is presented reporting an improvement in the accuracy of the identification of diabetes and the prediction of the onset of critical events for patients with diabetes (PwD). Globally, the cost of treating diabetes, a prevalent chronic illness condition characterized by high levels of sugar in the bloodstream over long periods, is placing severe demands on health providers and the proposed solution has the potential to support an increase in the rates of survival of PwD through informing on the optimum treatment on an individual patient basis. At the core of the proposed architecture is a fusion of machine learning classifiers (Support Vector Machine and Artificial Neural Network). Results indicate a classification accuracy of 94.67%, exceeding the performance of reported machine learning models for diabetes by ~1.8% over the best reported to date.
Collapse
Affiliation(s)
- Muhammad Waqas Nadeem
- Faculty of Information and Communication Technology (FICT), Universiti Tunku Abdul Rahman (UTAR), Kampar 31900, Perak, Malaysia; (M.W.N.); (H.G.G.); (V.P.)
| | - Hock Guan Goh
- Faculty of Information and Communication Technology (FICT), Universiti Tunku Abdul Rahman (UTAR), Kampar 31900, Perak, Malaysia; (M.W.N.); (H.G.G.); (V.P.)
| | - Vasaki Ponnusamy
- Faculty of Information and Communication Technology (FICT), Universiti Tunku Abdul Rahman (UTAR), Kampar 31900, Perak, Malaysia; (M.W.N.); (H.G.G.); (V.P.)
| | - Ivan Andonovic
- Department of Electronic & Electrical Engineering, University of Strathclyde, Royal College Building, 204 George St., Glasgow G1 1XW, UK
| | - Muhammad Adnan Khan
- Pattern Recognition and Machine Learning Lab, Department of Software, Gachon University, Seongnam 13557, Korea
| | - Muzammil Hussain
- Department of Computer Science, School of Systems and Technology, University of Management and Technology, Lahore 54000, Pakistan;
| |
Collapse
|
44
|
Nawaz M, Nazir T, Masood M, Mehmood A, Mahum R, Khan MA, Kadry S, Thinnukool O. Analysis of Brain MRI Images Using Improved CornerNet Approach. Diagnostics (Basel) 2021; 11:1856. [PMID: 34679554 PMCID: PMC8535141 DOI: 10.3390/diagnostics11101856] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Revised: 09/24/2021] [Accepted: 09/27/2021] [Indexed: 01/18/2023] Open
Abstract
The brain tumor is a deadly disease that is caused by the abnormal growth of brain cells, which affects the human blood cells and nerves. Timely and precise detection of brain tumors is an important task to avoid complex and painful treatment procedures, as it can assist doctors in surgical planning. Manual brain tumor detection is a time-consuming activity and highly dependent on the availability of area experts. Therefore, it is a need of the hour to design accurate automated systems for the detection and classification of various types of brain tumors. However, the exact localization and categorization of brain tumors is a challenging job due to extensive variations in their size, position, and structure. To deal with the challenges, we have presented a novel approach, namely, DenseNet-41-based CornerNet framework. The proposed solution comprises three steps. Initially, we develop annotations to locate the exact region of interest. In the second step, a custom CornerNet with DenseNet-41 as a base network is introduced to extract the deep features from the suspected samples. In the last step, the one-stage detector CornerNet is employed to locate and classify several brain tumors. To evaluate the proposed method, we have utilized two databases, namely, the Figshare and Brain MRI datasets, and attained an average accuracy of 98.8% and 98.5%, respectively. Both qualitative and quantitative analysis show that our approach is more proficient and consistent with detecting and classifying various types of brain tumors than other latest techniques.
Collapse
Affiliation(s)
- Marriam Nawaz
- Department of Computer Science, University of Engineering and Technology, Taxila 47050, Pakistan; (M.N.); (T.N.); (M.M.); (A.M.); (R.M.)
| | - Tahira Nazir
- Department of Computer Science, University of Engineering and Technology, Taxila 47050, Pakistan; (M.N.); (T.N.); (M.M.); (A.M.); (R.M.)
| | - Momina Masood
- Department of Computer Science, University of Engineering and Technology, Taxila 47050, Pakistan; (M.N.); (T.N.); (M.M.); (A.M.); (R.M.)
| | - Awais Mehmood
- Department of Computer Science, University of Engineering and Technology, Taxila 47050, Pakistan; (M.N.); (T.N.); (M.M.); (A.M.); (R.M.)
| | - Rabbia Mahum
- Department of Computer Science, University of Engineering and Technology, Taxila 47050, Pakistan; (M.N.); (T.N.); (M.M.); (A.M.); (R.M.)
| | | | - Seifedine Kadry
- Department of Applied Data Science, Noroff University College, 4612 Kristiansand, Norway;
| | - Orawit Thinnukool
- Research Group of Embedded Systems and Mobile Application in Health Science, College of Arts, Media and Technology, Chiang Mai University, Chiang Mai 50200, Thailand
| |
Collapse
|
45
|
Sethy PK, Behera SK. A data constrained approach for brain tumour detection using fused deep features and SVM. MULTIMEDIA TOOLS AND APPLICATIONS 2021; 80:28745-28760. [DOI: 10.1007/s11042-021-11098-2] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/08/2020] [Revised: 04/14/2021] [Accepted: 05/21/2021] [Indexed: 08/02/2023]
|
46
|
Aghalari M, Aghagolzadeh A, Ezoji M. Brain tumor image segmentation via asymmetric/symmetric UNet based on two-pathway-residual blocks. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102841] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
|
47
|
Hau P, Frappaz D, Hovey E, McCabe MG, Pajtler KW, Wiestler B, Seidel C, Combs SE, Dirven L, Klein M, Anazodo A, Hattingen E, Hofer S, Pfister SM, Zimmer C, Kortmann RD, Sunyach MP, Tanguy R, Effeney R, von Deimling A, Sahm F, Rutkowski S, Berghoff AS, Franceschi E, Pineda E, Beier D, Peeters E, Gorlia T, Vanlancker M, Bromberg JEC, Gautier J, Ziegler DS, Preusser M, Wick W, Weller M. Development of Randomized Trials in Adults with Medulloblastoma-The Example of EORTC 1634-BTG/NOA-23. Cancers (Basel) 2021; 13:cancers13143451. [PMID: 34298664 PMCID: PMC8303185 DOI: 10.3390/cancers13143451] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2021] [Revised: 07/07/2021] [Accepted: 07/08/2021] [Indexed: 12/15/2022] Open
Abstract
Simple Summary Medulloblastoma is rare after puberty. Among several molecular subgroups that have been described, the sonic hedgehog (SHH) subgroup is highly overrepresented in the post-pubertal population and can be targeted with smoothened (SMO) inhibitors. However, no practice-changing prospective clinical trials have been published in adults to date. Tumors often recur, and treatment toxicity is relevant. Thus, the EORTC 1634-BTG/NOA-23 trial for post-pubertal patients with standard risk medulloblastoma will aim to increase treatment efficacy and to decrease treatment toxicity. Patients will be randomized between standard-dose vs. reduced-dosed radiotherapy, and SHH-subgroup patients will also be randomized between the SMO inhibitor sonidegib (OdomzoTM,, Sun Pharmaceuticals Industries, Inc., New York, USA) in addition to standard radio-chemotherapy vs. standard radio-chemotherapy alone. In ancillary studies, we will investigate tumor tissue, blood and cerebrospinal fluid samples, magnetic resonance images, and radiotherapy plans to gain information that may improve future treatment. Patients will also be monitored long-term for late side effects of therapy, health-related quality of life, cognitive function, social and professional live outcomes, and reproduction and fertility. In summary, EORTC 1634-BTG/NOA-23 is a unique multi-national effort that will help to council patients and clinical scientists for the appropriate design of treatments and future clinical trials for post-pubertal patients with medulloblastoma. Abstract Medulloblastoma is a rare brain malignancy. Patients after puberty are rare and bear an intermediate prognosis. Standard treatment consists of maximal resection plus radio-chemotherapy. Treatment toxicity is high and produces disabling long-term side effects. The sonic hedgehog (SHH) subgroup is highly overrepresented in the post-pubertal and adult population and can be targeted by smoothened (SMO) inhibitors. No practice-changing prospective randomized data have been generated in adults. The EORTC 1634-BTG/NOA-23 trial will randomize patients between standard-dose vs. reduced-dosed craniospinal radiotherapy and SHH-subgroup patients between the SMO inhibitor sonidegib (OdomzoTM, Sun Pharmaceuticals Industries, Inc., New York, USA) in addition to standard radio-chemotherapy vs. standard radio-chemotherapy alone to improve outcomes in view of decreased radiotherapy-related toxicity and increased efficacy. We will further investigate tumor tissue, blood, and cerebrospinal fluid as well as magnetic resonance imaging and radiotherapy plans to generate information that helps to further improve treatment outcomes. Given that treatment side effects typically occur late, long-term follow-up will monitor classic side effects of therapy, but also health-related quality of life, cognition, social and professional outcome, and reproduction and fertility. In summary, we will generate unprecedented data that will be translated into treatment changes in post-pubertal patients with medulloblastoma and will help to design future clinical trials.
Collapse
Affiliation(s)
- Peter Hau
- Wilhelm Sander-NeuroOncology Unit, Regensburg University Hospital, 93053 Regensburg, Germany
- Department of Neurology, Regensburg University Hospital, 93053 Regensburg, Germany
- Correspondence: ; Tel.: +49-941-944-18750
| | - Didier Frappaz
- Neuro-Oncology Unit, Centre Léon Bérard, 69008 Lyon, France;
| | - Elizabeth Hovey
- Department of Medical Oncology, Sydney 2052, Australia;
- Nelune Comprehensive Cancer Centre, Prince of Wales Cancer Centre, Sydney 2031, Australia;
| | - Martin G. McCabe
- Faculty of Medicine, Biology and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester M20 4GJ, UK;
| | - Kristian W. Pajtler
- Hopp-Children’s Cancer Center Heidelberg (KiTZ), Division of Pediatric Neurooncology, German Cancer Research Center (DKFZ), 69120 Heidelberg, Germany; (K.W.P.); (S.M.P.)
- Department of Pediatric Hematology and Oncology, Heidelberg University Hospital, 69120 Heidelberg, Germany
| | - Benedikt Wiestler
- Department of Diagnostic and Interventional Neuroradiology, Klinikum Rechts der Isar der Technischen Universität München, TUM School of Medicine, 81675 Munich, Germany; (B.W.); (C.Z.)
| | - Clemens Seidel
- Department of Radiation-Oncology, University Hospital Leipzig, 04103 Leipzig, Germany; (C.S.); (R.-D.K.)
| | - Stephanie E. Combs
- Department of Radiation Oncology, Klinikum Rechts der Isar der Technischen Universität München, TUM School of Medicine, 81675 Munich, Germany;
| | - Linda Dirven
- Department of Neurology, Leiden University Medical Center, 2300 RC Leiden, The Netherlands;
- Department of Neurology, Haaglanden Medical Center, 2501 CK The Hague, The Netherlands
| | - Martin Klein
- Department of Medical Psychology, Amsterdam UMC, Vrije Universiteit Amsterdam, 1081 HV Amsterdam, The Netherlands;
- Brain Tumor Center Amsterdam at Amsterdam UMC, Vrije Universiteit Amsterdam, 1081 HV Amsterdam, The Netherlands
| | - Antoinette Anazodo
- Nelune Comprehensive Cancer Centre, Prince of Wales Cancer Centre, Sydney 2031, Australia;
- Kids Cancer Centre, Sydney Children’s Hospital, Sydney 2031, Australia;
- School of Women’s and Children’s Health, University of New South Wales, Sydney 2031, Australia
| | - Elke Hattingen
- Department of Neuroradiology, University Hospital Frankfurt, Goethe University, 60528 Frankfurt, Germany;
| | - Silvia Hofer
- Department of Neurology, University Hospital Zurich, 8091 Zurich, Switzerland; (S.H.); (M.W.)
| | - Stefan M. Pfister
- Hopp-Children’s Cancer Center Heidelberg (KiTZ), Division of Pediatric Neurooncology, German Cancer Research Center (DKFZ), 69120 Heidelberg, Germany; (K.W.P.); (S.M.P.)
- Department of Pediatric Hematology and Oncology, Heidelberg University Hospital, 69120 Heidelberg, Germany
| | - Claus Zimmer
- Department of Diagnostic and Interventional Neuroradiology, Klinikum Rechts der Isar der Technischen Universität München, TUM School of Medicine, 81675 Munich, Germany; (B.W.); (C.Z.)
| | - Rolf-Dieter Kortmann
- Department of Radiation-Oncology, University Hospital Leipzig, 04103 Leipzig, Germany; (C.S.); (R.-D.K.)
| | - Marie-Pierre Sunyach
- Department of Radiation Oncology, Centre Leon Berard, 69008 Lyon, France; (M.-P.S.); (R.T.)
| | - Ronan Tanguy
- Department of Radiation Oncology, Centre Leon Berard, 69008 Lyon, France; (M.-P.S.); (R.T.)
| | - Rachel Effeney
- Department of Radiation Oncology, Royal Brisbane and Women’s Hospital, Brisbane 4029, Australia;
| | - Andreas von Deimling
- Department of Neuropathology, University Hospital Heidelberg, 69120 Heidelberg, Germany; (A.v.D.); (F.S.)
- Clinical Cooperation Unit Neuropathology, German Consortium for Translational Cancer Research (DKTK), German Cancer Research, 69120 Heidelberg, Germany
| | - Felix Sahm
- Department of Neuropathology, University Hospital Heidelberg, 69120 Heidelberg, Germany; (A.v.D.); (F.S.)
- Clinical Cooperation Unit Neuropathology, German Consortium for Translational Cancer Research (DKTK), German Cancer Research, 69120 Heidelberg, Germany
| | - Stefan Rutkowski
- Department of Pediatric Hematology and Oncology, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany;
| | - Anna S. Berghoff
- Division of Oncology, Department of Medicine I, Medical University of Vienna, 1090 Vienna, Austria; (A.S.B.); (M.P.)
| | - Enrico Franceschi
- Medical Oncology Department, Azienda USL/IRCCS Institute of Neurological Sciences, 40139 Bologna, Italy;
| | - Estela Pineda
- Barcelona Translational Genomics and Targeted Therapeutics in Solid Tumors Group, Department of Medical Oncology, Hospital Clinic Barcelona, 08036 Barcelona, Spain;
| | - Dagmar Beier
- Department of Neurology, Odense University Hospital, DK-5000 Odense, Denmark;
| | - Ellen Peeters
- EORTC Headquarters, 1200 Brussels, Belgium; (E.P.); (T.G.); (M.V.)
| | - Thierry Gorlia
- EORTC Headquarters, 1200 Brussels, Belgium; (E.P.); (T.G.); (M.V.)
| | | | - Jacoline E. C. Bromberg
- Erasmus Medical Center Cancer Institute, Department of Neuro-Oncology, 3015 GD Rotterdam, The Netherlands;
| | - Julien Gautier
- Clinical Research Department, Centre Léon Bérard, 69008 Lyon, France;
| | - David S. Ziegler
- Kids Cancer Centre, Sydney Children’s Hospital, Sydney 2031, Australia;
- School of Women’s and Children’s Health, University of New South Wales, Sydney 2031, Australia
- Children’s Cancer Institute, University of New South Wales, Sydney 2031, Australia
| | - Matthias Preusser
- Division of Oncology, Department of Medicine I, Medical University of Vienna, 1090 Vienna, Austria; (A.S.B.); (M.P.)
| | - Wolfgang Wick
- Department of Neurology, University Hospital Heidelberg, 69120 Heidelberg, Germany;
- Clinical Cooperation Unit Neuro-Oncology, German Consortium for Translational Cancer Research (DKTK), German Cancer Research, 69120 Heidelberg, Germany
| | - Michael Weller
- Department of Neurology, University Hospital Zurich, 8091 Zurich, Switzerland; (S.H.); (M.W.)
| |
Collapse
|
48
|
Mbugua SN, Njenga LW, Odhiambo RA, Wandiga SO, Onani MO. Beyond DNA-targeting in Cancer Chemotherapy. Emerging Frontiers - A Review. Curr Top Med Chem 2021; 21:28-47. [PMID: 32814532 DOI: 10.2174/1568026620666200819160213] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2020] [Revised: 07/07/2020] [Accepted: 07/08/2020] [Indexed: 12/14/2022]
Abstract
Modern anti-cancer drugs target DNA specifically for rapid division of malignant cells. One downside of this approach is that they also target other rapidly dividing healthy cells, such as those involved in hair growth leading to serious toxic side effects and hair loss. Therefore, it would be better to develop novel agents that address cellular signaling mechanisms unique to cancerous cells, and new research is now focussing on such approaches. Although the classical chemotherapy area involving DNA as the set target continues to produce important findings, nevertheless, a distinctly discernible emerging trend is the divergence from the cisplatin operation model that uses the metal as the primary active center of the drug. Many successful anti-cancer drugs present are associated with elevated toxicity levels. Cancers also develop immunity against most therapies and the area of cancer research can, therefore, be seen as an area with a high unaddressed need. Hence, ongoing work into cancer pathogenesis is important to create accurate preclinical tests that can contribute to the development of innovative drugs to manage and treat cancer. Some of the emergent frontiers utilizing different approaches include nanoparticles delivery, use of quantum dots, metal complexes, tumor ablation, magnetic hypothermia and hyperthermia by use of Superparamagnetic Iron oxide Nanostructures, pathomics and radiomics, laser surgery and exosomes. This review summarizes these new approaches in good detail, giving critical views with necessary comparisons. It also delves into what they carry for the future, including their advantages and disadvantages.
Collapse
Affiliation(s)
- Simon N Mbugua
- Department of Chemistry, University of Nairobi, P.O. Box 30197-00100, Nairobi, Kenya
| | - Lydia W Njenga
- Department of Chemistry, University of Nairobi, P.O. Box 30197-00100, Nairobi, Kenya
| | - Ruth A Odhiambo
- Department of Chemistry, University of Nairobi, P.O. Box 30197-00100, Nairobi, Kenya
| | - Shem O Wandiga
- Department of Chemistry, University of Nairobi, P.O. Box 30197-00100, Nairobi, Kenya
| | - Martin O Onani
- Organometallics and Nanomaterials, Department of Chemistry, University of the Western Cape, Private Bag X17, Bellville, 7535, South Africa
| |
Collapse
|
49
|
Emara HM, Shoaib MR, Elwekeil M, El‐Shafai W, Taha TE, El‐Fishawy AS, El‐Rabaie EM, Alshebeili SA, Dessouky MI, Abd El‐Samie FE. Deep convolutional neural networks for COVID-19 automatic diagnosis. Microsc Res Tech 2021; 84:2504-2516. [PMID: 34121273 PMCID: PMC8420362 DOI: 10.1002/jemt.23713] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Revised: 12/29/2020] [Accepted: 01/06/2021] [Indexed: 11/16/2022]
Abstract
This article is mainly concerned with COVID‐19 diagnosis from X‐ray images. The number of cases infected with COVID‐19 is increasing daily, and there is a limitation in the number of test kits needed in hospitals. Therefore, there is an imperative need to implement an efficient automatic diagnosis system to alleviate COVID‐19 spreading among people. This article presents a discussion of the utilization of convolutional neural network (CNN) models with different learning strategies for automatic COVID‐19 diagnosis. First, we consider the CNN‐based transfer learning approach for automatic diagnosis of COVID‐19 from X‐ray images with different training and testing ratios. Different pre‐trained deep learning models in addition to a transfer learning model are considered and compared for the task of COVID‐19 detection from X‐ray images. Confusion matrices of these studied models are presented and analyzed. Considering the performance results obtained, ResNet models (ResNet18, ResNet50, and ResNet101) provide the highest classification accuracy on the two considered datasets with different training and testing ratios, namely 80/20, 70/30, 60/40, and 50/50. The accuracies obtained using the first dataset with 70/30 training and testing ratio are 97.67%, 98.81%, and 100% for ResNet18, ResNet50, and ResNet101, respectively. For the second dataset, the reported accuracies are 99%, 99.12%, and 99.29% for ResNet18, ResNet50, and ResNet101, respectively. The second approach is the training of a proposed CNN model from scratch. The results confirm that training of the CNN from scratch can lead to the identification of the signs of COVID‐19 disease.
Collapse
Affiliation(s)
- Heba M. Emara
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - Mohamed R. Shoaib
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - Mohamed Elwekeil
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - Walid El‐Shafai
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
- Security Engineering LabComputer Science Department, Prince Sultan UniversityRiyadhSaudi Arabia
| | - Taha E. Taha
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - Adel S. El‐Fishawy
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - El‐Sayed M. El‐Rabaie
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - Saleh A. Alshebeili
- Electrical Engineering DepartmentKACST‐TIC in Radio Frequency and Photonics for the e‐Society (RFTONICS), King Saud UniversityRiyadhSaudi Arabia
- Department of Electrical EngineeringKing Saud UniversityRiyadhSaudi Arabia
| | - Moawad I. Dessouky
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
| | - Fathi E. Abd El‐Samie
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic EngineeringMenoufia UniversityMenoufEgypt
- Department of Information TechnologyCollege of Computer and Information Sciences, Princess Nourah Bint Abdulrahman UniversityRiyadhSaudi Arabia
| |
Collapse
|
50
|
Nazir M, Shakil S, Khurshid K. Role of deep learning in brain tumor detection and classification (2015 to 2020): A review. Comput Med Imaging Graph 2021; 91:101940. [PMID: 34293621 DOI: 10.1016/j.compmedimag.2021.101940] [Citation(s) in RCA: 52] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2020] [Revised: 04/14/2021] [Accepted: 05/10/2021] [Indexed: 02/06/2023]
Abstract
During the last decade, computer vision and machine learning have revolutionized the world in every way possible. Deep Learning is a sub field of machine learning that has shown remarkable results in every field especially biomedical field due to its ability of handling huge amount of data. Its potential and ability have also been applied and tested in the detection of brain tumor using MRI images for effective prognosis and has shown remarkable performance. The main objective of this research work is to present a detailed critical analysis of the research and findings already done to detect and classify brain tumor through MRI images in the recent past. This analysis is specifically beneficial for the researchers who are experts of deep learning and are interested to apply their expertise for brain tumor detection and classification. As a first step, a brief review of the past research papers using Deep Learning for brain tumor classification and detection is carried out. Afterwards, a critical analysis of Deep Learning techniques proposed in these research papers (2015-2020) is being carried out in the form of a Table. Finally, the conclusion highlights the merits and demerits of deep neural networks. The results formulated in this paper will provide a thorough comparison of recent studies to the future researchers, along with the idea of the effectiveness of various deep learning approaches. We are confident that this study would greatly assist in advancement of brain tumor research.
Collapse
Affiliation(s)
- Maria Nazir
- iVision Lab, Electrical Engineering Department, Institute of Space Technology, Islamabad, Pakistan.
| | - Sadia Shakil
- iVision Lab, Electrical Engineering Department, Institute of Space Technology, Islamabad, Pakistan; Turner Institute for Brain and Mental Health, Monash University, Melbourne, Australia
| | - Khurram Khurshid
- iVision Lab, Electrical Engineering Department, Institute of Space Technology, Islamabad, Pakistan
| |
Collapse
|