Multi-Modal Brain Tumor Detection Using Deep Neural Network and Multiclass SVM

Improving healthcare sustainability using advanced brain simulations using a multi-modal deep learning strategy with VGG19 and bidirectional LSTM

Background

Brain tumor categorization on MRI is a challenging but crucial task in medical imaging, requiring high resilience and accuracy for effective diagnostic applications. This study describe a unique multimodal scheme combining the capabilities of deep learning with ensemble learning approaches to overcome these issues.

Methods

The system integrates three new modalities, spatial feature extraction using a pre-trained VGG19 network, sequential dependency learning using a Bidirectional LSTM, and classification efficiency through a LightGBM classifier.

Results

The combination of both methods leverages the complementary strengths of convolutional neural networks and recurrent neural networks, thus enabling the model to achieve state-of-the-art performance scores. The outcomes confirm the efficacy of this multimodal approach, which achieves a total accuracy of 97%, an F1-score of 0.97, and a ROC AUC score of 0.997.

Conclusion

With synergistic harnessing of spatial and sequential features, the model enhances classification rates and effectively deals with high-dimensional data, compared to traditional single-modal methods. The scalable methodology has the possibility of greatly augmenting brain tumor diagnosis and planning of treatment in medical imaging studies.

Interactive Multi-scale Fusion: Advancing Brain Tumor Detection Through Trans-IMSM Model

Multi-modal medical image (MI) fusion assists in generating collaboration images collecting complement features through the distinct images of several conditions. The images help physicians to diagnose disease accurately. Hence, this research proposes a novel multi-modal MI fusion modal named guided filter-based interactive multi-scale and multi-modal transformer (Trans-IMSM) fusion approach to develop high-quality computed tomography-magnetic resonance imaging (CT-MRI) fused images for brain tumor detection. This research utilizes the CT and MRI brain scan dataset to gather the input CT and MRI images. At first, the data preprocessing is carried out to preprocess these input images to improve the image quality and generalization ability for further analysis. Then, these preprocessed CT and MRI are decomposed into detail and base components utilizing the guided filter-based MI decomposition approach. This approach involves two phases: such as acquiring the image guidance and decomposing the images utilizing the guided filter. A canny operator is employed to acquire the image guidance comprising robust edge for CT and MRI images, and the guided filter is applied to decompose the guidance and preprocessed images. Then, by applying the Trans-IMSM model, fuse the detail components, while a weighting approach is used for the base components. The fused detail and base components are subsequently processed through a gated fusion and reconstruction network, and the final fused images for brain tumor detection are generated. Extensive tests are carried out to compute the Trans-IMSM method's efficacy. The evaluation results demonstrated the robustness and effectiveness, achieving an accuracy of 98.64% and an SSIM of 0.94.

A hybrid EfficientNet-DbneAlexnet for brain tumor detection using MRI images

The rapid growth of abnormal cells in the brain presents a serious risk to the health of humans as it can result in death. Since these tumors have a varied range of shapes, sizes, and positions, identifying Brain Tumors (BTs) is challenging. Magnetic Resonance Images (MRI) are most utilized for identifying malignant tumors. This paper develops a new approach, named EfficientNet-Deep batch normalized eLUAlexnet (EfficientNet-DbneAlexnet) for detecting BTs. Firstly, the input MRI image is transmitted for image enhancement. Here, the image is enhanced by the Piecewise Linear Transformation (PLT). After this, skull stripping is carried out, which is performed by the Fuzzy Local Information C Means (FLICM). Following this, the tumor area in the image is segmented with the help of a Projective Adversarial Network (PAN). The segmented image is later applied to the feature extraction module, wherein features like textural and statistical features are extracted. Finally, the BT detection is accomplished using the developed EfficientNet-DbneAlexnet, which is created by assimilating EfficientNet and Deep batch normalized eLUAlexnet (DbneAlexnet). The results demonstrate that EfficientNet-DbneAlexnet obtained a sensitivity of 90.36 %, accuracy of 92.77 %, and specificity of 91.82 %.

An attention 3DUNET and visual geometry group-19 based deep neural network for brain tumor segmentation and classification from MRI

There has been an abrupt increase in brain tumor (BT) related medical cases during the past ten years. The tenth most typical type of tumor affecting millions of people is the BT. The cure rate can, however, rise if it is found early. When evaluating BT diagnosis and treatment options, MRI is a crucial tool. However, segmenting the tumors from magnetic resonance (MR) images is complex. The advancement of deep learning (DL) has led to the development of numerous automatic segmentation and classification approaches. However, most need improvement since they are limited to 2D images. So, this article proposes a novel and optimal DL system for segmenting and classifying the BTs from 3D brain MR images. Preprocessing, segmentation, feature extraction, feature selection, and tumor classification are the main phases of the proposed work. Preprocessing, such as noise removal, is performed on the collected brain MR images using bilateral filtering. The tumor segmentation uses spatial and channel attention-based three-dimensional u-shaped network (SC3DUNet) to segment the tumor lesions from the preprocessed data. After that, the feature extraction is done based on dilated convolution-based visual geometry group-19 (DCVGG-19), making the classification task more manageable. The optimal features are selected from the extracted feature sets using diagonal linear uniform and tangent flight included butterfly optimization algorithm. Finally, the proposed system applies an optimal hyperparameters-based deep neural network to classify the tumor classes. The experiments conducted on the BraTS2020 dataset show that the suggested method can segment tumors and categorize them more accurately than the existing state-of-the-art mechanisms.Communicated by Ramaswamy H. Sarma.

Information Geometry and Manifold Learning: A Novel Framework for Analyzing Alzheimer's Disease MRI Data

Background: Alzheimer's disease is a progressive neurological condition marked by a decline in cognitive abilities. Early diagnosis is crucial but challenging due to overlapping symptoms among impairment stages, necessitating non-invasive, reliable diagnostic tools. Methods: We applied information geometry and manifold learning to analyze grayscale MRI scans classified into No Impairment, Very Mild, Mild, and Moderate Impairment. Preprocessed images were reduced via Principal Component Analysis (retaining 95% variance) and converted into statistical manifolds using estimated mean vectors and covariance matrices. Geodesic distances, computed with the Fisher Information metric, quantified class differences. Graph Neural Networks, including Graph Convolutional Networks (GCN), Graph Attention Networks (GAT), and GraphSAGE, were utilized to categorize impairment levels using graph-based representations of the MRI data. Results: Significant differences in covariance structures were observed, with increased variability and stronger feature correlations at higher impairment levels. Geodesic distances between No Impairment and Mild Impairment (58.68, p<0.001) and between Mild and Moderate Impairment (58.28, p<0.001) are statistically significant. GCN and GraphSAGE achieve perfect classification accuracy (precision, recall, F1-Score: 1.0), correctly identifying all instances across classes. GAT attains an overall accuracy of 59.61%, with variable performance across classes. Conclusions: Integrating information geometry, manifold learning, and GNNs effectively differentiates AD impairment stages from MRI data. The strong performance of GCN and GraphSAGE indicates their potential to assist clinicians in the early identification and tracking of Alzheimer's disease progression.

Advanced Brain Tumor Classification in MR Images Using Transfer Learning and Pre-Trained Deep CNN Models

BACKGROUND/OBJECTIVES

Brain tumor classification is a crucial task in medical diagnostics, as early and accurate detection can significantly improve patient outcomes. This study investigates the effectiveness of pre-trained deep learning models in classifying brain MRI images into four categories: Glioma, Meningioma, Pituitary, and No Tumor, aiming to enhance the diagnostic process through automation.

METHODS

A publicly available Brain Tumor MRI dataset containing 7023 images was used in this research. The study employs state-of-the-art pre-trained models, including Xception, MobileNetV2, InceptionV3, ResNet50, VGG16, and DenseNet121, which are fine-tuned using transfer learning, in combination with advanced preprocessing and data augmentation techniques. Transfer learning was applied to fine-tune the models and optimize classification accuracy while minimizing computational requirements, ensuring efficiency in real-world applications.

RESULTS

Among the tested models, Xception emerged as the top performer, achieving a weighted accuracy of 98.73% and a weighted F1 score of 95.29%, demonstrating exceptional generalization capabilities. These models proved particularly effective in addressing class imbalances and delivering consistent performance across various evaluation metrics, thus demonstrating their suitability for clinical adoption. However, challenges persist in improving recall for the Glioma and Meningioma categories, and the black-box nature of deep learning models requires further attention to enhance interpretability and trust in medical settings.

CONCLUSIONS

The findings underscore the transformative potential of deep learning in medical imaging, offering a pathway toward more reliable, scalable, and efficient diagnostic tools. Future research will focus on expanding dataset diversity, improving model explainability, and validating model performance in real-world clinical settings to support the widespread adoption of AI-driven systems in healthcare and ensure their integration into clinical workflows.

Prediction of Brain Cancer Occurrence and Risk Assessment of Brain Hemorrhage Using Hybrid Deep Learning Technique

The prediction of brain cancer occurrence and risk assessment of brain hemorrhage using a hybrid deep learning (DL) technique is a critical area of research in medical imaging analysis. One prominent challenge in this field is the accurate identification and classification of brain tumors and hemorrhages, which can significantly impact patient prognosis and treatment planning. The objectives of the study address the prediction of brain cancer occurrence and the assessment of risk levels associated with both brain cancers due to brain hemorrhage. A diverse dataset of brain MRI and CT scan images. Utilize Unsymmetrical Trimmed Median Filter with Optics Clustering for noise removal while preserving edges and details. The Chan-Vese segmentation process for refined segmentation. Brain cancer detection using Multi-Head Self-Attention Dilated Convolution Neural Network (MH-SA-DCNN) with Efficient Net Model. Brain cancer detection using MH-SA-DCNN with Efficient Net Model. This trains the algorithm to predict cancerous regions in brain images. Further, implement a Graph-Based Deep Neural Network Model (G-DNN) to capture spatial relationships and risk factors from brain images. Cox regression model to estimate cancer risk over time and fine-tune and optimize the model's parameters and features using the Osprey optimization algorithm (OPA).

Decoding the black box: Explainable AI (XAI) for cancer diagnosis, prognosis, and treatment planning-A state-of-the art systematic review

OBJECTIVE

Explainable Artificial Intelligence (XAI) is increasingly recognized as a crucial tool in cancer care, with significant potential to enhance diagnosis, prognosis, and treatment planning. However, the holistic integration of XAI across all stages of cancer care remains underexplored. This review addresses this gap by systematically evaluating the role of XAI in these critical areas, identifying key challenges and emerging trends.

MATERIALS AND METHODS

Following the PRISMA guidelines, a comprehensive literature search was conducted across Scopus and Web of Science, focusing on publications from January 2020 to May 2024. After rigorous screening and quality assessment, 69 studies were selected for in-depth analysis.

RESULTS

The review identified critical gaps in the application of XAI within cancer care, notably the exclusion of clinicians in 83% of studies, which raises concerns about real-world applicability and may lead to explanations that are technically sound but clinically irrelevant. Additionally, 87% of studies lacked rigorous evaluation of XAI explanations, compromising their reliability in clinical practice. The dominance of post-hoc visual methods like SHAP, LIME and Grad-CAM reflects a trend toward explanations that may be inherently flawed due to specific input perturbations and simplifying assumptions. The lack of formal evaluation metrics and standardization constrains broader XAI adoption in clinical settings, creating a disconnect between AI development and clinical integration. Moreover, translating XAI insights into actionable clinical decisions remains challenging due to the absence of clear guidelines for integrating these tools into clinical workflows.

CONCLUSION

This review highlights the need for greater clinician involvement, standardized XAI evaluation metrics, clinician-centric interfaces, context-aware XAI systems, and frameworks for integrating XAI into clinical workflows for informed clinical decision-making and improved outcomes in cancer care.

The Neural Frontier of Future Medical Imaging: A Review of Deep Learning for Brain Tumor Detection

Brain tumor detection is crucial in medical research due to high mortality rates and treatment challenges. Early and accurate diagnosis is vital for improving patient outcomes, however, traditional methods, such as manual Magnetic Resonance Imaging (MRI) analysis, are often time-consuming and error-prone. The rise of deep learning has led to advanced models for automated brain tumor feature extraction, segmentation, and classification. Despite these advancements, comprehensive reviews synthesizing recent findings remain scarce. By analyzing over 100 research papers over past half-decade (2019-2024), this review fills that gap, exploring the latest methods and paradigms, summarizing key concepts, challenges, datasets, and offering insights into future directions for brain tumor detection using deep learning. This review also incorporates an analysis of previous reviews and targets three main aspects: feature extraction, segmentation, and classification. The results revealed that research primarily focuses on Convolutional Neural Networks (CNNs) and their variants, with a strong emphasis on transfer learning using pre-trained models. Other methods, such as Generative Adversarial Networks (GANs) and Autoencoders, are used for feature extraction, while Recurrent Neural Networks (RNNs) are employed for time-sequence modeling. Some models integrate with Internet of Things (IoT) frameworks or federated learning for real-time diagnostics and privacy, often paired with optimization algorithms. However, the adoption of eXplainable AI (XAI) remains limited, despite its importance in building trust in medical diagnostics. Finally, this review outlines future opportunities, focusing on image quality, underexplored deep learning techniques, expanding datasets, and exploring deeper learning representations and model behavior such as recurrent expansion to advance medical imaging diagnostics.

Machine learning for predicting post-operative outcomes in meningiomas: a systematic review and meta-analysis

PURPOSE

Meningiomas are the most common primary brain tumour and account for over one-third of cases. Traditionally, estimations of morbidity and mortality following surgical resection have depended on subjective assessments of various factors, including tumour volume, location, WHO grade, extent of resection (Simpson grade) and pre-existing co-morbidities, an approach fraught with subjective variability. This systematic review and meta-analysis seeks to evaluate the efficacy with which machine learning (ML) algorithms predict post-operative outcomes in meningioma patients.

METHODS

A literature search was conducted in December 2023 by two independent reviewers through PubMed, DARE, Cochrane Library and SCOPUS electronic databases. Random-effects meta-analysis was conducted.

RESULTS

Systematic searches yielded 32 studies, comprising 142,459 patients and 139,043 meningiomas. Random-effects meta-analysis sought to generate restricted maximum-likelihood estimates for the accuracy of alternate ML algorithms in predicting several postoperative outcomes. ML models incorporating both clinical and radiomic data significantly outperformed models utilizing either data type alone as well as traditional methods. Pooled estimates for the AUCs achieved by different ML algorithms ranged from 0.74-0.81 in the prediction of overall survival and progression-/recurrence-free survival, with ensemble classifiers demonstrating particular promise for future clinical application. Additionally, current ML models may exhibit a bias in predictive accuracy towards female patients, presumably due to the higher prevalence of meningiomas in females.

CONCLUSION

This review underscores the potential of ML to improve the accuracy of prognoses for meningioma patients and provides insight into which model classes offer the greatest potential for predicting survival outcomes. However, future research will have to directly compare standardized ML methodologies to traditional approaches in large-scale, prospective studies, before their clinical utility can be confidently validated.

Automated brain tumor recognition using equilibrium optimizer with deep learning approach on MRI images

Brain tumours (BT) affect human health owing to their location. Artificial intelligence (AI) is intended to assist in diagnosing and treating complex diseases by combining technologies like deep learning (DL), big data analytics, and machine learning (ML). AI can identify and categorize tumours by analyzing brain imaging approaches like Magnetic Resonance Imaging (MRI). The medical sector has been promptly shifted by evolving technology, and an essential element of these transformations is AI technology. AI model determines tumours' class, size, aggressiveness, and location. This assists medical doctors in making more exact diagnoses and treatment plans and helps patients better understand their health. Also, AI is used to track the progress of patients through treatment. AI-based analytics is used to predict potential tumour recurrence and assess treatment response. This study presents Brain Tumor Recognition using an Equilibrium Optimizer with a Deep Learning Approach (BTR-EODLA) technique for MRI images. The BTR-EODLA technique intends to recognize whether or not a BT presence exists. In the BTR-EODLA technique, median filtering (MF) is deployed to eliminate the noise in the input MRI. Besides, the squeeze-excitation ResNet (SE-ResNet50) model is applied to derive feature vectors, and its parameters are fine-tuned by the design of the EO model. The BTR-EODLA technique utilizes the stacked autoencoder (SAE) model for BT detection. A sequence of experiments is performed to ensure the improved performance of the BTR-EODLA technique. The investigational validation of the BTR-EODLA technique portrayed a superior accuracy value of 98.78% over existing models.

Efficient and Accurate Brain Tumor Classification Using Hybrid MobileNetV2-Support Vector Machine for Magnetic Resonance Imaging Diagnostics in Neoplasms

BACKGROUND/OBJECTIVES

Magnetic Resonance Imaging (MRI) plays a vital role in brain tumor diagnosis by providing clear visualization of soft tissues without the use of ionizing radiation. Given the increasing incidence of brain tumors, there is an urgent need for reliable diagnostic tools, as misdiagnoses can lead to harmful treatment decisions and poor outcomes. While machine learning has significantly advanced medical diagnostics, achieving both high accuracy and computational efficiency remains a critical challenge.

METHODS

This study proposes a hybrid model that integrates MobileNetV2 for feature extraction with a Support Vector Machine (SVM) classifier for the classification of brain tumors. The model was trained and validated using the Kaggle MRI brain tumor dataset, which includes 7023 images categorized into four types: glioma, meningioma, pituitary tumor, and no tumor. MobileNetV2's efficient architecture was leveraged for feature extraction, and SVM was used to enhance classification accuracy.

RESULTS

The proposed hybrid model showed excellent results, achieving Area Under the Curve (AUC) scores of 0.99 for glioma, 0.97 for meningioma, and 1.0 for both pituitary tumors and the no tumor class. These findings highlight that the MobileNetV2-SVM hybrid not only improves classification accuracy but also reduces computational overhead, making it suitable for broader clinical use.

CONCLUSIONS

The MobileNetV2-SVM hybrid model demonstrates substantial potential for enhancing brain tumor diagnostics by offering a balance of precision and computational efficiency. Its ability to maintain high accuracy while operating efficiently could lead to better outcomes in medical practice, particularly in resource limited settings.

Efficient brain tumor grade classification using ensemble deep learning models

Detecting brain tumors early on is critical for effective treatment and life-saving efforts. The analysis of the brain with MRI scans is fundamental to the diagnosis because it contains detailed structural views of the brain, which is vital in identifying any of its abnormalities. The other option of performing an invasive biopsy is very painful and uncomfortable, which is not the case with MRI as it is free from surgically invasive margins and pieces of equipment. This helps patients to feel more at ease and hasten the diagnostic procedure, allowing physicians to formulate and practice action plans quicker. It is very difficult to locate a human brain tumor by manual because MRI scans produce large numbers of three-dimensional images. Complete applicability of pre-written computerized diagnostics, affords high possibilities in providing areas of interest earlier through the application of machine learning techniques and algorithms. The proposed work in the present study was to develop a deep learning model which will classify brain tumor grade images (BTGC), and hence enhance accuracy in diagnosing patients with different grades of brain tumors using MRI. A MobileNetV2 model, was used to extract the features from the images. This model increases the efficiency and generalizability of the model further. In this study, six standard Kaggle brain tumor MRI datasets were used to train and validate the developed and tested model of a brain tumor detection and classification algorithm into several types. This work consists of two key components: (i) brain tumor detection and (ii) classification of the tumor. The tumor classifications are conducted in both three classes (Meningioma, Pituitary, and glioma) and two classes (malignant, benign). The model has been reported to detect brain tumors with 99.85% accuracy, to distinguish benign and malignant tumors with 99.87% accuracy, and to type meningioma, pituitary, and glioma tumors with 99.38% accuracy. The results of this study indicate that the described technique is useful in the detection and classification of brain tumors.

Explainable Machine Learning Models for Brain Diseases: Insights from a Systematic Review

In recent years, Artificial Intelligence (AI) methods, specifically Machine Learning (ML) models, have been providing outstanding results in different areas of knowledge, with the health area being one of its most impactful fields of application. However, to be applied reliably, these models must provide users with clear, simple, and transparent explanations about the medical decision-making process. This systematic review aims to investigate the use and application of explainability in ML models used in brain disease studies. A systematic search was conducted in three major bibliographic databases, Web of Science, Scopus, and PubMed, from January 2014 to December 2023. A total of 133 relevant studies were identified and analyzed out of a total of 682 found in the initial search, in which the explainability of ML models in the medical context was studied, identifying 11 ML models and 12 explainability techniques applied in the study of 20 brain diseases.

Recent Applications of Explainable AI (XAI): A Systematic Literature Review

This systematic literature review employs the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology to investigate recent applications of explainable AI (XAI) over the past three years. From an initial pool of 664 articles identified through the Web of Science database, 512 peer-reviewed journal articles met the inclusion criteria—namely, being recent, high-quality XAI application articles published in English—and were analyzed in detail. Both qualitative and quantitative statistical techniques were used to analyze the identified articles: qualitatively by summarizing the characteristics of the included studies based on predefined codes, and quantitatively through statistical analysis of the data. These articles were categorized according to their application domains, techniques, and evaluation methods. Health-related applications were particularly prevalent, with a strong focus on cancer diagnosis, COVID-19 management, and medical imaging. Other significant areas of application included environmental and agricultural management, industrial optimization, cybersecurity, finance, transportation, and entertainment. Additionally, emerging applications in law, education, and social care highlight XAI’s expanding impact. The review reveals a predominant use of local explanation methods, particularly SHAP and LIME, with SHAP being favored for its stability and mathematical guarantees. However, a critical gap in the evaluation of XAI results is identified, as most studies rely on anecdotal evidence or expert opinion rather than robust quantitative metrics. This underscores the urgent need for standardized evaluation frameworks to ensure the reliability and effectiveness of XAI applications. Future research should focus on developing comprehensive evaluation standards and improving the interpretability and stability of explanations. These advancements are essential for addressing the diverse demands of various application domains while ensuring trust and transparency in AI systems.

Medical image analysis using improved SAM-Med2D: segmentation and classification perspectives

Recently emerged SAM-Med2D represents a state-of-the-art advancement in medical image segmentation. Through fine-tuning the Large Visual Model, Segment Anything Model (SAM), on extensive medical datasets, it has achieved impressive results in cross-modal medical image segmentation. However, its reliance on interactive prompts may restrict its applicability under specific conditions. To address this limitation, we introduce SAM-AutoMed, which achieves automatic segmentation of medical images by replacing the original prompt encoder with an improved MobileNet v3 backbone. The performance on multiple datasets surpasses both SAM and SAM-Med2D. Current enhancements on the Large Visual Model SAM lack applications in the field of medical image classification. Therefore, we introduce SAM-MedCls, which combines the encoder of SAM-Med2D with our designed attention modules to construct an end-to-end medical image classification model. It performs well on datasets of various modalities, even achieving state-of-the-art results, indicating its potential to become a universal model for medical image classification.

A Unified Pipeline for Simultaneous Brain Tumor Classification and Segmentation Using Fine-Tuned CNN and Residual UNet Architecture

In this paper, I present a comprehensive pipeline integrating a Fine-Tuned Convolutional Neural Network (FT-CNN) and a Residual-UNet (RUNet) architecture for the automated analysis of MRI brain scans. The proposed system addresses the dual challenges of brain tumor classification and segmentation, which are crucial tasks in medical image analysis for precise diagnosis and treatment planning. Initially, the pipeline preprocesses the FigShare brain MRI image dataset, comprising 3064 images, by normalizing and resizing them to achieve uniformity and compatibility with the model. The FT-CNN model then classifies the preprocessed images into distinct tumor types: glioma, meningioma, and pituitary tumor. Following classification, the RUNet model performs pixel-level segmentation to delineate tumor regions within the MRI scans. The FT-CNN leverages the VGG19 architecture, pre-trained on large datasets and fine-tuned for specific tumor classification tasks. Features extracted from MRI images are used to train the FT-CNN, demonstrating robust performance in discriminating between tumor types. Subsequently, the RUNet model, inspired by the U-Net design and enhanced with residual blocks, effectively segments tumors by combining high-resolution spatial information from the encoding path with context-rich features from the bottleneck. My experimental results indicate that the integrated pipeline achieves high accuracy in both classification (96%) and segmentation tasks (98%), showcasing its potential for clinical applications in brain tumor diagnosis. For the classification task, the metrics involved are loss, accuracy, confusion matrix, and classification report, while for the segmentation task, the metrics used are loss, accuracy, Dice coefficient, intersection over union, and Jaccard distance. To further validate the generalizability and robustness of the integrated pipeline, I evaluated the model on two additional datasets. The first dataset consists of 7023 images for classification tasks, expanding to a four-class dataset. The second dataset contains approximately 3929 images for both classification and segmentation tasks, including a binary classification scenario. The model demonstrated robust performance, achieving 95% accuracy on the four-class task and high accuracy (96%) in the binary classification and segmentation tasks, with a Dice coefficient of 95%.

Assessment of brain tumor detection techniques and recommendation of neural network

OBJECTIVES

Brain tumor classification is amongst the most complex and challenging jobs in the computer domain. The latest advances in brain tumor detection systems (BTDS) are presented as they can inspire new researchers to deliver new architectures for effective and efficient tumor detection. Here, the data of the multi-modal brain tumor segmentation task is employed, which has been registered, skull stripped, and histogram matching is conducted with the ferrous volume of high contrast.

METHODS

This research further configures a capsule network (CapsNet) for brain tumor classification. Results of the latest deep neural network (NN) architectures for tumor detection are compared and presented. The VGG16 and CapsNet architectures yield the highest f1-score and precision values, followed by VGG19. Overall, ResNet152, MobileNet, and MobileNetV2 give us the lowest f1-score.

RESULTS

The VGG16 and CapsNet have produced outstanding results. However, VGG16 and VGG19 are more profound architecture, resulting in slower computation speed. The research then recommends the latest suitable NN for effective brain tumor detection.

CONCLUSIONS

Finally, the work concludes with future directions and potential new architectures for tumor detection.

Optimal extreme learning machine for diagnosing brain tumor based on modified sailfish optimizer

This study proposes a hierarchical automated methodology for detecting brain tumors in Magnetic Resonance Imaging (MRI), focusing on preprocessing images to improve quality and eliminate artifacts or noise. A modified Extreme Learning Machine is then used to diagnose brain tumors that are integrated with the Modified Sailfish optimizer to enhance its performance. The Modified Sailfish optimizer is a metaheuristic algorithm known for efficiently navigating optimization landscapes and enhancing convergence speed. Experiments were conducted using the "Whole Brain Atlas (WBA)" database, which contains annotated MRI images. The results showed superior efficiency in accurately detecting brain tumors from MRI images, demonstrating the potential of the method in enhancing accuracy and efficiency. The proposed method utilizes hierarchical methodology, preprocessing techniques, and optimization of the Extreme Learning Machine with the Modified Sailfish optimizer to improve accuracy rates and decrease the time needed for brain tumor diagnosis. The proposed method outperformed other methods in terms of accuracy, recall, specificity, precision, and F1 score in medical imaging diagnosis. It achieved the highest accuracy at 93.95 %, with End/End and CNN attaining high values of 89.24 % and 93.17 %, respectively. The method also achieved a perfect score of 100 % in recall, 91.38 % in specificity, and 75.64 % in F1 score. However, it is crucial to consider factors like computational complexity, dataset characteristics, and generalizability before evaluating the effectiveness of the method in medical imaging diagnosis. This approach has the potential to make substantial contributions to medical imaging and aid healthcare professionals in making prompt and precise treatment decisions for brain tumors.

A novel approach to brain tumor detection using K-Means++, SGLDM, ResNet50, and synthetic data augmentation

Introduction: Brain tumors are abnormal cell growths in the brain, posing significant treatment challenges. Accurate early detection using non-invasive methods is crucial for effective treatment. This research focuses on improving the early detection of brain tumors in MRI images through advanced deep-learning techniques. The primary goal is to identify the most effective deep-learning model for classifying brain tumors from MRI data, enhancing diagnostic accuracy and reliability. Methods: The proposed method for brain tumor classification integrates segmentation using K-means++, feature extraction from the Spatial Gray Level Dependence Matrix (SGLDM), and classification with ResNet50, along with synthetic data augmentation to enhance model robustness. Segmentation isolates tumor regions, while SGLDM captures critical texture information. The ResNet50 model then classifies the tumors accurately. To further improve the interpretability of the classification results, Grad-CAM is employed, providing visual explanations by highlighting influential regions in the MRI images. Result: In terms of accuracy, sensitivity, and specificity, the evaluation on the Br35H::BrainTumorDetection2020 dataset showed superior performance of the suggested method compared to existing state-of-the-art approaches. This indicates its effectiveness in achieving higher precision in identifying and classifying brain tumors from MRI data, showcasing advancements in diagnostic reliability and efficacy. Discussion: The superior performance of the suggested method indicates its robustness in accurately classifying brain tumors from MRI images, achieving higher accuracy, sensitivity, and specificity compared to existing methods. The method's enhanced sensitivity ensures a greater detection rate of true positive cases, while its improved specificity reduces false positives, thereby optimizing clinical decision-making and patient care in neuro-oncology.

Shape-Scale Co-Awareness Network for 3D Brain Tumor Segmentation

The accurate segmentation of brain tumor is significant in clinical practice. Convolutional Neural Network (CNN)-based methods have made great progress in brain tumor segmentation due to powerful local modeling ability. However, brain tumors are frequently pattern-agnostic, i.e. variable in shape, size and location, which can not be effectively matched by traditional CNN-based methods with local and regular receptive fields. To address the above issues, we propose a shape-scale co-awareness network (S2CA-Net) for brain tumor segmentation, which can efficiently learn shape-aware and scale-aware features simultaneously to enhance pattern-agnostic representations. Primarily, three key components are proposed to accomplish the co-awareness of shape and scale. The Local-Global Scale Mixer (LGSM) decouples the extraction of local and global context by adopting the CNN-Former parallel structure, which contributes to obtaining finer hierarchical features. The Multi-level Context Aggregator (MCA) enriches the scale diversity of input patches by modeling global features across multiple receptive fields. The Multi-Scale Attentive Deformable Convolution (MS-ADC) learns the target deformation based on the multiscale inputs, which motivates the network to enforce feature constraints both in terms of scale and shape for optimal feature matching. Overall, LGSM and MCA focus on enhancing the scale-awareness of the network to cope with the size and location variations, while MS-ADC focuses on capturing deformation information for optimal shape matching. Finally, their effective integration prompts the network to perceive variations in shape and scale simultaneously, which can robustly tackle the variations in patterns of brain tumors. The experimental results on BraTS 2019, BraTS 2020, MSD BTS Task and BraTS2023-MEN show that S2CA-Net has superior overall performance in accuracy and efficiency compared to other state-of-the-art methods. Code: https://github.com/jiangyu945/S2CA-Net.

An enhanced pattern detection and segmentation of brain tumors in MRI images using deep learning technique

Neuroscience is a swiftly progressing discipline that aims to unravel the intricate workings of the human brain and mind. Brain tumors, ranging from non-cancerous to malignant forms, pose a significant diagnostic challenge due to the presence of more than 100 distinct types. Effective treatment hinges on the precise detection and segmentation of these tumors early. We introduce a cutting-edge deep-learning approach employing a binary convolutional neural network (BCNN) to address this. This method is employed to segment the 10 most prevalent brain tumor types and is a significant improvement over current models restricted to only segmenting four types. Our methodology begins with acquiring MRI images, followed by a detailed preprocessing stage where images undergo binary conversion using an adaptive thresholding method and morphological operations. This prepares the data for the next step, which is segmentation. The segmentation identifies the tumor type and classifies it according to its grade (Grade I to Grade IV) and differentiates it from healthy brain tissue. We also curated a unique dataset comprising 6,600 brain MRI images specifically for this study. The overall performance achieved by our proposed model is 99.36%. The effectiveness of our model is underscored by its remarkable performance metrics, achieving 99.40% accuracy, 99.32% precision, 99.45% recall, and a 99.28% F-Measure in segmentation tasks.

Enhancing Automated Brain Tumor Detection Accuracy Using Artificial Intelligence Approaches for Healthcare Environments

Medical imaging and deep learning models are essential to the early identification and diagnosis of brain cancers, facilitating timely intervention and improving patient outcomes. This research paper investigates the integration of YOLOv5, a state-of-the-art object detection framework, with non-local neural networks (NLNNs) to improve brain tumor detection's robustness and accuracy. This study begins by curating a comprehensive dataset comprising brain MRI scans from various sources. To facilitate effective fusion, the YOLOv5 and NLNNs, K-means+, and spatial pyramid pooling fast+ (SPPF+) modules are integrated within a unified framework. The brain tumor dataset is used to refine the YOLOv5 model through the application of transfer learning techniques, adapting it specifically to the task of tumor detection. The results indicate that the combination of YOLOv5 and other modules results in enhanced detection capabilities in comparison to the utilization of YOLOv5 exclusively, proving recall rates of 86% and 83% respectively. Moreover, the research explores the interpretability aspect of the combined model. By visualizing the attention maps generated by the NLNNs module, the regions of interest associated with tumor presence are highlighted, aiding in the understanding and validation of the decision-making procedure of the methodology. Additionally, the impact of hyperparameters, such as NLNNs kernel size, fusion strategy, and training data augmentation, is investigated to optimize the performance of the combined model.

Application of Machine Learning for Classification of Brain Tumors: A Systematic Review and Meta-Analysis

BACKGROUND

Classifying brain tumors accurately is crucial for treatment and prognosis. Machine learning (ML) shows great promise in improving tumor classification accuracy. This study evaluates ML algorithms for differentiating various brain tumor types.

METHODS

A systematic review and meta-analysis were conducted, searching PubMed, Embase, and Web of Science up to March 14, 2023. Studies that only investigated image segmentation accuracy or brain tumor detection instead of classification were excluded. We extracted binary diagnostic accuracy data, constructing contingency tables to derive sensitivity and specificity.

RESULTS

Fifty-one studies were included. The pooled area under the curve for glioblastoma versus lymphoma and low-grade versus high-grade gliomas were 0.99 (95% confidence interval [CI]: 0.98-1.00) and 0.89, respectively. The pooled sensitivity and specificity for benign versus malignant tumors were 0.90 (95% CI: 0.85-0.93) and 0.93 (95% CI: 0.90-0.95), respectively. The pooled sensitivity and specificity for low-grade versus high-grade gliomas were 0.99 (95% CI: 0.97-1.00) and 0.94, (95% CI: 0.79-0.99), respectively. Primary versus metastatic tumor identification yields sensitivity and specificity of 0.89, (95% CI: 0.83-0.93) and 0.87 (95% CI: 0.82-0.91), correspondingly. The differentiation of gliomas from pituitary tumors yielded the highest results among primary brain tumor classifications: sensitivity of 0.99 (95% CI: 0.99-1.00) and specificity of 0.99 (95% CI: 0.98-1.00).

CONCLUSIONS

ML demonstrated excellent performance in classifying brain tumor images, with near-maximum area under the curves, sensitivity, and specificity.

Utilizing support vector machines to foster sustainable development and innovation in the clean energy sector via green finance

As the global demand for clean energy continues to grow, the sustainable development of clean energy projects has become an important topic of research. in order to optimize the performance and sustainability of clean energy projects, this work explores the environmental and economic benefits of the clean energy industry. through the use of Support Vector Machine (SVM) Multi-factor models and a bi-level multi-objective approach, this work conducts comprehensive assessment and optimization. with wind power base a as a case study, the work describes the material consumption of wind turbines, transportation energy consumption and carbon dioxide (CO2) emissions, and infrastructure material consumption through descriptive statistics. Moreover, this work analyzes the characteristics of different wind turbine models in depth. On one hand, the SVM multi-factor model is used to predict and assess the profitability of Wind Power Base A. On the other hand, a bi-level multi-objective approach is applied to optimize the number of units, internal rate of return within the project, and annual average equivalent utilization hours of the Wind Power Base A. The research results indicate that in March, the WilderHill New Energy Global Innovation Index (NEX) was 0.91053, while the predicted value of the SVM multi-factor model was 0.98596. The predicted value is slightly higher than the actual value, demonstrating the model's good grasp of future returns. The cumulative rate of return of Wind Power Base A is 18.83%, with an annualized return of 9.47%, exceeding the market performance by 1.68%. Under the optimization of the bi-level multi-objective approach, the number of units at Wind Power Base A decreases from the original 7004 to 5860, with total purchase and transportation costs remaining basically unchanged. The internal rate of return of the project increases from 8% to 9.3%, and the annual equivalent utilization hours increase to 2044 h, comprehensively improving the investment return and utilization efficiency of the wind power base. Through optimization, significant improvements are achieved in terAs the global demand for clean energy continues to grow, the sustainable development of clean energy projects has become an important topic of research. In order to optimize the performance and sustainability of clean energy projects, this work explores the environmental and economic benefits of the clean energy industry. Through the use of Support Vector Machine (SVM) multi-factor models and a bi-level multi-objective approach, this work conducts comprehensive assessment and optimization. With Wind Power Base A as a case study, the work describes the material consumption of wind turbines, transportation energy consumption and carbon dioxide (CO2) emissions, and infrastructure material consumption through descriptive statistics. Moreover, this work analyzes the characteristics of different wind turbine models in depth. On one hand, the SVM multi-factor model is used to predict and assess the profitability of Wind Power Base A. On the other hand, a bi-level multi-objective approach is applied to optimize the number of units, internal rate of return within the project, and annual average equivalent utilization hours of the Wind Power Base A. The research results indicate that in March, the WilderHill New Energy Global Innovation Index (NEX) was 0.91053, while the predicted value of the SVM multi-factor model was 0.98596. The predicted value is slightly higher than the actual value, demonstrating the model's good grasp of future returns. The cumulative rate of return of Wind Power Base A is 18.83%, with an annualized return of 9.47%, exceeding the market performance by 1.68%. Under the optimization of the bi-level multi-objective approach, the number of units at Wind Power Base A decreases from the original 7004 to 5860, with total purchase and transportation costs remaining basically unchanged. The internal rate of return of the project increases from 8% to 9.3%, and the annual equivalent utilization hours increase to 2044 h, comprehensively improving the investment return and utilization efficiency of the wind power base. Through optimization, significant improvements are achieved in terms of the number of units, internal rate of return within the project, and annual average equivalent utilization hours at Wind Power Base A. The number of units decreases to 5860, with total purchase and transportation costs remaining basically unchanged, the internal rate of return increases to 9.3%, and annual equivalent utilization hours increase to 2044 h. Energy consumption and CO2 emissions are significantly reduced, with energy consumption decreasing by 0.68 × 109 kgce and CO2 emissions decreasing by 1.29 × 109 kg. The optimization effects are mainly concentrated in the production and installation stages, with emission reductions achieved through the recycling and disposal of materials consumed in the early stages. In terms of investment benefits, environmental benefits are enhanced, with a 13.93% reduction in CO2 emissions. Moreover, there is improved energy efficiency, with the energy input-output ratio increasing from 7.73 to 9.31. This indicates that the Wind Power Base A project has significant environmental and energy efficiency advantages in the clean energy industry. This work innovatively provides a comprehensive assessment and optimization scheme for clean energy projects and predicts the profitability of Wind Power Base A using SVM multi-factor models. Besides, this work optimizes key parameters of the project using a bi-level multi-objective approach, thus comprehensively improving the investment return and utilization efficiency of the wind power base. This work provides innovative methods and strong data support for the development of the clean energy industry, which is of great significance for promoting sustainable development under the backdrop of green finance.

Brain tumor detection using proper orthogonal decomposition integrated with deep learning networks

BACKGROUND AND OBJECTIVE

The central organ of the human nervous system is the brain, which receives and sends stimuli to the various parts of the body to engage in daily activities. Uncontrolled growth of brain cells can result in tumors which affect the normal functions of healthy brain cells. An automatic reliable technique for detecting tumors is imperative to assist medical practitioners in the timely diagnosis of patients. Although machine learning models are being used, with minimal data availability to train, development of low-order based models integrated with machine learning are a tool for reliable detection.

METHODS

In this study, we focus on comparing a low-order model such as proper orthogonal decomposition (POD) coupled with convolutional neural network (CNN) on 2D images from magnetic resonance imaging (MRI) scans to effectively identify brain tumors. The explainability of the coupled POD-CNN prediction output as well as the state-of-the-art pre-trained transfer learning models such as MobileNetV2, Inception-v3, ResNet101, and VGG-19 were explored.

RESULTS

The results showed that CNN predicted tumors with an accuracy of 99.21% whereas POD-CNN performed better with about 1/3rd of computational time at an accuracy of 95.88%. Explainable AI with SHAP showed MobileNetV2 has better prediction in identifying the tumor boundaries.

CONCLUSIONS

Integration of POD with CNN is carried for the first time to detect brain tumor detection with minimal MRI scan data. This study facilitates low-model approaches in machine learning to improve the accuracy and performance of tumor detection.

Multimodal Brain Tumor Classification Using Convolutional Tumnet Architecture

The most common and aggressive tumor is brain malignancy, which has a short life span in the fourth grade of the disease. As a result, the medical plan may be a crucial step toward improving the well-being of a patient. Both diagnosis and therapy are part of the medical plan. Brain tumors are commonly imaged with magnetic resonance imaging (MRI), positron emission tomography (PET), and computed tomography (CT). In this paper, multimodal fused imaging with classification and segmentation for brain tumors was proposed using the deep learning method. The MRI and CT brain tumor images of the same slices (308 slices of meningioma and sarcoma) are combined using three different types of pixel-level fusion methods. The presence/absence of a tumor is classified using the proposed Tumnet technique, and the tumor area is found accordingly. In the other case, Tumnet is also applied for single-modal MRI/CT (561 image slices) for classification. The proposed Tumnet was modeled with 5 convolutional layers, 3 pooling layers with ReLU activation function, and 3 fully connected layers. The first-order statistical fusion metrics for an average method of MRI-CT images are obtained as SSIM tissue at 83%, SSIM bone at 84%, accuracy at 90%, sensitivity at 96%, and specificity at 95%, and the second-order statistical fusion metrics are obtained as the standard deviation of fused images at 79% and entropy at 0.99. The entropy value confirms the presence of additional features in the fused image. The proposed Tumnet yields a sensitivity of 96%, an accuracy of 98%, a specificity of 99%, normalized values of the mean of 0.75, a standard deviation of 0.4, a variance of 0.16, and an entropy of 0.90.

CVG-Net: novel transfer learning based deep features for diagnosis of brain tumors using MRI scans

Brain tumors present a significant medical challenge, demanding accurate and timely diagnosis for effective treatment planning. These tumors disrupt normal brain functions in various ways, giving rise to a broad spectrum of physical, cognitive, and emotional challenges. The daily increase in mortality rates attributed to brain tumors underscores the urgency of this issue. In recent years, advanced medical imaging techniques, particularly magnetic resonance imaging (MRI), have emerged as indispensable tools for diagnosing brain tumors. Brain MRI scans provide high-resolution, non-invasive visualization of brain structures, facilitating the precise detection of abnormalities such as tumors. This study aims to propose an effective neural network approach for the timely diagnosis of brain tumors. Our experiments utilized a multi-class MRI image dataset comprising 21,672 images related to glioma tumors, meningioma tumors, and pituitary tumors. We introduced a novel neural network-based feature engineering approach, combining 2D convolutional neural network (2DCNN) and VGG16. The resulting 2DCNN-VGG16 network (CVG-Net) extracted spatial features from MRI images using 2DCNN and VGG16 without human intervention. The newly created hybrid feature set is then input into machine learning models to diagnose brain tumors. We have balanced the multi-class MRI image features data using the Synthetic Minority Over-sampling Technique (SMOTE) approach. Extensive research experiments demonstrate that utilizing the proposed CVG-Net, the k-neighbors classifier outperformed state-of-the-art studies with a k-fold accuracy performance score of 0.96. We also applied hyperparameter tuning to enhance performance for multi-class brain tumor diagnosis. Our novel proposed approach has the potential to revolutionize early brain tumor diagnosis, providing medical professionals with a cost-effective and timely diagnostic mechanism.

A hybrid CNN-SVM model for enhanced autism diagnosis

Autism is a representative disorder of pervasive developmental disorder. It exerts influence upon an individual's behavior and performance, potentially co-occurring with other mental illnesses. Consequently, an effective diagnostic approach proves to be invaluable in both therapeutic interventions and the timely provision of medical support. Currently, most scholars' research primarily relies on neuroimaging techniques for auxiliary diagnosis and does not take into account the distinctive features of autism's social impediments. In order to address this deficiency, this paper introduces a novel convolutional neural network-support vector machine model that integrates resting state functional magnetic resonance imaging data with the social responsiveness scale metrics for the diagnostic assessment of autism. We selected 821 subjects containing the social responsiveness scale measure from the publicly available Autism Brain Imaging Data Exchange dataset, including 379 subjects with autism spectrum disorder and 442 typical controls. After preprocessing of fMRI data, we compute the static and dynamic functional connectivity for each subject. Subsequently, convolutional neural networks and attention mechanisms are utilized to extracts their respective features. The extracted features, combined with the social responsiveness scale features, are then employed as novel inputs for the support vector machine to categorize autistic patients and typical controls. The proposed model identifies salient features within the static and dynamic functional connectivity, offering a possible biological foundation for clinical diagnosis. By incorporating the behavioral assessments, the model achieves a remarkable classification accuracy of 94.30%, providing a more reliable support for auxiliary diagnosis.

Brain MR Image Classification Using Superpixel-Based Deep Transfer Learning

Nowadays, brain MR (Magnetic Resonance) images are widely used by clinicians to examine the brain's anatomy to look into various pathological conditions like cerebrovascular incidents and neuro-degenerative diseases. Generally, these diseases can be identified with the MR images as "normal" and "abnormal" brains in a two-class classification problem or as disease-specific classes in a multi-class problem. This article presents an ensemble transfer learning-inspired deep architecture that uses the simple linear iterative clustering (SLIC)-based superpixel algorithm along with convolutional neural network (CNN) to classify the MR images as normal or abnormal. Superpixel algorithm segments the input MR images into clusters of regions defined by similarity measures using perceptual feature space. These superpixel images are beneficial as they can provide a compact and meaningful role in computationally demanding applications. The superpixel images are then fed to the deep convolutional neural network (CNN) to classify the images. Three brain MR image datasets, NITR-DHH, DS-75, and DS-160, are used to conduct the experimentation. Through the use of deep transfer learning, the model achieves performance accuracy of 88.15% (NITR-DHH), 98.15% (DS-160), and 98.33% (DS-75) even with the small-scale medical image dataset. The experimentally obtained results demonstrate that the proposed method is promising and efficient for clinical applications for diagnosing different brain diseases via MR images.

Deep Learning-Assisted Segmentation and Classification of Brain Tumor Types on Magnetic Resonance and Surgical Microscope Images

OBJECTIVE

The primary aim of this research was to harness the capabilities of deep learning to enhance neurosurgical procedures, focusing on accurate tumor boundary delineation and classification. Through advanced diagnostic tools, we aimed to offer surgeons a more insightful perspective during surgeries, improving surgical outcomes and patient care.

METHODS

The study deployed the Mask R-convolutional neural network (CNN) architecture, leveraging its sophisticated features to process and analyze data from surgical microscope videos and preoperative magnetic resonance images. Resnet101 and Resnet50 backbone networks are used in the Mask R-CNN method, and experimental results are given. We subsequently tested its performance across various metrics, such as accuracy, precision, recall, dice coefficient (DICE), and Jaccard index. Deep learning models were trained from magnetic resonance imaging and surgical microscope images, and the classification result obtained for each patient was combined with the weighted average.

RESULTS

The algorithm exhibited remarkable capabilities in distinguishing among meningiomas, metastases, and high-grade glial tumors. Specifically, for the Mask R-CNN Resnet 101 architecture, precision, recall, DICE, and Jaccard index values were recorded as 96%, 93%, 91%, and 84%, respectively. Conversely, for the Mask R-CNN Resnet 50 architecture, these values stood at 94%, 89%, 89%, and 82%. Additionally, the model achieved an impressive DICE score range of 94%-95% and an accuracy of 98% in pathology estimation.

CONCLUSIONS

As illustrated in our study, the confluence of deep learning with neurosurgical procedures marks a transformative phase in medical science. The results are promising but underscore diverse data sets' significance for training and refining these deep learning models.

Advances in the Use of Deep Learning for the Analysis of Magnetic Resonance Image in Neuro-Oncology

Machine Learning is entering a phase of maturity, but its medical applications still lag behind in terms of practical use. The field of oncological radiology (and neuro-oncology in particular) is at the forefront of these developments, now boosted by the success of Deep-Learning methods for the analysis of medical images. This paper reviews in detail some of the most recent advances in the use of Deep Learning in this field, from the broader topic of the development of Machine-Learning-based analytical pipelines to specific instantiations of the use of Deep Learning in neuro-oncology; the latter including its use in the groundbreaking field of ultra-low field magnetic resonance imaging.

Convolutional Neural Networks for Glioma Segmentation and Prognosis: A Systematic Review

Deep learning (DL) is poised to redefine the way medical images are processed and analyzed. Convolutional neural networks (CNNs), a specific type of DL architecture, are exceptional for high-throughput processing, allowing for the effective extraction of relevant diagnostic patterns from large volumes of complex visual data. This technology has garnered substantial interest in the field of neuro-oncology as a promising tool to enhance medical imaging throughput and analysis. A multitude of methods harnessing MRI-based CNNs have been proposed for brain tumor segmentation, classification, and prognosis prediction. They are often applied to gliomas, the most common primary brain cancer, to classify subtypes with the goal of guiding therapy decisions. Additionally, the difficulty of repeating brain biopsies to evaluate treatment response in the setting of often confusing imaging findings provides a unique niche for CNNs to help distinguish the treatment response to gliomas. For example, glioblastoma, the most aggressive type of brain cancer, can grow due to poor treatment response, can appear to grow acutely due to treatment-related inflammation as the tumor dies (pseudo-progression), or falsely appear to be regrowing after treatment as a result of brain damage from radiation (radiation necrosis). CNNs are being applied to separate this diagnostic dilemma. This review provides a detailed synthesis of recent DL methods and applications for intratumor segmentation, glioma classification, and prognosis prediction. Furthermore, this review discusses the future direction of MRI-based CNN in the field of neuro-oncology and challenges in model interpretability, data availability, and computation efficiency.

Machine Learning Approach for Analyzing 3-Year Outcomes of Patients with Brain Arteriovenous Malformation (AVM) after Stereotactic Radiosurgery (SRS)

A cerebral arteriovenous malformation (AVM) is a tangle of abnormal blood vessels that irregularly connects arteries and veins. Stereotactic radiosurgery (SRS) has been shown to be an effective treatment for AVM patients, but the factors associated with AVM obliteration remains a matter of debate. In this study, we aimed to develop a model that can predict whether patients with AVM will be cured 36 months after intervention by means of SRS and identify the most important predictors that explain the probability of being cured. A machine learning (ML) approach was applied using decision tree (DT) and logistic regression (LR) techniques on historical data (sociodemographic, clinical, treatment, angioarchitecture, and radiosurgery procedure) of 202 patients with AVM who underwent SRS at the Instituto de Radiocirugía del Perú (IRP) between 2005 and 2018. The LR model obtained the best results for predicting AVM cure with an accuracy of 0.92, sensitivity of 0.93, specificity of 0.89, and an area under the curve (AUC) of 0.98, which shows that ML models are suitable for predicting the prognosis of medical conditions such as AVM and can be a support tool for medical decision-making. In addition, several factors were identified that could explain whether patients with AVM would be cured at 36 months with the highest likelihood: the location of the AVM, the occupation of the patient, and the presence of hemorrhage.

The enlightening role of explainable artificial intelligence in medical & healthcare domains: A systematic literature review

In domains such as medical and healthcare, the interpretability and explainability of machine learning and artificial intelligence systems are crucial for building trust in their results. Errors caused by these systems, such as incorrect diagnoses or treatments, can have severe and even life-threatening consequences for patients. To address this issue, Explainable Artificial Intelligence (XAI) has emerged as a popular area of research, focused on understanding the black-box nature of complex and hard-to-interpret machine learning models. While humans can increase the accuracy of these models through technical expertise, understanding how these models actually function during training can be difficult or even impossible. XAI algorithms such as Local Interpretable Model-Agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP) can provide explanations for these models, improving trust in their predictions by providing feature importance and increasing confidence in the systems. Many articles have been published that propose solutions to medical problems by using machine learning models alongside XAI algorithms to provide interpretability and explainability. In our study, we identified 454 articles published from 2018-2022 and analyzed 93 of them to explore the use of these techniques in the medical domain.

Efficient Skip Connections-Based Residual Network (ESRNet) for Brain Tumor Classification

Brain tumors pose a complex and urgent challenge in medical diagnostics, requiring precise and timely classification due to their diverse characteristics and potentially life-threatening consequences. While existing deep learning (DL)-based brain tumor classification (BTC) models have shown significant progress, they encounter limitations like restricted depth, vanishing gradient issues, and difficulties in capturing intricate features. To address these challenges, this paper proposes an efficient skip connections-based residual network (ESRNet). leveraging the residual network (ResNet) with skip connections. ESRNet ensures smooth gradient flow during training, mitigating the vanishing gradient problem. Additionally, the ESRNet architecture includes multiple stages with increasing numbers of residual blocks for improved feature learning and pattern recognition. ESRNet utilizes residual blocks from the ResNet architecture, featuring skip connections that enable identity mapping. Through direct addition of the input tensor to the convolutional layer output within each block, skip connections preserve the gradient flow. This mechanism prevents vanishing gradients, ensuring effective information propagation across network layers during training. Furthermore, ESRNet integrates efficient downsampling techniques and stabilizing batch normalization layers, which collectively contribute to its robust and reliable performance. Extensive experimental results reveal that ESRNet significantly outperforms other approaches in terms of accuracy, sensitivity, specificity, F-score, and Kappa statistics, with median values of 99.62%, 99.68%, 99.89%, 99.47%, and 99.42%, respectively. Moreover, the achieved minimum performance metrics, including accuracy (99.34%), sensitivity (99.47%), specificity (99.79%), F-score (99.04%), and Kappa statistics (99.21%), underscore the exceptional effectiveness of ESRNet for BTC. Therefore, the proposed ESRNet showcases exceptional performance and efficiency in BTC, holding the potential to revolutionize clinical diagnosis and treatment planning.

Brain tumor detection and screening using artificial intelligence techniques: Current trends and future perspectives

A brain tumor is an abnormal mass of tissue located inside the skull. In addition to putting pressure on the healthy parts of the brain, it can lead to significant health problems. Depending on the region of the brain tumor, it can cause a wide range of health issues. As malignant brain tumors grow rapidly, the mortality rate of individuals with this cancer can increase substantially with each passing week. Hence it is vital to detect these tumors early so that preventive measures can be taken at the initial stages. Computer-aided diagnostic (CAD) systems, in coordination with artificial intelligence (AI) techniques, have a vital role in the early detection of this disorder. In this review, we studied 124 research articles published from 2000 to 2022. Here, the challenges faced by CAD systems based on different modalities are highlighted along with the current requirements of this domain and future prospects in this area of research.

A Robust Brain Tumor Detector Using BiLSTM and Mayfly Optimization and Multi-Level Thresholding

A brain tumor refers to an abnormal growth of cells in the brain that can be either benign or malignant. Oncologists typically use various methods such as blood or visual tests to detect brain tumors, but these approaches can be time-consuming, require additional human effort, and may not be effective in detecting small tumors. This work proposes an effective approach to brain tumor detection that combines segmentation and feature fusion. Segmentation is performed using the mayfly optimization algorithm with multilevel Kapur's threshold technique to locate brain tumors in MRI scans. Key features are achieved from tumors employing Histogram of Oriented Gradients (HOG) and ResNet-V2, and a bidirectional long short-term memory (BiLSTM) network is used to classify tumors into three categories: pituitary, glioma, and meningioma. The suggested methodology is trained and tested on two datasets, Figshare and Harvard, achieving high accuracy, precision, recall, F1 score, and area under the curve (AUC). The results of a comparative analysis with existing DL and ML methods demonstrate that the proposed approach offers superior outcomes. This approach has the potential to improve brain tumor detection, particularly for small tumors, but further validation and testing are needed before clinical use.

Blood Slide Image Analysis to Classify WBC Types for Prediction Haematology Based on a Hybrid Model of CNN and Handcrafted Features

White blood cells (WBCs) are one of the main components of blood produced by the bone marrow. WBCs are part of the immune system that protects the body from infectious diseases and an increase or decrease in the amount of any type that causes a particular disease. Thus, recognizing the WBC types is essential for diagnosing the patient's health and identifying the disease. Analyzing blood samples to determine the amount and WBC types requires experienced doctors. Artificial intelligence techniques were applied to analyze blood samples and classify their types to help doctors distinguish between types of infectious diseases due to increased or decreased WBC amounts. This study developed strategies for analyzing blood slide images to classify WBC types. The first strategy is to classify WBC types by the SVM-CNN technique. The second strategy for classifying WBC types is by SVM based on hybrid CNN features, which are called VGG19-ResNet101-SVM, ResNet101-MobileNet-SVM, and VGG19-ResNet101-MobileNet-SVM techniques. The third strategy for classifying WBC types by FFNN is based on a hybrid model of CNN and handcrafted features. With MobileNet and handcrafted features, FFNN achieved an AUC of 99.43%, accuracy of 99.80%, precision of 99.75%, specificity of 99.75%, and sensitivity of 99.68%.

Brain Tumor Segmentation Using Deep Learning on MRI Images

Brain tumor (BT) diagnosis is a lengthy process, and great skill and expertise are required from radiologists. As the number of patients has expanded, so has the amount of data to be processed, making previous techniques both costly and ineffective. Many academics have examined a range of reliable and quick techniques for identifying and categorizing BTs. Recently, deep learning (DL) methods have gained popularity for creating computer algorithms that can quickly and reliably diagnose or segment BTs. To identify BTs in medical images, DL permits a pre-trained convolutional neural network (CNN) model. The suggested magnetic resonance imaging (MRI) images of BTs are included in the BT segmentation dataset, which was created as a benchmark for developing and evaluating algorithms for BT segmentation and diagnosis. There are 335 annotated MRI images in the collection. For the purpose of developing and testing BT segmentation and diagnosis algorithms, the brain tumor segmentation (BraTS) dataset was produced. A deep CNN was also utilized in the model-building process for segmenting BTs using the BraTS dataset. To train the model, a categorical cross-entropy loss function and an optimizer, such as Adam, were employed. Finally, the model's output successfully identified and segmented BTs in the dataset, attaining a validation accuracy of 98%.

ETISTP: An Enhanced Model for Brain Tumor Identification and Survival Time Prediction

Technology-assisted diagnosis is increasingly important in healthcare systems. Brain tumors are a leading cause of death worldwide, and treatment plans rely heavily on accurate survival predictions. Gliomas, a type of brain tumor, have particularly high mortality rates and can be further classified as low- or high-grade, making survival prediction challenging. Existing literature provides several survival prediction models that use different parameters, such as patient age, gross total resection status, tumor size, or tumor grade. However, accuracy is often lacking in these models. The use of tumor volume instead of size may improve the accuracy of survival prediction. In response to this need, we propose a novel model, the enhanced brain tumor identification and survival time prediction (ETISTP), which computes tumor volume, classifies it into low- or high-grade glioma, and predicts survival time with greater accuracy. The ETISTP model integrates four parameters: patient age, survival days, gross total resection (GTR) status, and tumor volume. Notably, ETISTP is the first model to employ tumor volume for prediction. Furthermore, our model minimizes the computation time by allowing for parallel execution of tumor volume computation and classification. The simulation results demonstrate that ETISTP outperforms prominent survival prediction models.

Grade Classification of Tumors from Brain Magnetic Resonance Images Using a Deep Learning Technique

To improve the accuracy of tumor identification, it is necessary to develop a reliable automated diagnostic method. In order to precisely categorize brain tumors, researchers developed a variety of segmentation algorithms. Segmentation of brain images is generally recognized as one of the most challenging tasks in medical image processing. In this article, a novel automated detection and classification method was proposed. The proposed approach consisted of many phases, including pre-processing MRI images, segmenting images, extracting features, and classifying images. During the pre-processing portion of an MRI scan, an adaptive filter was utilized to eliminate background noise. For feature extraction, the local-binary grey level co-occurrence matrix (LBGLCM) was used, and for image segmentation, enhanced fuzzy c-means clustering (EFCMC) was used. After extracting the scan features, we used a deep learning model to classify MRI images into two groups: glioma and normal. The classifications were created using a convolutional recurrent neural network (CRNN). The proposed technique improved brain image classification from a defined input dataset. MRI scans from the REMBRANDT dataset, which consisted of 620 testing and 2480 training sets, were used for the research. The data demonstrate that the newly proposed method outperformed its predecessors. The proposed CRNN strategy was compared against BP, U-Net, and ResNet, which are three of the most prevalent classification approaches currently being used. For brain tumor classification, the proposed system outcomes were 98.17% accuracy, 91.34% specificity, and 98.79% sensitivity.

Hybrid Multilevel Thresholding Image Segmentation Approach for Brain MRI

A brain tumor is an abnormal growth of tissues inside the skull that can interfere with the normal functioning of the neurological system and the body, and it is responsible for the deaths of many individuals every year. Magnetic Resonance Imaging (MRI) techniques are widely used for detection of brain cancers. Segmentation of brain MRI is a foundational process with numerous clinical applications in neurology, including quantitative analysis, operational planning, and functional imaging. The segmentation process classifies the pixel values of the image into different groups based on the intensity levels of the pixels and a selected threshold value. The quality of the medical image segmentation extensively depends on the method which selects the threshold values of the image for the segmentation process. The traditional multilevel thresholding methods are computationally expensive since these methods thoroughly search for the best threshold values to maximize the accuracy of the segmentation process. Metaheuristic optimization algorithms are widely used for solving such problems. However, these algorithms suffer from the problem of local optima stagnation and slow convergence speed. In this work, the original Bald Eagle Search (BES) algorithm problems are resolved in the proposed Dynamic Opposite Bald Eagle Search (DOBES) algorithm by employing Dynamic Opposition Learning (DOL) at the initial, as well as exploitation, phases. Using the DOBES algorithm, a hybrid multilevel thresholding image segmentation approach has been developed for MRI image segmentation. The hybrid approach is divided into two phases. In the first phase, the proposed DOBES optimization algorithm is used for the multilevel thresholding. After the selection of the thresholds for the image segmentation, the morphological operations have been utilized in the second phase to remove the unwanted area present in the segmented image. The performance efficiency of the proposed DOBES based multilevel thresholding algorithm with respect to BES has been verified using the five benchmark images. The proposed DOBES based multilevel thresholding algorithm attains higher Peak Signal-to-Noise ratio (PSNR) and Structured Similarity Index Measure (SSIM) value in comparison to the BES algorithm for the benchmark images. Additionally, the proposed hybrid multilevel thresholding segmentation approach has been compared with the existing segmentation algorithms to validate its significance. The results show that the proposed algorithm performs better for tumor segmentation in MRI images as the SSIM value attained using the proposed hybrid segmentation approach is nearer to 1 when compared with ground truth images.

Investigating the Impact of Two Major Programming Environments on the Accuracy of Deep Learning-Based Glioma Detection from MRI Images

Brain tumors have been the subject of research for many years. Brain tumors are typically classified into two main groups: benign and malignant tumors. The most common tumor type among malignant brain tumors is known as glioma. In the diagnosis of glioma, different imaging technologies could be used. Among these techniques, MRI is the most preferred imaging technology due to its high-resolution image data. However, the detection of gliomas from a huge set of MRI data could be challenging for the practitioners. In order to solve this concern, many Deep Learning (DL) models based on Convolutional Neural Networks (CNNs) have been proposed to be used in detecting glioma. However, understanding which CNN architecture would work efficiently under various conditions including development environment or programming aspects as well as performance analysis has not been studied so far. In this research work, therefore, the purpose is to investigate the impact of two major programming environments (namely, MATLAB and Python) on the accuracy of CNN-based glioma detection from Magnetic Resonance Imaging (MRI) images. To this end, experiments on the Brain Tumor Segmentation (BraTS) dataset (2016 and 2017) consisting of multiparametric magnetic MRI images are performed by implementing two popular CNN architectures, the three-dimensional (3D) U-Net and the V-Net in the programming environments. From the results, it is concluded that the use of Python with Google Colaboratory (Colab) might be highly useful in the implementation of CNN-based models for glioma detection. Moreover, the 3D U-Net model is found to perform better, attaining a high accuracy on the dataset. The authors believe that the results achieved from this study would provide useful information to the research community in their appropriate implementation of DL approaches for brain tumor detection.

Computer-Aided Ankle Ligament Injury Diagnosis from Magnetic Resonance Images Using Machine Learning Techniques

Ankle injuries caused by the Anterior Talofibular Ligament (ATFL) are the most common type of injury. Thus, finding new ways to analyze these injuries through novel technologies is critical for assisting medical diagnosis and, as a result, reducing the subjectivity of this process. As a result, the purpose of this study is to compare the ability of specialists to diagnose lateral tibial tuberosity advancement (LTTA) injury using computer vision analysis on magnetic resonance imaging (MRI). The experiments were carried out on a database obtained from the Vue PACS-Carestream software, which contained 132 images of ATFL and normal (healthy) ankles. Because there were only a few images, image augmentation techniques was used to increase the number of images in the database. Following that, various feature extraction algorithms (GLCM, LBP, and HU invariant moments) and classifiers such as Multi-Layer Perceptron (MLP), Support Vector Machine (SVM), k-Nearest Neighbors (kNN), and Random Forest (RF) were used. Based on the results from this analysis, for cases that lack clear morphologies, the method delivers a hit rate of 85.03% with an increase of 22% over the human expert-based analysis.

Brain Tumor Classification Using Meta-Heuristic Optimized Convolutional Neural Networks

The field of medical image processing plays a significant role in brain tumor classification. The survival rate of patients can be increased by diagnosing the tumor at an early stage. Several automatic systems have been developed to perform the tumor recognition process. However, the existing systems could be more efficient in identifying the exact tumor region and hidden edge details with minimum computation complexity. The Harris Hawks optimized convolution network (HHOCNN) is used in this work to resolve these issues. The brain magnetic resonance (MR) images are pre-processed, and the noisy pixels are eliminated to minimize the false tumor recognition rate. Then, the candidate region process is applied to identify the tumor region. The candidate region method investigates the boundary regions with the help of the line segments concept, which reduces the loss of hidden edge details. Various features are extracted from the segmented region, which is classified by applying a convolutional neural network (CNN). The CNN computes the exact region of the tumor with fault tolerance. The proposed HHOCNN system was implemented using MATLAB, and performance was evaluated using pixel accuracy, error rate, accuracy, specificity, and sensitivity metrics. The nature-inspired Harris Hawks optimization algorithm minimizes the misclassification error rate and improves the overall tumor recognition accuracy to 98% achieved on the Kaggle dataset.

A Feature Extraction Using Probabilistic Neural Network and BTFSC-Net Model with Deep Learning for Brain Tumor Classification

BACKGROUND AND OBJECTIVES

Brain Tumor Fusion-based Segments and Classification-Non-enhancing tumor (BTFSC-Net) is a hybrid system for classifying brain tumors that combine medical image fusion, segmentation, feature extraction, and classification procedures.

MATERIALS AND METHODS

to reduce noise from medical images, the hybrid probabilistic wiener filter (HPWF) is first applied as a preprocessing step. Then, to combine robust edge analysis (REA) properties in magnetic resonance imaging (MRI) and computed tomography (CT) medical images, a fusion network based on deep learning convolutional neural networks (DLCNN) is developed. Here, the brain images' slopes and borders are detected using REA. To separate the sick region from the color image, adaptive fuzzy c-means integrated k-means (HFCMIK) clustering is then implemented. To extract hybrid features from the fused image, low-level features based on the redundant discrete wavelet transform (RDWT), empirical color features, and texture characteristics based on the gray-level cooccurrence matrix (GLCM) are also used. Finally, to distinguish between benign and malignant tumors, a deep learning probabilistic neural network (DLPNN) is deployed.

RESULTS

according to the findings, the suggested BTFSC-Net model performed better than more traditional preprocessing, fusion, segmentation, and classification techniques. Additionally, 99.21% segmentation accuracy and 99.46% classification accuracy were reached using the proposed BTFSC-Net model.

CONCLUSIONS

earlier approaches have not performed as well as our presented method for image fusion, segmentation, feature extraction, classification operations, and brain tumor classification. These results illustrate that the designed approach performed more effectively in terms of enhanced quantitative evaluation with better accuracy as well as visual performance.

Brain tumor magnetic resonance images classification based machine learning paradigms

INTRODUCTION

Cancer of the nervous system is one of the most common types of cancer in the world and mostly due to presence of a tumour in the brain. The symptoms and severity of the brain tumour depend on its location. The tumour within the brain may develop from nerves, dura (meningioma), pituitary gland (pituitary adenoma), or from the brain tissue itself (glioma).

MATERIAL AND METHODS

In this study we proposed a feature engineering approach for classification magnetic resonance imaging (MRI) of 3 kinds of most common brain tumour, i.e. glioma, meningioma, pituitary, and no-tumour. Here 5 machine learning classifiers were used, i.e. support vector machine, K-nearest neighbour (KNN), Naive Bayes, Decision Tree, and Ensemble classifier with their paradigms.

RESULTS

The handcrafted features such as histogram of oriented gradients, local binary pattern features, and grey level co-occurrence matrix are extracted from the MRI, and the feature fusion technique is adopted to enhance the dimension of feature vector. The Fine KNN outperforms among the classifiers for recognition of 4 kinds of MRI: glioma, meningioma, pituitary, and no tumour, and achieved 91.1% accuracy and 0.95 area under the curve (AUC).

CONCLUSIONS

The proposed method, i.e. Fine KNN, achieved 91.1% accuracy and 0.96 AUC. Furthermore, this model has the possibility to integrate in low-end devices unlike deep learning, which required a complex system.