Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images

Detection of brain lesion location in MRI images using convolutional neural network and robust PCA

Purpose and aim: Detection of brain tumors plays a critical role in the treatment of patients. Before any treatment, tumor segmentation is crucial to protect healthy tissues during treatment and to destroy tumor cells. Tumor segmentation involves the detection, precise identification, and separation of tumor tissues. In this paper, we provide a deep learning method for the segmentation of brain tumors. Material and methods: In this article, we used a convolutional neural network (CNN) to segment tumors in seven types of brain disease consisting of Glioma, Meningioma, Alzheimer's, Alzheimer's plus, Pick, Sarcoma, and Huntington. First, we used the feature-reduction-based method robust principal component analysis to find tumor location and spot in a dataset of Harvard Medical School. Then we present an architecture of the CNN method to detect brain tumors. Results: Results are depicted based on the probability of tumor location in magnetic resonance images. Results show that the presented method provides high accuracy (96%), sensitivity (99.9%), and dice index (91%) regarding other investigations. Conclusion: The provided unsupervised method for tumor clustering and proposed supervised architecture can be potential methods for medical uses.

ResNet-SVM: Fusion based glioblastoma tumor segmentation and classification

Computerized segmentation of brain tumor based on magnetic resonance imaging (MRI) data presents an important challenging act in computer vision. In image segmentation, numerous studies have explored the feasibility and advantages of employing deep neural network methods to automatically detect and segment brain tumors depicting on MRI. For training the deeper neural network, the procedure usually requires extensive computational power and it is also very time-consuming due to the complexity and the gradient diffusion difficulty. In order to address and help solve this challenge, we in this study present an automatic approach for Glioblastoma brain tumor segmentation based on deep Residual Learning Network (ResNet) to get over the gradient problem of deep Convolutional Neural Networks (CNNs). Using the extra layers added to a deep neural network, ResNet algorithm can effectively improve the accuracy and the performance, which is useful in solving complex problems with a much rapid training process. An additional method is then proposed to fully automatically classify different brain tumor categories (necrosis, edema, and enhancing regions). Results confirm that the proposed fusion method (ResNet-SVM) has an increased classification results of accuracy (AC = 89.36%), specificity (SP = 92.52%) and precision (PR = 90.12%) using 260 MRI data for the training and 112 data used for testing and validation of Glioblastoma tumor cases. Compared to the state-of-the art methods, the proposed scheme provides a higher performance by identifying Glioblastoma tumor type.

Improving performance robustness of subject-based brain segmentation software

Purpose

Artificial intelligence (AI)-based image analysis tools to quantify the brain have become commercialized. However, insufficient data for learning and scanner specificity is a limitation for achieving high quality. In the present study, the performance of personalized brain segmentation software when applied to multicenter data using an AI model trained on data from a single institution was improved.

Methods

Preindicators of brain white matter (WM) information from the training dataset were utilized for preprocessing. During learning, data of cognitively normal (CN) individuals from a single center were utilized, and data of CN individuals and Alzheimer disease (AD) patients enrolled in multiple centers were considered the test set.

Results

The preprocessing based on the preindicator (dice similarity coefficient [DSC], 0.8567) resulted in a better performance than without (DSC, 0.7921). The standard deviation (SD) of the WM region intensity (DSC, 0.8303) had a more substantial influence on the performance than the average intensity (DSC, 0.6591). When the SD of the test data WM intensity was smaller than the learning data, the performance improved (0.03 increase in lower SD, 0.05 decrease in higher SD). Furthermore, preindicator-based pretreatment increased the correlation of mean cortical thickness of the entire gray matter between Atroscan and FreeSurfer, and data augmentation without preprocessing did not.Both preindicator processing and data augmentation improved the correlation coefficient from 0.7584 to 0.8165.

Conclusion

Data augmentation and preindicator-based preprocessing of training data can improve the performance of AI-based brain segmentation software, both increasing the generalizability and stability of brain segmentation software.

Comprehensive Review on the Use of Artificial Intelligence in Ophthalmology and Future Research Directions

BACKGROUND

Having several applications in medicine, and in ophthalmology in particular, artificial intelligence (AI) tools have been used to detect visual function deficits, thus playing a key role in diagnosing eye diseases and in predicting the evolution of these common and disabling diseases. AI tools, i.e., artificial neural networks (ANNs), are progressively involved in detecting and customized control of ophthalmic diseases. The studies that refer to the efficiency of AI in medicine and especially in ophthalmology were analyzed in this review.

MATERIALS AND METHODS

We conducted a comprehensive review in order to collect all accounts published between 2015 and 2022 that refer to these applications of AI in medicine and especially in ophthalmology. Neural networks have a major role in establishing the demand to initiate preliminary anti-glaucoma therapy to stop the advance of the disease.

RESULTS

Different surveys in the literature review show the remarkable benefit of these AI tools in ophthalmology in evaluating the visual field, optic nerve, and retinal nerve fiber layer, thus ensuring a higher precision in detecting advances in glaucoma and retinal shifts in diabetes. We thus identified 1762 applications of artificial intelligence in ophthalmology: review articles and research articles (301 pub med, 144 scopus, 445 web of science, 872 science direct). Of these, we analyzed 70 articles and review papers (diabetic retinopathy (N = 24), glaucoma (N = 24), DMLV (N = 15), other pathologies (N = 7)) after applying the inclusion and exclusion criteria.

CONCLUSION

In medicine, AI tools are used in surgery, radiology, gynecology, oncology, etc., in making a diagnosis, predicting the evolution of a disease, and assessing the prognosis in patients with oncological pathologies. In ophthalmology, AI potentially increases the patient's access to screening/clinical diagnosis and decreases healthcare costs, mainly when there is a high risk of disease or communities face financial shortages. AI/DL (deep learning) algorithms using both OCT and FO images will change image analysis techniques and methodologies. Optimizing these (combined) technologies will accelerate progress in this area.

Axial Attention Convolutional Neural Network for Brain Tumor Segmentation with Multi-Modality MRI Scans

Accurately identifying tumors from MRI scans is of the utmost importance for clinical diagnostics and when making plans regarding brain tumor treatment. However, manual segmentation is a challenging and time-consuming process in practice and exhibits a high degree of variability between doctors. Therefore, an axial attention brain tumor segmentation network was established in this paper, automatically segmenting tumor subregions from multi-modality MRIs. The axial attention mechanism was employed to capture richer semantic information, which makes it easier for models to provide local-global contextual information by incorporating local and global feature representations while simplifying the computational complexity. The deep supervision mechanism is employed to avoid vanishing gradients and guide the AABTS-Net to generate better feature representations. The hybrid loss is employed in the model to handle the class imbalance of the dataset. Furthermore, we conduct comprehensive experiments on the BraTS 2019 and 2020 datasets. The proposed AABTS-Net shows greater robustness and accuracy, which signifies that the model can be employed in clinical practice and provides a new avenue for medical image segmentation systems.

Smart Visualization of Medical Images as a Tool in the Function of Education in Neuroradiology

The smart visualization of medical images (SVMI) model is based on multi-detector computed tomography (MDCT) data sets and can provide a clearer view of changes in the brain, such as tumors (expansive changes), bleeding, and ischemia on native imaging (i.e., a non-contrast MDCT scan). The new SVMI method provides a more precise representation of the brain image by hiding pixels that are not carrying information and rescaling and coloring the range of pixels essential for detecting and visualizing the disease. In addition, SVMI can be used to avoid the additional exposure of patients to ionizing radiation, which can lead to the occurrence of allergic reactions due to the contrast media administration. Results of the SVMI model were compared with the final diagnosis of the disease after additional diagnostics and confirmation by neuroradiologists, who are highly trained physicians with many years of experience. The application of the realized and presented SVMI model can optimize the engagement of material, medical, and human resources and has the potential for general application in medical training, education, and clinical research.

Pathological Diagnosis of Adult Craniopharyngioma on MR Images: An Automated End-to-End Approach Based on Deep Neural Networks Requiring No Manual Segmentation

PURPOSE

The goal of this study was to develop end-to-end convolutional neural network (CNN) models that can noninvasively discriminate papillary craniopharyngioma (PCP) from adamantinomatous craniopharyngioma (ACP) on MR images requiring no manual segmentation.

MATERIALS AND METHODS

A total of 97 patients diagnosed with ACP or PCP were included. Pretreatment contrast-enhanced T1-weighted images were collected and used as the input of the CNNs. Six models were established based on six networks, including VGG16, ResNet18, ResNet50, ResNet101, DenseNet121, and DenseNet169. The area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity were used to assess the performances of these deep neural networks. A five-fold cross-validation was applied to evaluate the performances of the models.

RESULTS

The six networks yielded feasible performances, with area under the receiver operating characteristic curves (AUCs) of at least 0.78 for classification. The model based on Resnet50 achieved the highest AUC of 0.838 ± 0.062, with an accuracy of 0.757 ± 0.052, a sensitivity of 0.608 ± 0.198, and a specificity of 0.845 ± 0.034, respectively. Moreover, the results also indicated that the CNN method had a competitive performance compared to the radiomics-based method, which required manual segmentation for feature extraction and further feature selection.

CONCLUSIONS

MRI-based deep neural networks can noninvasively differentiate ACP from PCP to facilitate the personalized assessment of craniopharyngiomas.

Beyond Imaging and Genetic Signature in Glioblastoma: Radiogenomic Holistic Approach in Neuro-Oncology

Glioblastoma (GBM) is a malignant brain tumor exhibiting rapid and infiltrative growth, with less than 10% of patients surviving over 5 years, despite aggressive and multimodal treatments. The poor prognosis and the lack of effective pharmacological treatments are imputable to a remarkable histological and molecular heterogeneity of GBM, which has led, to date, to the failure of precision oncology and targeted therapies. Identification of molecular biomarkers is a paradigm for comprehensive and tailored treatments; nevertheless, biopsy sampling has proved to be invasive and limited. Radiogenomics is an emerging translational field of research aiming to study the correlation between radiographic signature and underlying gene expression. Although a research field still under development, not yet incorporated into routine clinical practice, it promises to be a useful non-invasive tool for future personalized/adaptive neuro-oncology. This review provides an up-to-date summary of the recent advancements in the use of magnetic resonance imaging (MRI) radiogenomics for the assessment of molecular markers of interest in GBM regarding prognosis and response to treatments, for monitoring recurrence, also providing insights into the potential efficacy of such an approach for survival prognostication. Despite a high sensitivity and specificity in almost all studies, accuracy, reproducibility and clinical value of radiomic features are the Achilles heel of this newborn tool. Looking into the future, investigators' efforts should be directed towards standardization and a disciplined approach to data collection, algorithms, and statistical analysis.

Automated brain tumour segmentation from multi-modality magnetic resonance imaging data based on new particle swarm optimisation segmentation method

BACKGROUND

Segmentation of brain tumours is a complex problem in medical image processing and analysis. It is a time-consuming and error-prone task. Therefore, computer-aided detection systems need to be developed to decrease physicians' workload and improve the accuracy of segmentation.

METHODS

This paper proposes a level set method constrained by an intuitive artificial intelligence-based approach to perform brain tumour segmentation. By studying 3D brain tumour images, a new segmentation technique based on the Modified Particle Swarm Optimisation (MPSO), Darwin Particle Swarm Optimisation (DPSO), and Fractional Order Darwinian Particle Swarm Optimisation (FODPSO) algorithms were developed.

RESULTS

The introduced technique was verified according to the MICCAI RASTS 2013 database for high-grade glioma patients. The three algorithms were evaluated using different performance measures: accuracy, sensitivity, specificity, and Dice similarity coefficient to prove the performance and robustness of our 3D segmentation technique.

CONCLUSION

The result is that the MPSO algorithm consistently outperforms the DPSO and FO DPSO.

A Robust Computer-Aided Automated Brain Tumor Diagnosis Approach Using PSO-ReliefF Optimized Gaussian and Non-Linear Feature Space

Brain tumors are among the deadliest diseases in the modern world. This study proposes an optimized machine-learning approach for the detection and identification of the type of brain tumor (glioma, meningioma, or pituitary tumor) in brain images recorded using magnetic resonance imaging (MRI). The Gaussian features of the image are extracted using speed-up robust features (SURF), whereas its non-linear features are obtained using KAZE, owing to their high performance against rotation, scaling, and noise problems. To retrieve local-level information, all brain MRI images are segmented into an 8 × 8 pixel grid. To enhance the accuracy and reduce the computational time, the variance-based k-means clustering and PSO-ReliefF algorithms are employed to eliminate the redundant features of the brain MRI images. Finally, the performance of the proposed hybrid optimized feature vector is evaluated using various machine learning classifiers. An accuracy of 96.30% is obtained with 169 features using a support vector machine (SVM). Furthermore, the computational time is also reduced to 1 min compared to the non-optimized features used for training of the SVM. The findings are also compared with previous research, demonstrating that the suggested approach might assist physicians and doctors in the timely detection of brain tumors.

Application of a Modified Combinational Approach to Brain Tumor Detection in MR Images

For many years, brain tumor detection has been one of the most essential and competitive issues for medical researchers. Many methods have been developed to detect normal and abnormal tissues in Magnetic Resonance (MR) images. In this work, we present a novel algorithm based on iterative Co-Clustering and K-Means (ICCK). After image pre-processing and enhancement, this algorithm recognizes the part of the image that contains the tumor and eliminates the unused parts using a modification of the Co-Clustering method. Finally, the K-Means clustering method is adopted to detect the tumor area. The Co-Clustering methods cannot be used directly for the detection of brain tumors because they manipulate the image matrix for the purpose of block clustering. Furthermore, they are incapable of detecting the tumor area correctly and accurately. Such issues are addressed by our proposed methodology. The latent block model (LBM) is applied as the Co-Clustering method in this work. We evaluate the performance of our method on the images that were collected from the BraTS2019 dataset. The sensitivity, specificity, accuracy, and dice similarity coefficient values for our method are 82.41%, 99.74%, 99.28%, and 84.87%, respectively, which shows that the proposed method outperforms the existing methods in the literature. Moreover, it performs much better on complex images.

Clinical Decision Support Framework for Segmentation and Classification of Brain Tumor MRIs Using a U-Net and DCNN Cascaded Learning Algorithm

Brain tumors (BTs) are an uncommon but fatal kind of cancer. Therefore, the development of computer-aided diagnosis (CAD) systems for classifying brain tumors in magnetic resonance imaging (MRI) has been the subject of many research papers so far. However, research in this sector is still in its early stage. The ultimate goal of this research is to develop a lightweight effective implementation of the U-Net deep network for use in performing exact real-time segmentation. Moreover, a simplified deep convolutional neural network (DCNN) architecture for the BT classification is presented for automatic feature extraction and classification of the segmented regions of interest (ROIs). Five convolutional layers, rectified linear unit, normalization, and max-pooling layers make up the DCNN's proposed simplified architecture. The introduced method was verified on multimodal brain tumor segmentation (BRATS 2015) datasets. Our experimental results on BRATS 2015 acquired Dice similarity coefficient (DSC) scores, sensitivity, and classification accuracy of 88.8%, 89.4%, and 88.6% for high-grade gliomas. When it comes to segmenting BRATS 2015 BT images, the performance of our proposed CAD framework is on par with existing state-of-the-art methods. However, the accuracy achieved in this study for the classification of BT images has improved upon the accuracy reported in prior studies. Image classification accuracy for BRATS 2015 BT has been improved from 88% to 88.6%.

Fully Convolutional Network for the Semantic Segmentation of Medical Images: A Survey

There have been major developments in deep learning in computer vision since the 2010s. Deep learning has contributed to a wealth of data in medical image processing, and semantic segmentation is a salient technique in this field. This study retrospectively reviews recent studies on the application of deep learning for segmentation tasks in medical imaging and proposes potential directions for future development, including model development, data augmentation processing, and dataset creation. The strengths and deficiencies of studies on models and data augmentation, as well as their application to medical image segmentation, were analyzed. Fully convolutional network developments have led to the creation of the U-Net and its derivatives. Another noteworthy image segmentation model is DeepLab. Regarding data augmentation, due to the low data volume of medical images, most studies focus on means to increase the wealth of medical image data. Generative adversarial networks (GAN) increase data volume via deep learning. Despite the increasing types of medical image datasets, there is still a deficiency of datasets on specific problems, which should be improved moving forward. Considering the wealth of ongoing research on the application of deep learning processing to medical image segmentation, the data volume and practical clinical application problems must be addressed to ensure that the results are properly applied.

Brain tumor classification based on neural architecture search

Brain tumor is a life-threatening disease and causes about 0.25 million deaths worldwide in 2020. Magnetic Resonance Imaging (MRI) is frequently used for diagnosing brain tumors. In medically underdeveloped regions, physicians who can accurately diagnose and assess the severity of brain tumors from MRI are highly lacking. Deep learning methods have been developed to assist physicians in detecting brain tumors from MRI and determining their subtypes. In existing methods, neural architectures are manually designed by human experts, which is time-consuming and labor-intensive. To address this problem, we propose to automatically search for high-performance neural architectures for classifying brain tumors from MRIs, by leveraging a Learning-by-Self-Explanation (LeaSE) architecture search method. LeaSE consists of an explainer model and an audience model. The explainer aims at searching for a highly performant architecture by encouraging the architecture to generate high-fidelity explanations of prediction outcomes, where explanations' fidelity is evaluated by the audience model. LeaSE is formulated as a four-level optimization problem involving a sequence of four learning stages which are conducted end-to-end. We apply LeaSE for MRI-based brain tumor classification, including four classes: glioma, meningioma, pituitary tumor, and healthy, on a dataset containing 3264 MRI images. Results show that our method can search for neural architectures that achieve better classification accuracy than manually designed deep neural networks while having fewer model parameters. For example, our method achieves a test accuracy of 90.6% and an AUC of 95.6% with 3.75M parameters while the accuracy and AUC of a human-designed network-ResNet101-is 84.5% and 90.1% respectively with 42.56M parameters. In addition, our method outperforms state-of-the-art neural architecture search methods.

Synthetic augmentation for semantic segmentation of class imbalanced biomedical images: A data pair generative adversarial network approach

In recent years, deep learning (DL) has been recognized very useful in the semantic segmentation of biomedical images. Such an application, however, is significantly hindered by the lack of pixel-wise annotations. In this work, we propose a data pair generative adversarial network (DPGAN) for the purpose of synthesizing concurrently the diverse biomedical images and the segmentation labels from random latent vectors. First, a hierarchical structure is constructed consisting of three variational auto-encoder generative adversarial networks (VAEGANs) with an extra discriminator. Subsequently, to alleviate the influence from the imbalance between lesions and non-lesions areas in biomedical segmentation data sets, we divide the DPGAN into three stages, namely, background stage, mask stage and advanced stage, with each stage deploying a VAEGAN. In such a way, a large number of new segmentation data pairs are generated from random latent vectors and then used to augment the original data sets. Finally, to validate the effectiveness of the proposed DPGAN, experiments are carried out on a vestibular schwannoma data set, a kidney tumor data set and a skin cancer data set. The results indicate that, in comparison to other state-of-the-art GAN-based methods, the proposed DPGAN shows better performance in the generative quality, and meanwhile, gains an effective boost on semantic segmentation of class imbalanced biomedical images.

Qutrit-Inspired Fully Self-Supervised Shallow Quantum Learning Network for Brain Tumor Segmentation

Classical self-supervised networks suffer from convergence problems and reduced segmentation accuracy due to forceful termination. Qubits or bilevel quantum bits often describe quantum neural network models. In this article, a novel self-supervised shallow learning network model exploiting the sophisticated three-level qutrit-inspired quantum information system, referred to as quantum fully self-supervised neural network (QFS-Net), is presented for automated segmentation of brain magnetic resonance (MR) images. The QFS-Net model comprises a trinity of a layered structure of qutrits interconnected through parametric Hadamard gates using an eight-connected second-order neighborhood-based topology. The nonlinear transformation of the qutrit states allows the underlying quantum neural network model to encode the quantum states, thereby enabling a faster self-organized counterpropagation of these states between the layers without supervision. The suggested QFS-Net model is tailored and extensively validated on the Cancer Imaging Archive (TCIA) dataset collected from the Nature repository. The experimental results are also compared with state-of-the-art supervised (U-Net and URes-Net architectures) and the self-supervised QIS-Net model and its classical counterpart. Results shed promising segmented outcomes in detecting tumors in terms of dice similarity and accuracy with minimum human intervention and computational resources. The proposed QFS-Net is also investigated on natural gray-scale images from the Berkeley segmentation dataset and yields promising outcomes in segmentation, thereby demonstrating the robustness of the QFS-Net model.

Influence of contrast and texture based image modifications on the performance and attention shift of U-Net models for brain tissue segmentation

Contrast and texture modifications applied during training or test-time have recently shown promising results to enhance the generalization performance of deep learning segmentation methods in medical image analysis. However, a deeper understanding of this phenomenon has not been investigated. In this study, we investigated this phenomenon using a controlled experimental setting, using datasets from the Human Connectome Project and a large set of simulated MR protocols, in order to mitigate data confounders and investigate possible explanations as to why model performance changes when applying different levels of contrast and texture-based modifications. Our experiments confirm previous findings regarding the improved performance of models subjected to contrast and texture modifications employed during training and/or testing time, but further show the interplay when these operations are combined, as well as the regimes of model improvement/worsening across scanning parameters. Furthermore, our findings demonstrate a spatial attention shift phenomenon of trained models, occurring for different levels of model performance, and varying in relation to the type of applied image modification.

Deep Learning Hybrid Techniques for Brain Tumor Segmentation

Medical images play an important role in medical diagnosis and treatment. Oncologists analyze images to determine the different characteristics of deadly diseases, plan the therapy, and observe the evolution of the disease. The objective of this paper is to propose a method for the detection of brain tumors. Brain tumors are identified from Magnetic Resonance (MR) images by performing suitable segmentation procedures. The latest technical literature concerning radiographic images of the brain shows that deep learning methods can be implemented to extract specific features of brain tumors, aiding clinical diagnosis. For this reason, most data scientists and AI researchers work on Machine Learning methods for designing automatic screening procedures. Indeed, an automated method would result in quicker segmentation findings, providing a robust output with respect to possible differences in data sources, mostly due to different procedures in data recording and storing, resulting in a more consistent identification of brain tumors. To improve the performance of the segmentation procedure, new architectures are proposed and tested in this paper. We propose deep neural networks for the detection of brain tumors, trained on the MRI scans of patients' brains. The proposed architectures are based on convolutional neural networks and inception modules for brain tumor segmentation. A comparison of these proposed architectures with the baseline reference ones shows very interesting results. MI-Unet showed a performance increase in comparison to baseline Unet architecture by 7.5% in dice score, 23.91% insensitivity, and 7.09% in specificity. Depth-wise separable MI-Unet showed a performance increase by 10.83% in dice score, 2.97% in sensitivity, and 12.72% in specificity as compared to the baseline Unet architecture. Hybrid Unet architecture achieved performance improvement of 9.71% in dice score, 3.56% in sensitivity, and 12.6% in specificity. Whereas the depth-wise separable hybrid Unet architecture outperformed the baseline architecture by 15.45% in dice score, 20.56% in sensitivity, and 12.22% in specificity.

Deep Convolutional Neural Network for Nasopharyngeal Carcinoma Discrimination on MRI by Comparison of Hierarchical and Simple Layered Convolutional Neural Networks

Nasopharyngeal carcinoma (NPC) is one of the most common head and neck cancers. Early diagnosis plays a critical role in the treatment of NPC. To aid diagnosis, deep learning methods can provide interpretable clues for identifying NPC from magnetic resonance images (MRI). To identify the optimal models, we compared the discrimination performance of hierarchical and simple layered convolutional neural networks (CNN). Retrospectively, we collected the MRI images of patients and manually built the tailored NPC image dataset. We examined the performance of the representative CNN models including shallow CNN, ResNet50, ResNet101, and EfficientNet-B7. By fine-tuning, shallow CNN, ResNet50, ResNet101, and EfficientNet-B7 achieved the precision of 72.2%, 94.4%, 92.6%, and 88.4%, displaying the superiority of deep hierarchical neural networks. Among the examined models, ResNet50 with pre-trained weights demonstrated the best classification performance over other types of CNN with accuracy, precision, and an F1-score of 0.93, 0.94, and 0.93, respectively. The fine-tuned ResNet50 achieved the highest prediction performance and can be used as a potential tool for aiding the diagnosis of NPC tumors.

A Classification Method for Thoracolumbar Vertebral Fractures due to Basketball Sports Injury Based on Deep Learning

Objective

There are more and more basketball competitions, to propose a classification method of thoracolumbar fractures to assist in the diagnosis of basketball injuries, to analyze the feasibility of its clinical application, and to improve the recovery rate.

Methods

From February 2015 to May 2022, 1130 CT images of thoracolumbar fractures admitted to our hospital and affiliated hospital units due to basketball injuries were collected, and the image labeling system uniformly labeled them. All CT images were classified according to the AO spine classification of thoracolumbar injuries. In the ABC-type classification, 935 CT images were used for training and validation to optimize the deep learning system, including 815 training sets and 120 validation sets; the remaining 198 CT images were used as test sets for comparing the deep learning system and clinician's diagnosis. In the classification of subtype A, a total of 523 CT scans can be performed for training and validation to optimize the deep learning system, including 500 training sets and 23 validation sets; the remaining 94 CT images are used as test sets for comparing depth learning systems and clinicians' diagnostic results.

Results

The deep learning system had a correct rate of ABC classification of fractures in 86.4%, with a kappa coefficient of 0.850 (P < 0.001); the correct rate of subtype A was 85.3%, with a kappa coefficient of 0.815 (P < 0.001).

Conclusion

The classification accuracy of thoracolumbar fractures based on deep learning is high. The method can assist in diagnosing CT images of thoracolumbar fractures and improve the current manual and complex diagnosis process.

A domain adaptation benchmark for T1-weighted brain magnetic resonance image segmentation

Accurate brain segmentation is critical for magnetic resonance imaging (MRI) analysis pipelines. Machine-learning-based brain MR image segmentation methods are among the state-of-the-art techniques for this task. Nevertheless, the segmentations produced by machine learning models often degrade in the presence of expected domain shifts between the test and train sets data distributions. These domain shifts are expected due to several factors, such as scanner hardware and software differences, technology updates, and differences in MRI acquisition parameters. Domain adaptation (DA) methods can make machine learning models more resilient to these domain shifts. This paper proposes a benchmark for investigating DA techniques for brain MR image segmentation using data collected across sites with scanners from different vendors (Philips, Siemens, and General Electric). Our work provides labeled data, publicly available source code for a set of baseline and DA models, and a benchmark for assessing different brain MR image segmentation techniques. We applied the proposed benchmark to evaluate two segmentation tasks: skull-stripping; and white-matter, gray-matter, and cerebrospinal fluid segmentation, but the benchmark can be extended to other brain structures. Our main findings during the development of this benchmark are that there is not a single DA technique that consistently outperforms others, and hyperparameter tuning and computational times for these methods still pose a challenge before broader adoption of these methods in the clinical practice.

Exploring the role of nanomedicines for the therapeutic approach of central nervous system dysfunction: At a glance

In recent decades, research scientists, molecular biologists, and pharmacologists have placed a strong emphasis on cutting-edge nanostructured materials technologies to increase medicine delivery to the central nervous system (CNS). The application of nanoscience for the treatment of neurodegenerative diseases (NDs) such as Alzheimer’s disease (AD), Parkinson’s disease (PD), multiple sclerosis (MS), Huntington’s disease (HD), brain cancer, and hemorrhage has the potential to transform care. Multiple studies have indicated that nanomaterials can be used to successfully treat CNS disorders in the case of neurodegeneration. Nanomedicine development for the cure of degenerative and inflammatory diseases of the nervous system is critical. Nanoparticles may act as a drug transporter that can precisely target sick brain sub-regions, boosting therapy success. It is important to develop strategies that can penetrate the blood–brain barrier (BBB) and improve the effectiveness of medications. One of the probable tactics is the use of different nanoscale materials. These nano-based pharmaceuticals offer low toxicity, tailored delivery, high stability, and drug loading capacity. They may also increase therapeutic effectiveness. A few examples of the many different kinds and forms of nanomaterials that have been widely employed to treat neurological diseases include quantum dots, dendrimers, metallic nanoparticles, polymeric nanoparticles, carbon nanotubes, liposomes, and micelles. These unique qualities, including sensitivity, selectivity, and ability to traverse the BBB when employed in nano-sized particles, make these nanoparticles useful for imaging studies and treatment of NDs. Multifunctional nanoparticles carrying pharmacological medications serve two purposes: they improve medication distribution while also enabling cell dynamics imaging and pharmacokinetic study. However, because of the potential for wide-ranging clinical implications, safety concerns persist, limiting any potential for translation. The evidence for using nanotechnology to create drug delivery systems that could pass across the BBB and deliver therapeutic chemicals to CNS was examined in this study.

Attention 3D U-Net with Multiple Skip Connections for Segmentation of Brain Tumor Images

Among researchers using traditional and new machine learning and deep learning techniques, 2D medical image segmentation models are popular. Additionally, 3D volumetric data recently became more accessible, as a result of the high number of studies conducted in recent years regarding the creation of 3D volumes. Using these 3D data, researchers have begun conducting research on creating 3D segmentation models, such as brain tumor segmentation and classification. Since a higher number of crucial features can be extracted using 3D data than 2D data, 3D brain tumor detection models have increased in popularity among researchers. Until now, various significant research works have focused on the 3D version of the U-Net and other popular models, such as 3D U-Net and V-Net, while doing superior research works. In this study, we used 3D brain image data and created a new architecture based on a 3D U-Net model that uses multiple skip connections with cost-efficient pretrained 3D MobileNetV2 blocks and attention modules. These pretrained MobileNetV2 blocks assist our architecture by providing smaller parameters to maintain operable model size in terms of our computational capability and help the model to converge faster. We added additional skip connections between the encoder and decoder blocks to ease the exchange of extracted features between the two blocks, which resulted in the maximum use of the features. We also used attention modules to filter out irrelevant features coming through the skip connections and, thus, preserved more computational power while achieving improved accuracy.

Glioma segmentation with DWI weighted images, conventional anatomical images, and post-contrast enhancement magnetic resonance imaging images by U-Net

Glioma segmentation is believed to be one of the most important stages of treatment management. Recent developments in magnetic resonance imaging (MRI) protocols have led to a renewed interest in using automatic glioma segmentation with different MRI image weights. U-Net is a major area of interest within the field of automatic glioma segmentation. This paper examines the impact of different input MRI image-weight on the U-Net output performance for glioma segmentation. One hundred forty-nine glioma patients were scanned with a 1.5T MRI scanner. The main MRI image-weights acquired are diffusion-weighted imaging (DWI) weighted images (b50, b500, b1000, Apparent diffusion coefficient (ADC) map, Exponential apparent diffusion coefficient (eADC) map), anatomical image-weights (T₂, T₁, T₂-FLAIR), and post enhancement image-weights (T₁Gd). The U-Net and data augmentation are used to segment the glioma tumors. Having the Dice coefficient and accuracy enabled us to compare our results with the previous study. The first set of analyses examined the impact of epoch number on the accuracy of U-Net, and n_epoch = 20 was selected for U-Net training. The mean Dice coefficient for b50, b500, b1000, ADC map, eADC map, T₂, T₁, T₂-FLAIR, and T₁Gd image weights for glioma segmentation with U-Net were calculated 0.892, 0.872, 0.752, 0.931, 0.944, 0.762, 0.721, 0.896, 0.694 respectively. This study has found that, DWI image-weights have a higher diagnostic value for glioma segmentation with U-Net in comparison with anatomical image-weights and post enhancement image-weights. The results of this investigation show that ADC and eADC maps have higher performance for glioma segmentation with U-Net.

Deep Learning in Dermatology: A Systematic Review of Current Approaches, Outcomes, and Limitations

Artificial intelligence (AI) has recently made great advances in image classification and malignancy prediction in the field of dermatology. However, understanding the applicability of AI in clinical dermatology practice remains challenging owing to the variability of models, image data, database characteristics, and variable outcome metrics. This systematic review aims to provide a comprehensive overview of dermatology literature using convolutional neural networks. Furthermore, the review summarizes the current landscape of image datasets, transfer learning approaches, challenges, and limitations within current AI literature and current regulatory pathways for approval of models as clinical decision support tools.

3D Automatic Segmentation of Brain Tumor Based on Deep Neural Network and Multimodal MRI Images

Brain tumor segmentation is an important content in medical image processing, and it is also a very common research in medicine. Due to the development of modern technology, it is very valuable to use deep learning (DL) and multimodal MRI images to study brain tumor segmentation. In order to solve the problems of low efficiency and low accuracy of brain tumor segmentation, this paper proposes DL to conduct research on multimodal MRI image segmentation, aiming to make accurate diagnosis and treatment for doctors. In addition, this paper constructs an automatic diagnosis system for brain tumors, uses GLCM and discrete wavelet transform (DWT) to extract features from MRI images, and then uses a convolutional neural network (CNN) for final diagnosis; finally, through four. The comparison of the results between the two algorithms proves that the CNN algorithm has the better processing power and higher efficiency.

MTDCNet: A 3D multi-threading dilated convolutional network for brain tumor automatic segmentation

Glioma is one of the most threatening tumors and the survival rate of the infected patient is low. The automatic segmentation of the tumors by reliable algorithms can reduce diagnosis time. In this paper, a novel 3D multi-threading dilated convolutional network (MTDC-Net) is proposed for the automatic brain tumor segmentation. First of all, a multi-threading dilated convolution (MTDC) strategy is introduced in the encoder part, so that the low dimensional structural features can be extracted and integrated better. At the same time, the pyramid matrix fusion (PMF) algorithm is used to integrate the characteristic structural information better. Secondly, in order to make the better use of context semantical information, this paper proposed a spatial pyramid convolution (SPC) operation. By using convolution with different kernel sizes, the model can aggregate more semantic information. Finally, the multi-threading adaptive pooling up-sampling (MTAU) strategy is used to increase the weight of semantic information, and improve the recognition ability of the model. And a pixel-based post-processing method is used to prevent the effects of error prediction. On the brain tumors segmentation challenge 2018 (BraTS2018) public validation dataset, the dice scores of MTDC-Net are 0.832, 0.892 and 0.809 for core, whole and enhanced of the tumor, respectively. On the BraTS2020 public validation dataset, the dice scores of MTDC-Net are 0.833, 0.896 and 0.797 for the core tumor, whole tumor and enhancing tumor, respectively. Mass numerical experiments show that MTDC-Net is a state-of-the-art network for automatic brain tumor segmentation.

Study and analysis of different segmentation methods for brain tumor MRI application

Medical Resonance Imaging (MRI) is one of the preferred imaging methods for brain tumor diagnosis and getting detailed information on tumor type, location, size, identification, and detection. Segmentation divides an image into multiple segments and describes the separation of the suspicious region from pre-processed MRI images to make the simpler image that is more meaningful and easier to examine. There are many segmentation methods, embedded with detection devices, and the response of each method is different. The study article focuses on comparing the performance of several image segmentation algorithms for brain tumor diagnosis, such as Otsu's, watershed, level set, K-means, HAAR Discrete Wavelet Transform (DWT), and Convolutional Neural Network (CNN). All of the techniques are simulated in MATLAB using online images from the Brain Tumor Image Segmentation Benchmark (BRATS) dataset-2018. The performance of these methods is analyzed based on response time and measures such as recall, precision, F-measures, and accuracy. The measured accuracy of Otsu's, watershed, level set, K-means, DWT, and CNN methods is 71.42%, 78.26%, 80.45%, 84.34%, 86.95%, and 91.39 respectively. The response time of CNN is 2.519 s in the MATLAB simulation environment for the designed algorithm. The novelty of the work is that CNN has been proven the best algorithm in comparison to all other methods for brain tumor image segmentation. The simulated and estimated parameters provide the direction to researchers to choose the specific algorithm for embedded hardware solutions and develop the optimal machine-learning models, as the industries are looking for the optimal solutions of CNN and deep learning-based hardware models for the brain tumor.

Multi-Modal Brain Tumor Detection Using Deep Neural Network and Multiclass SVM

Background and Objectives: Clinical diagnosis has become very significant in today's health system. The most serious disease and the leading cause of mortality globally is brain cancer which is a key research topic in the field of medical imaging. The examination and prognosis of brain tumors can be improved by an early and precise diagnosis based on magnetic resonance imaging. For computer-aided diagnosis methods to assist radiologists in the proper detection of brain tumors, medical imagery must be detected, segmented, and classified. Manual brain tumor detection is a monotonous and error-prone procedure for radiologists; hence, it is very important to implement an automated method. As a result, the precise brain tumor detection and classification method is presented. Materials and Methods: The proposed method has five steps. In the first step, a linear contrast stretching is used to determine the edges in the source image. In the second step, a custom 17-layered deep neural network architecture is developed for the segmentation of brain tumors. In the third step, a modified MobileNetV2 architecture is used for feature extraction and is trained using transfer learning. In the fourth step, an entropy-based controlled method was used along with a multiclass support vector machine (M-SVM) for the best features selection. In the final step, M-SVM is used for brain tumor classification, which identifies the meningioma, glioma and pituitary images. Results: The proposed method was demonstrated on BraTS 2018 and Figshare datasets. Experimental study shows that the proposed brain tumor detection and classification method outperforms other methods both visually and quantitatively, obtaining an accuracy of 97.47% and 98.92%, respectively. Finally, we adopt the eXplainable Artificial Intelligence (XAI) method to explain the result. Conclusions: Our proposed approach for brain tumor detection and classification has outperformed prior methods. These findings demonstrate that the proposed approach obtained higher performance in terms of both visually and enhanced quantitative evaluation with improved accuracy.

Deep Neural Network-Based Novel Mathematical Model for 3D Brain Tumor Segmentation

The use of multimodal magnetic resonance imaging (MRI) to autonomously segment brain tumors and subregions is critical for accurate and consistent tumor measurement, which can help with detection, care planning, and evaluation. This research is a contribution to the neuroscience research. In the present work, we provide a completely automated brain tumor segmentation method based on a mathematical model and deep neural networks (DNNs). Each slice of the 3D picture is enhanced by the suggested mathematical model, which is then sent through the 3D attention U-Net to provide a tumor segmented output. The study includes a detailed mathematical model for tumor pixel enhancement as well as a 3D attention U-Net to appropriately separate the pixels. On the BraTS 2019 dataset, the suggested system is tested and verified. This proposed work will definitely help for the treatment of the brain tumor patient. The pixel level accuracy for tumor pixel segmentation is 98.90%. The suggested system architecture's outcomes are compared to those of current system designs. This study also examines the suggested system architecture's time complexity on various processing units with neuroscience approach.

Application of artificial intelligence in glioma researches: A bibliometric analysis

Background

There have been no researches assessing the research trends of the application of artificial intelligence in glioma researches with bibliometric methods.

Purpose

The aim of the study is to assess the research trends of the application of artificial intelligence in glioma researches with bibliometric analysis.

Methods

Documents were retrieved from web of science between 1996 and 2022. The bibliometrix package from Rstudio was applied for data analysis and plotting.

Results

A total of 1081 documents were retrieved from web of science between 1996 and 2022. The annual growth rate was 30.47%. The top 5 most productive countries were the USA, China, Germany, France, and UK. The USA and China have the strongest international cooperative link. Machine learning, deep learning, radiomics, and radiogenomics have been the key words and trend topics. “Neuro-Oncology”, “Frontiers in Oncology”, and “Cancers” have been the top 3 most relevant journals. The top 3 most relevant institutions were University of Pennsylvania, Capital Medical University, and Fudan University.

Conclusions

With the growth of publications concerning the application of artificial intelligence in glioma researches, bibliometric analysis help researchers to get access to the international academic collaborations and trend topics in the research field.

CAN3D: Fast 3D medical image segmentation via compact context aggregation

Direct automatic segmentation of objects in 3D medical imaging, such as magnetic resonance (MR) imaging, is challenging as it often involves accurately identifying multiple individual structures with complex geometries within a large volume under investigation. Most deep learning approaches address these challenges by enhancing their learning capability through a substantial increase in trainable parameters within their models. An increased model complexity will incur high computational costs and large memory requirements unsuitable for real-time implementation on standard clinical workstations, as clinical imaging systems typically have low-end computer hardware with limited memory and CPU resources only. This paper presents a compact convolutional neural network (CAN3D) designed specifically for clinical workstations and allows the segmentation of large 3D Magnetic Resonance (MR) images in real-time. The proposed CAN3D has a shallow memory footprint to reduce the number of model parameters and computer memory required for state-of-the-art performance and maintain data integrity by directly processing large full-size 3D image input volumes with no patches required. The proposed architecture significantly reduces computational costs, especially for inference using the CPU. We also develop a novel loss function with extra shape constraints to improve segmentation accuracy for imbalanced classes in 3D MR images. Compared to state-of-the-art approaches (U-Net3D, improved U-Net3D and V-Net), CAN3D reduced the number of parameters up to two orders of magnitude and achieved much faster inference, up to 5 times when predicting with a standard commercial CPU (instead of GPU). For the open-access OAI-ZIB knee MR dataset, in comparison with manual segmentation, CAN3D achieved Dice coefficient values of (mean = 0.87 ± 0.02 and 0.85 ± 0.04) with mean surface distance errors (mean = 0.36 ± 0.32 mm and 0.29 ± 0.10 mm) for imbalanced classes such as (femoral and tibial) cartilage volumes respectively when training volume-wise under only 12G video memory. Similarly, CAN3D demonstrated high accuracy and efficiency on a pelvis 3D MR imaging dataset for prostate cancer consisting of 211 examinations with expert manual semantic labels (bladder, body, bone, rectum, prostate) now released publicly for scientific use as part of this work.

Research on Segmentation of Brain Tumor in MRI Image Based on Convolutional Neural Network

Brain tumors are the brain diseases with the highest mortality and prevalence, and magnetic resonance imaging has high-resolution and multiparameter. As the basis for realizing the quantitative analysis of brain tumors, automatic segmentation plays a vital role in diagnosis and treatment. A new network model is proposed to improve the accuracy of convolutional neural network segmentation of brain tumor regions and control the parameter space scale of the network model. The model first uses a convolutional layer composed of a series of 3D convolution filters to construct a backbone network for feature learning of input 3D MRI image blocks. Then, a pyramid structure constructed by a 3D convolutional layer is designed to extract and fuse features of tumor lesions and context information of different scales and then classify the fused feature at the voxel level to obtain segmentation results. Finally, a conditional random field is used to postprocess segmentation results for structured refinement. By designing massive ablation experiments to analyze the sensitivity of the essential modules of the comparison network, the results confirm that our method can better solve the problems faced by the traditional fully connected convolutional neural network.

Research and Analysis of Brain Glioma Imaging Based on Deep Learning

The incidence of glioma is increasing year by year, seriously endangering people's health. Magnetic resonance imaging (MRI) can effectively provide intracranial images of brain tumors and provide strong support for the diagnosis and treatment of the disease. Accurate segmentation of brain glioma has positive significance in medicine. However, due to the strong variability of the size, shape, and location of glioma and the large differences between different cases, the recognition and segmentation of glioma images are very difficult. Traditional methods are time-consuming, labor-intensive, and inefficient, and single-modal MRI images cannot provide comprehensive information about gliomas. Therefore, it is necessary to synthesize multimodal MRI images to identify and segment glioma MRI images. This work is based on multimodal MRI images and based on deep learning technology to achieve automatic and efficient segmentation of gliomas. The main tasks are as follows. A deep learning model based on dense blocks of holes, 3D U-Net, is proposed. It can automatically segment multimodal MRI glioma images. U-Net network is often used in image segmentation and has good performance. However, due to the strong specificity of glioma, the U-Net model cannot effectively obtain more details. Therefore, the 3D U-Net model proposed in this paper can integrate hollow convolution and densely connected blocks. In addition, this paper also combines classification loss and cross-entropy loss as the loss function of the network to improve the problem of category imbalance in glioma image segmentation tasks. The algorithm proposed in this paper has been used to perform a lot of experiments on the BraTS2018 dataset, and the results prove that this model has good segmentation performance.