1
|
Zhan Y, Hao Y, Wang X, Guo D. Advances of artificial intelligence in clinical application and scientific research of neuro-oncology: Current knowledge and future perspectives. Crit Rev Oncol Hematol 2025; 209:104682. [PMID: 40032186 DOI: 10.1016/j.critrevonc.2025.104682] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2024] [Revised: 02/16/2025] [Accepted: 02/25/2025] [Indexed: 03/05/2025] Open
Abstract
Brain tumors refer to the abnormal growths that occur within the brain's tissue, comprising both primary neoplasms and metastatic lesions. Timely detection, precise staging, suitable treatment, and standardized management are of significant clinical importance for extending the survival rates of brain tumor patients. Artificial intelligence (AI), a discipline within computer science, is leveraging its robust capacity for information identification and combination to revolutionize traditional paradigms of oncology care, offering substantial potential for precision medicine. This article provides an overview of the current applications of AI in brain tumors, encompassing the primary AI technologies, their working mechanisms and working workflow, the contributions of AI to brain tumor diagnosis and treatment, as well as the role of AI in brain tumor scientific research, particularly in drug innovation and revealing tumor microenvironment. Finally, the paper addresses the existing challenges, potential solutions, and the future application prospects. This review aims to enhance our understanding of the application of AI in brain tumors and provide valuable insights for forthcoming clinical applications and scientific inquiries.
Collapse
Affiliation(s)
- Yankun Zhan
- First People's Hospital of Linping District; Linping Campus, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, 311100, China
| | - Yanying Hao
- First People's Hospital of Linping District; Linping Campus, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, 311100, China
| | - Xiang Wang
- First People's Hospital of Linping District; Linping Campus, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, 311100, China.
| | - Duancheng Guo
- Cancer Institute, Fudan University Shanghai Cancer Center; Department of Oncology, Shanghai Medical College, Fudan University, Shanghai 200032, China.
| |
Collapse
|
2
|
Gunasundari C, Selva Bhuvaneswari K. Machine learning fusion for glioma tumor detection. Sci Rep 2025; 15:11236. [PMID: 40175410 PMCID: PMC11965284 DOI: 10.1038/s41598-025-89911-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2024] [Accepted: 02/10/2025] [Indexed: 04/04/2025] Open
Abstract
The early detection of brain tumors is very important for treating them and improving the quality of life for patients. Through advanced imaging techniques, doctors can now make more informed decisions. This paper introduces a framework for a tumor detection system capable of grading gliomas. The system's implementation begins with the acquisition and analysis of brain magnetic resonance images. Key features indicative of tumors and gliomas are extracted and classified as independent components. A deep learning model is then employed to categorize these gliomas. The proposed model classifies gliomas into three primary categories: meningioma, pituitary, and glioma. Performance evaluation demonstrates a high level of accuracy (99.21%), specificity (98.3%), and sensitivity (97.83%). Further research and validation are essential to refine the system and ensure its clinical applicability. The development of accurate and efficient tumor detection systems holds significant promise for enhancing patient care and improving survival rates.
Collapse
Affiliation(s)
- C Gunasundari
- SRM Institute of Science and Technology, Tiruchirappalli, India.
| | - K Selva Bhuvaneswari
- Department of Computer Science & Engineering, University College of Engineering Kancheepuram, Kanchipuram, India
| |
Collapse
|
3
|
Pande SD, Ahammad SH, Madhav BTP, Ramya KR, Smirani LK, Hossain MA, Rashed ANZ. Assessment of brain tumor detection techniques and recommendation of neural network. BIOMED ENG-BIOMED TE 2024; 69:395-406. [PMID: 38285486 DOI: 10.1515/bmt-2022-0336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Accepted: 01/05/2024] [Indexed: 01/30/2024]
Abstract
OBJECTIVES Brain tumor classification is amongst the most complex and challenging jobs in the computer domain. The latest advances in brain tumor detection systems (BTDS) are presented as they can inspire new researchers to deliver new architectures for effective and efficient tumor detection. Here, the data of the multi-modal brain tumor segmentation task is employed, which has been registered, skull stripped, and histogram matching is conducted with the ferrous volume of high contrast. METHODS This research further configures a capsule network (CapsNet) for brain tumor classification. Results of the latest deep neural network (NN) architectures for tumor detection are compared and presented. The VGG16 and CapsNet architectures yield the highest f1-score and precision values, followed by VGG19. Overall, ResNet152, MobileNet, and MobileNetV2 give us the lowest f1-score. RESULTS The VGG16 and CapsNet have produced outstanding results. However, VGG16 and VGG19 are more profound architecture, resulting in slower computation speed. The research then recommends the latest suitable NN for effective brain tumor detection. CONCLUSIONS Finally, the work concludes with future directions and potential new architectures for tumor detection.
Collapse
Affiliation(s)
| | - Shaik Hasane Ahammad
- Department of ECE, Koneru Lakshmaiah Education Foundation, Vaddeswaram, Andhra Pradesh, India
| | | | - Kalangi Ruth Ramya
- Department of Computer Engineering, Indira College of Engineering and Management, Pune, MH, India
| | - Lassaad K Smirani
- Deanship of Information Technology, Umm Al-Qura University, Makkah, Saudi Arabia
| | - Md Amzad Hossain
- Department of Electrical and Electronic Engineering, Jashore University of Science and Technology, Jashore, Bangladesh
| | - Ahmed Nabih Zaki Rashed
- Electronics and Electrical Communications Engineering Department, Faculty of Electronic Engineering, Menoufia University, Menouf, Egypt
- Department of VLSI Microelectronics, Institute of Electronics and Communication Engineering, Saveetha School of Engineering, SIMATS, Chennai, Tamilnadu, India
| |
Collapse
|
4
|
Batool A, Byun YC. Brain tumor detection with integrating traditional and computational intelligence approaches across diverse imaging modalities - Challenges and future directions. Comput Biol Med 2024; 175:108412. [PMID: 38691914 DOI: 10.1016/j.compbiomed.2024.108412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Revised: 03/18/2024] [Accepted: 04/02/2024] [Indexed: 05/03/2024]
Abstract
Brain tumor segmentation and classification play a crucial role in the diagnosis and treatment planning of brain tumors. Accurate and efficient methods for identifying tumor regions and classifying different tumor types are essential for guiding medical interventions. This study comprehensively reviews brain tumor segmentation and classification techniques, exploring various approaches based on image processing, machine learning, and deep learning. Furthermore, our study aims to review existing methodologies, discuss their advantages and limitations, and highlight recent advancements in this field. The impact of existing segmentation and classification techniques for automated brain tumor detection is also critically examined using various open-source datasets of Magnetic Resonance Images (MRI) of different modalities. Moreover, our proposed study highlights the challenges related to segmentation and classification techniques and datasets having various MRI modalities to enable researchers to develop innovative and robust solutions for automated brain tumor detection. The results of this study contribute to the development of automated and robust solutions for analyzing brain tumors, ultimately aiding medical professionals in making informed decisions and providing better patient care.
Collapse
Affiliation(s)
- Amreen Batool
- Department of Electronic Engineering, Institute of Information Science & Technology, Jeju National University, Jeju, 63243, South Korea
| | - Yung-Cheol Byun
- Department of Computer Engineering, Major of Electronic Engineering, Jeju National University, Institute of Information Science Technology, Jeju, 63243, South Korea.
| |
Collapse
|
5
|
Zaman A, Hassan H, Zeng X, Khan R, Lu J, Yang H, Miao X, Cao A, Yang Y, Huang B, Guo Y, Kang Y. Adaptive Feature Medical Segmentation Network: an adaptable deep learning paradigm for high-performance 3D brain lesion segmentation in medical imaging. Front Neurosci 2024; 18:1363930. [PMID: 38680446 PMCID: PMC11047127 DOI: 10.3389/fnins.2024.1363930] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Accepted: 03/04/2024] [Indexed: 05/01/2024] Open
Abstract
Introduction In neurological diagnostics, accurate detection and segmentation of brain lesions is crucial. Identifying these lesions is challenging due to its complex morphology, especially when using traditional methods. Conventional methods are either computationally demanding with a marginal impact/enhancement or sacrifice fine details for computational efficiency. Therefore, balancing performance and precision in compute-intensive medical imaging remains a hot research topic. Methods We introduce a novel encoder-decoder network architecture named the Adaptive Feature Medical Segmentation Network (AFMS-Net) with two encoder variants: the Single Adaptive Encoder Block (SAEB) and the Dual Adaptive Encoder Block (DAEB). A squeeze-and-excite mechanism is employed in SAEB to identify significant data while disregarding peripheral details. This approach is best suited for scenarios requiring quick and efficient segmentation, with an emphasis on identifying key lesion areas. In contrast, the DAEB utilizes an advanced channel spatial attention strategy for fine-grained delineation and multiple-class classifications. Additionally, both architectures incorporate a Segmentation Path (SegPath) module between the encoder and decoder, refining segmentation, enhancing feature extraction, and improving model performance and stability. Results AFMS-Net demonstrates exceptional performance across several notable datasets, including BRATs 2021, ATLAS 2021, and ISLES 2022. Its design aims to construct a lightweight architecture capable of handling complex segmentation challenges with high precision. Discussion The proposed AFMS-Net addresses the critical balance issue between performance and computational efficiency in the segmentation of brain lesions. By introducing two tailored encoder variants, the network adapts to varying requirements of speed and feature. This approach not only advances the state-of-the-art in lesion segmentation but also provides a scalable framework for future research in medical image processing.
Collapse
Affiliation(s)
- Asim Zaman
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, China
- School of Applied Technology, Shenzhen University, Shenzhen, China
- Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen, China
| | - Haseeb Hassan
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, China
| | - Xueqiang Zeng
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, China
- School of Applied Technology, Shenzhen University, Shenzhen, China
| | - Rashid Khan
- School of Applied Technology, Shenzhen University, Shenzhen, China
- Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen, China
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China
| | - Jiaxi Lu
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, China
- School of Applied Technology, Shenzhen University, Shenzhen, China
| | - Huihui Yang
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, China
- School of Applied Technology, Shenzhen University, Shenzhen, China
| | - Xiaoqiang Miao
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, China
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
| | - Anbo Cao
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, China
- School of Applied Technology, Shenzhen University, Shenzhen, China
| | - Yingjian Yang
- Shenzhen Lanmage Medical Technology Co., Ltd, Shenzhen, China
| | - Bingding Huang
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China
| | - Yingwei Guo
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, China
- School of Electrical and Information Engineering, Northeast Petroleum University, Daqing, China
| | - Yan Kang
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, China
- School of Applied Technology, Shenzhen University, Shenzhen, China
- Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen, China
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
| |
Collapse
|
6
|
Di Ieva A. Computational Fractal-Based Analysis of MR Susceptibility-Weighted Imaging (SWI) in Neuro-Oncology and Neurotraumatology. ADVANCES IN NEUROBIOLOGY 2024; 36:445-468. [PMID: 38468047 DOI: 10.1007/978-3-031-47606-8_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/13/2024]
Abstract
Susceptibility-weighted imaging (SWI) is a magnetic resonance imaging (MRI) technique able to depict the magnetic susceptibility produced by different substances, such as deoxyhemoglobin, calcium, and iron. The main application of SWI in clinical neuroimaging is detecting microbleedings and venous vasculature. Quantitative analyses of SWI have been developed over the last few years, aimed to offer new parameters, which could be used as neuroimaging biomarkers. Each technique has shown pros and cons, but no gold standard exists yet. The fractal dimension (FD) has been investigated as a novel potential objective parameter for monitoring intratumoral space-filling properties of SWI patterns. We showed that SWI patterns found in different tumors or different glioma grades can be represented by a gradient in the fractal dimension, thereby enabling each tumor to be assigned a specific SWI fingerprint. Such results were especially relevant in the differentiation of low-grade versus high-grade gliomas, as well as from high-grade gliomas versus lymphomas.Therefore, FD has been suggested as a potential image biomarker to analyze intrinsic neoplastic architecture in order to improve the differential diagnosis within clinical neuroimaging, determine appropriate therapy, and improve outcome in patients.These promising preliminary findings could be extended into the field of neurotraumatology, by means of the application of computational fractal-based analysis for the qualitative and quantitative imaging of microbleedings in traumatic brain injury patients. In consideration of some evidences showing that SWI signals are correlated with trauma clinical severity, FD might offer some objective prognostic biomarkers.In conclusion, fractal-based morphometrics of SWI could be further investigated to be used in a complementary way with other techniques, in order to form a holistic understanding of the temporal evolution of brain tumors and follow-up response to treatment, with several further applications in other fields, such as neurotraumatology and cerebrovascular neurosurgery as well.
Collapse
Affiliation(s)
- Antonio Di Ieva
- Computational NeuroSurgery (CNS) Lab & Macquarie Neurosurgery, Macquarie Medical School, Faculty of Medicine, Human and Health Sciences, Macquarie University, Sydney, NSW, Australia.
| |
Collapse
|
7
|
Livi L. On Multiscaling of Parkinsonian Rest Tremor Signals and Their Classification. ADVANCES IN NEUROBIOLOGY 2024; 36:571-583. [PMID: 38468054 DOI: 10.1007/978-3-031-47606-8_30] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/13/2024]
Abstract
Self-similar stochastic processes and broad probability distributions are ubiquitous in nature and in many man-made systems. The brain is a particularly interesting example of (natural) complex system where those features play a pivotal role. In fact, the controversial yet experimentally validated "criticality hypothesis" explaining the functioning of the brain implies the presence of scaling laws for correlations. Recently, we have analyzed a collection of rest tremor velocity signals recorded from patients affected by Parkinson's disease, with the aim of determining and hence exploiting the presence of scaling laws. Our results show that multiple scaling laws are required in order to describe the dynamics of such signals, stressing the complexity of the underlying generating mechanism. We successively extracted numeric features by using the multifractal detrended fluctuation analysis procedure. We found that such features can be effective for discriminating classes of signals recorded in different experimental conditions. Notably, we show that the use of medication (L-DOPA) can be recognized with high accuracy.
Collapse
Affiliation(s)
- Lorenzo Livi
- Department of Computer Science, University of Manitoba, Winnipeg, MB, Canada.
| |
Collapse
|
8
|
Sánchez J, Martín-Landrove M. Multifractal Analysis of Brain Tumor Interface in Glioblastoma. ADVANCES IN NEUROBIOLOGY 2024; 36:487-499. [PMID: 38468049 DOI: 10.1007/978-3-031-47606-8_25] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/13/2024]
Abstract
The dynamics of tumor growth is a very complex process, generally accompanied by numerous chromosomal aberrations that determine its genetic and dynamical heterogeneity. Consequently, the tumor interface exhibits a non-regular and heterogeneous behavior often described by a single fractal dimension. A more suitable approach is to consider the tumor interface as a multifractal object that can be described by a set of generalized fractal dimensions. In the present work, detrended fluctuation and multifractal analysis are used to characterize the complexity of glioblastoma.
Collapse
Affiliation(s)
- Jacksson Sánchez
- Faculty of Science and Technology, Physics Department, Universidad Nacional Pedro Henríquez Ureña, Santo Domingo, Dominican Republic
| | - Miguel Martín-Landrove
- Centre for Medical Visualization, National Institute for Bioengineering, INABIO, Universidad Central de Venezuela and Centro de Diagnóstico Docente Las Mercedes, Caracas, Venezuela.
| |
Collapse
|
9
|
Reza SMS, Islam A, Iftekharuddin KM. Texture Estimation for Abnormal Tissue Segmentation in Brain MRI. ADVANCES IN NEUROBIOLOGY 2024; 36:469-486. [PMID: 38468048 DOI: 10.1007/978-3-031-47606-8_24] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/13/2024]
Abstract
This chapter discusses multifractal texture estimation and characterization of brain lesions (necrosis, edema, enhanced tumor, nonenhanced tumor, etc.) in magnetic resonance (MR) images. This work formulates the complex texture of tumor in MR images using a stochastic model known as multifractional Brownian motion (mBm). Mathematical derivations of the mBm model and corresponding algorithm to extract the spatially varying multifractal texture feature are discussed. Extracted multifractal texture feature is fused with other effective features to enhance the tissue characteristics. Segmentation of the tissues is performed using a feature-based classification method. The efficacy of the mBm texture feature in segmenting different abnormal tissues is demonstrated using a large-scale publicly available clinical dataset. Experimental results and performance of the methods confirm the efficacy of the proposed technique in an automatic segmentation of abnormal tissues in multimodal (T1, T2, Flair, and T1contrast) brain MRIs.
Collapse
Affiliation(s)
- Syed M S Reza
- Department of Electrical and Computer Engineering, Old Dominion University, Norfolk, VA, USA
| | - Atiq Islam
- Applied Research, Ebay Inc, San Jose, CA, USA
| | - Khan M Iftekharuddin
- Department of Electrical and Computer Engineering, Old Dominion University, Norfolk, VA, USA.
| |
Collapse
|
10
|
Kaifi R. A Review of Recent Advances in Brain Tumor Diagnosis Based on AI-Based Classification. Diagnostics (Basel) 2023; 13:3007. [PMID: 37761373 PMCID: PMC10527911 DOI: 10.3390/diagnostics13183007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 09/14/2023] [Accepted: 09/19/2023] [Indexed: 09/29/2023] Open
Abstract
Uncontrolled and fast cell proliferation is the cause of brain tumors. Early cancer detection is vitally important to save many lives. Brain tumors can be divided into several categories depending on the kind, place of origin, pace of development, and stage of progression; as a result, tumor classification is crucial for targeted therapy. Brain tumor segmentation aims to delineate accurately the areas of brain tumors. A specialist with a thorough understanding of brain illnesses is needed to manually identify the proper type of brain tumor. Additionally, processing many images takes time and is tiresome. Therefore, automatic segmentation and classification techniques are required to speed up and enhance the diagnosis of brain tumors. Tumors can be quickly and safely detected by brain scans using imaging modalities, including computed tomography (CT), magnetic resonance imaging (MRI), and others. Machine learning (ML) and artificial intelligence (AI) have shown promise in developing algorithms that aid in automatic classification and segmentation utilizing various imaging modalities. The right segmentation method must be used to precisely classify patients with brain tumors to enhance diagnosis and treatment. This review describes multiple types of brain tumors, publicly accessible datasets, enhancement methods, segmentation, feature extraction, classification, machine learning techniques, deep learning, and learning through a transfer to study brain tumors. In this study, we attempted to synthesize brain cancer imaging modalities with automatically computer-assisted methodologies for brain cancer characterization in ML and DL frameworks. Finding the current problems with the engineering methodologies currently in use and predicting a future paradigm are other goals of this article.
Collapse
Affiliation(s)
- Reham Kaifi
- Department of Radiological Sciences, College of Applied Medical Sciences, King Saud bin Abdulaziz University for Health Sciences, Jeddah City 22384, Saudi Arabia;
- King Abdullah International Medical Research Center, Jeddah City 22384, Saudi Arabia
- Medical Imaging Department, Ministry of the National Guard—Health Affairs, Jeddah City 11426, Saudi Arabia
| |
Collapse
|
11
|
Berkley A, Saueressig C, Shukla U, Chowdhury I, Munoz-Gauna A, Shehu O, Singh R, Munbodh R. Clinical capability of modern brain tumor segmentation models. Med Phys 2023; 50:4943-4959. [PMID: 36847185 DOI: 10.1002/mp.16321] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Revised: 10/27/2022] [Accepted: 10/27/2022] [Indexed: 03/01/2023] Open
Abstract
PURPOSE State-of-the-art automated segmentation methods achieve exceptionally high performance on the Brain Tumor Segmentation (BraTS) challenge, a dataset of uniformly processed and standardized magnetic resonance generated images (MRIs) of gliomas. However, a reasonable concern is that these models may not fare well on clinical MRIs that do not belong to the specially curated BraTS dataset. Research using the previous generation of deep learning models indicates significant performance loss on cross-institutional predictions. Here, we evaluate the cross-institutional applicability and generalzsability of state-of-the-art deep learning models on new clinical data. METHODS We train a state-of-the-art 3D U-Net model on the conventional BraTS dataset comprising low- and high-grade gliomas. We then evaluate the performance of this model for automatic tumor segmentation of brain tumors on in-house clinical data. This dataset contains MRIs of different tumor types, resolutions, and standardization than those found in the BraTS dataset. Ground truth segmentations to validate the automated segmentation for in-house clinical data were obtained from expert radiation oncologists. RESULTS We report average Dice scores of 0.764, 0.648, and 0.61 for the whole tumor, tumor core, and enhancing tumor, respectively, in the clinical MRIs. These means are higher than numbers reported previously on same institution and cross-institution datasets of different origin using different methods. There is no statistically significant difference when comparing the dice scores to the inter-annotation variability between two expert clinical radiation oncologists. Although performance on the clinical data is lower than on the BraTS data, these numbers indicate that models trained on the BraTS dataset have impressive segmentation performance on previously unseen images obtained at a separate clinical institution. These images differ in the imaging resolutions, standardization pipelines, and tumor types from the BraTS data. CONCLUSIONS State-of-the-art deep learning models demonstrate promising performance on cross-institutional predictions. They considerably improve on previous models and can transfer knowledge to new types of brain tumors without additional modeling.
Collapse
Affiliation(s)
- Adam Berkley
- Department of Computer Science, Brown University, Providence, Rhode Island, USA
| | - Camillo Saueressig
- Department of Computer Science, Brown University, Providence, Rhode Island, USA
| | - Utkarsh Shukla
- Department of Radiation Oncology, Rhode Island Hospital, Providence, Rhode Island, USA
- The Department of Radiation Oncology at Tufts Medical Center, Boston, Massachusetts, USA
- Department of Radiation Oncology, Warren Alpert Medical School of Brown University, Providence, Rhode Island, USA
| | - Imran Chowdhury
- Department of Radiation Oncology, Rhode Island Hospital, Providence, Rhode Island, USA
- The Department of Radiation Oncology at Tufts Medical Center, Boston, Massachusetts, USA
- Department of Radiation Oncology, Warren Alpert Medical School of Brown University, Providence, Rhode Island, USA
| | - Anthony Munoz-Gauna
- Department of Radiation Oncology, Warren Alpert Medical School of Brown University, Providence, Rhode Island, USA
| | - Olalekan Shehu
- Department of Physics, University of Rhode Island, Kingston, Rhode Island, USA
| | - Ritambhara Singh
- Department of Computer Science, Brown University, Providence, Rhode Island, USA
- Center for Computational Molecular Biology, Brown University, Providence, Rhode Island, USA
| | - Reshma Munbodh
- Department of Radiation Oncology, Warren Alpert Medical School of Brown University, Providence, Rhode Island, USA
- Department of Radiation Oncology, Columbia University Irving Medical Center, New York, New York, USA
| |
Collapse
|
12
|
Rasheed M, Iqbal MW, Jaffar A, Ashraf MU, Almarhabi KA, Alghamdi AM, Bahaddad AA. Recognizing Brain Tumors Using Adaptive Noise Filtering and Statistical Features. Diagnostics (Basel) 2023; 13:diagnostics13081451. [PMID: 37189550 DOI: 10.3390/diagnostics13081451] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 03/29/2023] [Accepted: 04/05/2023] [Indexed: 05/17/2023] Open
Abstract
The human brain, primarily composed of white blood cells, is centered on the neurological system. Incorrectly positioned cells in the immune system, blood vessels, endocrine, glial, axon, and other cancer-causing tissues, can assemble to create a brain tumor. It is currently impossible to find cancer physically and make a diagnosis. The tumor can be found and recognized using the MRI-programmed division method. It takes a powerful segmentation technique to produce accurate output. This study examines a brain MRI scan and uses a technique to obtain a more precise image of the tumor-affected area. The critical aspects of the proposed method are the utilization of noisy MRI brain images, anisotropic noise removal filtering, segmentation with an SVM classifier, and isolation of the adjacent region from the normal morphological processes. Accurate brain MRI imaging is the primary goal of this strategy. The divided section of the cancer is placed on the actual image of a particular culture, but that is by no means the last step. The tumor is located by categorizing the pixel brightness in the filtered image. According to test findings, the SVM could partition data with 98% accuracy.
Collapse
Affiliation(s)
- Mehwish Rasheed
- Department of Computer Science, Superior University, Lahore 54000, Pakistan
| | | | - Arfan Jaffar
- Department of Computer Science, Superior University, Lahore 54000, Pakistan
| | | | - Khalid Ali Almarhabi
- Department of Computer Science, College of Computing in Al-Qunfudah, Umm Al-Qura University, Makkah 24381, Saudi Arabia
| | - Ahmed Mohammed Alghamdi
- Department of Software Engineering, College of Computer Science and Engineering, University of Jeddah, Jeddah 21493, Saudi Arabia
| | - Adel A Bahaddad
- Department of Information System, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| |
Collapse
|
13
|
Li X, Jiang Y, Li M, Zhang J, Yin S, Luo H. MSFR-Net: Multi-modality and single-modality feature recalibration network for brain tumor segmentation. Med Phys 2023; 50:2249-2262. [PMID: 35962724 DOI: 10.1002/mp.15933] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Revised: 05/16/2022] [Accepted: 06/14/2022] [Indexed: 11/11/2022] Open
Abstract
BACKGROUND Accurate and automated brain tumor segmentation from multi-modality MR images plays a significant role in tumor treatment. However, the existing approaches mainly focus on the fusion of multi-modality while ignoring the correlation between single-modality and tumor subcomponents. For example, T2-weighted images show good visualization of edema, and T1-contrast images have a good contrast between enhancing tumor core and necrosis. In the actual clinical process, professional physicians also label tumors according to these characteristics. We design a method for brain tumors segmentation that utilizes both multi-modality fusion and single-modality characteristics. METHODS A multi-modality and single-modality feature recalibration network (MSFR-Net) is proposed for brain tumor segmentation from MR images. Specifically, multi-modality information and single-modality information are assigned to independent pathways. Multi-modality network explicitly learns the relationship between all modalities and all tumor sub-components. Single-modality network learns the relationship between single-modality and its highly correlated tumor subcomponents. Then, a dual recalibration module (DRM) is designed to connect the parallel single-modality network and multi-modality network at multiple stages. The function of the DRM is to unify the two types of features into the same feature space. RESULTS Experiments on BraTS 2015 dataset and BraTS 2018 dataset show that the proposed method is competitive and superior to other state-of-the-art methods. The proposed method achieved the segmentation results with Dice coefficients of 0.86 and Hausdorff distance of 4.82 on BraTS 2018 dataset, with dice coefficients of 0.80, positive predictive value of 0.76, and sensitivity of 0.78 on BraTS 2015 dataset. CONCLUSIONS This work combines the manual labeling process of doctors and introduces the correlation between single-modality and the tumor subcomponents into the segmentation network. The method improves the segmentation performance of brain tumors and can be applied in the clinical practice. The code of the proposed method is available at: https://github.com/xiangQAQ/MSFR-Net.
Collapse
Affiliation(s)
- Xiang Li
- Department of Control Science and Engineering, Harbin Institute of Technology, Harbin, China
| | - Yuchen Jiang
- Department of Control Science and Engineering, Harbin Institute of Technology, Harbin, China
| | - Minglei Li
- Department of Control Science and Engineering, Harbin Institute of Technology, Harbin, China
| | - Jiusi Zhang
- Department of Control Science and Engineering, Harbin Institute of Technology, Harbin, China
| | - Shen Yin
- Department of Mechanical and Industrial Engineering, Faculty of Engineering, Norwegian University of Science and Technology, Trondheim, Norway
| | - Hao Luo
- Department of Control Science and Engineering, Harbin Institute of Technology, Harbin, China
| |
Collapse
|
14
|
Classification of Covid-19 misinformation on social media based on neuro-fuzzy and neural network: A systematic review. Neural Comput Appl 2023; 35:699-717. [PMID: 36159189 PMCID: PMC9488884 DOI: 10.1007/s00521-022-07797-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Accepted: 09/06/2022] [Indexed: 01/11/2023]
Abstract
The spread of Covid-19 misinformation on social media had significant real-world consequences, and it raised fears among internet users since the pandemic has begun. Researchers from all over the world have shown an interest in developing deception classification methods to reduce the issue. Despite numerous obstacles that can thwart the efforts, the researchers aim to create an automated, stable, accurate, and effective mechanism for misinformation classification. In this paper, a systematic literature review is conducted to analyse the state-of-the-art related to the classification of misinformation on social media. IEEE Xplore, SpringerLink, ScienceDirect, Scopus, Taylor & Francis, Wiley, Google Scholar are used as databases to find relevant papers since 2018-2021. Firstly, the study begins by reviewing the history of the issues surrounding Covid-19 misinformation and its effects on social media users. Secondly, various neuro-fuzzy and neural network classification methods are identified. Thirdly, the strength, limitations, and challenges of neuro-fuzzy and neural network approaches are verified for the classification misinformation specially in case of Covid-19. Finally, the most efficient hybrid method of neuro-fuzzy and neural networks in terms of performance accuracy is discovered. This study is wrapped up by suggesting a hybrid ANFIS-DNN model for improving Covid-19 misinformation classification. The results of this study can be served as a roadmap for future research on misinformation classification.
Collapse
|
15
|
Popat M, Patel S. Research perspective and review towards brain tumour segmentation and classification using different image modalities. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING: IMAGING & VISUALIZATION 2022. [DOI: 10.1080/21681163.2022.2124546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Affiliation(s)
- Mayuri Popat
- U & P.U. Patel Department of Computer Engineering, Chandubhai S Patel Institute of Technology (CSPIT), Charotar University of Science and Technology (CHARUSAT), Gujarat, India
| | - Sanskruti Patel
- Smt. Chandaben Mohanbhai Patel Institute of Computer Applications (CMPICA), Charotar University of Science and Technology (CHARUSAT), Gujarat, India
| |
Collapse
|
16
|
IOTEML: An Internet of Things (IoT)-Based Enhanced Machine Learning Model for Tumour Investigation. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:1391340. [PMID: 36156969 PMCID: PMC9492353 DOI: 10.1155/2022/1391340] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/29/2022] [Revised: 08/01/2022] [Accepted: 08/12/2022] [Indexed: 11/17/2022]
Abstract
In the current age of technology, various diseases in the body are also on the rise. Tumours that cause more discomfort in the body are set to increase the discomfort of most patients. Patients experience different effects depending on the tumour size and type. Future developments in the medical field are moving towards the development of tools based on IoT devices. These advances will in the future follow special features designed based on multiple machine learning developed by artificial intelligence. In that order, an improved algorithm named Internet of Things-based enhanced machine learning is proposed in this paper. What makes it special is that it involves separate functions to diagnose each type of tumour. It analyzes and calculates things like the size, shape, and location of the tumour. Cure from cancer is determined by the stage at which we find cancer. Early detection of cancer has the potential to cure quickly. At a saturation point, the proposed Internet of Things-based enhanced machine learning model achieved 94.56% of accuracy, 94.12% of precision, 94.98% of recall, 95.12% of F1-score, and 1856 ms of execution time. The simulation is conducted to test the efficacy of the model, and the results of the simulation show that the proposed Internet of Things-based enhanced machine learning obtains a higher rate of intelligence than other methods.
Collapse
|
17
|
Mazumdar I, Mukherjee J. Fully automatic MRI brain tumor segmentation using efficient spatial attention convolutional networks with composite loss. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.05.050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
18
|
Sriram A, Sekhar Reddy G, Anand Babu GL, Bachanna P, Gurpreet SC, Moyal V, Shubhangi DC, Sahu AK, Bhonsle D, Madana Mohana R, Srihari K, Chamato FA. A Smart Solution for Cancer Patient Monitoring Based on Internet of Medical Things Using Machine Learning Approach. EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE : ECAM 2022; 2022:2056807. [PMID: 35783507 PMCID: PMC9249483 DOI: 10.1155/2022/2056807] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 04/30/2022] [Accepted: 05/04/2022] [Indexed: 11/18/2022]
Abstract
The Internet of Medical Things (IoMT) is a huge, exciting new phenomenon that is changing the world of technology and innovating various industries, including healthcare. It has specific applications and changes in the medical world based on what can be done for clinical workflow models. The first and most fundamental thing that IoMT does in healthcare is to bring a flood of new data into medical processes. In this study, an efficient Internet of Medical Things based cancer detection model was proposed. In fact, for many, new fitness monitors and watches are one of the best examples on the Internet; these mobile, portable, wearable devices can record real-time heart rate, blood pressure, and eye movement of cancer patients. These details are sent to doctors or anywhere else. The proposed method leads to a kind of big data renaissance in the health service. The proposed model gets more accuracy while comparing with the existing models. This will help the doctors to analyze the patients' health report and provides better treatment.
Collapse
Affiliation(s)
- Arram Sriram
- IT Department, Anurag University, Hyderabad, India
| | | | - G. L. Anand Babu
- Department of Information Technology, Anurag University, Hyderabad, India
| | - Prashant Bachanna
- Department of ECE, Institute of Aeronautical Engineering, Dundigal, Hyderabad, India
| | - Singh Chhabra Gurpreet
- Department of CSE, GITAM Institute of Technology, GITAM (Deemed to be University), Visakhapatnam, AP, India
| | - Vishal Moyal
- SVKM's Institute of Technology, Dhule, MS 424001, India
| | - D. C. Shubhangi
- Department of Computer Science and Engineering, Visvesvaraya Technological University (VTU), Center for PG Studies, Kalaburagi 585105, Karnataka, India
| | - Anil Kumar Sahu
- Bharat Institute of Engineering and Technology, Hyderabad, Telangana 501510, India
| | - Devanand Bhonsle
- Shri Shankaracharya Technical Campus, Bhilai, Chhattisgarh 490020, India
| | - R. Madana Mohana
- Department of Computer Science and Engineering, Bharat Institute of Engineering and Technology, Ibrahimpatnam, Hyderabad 501510, Telangana, India
| | | | - Fekadu Ashine Chamato
- Department of Chemical Engineering, College of Biological and Chemical Engineering, Addis Ababa Science and Technology University, Addis Ababa, Ethiopia
| |
Collapse
|
19
|
A Generalization of Multifractional Brownian Motion. FRACTAL AND FRACTIONAL 2022. [DOI: 10.3390/fractalfract6020074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In this article, some properties of multifractional Brownian motion (MFBM) are discussed. It is shown that it has persistence of signs long range dependence (LRD) and persistence of magnitudes LRD properties. A generalization called here nth order multifractional Brownian motion (n-MFBM) that allows to take the functional parameter H(t) values in the range (n−1,n) is discussed. Two representations of the n-MFBM are given and their relationship with each other is obtained.
Collapse
|
20
|
A Hybrid CNN-GLCM Classifier For Detection And Grade Classification Of Brain Tumor. Brain Imaging Behav 2022; 16:1410-1427. [PMID: 35048264 DOI: 10.1007/s11682-021-00598-2] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/02/2021] [Indexed: 11/02/2022]
Abstract
A supervised CNN Deep net classifier is proposed for the detection, classification and diagnosis of meningioma brain tumor using deep learning approach. This proposed method includes preprocessing, classification, and segmentation of the primary occurring brain tumor in adults. The proposed CNN Deep Net classifier extracts the features internally from the enhanced image and classifies them into normal and abnormal tumor images. The segmentation of tumor region is performed by global thresholding along with an area morphological function. This proposed method of fully automated classification and segmentation of brain tumor preserves the spatial invariance and inheritance. Furthermore, based on its feature attributes the proposed CNN Deep net classifier, classifies the detected tumor image either as (low grade) benign or (high grade) malignant. This proposed CNN Deep net classification approach with grading system is evaluated both quantitatively and qualitatively. The quantitative measures such as sensitivity, specificity, accuracy, Dice similarity coefficient, precision, F-score of the proposed classifier states a better segmentation accuracy and classification rate of 99.4% and 99.5% with respect to ground truth images.
Collapse
|
21
|
Allahverdy A, Zare-Sadeghi A, Kalantari R, Moqadam R, Loghmani N, Shiran M. Brain tumor segmentation using hierarchical combination of fuzzy logic and cellular automata. JOURNAL OF MEDICAL SIGNALS & SENSORS 2022; 12:263-268. [PMID: 36120403 PMCID: PMC9480508 DOI: 10.4103/jmss.jmss_128_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2021] [Revised: 10/30/2021] [Accepted: 01/01/2022] [Indexed: 11/25/2022]
Abstract
Background: Magnetic resonance (MR) image is one of the most important diagnostic tools for brain tumor detection. Segmentation of glioma tumor region in brain MR images is challenging in medical image processing problems. Precise and reliable segmentation algorithms can be significantly helpful in the diagnosis and treatment planning. Methods: In this article, a novel brain tumor segmentation method is introduced as a postsegmentation module, which uses the primary segmentation method's output as input and makes the segmentation performance values better. This approach is a combination of fuzzy logic and cellular automata (CA). Results: The BraTS online dataset has been used for implementing the proposed method. In the first step, the intensity of each pixel is fed to a fuzzy system to label each pixel, and at the second step, the label of each pixel is fed to a fuzzy CA to make the performance of segmentation better. This step repeated while the performance saturated. The accuracy of the first step was 85.8%, but the accuracy of segmentation after using fuzzy CA was obtained to 99.8%. Conclusion: The practical results have shown that our proposed method could improve the brain tumor segmentation in MR images significantly in comparison with other approaches.
Collapse
|
22
|
Low-Altitude Aerial Video Surveillance via One-Class SVM Anomaly Detection from Textural Features in UAV Images. INFORMATION 2021. [DOI: 10.3390/info13010002] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023] Open
Abstract
In recent years, small-scale Unmanned Aerial Vehicles (UAVs) have been used in many video surveillance applications, such as vehicle tracking, border control, dangerous object detection, and many others. Anomaly detection can represent a prerequisite of many of these applications thanks to its ability to identify areas and/or objects of interest without knowing them a priori. In this paper, a One-Class Support Vector Machine (OC-SVM) anomaly detector based on customized Haralick textural features for aerial video surveillance at low-altitude is presented. The use of a One-Class SVM, which is notoriously a lightweight and fast classifier, enables the implementation of real-time systems even when these are embedded in low-computational small-scale UAVs. At the same time, the use of textural features allows a vision-based system to detect micro and macro structures of an analyzed surface, thus allowing the identification of small and large anomalies, respectively. The latter aspect plays a key role in aerial video surveillance at low-altitude, i.e., 6 to 15 m, where the detection of common items, e.g., cars, is as important as the detection of little and undefined objects, e.g., Improvised Explosive Devices (IEDs). Experiments obtained on the UAV Mosaicking and Change Detection (UMCD) dataset show the effectiveness of the proposed system in terms of accuracy, precision, recall, and F1-score, where the model achieves a 100% precision, i.e., never misses an anomaly, but at the expense of a reasonable trade-off in its recall, which still manages to reach up to a 71.23% score. Moreover, when compared to classical Haralick textural features, the model obtains significantly higher performances, i.e., ≈20% on all metrics, further demonstrating the approach effectiveness.
Collapse
|
23
|
Abstract
AbstractBrain tumor occurs owing to uncontrolled and rapid growth of cells. If not treated at an initial phase, it may lead to death. Despite many significant efforts and promising outcomes in this domain, accurate segmentation and classification remain a challenging task. A major challenge for brain tumor detection arises from the variations in tumor location, shape, and size. The objective of this survey is to deliver a comprehensive literature on brain tumor detection through magnetic resonance imaging to help the researchers. This survey covered the anatomy of brain tumors, publicly available datasets, enhancement techniques, segmentation, feature extraction, classification, and deep learning, transfer learning and quantum machine learning for brain tumors analysis. Finally, this survey provides all important literature for the detection of brain tumors with their advantages, limitations, developments, and future trends.
Collapse
|
24
|
Wang H, Hu J, Song Y, Zhang L, Bai S, Yi Z. Multi-view fusion segmentation for brain glioma on CT images. APPL INTELL 2021. [DOI: 10.1007/s10489-021-02784-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
|
25
|
Roy S, Maji P. Multispectral co-occurrence of wavelet coefficients for malignancy assessment of brain tumors. PLoS One 2021; 16:e0250964. [PMID: 34138852 PMCID: PMC8211259 DOI: 10.1371/journal.pone.0250964] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Accepted: 04/18/2021] [Indexed: 11/25/2022] Open
Abstract
Brain tumor is not most common, but truculent type of cancer. Therefore, correct prediction of its aggressiveness nature at an early stage would influence the treatment strategy. Although several diagnostic methods based on different modalities exist, a pre-operative method for determining tumor malignancy state still remains as an active research area. In this regard, the paper presents a new method for the assessment of tumor grades using conventional MR sequences namely, T1, T1 with contrast enhancement, T2 and FLAIR. The proposed method for tumor gradation is mainly based on feature extraction using multiresolution image analysis and classification using support vector machine. Since the wavelet features of different tumor subregions, obtained from single MR sequence, do not carry equally important information, a wavelet fusion technique is proposed based on the texture information content of each voxel. The concept of texture gradient, used in the proposed algorithm, fuses the wavelet coefficients of the given MR sequences. The feature vector is then derived from the co-occurrence of fused wavelet coefficients. As each wavelet subband contains distinct detail information, a novel concept of multispectral co-occurrence of wavelet coefficients is introduced to capture the spatial correlation among different subbands. It enables to convey more informative features to characterize the tumor type. The effectiveness of the proposed method is analyzed, with respect to six classification performance indices, on BRATS 2012 and BRATS 2014 data sets. The classification accuracy, sensitivity, specificity, positive predictive value, negative predictive value, and area under curve assessed by the ten-fold cross-validation are 91.3%, 96.8%, 66.7%, 92.4%, 88.4%, and 92.0%, respectively, on real brain MR data.
Collapse
Affiliation(s)
- Shaswati Roy
- Department of Information Technology, RCC Institute of Information Technology, Kolkata, West Bengal, India
| | - Pradipta Maji
- Biomedical Imaging and Bioinformatics Lab, Machine Intelligence Unit, Indian Statistical Institute, Kolkata, West Bengal, India
| |
Collapse
|
26
|
Wang Y, Wan Q, Xia X, Hu J, Liao Y, Wang P, Peng Y, Liu H, Li X. Value of radiomics model based on multi-parametric magnetic resonance imaging in predicting epidermal growth factor receptor mutation status in patients with lung adenocarcinoma. J Thorac Dis 2021; 13:3497-3508. [PMID: 34277045 PMCID: PMC8264682 DOI: 10.21037/jtd-20-3358] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2020] [Accepted: 04/02/2021] [Indexed: 11/25/2022]
Abstract
BACKGROUND The epidermal growth factor receptor (EGFR) is an important therapeutic target for patients with non-small-cell lung cancer (NSCLC). Radiomics and radiogenomics have emerged as attractive research topics aiming to extract mineable high-dimensional features from medical images and show potential to correlate with the gene mutation. Herein, we aim to develop a magnetic resonance imaging (MRI)-based radiomics model for pretreatment prediction of the EGFR status in patients with lung adenocarcinoma. METHODS A total of 92 patients with pathologically confirmed lung adenocarcinoma were retrospectively enrolled in this study. EGFR genotype was analyzed by sequence testing. All patients were randomized into training and test group in a 7:3 ratio using the R software. Radiomics features were extracted from T2 weighted imaging (T2WI), diffusion-weighted imaging (DWI), and apparent diffusion coefficient (ADC); radiomics signatures were built using the least absolute shrinkage and selection operator (LASSO) and logistic regression. Preoperative clinical factors and image features associated with EGFR were also evaluated. A nomogram including sex, smoking status, and radiomics signatures was constructed. A total of five radiomics models were built, and the area under the curve (AUC) was used to evaluate their performance of EGFR mutation prediction. RESULTS Among the three single-sequence models, the ADC model showed the best prediction performance. The AUCs of the ADC, DWI, T2WI prediction model in the test cohort were 0.805 (95% CI: 0.610 to 1.000), 0.722 (95% CI: 0.519 to 0.924), and 0.655 (95% CI: 0.438 to 0.872), respectively. Compared with the single-sequence model, the multi-sequence prediction model showed better performed [AUCtest =0.838 (95% CI: 0.685 to 0.992)]. The AUC of the nomogram in the training group was 0.925 (95% CI: 0.855 to 0.994) and 0.727 (95% CI: 0.531 to 0.924) in the test group, respectively. CONCLUSIONS The radiomics model based on MRI might have the potential to predict EGFR mutation in patients with lung adenocarcinoma. The multi-sequence model had better performance than other models.
Collapse
Affiliation(s)
- Yuze Wang
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Qi Wan
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Xiaoying Xia
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Jianfeng Hu
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | | | - Peng Wang
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Yu Peng
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Hongyan Liu
- The Sixth Affiliated Hospital of Guangzhou Medical University, Qingyuan People’s Hospital, Qingyuan, China
| | - Xinchun Li
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| |
Collapse
|
27
|
Gryska E, Schneiderman J, Björkman-Burtscher I, Heckemann RA. Automatic brain lesion segmentation on standard magnetic resonance images: a scoping review. BMJ Open 2021; 11:e042660. [PMID: 33514580 PMCID: PMC7849889 DOI: 10.1136/bmjopen-2020-042660] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/11/2020] [Revised: 01/09/2021] [Accepted: 01/12/2021] [Indexed: 12/11/2022] Open
Abstract
OBJECTIVES Medical image analysis practices face challenges that can potentially be addressed with algorithm-based segmentation tools. In this study, we map the field of automatic MR brain lesion segmentation to understand the clinical applicability of prevalent methods and study designs, as well as challenges and limitations in the field. DESIGN Scoping review. SETTING Three databases (PubMed, IEEE Xplore and Scopus) were searched with tailored queries. Studies were included based on predefined criteria. Emerging themes during consecutive title, abstract, methods and whole-text screening were identified. The full-text analysis focused on materials, preprocessing, performance evaluation and comparison. RESULTS Out of 2990 unique articles identified through the search, 441 articles met the eligibility criteria, with an estimated growth rate of 10% per year. We present a general overview and trends in the field with regard to publication sources, segmentation principles used and types of lesions. Algorithms are predominantly evaluated by measuring the agreement of segmentation results with a trusted reference. Few articles describe measures of clinical validity. CONCLUSIONS The observed reporting practices leave room for improvement with a view to studying replication, method comparison and clinical applicability. To promote this improvement, we propose a list of recommendations for future studies in the field.
Collapse
Affiliation(s)
- Emilia Gryska
- Medical Radiation Sciences, Goteborgs universitet Institutionen for kliniska vetenskaper, Goteborg, Sweden
| | - Justin Schneiderman
- Sektionen för klinisk neurovetenskap, Goteborgs Universitet Institutionen for Neurovetenskap och fysiologi, Goteborg, Sweden
| | | | - Rolf A Heckemann
- Medical Radiation Sciences, Goteborgs universitet Institutionen for kliniska vetenskaper, Goteborg, Sweden
| |
Collapse
|
28
|
A Fully Automatic Procedure for Brain Tumor Segmentation from Multi-Spectral MRI Records Using Ensemble Learning and Atlas-Based Data Enhancement. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11020564] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
The accurate and reliable segmentation of gliomas from magnetic resonance image (MRI) data has an important role in diagnosis, intervention planning, and monitoring the tumor’s evolution during and after therapy. Segmentation has serious anatomical obstacles like the great variety of the tumor’s location, size, shape, and appearance and the modified position of normal tissues. Other phenomena like intensity inhomogeneity and the lack of standard intensity scale in MRI data represent further difficulties. This paper proposes a fully automatic brain tumor segmentation procedure that attempts to handle all the above problems. Having its foundations on the MRI data provided by the MICCAI Brain Tumor Segmentation (BraTS) Challenges, the procedure consists of three main phases. The first pre-processing phase prepares the MRI data to be suitable for supervised classification, by attempting to fix missing data, suppressing the intensity inhomogeneity, normalizing the histogram of observed data channels, generating additional morphological, gradient-based, and Gabor-wavelet features, and optionally applying atlas-based data enhancement. The second phase accomplishes the main classification process using ensembles of binary decision trees and provides an initial, intermediary labeling for each pixel of test records. The last phase reevaluates these intermediary labels using a random forest classifier, then deploys a spatial region growing-based structural validation of suspected tumors, thus achieving a high-quality final segmentation result. The accuracy of the procedure is evaluated using the multi-spectral MRI records of the BraTS 2015 and BraTS 2019 training data sets. The procedure achieves high-quality segmentation results, characterized by average Dice similarity scores of up to 86%.
Collapse
|
29
|
Geetha A, Gomathi N. A robust grey wolf-based deep learning for brain tumour detection in MR images. ACTA ACUST UNITED AC 2020; 65:191-207. [DOI: 10.1515/bmt-2018-0244] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2018] [Accepted: 08/06/2019] [Indexed: 11/15/2022]
Abstract
AbstractIn recent times, the detection of brain tumours has become more common. Generally, a brain tumour is an abnormal mass of tissue where the cells grow uncontrollably and are apparently unregulated by the mechanisms that control cells. A number of techniques have been developed thus far; however, the time needed in a detecting brain tumour is still a challenge in the field of image processing. This article proposes a new accurate detection model. The model includes certain processes such as preprocessing, segmentation, feature extraction and classification. Particularly, two extreme processes such as contrast enhancement and skull stripping are processed under the initial phase. In the segmentation process, we used the fuzzy means clustering (FCM) algorithm. Both the grey co-occurrence matrix (GLCM) as well as the grey-level run-length matrix (GRLM) features were extracted in the feature extraction phase. Moreover, this paper uses a deep belief network (DBN) for classification. The optimized DBN concept is used here, for which grey wolf optimisation (GWO) is used. The proposed model is termed the GW-DBN model. The proposed model compares its performance over other conventional methods in terms of accuracy, specificity, sensitivity, precision, negative predictive value (NPV), the F1Score and Matthews correlation coefficient (MCC), false negative rate (FNR), false positive rate (FPR) and false discovery rate (FDR), and proves the superiority of the proposed work.
Collapse
Affiliation(s)
- A. Geetha
- VelTech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Velachery, Chennai 600042, Tamil Nadu, India
| | - N. Gomathi
- VelTech Dr. Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Avadi, Chennai 600062, Tamil Nadu, India
| |
Collapse
|
30
|
[Radiomics models based on non-enhanced MRI can differentiate chondrosarcoma from enchondroma]. NAN FANG YI KE DA XUE XUE BAO = JOURNAL OF SOUTHERN MEDICAL UNIVERSITY 2020; 40:483-490. [PMID: 32895139 PMCID: PMC7225098 DOI: 10.12122/j.issn.1673-4254.2020.04.06] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
OBJECTIVE To develop and validate radiomics models based on non-enhanced magnetic resonance (MR) imaging for differentiating chondrosarcoma from enchondroma. METHODS We retrospectively evaluated a total of 68 patients (including 27 with chondrosarcoma and 41 with enchondroma), who were randomly divided into training group (n=46) and validation group (n=22). Radiomics features were extracted from T1WI and T2WI-FS sequences of the whole tumor by two radiologists independently and selected by Low Variance, Univariate feature selection, and least absolute shrinkage and selection operator (LASSO). Radiomics models were constructed by multivariate logistic regression analysis based on the features from T1WI and T2WI-FS sequences. The receiver-operating characteristics (ROC) curve and intraclass correlation coefficient (ICC) analyses of the radiomics models and conventional MR imaging were performed to determine their diagnostic accuracy. RESULTS The ICC value for interreader agreement of the radiomics features ranged from 0.779 to 0.923, which indicated good agreement. Ten and 11 features were selected from the T1WI and T2WI-FS sequences to construct radiomics models, respectively. The areas under the curve (AUCs) of T1WI and T2WI-FS models were 0.990 and 0.925 in training group and 0.915 and 0.855 in the validation group, respectively, showing no significant differences between the two sequence-based models (P>0.05). In all the cases, the AUCs of the two radiomics models based on T1WI and T2WI-FS sequences and conventional MR imaging were 0.955, 0.901 and 0.569, respectively, demonstrating a significantly higher diagnostic accuracy of the two sequence-based radiomics models than conventional MR imaging (P<0.01). CONCLUSIONS The radiomics models based on T1WI and T2WI-FS non-enhanced MR imaging can be used for the differentiation of chondrosarcoma from enchondroma.
Collapse
|
31
|
Rohini P, Sundar S, Ramakrishnan S. Differentiation of early mild cognitive impairment in brainstem MR images using multifractal detrended moving average singularity spectral features. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2019.101780] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
|
32
|
Shboul ZA, Chen J, M Iftekharuddin K. Prediction of Molecular Mutations in Diffuse Low-Grade Gliomas using MR Imaging Features. Sci Rep 2020; 10:3711. [PMID: 32111869 PMCID: PMC7048831 DOI: 10.1038/s41598-020-60550-0] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2018] [Accepted: 02/12/2020] [Indexed: 11/10/2022] Open
Abstract
Diffuse low-grade gliomas (LGG) have been reclassified based on molecular mutations, which require invasive tumor tissue sampling. Tissue sampling by biopsy may be limited by sampling error, whereas non-invasive imaging can evaluate the entirety of a tumor. This study presents a non-invasive analysis of low-grade gliomas using imaging features based on the updated classification. We introduce molecular (MGMT methylation, IDH mutation, 1p/19q co-deletion, ATRX mutation, and TERT mutations) prediction methods of low-grade gliomas with imaging. Imaging features are extracted from magnetic resonance imaging data and include texture features, fractal and multi-resolution fractal texture features, and volumetric features. Training models include nested leave-one-out cross-validation to select features, train the model, and estimate model performance. The prediction models of MGMT methylation, IDH mutations, 1p/19q co-deletion, ATRX mutation, and TERT mutations achieve a test performance AUC of 0.83 ± 0.04, 0.84 ± 0.03, 0.80 ± 0.04, 0.70 ± 0.09, and 0.82 ± 0.04, respectively. Furthermore, our analysis shows that the fractal features have a significant effect on the predictive performance of MGMT methylation IDH mutations, 1p/19q co-deletion, and ATRX mutations. The performance of our prediction methods indicates the potential of correlating computed imaging features with LGG molecular mutations types and identifies candidates that may be considered potential predictive biomarkers of LGG molecular classification.
Collapse
Affiliation(s)
- Zeina A Shboul
- Vision Lab, Electrical & Computer Engineering, Old Dominion University, Norfolk, VA, USA
| | - James Chen
- University of California San Diego Health System, San Diego, CA, USA
- Department of Radiology, San Diego VA Medical Center, San Diego, CA, USA
| | - Khan M Iftekharuddin
- Vision Lab, Electrical & Computer Engineering, Old Dominion University, Norfolk, VA, USA.
| |
Collapse
|
33
|
Gyorfi A, Kovacs L, Szilagyi L. A Feature Ranking and Selection Algorithm for Brain Tumor Segmentation in Multi-Spectral Magnetic Resonance Image Data .. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:804-807. [PMID: 31946017 DOI: 10.1109/embc.2019.8857794] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Accuracy is the most important quality marker in medical image segmentation. However, when the task is to handle large volumes of data, the relevance of processing speed rises. In machine learning solutions the optimization of the feature set can significantly reduce the computational load. This paper presents a method for feature selection and applies it in the context of a brain tumor detection and segmentation problem in multi-spectral magnetic resonance image data. Starting from an initial set of 104 features involved in an existing ensemble learning solution that employs binary decision trees, a reduced set of features is obtained using a iterative algorithm based on a composite criterion. In each iteration, features are ranked according to the frequency of usage and the correctness of the decisions to which they contribute. Lowest ranked features are iteratively eliminated as long as the segmentation accuracy is not damaged. The final reduced set of 13 features provide the same accuracy in the whole tumor segmentation process as the initial one, but three times faster.
Collapse
|
34
|
Longitudinal brain tumor segmentation prediction in MRI using feature and label fusion. Biomed Signal Process Control 2020; 55:101648. [PMID: 34354762 PMCID: PMC8336640 DOI: 10.1016/j.bspc.2019.101648] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
This work proposes a novel framework for brain tumor segmentation prediction in longitudinal multi-modal MRI scans, comprising two methods; feature fusion and joint label fusion (JLF). The first method fuses stochastic multi-resolution texture features with tumor cell density feature to obtain tumor segmentation predictions in follow-up timepoints using data from baseline pre-operative timepoint. The cell density feature is obtained by solving the 3D reaction-diffusion equation for biophysical tumor growth modelling using the Lattice-Boltzmann method. The second method utilizes JLF to combine segmentation labels obtained from (i) the stochastic texture feature-based and Random Forest (RF)-based tumor segmentation method; and (ii) another state-of-the-art tumor growth and segmentation method, known as boosted Glioma Image Segmentation and Registration (GLISTRboost, or GB). We quantitatively evaluate both proposed methods using the Dice Similarity Coefficient (DSC) in longitudinal scans of 9 patients from the public BraTS 2015 multi-institutional dataset. The evaluation results for the feature-based fusion method show improved tumor segmentation prediction for the whole tumor(DSC WT = 0.314, p = 0.1502), tumor core (DSC TC = 0.332, p = 0.0002), and enhancing tumor (DSC ET = 0.448, p = 0.0002) regions. The feature-based fusion shows some improvement on tumor prediction of longitudinal brain tumor tracking, whereas the JLF offers statistically significant improvement on the actual segmentation of WT and ET (DSC WT = 0.85 ± 0.055, DSC ET = 0.837 ± 0.074), and also improves the results of GB. The novelty of this work is two-fold: (a) exploit tumor cell density as a feature to predict brain tumor segmentation, using a stochastic multi-resolution RF-based method, and (b) improve the performance of another successful tumor segmentation method, GB, by fusing with the RF-based segmentation labels.
Collapse
|
35
|
Sharif M, Amin J, Nisar MW, Anjum MA, Muhammad N, Ali Shad S. A unified patch based method for brain tumor detection using features fusion. COGN SYST RES 2020. [DOI: 10.1016/j.cogsys.2019.10.001] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
36
|
Shboul ZA, Alam M, Vidyaratne L, Pei L, Elbakary MI, Iftekharuddin KM. Feature-Guided Deep Radiomics for Glioblastoma Patient Survival Prediction. Front Neurosci 2019; 13:966. [PMID: 31619949 PMCID: PMC6763591 DOI: 10.3389/fnins.2019.00966] [Citation(s) in RCA: 32] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2019] [Accepted: 08/28/2019] [Indexed: 12/13/2022] Open
Abstract
Glioblastoma is recognized as World Health Organization (WHO) grade IV glioma with an aggressive growth pattern. The current clinical practice in diagnosis and prognosis of Glioblastoma using MRI involves multiple steps including manual tumor sizing. Accurate identification and segmentation of multiple abnormal tissues within tumor volume in MRI is essential for precise survival prediction. Manual tumor and abnormal tissue detection and sizing are tedious, and subject to inter-observer variability. Consequently, this work proposes a fully automated MRI-based glioblastoma and abnormal tissue segmentation, and survival prediction framework. The framework includes radiomics feature-guided deep neural network methods for tumor tissue segmentation; followed by survival regression and classification using these abnormal tumor tissue segments and other relevant clinical features. The proposed multiple abnormal tumor tissue segmentation step effectively fuses feature-based and feature-guided deep radiomics information in structural MRI. The survival prediction step includes two representative survival prediction pipelines that combine different feature selection and regression approaches. The framework is evaluated using two recent widely used benchmark datasets from Brain Tumor Segmentation (BraTS) global challenges in 2017 and 2018. The best overall survival pipeline in the proposed framework achieves leave-one-out cross-validation (LOOCV) accuracy of 0.73 for training datasets and 0.68 for validation datasets, respectively. These training and validation accuracies for tumor patient survival prediction are among the highest reported in literature. Finally, a critical analysis of radiomics features and efficacy of these features in segmentation and survival prediction performance is presented as lessons learned.
Collapse
Affiliation(s)
| | | | | | | | | | - Khan M. Iftekharuddin
- Vision Lab in Department of Electrical and Computer Engineering, Old Dominion University, Norfolk, VA, United States
| |
Collapse
|
37
|
Smitha B, K PJ. Analysis of Carotid Plaque Using Multifractal method in Ultrasound Images. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2019; 2019:943-946. [PMID: 31946049 DOI: 10.1109/embc.2019.8856759] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
This paper analyses the non-linear parameters of the plaque in carotid B-mode ultrasound images. In this work an attempt has been made to differentiate textural features of the symptomatic and asymptomatic plaque by multifractal method. The fractal dimension represents irregularity and hence the fractal nature. The interwoven sets of singularities are characterized by its own scaling behaviour, quantitatively represented as the fractal dimension, explains the multifractal behavior. The multifractal characteristics are plotted using a multifractal formalism proposed by Halsey. Certain multifractal features are extracted namely bandwidth (BW) of the spectrum and singularity exponent peak (SXPpeak). These extracted features have coefficient of variation in the range of 0.1 to 0.3; hence they have lower inter-subject variability. This analysis could aid in the study of the symptomatic and asymptomatic plaques.
Collapse
|
38
|
Abd-Ellah MK, Awad AI, Khalaf AAM, Hamed HFA. A review on brain tumor diagnosis from MRI images: Practical implications, key achievements, and lessons learned. Magn Reson Imaging 2019; 61:300-318. [PMID: 31173851 DOI: 10.1016/j.mri.2019.05.028] [Citation(s) in RCA: 85] [Impact Index Per Article: 14.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2018] [Revised: 05/20/2019] [Accepted: 05/20/2019] [Indexed: 12/21/2022]
Abstract
The successful early diagnosis of brain tumors plays a major role in improving the treatment outcomes and thus improving patient survival. Manually evaluating the numerous magnetic resonance imaging (MRI) images produced routinely in the clinic is a difficult process. Thus, there is a crucial need for computer-aided methods with better accuracy for early tumor diagnosis. Computer-aided brain tumor diagnosis from MRI images consists of tumor detection, segmentation, and classification processes. Over the past few years, many studies have focused on traditional or classical machine learning techniques for brain tumor diagnosis. Recently, interest has developed in using deep learning techniques for diagnosing brain tumors with better accuracy and robustness. This study presents a comprehensive review of traditional machine learning techniques and evolving deep learning techniques for brain tumor diagnosis. This review paper identifies the key achievements reflected in the performance measurement metrics of the applied algorithms in the three diagnosis processes. In addition, this study discusses the key findings and draws attention to the lessons learned as a roadmap for future research.
Collapse
Affiliation(s)
- Mahmoud Khaled Abd-Ellah
- Electronics and Communications Department, Al-Madina Higher Institute for Engineering and Technology, Giza, Egypt.
| | - Ali Ismail Awad
- Department of Computer Science, Electrical and Space Engineering, Luleå University of Technology, Luleå 97187, Sweden; Faculty of Engineering, Al-Azhar University, P.O. Box 83513, Qena, Egypt.
| | - Ashraf A M Khalaf
- Electronics and Communications Department, Faculty of Engineering, Minia University, Minia, Egypt.
| | - Hesham F A Hamed
- Electronics and Communications Department, Faculty of Engineering, Minia University, Minia, Egypt.
| |
Collapse
|
39
|
Agn M, Munck Af Rosenschöld P, Puonti O, Lundemann MJ, Mancini L, Papadaki A, Thust S, Ashburner J, Law I, Van Leemput K. A modality-adaptive method for segmenting brain tumors and organs-at-risk in radiation therapy planning. Med Image Anal 2019; 54:220-237. [PMID: 30952038 PMCID: PMC6554451 DOI: 10.1016/j.media.2019.03.005] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2018] [Revised: 03/14/2019] [Accepted: 03/21/2019] [Indexed: 12/25/2022]
Abstract
In this paper we present a method for simultaneously segmenting brain tumors and an extensive set of organs-at-risk for radiation therapy planning of glioblastomas. The method combines a contrast-adaptive generative model for whole-brain segmentation with a new spatial regularization model of tumor shape using convolutional restricted Boltzmann machines. We demonstrate experimentally that the method is able to adapt to image acquisitions that differ substantially from any available training data, ensuring its applicability across treatment sites; that its tumor segmentation accuracy is comparable to that of the current state of the art; and that it captures most organs-at-risk sufficiently well for radiation therapy planning purposes. The proposed method may be a valuable step towards automating the delineation of brain tumors and organs-at-risk in glioblastoma patients undergoing radiation therapy.
Collapse
Affiliation(s)
- Mikael Agn
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Denmark.
| | - Per Munck Af Rosenschöld
- Radiation Physics, Department of Hematology, Oncology and Radiation Physics, Skåne University Hospital, Lund, Sweden
| | - Oula Puonti
- Danish Research Centre for Magnetic Resonance, Copenhagen University Hospital Hvidovre, Denmark
| | - Michael J Lundemann
- Department of Oncology, Copenhagen University Hospital Rigshospitalet, Denmark
| | - Laura Mancini
- Neuroradiological Academic Unit, Department of Brain Repair and Rehabilitation, UCL Institute of Neurology, University College London, UK; Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, UCLH NHS Foundation Trust, UK
| | - Anastasia Papadaki
- Neuroradiological Academic Unit, Department of Brain Repair and Rehabilitation, UCL Institute of Neurology, University College London, UK; Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, UCLH NHS Foundation Trust, UK
| | - Steffi Thust
- Neuroradiological Academic Unit, Department of Brain Repair and Rehabilitation, UCL Institute of Neurology, University College London, UK; Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery, UCLH NHS Foundation Trust, UK
| | - John Ashburner
- Wellcome Centre for Human Neuroimaging, UCL Institute of Neurology, University College London, UK
| | - Ian Law
- Department of Clinical Physiology, Nuclear Medicine and PET, Copenhagen University Hospital Rigshospitalet, Denmark
| | - Koen Van Leemput
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Denmark; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, USA
| |
Collapse
|
40
|
Reza SMS, Samad MD, Shboul ZA, Jones KA, Iftekharuddin KM. Glioma grading using structural magnetic resonance imaging and molecular data. J Med Imaging (Bellingham) 2019; 6:024501. [PMID: 31037246 PMCID: PMC6479231 DOI: 10.1117/1.jmi.6.2.024501] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2019] [Accepted: 04/01/2019] [Indexed: 11/14/2022] Open
Abstract
A glioma grading method using conventional structural magnetic resonance image (MRI) and molecular data from patients is proposed. The noninvasive grading of glioma tumors is obtained using multiple radiomic texture features including dynamic texture analysis, multifractal detrended fluctuation analysis, and multiresolution fractal Brownian motion in structural MRI. The proposed method is evaluated using two multicenter MRI datasets: (1) the brain tumor segmentation (BRATS-2017) challenge for high-grade versus low-grade (LG) and (2) the cancer imaging archive (TCIA) repository for glioblastoma (GBM) versus LG glioma grading. The grading performance using MRI is compared with that of digital pathology (DP) images in the cancer genome atlas (TCGA) data repository. The results show that the mean area under the receiver operating characteristic curve (AUC) is 0.88 for the BRATS dataset. The classification of tumor grades using MRI and DP images in TCIA/TCGA yields mean AUC of 0.90 and 0.93, respectively. This work further proposes and compares tumor grading performance using molecular alterations (IDH1/2 mutations) along with MRI and DP data, following the most recent World Health Organization grading criteria, respectively. The overall grading performance demonstrates the efficacy of the proposed noninvasive glioma grading approach using structural MRI.
Collapse
Affiliation(s)
- Syed M. S. Reza
- Old Dominion University, Department of Electrical and Computer Engineering, Norfolk, Virginia, United States
| | - Manar D. Samad
- Tennessee State University, Department of Computer Science, Nashville, Tennessee, United States
| | - Zeina A. Shboul
- Old Dominion University, Department of Electrical and Computer Engineering, Norfolk, Virginia, United States
| | - Karra A. Jones
- University of Iowa, Department of Pathology, Iowa City, Iowa, United States
| | - Khan M. Iftekharuddin
- Old Dominion University, Department of Electrical and Computer Engineering, Norfolk, Virginia, United States
| |
Collapse
|
41
|
An Enhancement of Deep Learning Algorithm for Brain Tumor Segmentation Using Kernel Based CNN with M-SVM. J Med Syst 2019; 43:84. [PMID: 30810822 DOI: 10.1007/s10916-019-1223-7] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2018] [Accepted: 02/21/2019] [Indexed: 01/09/2023]
Abstract
The brain tumor can be created by uncontrollable increase of abnormal cells in tissue of brain and it has two kinds of tumors: one is benign and another one is malignant tumor. The benign brain tumor does not affect the adjacent normal and healthy tissue but the malignant tumor can affect the neighboring tissues of brain that can lead to the death of person. An early detection of brain tumor can be required to protect the survival of patients. Usually, the brain tumor is detected using MRI scanning method. However, the radiologists are not providing the effective tumor segmentation in MRI image due to the irregular shape of tumors and position of tumor in the brain. Accurate brain tumor segmentation is needed to locate the tumor and it is used to give the correct treatment for a patient and it provides the key to the doctor who must execute the surgery for patient. In this paper, a novel deep learning algorithm (kernel based CNN) with M-SVM is presented to segment the tumor automatically and efficiently. This presented work contains several steps that are preprocessing, feature extraction, image classification and tumor segmentation of brain. The MRI image is smoothed and enhanced by Laplacian of Gaussian filtering method (LoG) with Contrast Limited Adaptive Histrogram Equalization (CLAHE) and feature can be extracted from it based on tumor shape position, shape and surface features in brain. Consequently, the image classification is done using M-SVM depending on the selected features. From MRI image, the tumor is segmented with help of kernel based CNN method.. Experimental results of proposed method can show that this presented technique can executes brain tumor segmentation accurately reaching almost 84% in evaluation with existing algorithms.
Collapse
|
42
|
Active Learning for Recognition of Shipwreck Target in Side-Scan Sonar Image. REMOTE SENSING 2019. [DOI: 10.3390/rs11030243] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In order to realize the automatic and accurate recognition of shipwreck targets in side-scan sonar (SSS) waterfall images, a pipeline that contains feature extraction, selection, and shipwreck recognition, an AdaBoost model was constructed by sample images. Shipwreck targets are detected quickly by a nonlinear matching model, and a shipwreck recognition in SSS waterfall images are given, and according to a wide set of combinations of different types of these individual procedures, the model is able to recognize the shipwrecks accurately. Firstly, two feature-extraction methods suitable for recognizing SSS shipwreck targets from natural sea bottom images were studied. In addition to these two typical features, some commonly used features were extracted and combined as comprehensive features to characterize shipwrecks from various feature spaces. Based on Independent Component Analysis (ICA), the preferred features were selected from the comprehensive features, which avoid dimension disaster and improved the correct recognition rate. Then, the Gentle AdaBoost algorithm was studied and used for constructing the shipwreck target recognition model using sample images. Finally, a shipwreck target recognition process for the SSS waterfall image was given, and the process contains shipwreck target fast detection by a nonlinear matching model and accurate recognition by the Gentle AdaBoost recognition model. The results show that the correct recognition rate of the model for the sample image is 97.44%, while the false positive rate is 3.13% and the missing detection rate is 0. This study of a measured SSS waterfall image confirms the correctness of the recognition process and model.
Collapse
|
43
|
Padlia M, Sharma J. Fractional Sobel Filter Based Brain Tumor Detection and Segmentation Using Statistical Features and SVM. NANOELECTRONICS, CIRCUITS AND COMMUNICATION SYSTEMS 2019. [DOI: 10.1007/978-981-13-0776-8_15] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
44
|
M M, P S. MRI Brain Tumour Segmentation Using Hybrid Clustering and Classification by Back Propagation Algorithm. Asian Pac J Cancer Prev 2018; 19:3257-3263. [PMID: 30486629 PMCID: PMC6318394 DOI: 10.31557/apjcp.2018.19.11.3257] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
Generally the segmentation refers, the partitioning of an image into smaller regions to identify or locate the region of abnormality. Even though image segmentation is the challenging task in medical applications, due to contrary image, local observations of an image, noise image, non uniform texture of the images and so on. Many techniques are available for image segmentation, but still it requires to introduce an efficient, fast medical image segmentation methods. This research article introduces an efficient image segmentation method based on K means clustering integrated with a spatial Fuzzy C means clustering algorithms. The suggested technique combines the advantages of the two methods. K means segmentation requires minimum computation time, but spatial Fuzzy C means provides high accuracy for image segmentation. The performance of the proposed method is evaluated in terms of accuracy, PSNR and processing time. It also provides good implementation results for MRI brain image segmentation with high accuracy and minimal execution time. After completing the segmentation the of abnormal part of the input MRI brain image, it is compulsory to classify the image is normal or abnormal. There are many classifiers like a self organizing map, Back propagation algorithm, support vector machine etc., The algorithm helps to classify the abnormalities like benign or malignant brain tumour in case of MRI brain image. The abnormality is detected based on the extracted features from an input image. Discrete wavelet transform helps to find the hidden information from the MRI brain image. The extracted features are trained by Back Propagation Algorithm to classify the abnormalities of MRI brain image.
Collapse
Affiliation(s)
- Malathi M
- Department of Electronics and Instrumentation, Saveetha Engineering College, Chennai, India.
| | | |
Collapse
|
45
|
Selvapandian A, Manivannan K. Fusion based Glioma brain tumor detection and segmentation using ANFIS classification. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 166:33-38. [PMID: 30415716 DOI: 10.1016/j.cmpb.2018.09.006] [Citation(s) in RCA: 38] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/17/2018] [Revised: 09/05/2018] [Accepted: 09/11/2018] [Indexed: 06/09/2023]
Abstract
The detection of tumor regions in Glioma brain image is a challenging task due to its low sensitive boundary pixels. In this paper, Non-Sub sampled Contourlet Transform (NSCT) is used to enhance the brain image and then texture features are extracted from the enhanced brain image. These extracted features are trained and classified using Adaptive Neuro Fuzzy Inference System (ANFIS) approach to classify the brain image into normal and Glioma brain image. Then, the tumor regions in Glioma brain image is segmented using morphological functions. The proposed Glioma brain tumor detection methodology is applied on the Brain Tumor image Segmentation challenge (BRATS) open access dataset in order to evaluate the performance.
Collapse
Affiliation(s)
- A Selvapandian
- Department of Electronics and Communication Engineering, PSNA College of Engineering and Technology, Dindigul,Tamil Nadu 624001, India.
| | - K Manivannan
- Department of Computer Science and Engineering, PSNA College of Engineering and Technology, Dindigul, Tamil Nadu 624001, India
| |
Collapse
|
46
|
Pinto A, Pereira S, Correia H, Oliveira J, Rasteiro DMLD, Silva CA. Brain Tumour Segmentation based on Extremely Randomized Forest with high-level features. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2018; 2015:3037-40. [PMID: 26736932 DOI: 10.1109/embc.2015.7319032] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Gliomas are among the most common and aggressive brain tumours. Segmentation of these tumours is important for surgery and treatment planning, but also for follow-up evaluations. However, it is a difficult task, given that its size and locations are variable, and the delineation of all tumour tissue is not trivial, even with all the different modalities of the Magnetic Resonance Imaging (MRI). We propose a discriminative and fully automatic method for the segmentation of gliomas, using appearance- and context-based features to feed an Extremely Randomized Forest (Extra-Trees). Some of these features are computed over a non-linear transformation of the image. The proposed method was evaluated using the publicly available Challenge database from BraTS 2013, having obtained a Dice score of 0.83, 0.78 and 0.73 for the complete tumour, and the core and the enhanced regions, respectively. Our results are competitive, when compared against other results reported using the same database.
Collapse
|
47
|
Vidyaratne L, Alam M, Shboul Z, Iftekharuddin KM. Deep Learning and Texture-Based Semantic Label Fusion for Brain Tumor Segmentation. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2018; 2018. [PMID: 29551853 DOI: 10.1117/12.2292930] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Brain tumor segmentation is a fundamental step in surgical treatment and therapy. Many hand-crafted and learning based methods have been proposed for automatic brain tumor segmentation from MRI. Studies have shown that these approaches have their inherent advantages and limitations. This work proposes a semantic label fusion algorithm by combining two representative state-of-the-art segmentation algorithms: texture based hand-crafted, and deep learning based methods to obtain robust tumor segmentation. We evaluate the proposed method using publicly available BRATS 2017 brain tumor segmentation challenge dataset. The results show that the proposed method offers improved segmentation by alleviating inherent weaknesses: extensive false positives in texture based method, and the false tumor tissue classification problem in deep learning method, respectively. Furthermore, we investigate the effect of patient's gender on the segmentation performance using a subset of validation dataset. Note the substantial improvement in brain tumor segmentation performance proposed in this work has recently enabled us to secure the first place by our group in overall patient survival prediction task at the BRATS 2017 challenge.
Collapse
Affiliation(s)
- L Vidyaratne
- Vision Lab in Department of Electrical and Computer Engineering, Old Dominion University, Norfolk, VA 23529
| | - M Alam
- Vision Lab in Department of Electrical and Computer Engineering, Old Dominion University, Norfolk, VA 23529
| | - Z Shboul
- Vision Lab in Department of Electrical and Computer Engineering, Old Dominion University, Norfolk, VA 23529
| | - K M Iftekharuddin
- Vision Lab in Department of Electrical and Computer Engineering, Old Dominion University, Norfolk, VA 23529
| |
Collapse
|
48
|
Shboul Z, Vidyaratne L, Alam M, Reza SMS, Iftekharuddin KM. Glioblastoma and Survival Prediction. BRAINLESION : GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES. BRAINLES (WORKSHOP) 2018; 10670:358-368. [PMID: 30016377 PMCID: PMC5999323 DOI: 10.1007/978-3-319-75238-9_31] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Glioblastoma is a stage IV highly invasive astrocytoma tumor. Its heterogeneous appearance in MRI poses critical challenge in diagnosis, prognosis and survival prediction. This work extracts a total of 1207 different types of texture and other features, tests their significance and prognostic values, and then utilizes the most significant features with Random Forest regression model to perform survival prediction. We use 163 cases from BraTS17 training dataset for evaluation of the proposed model. A 10-fold cross validation offers normalized root mean square error of 30% for the training dataset and the cross validated accuracy of 63%, respectively.
Collapse
Affiliation(s)
- Zeina Shboul
- Vision Lab, Electrical & Computer Engineering, Old Dominion University
| | | | - Mahbubul Alam
- Vision Lab, Electrical & Computer Engineering, Old Dominion University
| | - Syed M S Reza
- Vision Lab, Electrical & Computer Engineering, Old Dominion University
| | | |
Collapse
|
49
|
A novel fully automatic multilevel thresholding technique based on optimized intuitionistic fuzzy sets and tsallis entropy for MR brain tumor image segmentation. AUSTRALASIAN PHYSICAL & ENGINEERING SCIENCES IN MEDICINE 2017; 41:41-58. [PMID: 29238919 DOI: 10.1007/s13246-017-0609-4] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/14/2016] [Accepted: 12/06/2017] [Indexed: 10/18/2022]
Abstract
In the present paper, a hybrid multilevel thresholding technique that combines intuitionistic fuzzy sets and tsallis entropy has been proposed for the automatic delineation of the tumor from magnetic resonance images having vague boundaries and poor contrast. This novel technique takes into account both the image histogram and the uncertainty information for the computation of multiple thresholds. The benefit of the methodology is that it provides fast and improved segmentation for the complex tumorous images with imprecise gray levels. To further boost the computational speed, the mutation based particle swarm optimization is used that selects the most optimal threshold combination. The accuracy of the proposed segmentation approach has been validated on simulated, real low-grade glioma tumor volumes taken from MICCAI brain tumor segmentation (BRATS) challenge 2012 dataset and the clinical tumor images, so as to corroborate its generality and novelty. The designed technique achieves an average Dice overlap equal to 0.82010, 0.78610 and 0.94170 for three datasets. Further, a comparative analysis has also been made between the eight existing multilevel thresholding implementations so as to show the superiority of the designed technique. In comparison, the results indicate a mean improvement in Dice by an amount equal to 4.00% (p < 0.005), 9.60% (p < 0.005) and 3.58% (p < 0.005), respectively in contrast to the fuzzy tsallis approach.
Collapse
|
50
|
Ilunga–Mbuyamba E, Avina–Cervantes JG, Cepeda–Negrete J, Ibarra–Manzano MA, Chalopin C. Automatic selection of localized region-based active contour models using image content analysis applied to brain tumor segmentation. Comput Biol Med 2017; 91:69-79. [DOI: 10.1016/j.compbiomed.2017.10.003] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2017] [Revised: 10/05/2017] [Accepted: 10/05/2017] [Indexed: 11/30/2022]
|