1
|
Wang S, Shen Y, Zeng F, Wang M, Li B, Shen D, Tang X, Wang B. Exploiting biochemical data to improve osteosarcoma diagnosis with deep learning. Health Inf Sci Syst 2024; 12:31. [PMID: 38645838 PMCID: PMC11026331 DOI: 10.1007/s13755-024-00288-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Accepted: 03/05/2024] [Indexed: 04/23/2024] Open
Abstract
Early and accurate diagnosis of osteosarcomas (OS) is of great clinical significance, and machine learning (ML) based methods are increasingly adopted. However, current ML-based methods for osteosarcoma diagnosis consider only X-ray images, usually fail to generalize to new cases, and lack explainability. In this paper, we seek to explore the capability of deep learning models in diagnosing primary OS, with higher accuracy, explainability, and generality. Concretely, we analyze the added value of integrating the biochemical data, i.e., alkaline phosphatase (ALP) and lactate dehydrogenase (LDH), and design a model that incorporates the numerical features of ALP and LDH and the visual features of X-ray imaging through a late fusion approach in the feature space. We evaluate this model on real-world clinic data with 848 patients aged from 4 to 81. The experimental results reveal the effectiveness of incorporating ALP and LDH simultaneously in a late fusion approach, with the accuracy of the considered 2608 cases increased to 97.17%, compared to 94.35% in the baseline. Grad-CAM visualizations consistent with orthopedic specialists further justified the model's explainability.
Collapse
Affiliation(s)
- Shidong Wang
- Musculoskeletal Tumor Center, Peking University People’s Hospital, Beijing, China
| | - Yangyang Shen
- School of Computer Science and Technology, Southeast University, Nanjing, China
| | - Fanwei Zeng
- Musculoskeletal Tumor Center, Peking University People’s Hospital, Beijing, China
| | - Meng Wang
- College of Design and Innovation, Tongji University, Shanghai, China
| | - Bohan Li
- College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China
- Ministry of Industry and Information Technology, Collaborative Innovation Center of Novel Software Technology and Industrialization, Nanjing, China
- National Engineering Laboratory for Integrated Aero-Space-Ground Ocean Big Data Application Technology, Xi’an, China
| | - Dian Shen
- School of Computer Science and Technology, Southeast University, Nanjing, China
| | - Xiaodong Tang
- Musculoskeletal Tumor Center, Peking University People’s Hospital, Beijing, China
| | - Beilun Wang
- School of Computer Science and Technology, Southeast University, Nanjing, China
| |
Collapse
|
2
|
Zolya MA, Baltag C, Bratu DV, Coman S, Moraru SA. COVID-19 Detection and Diagnosis Model on CT Scans Based on AI Techniques. Bioengineering (Basel) 2024; 11:79. [PMID: 38247956 PMCID: PMC10813639 DOI: 10.3390/bioengineering11010079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Revised: 12/31/2023] [Accepted: 01/08/2024] [Indexed: 01/23/2024] Open
Abstract
The end of 2019 could be mounted in a rudimentary framing of a new medical problem, which globally introduces into the discussion a fulminant outbreak of coronavirus, consequently spreading COVID-19 that conducted long-lived and persistent repercussions. Hence, the theme proposed to be solved arises from the field of medical imaging, where a pulmonary CT-based standardized reporting system could be addressed as a solution. The core of it focuses on certain impediments such as the overworking of doctors, aiming essentially to solve a classification problem using deep learning techniques, namely, if a patient suffers from COVID-19, viral pneumonia, or is healthy from a pulmonary point of view. The methodology's approach was a meticulous one, denoting an empirical character in which the initial stage, given using data processing, performs an extraction of the lung cavity from the CT scans, which is a less explored approach, followed by data augmentation. The next step is comprehended by developing a CNN in two scenarios, one in which there is a binary classification (COVID and non-COVID patients), and the other one is represented by a three-class classification. Moreover, viral pneumonia is addressed. To obtain an efficient version, architectural changes were gradually made, involving four databases during this process. Furthermore, given the availability of pre-trained models, the transfer learning technique was employed by incorporating the linear classifier from our own convolutional network into an existing model, with the result being much more promising. The experimentation encompassed several models including MobileNetV1, ResNet50, DenseNet201, VGG16, and VGG19. Through a more in-depth analysis, using the CAM technique, MobilneNetV1 differentiated itself via the detection accuracy of possible pulmonary anomalies. Interestingly, this model stood out as not being among the most used in the literature. As a result, the following values of evaluation metrics were reached: loss (0.0751), accuracy (0.9744), precision (0.9758), recall (0.9742), AUC (0.9902), and F1 score (0.9750), from 1161 samples allocated for each of the three individual classes.
Collapse
Affiliation(s)
- Maria-Alexandra Zolya
- Department of Automatics and Information Technology, Transilvania University of Brasov, 500036 Brașov, Romania; (C.B.); (D.-V.B.); (S.C.); (S.-A.M.)
| | | | | | | | | |
Collapse
|
3
|
Pitarch C, Ungan G, Julià-Sapé M, Vellido A. Advances in the Use of Deep Learning for the Analysis of Magnetic Resonance Image in Neuro-Oncology. Cancers (Basel) 2024; 16:300. [PMID: 38254790 PMCID: PMC10814384 DOI: 10.3390/cancers16020300] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2023] [Revised: 12/28/2023] [Accepted: 01/08/2024] [Indexed: 01/24/2024] Open
Abstract
Machine Learning is entering a phase of maturity, but its medical applications still lag behind in terms of practical use. The field of oncological radiology (and neuro-oncology in particular) is at the forefront of these developments, now boosted by the success of Deep-Learning methods for the analysis of medical images. This paper reviews in detail some of the most recent advances in the use of Deep Learning in this field, from the broader topic of the development of Machine-Learning-based analytical pipelines to specific instantiations of the use of Deep Learning in neuro-oncology; the latter including its use in the groundbreaking field of ultra-low field magnetic resonance imaging.
Collapse
Affiliation(s)
- Carla Pitarch
- Department of Computer Science, Universitat Politècnica de Catalunya (UPC BarcelonaTech) and Intelligent Data Science and Artificial Intelligence (IDEAI-UPC) Research Center, 08034 Barcelona, Spain;
- Eurecat, Digital Health Unit, Technology Centre of Catalonia, 08005 Barcelona, Spain
| | - Gulnur Ungan
- Departament de Bioquímica i Biologia Molecular and Institut de Biotecnologia i Biomedicina (IBB), Universitat Autònoma de Barcelona (UAB), 08193 Barcelona, Spain; (G.U.); (M.J.-S.)
- Centro de Investigación Biomédica en Red (CIBER), 28029 Madrid, Spain
| | - Margarida Julià-Sapé
- Departament de Bioquímica i Biologia Molecular and Institut de Biotecnologia i Biomedicina (IBB), Universitat Autònoma de Barcelona (UAB), 08193 Barcelona, Spain; (G.U.); (M.J.-S.)
- Centro de Investigación Biomédica en Red (CIBER), 28029 Madrid, Spain
| | - Alfredo Vellido
- Department of Computer Science, Universitat Politècnica de Catalunya (UPC BarcelonaTech) and Intelligent Data Science and Artificial Intelligence (IDEAI-UPC) Research Center, 08034 Barcelona, Spain;
- Centro de Investigación Biomédica en Red (CIBER), 28029 Madrid, Spain
| |
Collapse
|
4
|
B. A, Kaur M, Singh D, Roy S, Amoon M. Efficient Skip Connections-Based Residual Network (ESRNet) for Brain Tumor Classification. Diagnostics (Basel) 2023; 13:3234. [PMID: 37892055 PMCID: PMC10606037 DOI: 10.3390/diagnostics13203234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Revised: 10/10/2023] [Accepted: 10/12/2023] [Indexed: 10/29/2023] Open
Abstract
Brain tumors pose a complex and urgent challenge in medical diagnostics, requiring precise and timely classification due to their diverse characteristics and potentially life-threatening consequences. While existing deep learning (DL)-based brain tumor classification (BTC) models have shown significant progress, they encounter limitations like restricted depth, vanishing gradient issues, and difficulties in capturing intricate features. To address these challenges, this paper proposes an efficient skip connections-based residual network (ESRNet). leveraging the residual network (ResNet) with skip connections. ESRNet ensures smooth gradient flow during training, mitigating the vanishing gradient problem. Additionally, the ESRNet architecture includes multiple stages with increasing numbers of residual blocks for improved feature learning and pattern recognition. ESRNet utilizes residual blocks from the ResNet architecture, featuring skip connections that enable identity mapping. Through direct addition of the input tensor to the convolutional layer output within each block, skip connections preserve the gradient flow. This mechanism prevents vanishing gradients, ensuring effective information propagation across network layers during training. Furthermore, ESRNet integrates efficient downsampling techniques and stabilizing batch normalization layers, which collectively contribute to its robust and reliable performance. Extensive experimental results reveal that ESRNet significantly outperforms other approaches in terms of accuracy, sensitivity, specificity, F-score, and Kappa statistics, with median values of 99.62%, 99.68%, 99.89%, 99.47%, and 99.42%, respectively. Moreover, the achieved minimum performance metrics, including accuracy (99.34%), sensitivity (99.47%), specificity (99.79%), F-score (99.04%), and Kappa statistics (99.21%), underscore the exceptional effectiveness of ESRNet for BTC. Therefore, the proposed ESRNet showcases exceptional performance and efficiency in BTC, holding the potential to revolutionize clinical diagnosis and treatment planning.
Collapse
Affiliation(s)
- Ashwini B.
- Department of ISE, NMAM Institute of Technology, Nitte (Deemed to be University), Nitte 574110, India;
| | - Manjit Kaur
- School of Computer Science and Artificial Intelligence, SR University, Warangal 506371, India
| | - Dilbag Singh
- Center of Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY 10016, USA;
- Research and Development Cell, Lovely Professional University, Phagwara 144411, India
| | - Satyabrata Roy
- Department of Computer Science and Engineering, Manipal University Jaipur, Jaipur 303007, India;
| | - Mohammed Amoon
- Department of Computer Science, Community College, King Saud University, P.O. Box 28095, Riyadh 11437, Saudi Arabia
| |
Collapse
|
5
|
Mohamad Mostafa A, El-Meligy MA, Abdullah Alkhayyal M, Alnuaim A, Sharaf M. A framework for brain tumor detection based on segmentation and features fusion using MRI images. Brain Res 2023; 1806:148300. [PMID: 36842569 DOI: 10.1016/j.brainres.2023.148300] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Revised: 02/17/2023] [Accepted: 02/21/2023] [Indexed: 02/26/2023]
Abstract
Irregular growth of cells in the skull is recognized as a brain tumor that can have two types such as benign and malignant. There exist various methods which are used by oncologists to assess the existence of brain tumors such as blood tests or visual assessments. Moreover, the noninvasive magnetic resonance imaging (MRI) technique without ionizing radiation has been commonly utilized for diagnosis. However, the segmentation in 3-dimensional MRI is time-consuming and the outcomes mainly depend on the operator's experience. Therefore, a novel and robust automated brain tumor detector has been suggested based on segmentation and fusion of features. To improve the localization results, we pre-processed the images using Gaussian Filter (GF), and SynthStrip: a tool for brain skull stripping. We utilized two known benchmarks for training and testing i.e., Figshare and Harvard. The proposed methodology attained 99.8% accuracy, 99.3% recall, 99.4% precision, 99.5% F1 score, and 0.989 AUC. We performed the comparative analysis of our approach with prevailing DL, classical, and segmentation-based approaches. Additionally, we also performed the cross-validation using Harvard dataset attaining 99.3% identification accuracy. The outcomes exhibit that our approach offers significant outcomes than existing methods and outperforms them.
Collapse
Affiliation(s)
- Almetwally Mohamad Mostafa
- Department of Information Systems, College of Computer and Information Sciences, King Saud University, P.O. BOX 51178, Riyadh 11543, Saudi Arabia.
| | - Mohammed A El-Meligy
- Advanced Manufacturing Institute, King Saud University, Riyadh 11421, Saudi Arabia.
| | - Maram Abdullah Alkhayyal
- Department of Information Systems, College of Computer and Information Sciences, King Saud University, P.O. BOX 51178, Riyadh 11543, Saudi Arabia.
| | - Abeer Alnuaim
- Department of Computer Science and Engineering, College of Applied Studies and Community Services, King Saud University, P.O. BOX 22459, Riyadh 11495, Saudi Arabia.
| | - Mohamed Sharaf
- Industrial Engineering Department, College of Engineering, King Saud University, P.O. Box 800, Riyadh 11421, Saudi Arabia.
| |
Collapse
|
6
|
Shi H, Li X, Chen Z, Jiang W, Dong S, He R, Zhou W. Nomograms for Predicting the Risk and Prognosis of Liver Metastases in Pancreatic Cancer: A Population-Based Analysis. J Pers Med 2023; 13:jpm13030409. [PMID: 36983591 PMCID: PMC10056156 DOI: 10.3390/jpm13030409] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Revised: 02/11/2023] [Accepted: 02/21/2023] [Indexed: 03/03/2023] Open
Abstract
The liver is the most prevalent location of distant metastasis for pancreatic cancer (PC), which is highly aggressive. Pancreatic cancer with liver metastases (PCLM) patients have a poor prognosis. Furthermore, there is a lack of effective predictive tools for anticipating the diagnostic and prognostic techniques that are needed for the PCLM patients in current clinical work. Therefore, we aimed to construct two nomogram predictive models incorporating common clinical indicators to anticipate the risk factors and prognosis for PCLM patients. Clinicopathological information on pancreatic cancer that referred to patients who had been diagnosed between the years of 2004 and 2015 was extracted from the Surveillance, Epidemiology, and End Results (SEER) database. Univariate and multivariate logistic regression analyses and a Cox regression analysis were utilized to recognize the independent risk variables and independent predictive factors for the PCLM patients, respectively. Using the independent risk as well as prognostic factors derived from the multivariate regression analysis, we constructed two novel nomogram models for predicting the risk and prognosis of PCLM patients. The area under the curve (AUC) of the receiver operating characteristic (ROC) curve, the consistency index (C-index), and the calibration curve were then utilized to establish the accuracy of the nomograms’ predictions and their discriminability between groups. Using a decision curve analysis (DCA), the clinical values of the two predictors were examined. Finally, we utilized Kaplan–Meier curves to examine the effects of different factors on the prognostic overall survival (OS). As many as 1898 PCLM patients were screened. The patient’s sex, primary site, histopathological type, grade, T stage, N stage, bone metastases, lung metastases, tumor size, surgical resection, radiotherapy, and chemotherapy were all found to be independent risks variables for PCLM in a multivariate logistic regression analysis. Using a multivariate Cox regression analysis, we discovered that age, histopathological type, grade, bone metastasis, lung metastasis, tumor size, and surgery were all independent prognostic variables for PCLM. According to these factors, two nomogram models were developed to anticipate the prognostic OS as well as the risk variables for the progression of PCLM in PCLM patients, and a web-based version of the prediction model was constructed. The diagnostic nomogram model had a C-index of 0.884 (95% CI: 0.876–0.892); the prognostic model had a C-index of 0.686 (95% CI: 0.648–0.722) in the training cohort and a C-index of 0.705 (95% CI: 0.647–0.758) in the validation cohort. Subsequent AUC, calibration curve, and DCA analyses revealed that the risk and predictive model of PCLM had high accuracy as well as efficacy for clinical application. The nomograms constructed can effectively predict risk and prognosis factors in PCLM patients, which facilitates personalized clinical decision-making for patients.
Collapse
Affiliation(s)
- Huaqing Shi
- Second College of Clinical Medicine, Lanzhou University, Lanzhou 730000, China
| | - Xin Li
- The First Clinical Medical College, Lanzhou University, Lanzhou 730030, China
| | - Zhou Chen
- The First Clinical Medical College, Lanzhou University, Lanzhou 730030, China
| | - Wenkai Jiang
- Second College of Clinical Medicine, Lanzhou University, Lanzhou 730000, China
| | - Shi Dong
- Second College of Clinical Medicine, Lanzhou University, Lanzhou 730000, China
| | - Ru He
- The First Clinical Medical College, Lanzhou University, Lanzhou 730030, China
| | - Wence Zhou
- Second College of Clinical Medicine, Lanzhou University, Lanzhou 730000, China
- Department of General Surgery, Lanzhou University Second Hospital, Lanzhou 730030, China
- Correspondence:
| |
Collapse
|