1
|
Lu J, Liu X, Ji X, Jiang Y, Zuo A, Guo Z, Yang S, Peng H, Sun F, Lu D. Predicting PD-L1 status in NSCLC patients using deep learning radiomics based on CT images. Sci Rep 2025; 15:12495. [PMID: 40216830 PMCID: PMC11992188 DOI: 10.1038/s41598-025-91575-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2024] [Accepted: 02/21/2025] [Indexed: 04/14/2025] Open
Abstract
Radiomics refers to the utilization of automated or semi-automated techniques to extract and analyze numerous quantitative features from medical images, such as computerized tomography (CT) or magnetic resonance imaging (MRI) scans. This study aims to develop a deep learning radiomics (DLR)-based approach for predicting programmed death-ligand 1 (PD-L1) expression in patients with non-small cell lung cancer (NSCLC). Data from 352 NSCLC patients with known PD-L1 expression were collected, of which 48.29% (170/352) were tested positive for PD-L1 expression. Tumor regions of interest (ROI) were semi-automatically segmented based on CT images, and DL features were extracted using Residual Network 50. The least absolute shrinkage and selection operator (LASSO) algorithm was used for feature selection and dimensionality reduction. Seven algorithms were used to build models, and the most optimal ones were identified. A combined model integrating DLR with clinical data was also developed. The predictive performance of each model was evaluated using the area under the curve (AUC) of the receiver operating characteristic (ROC) curve analysis. The DLR model, based on CT images, demonstrated an AUC of 0.85 (95% confidence interval (CI), 0.82-0.88), sensitivity of 0.80 (0.74-0.85), and specificity of 0.73 (0.70-0.77) for predicting PD-L1 status. The integrated model exhibited superior performance, with an AUC of 0.91 (0.87-0.95), sensitivity of 0.85 (0.82-0.89), and specificity of 0.75 (0.72-0.80). Our findings indicate that the DLR model holds promise as a valuable tool for predicting the PD-L1 status in patients with NSCLC, which can greatly assist in clinical decision-making and the selection of personalized treatment strategies.
Collapse
Affiliation(s)
- Jiameng Lu
- Department of Respiratory, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Shandong Institute of Respiratory Diseases, Shandong Institute of Anesthesia and Respiratory Critical Medicine, 16766 Jingshilu, Lixia, Jinan, 250014, Shandong, People's Republic of China
- Faculty of Medicine, Macau University of Science and Technology, Avenida Wai Long, Taipa, 999078, Macau Special Administrative Region, People's Republic of China
| | - Xinyi Liu
- Department of Respiratory, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Shandong Institute of Respiratory Diseases, Shandong Institute of Anesthesia and Respiratory Critical Medicine, 16766 Jingshilu, Lixia, Jinan, 250014, Shandong, People's Republic of China
| | - Xiaoqing Ji
- Department of Nursing, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan, 250014, Shandong, China
| | - Yunxiu Jiang
- Department of Respiratory, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Shandong Institute of Respiratory Diseases, Shandong Institute of Anesthesia and Respiratory Critical Medicine, 16766 Jingshilu, Lixia, Jinan, 250014, Shandong, People's Republic of China
| | - Anli Zuo
- Department of Respiratory, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Shandong Institute of Respiratory Diseases, Shandong Institute of Anesthesia and Respiratory Critical Medicine, 16766 Jingshilu, Lixia, Jinan, 250014, Shandong, People's Republic of China
| | - Zihan Guo
- Department of Respiratory, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Shandong Institute of Respiratory Diseases, Shandong Institute of Anesthesia and Respiratory Critical Medicine, 16766 Jingshilu, Lixia, Jinan, 250014, Shandong, People's Republic of China
| | - Shuran Yang
- Department of Respiratory, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Shandong Institute of Respiratory Diseases, Shandong Institute of Anesthesia and Respiratory Critical Medicine, 16766 Jingshilu, Lixia, Jinan, 250014, Shandong, People's Republic of China
| | - Haiying Peng
- Department of Respiratory and Critical Care Medicine, The Second People's Hospital of Yibin City, 644002, Yibin, People's Republic of China
| | - Fei Sun
- Department of Respiratory and Critical Care Medicine, Jining No.1 People's Hospital, 272000, Jining, People's Republic of China
| | - Degan Lu
- Department of Respiratory, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Shandong Institute of Respiratory Diseases, Shandong Institute of Anesthesia and Respiratory Critical Medicine, 16766 Jingshilu, Lixia, Jinan, 250014, Shandong, People's Republic of China.
| |
Collapse
|
2
|
Chen X, Long Z, Lei Y, Liang S, Sima Y, Lin R, Ding Y, Lin Q, Ma T, Deng Y. CT Differentiation and Prognostic Modeling in COVID-19 and Influenza A Pneumonia. Acad Radiol 2025:S1076-6332(25)00106-0. [PMID: 40037939 DOI: 10.1016/j.acra.2025.02.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2024] [Revised: 01/26/2025] [Accepted: 02/03/2025] [Indexed: 03/06/2025]
Abstract
RATIONALE AND OBJECTIVES This study aimed to compare CT features of COVID-19 and Influenza A pneumonia, develop a diagnostic differential model, and explore a prognostic model for lesion resolution. MATERIALS AND METHODS A total of 446 patients diagnosed with COVID-19 and 80 with Influenza A pneumonitis underwent baseline chest CT evaluation. Logistic regression analysis was conducted after multivariate analysis and the results were presented as nomograms. Machine learning models were also evaluated for their diagnostic performance. Prognostic factors for lesion resolution were analyzed using Cox regression after excluding patients who were lost to follow-up, with a nomogram being created. RESULTS COVID-19 patients showed more features such as thickening of bronchovascular bundles, crazy paving sign and traction bronchiectasis. Influenza A patients exhibited more features such as consolidation, coarse banding and pleural effusion (P < 0.05). The logistic regression model achieved AUC values of 0.937 (training) and 0.931 (validation). Machine learning models exhibited area under the curve values ranging from 0.8486 to 0.9017. COVID-19 patients showed better lesion resolution. Independent prognostic factors for resolution at baseline included age, sex, lesion distribution, morphology, coarse banding, and widening of the main pulmonary artery. CONCLUSION Distinct imaging features can differentiate COVID-19 from Influenza A pneumonia. The logistic discriminative model and each machine - learning network model constructed in this study demonstrated efficacy. The nomogram for the logistic discriminative model exhibited high utility. Patients with COVID-19 may exhibit a better resolution of lesions. Certain baseline characteristics may act as independent prognostic factors for complete resolution of lesions.
Collapse
Affiliation(s)
- Xilai Chen
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Zhenchu Long
- Department of Radiology, Fuyong People's Hospital, Shenzhen, China
| | - Yongxia Lei
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Shaohua Liang
- Department of Radiology, the Second Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Yizou Sima
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Ran Lin
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Yajun Ding
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Qiuxi Lin
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Ting Ma
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Yu Deng
- Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.
| |
Collapse
|
3
|
Ilesanmi AE, Ilesanmi T, Ajayi B, Gbotoso GA, Belhaouari SB. Unlocking the Power of 3D Convolutional Neural Networks for COVID-19 Detection: A Comprehensive Review. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2025:10.1007/s10278-025-01393-x. [PMID: 39849202 DOI: 10.1007/s10278-025-01393-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2024] [Revised: 12/11/2024] [Accepted: 12/23/2024] [Indexed: 01/25/2025]
Abstract
The advent of three-dimensional convolutional neural networks (3D CNNs) has revolutionized the detection and analysis of COVID-19 cases. As imaging technologies have advanced, 3D CNNs have emerged as a powerful tool for segmenting and classifying COVID-19 in medical images. These networks have demonstrated both high accuracy and rapid detection capabilities, making them crucial for effective COVID-19 diagnostics. This study offers a thorough review of various 3D CNN algorithms, evaluating their efficacy in segmenting and classifying COVID-19 across a range of medical imaging modalities. This review systematically examines recent advancements in 3D CNN methodologies. The process involved a comprehensive screening of abstracts and titles to ensure relevance, followed by a meticulous selection and analysis of research papers from academic repositories. The study evaluates these papers based on specific criteria and provides detailed insights into the network architectures and algorithms used for COVID-19 detection. The review reveals significant trends in the use of 3D CNNs for COVID-19 segmentation and classification. It highlights key findings, including the diverse range of networks employed for COVID-19 detection compared to other diseases, which predominantly utilize encoder/decoder frameworks. The study provides an in-depth analysis of these methods, discussing their strengths, limitations, and potential areas for future research. The study reviewed a total of 60 papers published across various repositories, including Springer and Elsevier. The insights from this study have implications for clinical diagnosis and treatment strategies. Despite some limitations, the accuracy and efficiency of 3D CNN algorithms underscore their potential for advancing medical image segmentation and classification. The findings suggest that 3D CNNs could significantly enhance the detection and management of COVID-19, contributing to improved healthcare outcomes.
Collapse
Affiliation(s)
| | | | | | - Gbenga A Gbotoso
- Lagos State University of Science and Technology, Ikorodu, Nigeria
| | | |
Collapse
|
4
|
Gathright R, Mejia I, Gonzalez JM, Hernandez Torres SI, Berard D, Snider EJ. Overview of Wearable Healthcare Devices for Clinical Decision Support in the Prehospital Setting. SENSORS (BASEL, SWITZERLAND) 2024; 24:8204. [PMID: 39771939 PMCID: PMC11679471 DOI: 10.3390/s24248204] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/25/2024] [Revised: 12/16/2024] [Accepted: 12/17/2024] [Indexed: 01/11/2025]
Abstract
Prehospital medical care is a major challenge for both civilian and military situations as resources are limited, yet critical triage and treatment decisions must be rapidly made. Prehospital medicine is further complicated during mass casualty situations or remote applications that require more extensive medical treatments to be monitored. It is anticipated on the future battlefield where air superiority will be contested that prolonged field care will extend to as much 72 h in a prehospital environment. Traditional medical monitoring is not practical in these situations and, as such, wearable sensor technology may help support prehospital medicine. However, sensors alone are not sufficient in the prehospital setting where limited personnel without specialized medical training must make critical decisions based on physiological signals. Machine learning-based clinical decision support systems can instead be utilized to interpret these signals for diagnosing injuries, making triage decisions, or driving treatments. Here, we summarize the challenges of the prehospital medical setting and review wearable sensor technology suitability for this environment, including their use with medical decision support triage or treatment guidance options. Further, we discuss recommendations for wearable healthcare device development and medical decision support technology to better support the prehospital medical setting. With further design improvement and integration with decision support tools, wearable healthcare devices have the potential to simplify and improve medical care in the challenging prehospital environment.
Collapse
Affiliation(s)
| | | | | | | | | | - Eric J. Snider
- Organ Support and Automation Technologies Group, U.S. Army Institute of Surgical Research, JBSA Fort Sam Houston, San Antonio, TX 78234, USA
| |
Collapse
|
5
|
Ali MJ, Essaid M, Moalic L, Idoumghar L. A review of AutoML optimization techniques for medical image applications. Comput Med Imaging Graph 2024; 118:102441. [PMID: 39489100 DOI: 10.1016/j.compmedimag.2024.102441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 09/06/2024] [Accepted: 09/30/2024] [Indexed: 11/05/2024]
Abstract
Automatic analysis of medical images using machine learning techniques has gained significant importance over the years. A large number of approaches have been proposed for solving different medical image analysis tasks using machine learning and deep learning approaches. These approaches are quite effective thanks to their ability to analyze large volume of medical imaging data. Moreover, they can also identify patterns that may be difficult for human experts to detect. Manually designing and tuning the parameters of these algorithms is a challenging and time-consuming task. Furthermore, designing a generalized model that can handle different imaging modalities is difficult, as each modality has specific characteristics. To solve these problems and automate the whole pipeline of different medical image analysis tasks, numerous Automatic Machine Learning (AutoML) techniques have been proposed. These techniques include Hyper-parameter Optimization (HPO), Neural Architecture Search (NAS), and Automatic Data Augmentation (ADA). This study provides an overview of several AutoML-based approaches for different medical imaging tasks in terms of optimization search strategies. The usage of optimization techniques (evolutionary, gradient-based, Bayesian optimization, etc.) is of significant importance for these AutoML approaches. We comprehensively reviewed existing AutoML approaches, categorized them, and performed a detailed analysis of different proposed approaches. Furthermore, current challenges and possible future research directions are also discussed.
Collapse
Affiliation(s)
| | - Mokhtar Essaid
- Université de Haute-Alsace, IRIMAS UR7499, Mulhouse, 68100, France.
| | - Laurent Moalic
- Université de Haute-Alsace, IRIMAS UR7499, Mulhouse, 68100, France.
| | | |
Collapse
|
6
|
Varriano G, Nardone V, Correra S, Mercaldo F, Santone A. An automatic radiomic-based approach for disease localization: A pilot study on COVID-19. Comput Med Imaging Graph 2024; 116:102411. [PMID: 38924800 DOI: 10.1016/j.compmedimag.2024.102411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Revised: 04/15/2024] [Accepted: 06/09/2024] [Indexed: 06/28/2024]
Abstract
Radiomics is an innovative field in Personalized Medicine to help medical specialists in diagnosis and prognosis. Mainly, the application of Radiomics to medical images requires the definition and delimitation of the Region Of Interest (ROI) on the medical image to extract radiomic features. The aim of this preliminary study is to define an approach that automatically detects the specific areas indicative of a particular disease and examines them to minimize diagnostic errors associated with false positives and false negatives. This approach aims to create a nxn grid on the DICOM image sequence and each cell in the matrix is associated with a region from which radiomic features can be extracted. The proposed procedure uses the Model Checking technique and produces as output the medical diagnosis of the patient, i.e., whether the patient under analysis is affected or not by a specific disease. Furthermore, the matrix-based method also localizes where appears the disease marks. To evaluate the performance of the proposed methodology, a case study on COVID-19 disease is used. Both results on disease identification and localization seem very promising. Furthermore, this proposed approach yields better results compared to methods based on the extraction of features using the whole image as a single ROI, as evidenced by improvements in Accuracy and especially Recall. Our approach supports the advancement of knowledge, interoperability and trust in the software tool, fostering collaboration among doctors, staff and Radiomics.
Collapse
Affiliation(s)
- Giulia Varriano
- University of Molise, Department of Medicine and Health Sciences "V. Tiberio", Campobasso 86100, Italy.
| | - Vittoria Nardone
- University of Molise, Department of Medicine and Health Sciences "V. Tiberio", Campobasso 86100, Italy.
| | - Simona Correra
- University of Molise, Department of Medicine and Health Sciences "V. Tiberio", Campobasso 86100, Italy.
| | - Francesco Mercaldo
- University of Molise, Department of Medicine and Health Sciences "V. Tiberio", Campobasso 86100, Italy.
| | - Antonella Santone
- University of Molise, Department of Medicine and Health Sciences "V. Tiberio", Campobasso 86100, Italy.
| |
Collapse
|
7
|
Farghaly O, Deshpande P. Texture-Based Classification to Overcome Uncertainty between COVID-19 and Viral Pneumonia Using Machine Learning and Deep Learning Techniques. Diagnostics (Basel) 2024; 14:1017. [PMID: 38786315 PMCID: PMC11119936 DOI: 10.3390/diagnostics14101017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2024] [Revised: 05/11/2024] [Accepted: 05/13/2024] [Indexed: 05/25/2024] Open
Abstract
The SARS-CoV-2 virus, responsible for COVID-19, often manifests symptoms akin to viral pneumonia, complicating early detection and potentially leading to severe COVID pneumonia and long-term effects. Particularly affecting young individuals, the elderly, and those with weakened immune systems, the accurate classification of COVID-19 poses challenges, especially with highly dimensional image data. Past studies have faced limitations due to simplistic algorithms and small, biased datasets, yielding inaccurate results. In response, our study introduces a novel classification model that integrates advanced texture feature extraction methods, including GLCM, GLDM, and wavelet transform, within a deep learning framework. This innovative approach enables the effective classification of chest X-ray images into normal, COVID-19, and viral pneumonia categories, overcoming the limitations encountered in previous studies. Leveraging the unique textures inherent to each dataset class, our model achieves superior classification performance, even amidst the complexity and diversity of the data. Moreover, we present comprehensive numerical findings demonstrating the superiority of our approach over traditional methods. The numerical results highlight the accuracy (random forest (RF): 0.85; SVM (support vector machine): 0.70; deep learning neural network (DLNN): 0.92), recall (RF: 0.85, SVM: 0.74, DLNN: 0.93), precision (RF: 0.86, SVM: 0.71, DLNN: 0.87), and F1-Score (RF: 0.86, SVM: 0.72, DLNN: 0.89) of our proposed model. Our study represents a significant advancement in AI-based diagnostic systems for COVID-19 and pneumonia, promising improved patient outcomes and healthcare management strategies.
Collapse
Affiliation(s)
- Omar Farghaly
- Data-Intensive Computing Distributed Systems Laboratory, Department of Electrical and Computer Engineering, Marquette University, Milwaukee, WI 53233, USA
| | - Priya Deshpande
- Data-Intensive Computing Distributed Systems Laboratory, Department of Electrical and Computer Engineering, Marquette University, Milwaukee, WI 53233, USA
| |
Collapse
|
8
|
Zhang L, Huang Y, Chen J, Xu X, Xu F, Yao J. Multimodal deep transfer learning to predict retinal vein occlusion macular edema recurrence after anti-VEGF therapy. Heliyon 2024; 10:e29334. [PMID: 38655307 PMCID: PMC11036002 DOI: 10.1016/j.heliyon.2024.e29334] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 03/28/2024] [Accepted: 04/05/2024] [Indexed: 04/26/2024] Open
Abstract
Purpose To develop a multimodal deep transfer learning (DTL) fusion model using optical coherence tomography angiography (OCTA) images to predict the recurrence of retinal vein occlusion (RVO) and macular edema (ME) after three consecutive anti-VEGF therapies. Methods This retrospective cross-sectional study consisted of 2800 B-scan OCTA macular images collected from 140 patients with RVO-ME. The central macular thickness (CMT) > 250 μm was used as a criterion for recurrence in the three-month follow-up after three injections of anti-VEGF therapy. The qualified OCTA image preprocessing and the lesion area segmentation were performed by senior ophthalmologists. We developed and validated the clinical, DTL, and multimodal fusion models based on clinical and extracted OCTA imaging features. The performance of the models and experts predictions were evaluated using several performance metrics, including the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity. Results The DTL models exhibited higher prediction efficacy than the clinical models and experts' predictions. Among the DTL models, the Vgg19 performed better than that of the other models, with an AUC of 0.968 (95 % CI, 0.943-0.994), accuracy of 0.913, sensitivity of 0.922, and specificity of 0.902 in the validation cohort. Moreover, the fusion Vgg19 model showed the highest prediction efficacy among all the models, with an AUC of 0.972 (95 % CI, 0.946-0.997), accuracy of 0.935, sensitivity of 0.935, and specificity of 0.934 in the validation cohort. Conclusions Multimodal fusion DTL models showed robust performance in predicting RVO-ME recurrence and may be applied to assist clinicians in determining patients' follow-up time after anti-VEGF therapy.
Collapse
Affiliation(s)
- Laihe Zhang
- The Affiliated Eye Hospital, Nanjing Medical University, Nanjing, China
- The Fourth School of Clinical Medicine, Nanjing Medical University, Nanjing, China
| | - Ying Huang
- The Affiliated Eye Hospital, Nanjing Medical University, Nanjing, China
- The Fourth School of Clinical Medicine, Nanjing Medical University, Nanjing, China
| | - Jiaqin Chen
- The Affiliated Eye Hospital, Nanjing Medical University, Nanjing, China
- The Fourth School of Clinical Medicine, Nanjing Medical University, Nanjing, China
| | - Xiangzhong Xu
- The Affiliated Eye Hospital, Nanjing Medical University, Nanjing, China
- The Fourth School of Clinical Medicine, Nanjing Medical University, Nanjing, China
| | - Fan Xu
- The Affiliated Eye Hospital, Nanjing Medical University, Nanjing, China
- The Fourth School of Clinical Medicine, Nanjing Medical University, Nanjing, China
| | - Jin Yao
- The Affiliated Eye Hospital, Nanjing Medical University, Nanjing, China
- The Fourth School of Clinical Medicine, Nanjing Medical University, Nanjing, China
| |
Collapse
|
9
|
Munshi RM, Khayyat MM, Ben Slama S, Khayyat MM. A deep learning-based approach for predicting COVID-19 diagnosis. Heliyon 2024; 10:e28031. [PMID: 38596143 PMCID: PMC11002549 DOI: 10.1016/j.heliyon.2024.e28031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 03/06/2024] [Accepted: 03/11/2024] [Indexed: 04/11/2024] Open
Abstract
This paper focuses on forecasting the total count of confirmed COVID-19 cases in Saudi Arabia through a range of methodologies, including ARIMA, mathematical modeling, and deep learning network (DQN) techniques. Its primary aim is to anticipate the verified COVID-19 cases in Saudi Arabia, aiding in decision-making for life-saving interventions by enhancing awareness of COVID-19 infection. Mathematical modeling and ARIMA are employed for their efficacy in forecasting, while DQN approaches, particularly through comparative analysis, are utilized for prediction. This comparative analysis evaluates the predictive capacities of ARIMA, mathematical modeling, and DQN techniques, aiming to pinpoint the most reliable method for forecasting positive COVID-19 cases. The modeling encompasses COVID-19 cases in Saudi Arabia, the United Kingdom (UK), and Tunisia (TU) spanning from 2020 to 2021. Predicting the number of individuals likely to test positive for COVID-19 poses a challenge, requiring adherence to fundamental assumptions in mathematical and ARIMA projections. The proposed methodology was implemented on a local server. The DQN algorithm formulates a reward function to uphold target functional performance while balancing training and testing periods. The findings indicate that DQN technology surpasses conventional approaches in efficiency and accuracy for predictions.
Collapse
Affiliation(s)
- Raafat M. Munshi
- Department of Medical Laboratory Technology (MLT) Faculty of Applied Medical Sciences, King Abdulaziz University, Rabigh, Saudi Arabia
| | - Mashael M. Khayyat
- Department of Information Systems and Technology, College of Computer Science and Engineering, University of Jeddah, Jeddah, Saudi Arabia
| | - Sami Ben Slama
- Analysis and Processing of Electrical and Energy Systems Unit, Faculty of Sciences of Tunis El Manar, Tunis, 2092, Tunisia
- Faculty of Computing & Information Technology Information System Department, Jeddah, King Abdulaziz University, Saudi Arabia
| | - Manal Mahmoud Khayyat
- Department of Computer Science and Artificial Intelligence College of Computing, Umm Al-Qura University Makkah 24382, Saudi Arabia
| |
Collapse
|
10
|
Tariq MU, Ismail SB. Deep learning in public health: Comparative predictive models for COVID-19 case forecasting. PLoS One 2024; 19:e0294289. [PMID: 38483948 PMCID: PMC10939212 DOI: 10.1371/journal.pone.0294289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Accepted: 10/28/2023] [Indexed: 03/17/2024] Open
Abstract
The COVID-19 pandemic has had a significant impact on both the United Arab Emirates (UAE) and Malaysia, emphasizing the importance of developing accurate and reliable forecasting mechanisms to guide public health responses and policies. In this study, we compared several cutting-edge deep learning models, including Long Short-Term Memory (LSTM), bidirectional LSTM, Convolutional Neural Networks (CNN), hybrid CNN-LSTM, Multilayer Perceptron's, and Recurrent Neural Networks (RNN), to project COVID-19 cases in the aforementioned regions. These models were calibrated and evaluated using a comprehensive dataset that includes confirmed case counts, demographic data, and relevant socioeconomic factors. To enhance the performance of these models, Bayesian optimization techniques were employed. Subsequently, the models were re-evaluated to compare their effectiveness. Analytic approaches, both predictive and retrospective in nature, were used to interpret the data. Our primary objective was to determine the most effective model for predicting COVID-19 cases in the United Arab Emirates (UAE) and Malaysia. The findings indicate that the selected deep learning algorithms were proficient in forecasting COVID-19 cases, although their efficacy varied across different models. After a thorough evaluation, the model architectures most suitable for the specific conditions in the UAE and Malaysia were identified. Our study contributes significantly to the ongoing efforts to combat the COVID-19 pandemic, providing crucial insights into the application of sophisticated deep learning algorithms for the precise and timely forecasting of COVID-19 cases. These insights hold substantial value for shaping public health strategies, enabling authorities to develop targeted and evidence-based interventions to manage the virus spread and its impact on the populations of the UAE and Malaysia. The study confirms the usefulness of deep learning methodologies in efficiently processing complex datasets and generating reliable projections, a skill of great importance in healthcare and professional settings.
Collapse
Affiliation(s)
- Muhammad Usman Tariq
- Abu Dhabi University, Abu Dhabi, United Arab Emirates
- Universiti Tun Hussein Onn Malaysia (UTHM), Parit Raja, Malaysia
| | | |
Collapse
|
11
|
Fili V, Savelonas M. Self-attention-driven retrieval of chest CT images for COVID-19 assessment. Biomed Phys Eng Express 2024; 10:025013. [PMID: 38224614 DOI: 10.1088/2057-1976/ad1e76] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2023] [Accepted: 01/15/2024] [Indexed: 01/17/2024]
Abstract
Numerous methods have been developed for computer-aided diagnosis (CAD) of coronavirus disease-19 (COVID-19), based on chest computed tomography (CT) images. The majority of these methods are based on deep neural networks and often act as "black boxes" that cannot easily gain the trust of medical community, whereas their result is uniformly influenced by all image regions. This work introduces a novel, self-attention-driven method for content-based image retrieval (CBIR) of chest CT images. The proposed method analyzes a query CT image and returns a classification result, as well as a list of classified images, ranked according to similarity with the query. Each CT image is accompanied by a heatmap, which is derived by gradient-weighted class activation mapping (Grad-CAM) and represents the contribution of lung tissue and lesions to COVID-19 pathology. Beyond visualization, Grad-CAM weights are employed in a self-attention mechanism, in order to strengthen the influence of the most COVID-19-related image regions on the retrieval result. Experiments on two publicly available datasets demonstrate that the binary classification accuracy obtained by means of DenseNet-201 is 81.3% and 96.4%, for COVID-CT and SARS-CoV-2 datasets, respectively, with a false negative rate which is less than 3% in both datasets. In addition, the Grad-CAM-guided CBIR framework slightly outperforms the plain CBIR in most cases, with respect to nearest neighbour (NN) and first four (FF). The proposed method could serve as a computational tool for a more transparent decision-making process that could be trusted by the medical community. In addition, the employed self-attention mechanism increases the obtained retrieval performance.
Collapse
Affiliation(s)
- Victoria Fili
- Department of Computer Science and Biomedical Informatics, University of Thessaly, Papasiopoulou 2-4, Lamia, 35131, Greece
| | - Michalis Savelonas
- Department of Computer Science and Biomedical Informatics, University of Thessaly, Papasiopoulou 2-4, Lamia, 35131, Greece
| |
Collapse
|
12
|
Alhhazmi A, Alferidi A, Almutawif YA, Makhdoom H, Albasri HM, Sami BS. Artificial intelligence in healthcare: combining deep learning and Bayesian optimization to forecast COVID-19 confirmed cases. Front Artif Intell 2024; 6:1327355. [PMID: 38375088 PMCID: PMC10875994 DOI: 10.3389/frai.2023.1327355] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Accepted: 12/27/2023] [Indexed: 02/21/2024] Open
Abstract
Healthcare is a topic of significant concern within the academic and business sectors. The COVID-19 pandemic has had a considerable effect on the health of people worldwide. The rapid increase in cases adversely affects a nation's economy, public health, and residents' social and personal well-being. Improving the precision of COVID-19 infection forecasts can aid in making informed decisions regarding interventions, given the pandemic's harmful impact on numerous aspects of human life, such as health and the economy. This study aims to predict the number of confirmed COVID-19 cases in Saudi Arabia using Bayesian optimization (BOA) and deep learning (DL) methods. Two methods were assessed for their efficacy in predicting the occurrence of positive cases of COVID-19. The research employed data from confirmed COVID-19 cases in Saudi Arabia (SA), the United Kingdom (UK), and Tunisia (TU) from 2020 to 2021. The findings from the BOA model indicate that accurately predicting the number of COVID-19 positive cases is difficult due to the BOA projections needing to align with the assumptions. Thus, a DL approach was utilized to enhance the precision of COVID-19 positive case prediction in South Africa. The DQN model performed better than the BOA model when assessing RMSE and MAPE values. The model operates on a local server infrastructure, where the trained policy is transmitted solely to DQN. DQN formulated a reward function to amplify the efficiency of the DQN algorithm. By examining the rate of change and duration of sleep in the test data, this function can enhance the DQN model's training. Based on simulation findings, it can decrease the DQN work cycle by roughly 28% and diminish data overhead by more than 50% on average.
Collapse
Affiliation(s)
- Areej Alhhazmi
- Medical Laboratories Technology Department, College of Applied Medical Sciences, Taibah University, Al-Madinah Al-Munawarah, Saudi Arabia
| | - Ahmad Alferidi
- Department of Electrical Engineering, College of Engineering, Taibah University, Al-Madinah Al-Munawarah, Saudi Arabia
| | - Yahya A. Almutawif
- Medical Laboratories Technology Department, College of Applied Medical Sciences, Taibah University, Al-Madinah Al-Munawarah, Saudi Arabia
| | - Hatim Makhdoom
- Medical Laboratories Technology Department, College of Applied Medical Sciences, Taibah University, Al-Madinah Al-Munawarah, Saudi Arabia
| | - Hibah M. Albasri
- Department of Biology, College of Science, Taibah University, Al-Madinah Al-Munawarah, Saudi Arabia
| | - Ben Slama Sami
- Computer Sciences Department, The Applied College, King Abdulaziz, Saudi Arabia University, Jeddah, Saudi Arabia
| |
Collapse
|
13
|
Ozaltin O, Yeniay O, Subasi A. OzNet: A New Deep Learning Approach for Automated Classification of COVID-19 Computed Tomography Scans. BIG DATA 2023; 11:420-436. [PMID: 36927081 DOI: 10.1089/big.2022.0042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
Coronavirus disease 2019 (COVID-19) is spreading rapidly around the world. Therefore, the classification of computed tomography (CT) scans alleviates the workload of experts, whose workload increased considerably during the pandemic. Convolutional neural network (CNN) architectures are successful for the classification of medical images. In this study, we have developed a new deep CNN architecture called OzNet. Moreover, we have compared it with pretrained architectures namely AlexNet, DenseNet201, GoogleNet, NASNetMobile, ResNet-50, SqueezeNet, and VGG-16. In addition, we have compared the classification success of three preprocessing methods with raw CT scans. We have not only classified the raw CT scans, but also have performed the classification with three different preprocessing methods, which are discrete wavelet transform (DWT), intensity adjustment, and gray to color red, green, blue image conversion on the data sets. Furthermore, it is known that the architecture's performance increases with the use of DWT preprocessing method rather than using the raw data set. The results are extremely promising with the CNN algorithms using the COVID-19 CT scans processed with the DWT. The proposed DWT-OzNet has achieved a high classification performance of more than 98.8% for each calculated metric.
Collapse
Affiliation(s)
- Oznur Ozaltin
- Department of Statistics, Institute of Science, Hacettepe University, Ankara, Turkey
| | - Ozgur Yeniay
- Department of Statistics, Institute of Science, Hacettepe University, Ankara, Turkey
| | - Abdulhamit Subasi
- Institute of Biomedicine, Faculty of Medicine, University of Turku, Turku, Finland
- Department of Computer Science, College of Engineering, Effat University, Jeddah, Saudi Arabia
| |
Collapse
|
14
|
Chu WT, Reza SMS, Anibal JT, Landa A, Crozier I, Bağci U, Wood BJ, Solomon J. Artificial Intelligence and Infectious Disease Imaging. J Infect Dis 2023; 228:S322-S336. [PMID: 37788501 PMCID: PMC10547369 DOI: 10.1093/infdis/jiad158] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 05/06/2023] [Indexed: 10/05/2023] Open
Abstract
The mass production of the graphics processing unit and the coronavirus disease 2019 (COVID-19) pandemic have provided the means and the motivation, respectively, for rapid developments in artificial intelligence (AI) and medical imaging techniques. This has led to new opportunities to improve patient care but also new challenges that must be overcome before these techniques are put into practice. In particular, early AI models reported high performances but failed to perform as well on new data. However, these mistakes motivated further innovation focused on developing models that were not only accurate but also stable and generalizable to new data. The recent developments in AI in response to the COVID-19 pandemic will reap future dividends by facilitating, expediting, and informing other medical AI applications and educating the broad academic audience on the topic. Furthermore, AI research on imaging animal models of infectious diseases offers a unique problem space that can fill in evidence gaps that exist in clinical infectious disease research. Here, we aim to provide a focused assessment of the AI techniques leveraged in the infectious disease imaging research space, highlight the unique challenges, and discuss burgeoning solutions.
Collapse
Affiliation(s)
- Winston T Chu
- Center for Infectious Disease Imaging, Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, Maryland, USA
- Integrated Research Facility at Fort Detrick, Division of Clinical Research, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Frederick, Maryland, USA
| | - Syed M S Reza
- Center for Infectious Disease Imaging, Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, Maryland, USA
| | - James T Anibal
- Center for Interventional Oncology, Clinical Center, National Institutes of Health, Bethesda, Maryland, USA
| | - Adam Landa
- Center for Interventional Oncology, Clinical Center, National Institutes of Health, Bethesda, Maryland, USA
| | - Ian Crozier
- Clinical Monitoring Research Program Directorate, Frederick National Laboratory for Cancer Research sponsored by the National Cancer Institute, Frederick, Maryland, USA
| | - Ulaş Bağci
- Department of Radiology, Feinberg School of Medicine, Northwestern University, Chicago, Illinois, USA
| | - Bradford J Wood
- Center for Interventional Oncology, Clinical Center, National Institutes of Health, Bethesda, Maryland, USA
- Center for Interventional Oncology, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - Jeffrey Solomon
- Clinical Monitoring Research Program Directorate, Frederick National Laboratory for Cancer Research sponsored by the National Cancer Institute, Frederick, Maryland, USA
| |
Collapse
|
15
|
Ahmed ST, Basha SM, Venkatesan M, Mathivanan SK, Mallik S, Alsubaie N, Alqahtani MS. TVFx - CoVID-19 X-Ray images classification approach using neural networks based feature thresholding technique. BMC Med Imaging 2023; 23:146. [PMID: 37784025 PMCID: PMC10544389 DOI: 10.1186/s12880-023-01100-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Accepted: 09/11/2023] [Indexed: 10/04/2023] Open
Abstract
COVID-19, the global pandemic of twenty-first century, has caused major challenges and setbacks for researchers and medical infrastructure worldwide. The CoVID-19 influences on the patients respiratory system cause flooding of airways in the lungs. Multiple techniques have been proposed since the outbreak each of which is interdepended on features and larger training datasets. It is challenging scenario to consolidate larger datasets for accurate and reliable decision support. This research article proposes a chest X-Ray images classification approach based on feature thresholding in categorizing the CoVID-19 samples. The proposed approach uses the threshold value-based Feature Extraction (TVFx) technique and has been validated on 661-CoVID-19 X-Ray datasets in providing decision support for medical experts. The model has three layers of training datasets to attain a sequential pattern based on various learning features. The aligned feature-set of the proposed technique has successfully categorized CoVID-19 active samples into mild, serious, and extreme categories as per medical standards. The proposed technique has achieved an accuracy of 97.42% in categorizing and classifying given samples sets.
Collapse
Affiliation(s)
- Syed Thouheed Ahmed
- Department of Electrical Engineering, Indian Institute of Technology, Hyderabad., Hyderabad, India
- School of Computer Science and Engineering, REVA University, Bengaluru, India
| | - Syed Muzamil Basha
- School of Computer Science and Engineering, REVA University, Bengaluru, India
| | - Muthukumaran Venkatesan
- Department of Mathematics, College of Engineering and Technology, SRM Institute of Science and Technology, Kattankulathur, Tamilnadu, 603203, India
| | - Sandeep Kumar Mathivanan
- School of Computing Science & Engineering, Galgotias University, Greater Noida, Uttar Pradesh, 203201, India.
| | - Saurav Mallik
- Department of Environmental Health, Harvard T H Chan School of Public Health, Boston, MA, 02115, USA.
- Department of Pharmacology & Toxicology, The University of Arizona, Tucson, AZ, 85721, USA.
| | - Najah Alsubaie
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, P.O. Box 84428, Riyadh, 11671, Saudi Arabia.
| | - Mohammed S Alqahtani
- Radiological Sciences Department, College of Applied Medical Sciences, King Khalid University, Abha, 61421, Saudi Arabia
- BioImaging Unit, Space Research Centre, University of Leicester, Michael Atiyah Building, Leicester, LE1 7RH, UK
| |
Collapse
|
16
|
Abu Khurma R, Albashish D, Braik M, Alzaqebah A, Qasem A, Adwan O. An augmented Snake Optimizer for diseases and COVID-19 diagnosis. Biomed Signal Process Control 2023; 84:104718. [PMID: 36811003 PMCID: PMC9935299 DOI: 10.1016/j.bspc.2023.104718] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2022] [Revised: 01/21/2023] [Accepted: 02/14/2023] [Indexed: 02/19/2023]
Abstract
Feature Selection (FS) techniques extract the most recognizable features for improving the performance of classification methods for medical applications. In this paper, two intelligent wrapper FS approaches based on a new metaheuristic algorithm named the Snake Optimizer (SO) are introduced. The binary SO, called BSO, is built based on an S-shape transform function to handle the binary discrete values in the FS domain. To improve the exploration of the search space by BSO, three evolutionary crossover operators (i.e., one-point crossover, two-point crossover, and uniform crossover) are incorporated and controlled by a switch probability. The two newly developed FS algorithms, BSO and BSO-CV, are implemented and assessed on a real-world COVID-19 dataset and 23 disease benchmark datasets. According to the experimental results, the improved BSO-CV significantly outperformed the standard BSO in terms of accuracy and running time in 17 datasets. Furthermore, it shrinks the COVID-19 dataset's dimension by 89% as opposed to the BSO's 79%. Moreover, the adopted operator on BSO-CV improved the balance between exploitation and exploration capabilities in the standard BSO, particularly in searching and converging toward optimal solutions. The BSO-CV was compared against the most recent wrapper-based FS methods; namely, the hyperlearning binary dragonfly algorithm (HLBDA), the binary moth flame optimization with Lévy flight (LBMFO-V3), the coronavirus herd immunity optimizer with greedy crossover operator (CHIO-GC), as well as four filter methods with an accuracy of more than 90% in most benchmark datasets. These optimistic results reveal the great potential of BSO-CV in reliably searching the feature space.
Collapse
Affiliation(s)
- Ruba Abu Khurma
- Computer Science Department, Faculty of Information Technology, Al-Ahliyya Amman University, Amman, Jordan
| | - Dheeb Albashish
- Computer Science Department, Prince Abdullah bin Ghazi Faculty of Information and Communication Technology, Al-Balqa Applied University, Salt, Jordan
| | - Malik Braik
- Computer Science Department, Prince Abdullah bin Ghazi Faculty of Information and Communication Technology, Al-Balqa Applied University, Salt, Jordan
| | - Abdullah Alzaqebah
- Computer Science Department, Faculty of Information Technology, The World Islamic Sciences & Education University, Amman, Jordan
| | - Ashwaq Qasem
- School of Electrical Engineering and Artificial Intelligence, Xiamen University Malaysia, Sepang, Malaysia
| | - Omar Adwan
- Computer Science Department, Faculty of Information Technology, Al-Ahliyya Amman University, Amman, Jordan
- Department of Computer Science, University of Jordan, Amman, Jordan
| |
Collapse
|
17
|
Dumakude A, Ezugwu AE. Automated COVID-19 detection with convolutional neural networks. Sci Rep 2023; 13:10607. [PMID: 37391527 PMCID: PMC10313722 DOI: 10.1038/s41598-023-37743-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Accepted: 06/27/2023] [Indexed: 07/02/2023] Open
Abstract
This paper focuses on addressing the urgent need for efficient and accurate automated screening tools for COVID-19 detection. Inspired by existing research efforts, we propose two framework models to tackle this challenge. The first model combines a conventional CNN architecture as a feature extractor with XGBoost as the classifier. The second model utilizes a classical CNN architecture with a Feedforward Neural Network for classification. The key distinction between the two models lies in their classification layers. Bayesian optimization techniques are employed to optimize the hyperparameters of both models, enabling a "cheat-start" to the training process with optimal configurations. To mitigate overfitting, transfer learning techniques such as Dropout and Batch normalization are incorporated. The CovidxCT-2A dataset is used for training, validation, and testing purposes. To establish a benchmark, we compare the performance of our models with state-of-the-art methods reported in the literature. Evaluation metrics including Precision, Recall, Specificity, Accuracy, and F1-score are employed to assess the efficacy of the models. The hybrid model demonstrates impressive results, achieving high precision (98.43%), recall (98.41%), specificity (99.26%), accuracy (99.04%), and F1-score (98.42%). The standalone CNN model exhibits slightly lower but still commendable performance, with precision (98.25%), recall (98.44%), specificity (99.27%), accuracy (98.97%), and F1-score (98.34%). Importantly, both models outperform five other state-of-the-art models in terms of classification accuracy, as demonstrated by the results of this study.
Collapse
Affiliation(s)
- Aphelele Dumakude
- School of Mathematics, Statistics, and Computer Science, University of KwaZulu-Natal, King Edward Avenue, Pietermaritzburg Campus, Pietermaritzburg, 3201, KwaZulu-Natal, South Africa
| | - Absalom E Ezugwu
- Unit for Data Science and Computing, North-West University, 11 Hoffman Street, Potchefstroom, 2520, South Africa.
| |
Collapse
|
18
|
Ajagbe SA, Adigun MO. Deep learning techniques for detection and prediction of pandemic diseases: a systematic literature review. MULTIMEDIA TOOLS AND APPLICATIONS 2023:1-35. [PMID: 37362693 PMCID: PMC10226029 DOI: 10.1007/s11042-023-15805-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/17/2022] [Revised: 03/06/2023] [Accepted: 05/10/2023] [Indexed: 06/28/2023]
Abstract
Deep learning (DL) is becoming a fast-growing field in the medical domain and it helps in the timely detection of any infectious disease (IDs) and is essential to the management of diseases and the prediction of future occurrences. Many scientists and scholars have implemented DL techniques for the detection and prediction of pandemics, IDs and other healthcare-related purposes, these outcomes are with various limitations and research gaps. For the purpose of achieving an accurate, efficient and less complicated DL-based system for the detection and prediction of pandemics, therefore, this study carried out a systematic literature review (SLR) on the detection and prediction of pandemics using DL techniques. The survey is anchored by four objectives and a state-of-the-art review of forty-five papers out of seven hundred and ninety papers retrieved from different scholarly databases was carried out in this study to analyze and evaluate the trend of DL techniques application areas in the detection and prediction of pandemics. This study used various tables and graphs to analyze the extracted related articles from various online scholarly repositories and the analysis showed that DL techniques have a good tool in pandemic detection and prediction. Scopus and Web of Science repositories are given attention in this current because they contain suitable scientific findings in the subject area. Finally, the state-of-the-art review presents forty-four (44) studies of various DL technique performances. The challenges identified from the literature include the low performance of the model due to computational complexities, improper labeling and the absence of a high-quality dataset among others. This survey suggests possible solutions such as the development of improved DL-based techniques or the reduction of the output layer of DL-based architecture for the detection and prediction of pandemic-prone diseases as future considerations.
Collapse
Affiliation(s)
- Sunday Adeola Ajagbe
- Department of Computer & Industrial Production Engineering, First Technical University Ibadan, Ibadan, 200255 Nigeria
- Department of Computer Science, University of Zululand, Kwadlangezwa, 3886 South Africa
| | - Matthew O. Adigun
- Department of Computer Science, University of Zululand, Kwadlangezwa, 3886 South Africa
| |
Collapse
|
19
|
Mozaffari J, Amirkhani A, Shokouhi SB. A survey on deep learning models for detection of COVID-19. Neural Comput Appl 2023; 35:1-29. [PMID: 37362568 PMCID: PMC10224665 DOI: 10.1007/s00521-023-08683-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Accepted: 05/10/2023] [Indexed: 06/28/2023]
Abstract
The spread of the COVID-19 started back in 2019; and so far, more than 4 million people around the world have lost their lives to this deadly virus and its variants. In view of the high transmissibility of the Corona virus, which has turned this disease into a global pandemic, artificial intelligence can be employed as an effective tool for an earlier detection and treatment of this illness. In this review paper, we evaluate the performance of the deep learning models in processing the X-Ray and CT-Scan images of the Corona patients' lungs and describe the changes made to these models in order to enhance their Corona detection accuracy. To this end, we introduce the famous deep learning models such as VGGNet, GoogleNet and ResNet and after reviewing the research works in which these models have been used for the detection of COVID-19, we compare the performances of the newer models such as DenseNet, CapsNet, MobileNet and EfficientNet. We then present the deep learning techniques of GAN, transfer learning, and data augmentation and examine the statistics of using these techniques. Here, we also describe the datasets introduced since the onset of the COVID-19. These datasets contain the lung images of Corona patients, healthy individuals, and the patients with non-Corona pulmonary diseases. Lastly, we elaborate on the existing challenges in the use of artificial intelligence for COVID-19 detection and the prospective trends of using this method in similar situations and conditions. Supplementary Information The online version contains supplementary material available at 10.1007/s00521-023-08683-x.
Collapse
Affiliation(s)
- Javad Mozaffari
- School of Electrical Engineering, Iran University of Science and Technology, Tehran, 16846-13114 Iran
| | - Abdollah Amirkhani
- School of Automotive Engineering, Iran University of Science and Technology, Tehran, 16846-13114 Iran
| | - Shahriar B. Shokouhi
- School of Electrical Engineering, Iran University of Science and Technology, Tehran, 16846-13114 Iran
| |
Collapse
|
20
|
Subramaniam K, Palanisamy N, Sinnaswamy RA, Muthusamy S, Mishra OP, Loganathan AK, Ramamoorthi P, Gnanakkan CARC, Thangavel G, Sundararajan SCM. A comprehensive review of analyzing the chest X-ray images to detect COVID-19 infections using deep learning techniques. Soft comput 2023; 27:1-22. [PMID: 37362273 PMCID: PMC10220331 DOI: 10.1007/s00500-023-08561-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/18/2023] [Indexed: 06/28/2023]
Abstract
COVID-19, a highly infectious respiratory disease a used by SARS virus, has killed millions of people across many countries. To enhance quick and accurate diagnosis of COVID-19, chest X-ray (CXR) imaging methods were commonly utilized. Identifying the infection manually by radio imaging, on the other hand, was considered, extremely difficult due to the time commitment and significant risk of human error. Emerging artificial intelligence (AI) techniques promised exploration in the development of precise and as well as automated COVID-19 detection tools. Convolution neural networks (CNN), a well performing deep learning strategy tends to gain substantial favors among AI approaches for COVID-19 classification. The preprints and published studies to diagnose COVID-19 with CXR pictures using CNN and other deep learning methodologies are reviewed and critically assessed in this research. This study focused on the methodology, algorithms, and preprocessing techniques used in various deep learning architectures, as well as datasets and performance studies of several deep learning architectures used in prediction and diagnosis. Our research concludes with a list of future research directions in COVID-19 imaging categorization.
Collapse
Affiliation(s)
- Kavitha Subramaniam
- Department of Computer Science and Engineering, Kongu Engineering College (Autonomous), Perundurai, Erode, Tamil Nadu India
| | - Natesan Palanisamy
- Department of Computer Science and Engineering, Kongu Engineering College (Autonomous), Perundurai, Erode, Tamil Nadu India
| | - Renugadevi Ammapalayam Sinnaswamy
- Department of Electronics and Communication Engineering, Kongu Engineering College (Autonomous), Perundurai, Erode, Tamil Nadu India
| | - Suresh Muthusamy
- Department of Electronics and Communication Engineering, Kongu Engineering College (Autonomous), Perundurai, Erode, Tamil Nadu India
| | - Om Prava Mishra
- Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Avadi, Chennai, Tamil Nadu India
| | - Ashok Kumar Loganathan
- Department of Electrical and Electronics Engineering, PSG College of Technology, Coimbatore, Tamil Nadu India
| | - Ponarun Ramamoorthi
- Department of Electrical and Electronics Engineering, Theni Kammavar Sangam College of Technology, Theni, Tamil Nadu India
| | | | - Gunasekaran Thangavel
- Department of Engineering, University of Technology and Applied Sciences, Muscat, Sultanate of Oman
| | | |
Collapse
|
21
|
Li G, Togo R, Ogawa T, Haseyama M. Boosting automatic COVID-19 detection performance with self-supervised learning and batch knowledge ensembling. Comput Biol Med 2023; 158:106877. [PMID: 37019015 PMCID: PMC10063457 DOI: 10.1016/j.compbiomed.2023.106877] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Revised: 03/15/2023] [Accepted: 03/30/2023] [Indexed: 04/03/2023]
Abstract
PROBLEM Detecting COVID-19 from chest X-ray (CXR) images has become one of the fastest and easiest methods for detecting COVID-19. However, the existing methods usually use supervised transfer learning from natural images as a pretraining process. These methods do not consider the unique features of COVID-19 and the similar features between COVID-19 and other pneumonia. AIM In this paper, we want to design a novel high-accuracy COVID-19 detection method that uses CXR images, which can consider the unique features of COVID-19 and the similar features between COVID-19 and other pneumonia. METHODS Our method consists of two phases. One is self-supervised learning-based pertaining; the other is batch knowledge ensembling-based fine-tuning. Self-supervised learning-based pretraining can learn distinguished representations from CXR images without manually annotated labels. On the other hand, batch knowledge ensembling-based fine-tuning can utilize category knowledge of images in a batch according to their visual feature similarities to improve detection performance. Unlike our previous implementation, we introduce batch knowledge ensembling into the fine-tuning phase, reducing the memory used in self-supervised learning and improving COVID-19 detection accuracy. RESULTS On two public COVID-19 CXR datasets, namely, a large dataset and an unbalanced dataset, our method exhibited promising COVID-19 detection performance. Our method maintains high detection accuracy even when annotated CXR training images are reduced significantly (e.g., using only 10% of the original dataset). In addition, our method is insensitive to changes in hyperparameters. CONCLUSION The proposed method outperforms other state-of-the-art COVID-19 detection methods in different settings. Our method can reduce the workloads of healthcare providers and radiologists.
Collapse
Affiliation(s)
- Guang Li
- Graduate School of Information Science and Technology, Hokkaido University, N-14, W-9, Kita-Ku, Sapporo, 060-0814, Japan.
| | - Ren Togo
- Faculty of Information Science and Technology, Hokkaido University, N-14, W-9, Kita-Ku, Sapporo, 060-0814, Japan.
| | - Takahiro Ogawa
- Faculty of Information Science and Technology, Hokkaido University, N-14, W-9, Kita-Ku, Sapporo, 060-0814, Japan.
| | - Miki Haseyama
- Faculty of Information Science and Technology, Hokkaido University, N-14, W-9, Kita-Ku, Sapporo, 060-0814, Japan.
| |
Collapse
|
22
|
Ren K, Hong G, Chen X, Wang Z. A COVID-19 medical image classification algorithm based on Transformer. Sci Rep 2023; 13:5359. [PMID: 37005476 PMCID: PMC10067012 DOI: 10.1038/s41598-023-32462-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Accepted: 03/28/2023] [Indexed: 04/04/2023] Open
Abstract
Coronavirus 2019 (COVID-19) is a new acute respiratory disease that has spread rapidly throughout the world. This paper proposes a novel deep learning network based on ResNet-50 merged transformer named RMT-Net. On the backbone of ResNet-50, it uses Transformer to capture long-distance feature information, adopts convolutional neural networks and depth-wise convolution to obtain local features, reduce the computational cost and acceleration the detection process. The RMT-Net includes four stage blocks to realize the feature extraction of different receptive fields. In the first three stages, the global self-attention method is adopted to capture the important feature information and construct the relationship between tokens. In the fourth stage, the residual blocks are used to extract the details of feature. Finally, a global average pooling layer and a fully connected layer perform classification tasks. Training, verification and testing are carried out on self-built datasets. The RMT-Net model is compared with ResNet-50, VGGNet-16, i-CapsNet and MGMADS-3. The experimental results show that the RMT-Net model has a Test_ acc of 97.65% on the X-ray image dataset, 99.12% on the CT image dataset, which both higher than the other four models. The size of RMT-Net model is only 38.5 M, and the detection speed of X-ray image and CT image is 5.46 ms and 4.12 ms per image, respectively. It is proved that the model can detect and classify COVID-19 with higher accuracy and efficiency.
Collapse
Affiliation(s)
- Keying Ren
- College of Electronic Information and Automation, Tianjin University of Science and Technology, Tianjin, 300222, China
| | - Geng Hong
- College of Electronic Information and Automation, Tianjin University of Science and Technology, Tianjin, 300222, China
| | - Xiaoyan Chen
- College of Electronic Information and Automation, Tianjin University of Science and Technology, Tianjin, 300222, China.
| | - Zichen Wang
- College of Electronic Information and Automation, Tianjin University of Science and Technology, Tianjin, 300222, China
| |
Collapse
|
23
|
Paul SG, Saha A, Biswas AA, Zulfiker MS, Arefin MS, Rahman MM, Reza AW. Combating Covid-19 using machine learning and deep learning: Applications, challenges, and future perspectives. ARRAY 2023; 17:100271. [PMID: 36530931 PMCID: PMC9737520 DOI: 10.1016/j.array.2022.100271] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 12/05/2022] [Accepted: 12/07/2022] [Indexed: 12/14/2022] Open
Abstract
COVID-19, a worldwide pandemic that has affected many people and thousands of individuals have died due to COVID-19, during the last two years. Due to the benefits of Artificial Intelligence (AI) in X-ray image interpretation, sound analysis, diagnosis, patient monitoring, and CT image identification, it has been further researched in the area of medical science during the period of COVID-19. This study has assessed the performance and investigated different machine learning (ML), deep learning (DL), and combinations of various ML, DL, and AI approaches that have been employed in recent studies with diverse data formats to combat the problems that have arisen due to the COVID-19 pandemic. Finally, this study shows the comparison among the stand-alone ML and DL-based research works regarding the COVID-19 issues with the combinations of ML, DL, and AI-based research works. After in-depth analysis and comparison, this study responds to the proposed research questions and presents the future research directions in this context. This review work will guide different research groups to develop viable applications based on ML, DL, and AI models, and will also guide healthcare institutes, researchers, and governments by showing them how these techniques can ease the process of tackling the COVID-19.
Collapse
Affiliation(s)
- Showmick Guha Paul
- Department of Computer Science and Engineering, Daffodil International University, Dhaka, Bangladesh
| | - Arpa Saha
- Department of Computer Science and Engineering, Daffodil International University, Dhaka, Bangladesh
| | - Al Amin Biswas
- Department of Computer Science and Engineering, Daffodil International University, Dhaka, Bangladesh,Corresponding author
| | - Md. Sabab Zulfiker
- Department of Computer Science and Engineering, Daffodil International University, Dhaka, Bangladesh
| | - Mohammad Shamsul Arefin
- Department of Computer Science and Engineering, Daffodil International University, Dhaka, Bangladesh,Department of Computer Science and Engineering, Chittagong University of Engineering and Technology, Chittagong, Bangladesh
| | - Md. Mahfujur Rahman
- Department of Computer Science and Engineering, Daffodil International University, Dhaka, Bangladesh
| | - Ahmed Wasif Reza
- Department of Computer Science and Engineering, East West University, Dhaka, Bangladesh
| |
Collapse
|
24
|
A Novel Proposal for Deep Learning-Based Diabetes Prediction: Converting Clinical Data to Image Data. Diagnostics (Basel) 2023; 13:diagnostics13040796. [PMID: 36832284 PMCID: PMC9955314 DOI: 10.3390/diagnostics13040796] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Revised: 02/14/2023] [Accepted: 02/15/2023] [Indexed: 02/22/2023] Open
Abstract
Diabetes, one of the most common diseases worldwide, has become an increasingly global threat to humans in recent years. However, early detection of diabetes greatly inhibits the progression of the disease. This study proposes a new method based on deep learning for the early detection of diabetes. Like many other medical data, the PIMA dataset used in the study contains only numerical values. In this sense, the application of popular convolutional neural network (CNN) models to such data are limited. This study converts numerical data into images based on the feature importance to use the robust representation of CNN models in early diabetes diagnosis. Three different classification strategies are then applied to the resulting diabetes image data. In the first, diabetes images are fed into the ResNet18 and ResNet50 CNN models. In the second, deep features of the ResNet models are fused and classified with support vector machines (SVM). In the last approach, the selected fusion features are classified by SVM. The results demonstrate the robustness of diabetes images in the early diagnosis of diabetes.
Collapse
|
25
|
Novel Light Convolutional Neural Network for COVID Detection with Watershed Based Region Growing Segmentation. J Imaging 2023; 9:jimaging9020042. [PMID: 36826961 PMCID: PMC9963211 DOI: 10.3390/jimaging9020042] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Revised: 02/06/2023] [Accepted: 02/08/2023] [Indexed: 02/16/2023] Open
Abstract
A rapidly spreading epidemic, COVID-19 had a serious effect on millions and took many lives. Therefore, for individuals with COVID-19, early discovery is essential for halting the infection's progress. To quickly and accurately diagnose COVID-19, imaging modalities, including computed tomography (CT) scans and chest X-ray radiographs, are frequently employed. The potential of artificial intelligence (AI) approaches further explored the creation of automated and precise COVID-19 detection systems. Scientists widely use deep learning techniques to identify coronavirus infection in lung imaging. In our paper, we developed a novel light CNN model architecture with watershed-based region-growing segmentation on Chest X-rays. Both CT scans and X-ray radiographs were employed along with 5-fold cross-validation. Compared to earlier state-of-the-art models, our model is lighter and outperformed the previous methods by achieving a mean accuracy of 98.8% on X-ray images and 98.6% on CT scans, predicting the rate of 0.99% and 0.97% for PPV (Positive predicted Value) and NPV (Negative predicted Value) rate of 0.98% and 0.99%, respectively.
Collapse
|
26
|
Aldhahi W, Sull S. Uncertain-CAM: Uncertainty-Based Ensemble Machine Voting for Improved COVID-19 CXR Classification and Explainability. Diagnostics (Basel) 2023; 13:441. [PMID: 36766546 PMCID: PMC9914375 DOI: 10.3390/diagnostics13030441] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Revised: 01/08/2023] [Accepted: 01/20/2023] [Indexed: 01/27/2023] Open
Abstract
The ongoing coronavirus disease 2019 (COVID-19) pandemic has had a significant impact on patients and healthcare systems across the world. Distinguishing non-COVID-19 patients from COVID-19 patients at the lowest possible cost and in the earliest stages of the disease is a major issue. Additionally, the implementation of explainable deep learning decisions is another issue, especially in critical fields such as medicine. The study presents a method to train deep learning models and apply an uncertainty-based ensemble voting policy to achieve 99% accuracy in classifying COVID-19 chest X-rays from normal and pneumonia-related infections. We further present a training scheme that integrates the cyclic cosine annealing approach with cross-validation and uncertainty quantification that is measured using prediction interval coverage probability (PICP) as final ensemble voting weights. We also propose the Uncertain-CAM technique, which improves deep learning explainability and provides a more reliable COVID-19 classification system. We introduce a new image processing technique to measure the explainability based on ground-truth, and we compared it with the widely adopted Grad-CAM method.
Collapse
Affiliation(s)
| | - Sanghoon Sull
- School of Electrical Engineering, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul 02841, Republic of Korea
| |
Collapse
|
27
|
Saad MH, Hashima S, Sayed W, El-Shazly EH, Madian AH, Fouda MM. Early Diagnosis of COVID-19 Images Using Optimal CNN Hyperparameters. Diagnostics (Basel) 2022; 13:76. [PMID: 36611368 PMCID: PMC9818649 DOI: 10.3390/diagnostics13010076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Revised: 12/13/2022] [Accepted: 12/19/2022] [Indexed: 12/29/2022] Open
Abstract
Coronavirus disease (COVID-19) is a worldwide epidemic that poses substantial health hazards. However, COVID-19 diagnostic test sensitivity is still restricted due to abnormalities in specimen processing. Meanwhile, optimizing the highly defined number of convolutional neural network (CNN) hyperparameters (hundreds to thousands) is a useful direction to improve its overall performance and overcome its cons. Hence, this paper proposes an optimization strategy for obtaining the optimal learning rate and momentum of a CNN's hyperparameters using the grid search method to improve the network performance. Therefore, three alternative CNN architectures (GoogleNet, VGG16, and ResNet) were used to optimize hyperparameters utilizing two different COVID-19 radiography data sets (Kaggle (X-ray) and China national center for bio-information (CT)). These architectures were tested with/without optimizing the hyperparameters. The results confirm effective disease classification using the CNN structures with optimized hyperparameters. Experimental findings indicate that the new technique outperformed the previous in terms of accuracy, sensitivity, specificity, recall, F-score, false positive and negative rates, and error rate. At epoch 25, the optimized Resnet obtained high classification accuracy, reaching 98.98% for X-ray images and 98.78% for CT images.
Collapse
Affiliation(s)
- Mohamed H. Saad
- Radiation Engineering Department, National Center for Radiation Research and Technology (NCRRT), Egyptian Atomic Energy Authority, Cairo 11787, Egypt
| | - Sherief Hashima
- Engineering Department, Nuclear Research Center (NRC), Egyptian Atomic Energy Authority, Cairo 13759, Egypt
| | - Wessam Sayed
- Radiation Engineering Department, National Center for Radiation Research and Technology (NCRRT), Egyptian Atomic Energy Authority, Cairo 11787, Egypt
| | - Ehab H. El-Shazly
- Radiation Engineering Department, National Center for Radiation Research and Technology (NCRRT), Egyptian Atomic Energy Authority, Cairo 11787, Egypt
| | - Ahmed H. Madian
- Radiation Engineering Department, National Center for Radiation Research and Technology (NCRRT), Egyptian Atomic Energy Authority, Cairo 11787, Egypt
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
- Department of Electrical Engineering, Faculty of Engineering at Shoubra, Benha University, Cairo 11672, Egypt
| |
Collapse
|
28
|
Han X, Hu Z, Wang S, Zhang Y. A Survey on Deep Learning in COVID-19 Diagnosis. J Imaging 2022; 9:1. [PMID: 36662099 PMCID: PMC9866755 DOI: 10.3390/jimaging9010001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Revised: 12/05/2022] [Accepted: 12/16/2022] [Indexed: 12/31/2022] Open
Abstract
According to the World Health Organization statistics, as of 25 October 2022, there have been 625,248,843 confirmed cases of COVID-19, including 65,622,281 deaths worldwide. The spread and severity of COVID-19 are alarming. The economy and life of countries worldwide have been greatly affected. The rapid and accurate diagnosis of COVID-19 directly affects the spread of the virus and the degree of harm. Currently, the classification of chest X-ray or CT images based on artificial intelligence is an important method for COVID-19 diagnosis. It can assist doctors in making judgments and reduce the misdiagnosis rate. The convolutional neural network (CNN) is very popular in computer vision applications, such as applied to biological image segmentation, traffic sign recognition, face recognition, and other fields. It is one of the most widely used machine learning methods. This paper mainly introduces the latest deep learning methods and techniques for diagnosing COVID-19 using chest X-ray or CT images based on the convolutional neural network. It reviews the technology of CNN at various stages, such as rectified linear units, batch normalization, data augmentation, dropout, and so on. Several well-performing network architectures are explained in detail, such as AlexNet, ResNet, DenseNet, VGG, GoogleNet, etc. We analyzed and discussed the existing CNN automatic COVID-19 diagnosis systems from sensitivity, accuracy, precision, specificity, and F1 score. The systems use chest X-ray or CT images as datasets. Overall, CNN has essential value in COVID-19 diagnosis. All of them have good performance in the existing experiments. If expanding the datasets, adding GPU acceleration and data preprocessing techniques, and expanding the types of medical images, the performance of CNN will be further improved. This paper wishes to make contributions to future research.
Collapse
Affiliation(s)
- Xue Han
- School of Mathematics and Information Science, Nanjing Normal University of Special Education, Nanjing 210038, China
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK
| | - Zuojin Hu
- School of Mathematics and Information Science, Nanjing Normal University of Special Education, Nanjing 210038, China
| | - Shuihua Wang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK
| | - Yudong Zhang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK
| |
Collapse
|
29
|
New patch-based strategy for COVID-19 automatic identification using chest x-ray images. HEALTH AND TECHNOLOGY 2022; 12:1117-1132. [PMCID: PMC9647770 DOI: 10.1007/s12553-022-00704-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Accepted: 10/09/2022] [Indexed: 11/11/2022]
Abstract
Purpose The development of a robust model for automatic identification of COVID-19 based on chest x-rays has been a widely addressed topic over the last couple of years; however, the scarcity of good quality images sets, and their limited size, have proven to be an important obstacle to obtain reliable models. In fact, models proposed so far have suffered from over-fitting erroneous features instead of learning lung features, a phenomenon known as shortcut learning. In this research, a new image classification methodology is proposed that attempts to mitigate this problem. Methods To this end, annotation by expert radiologists of a set of images was performed. The lung region was then segmented and a new classification strategy based on a patch partitioning that improves the resolution of the convolution neural network is proposed. In addition, a set of native images, used as an external evaluation set, is released. Results The best results were obtained for the 6-patch splitting variant with 0.887 accuracy, 0.85 recall and 0.848 F1score on the external validation set. Conclusion The results show that the proposed new strategy maintains similar values between internal and external validation, which gives our model generalization power, making it available for use in hospital settings. Supplementary Information The online version contains supplementary material available at 10.1007/s12553-022-00704-4.
Collapse
|
30
|
Hamza A, Attique Khan M, Wang SH, Alhaisoni M, Alharbi M, Hussein HS, Alshazly H, Kim YJ, Cha J. COVID-19 classification using chest X-ray images based on fusion-assisted deep Bayesian optimization and Grad-CAM visualization. Front Public Health 2022; 10:1046296. [PMID: 36408000 PMCID: PMC9672507 DOI: 10.3389/fpubh.2022.1046296] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Accepted: 10/12/2022] [Indexed: 11/06/2022] Open
Abstract
The COVID-19 virus's rapid global spread has caused millions of illnesses and deaths. As a result, it has disastrous consequences for people's lives, public health, and the global economy. Clinical studies have revealed a link between the severity of COVID-19 cases and the amount of virus present in infected people's lungs. Imaging techniques such as computed tomography (CT) and chest x-rays can detect COVID-19 (CXR). Manual inspection of these images is a difficult process, so computerized techniques are widely used. Deep convolutional neural networks (DCNNs) are a type of machine learning that is frequently used in computer vision applications, particularly in medical imaging, to detect and classify infected regions. These techniques can assist medical personnel in the detection of patients with COVID-19. In this article, a Bayesian optimized DCNN and explainable AI-based framework is proposed for the classification of COVID-19 from the chest X-ray images. The proposed method starts with a multi-filter contrast enhancement technique that increases the visibility of the infected part. Two pre-trained deep models, namely, EfficientNet-B0 and MobileNet-V2, are fine-tuned according to the target classes and then trained by employing Bayesian optimization (BO). Through BO, hyperparameters have been selected instead of static initialization. Features are extracted from the trained model and fused using a slicing-based serial fusion approach. The fused features are classified using machine learning classifiers for the final classification. Moreover, visualization is performed using a Grad-CAM that highlights the infected part in the image. Three publically available COVID-19 datasets are used for the experimental process to obtain improved accuracies of 98.8, 97.9, and 99.4%, respectively.
Collapse
Affiliation(s)
- Ameer Hamza
- Department of Computer Science, HITEC University, Taxila, Pakistan
| | | | - Shui-Hua Wang
- Department of Mathematics, University of Leicester, Leicester, United Kingdom
| | - Majed Alhaisoni
- Computer Sciences Department, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, Riyadh, Saudi Arabia
| | - Meshal Alharbi
- Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al-Kharj, Saudi Arabia
| | - Hany S. Hussein
- Electrical Engineering Department, College of Engineering, King Khalid University, Abha, Saudi Arabia
- Electrical Engineering Department, Faculty of Engineering, Aswan University, Aswan, Egypt
| | - Hammam Alshazly
- Faculty of Computers and Information, South Valley University, Qena, Egypt
| | - Ye Jin Kim
- Department of Computer Science, Hanyang University, Seoul, South Korea
| | - Jaehyuk Cha
- Department of Computer Science, Hanyang University, Seoul, South Korea
| |
Collapse
|
31
|
Shibu George G, Raj Mishra P, Sinha P, Ranjan Prusty M. COVID-19 Detection on Chest X-Ray Images Using Homomorphic Transformation and VGG Inspired Deep Convolutional Neural Network. Biocybern Biomed Eng 2022; 43:1-16. [PMID: 36447948 PMCID: PMC9684127 DOI: 10.1016/j.bbe.2022.11.003] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Revised: 11/01/2022] [Accepted: 11/18/2022] [Indexed: 11/25/2022]
Abstract
COVID-19 had caused the whole world to come to a standstill. The current detection methods are time consuming as well as costly. Using Chest X-rays (CXRs) is a solution to this problem, however, manual examination of CXRs is a cumbersome and difficult process needing specialization in the domain. Most of existing methods used for this application involve the usage of pretrained models such as VGG19, ResNet, DenseNet, Xception, and EfficeintNet which were trained on RGB image datasets. X-rays are fundamentally single channel images, hence using RGB trained model is not appropriate since it increases the operations by involving three channels instead of one. A way of using pretrained model for grayscale images is by replicating the one channel image data to three channel which introduces redundancy and another way is by altering the input layer of pretrained model to take in one channel image data, which comprises the weights in the forward layers that were trained on three channel images which weakens the use of pre-trained weights in a transfer learning approach. A novel approach for identification of COVID-19 using CXRs, Contrast Limited Adaptive Histogram Equalization (CLAHE) along with Homomorphic Transformation Filter which is used to process the pixel data in images and extract features from the CXRs is suggested in this paper. These processed images are then provided as input to a VGG inspired deep Convolutional Neural Network (CNN) model which takes one channel image data as input (grayscale images) to categorize CXRs into three class labels, namely, No-Findings, COVID-19, and Pneumonia. Evaluation of the suggested model is done with the help of two publicly available datasets; one to obtain COVID-19 and No-Finding images and the other to obtain Pneumonia CXRs. The dataset comprises 6750 images in total; 2250 images for each class. Results obtained show that the model has achieved 96.56% for multi-class classification and 98.06% accuracy for binary classification using 5-fold stratified cross validation (CV) method. This result is competitive and up to the mark when compared with the performance shown by existing approaches for COVID-19 classification.
Collapse
Affiliation(s)
- Gerosh Shibu George
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, Tamil Nadu 600127, India
| | - Pratyush Raj Mishra
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, Tamil Nadu 600127, India
| | - Panav Sinha
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, Tamil Nadu 600127, India
| | - Manas Ranjan Prusty
- Centre for Cyber Physical Systems, School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, Tamil Nadu 600127, India
| |
Collapse
|
32
|
Addo D, Zhou S, Jackson JK, Nneji GU, Monday HN, Sarpong K, Patamia RA, Ekong F, Owusu-Agyei CA. EVAE-Net: An Ensemble Variational Autoencoder Deep Learning Network for COVID-19 Classification Based on Chest X-ray Images. Diagnostics (Basel) 2022; 12:2569. [PMID: 36359413 PMCID: PMC9689048 DOI: 10.3390/diagnostics12112569] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 10/13/2022] [Accepted: 10/18/2022] [Indexed: 09/08/2024] Open
Abstract
The COVID-19 pandemic has had a significant impact on many lives and the economies of many countries since late December 2019. Early detection with high accuracy is essential to help break the chain of transmission. Several radiological methodologies, such as CT scan and chest X-ray, have been employed in diagnosing and monitoring COVID-19 disease. Still, these methodologies are time-consuming and require trial and error. Machine learning techniques are currently being applied by several studies to deal with COVID-19. This study exploits the latent embeddings of variational autoencoders combined with ensemble techniques to propose three effective EVAE-Net models to detect COVID-19 disease. Two encoders are trained on chest X-ray images to generate two feature maps. The feature maps are concatenated and passed to either a combined or individual reparameterization phase to generate latent embeddings by sampling from a distribution. The latent embeddings are concatenated and passed to a classification head for classification. The COVID-19 Radiography Dataset from Kaggle is the source of chest X-ray images. The performances of the three models are evaluated. The proposed model shows satisfactory performance, with the best model achieving 99.19% and 98.66% accuracy on four classes and three classes, respectively.
Collapse
Affiliation(s)
- Daniel Addo
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 610056, China
| | - Shijie Zhou
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 610056, China
| | - Jehoiada Kofi Jackson
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 610056, China
| | - Grace Ugochi Nneji
- Department of Computing, Oxford Brookes College of Chengdu University of Technology, Chengdu 610059, China
| | - Happy Nkanta Monday
- Department of Computing, Oxford Brookes College of Chengdu University of Technology, Chengdu 610059, China
| | - Kwabena Sarpong
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 610056, China
| | - Rutherford Agbeshi Patamia
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 610056, China
| | - Favour Ekong
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 610056, China
| | | |
Collapse
|
33
|
Liu S, Cai T, Tang X, Zhang Y, Wang C. COVID-19 diagnosis via chest X-ray image classification based on multiscale class residual attention. Comput Biol Med 2022; 149:106065. [PMID: 36081225 PMCID: PMC9433340 DOI: 10.1016/j.compbiomed.2022.106065] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2022] [Revised: 08/07/2022] [Accepted: 08/27/2022] [Indexed: 12/11/2022]
Abstract
Aiming at detecting COVID-19 effectively, a multiscale class residual attention (MCRA) network is proposed via chest X-ray (CXR) image classification. First, to overcome the data shortage and improve the robustness of our network, a pixel-level image mixing of local regions was introduced to achieve data augmentation and reduce noise. Secondly, multi-scale fusion strategy was adopted to extract global contextual information at different scales and enhance semantic representation. Last but not least, class residual attention was employed to generate spatial attention for each class, which can avoid inter-class interference and enhance related features to further improve the COVID-19 detection. Experimental results show that our network achieves superior diagnostic performance on COVIDx dataset, and its accuracy, PPV, sensitivity, specificity and F1-score are 97.71%, 96.76%, 96.56%, 98.96% and 96.64%, respectively; moreover, the heat maps can endow our deep model with somewhat interpretability.
Collapse
Affiliation(s)
- Shangwang Liu
- College of Computer and Information Engineering, Henan Normal University, Xinxiang, 453007, China; Engineering Lab of Intelligence Business & Internet of Things, Henan Province, China.
| | - Tongbo Cai
- College of Computer and Information Engineering, Henan Normal University, Xinxiang, 453007, China; Engineering Lab of Intelligence Business & Internet of Things, Henan Province, China
| | - Xiufang Tang
- College of Computer and Information Engineering, Henan Normal University, Xinxiang, 453007, China; Engineering Lab of Intelligence Business & Internet of Things, Henan Province, China
| | - Yangyang Zhang
- College of Computer and Information Engineering, Henan Normal University, Xinxiang, 453007, China; Engineering Lab of Intelligence Business & Internet of Things, Henan Province, China
| | - Changgeng Wang
- College of Computer and Information Engineering, Henan Normal University, Xinxiang, 453007, China; Engineering Lab of Intelligence Business & Internet of Things, Henan Province, China
| |
Collapse
|
34
|
Segmentation-Based Classification Deep Learning Model Embedded with Explainable AI for COVID-19 Detection in Chest X-ray Scans. Diagnostics (Basel) 2022; 12:diagnostics12092132. [PMID: 36140533 PMCID: PMC9497601 DOI: 10.3390/diagnostics12092132] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Revised: 08/26/2022] [Accepted: 08/30/2022] [Indexed: 12/16/2022] Open
Abstract
Background and Motivation: COVID-19 has resulted in a massive loss of life during the last two years. The current imaging-based diagnostic methods for COVID-19 detection in multiclass pneumonia-type chest X-rays are not so successful in clinical practice due to high error rates. Our hypothesis states that if we can have a segmentation-based classification error rate <5%, typically adopted for 510 (K) regulatory purposes, the diagnostic system can be adapted in clinical settings. Method: This study proposes 16 types of segmentation-based classification deep learning-based systems for automatic, rapid, and precise detection of COVID-19. The two deep learning-based segmentation networks, namely UNet and UNet+, along with eight classification models, namely VGG16, VGG19, Xception, InceptionV3, Densenet201, NASNetMobile, Resnet50, and MobileNet, were applied to select the best-suited combination of networks. Using the cross-entropy loss function, the system performance was evaluated by Dice, Jaccard, area-under-the-curve (AUC), and receiver operating characteristics (ROC) and validated using Grad-CAM in explainable AI framework. Results: The best performing segmentation model was UNet, which exhibited the accuracy, loss, Dice, Jaccard, and AUC of 96.35%, 0.15%, 94.88%, 90.38%, and 0.99 (p-value <0.0001), respectively. The best performing segmentation-based classification model was UNet+Xception, which exhibited the accuracy, precision, recall, F1-score, and AUC of 97.45%, 97.46%, 97.45%, 97.43%, and 0.998 (p-value <0.0001), respectively. Our system outperformed existing methods for segmentation-based classification models. The mean improvement of the UNet+Xception system over all the remaining studies was 8.27%. Conclusion: The segmentation-based classification is a viable option as the hypothesis (error rate <5%) holds true and is thus adaptable in clinical practice.
Collapse
|
35
|
Schad F, Thronicke A. Real-World Evidence-Current Developments and Perspectives. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:10159. [PMID: 36011793 PMCID: PMC9408280 DOI: 10.3390/ijerph191610159] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 08/04/2022] [Accepted: 08/08/2022] [Indexed: 06/06/2023]
Abstract
Real-world evidence (RWE) is increasingly involved in the early benefit assessment of medicinal drugs. It is expected that RWE will help to speed up approval processes comparable to RWE developments in vaccine research during the COVID-19 pandemic. Definitions of RWE are diverse, marking the highly fluid status in this field. So far, RWE comprises information produced from data routinely collected on patient's health status and/or delivery of health care from various sources other than traditional clinical trials. These sources can include electronic health records, claims, patient-generated data including in home-use settings, data from mobile devices, as well as patient, product, and disease registries. The aim of the present update was to review current RWE developments and guidelines, mainly in the U.S. and Europe over the last decade. RWE has already been included in various approval procedures of regulatory authorities, reflecting its actual acceptance and growing importance in evaluating and accelerating new therapies. However, since RWE research is still in a transition process, and since a number of gaps in this field have been explored, more guidance and a consented definition are necessary to increase the implementation of real-world data.
Collapse
Affiliation(s)
- Friedemann Schad
- Interdisciplinary Oncology and Palliative Care, Hospital Gemeinschaftskrankenhaus Havelhöhe, 14089 Berlin, Germany
- Research Institute Havelhöhe, Hospital Havelhöhe, 14089 Berlin, Germany
| | - Anja Thronicke
- Research Institute Havelhöhe, Hospital Havelhöhe, 14089 Berlin, Germany
| |
Collapse
|
36
|
Taspinar YS, Dogan M, Cinar I, Kursun R, Ozkan IA, Koklu M. Computer vision classification of dry beans (Phaseolus vulgaris L.) based on deep transfer learning techniques. Eur Food Res Technol 2022. [DOI: 10.1007/s00217-022-04080-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
|
37
|
Laddha S, Mnasri S, Alghamdi M, Kumar V, Kaur M, Alrashidi M, Almuhaimeed A, Alshehri A, Alrowaily MA, Alkhazi I. COVID-19 Diagnosis and Classification Using Radiological Imaging and Deep Learning Techniques: A Comparative Study. Diagnostics (Basel) 2022; 12:1880. [PMID: 36010231 PMCID: PMC9406661 DOI: 10.3390/diagnostics12081880] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 07/23/2022] [Accepted: 07/25/2022] [Indexed: 11/16/2022] Open
Abstract
In December 2019, the novel coronavirus disease 2019 (COVID-19) appeared. Being highly contagious and with no effective treatment available, the only solution was to detect and isolate infected patients to further break the chain of infection. The shortage of test kits and other drawbacks of lab tests motivated researchers to build an automated diagnosis system using chest X-rays and CT scanning. The reviewed works in this study use AI coupled with the radiological image processing of raw chest X-rays and CT images to train various CNN models. They use transfer learning and numerous types of binary and multi-class classifications. The models are trained and validated on several datasets, the attributes of which are also discussed. The obtained results of various algorithms are later compared using performance metrics such as accuracy, F1 score, and AUC. Major challenges faced in this research domain are the limited availability of COVID image data and the high accuracy of the prediction of the severity of patients using deep learning compared to well-known methods of COVID-19 detection such as PCR tests. These automated detection systems using CXR technology are reliable enough to help radiologists in the initial screening and in the immediate diagnosis of infected individuals. They are preferred because of their low cost, availability, and fast results.
Collapse
Affiliation(s)
- Saloni Laddha
- Computer Science and Engineering Department, National Institute of Technology Hamirpur, Hamirpur 177005, Himachal Pradesh, India; (S.L.); (V.K.)
| | - Sami Mnasri
- Department of Computer Science, Applied College, University of Tabuk, Tabuk 47512, Saudi Arabia; (M.A.); (M.A.); (A.A.); (M.A.A.)
- Department of Computer Science, ISSAT of Gafsa, University of Gafsa, Gafsa 2112, Tunisia
| | - Mansoor Alghamdi
- Department of Computer Science, Applied College, University of Tabuk, Tabuk 47512, Saudi Arabia; (M.A.); (M.A.); (A.A.); (M.A.A.)
| | - Vijay Kumar
- Computer Science and Engineering Department, National Institute of Technology Hamirpur, Hamirpur 177005, Himachal Pradesh, India; (S.L.); (V.K.)
| | - Manjit Kaur
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju 61005, Korea;
| | - Malek Alrashidi
- Department of Computer Science, Applied College, University of Tabuk, Tabuk 47512, Saudi Arabia; (M.A.); (M.A.); (A.A.); (M.A.A.)
| | - Abdullah Almuhaimeed
- The National Centre for Genomics Technologies and Bioinformatics, King Abdulaziz City for Science and Technology, Riyadh 11442, Saudi Arabia
| | - Ali Alshehri
- Department of Computer Science, Applied College, University of Tabuk, Tabuk 47512, Saudi Arabia; (M.A.); (M.A.); (A.A.); (M.A.A.)
| | - Majed Abdullah Alrowaily
- Department of Computer Science, Applied College, University of Tabuk, Tabuk 47512, Saudi Arabia; (M.A.); (M.A.); (A.A.); (M.A.A.)
| | - Ibrahim Alkhazi
- College of Computers & Information Technology, University of Tabuk, Tabuk 47512, Saudi Arabia;
| |
Collapse
|
38
|
COVID-19 Diagnosis on Chest Radiographs with Enhanced Deep Neural Networks. Diagnostics (Basel) 2022; 12:diagnostics12081828. [PMID: 36010179 PMCID: PMC9406472 DOI: 10.3390/diagnostics12081828] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Revised: 07/12/2022] [Accepted: 07/20/2022] [Indexed: 11/17/2022] Open
Abstract
The COVID-19 pandemic has caused a devastating impact on the social activity, economy and politics worldwide. Techniques to diagnose COVID-19 cases by examining anomalies in chest X-ray images are urgently needed. Inspired by the success of deep learning in various tasks, this paper evaluates the performance of four deep neural networks in detecting COVID-19 patients from their chest radiographs. The deep neural networks studied include VGG16, MobileNet, ResNet50 and DenseNet201. Preliminary experiments show that all deep neural networks perform promisingly, while DenseNet201 outshines other models. Nevertheless, the sensitivity rates of the models are below expectations, which can be attributed to several factors: limited publicly available COVID-19 images, imbalanced sample size for the COVID-19 class and non-COVID-19 class, overfitting or underfitting of the deep neural networks and that the feature extraction of pre-trained models does not adapt well to the COVID-19 detection task. To address these factors, several enhancements are proposed, including data augmentation, adjusted class weights, early stopping and fine-tuning, to improve the performance. Empirical results on DenseNet201 with these enhancements demonstrate outstanding performance with an accuracy of 0.999%, precision of 0.9899%, sensitivity of 0.98%, specificity of 0.9997% and F1-score of 0.9849% on the COVID-Xray-5k dataset.
Collapse
|
39
|
COVID-19 Infection Segmentation and Severity Assessment Using a Self-Supervised Learning Approach. Diagnostics (Basel) 2022; 12:diagnostics12081805. [PMID: 35892518 PMCID: PMC9332359 DOI: 10.3390/diagnostics12081805] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 07/14/2022] [Accepted: 07/23/2022] [Indexed: 11/16/2022] Open
Abstract
Background: Automated segmentation of COVID-19 infection lesions and the assessment of the severity of the infections are critical in COVID-19 diagnosis and treatment. Based on a large amount of annotated data, deep learning approaches have been widely used in COVID-19 medical image analysis. However, the number of medical image samples is generally huge, and it is challenging to obtain enough annotated medical images for training a deep CNN model. Methods: To address these challenges, we propose a novel self-supervised deep learning method for automated segmentation of COVID-19 infection lesions and assessing the severity of infection, which can reduce the dependence on the annotation of the training samples. In the proposed method, first, many unlabeled data are used to pre-train an encoder-decoder model to learn rotation-dependent and rotation-invariant features. Then, a small amount of labeled data is used to fine-tune the pre-trained encoder-decoder for COVID-19 severity classification and lesion segmentation. Results: The proposed methods were tested on two public COVID-19 CT datasets and one self-built dataset. Accuracy, precision, recall, and F1-score were used to measure classification performance and Dice coefficient was used to measure segmentation performance. For COVID-19 severity classification, the proposed method outperformed other unsupervised feature learning methods by about 7.16% in accuracy. For segmentation, when the amount of labeled data was 100%, the Dice value of the proposed method was 5.58% higher than that of U-Net.; in 70% of the cases, our method was 8.02% higher than U-Net; in 30% of the cases, our method was 11.88% higher than U-Net; and in 10% of the cases, our method was 16.88% higher than U-Net. Conclusions: The proposed method provides better classification and segmentation performance under limited labeled data than other methods.
Collapse
|
40
|
|
41
|
A New Approach to COVID-19 Detection: An ANN Proposal Optimized through Tree-Seed Algorithm. Symmetry (Basel) 2022. [DOI: 10.3390/sym14071310] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
Abstract
Coronavirus disease (COVID-19), which affects the whole world, continues to spread. This disease has infected and killed millions of people worldwide. To limit the rate of spread of the disease, early detection should be provided and then the infected person should be quarantined. This paper proposes a Deep Learning-based application for early and accurate diagnosis of COVID-19. Compared to other studies, this application’s biggest difference and contribution are that it uses Tree Seed Algorithm (TSA)-optimized Artificial Neural Networks (ANN) to classify deep architectural features. Previous studies generally use fully connected layers for end-to-end learning classification. However, this study proves that even relatively simple AlexNet features can be classified more accurately with the TSA-ANN structure. The proposed hybrid model provides diagnosis with 98.54% accuracy for COVID-19 disease, which shows asymmetric distribution on Computed Tomography (CT) images. As a result, it is shown that using the proposed classification strategy, the features of end-to-end architectures can be classified more accurately.
Collapse
|
42
|
Heidari A, Jafari Navimipour N, Unal M, Toumaj S. Machine learning applications for COVID-19 outbreak management. Neural Comput Appl 2022; 34:15313-15348. [PMID: 35702664 PMCID: PMC9186489 DOI: 10.1007/s00521-022-07424-w] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Accepted: 05/10/2022] [Indexed: 12/29/2022]
Abstract
Recently, the COVID-19 epidemic has resulted in millions of deaths and has impacted practically every area of human life. Several machine learning (ML) approaches are employed in the medical field in many applications, including detecting and monitoring patients, notably in COVID-19 management. Different medical imaging systems, such as computed tomography (CT) and X-ray, offer ML an excellent platform for combating the pandemic. Because of this need, a significant quantity of study has been carried out; thus, in this work, we employed a systematic literature review (SLR) to cover all aspects of outcomes from related papers. Imaging methods, survival analysis, forecasting, economic and geographical issues, monitoring methods, medication development, and hybrid apps are the seven key uses of applications employed in the COVID-19 pandemic. Conventional neural networks (CNNs), long short-term memory networks (LSTM), recurrent neural networks (RNNs), generative adversarial networks (GANs), autoencoders, random forest, and other ML techniques are frequently used in such scenarios. Next, cutting-edge applications related to ML techniques for pandemic medical issues are discussed. Various problems and challenges linked with ML applications for this pandemic were reviewed. It is expected that additional research will be conducted in the upcoming to limit the spread and catastrophe management. According to the data, most papers are evaluated mainly on characteristics such as flexibility and accuracy, while other factors such as safety are overlooked. Also, Keras was the most often used library in the research studied, accounting for 24.4 percent of the time. Furthermore, medical imaging systems are employed for diagnostic reasons in 20.4 percent of applications.
Collapse
Affiliation(s)
- Arash Heidari
- Department of Computer Engineering, Tabriz Branch, Islamic Azad University, Tabriz, Iran
- Department of Computer Engineering, Shabestar Branch, Islamic Azad University, Shabestar, Iran
| | | | - Mehmet Unal
- Department of Computer Engineering, Nisantasi University, Istanbul, Turkey
| | - Shiva Toumaj
- Urmia University of Medical Sciences, Urmia, Iran
| |
Collapse
|
43
|
Aslan MF, Hasikin K, Yusefi A, Durdu A, Sabanci K, Azizan MM. COVID-19 Isolation Control Proposal via UAV and UGV for Crowded Indoor Environments: Assistive Robots in the Shopping Malls. Front Public Health 2022; 10:855994. [PMID: 35734764 PMCID: PMC9208298 DOI: 10.3389/fpubh.2022.855994] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2022] [Accepted: 05/10/2022] [Indexed: 11/13/2022] Open
Abstract
Artificial intelligence researchers conducted different studies to reduce the spread of COVID-19. Unlike other studies, this paper isn't for early infection diagnosis, but for preventing the transmission of COVID-19 in social environments. Among the studies on this is regarding social distancing, as this method is proven to prevent COVID-19 to be transmitted from one to another. In the study, Robot Operating System (ROS) simulates a shopping mall using Gazebo, and customers are monitored by Turtlebot and Unmanned Aerial Vehicle (UAV, DJI Tello). Through frames analysis captured by Turtlebot, a particular person is identified and followed at the shopping mall. Turtlebot is a wheeled robot that follows people without contact and is used as a shopping cart. Therefore, a customer doesn't touch the shopping cart that someone else comes into contact with, and also makes his/her shopping easier. The UAV detects people from above and determines the distance between people. In this way, a warning system can be created by detecting places where social distance is neglected. Histogram of Oriented-Gradients (HOG)-Support Vector Machine (SVM) is applied by Turtlebot to detect humans, and Kalman-Filter is used for human tracking. SegNet is performed for semantically detecting people and measuring distance via UAV. This paper proposes a new robotic study to prevent the infection and proved that this system is feasible.
Collapse
Affiliation(s)
- Muhammet Fatih Aslan
- Electrical and Electronics Engineering, Karamanoglu Mehmetbey University, Karaman, Turkey
| | - Khairunnisa Hasikin
- Department of Biomedical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
- Center of Image and Signal Processing (CISIP), Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
| | - Abdullah Yusefi
- Computer Engineering, Konya Technical University, Konya, Turkey
| | - Akif Durdu
- Electrical and Electronics Engineering, Konya Technical University, Konya, Turkey
| | - Kadir Sabanci
- Electrical and Electronics Engineering, Karamanoglu Mehmetbey University, Karaman, Turkey
| | - Muhammad Mokhzaini Azizan
- Department of Electrical and Electronic Engineering, Faculty of Engineering and Built Environment, Universiti Sains Islam Malaysia, Bandar Baru Nilai, Malaysia
| |
Collapse
|
44
|
A Novel Data Augmentation-Based Brain Tumor Detection Using Convolutional Neural Network. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12083773] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Brain tumor is a severe cancer and a life-threatening disease. Thus, early detection is crucial in the process of treatment. Recent progress in the field of deep learning has contributed enormously to the health industry medical diagnosis. Convolutional neural networks (CNNs) have been intensively used as a deep learning approach to detect brain tumors using MRI images. Due to the limited dataset, deep learning algorithms and CNNs should be improved to be more efficient. Thus, one of the most known techniques used to improve model performance is Data Augmentation. This paper presents a detailed review of various CNN architectures and highlights the characteristics of particular models such as ResNet, AlexNet, and VGG. After that, we provide an efficient method for detecting brain tumors using magnetic resonance imaging (MRI) datasets based on CNN and data augmentation. Evaluation metrics values of the proposed solution prove that it succeeded in being a contribution to previous studies in terms of both deep architectural design and high detection success.
Collapse
|
45
|
Nneji GU, Cai J, Monday HN, Hossin MA, Nahar S, Mgbejime GT, Deng J. Fine-Tuned Siamese Network with Modified Enhanced Super-Resolution GAN Plus Based on Low-Quality Chest X-ray Images for COVID-19 Identification. Diagnostics (Basel) 2022; 12:diagnostics12030717. [PMID: 35328271 PMCID: PMC8947640 DOI: 10.3390/diagnostics12030717] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Revised: 03/05/2022] [Accepted: 03/09/2022] [Indexed: 12/20/2022] Open
Abstract
Coronavirus disease has rapidly spread globally since early January of 2020. With millions of deaths, it is essential for an automated system to be utilized to aid in the clinical diagnosis and reduce time consumption for image analysis. This article presents a generative adversarial network (GAN)-based deep learning application for precisely regaining high-resolution (HR) CXR images from low-resolution (LR) CXR correspondents for COVID-19 identification. Respectively, using the building blocks of GAN, we introduce a modified enhanced super-resolution generative adversarial network plus (MESRGAN+) to implement a connected nonlinear mapping collected from noise-contaminated low-resolution input images to produce deblurred and denoised HR images. As opposed to the latest trends of network complexity and computational costs, we incorporate an enhanced VGG19 fine-tuned twin network with the wavelet pooling strategy in order to extract distinct features for COVID-19 identification. We demonstrate our proposed model on a publicly available dataset of 11,920 samples of chest X-ray images, with 2980 cases of COVID-19 CXR, healthy, viral and bacterial cases. Our proposed model performs efficiently both on the binary and four-class classification. The proposed method achieves accuracy of 98.8%, precision of 98.6%, sensitivity of 97.5%, specificity of 98.9%, an F1 score of 97.8% and ROC AUC of 98.8% for the multi-class task, while, for the binary class, the model achieves accuracy of 99.7%, precision of 98.9%, sensitivity of 98.7%, specificity of 99.3%, an F1 score of 98.2% and ROC AUC of 99.7%. Our method obtains state-of-the-art (SOTA) performance, according to the experimental results, which is helpful for COVID-19 screening. This new conceptual framework is proposed to play an influential role in addressing the issues facing COVID-19 examination and other diseases.
Collapse
Affiliation(s)
- Grace Ugochi Nneji
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.D.)
| | - Jingye Cai
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.D.)
- Correspondence:
| | - Happy Nkanta Monday
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (H.N.M.); (G.T.M.)
| | - Md Altab Hossin
- School of Management and Economics, University of Electronic Science and Technology of China, Chengdu 611731, China;
| | - Saifun Nahar
- Department of Information System and Technology, University of Missouri St. Louis, St. Louis, MO 63121, USA;
| | - Goodness Temofe Mgbejime
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (H.N.M.); (G.T.M.)
| | - Jianhua Deng
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.D.)
| |
Collapse
|